2024-04-18T14:29:06.311 INFO:root:teuthology version: 0.0.1.dev269+g9481b1d 2024-04-18T14:29:06.311 DEBUG:teuthology.run:Teuthology command: teuthology --name yuriw-2024-04-18_14:15:21-rados-wip-yuri2-testing-2024-04-17-0823-reef-distro-default-smithi --owner scheduled_yuriw@teuthology --description rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/classic msgr-failures/few objectstore/bluestore-stupid rados recovery-overrides/{default} supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} --archive /home/teuthworker/archive/yuriw-2024-04-18_14:15:21-rados-wip-yuri2-testing-2024-04-17-0823-reef-distro-default-smithi/7662103 --verbose -- /home/teuthworker/archive/yuriw-2024-04-18_14:15:21-rados-wip-yuri2-testing-2024-04-17-0823-reef-distro-default-smithi/7662103/orig.config.yaml 2024-04-18T14:29:06.356 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-18T14:29:06.446 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/yuriw-2024-04-18_14:15:21-rados-wip-yuri2-testing-2024-04-17-0823-reef-distro-default-smithi/7662103 branch: wip-yuri2-testing-2024-04-17-0823-reef description: rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/classic msgr-failures/few objectstore/bluestore-stupid rados recovery-overrides/{default} supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} email: yweinste@redhat.com first_in_suite: false job_id: '7662103' kernel: kdb: 1 sha1: distro ktype: distro last_in_suite: false machine_type: smithi name: yuriw-2024-04-18_14:15:21-rados-wip-yuri2-testing-2024-04-17-0823-reef-distro-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 10 os_type: ubuntu os_version: '22.04' overrides: admin_socket: branch: wip-yuri2-testing-2024-04-17-0823-reef ceph: conf: global: mon client directed command retry: 5 mon election default strategy: 1 ms inject socket failures: 5000 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon scrub interval: 300 osd: bdev async discard: true bdev enable discard: true bluestore allocator: stupid bluestore block size: 96636764160 bluestore fsck on mount: true bluestore zero block detection: true debug bluefs: 20 debug bluestore: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd blocked scrub grace period: 3600 osd debug reject backfill probability: 0.3 osd debug verify cached snaps: true osd debug verify missing on start: true osd failsafe full ratio: 0.95 osd heartbeat use min delay socket: true osd max backfills: 3 osd max markdown count: 1000 osd mclock override recovery settings: true osd mclock profile: high_recovery_ops osd objectstore: bluestore osd op queue: debug_random osd op queue cut off: debug_random osd scrub max interval: 120 osd scrub min interval: 60 osd shutdown pgref assert: true flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(OSD_SLOW_PING_TIME - but it is still running - objects unfound and apparently lost - slow request - \(POOL_APP_NOT_ENABLED\) - overall HEALTH_ - \(OSDMAP_FLAGS\) - \(OSD_ - \(PG_ - \(POOL_ - \(CACHE_POOL_ - \(SMALLER_PGP_NUM\) - \(OBJECT_ - \(SLOW_OPS\) - \(REQUEST_SLOW\) - \(TOO_FEW_PGS\) - slow request - timeout on replica - late reservation from sha1: 6a7528e4aecd36b18c4b41cee6012e9f92aa7ab0 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: 6a7528e4aecd36b18c4b41cee6012e9f92aa7ab0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-yuri2-testing-2024-04-17-0823-reef sha1: 6a7528e4aecd36b18c4b41cee6012e9f92aa7ab0 owner: scheduled_yuriw@teuthology priority: 75 repo: https://github.com/ceph/ceph-ci.git roles: - - mon.a - mgr.y - osd.0 - osd.4 - osd.8 - osd.12 - - mon.b - osd.1 - osd.5 - osd.9 - osd.13 - - mon.c - osd.2 - osd.6 - osd.10 - osd.14 - - mgr.x - osd.3 - osd.7 - osd.11 - osd.15 - client.0 seed: 400 sha1: 6a7528e4aecd36b18c4b41cee6012e9f92aa7ab0 sleep_before_teardown: 0 subset: 111/120000 suite: rados suite_branch: wip-yuri2-testing-2024-04-17-0823-reef suite_path: /home/teuthworker/src/github.com_ceph_ceph-c_6a7528e4aecd36b18c4b41cee6012e9f92aa7ab0/qa suite_relpath: qa suite_repo: https://github.com/ceph/ceph-ci.git suite_sha1: 6a7528e4aecd36b18c4b41cee6012e9f92aa7ab0 targets: smithi086.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBAFHCSwZshUquelH2RH/eCH33F5R6VkY1s0tq4s5Aa+0YH1B7AU3VMQzdyFi9F4Dz90hYyeChQSBS3ldjwcbTCs= smithi096.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBGVhDLNLAPvVASgjD/Bp9bUGYiKjehC+HF7GbNof5wULz61p/pN8O5Cbpb8rkR3A92bdsHKIQHq91QrPYUJGc7Y= smithi119.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJDd9poIuqlwXxtxjXWvgCa/Jf5tYYWDVJz6CW9q3mP/9rc7gFG9jSzjtZ/FJK6juz60g8iFwDOQlVJPyeKTU14= smithi134.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBG76MFDcDfRRvMjHdI3K9ehbCKKaXuNQyIUBBDrOB9AH63imyNkrwmbU7hKqmbj0qgPebvJ91SPqBhkoqlnaz1U= tasks: - install: null - ceph: conf: osd: debug monc: 20 - thrashosds: aggressive_pg_num_changes: false chance_pgnum_grow: 1 chance_pgnum_shrink: 1 chance_pgpnum_fix: 1 min_in: 8 timeout: 1200 - rados: clients: - client.0 ec_pool: true erasure_code_profile: c: 2 crush-failure-domain: osd k: 4 m: 3 name: shecprofile plugin: shec objects: 50 op_weights: append: 100 copy_from: 50 delete: 50 read: 100 rmattr: 25 rollback: 50 setattr: 25 snap_create: 50 snap_remove: 50 write: 0 ops: 400 write_append_excl: false teuthology: fragments_dropped: [] meta: {} postmerge: [] teuthology_branch: main teuthology_sha1: 9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17 timestamp: 2024-04-18_14:15:21 tube: smithi user: yuriw verbose: true worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885 2024-04-18T14:29:06.446 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_ceph_ceph-c_6a7528e4aecd36b18c4b41cee6012e9f92aa7ab0/qa; will attempt to use it 2024-04-18T14:29:06.447 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_ceph_ceph-c_6a7528e4aecd36b18c4b41cee6012e9f92aa7ab0/qa/tasks 2024-04-18T14:29:06.447 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-04-18T14:29:06.448 INFO:teuthology.task.internal:Checking packages... 2024-04-18T14:29:06.473 INFO:teuthology.task.internal:Checking packages for os_type 'ubuntu', flavor 'default' and ceph hash '6a7528e4aecd36b18c4b41cee6012e9f92aa7ab0' 2024-04-18T14:29:06.473 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-04-18T14:29:06.473 INFO:teuthology.packaging:ref: None 2024-04-18T14:29:06.473 INFO:teuthology.packaging:tag: None 2024-04-18T14:29:06.473 INFO:teuthology.packaging:branch: wip-yuri2-testing-2024-04-17-0823-reef 2024-04-18T14:29:06.473 INFO:teuthology.packaging:sha1: 6a7528e4aecd36b18c4b41cee6012e9f92aa7ab0 2024-04-18T14:29:06.473 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&ref=wip-yuri2-testing-2024-04-17-0823-reef 2024-04-18T14:29:06.613 INFO:teuthology.task.internal:Found packages for ceph version 18.2.2-1240-g6a7528e4-1jammy 2024-04-18T14:29:06.615 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-04-18T14:29:06.629 INFO:teuthology.task.internal:no buildpackages task found 2024-04-18T14:29:06.629 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-04-18T14:29:06.725 INFO:teuthology.task.internal:Saving configuration 2024-04-18T14:29:06.743 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-04-18T14:29:06.756 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-04-18T14:29:06.781 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi086.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2024-04-18_14:15:21-rados-wip-yuri2-testing-2024-04-17-0823-reef-distro-default-smithi/7662103', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-18 14:17:55.726957', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIH5Q6dFWHo8e0+E3R+RvcQV6stWxTcZmk92W+aaeY1rR'} 2024-04-18T14:29:06.804 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi096.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2024-04-18_14:15:21-rados-wip-yuri2-testing-2024-04-17-0823-reef-distro-default-smithi/7662103', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-18 14:17:55.725760', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIKTK3wf8nrXE4BNMnzy9fhxMPljTgBywy8P55ZKiJGEn'} 2024-04-18T14:29:06.824 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi119.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2024-04-18_14:15:21-rados-wip-yuri2-testing-2024-04-17-0823-reef-distro-default-smithi/7662103', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-18 14:17:55.728020', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAINyRhb6X9wtQsiuv8S7TKhT871FLxPSBC9gA8CujqELg'} 2024-04-18T14:29:06.848 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi134.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2024-04-18_14:15:21-rados-wip-yuri2-testing-2024-04-17-0823-reef-distro-default-smithi/7662103', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-18 14:17:55.724331', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIPdEu0UMBG+Oe5YUCaBjWdE60OBig8JpZsK8H7ZwGH/h'} 2024-04-18T14:29:06.848 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-04-18T14:29:06.859 INFO:teuthology.task.internal:roles: ubuntu@smithi086.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'osd.0', 'osd.4', 'osd.8', 'osd.12'] 2024-04-18T14:29:06.859 INFO:teuthology.task.internal:roles: ubuntu@smithi096.front.sepia.ceph.com - ['mon.b', 'osd.1', 'osd.5', 'osd.9', 'osd.13'] 2024-04-18T14:29:06.859 INFO:teuthology.task.internal:roles: ubuntu@smithi119.front.sepia.ceph.com - ['mon.c', 'osd.2', 'osd.6', 'osd.10', 'osd.14'] 2024-04-18T14:29:06.859 INFO:teuthology.task.internal:roles: ubuntu@smithi134.front.sepia.ceph.com - ['mgr.x', 'osd.3', 'osd.7', 'osd.11', 'osd.15', 'client.0'] 2024-04-18T14:29:06.860 INFO:teuthology.run_tasks:Running task console_log... 2024-04-18T14:29:07.008 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fa6b7a983a0>, signals=[15]) 2024-04-18T14:29:07.009 INFO:teuthology.run_tasks:Running task internal.connect... 2024-04-18T14:29:07.019 INFO:teuthology.task.internal:Opening connections... 2024-04-18T14:29:07.019 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi086.front.sepia.ceph.com 2024-04-18T14:29:07.021 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi086.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T14:29:07.114 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi096.front.sepia.ceph.com 2024-04-18T14:29:07.115 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi096.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T14:29:07.195 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi119.front.sepia.ceph.com 2024-04-18T14:29:07.196 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T14:29:07.272 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi134.front.sepia.ceph.com 2024-04-18T14:29:07.273 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi134.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T14:29:07.357 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-04-18T14:29:07.369 DEBUG:teuthology.orchestra.run.smithi086:> uname -m 2024-04-18T14:29:07.375 INFO:teuthology.orchestra.run.smithi086.stdout:x86_64 2024-04-18T14:29:07.375 DEBUG:teuthology.orchestra.run.smithi086:> cat /etc/os-release 2024-04-18T14:29:07.423 INFO:teuthology.orchestra.run.smithi086.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-04-18T14:29:07.423 INFO:teuthology.orchestra.run.smithi086.stdout:NAME="Ubuntu" 2024-04-18T14:29:07.423 INFO:teuthology.orchestra.run.smithi086.stdout:VERSION_ID="22.04" 2024-04-18T14:29:07.423 INFO:teuthology.orchestra.run.smithi086.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-04-18T14:29:07.423 INFO:teuthology.orchestra.run.smithi086.stdout:VERSION_CODENAME=jammy 2024-04-18T14:29:07.423 INFO:teuthology.orchestra.run.smithi086.stdout:ID=ubuntu 2024-04-18T14:29:07.423 INFO:teuthology.orchestra.run.smithi086.stdout:ID_LIKE=debian 2024-04-18T14:29:07.423 INFO:teuthology.orchestra.run.smithi086.stdout:HOME_URL="https://www.ubuntu.com/" 2024-04-18T14:29:07.423 INFO:teuthology.orchestra.run.smithi086.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-04-18T14:29:07.423 INFO:teuthology.orchestra.run.smithi086.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-04-18T14:29:07.423 INFO:teuthology.orchestra.run.smithi086.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-04-18T14:29:07.424 INFO:teuthology.orchestra.run.smithi086.stdout:UBUNTU_CODENAME=jammy 2024-04-18T14:29:07.424 INFO:teuthology.lock.ops:Updating smithi086.front.sepia.ceph.com on lock server 2024-04-18T14:29:07.449 DEBUG:teuthology.orchestra.run.smithi096:> uname -m 2024-04-18T14:29:07.455 INFO:teuthology.orchestra.run.smithi096.stdout:x86_64 2024-04-18T14:29:07.455 DEBUG:teuthology.orchestra.run.smithi096:> cat /etc/os-release 2024-04-18T14:29:07.502 INFO:teuthology.orchestra.run.smithi096.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-04-18T14:29:07.502 INFO:teuthology.orchestra.run.smithi096.stdout:NAME="Ubuntu" 2024-04-18T14:29:07.502 INFO:teuthology.orchestra.run.smithi096.stdout:VERSION_ID="22.04" 2024-04-18T14:29:07.502 INFO:teuthology.orchestra.run.smithi096.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-04-18T14:29:07.502 INFO:teuthology.orchestra.run.smithi096.stdout:VERSION_CODENAME=jammy 2024-04-18T14:29:07.502 INFO:teuthology.orchestra.run.smithi096.stdout:ID=ubuntu 2024-04-18T14:29:07.502 INFO:teuthology.orchestra.run.smithi096.stdout:ID_LIKE=debian 2024-04-18T14:29:07.503 INFO:teuthology.orchestra.run.smithi096.stdout:HOME_URL="https://www.ubuntu.com/" 2024-04-18T14:29:07.503 INFO:teuthology.orchestra.run.smithi096.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-04-18T14:29:07.503 INFO:teuthology.orchestra.run.smithi096.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-04-18T14:29:07.503 INFO:teuthology.orchestra.run.smithi096.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-04-18T14:29:07.503 INFO:teuthology.orchestra.run.smithi096.stdout:UBUNTU_CODENAME=jammy 2024-04-18T14:29:07.503 INFO:teuthology.lock.ops:Updating smithi096.front.sepia.ceph.com on lock server 2024-04-18T14:29:07.524 DEBUG:teuthology.orchestra.run.smithi119:> uname -m 2024-04-18T14:29:07.529 INFO:teuthology.orchestra.run.smithi119.stdout:x86_64 2024-04-18T14:29:07.530 DEBUG:teuthology.orchestra.run.smithi119:> cat /etc/os-release 2024-04-18T14:29:07.576 INFO:teuthology.orchestra.run.smithi119.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-04-18T14:29:07.576 INFO:teuthology.orchestra.run.smithi119.stdout:NAME="Ubuntu" 2024-04-18T14:29:07.576 INFO:teuthology.orchestra.run.smithi119.stdout:VERSION_ID="22.04" 2024-04-18T14:29:07.576 INFO:teuthology.orchestra.run.smithi119.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-04-18T14:29:07.576 INFO:teuthology.orchestra.run.smithi119.stdout:VERSION_CODENAME=jammy 2024-04-18T14:29:07.576 INFO:teuthology.orchestra.run.smithi119.stdout:ID=ubuntu 2024-04-18T14:29:07.576 INFO:teuthology.orchestra.run.smithi119.stdout:ID_LIKE=debian 2024-04-18T14:29:07.576 INFO:teuthology.orchestra.run.smithi119.stdout:HOME_URL="https://www.ubuntu.com/" 2024-04-18T14:29:07.577 INFO:teuthology.orchestra.run.smithi119.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-04-18T14:29:07.577 INFO:teuthology.orchestra.run.smithi119.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-04-18T14:29:07.577 INFO:teuthology.orchestra.run.smithi119.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-04-18T14:29:07.577 INFO:teuthology.orchestra.run.smithi119.stdout:UBUNTU_CODENAME=jammy 2024-04-18T14:29:07.577 INFO:teuthology.lock.ops:Updating smithi119.front.sepia.ceph.com on lock server 2024-04-18T14:29:07.599 DEBUG:teuthology.orchestra.run.smithi134:> uname -m 2024-04-18T14:29:07.605 INFO:teuthology.orchestra.run.smithi134.stdout:x86_64 2024-04-18T14:29:07.605 DEBUG:teuthology.orchestra.run.smithi134:> cat /etc/os-release 2024-04-18T14:29:07.654 INFO:teuthology.orchestra.run.smithi134.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-04-18T14:29:07.654 INFO:teuthology.orchestra.run.smithi134.stdout:NAME="Ubuntu" 2024-04-18T14:29:07.654 INFO:teuthology.orchestra.run.smithi134.stdout:VERSION_ID="22.04" 2024-04-18T14:29:07.654 INFO:teuthology.orchestra.run.smithi134.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-04-18T14:29:07.654 INFO:teuthology.orchestra.run.smithi134.stdout:VERSION_CODENAME=jammy 2024-04-18T14:29:07.654 INFO:teuthology.orchestra.run.smithi134.stdout:ID=ubuntu 2024-04-18T14:29:07.654 INFO:teuthology.orchestra.run.smithi134.stdout:ID_LIKE=debian 2024-04-18T14:29:07.654 INFO:teuthology.orchestra.run.smithi134.stdout:HOME_URL="https://www.ubuntu.com/" 2024-04-18T14:29:07.655 INFO:teuthology.orchestra.run.smithi134.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-04-18T14:29:07.655 INFO:teuthology.orchestra.run.smithi134.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-04-18T14:29:07.655 INFO:teuthology.orchestra.run.smithi134.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-04-18T14:29:07.655 INFO:teuthology.orchestra.run.smithi134.stdout:UBUNTU_CODENAME=jammy 2024-04-18T14:29:07.655 INFO:teuthology.lock.ops:Updating smithi134.front.sepia.ceph.com on lock server 2024-04-18T14:29:07.673 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-04-18T14:29:07.688 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-04-18T14:29:07.700 INFO:teuthology.task.internal:Checking for old test directory... 2024-04-18T14:29:07.700 DEBUG:teuthology.orchestra.run.smithi086:> test '!' -e /home/ubuntu/cephtest 2024-04-18T14:29:07.703 DEBUG:teuthology.orchestra.run.smithi096:> test '!' -e /home/ubuntu/cephtest 2024-04-18T14:29:07.706 DEBUG:teuthology.orchestra.run.smithi119:> test '!' -e /home/ubuntu/cephtest 2024-04-18T14:29:07.712 DEBUG:teuthology.orchestra.run.smithi134:> test '!' -e /home/ubuntu/cephtest 2024-04-18T14:29:07.717 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-04-18T14:29:07.725 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-04-18T14:29:07.725 DEBUG:teuthology.orchestra.run.smithi086:> test -z $(ls -A /var/lib/ceph) 2024-04-18T14:29:07.748 DEBUG:teuthology.orchestra.run.smithi096:> test -z $(ls -A /var/lib/ceph) 2024-04-18T14:29:07.758 DEBUG:teuthology.orchestra.run.smithi119:> test -z $(ls -A /var/lib/ceph) 2024-04-18T14:29:07.761 DEBUG:teuthology.orchestra.run.smithi134:> test -z $(ls -A /var/lib/ceph) 2024-04-18T14:29:07.777 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-04-18T14:29:07.886 INFO:teuthology.run_tasks:Running task kernel... 2024-04-18T14:29:07.903 INFO:teuthology.task.kernel:normalize config orig: {'kdb': 1, 'sha1': 'distro'} 2024-04-18T14:29:07.903 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': 1, 'sha1': 'distro'}, 'mon.b': {'kdb': 1, 'sha1': 'distro'}, 'mon.c': {'kdb': 1, 'sha1': 'distro'}, 'mgr.x': {'kdb': 1, 'sha1': 'distro'}}, timeout 300 2024-04-18T14:29:07.903 DEBUG:teuthology.orchestra.run.smithi086:> test -f /run/.containerenv -o -f /.dockerenv 2024-04-18T14:29:07.904 DEBUG:teuthology.orchestra.run.smithi096:> test -f /run/.containerenv -o -f /.dockerenv 2024-04-18T14:29:07.905 DEBUG:teuthology.orchestra.run.smithi119:> test -f /run/.containerenv -o -f /.dockerenv 2024-04-18T14:29:07.905 DEBUG:teuthology.orchestra.run.smithi134:> test -f /run/.containerenv -o -f /.dockerenv 2024-04-18T14:29:07.917 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-18T14:29:07.917 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-18T14:29:07.917 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-18T14:29:07.917 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-18T14:29:07.919 DEBUG:teuthology.orchestra.run.smithi119:> uname -r 2024-04-18T14:29:07.919 DEBUG:teuthology.orchestra.run.smithi134:> uname -r 2024-04-18T14:29:07.920 DEBUG:teuthology.orchestra.run.smithi086:> uname -r 2024-04-18T14:29:07.920 DEBUG:teuthology.orchestra.run.smithi096:> uname -r 2024-04-18T14:29:07.968 INFO:teuthology.orchestra.run.smithi096.stdout:5.15.0-56-generic 2024-04-18T14:29:07.968 INFO:teuthology.orchestra.run.smithi086.stdout:5.15.0-56-generic 2024-04-18T14:29:07.969 INFO:teuthology.orchestra.run.smithi134.stdout:5.15.0-56-generic 2024-04-18T14:29:07.969 INFO:teuthology.task.kernel:Running kernel on smithi096: 5.15.0-56-generic 2024-04-18T14:29:07.969 DEBUG:teuthology.orchestra.run.smithi096:> sudo apt-get clean 2024-04-18T14:29:07.970 INFO:teuthology.task.kernel:Running kernel on smithi086: 5.15.0-56-generic 2024-04-18T14:29:07.970 DEBUG:teuthology.orchestra.run.smithi086:> sudo apt-get clean 2024-04-18T14:29:07.971 INFO:teuthology.task.kernel:Running kernel on smithi134: 5.15.0-56-generic 2024-04-18T14:29:07.971 DEBUG:teuthology.orchestra.run.smithi134:> sudo apt-get clean 2024-04-18T14:29:07.973 INFO:teuthology.orchestra.run.smithi119.stdout:5.15.0-56-generic 2024-04-18T14:29:07.973 INFO:teuthology.task.kernel:Running kernel on smithi119: 5.15.0-56-generic 2024-04-18T14:29:07.973 DEBUG:teuthology.orchestra.run.smithi119:> sudo apt-get clean 2024-04-18T14:29:08.075 DEBUG:teuthology.orchestra.run.smithi134:> sudo apt-get update 2024-04-18T14:29:08.082 DEBUG:teuthology.orchestra.run.smithi086:> sudo apt-get update 2024-04-18T14:29:08.105 DEBUG:teuthology.orchestra.run.smithi096:> sudo apt-get update 2024-04-18T14:29:08.125 DEBUG:teuthology.orchestra.run.smithi119:> sudo apt-get update 2024-04-18T14:29:08.252 INFO:teuthology.orchestra.run.smithi134.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-04-18T14:29:08.253 INFO:teuthology.orchestra.run.smithi134.stdout:Get:2 http://security.ubuntu.com/ubuntu jammy-security InRelease [110 kB] 2024-04-18T14:29:08.267 INFO:teuthology.orchestra.run.smithi134.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease [119 kB] 2024-04-18T14:29:08.285 INFO:teuthology.orchestra.run.smithi086.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-04-18T14:29:08.286 INFO:teuthology.orchestra.run.smithi086.stdout:Get:2 http://security.ubuntu.com/ubuntu jammy-security InRelease [110 kB] 2024-04-18T14:29:08.293 INFO:teuthology.orchestra.run.smithi086.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease [119 kB] 2024-04-18T14:29:08.294 INFO:teuthology.orchestra.run.smithi096.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-04-18T14:29:08.326 INFO:teuthology.orchestra.run.smithi119.stdout:Get:1 http://security.ubuntu.com/ubuntu jammy-security InRelease [110 kB] 2024-04-18T14:29:08.328 INFO:teuthology.orchestra.run.smithi096.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates InRelease [119 kB] 2024-04-18T14:29:08.360 INFO:teuthology.orchestra.run.smithi096.stdout:Get:3 http://security.ubuntu.com/ubuntu jammy-security InRelease [110 kB] 2024-04-18T14:29:08.407 INFO:teuthology.orchestra.run.smithi119.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-04-18T14:29:08.416 INFO:teuthology.orchestra.run.smithi134.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease [109 kB] 2024-04-18T14:29:08.432 INFO:teuthology.orchestra.run.smithi086.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease [109 kB] 2024-04-18T14:29:08.439 INFO:teuthology.orchestra.run.smithi096.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease [109 kB] 2024-04-18T14:29:08.468 INFO:teuthology.orchestra.run.smithi119.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease [119 kB] 2024-04-18T14:29:08.482 INFO:teuthology.orchestra.run.smithi134.stdout:Get:5 http://security.ubuntu.com/ubuntu jammy-security/main amd64 Packages [1,346 kB] 2024-04-18T14:29:08.520 INFO:teuthology.orchestra.run.smithi086.stdout:Get:5 http://security.ubuntu.com/ubuntu jammy-security/main i386 Packages [445 kB] 2024-04-18T14:29:08.560 INFO:teuthology.orchestra.run.smithi134.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 Packages [1,562 kB] 2024-04-18T14:29:08.571 INFO:teuthology.orchestra.run.smithi096.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main i386 Packages [611 kB] 2024-04-18T14:29:08.615 INFO:teuthology.orchestra.run.smithi086.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main i386 Packages [611 kB] 2024-04-18T14:29:08.678 INFO:teuthology.orchestra.run.smithi119.stdout:Get:4 http://security.ubuntu.com/ubuntu jammy-security/main i386 Packages [445 kB] 2024-04-18T14:29:08.695 INFO:teuthology.orchestra.run.smithi086.stdout:Get:7 http://security.ubuntu.com/ubuntu jammy-security/main amd64 Packages [1,346 kB] 2024-04-18T14:29:08.700 INFO:teuthology.orchestra.run.smithi134.stdout:Get:7 http://security.ubuntu.com/ubuntu jammy-security/main i386 Packages [445 kB] 2024-04-18T14:29:08.720 INFO:teuthology.orchestra.run.smithi134.stdout:Get:8 http://security.ubuntu.com/ubuntu jammy-security/main Translation-en [237 kB] 2024-04-18T14:29:08.730 INFO:teuthology.orchestra.run.smithi134.stdout:Get:9 http://security.ubuntu.com/ubuntu jammy-security/main amd64 c-n-f Metadata [11.4 kB] 2024-04-18T14:29:08.731 INFO:teuthology.orchestra.run.smithi134.stdout:Get:10 http://security.ubuntu.com/ubuntu jammy-security/restricted i386 Packages [34.1 kB] 2024-04-18T14:29:08.733 INFO:teuthology.orchestra.run.smithi134.stdout:Get:11 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 Packages [1,670 kB] 2024-04-18T14:29:08.745 INFO:teuthology.orchestra.run.smithi096.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 Packages [1,562 kB] 2024-04-18T14:29:08.783 INFO:teuthology.orchestra.run.smithi096.stdout:Get:7 http://security.ubuntu.com/ubuntu jammy-security/main i386 Packages [445 kB] 2024-04-18T14:29:08.792 INFO:teuthology.orchestra.run.smithi086.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 Packages [1,562 kB] 2024-04-18T14:29:08.835 INFO:teuthology.orchestra.run.smithi119.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-backports InRelease [109 kB] 2024-04-18T14:29:08.852 INFO:teuthology.orchestra.run.smithi134.stdout:Get:12 http://security.ubuntu.com/ubuntu jammy-security/restricted Translation-en [280 kB] 2024-04-18T14:29:08.880 INFO:teuthology.orchestra.run.smithi134.stdout:Get:13 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 c-n-f Metadata [520 B] 2024-04-18T14:29:08.880 INFO:teuthology.orchestra.run.smithi134.stdout:Get:14 http://security.ubuntu.com/ubuntu jammy-security/universe i386 Packages [600 kB] 2024-04-18T14:29:08.901 INFO:teuthology.orchestra.run.smithi134.stdout:Get:15 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 Packages [852 kB] 2024-04-18T14:29:08.905 INFO:teuthology.orchestra.run.smithi086.stdout:Get:9 http://security.ubuntu.com/ubuntu jammy-security/main Translation-en [237 kB] 2024-04-18T14:29:08.908 INFO:teuthology.orchestra.run.smithi134.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/main i386 Packages [611 kB] 2024-04-18T14:29:08.910 INFO:teuthology.orchestra.run.smithi086.stdout:Get:10 http://security.ubuntu.com/ubuntu jammy-security/main amd64 c-n-f Metadata [11.4 kB] 2024-04-18T14:29:08.911 INFO:teuthology.orchestra.run.smithi086.stdout:Get:11 http://security.ubuntu.com/ubuntu jammy-security/restricted i386 Packages [34.1 kB] 2024-04-18T14:29:08.912 INFO:teuthology.orchestra.run.smithi086.stdout:Get:12 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 Packages [1,670 kB] 2024-04-18T14:29:08.935 INFO:teuthology.orchestra.run.smithi096.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main Translation-en [298 kB] 2024-04-18T14:29:08.939 INFO:teuthology.orchestra.run.smithi119.stdout:Get:6 http://security.ubuntu.com/ubuntu jammy-security/main amd64 Packages [1,346 kB] 2024-04-18T14:29:08.940 INFO:teuthology.orchestra.run.smithi134.stdout:Get:17 http://security.ubuntu.com/ubuntu jammy-security/universe Translation-en [163 kB] 2024-04-18T14:29:08.942 INFO:teuthology.orchestra.run.smithi134.stdout:Get:18 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 c-n-f Metadata [16.8 kB] 2024-04-18T14:29:08.943 INFO:teuthology.orchestra.run.smithi134.stdout:Get:19 http://security.ubuntu.com/ubuntu jammy-security/multiverse i386 Packages [1,356 B] 2024-04-18T14:29:08.944 INFO:teuthology.orchestra.run.smithi134.stdout:Get:20 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 Packages [37.2 kB] 2024-04-18T14:29:08.944 INFO:teuthology.orchestra.run.smithi134.stdout:Get:21 http://security.ubuntu.com/ubuntu jammy-security/multiverse Translation-en [7,588 B] 2024-04-18T14:29:08.945 INFO:teuthology.orchestra.run.smithi134.stdout:Get:22 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 c-n-f Metadata [260 B] 2024-04-18T14:29:08.952 INFO:teuthology.orchestra.run.smithi134.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-updates/main Translation-en [298 kB] 2024-04-18T14:29:08.954 INFO:teuthology.orchestra.run.smithi086.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy-updates/main Translation-en [298 kB] 2024-04-18T14:29:08.961 INFO:teuthology.orchestra.run.smithi096.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 c-n-f Metadata [16.1 kB] 2024-04-18T14:29:08.962 INFO:teuthology.orchestra.run.smithi096.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 Packages [1,754 kB] 2024-04-18T14:29:08.976 INFO:teuthology.orchestra.run.smithi134.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 c-n-f Metadata [16.1 kB] 2024-04-18T14:29:08.977 INFO:teuthology.orchestra.run.smithi134.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/restricted i386 Packages [38.1 kB] 2024-04-18T14:29:08.977 INFO:teuthology.orchestra.run.smithi086.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 c-n-f Metadata [16.1 kB] 2024-04-18T14:29:08.978 INFO:teuthology.orchestra.run.smithi086.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy-updates/restricted i386 Packages [38.1 kB] 2024-04-18T14:29:08.978 INFO:teuthology.orchestra.run.smithi119.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main i386 Packages [611 kB] 2024-04-18T14:29:08.979 INFO:teuthology.orchestra.run.smithi134.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 Packages [1,754 kB] 2024-04-18T14:29:08.979 INFO:teuthology.orchestra.run.smithi086.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 Packages [1,754 kB] 2024-04-18T14:29:08.998 INFO:teuthology.orchestra.run.smithi086.stdout:Get:17 http://security.ubuntu.com/ubuntu jammy-security/restricted Translation-en [280 kB] 2024-04-18T14:29:09.007 INFO:teuthology.orchestra.run.smithi086.stdout:Get:18 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 c-n-f Metadata [520 B] 2024-04-18T14:29:09.008 INFO:teuthology.orchestra.run.smithi086.stdout:Get:19 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 Packages [852 kB] 2024-04-18T14:29:09.031 INFO:teuthology.orchestra.run.smithi086.stdout:Get:20 http://security.ubuntu.com/ubuntu jammy-security/universe i386 Packages [600 kB] 2024-04-18T14:29:09.050 INFO:teuthology.orchestra.run.smithi086.stdout:Get:21 http://security.ubuntu.com/ubuntu jammy-security/universe Translation-en [163 kB] 2024-04-18T14:29:09.053 INFO:teuthology.orchestra.run.smithi086.stdout:Get:22 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 c-n-f Metadata [16.8 kB] 2024-04-18T14:29:09.054 INFO:teuthology.orchestra.run.smithi086.stdout:Get:23 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 Packages [37.2 kB] 2024-04-18T14:29:09.055 INFO:teuthology.orchestra.run.smithi086.stdout:Get:24 http://security.ubuntu.com/ubuntu jammy-security/multiverse i386 Packages [1,356 B] 2024-04-18T14:29:09.055 INFO:teuthology.orchestra.run.smithi086.stdout:Get:25 http://security.ubuntu.com/ubuntu jammy-security/multiverse Translation-en [7,588 B] 2024-04-18T14:29:09.056 INFO:teuthology.orchestra.run.smithi086.stdout:Get:26 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 c-n-f Metadata [260 B] 2024-04-18T14:29:09.060 INFO:teuthology.orchestra.run.smithi086.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy-updates/restricted Translation-en [295 kB] 2024-04-18T14:29:09.067 INFO:teuthology.orchestra.run.smithi096.stdout:Get:11 http://security.ubuntu.com/ubuntu jammy-security/main amd64 Packages [1,346 kB] 2024-04-18T14:29:09.074 INFO:teuthology.orchestra.run.smithi134.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy-updates/restricted Translation-en [295 kB] 2024-04-18T14:29:09.075 INFO:teuthology.orchestra.run.smithi086.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 c-n-f Metadata [520 B] 2024-04-18T14:29:09.075 INFO:teuthology.orchestra.run.smithi086.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 Packages [1,074 kB] 2024-04-18T14:29:09.086 INFO:teuthology.orchestra.run.smithi134.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 c-n-f Metadata [520 B] 2024-04-18T14:29:09.087 INFO:teuthology.orchestra.run.smithi134.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 Packages [1,074 kB] 2024-04-18T14:29:09.100 INFO:teuthology.orchestra.run.smithi119.stdout:Get:8 http://security.ubuntu.com/ubuntu jammy-security/main Translation-en [237 kB] 2024-04-18T14:29:09.178 INFO:teuthology.orchestra.run.smithi119.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 Packages [1,562 kB] 2024-04-18T14:29:09.184 INFO:teuthology.orchestra.run.smithi086.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy-updates/universe i386 Packages [699 kB] 2024-04-18T14:29:09.185 INFO:teuthology.orchestra.run.smithi119.stdout:Get:10 http://security.ubuntu.com/ubuntu jammy-security/main amd64 c-n-f Metadata [11.4 kB] 2024-04-18T14:29:09.186 INFO:teuthology.orchestra.run.smithi119.stdout:Get:11 http://security.ubuntu.com/ubuntu jammy-security/restricted i386 Packages [34.1 kB] 2024-04-18T14:29:09.187 INFO:teuthology.orchestra.run.smithi119.stdout:Get:12 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 Packages [1,670 kB] 2024-04-18T14:29:09.188 INFO:teuthology.orchestra.run.smithi096.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy-updates/restricted i386 Packages [38.1 kB] 2024-04-18T14:29:09.189 INFO:teuthology.orchestra.run.smithi096.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy-updates/restricted Translation-en [295 kB] 2024-04-18T14:29:09.190 INFO:teuthology.orchestra.run.smithi134.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy-updates/universe i386 Packages [699 kB] 2024-04-18T14:29:09.190 INFO:teuthology.orchestra.run.smithi086.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy-updates/universe Translation-en [245 kB] 2024-04-18T14:29:09.193 INFO:teuthology.orchestra.run.smithi086.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 c-n-f Metadata [22.1 kB] 2024-04-18T14:29:09.193 INFO:teuthology.orchestra.run.smithi086.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse i386 Packages [4,472 B] 2024-04-18T14:29:09.193 INFO:teuthology.orchestra.run.smithi086.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 Packages [42.7 kB] 2024-04-18T14:29:09.195 INFO:teuthology.orchestra.run.smithi086.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse Translation-en [10.4 kB] 2024-04-18T14:29:09.195 INFO:teuthology.orchestra.run.smithi086.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 c-n-f Metadata [472 B] 2024-04-18T14:29:09.195 INFO:teuthology.orchestra.run.smithi086.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 Packages [67.1 kB] 2024-04-18T14:29:09.196 INFO:teuthology.orchestra.run.smithi096.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 c-n-f Metadata [520 B] 2024-04-18T14:29:09.196 INFO:teuthology.orchestra.run.smithi086.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy-backports/main i386 Packages [59.2 kB] 2024-04-18T14:29:09.197 INFO:teuthology.orchestra.run.smithi134.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy-updates/universe Translation-en [245 kB] 2024-04-18T14:29:09.200 INFO:teuthology.orchestra.run.smithi134.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 c-n-f Metadata [22.1 kB] 2024-04-18T14:29:09.200 INFO:teuthology.orchestra.run.smithi134.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 Packages [42.7 kB] 2024-04-18T14:29:09.201 INFO:teuthology.orchestra.run.smithi134.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse i386 Packages [4,472 B] 2024-04-18T14:29:09.201 INFO:teuthology.orchestra.run.smithi134.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse Translation-en [10.4 kB] 2024-04-18T14:29:09.201 INFO:teuthology.orchestra.run.smithi134.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 c-n-f Metadata [472 B] 2024-04-18T14:29:09.201 INFO:teuthology.orchestra.run.smithi134.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy-backports/main i386 Packages [59.2 kB] 2024-04-18T14:29:09.202 INFO:teuthology.orchestra.run.smithi134.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 Packages [67.1 kB] 2024-04-18T14:29:09.204 INFO:teuthology.orchestra.run.smithi096.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 Packages [1,074 kB] 2024-04-18T14:29:09.233 INFO:teuthology.orchestra.run.smithi096.stdout:Get:16 http://security.ubuntu.com/ubuntu jammy-security/main Translation-en [237 kB] 2024-04-18T14:29:09.233 INFO:teuthology.orchestra.run.smithi086.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy-backports/main Translation-en [11.0 kB] 2024-04-18T14:29:09.237 INFO:teuthology.orchestra.run.smithi134.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy-backports/main Translation-en [11.0 kB] 2024-04-18T14:29:09.238 INFO:teuthology.orchestra.run.smithi119.stdout:Get:13 http://security.ubuntu.com/ubuntu jammy-security/restricted Translation-en [280 kB] 2024-04-18T14:29:09.244 INFO:teuthology.orchestra.run.smithi119.stdout:Get:14 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 c-n-f Metadata [520 B] 2024-04-18T14:29:09.245 INFO:teuthology.orchestra.run.smithi119.stdout:Get:15 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 Packages [852 kB] 2024-04-18T14:29:09.245 INFO:teuthology.orchestra.run.smithi096.stdout:Get:17 http://security.ubuntu.com/ubuntu jammy-security/main amd64 c-n-f Metadata [11.4 kB] 2024-04-18T14:29:09.246 INFO:teuthology.orchestra.run.smithi096.stdout:Get:18 http://security.ubuntu.com/ubuntu jammy-security/restricted i386 Packages [34.1 kB] 2024-04-18T14:29:09.248 INFO:teuthology.orchestra.run.smithi096.stdout:Get:19 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 Packages [1,670 kB] 2024-04-18T14:29:09.274 INFO:teuthology.orchestra.run.smithi096.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy-updates/universe i386 Packages [699 kB] 2024-04-18T14:29:09.287 INFO:teuthology.orchestra.run.smithi086.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 c-n-f Metadata [388 B] 2024-04-18T14:29:09.287 INFO:teuthology.orchestra.run.smithi086.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy-backports/universe i386 Packages [17.2 kB] 2024-04-18T14:29:09.287 INFO:teuthology.orchestra.run.smithi086.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 Packages [28.4 kB] 2024-04-18T14:29:09.288 INFO:teuthology.orchestra.run.smithi086.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy-backports/universe Translation-en [16.2 kB] 2024-04-18T14:29:09.288 INFO:teuthology.orchestra.run.smithi086.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 c-n-f Metadata [644 B] 2024-04-18T14:29:09.289 INFO:teuthology.orchestra.run.smithi134.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 c-n-f Metadata [388 B] 2024-04-18T14:29:09.289 INFO:teuthology.orchestra.run.smithi134.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy-backports/universe i386 Packages [17.2 kB] 2024-04-18T14:29:09.290 INFO:teuthology.orchestra.run.smithi134.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 Packages [28.4 kB] 2024-04-18T14:29:09.290 INFO:teuthology.orchestra.run.smithi134.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy-backports/universe Translation-en [16.2 kB] 2024-04-18T14:29:09.291 INFO:teuthology.orchestra.run.smithi134.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 c-n-f Metadata [644 B] 2024-04-18T14:29:09.294 INFO:teuthology.orchestra.run.smithi119.stdout:Get:16 http://security.ubuntu.com/ubuntu jammy-security/universe i386 Packages [600 kB] 2024-04-18T14:29:09.328 INFO:teuthology.orchestra.run.smithi096.stdout:Get:21 http://security.ubuntu.com/ubuntu jammy-security/restricted Translation-en [280 kB] 2024-04-18T14:29:09.332 INFO:teuthology.orchestra.run.smithi119.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/main Translation-en [298 kB] 2024-04-18T14:29:09.336 INFO:teuthology.orchestra.run.smithi096.stdout:Get:22 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 c-n-f Metadata [520 B] 2024-04-18T14:29:09.336 INFO:teuthology.orchestra.run.smithi096.stdout:Get:23 http://security.ubuntu.com/ubuntu jammy-security/universe i386 Packages [600 kB] 2024-04-18T14:29:09.346 INFO:teuthology.orchestra.run.smithi119.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 c-n-f Metadata [16.1 kB] 2024-04-18T14:29:09.347 INFO:teuthology.orchestra.run.smithi119.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/restricted i386 Packages [38.1 kB] 2024-04-18T14:29:09.348 INFO:teuthology.orchestra.run.smithi119.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 Packages [1,754 kB] 2024-04-18T14:29:09.352 INFO:teuthology.orchestra.run.smithi096.stdout:Get:24 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 Packages [852 kB] 2024-04-18T14:29:09.381 INFO:teuthology.orchestra.run.smithi096.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/universe Translation-en [245 kB] 2024-04-18T14:29:09.393 INFO:teuthology.orchestra.run.smithi119.stdout:Get:21 http://security.ubuntu.com/ubuntu jammy-security/universe Translation-en [163 kB] 2024-04-18T14:29:09.397 INFO:teuthology.orchestra.run.smithi119.stdout:Get:22 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 c-n-f Metadata [16.8 kB] 2024-04-18T14:29:09.397 INFO:teuthology.orchestra.run.smithi119.stdout:Get:23 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 Packages [37.2 kB] 2024-04-18T14:29:09.405 INFO:teuthology.orchestra.run.smithi119.stdout:Get:24 http://security.ubuntu.com/ubuntu jammy-security/multiverse i386 Packages [1,356 B] 2024-04-18T14:29:09.409 INFO:teuthology.orchestra.run.smithi096.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 c-n-f Metadata [22.1 kB] 2024-04-18T14:29:09.409 INFO:teuthology.orchestra.run.smithi096.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 Packages [42.7 kB] 2024-04-18T14:29:09.411 INFO:teuthology.orchestra.run.smithi096.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse i386 Packages [4,472 B] 2024-04-18T14:29:09.411 INFO:teuthology.orchestra.run.smithi119.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/restricted Translation-en [295 kB] 2024-04-18T14:29:09.411 INFO:teuthology.orchestra.run.smithi096.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse Translation-en [10.4 kB] 2024-04-18T14:29:09.412 INFO:teuthology.orchestra.run.smithi096.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 c-n-f Metadata [472 B] 2024-04-18T14:29:09.412 INFO:teuthology.orchestra.run.smithi096.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy-backports/main i386 Packages [59.2 kB] 2024-04-18T14:29:09.413 INFO:teuthology.orchestra.run.smithi096.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 Packages [67.1 kB] 2024-04-18T14:29:09.415 INFO:teuthology.orchestra.run.smithi096.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy-backports/main Translation-en [11.0 kB] 2024-04-18T14:29:09.418 INFO:teuthology.orchestra.run.smithi119.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 c-n-f Metadata [520 B] 2024-04-18T14:29:09.425 INFO:teuthology.orchestra.run.smithi096.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 c-n-f Metadata [388 B] 2024-04-18T14:29:09.429 INFO:teuthology.orchestra.run.smithi119.stdout:Get:27 http://security.ubuntu.com/ubuntu jammy-security/multiverse Translation-en [7,588 B] 2024-04-18T14:29:09.430 INFO:teuthology.orchestra.run.smithi119.stdout:Get:28 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 c-n-f Metadata [260 B] 2024-04-18T14:29:09.481 INFO:teuthology.orchestra.run.smithi096.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 Packages [28.4 kB] 2024-04-18T14:29:09.483 INFO:teuthology.orchestra.run.smithi096.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy-backports/universe i386 Packages [17.2 kB] 2024-04-18T14:29:09.484 INFO:teuthology.orchestra.run.smithi096.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy-backports/universe Translation-en [16.2 kB] 2024-04-18T14:29:09.487 INFO:teuthology.orchestra.run.smithi096.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 c-n-f Metadata [644 B] 2024-04-18T14:29:09.535 INFO:teuthology.orchestra.run.smithi096.stdout:Get:39 http://security.ubuntu.com/ubuntu jammy-security/universe Translation-en [163 kB] 2024-04-18T14:29:09.582 INFO:teuthology.orchestra.run.smithi119.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy-updates/universe i386 Packages [699 kB] 2024-04-18T14:29:09.932 INFO:teuthology.orchestra.run.smithi096.stdout:Get:40 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 c-n-f Metadata [16.8 kB] 2024-04-18T14:29:09.938 INFO:teuthology.orchestra.run.smithi096.stdout:Get:41 http://security.ubuntu.com/ubuntu jammy-security/multiverse i386 Packages [1,356 B] 2024-04-18T14:29:09.939 INFO:teuthology.orchestra.run.smithi096.stdout:Get:42 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 Packages [37.2 kB] 2024-04-18T14:29:09.953 INFO:teuthology.orchestra.run.smithi096.stdout:Get:43 http://security.ubuntu.com/ubuntu jammy-security/multiverse Translation-en [7,588 B] 2024-04-18T14:29:09.955 INFO:teuthology.orchestra.run.smithi096.stdout:Get:44 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 c-n-f Metadata [260 B] 2024-04-18T14:29:10.166 INFO:teuthology.orchestra.run.smithi119.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 Packages [1,074 kB] 2024-04-18T14:29:10.278 INFO:teuthology.orchestra.run.smithi119.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy-updates/universe Translation-en [245 kB] 2024-04-18T14:29:10.298 INFO:teuthology.orchestra.run.smithi119.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 c-n-f Metadata [22.1 kB] 2024-04-18T14:29:10.299 INFO:teuthology.orchestra.run.smithi119.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse i386 Packages [4,472 B] 2024-04-18T14:29:10.299 INFO:teuthology.orchestra.run.smithi119.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 Packages [42.7 kB] 2024-04-18T14:29:10.303 INFO:teuthology.orchestra.run.smithi119.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse Translation-en [10.4 kB] 2024-04-18T14:29:10.303 INFO:teuthology.orchestra.run.smithi119.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 c-n-f Metadata [472 B] 2024-04-18T14:29:10.303 INFO:teuthology.orchestra.run.smithi119.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 Packages [67.1 kB] 2024-04-18T14:29:10.308 INFO:teuthology.orchestra.run.smithi119.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy-backports/main i386 Packages [59.2 kB] 2024-04-18T14:29:10.313 INFO:teuthology.orchestra.run.smithi119.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy-backports/main Translation-en [11.0 kB] 2024-04-18T14:29:10.477 INFO:teuthology.orchestra.run.smithi119.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 c-n-f Metadata [388 B] 2024-04-18T14:29:10.559 INFO:teuthology.orchestra.run.smithi119.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy-backports/universe i386 Packages [17.2 kB] 2024-04-18T14:29:10.641 INFO:teuthology.orchestra.run.smithi119.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 Packages [28.4 kB] 2024-04-18T14:29:10.722 INFO:teuthology.orchestra.run.smithi119.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy-backports/universe Translation-en [16.2 kB] 2024-04-18T14:29:10.747 INFO:teuthology.orchestra.run.smithi119.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 c-n-f Metadata [644 B] 2024-04-18T14:29:14.510 INFO:teuthology.orchestra.run.smithi086.stdout:Fetched 12.9 MB in 2s (6,298 kB/s) 2024-04-18T14:29:14.594 INFO:teuthology.orchestra.run.smithi134.stdout:Fetched 12.9 MB in 2s (6,541 kB/s) 2024-04-18T14:29:14.616 INFO:teuthology.orchestra.run.smithi096.stdout:Fetched 12.9 MB in 2s (6,085 kB/s) 2024-04-18T14:29:15.046 INFO:teuthology.orchestra.run.smithi119.stdout:Fetched 12.9 MB in 3s (5,075 kB/s) 2024-04-18T14:29:15.876 INFO:teuthology.orchestra.run.smithi086.stdout:Reading package lists... 2024-04-18T14:29:15.894 DEBUG:teuthology.orchestra.run.smithi086:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-04-18T14:29:15.955 INFO:teuthology.orchestra.run.smithi086.stdout:Reading package lists... 2024-04-18T14:29:16.028 INFO:teuthology.orchestra.run.smithi134.stdout:Reading package lists... 2024-04-18T14:29:16.046 DEBUG:teuthology.orchestra.run.smithi134:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-04-18T14:29:16.108 INFO:teuthology.orchestra.run.smithi134.stdout:Reading package lists... 2024-04-18T14:29:16.154 INFO:teuthology.orchestra.run.smithi086.stdout:Building dependency tree... 2024-04-18T14:29:16.154 INFO:teuthology.orchestra.run.smithi086.stdout:Reading state information... 2024-04-18T14:29:16.207 INFO:teuthology.orchestra.run.smithi096.stdout:Reading package lists... 2024-04-18T14:29:16.227 DEBUG:teuthology.orchestra.run.smithi096:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-04-18T14:29:16.290 INFO:teuthology.orchestra.run.smithi096.stdout:Reading package lists... 2024-04-18T14:29:16.307 INFO:teuthology.orchestra.run.smithi134.stdout:Building dependency tree... 2024-04-18T14:29:16.308 INFO:teuthology.orchestra.run.smithi134.stdout:Reading state information... 2024-04-18T14:29:16.328 INFO:teuthology.orchestra.run.smithi086.stdout:The following packages were automatically installed and are no longer required: 2024-04-18T14:29:16.329 INFO:teuthology.orchestra.run.smithi086.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-04-18T14:29:16.329 INFO:teuthology.orchestra.run.smithi086.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-04-18T14:29:16.329 INFO:teuthology.orchestra.run.smithi086.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-04-18T14:29:16.329 INFO:teuthology.orchestra.run.smithi086.stdout: python2 python2-dev python2-minimal python2.7 python2.7-dev 2024-04-18T14:29:16.329 INFO:teuthology.orchestra.run.smithi086.stdout: python2.7-minimal 2024-04-18T14:29:16.329 INFO:teuthology.orchestra.run.smithi086.stdout:Use 'sudo apt autoremove' to remove them. 2024-04-18T14:29:16.330 INFO:teuthology.orchestra.run.smithi086.stdout:The following additional packages will be installed: 2024-04-18T14:29:16.330 INFO:teuthology.orchestra.run.smithi086.stdout: linux-generic linux-headers-5.15.0-102 linux-headers-5.15.0-102-generic 2024-04-18T14:29:16.330 INFO:teuthology.orchestra.run.smithi086.stdout: linux-headers-generic linux-image-5.15.0-102-generic 2024-04-18T14:29:16.330 INFO:teuthology.orchestra.run.smithi086.stdout: linux-modules-5.15.0-102-generic linux-modules-extra-5.15.0-102-generic 2024-04-18T14:29:16.331 INFO:teuthology.orchestra.run.smithi086.stdout:Suggested packages: 2024-04-18T14:29:16.331 INFO:teuthology.orchestra.run.smithi086.stdout: fdutils linux-doc | linux-source-5.15.0 linux-tools 2024-04-18T14:29:16.331 INFO:teuthology.orchestra.run.smithi086.stdout:Recommended packages: 2024-04-18T14:29:16.332 INFO:teuthology.orchestra.run.smithi086.stdout: thermald 2024-04-18T14:29:16.375 INFO:teuthology.orchestra.run.smithi086.stdout:The following NEW packages will be installed: 2024-04-18T14:29:16.375 INFO:teuthology.orchestra.run.smithi086.stdout: linux-headers-5.15.0-102 linux-headers-5.15.0-102-generic 2024-04-18T14:29:16.375 INFO:teuthology.orchestra.run.smithi086.stdout: linux-image-5.15.0-102-generic linux-modules-5.15.0-102-generic 2024-04-18T14:29:16.375 INFO:teuthology.orchestra.run.smithi086.stdout: linux-modules-extra-5.15.0-102-generic 2024-04-18T14:29:16.376 INFO:teuthology.orchestra.run.smithi086.stdout:The following packages will be upgraded: 2024-04-18T14:29:16.376 INFO:teuthology.orchestra.run.smithi086.stdout: linux-generic linux-headers-generic linux-image-generic 2024-04-18T14:29:16.449 INFO:teuthology.orchestra.run.smithi119.stdout:Reading package lists... 2024-04-18T14:29:16.466 DEBUG:teuthology.orchestra.run.smithi119:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-04-18T14:29:16.484 INFO:teuthology.orchestra.run.smithi134.stdout:The following packages were automatically installed and are no longer required: 2024-04-18T14:29:16.484 INFO:teuthology.orchestra.run.smithi134.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-04-18T14:29:16.484 INFO:teuthology.orchestra.run.smithi134.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-04-18T14:29:16.485 INFO:teuthology.orchestra.run.smithi134.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-04-18T14:29:16.485 INFO:teuthology.orchestra.run.smithi134.stdout: python2 python2-dev python2-minimal python2.7 python2.7-dev 2024-04-18T14:29:16.485 INFO:teuthology.orchestra.run.smithi134.stdout: python2.7-minimal 2024-04-18T14:29:16.485 INFO:teuthology.orchestra.run.smithi134.stdout:Use 'sudo apt autoremove' to remove them. 2024-04-18T14:29:16.486 INFO:teuthology.orchestra.run.smithi134.stdout:The following additional packages will be installed: 2024-04-18T14:29:16.486 INFO:teuthology.orchestra.run.smithi134.stdout: linux-generic linux-headers-5.15.0-102 linux-headers-5.15.0-102-generic 2024-04-18T14:29:16.486 INFO:teuthology.orchestra.run.smithi134.stdout: linux-headers-generic linux-image-5.15.0-102-generic 2024-04-18T14:29:16.487 INFO:teuthology.orchestra.run.smithi134.stdout: linux-modules-5.15.0-102-generic linux-modules-extra-5.15.0-102-generic 2024-04-18T14:29:16.488 INFO:teuthology.orchestra.run.smithi134.stdout:Suggested packages: 2024-04-18T14:29:16.488 INFO:teuthology.orchestra.run.smithi134.stdout: fdutils linux-doc | linux-source-5.15.0 linux-tools 2024-04-18T14:29:16.488 INFO:teuthology.orchestra.run.smithi134.stdout:Recommended packages: 2024-04-18T14:29:16.488 INFO:teuthology.orchestra.run.smithi134.stdout: thermald 2024-04-18T14:29:16.490 INFO:teuthology.orchestra.run.smithi096.stdout:Building dependency tree... 2024-04-18T14:29:16.491 INFO:teuthology.orchestra.run.smithi096.stdout:Reading state information... 2024-04-18T14:29:16.516 INFO:teuthology.orchestra.run.smithi119.stdout:Reading package lists... 2024-04-18T14:29:16.540 INFO:teuthology.orchestra.run.smithi134.stdout:The following NEW packages will be installed: 2024-04-18T14:29:16.540 INFO:teuthology.orchestra.run.smithi134.stdout: linux-headers-5.15.0-102 linux-headers-5.15.0-102-generic 2024-04-18T14:29:16.540 INFO:teuthology.orchestra.run.smithi134.stdout: linux-image-5.15.0-102-generic linux-modules-5.15.0-102-generic 2024-04-18T14:29:16.540 INFO:teuthology.orchestra.run.smithi134.stdout: linux-modules-extra-5.15.0-102-generic 2024-04-18T14:29:16.541 INFO:teuthology.orchestra.run.smithi134.stdout:The following packages will be upgraded: 2024-04-18T14:29:16.542 INFO:teuthology.orchestra.run.smithi134.stdout: linux-generic linux-headers-generic linux-image-generic 2024-04-18T14:29:16.557 INFO:teuthology.orchestra.run.smithi086.stdout:3 upgraded, 5 newly installed, 0 to remove and 315 not upgraded. 2024-04-18T14:29:16.557 INFO:teuthology.orchestra.run.smithi086.stdout:Need to get 113 MB of archives. 2024-04-18T14:29:16.557 INFO:teuthology.orchestra.run.smithi086.stdout:After this operation, 583 MB of additional disk space will be used. 2024-04-18T14:29:16.557 INFO:teuthology.orchestra.run.smithi086.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-5.15.0-102-generic amd64 5.15.0-102.112 [22.7 MB] 2024-04-18T14:29:16.600 INFO:teuthology.orchestra.run.smithi134.stdout:3 upgraded, 5 newly installed, 0 to remove and 315 not upgraded. 2024-04-18T14:29:16.600 INFO:teuthology.orchestra.run.smithi134.stdout:Need to get 113 MB of archives. 2024-04-18T14:29:16.600 INFO:teuthology.orchestra.run.smithi134.stdout:After this operation, 583 MB of additional disk space will be used. 2024-04-18T14:29:16.600 INFO:teuthology.orchestra.run.smithi134.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-5.15.0-102-generic amd64 5.15.0-102.112 [22.7 MB] 2024-04-18T14:29:16.665 INFO:teuthology.orchestra.run.smithi096.stdout:The following packages were automatically installed and are no longer required: 2024-04-18T14:29:16.665 INFO:teuthology.orchestra.run.smithi096.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-04-18T14:29:16.665 INFO:teuthology.orchestra.run.smithi096.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-04-18T14:29:16.666 INFO:teuthology.orchestra.run.smithi096.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-04-18T14:29:16.666 INFO:teuthology.orchestra.run.smithi096.stdout: python2 python2-dev python2-minimal python2.7 python2.7-dev 2024-04-18T14:29:16.666 INFO:teuthology.orchestra.run.smithi096.stdout: python2.7-minimal 2024-04-18T14:29:16.666 INFO:teuthology.orchestra.run.smithi096.stdout:Use 'sudo apt autoremove' to remove them. 2024-04-18T14:29:16.667 INFO:teuthology.orchestra.run.smithi096.stdout:The following additional packages will be installed: 2024-04-18T14:29:16.667 INFO:teuthology.orchestra.run.smithi096.stdout: linux-generic linux-headers-5.15.0-102 linux-headers-5.15.0-102-generic 2024-04-18T14:29:16.667 INFO:teuthology.orchestra.run.smithi096.stdout: linux-headers-generic linux-image-5.15.0-102-generic 2024-04-18T14:29:16.667 INFO:teuthology.orchestra.run.smithi096.stdout: linux-modules-5.15.0-102-generic linux-modules-extra-5.15.0-102-generic 2024-04-18T14:29:16.669 INFO:teuthology.orchestra.run.smithi096.stdout:Suggested packages: 2024-04-18T14:29:16.669 INFO:teuthology.orchestra.run.smithi096.stdout: fdutils linux-doc | linux-source-5.15.0 linux-tools 2024-04-18T14:29:16.669 INFO:teuthology.orchestra.run.smithi096.stdout:Recommended packages: 2024-04-18T14:29:16.669 INFO:teuthology.orchestra.run.smithi096.stdout: thermald 2024-04-18T14:29:16.692 INFO:teuthology.orchestra.run.smithi119.stdout:Building dependency tree... 2024-04-18T14:29:16.693 INFO:teuthology.orchestra.run.smithi119.stdout:Reading state information... 2024-04-18T14:29:16.721 INFO:teuthology.orchestra.run.smithi096.stdout:The following NEW packages will be installed: 2024-04-18T14:29:16.722 INFO:teuthology.orchestra.run.smithi096.stdout: linux-headers-5.15.0-102 linux-headers-5.15.0-102-generic 2024-04-18T14:29:16.722 INFO:teuthology.orchestra.run.smithi096.stdout: linux-image-5.15.0-102-generic linux-modules-5.15.0-102-generic 2024-04-18T14:29:16.722 INFO:teuthology.orchestra.run.smithi096.stdout: linux-modules-extra-5.15.0-102-generic 2024-04-18T14:29:16.723 INFO:teuthology.orchestra.run.smithi096.stdout:The following packages will be upgraded: 2024-04-18T14:29:16.724 INFO:teuthology.orchestra.run.smithi096.stdout: linux-generic linux-headers-generic linux-image-generic 2024-04-18T14:29:16.791 INFO:teuthology.orchestra.run.smithi096.stdout:3 upgraded, 5 newly installed, 0 to remove and 315 not upgraded. 2024-04-18T14:29:16.791 INFO:teuthology.orchestra.run.smithi096.stdout:Need to get 113 MB of archives. 2024-04-18T14:29:16.791 INFO:teuthology.orchestra.run.smithi096.stdout:After this operation, 583 MB of additional disk space will be used. 2024-04-18T14:29:16.791 INFO:teuthology.orchestra.run.smithi096.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-5.15.0-102-generic amd64 5.15.0-102.112 [22.7 MB] 2024-04-18T14:29:16.848 INFO:teuthology.orchestra.run.smithi119.stdout:The following packages were automatically installed and are no longer required: 2024-04-18T14:29:16.849 INFO:teuthology.orchestra.run.smithi119.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-04-18T14:29:16.849 INFO:teuthology.orchestra.run.smithi119.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-04-18T14:29:16.850 INFO:teuthology.orchestra.run.smithi119.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-04-18T14:29:16.850 INFO:teuthology.orchestra.run.smithi119.stdout: python2 python2-dev python2-minimal python2.7 python2.7-dev 2024-04-18T14:29:16.850 INFO:teuthology.orchestra.run.smithi119.stdout: python2.7-minimal 2024-04-18T14:29:16.850 INFO:teuthology.orchestra.run.smithi119.stdout:Use 'sudo apt autoremove' to remove them. 2024-04-18T14:29:16.851 INFO:teuthology.orchestra.run.smithi119.stdout:The following additional packages will be installed: 2024-04-18T14:29:16.851 INFO:teuthology.orchestra.run.smithi119.stdout: linux-generic linux-headers-5.15.0-102 linux-headers-5.15.0-102-generic 2024-04-18T14:29:16.851 INFO:teuthology.orchestra.run.smithi119.stdout: linux-headers-generic linux-image-5.15.0-102-generic 2024-04-18T14:29:16.851 INFO:teuthology.orchestra.run.smithi119.stdout: linux-modules-5.15.0-102-generic linux-modules-extra-5.15.0-102-generic 2024-04-18T14:29:16.852 INFO:teuthology.orchestra.run.smithi119.stdout:Suggested packages: 2024-04-18T14:29:16.852 INFO:teuthology.orchestra.run.smithi119.stdout: fdutils linux-doc | linux-source-5.15.0 linux-tools 2024-04-18T14:29:16.852 INFO:teuthology.orchestra.run.smithi119.stdout:Recommended packages: 2024-04-18T14:29:16.852 INFO:teuthology.orchestra.run.smithi119.stdout: thermald 2024-04-18T14:29:16.899 INFO:teuthology.orchestra.run.smithi119.stdout:The following NEW packages will be installed: 2024-04-18T14:29:16.899 INFO:teuthology.orchestra.run.smithi119.stdout: linux-headers-5.15.0-102 linux-headers-5.15.0-102-generic 2024-04-18T14:29:16.899 INFO:teuthology.orchestra.run.smithi119.stdout: linux-image-5.15.0-102-generic linux-modules-5.15.0-102-generic 2024-04-18T14:29:16.899 INFO:teuthology.orchestra.run.smithi119.stdout: linux-modules-extra-5.15.0-102-generic 2024-04-18T14:29:16.900 INFO:teuthology.orchestra.run.smithi119.stdout:The following packages will be upgraded: 2024-04-18T14:29:16.901 INFO:teuthology.orchestra.run.smithi119.stdout: linux-generic linux-headers-generic linux-image-generic 2024-04-18T14:29:17.079 INFO:teuthology.orchestra.run.smithi119.stdout:3 upgraded, 5 newly installed, 0 to remove and 315 not upgraded. 2024-04-18T14:29:17.079 INFO:teuthology.orchestra.run.smithi119.stdout:Need to get 113 MB of archives. 2024-04-18T14:29:17.079 INFO:teuthology.orchestra.run.smithi119.stdout:After this operation, 583 MB of additional disk space will be used. 2024-04-18T14:29:17.079 INFO:teuthology.orchestra.run.smithi119.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-5.15.0-102-generic amd64 5.15.0-102.112 [22.7 MB] 2024-04-18T14:29:17.160 INFO:teuthology.orchestra.run.smithi134.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-5.15.0-102-generic amd64 5.15.0-102.112 [11.5 MB] 2024-04-18T14:29:17.421 INFO:teuthology.orchestra.run.smithi134.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-extra-5.15.0-102-generic amd64 5.15.0-102.112 [63.9 MB] 2024-04-18T14:29:17.557 INFO:teuthology.orchestra.run.smithi096.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-5.15.0-102-generic amd64 5.15.0-102.112 [11.5 MB] 2024-04-18T14:29:17.842 INFO:teuthology.orchestra.run.smithi096.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-extra-5.15.0-102-generic amd64 5.15.0-102.112 [63.9 MB] 2024-04-18T14:29:17.985 INFO:teuthology.orchestra.run.smithi086.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-5.15.0-102-generic amd64 5.15.0-102.112 [11.5 MB] 2024-04-18T14:29:18.392 INFO:teuthology.orchestra.run.smithi086.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-extra-5.15.0-102-generic amd64 5.15.0-102.112 [63.9 MB] 2024-04-18T14:29:18.481 INFO:teuthology.orchestra.run.smithi119.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-5.15.0-102-generic amd64 5.15.0-102.112 [11.5 MB] 2024-04-18T14:29:18.833 INFO:teuthology.orchestra.run.smithi119.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-extra-5.15.0-102-generic amd64 5.15.0-102.112 [63.9 MB] 2024-04-18T14:29:19.038 INFO:teuthology.orchestra.run.smithi134.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-generic amd64 5.15.0.102.99 [1,700 B] 2024-04-18T14:29:19.039 INFO:teuthology.orchestra.run.smithi134.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-generic amd64 5.15.0.102.99 [2,512 B] 2024-04-18T14:29:19.039 INFO:teuthology.orchestra.run.smithi134.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-102 all 5.15.0-102.112 [12.4 MB] 2024-04-18T14:29:19.202 INFO:teuthology.orchestra.run.smithi134.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-102-generic amd64 5.15.0-102.112 [2,877 kB] 2024-04-18T14:29:19.234 INFO:teuthology.orchestra.run.smithi134.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-generic amd64 5.15.0.102.99 [2,360 B] 2024-04-18T14:29:19.306 INFO:teuthology.orchestra.run.smithi096.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-generic amd64 5.15.0.102.99 [1,700 B] 2024-04-18T14:29:19.307 INFO:teuthology.orchestra.run.smithi096.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-generic amd64 5.15.0.102.99 [2,512 B] 2024-04-18T14:29:19.307 INFO:teuthology.orchestra.run.smithi096.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-102 all 5.15.0-102.112 [12.4 MB] 2024-04-18T14:29:19.449 INFO:teuthology.orchestra.run.smithi096.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-102-generic amd64 5.15.0-102.112 [2,877 kB] 2024-04-18T14:29:19.480 INFO:teuthology.orchestra.run.smithi096.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-generic amd64 5.15.0.102.99 [2,360 B] 2024-04-18T14:29:19.630 INFO:teuthology.orchestra.run.smithi134.stdout:Fetched 113 MB in 3s (42.2 MB/s) 2024-04-18T14:29:19.844 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package linux-modules-5.15.0-102-generic. 2024-04-18T14:29:19.886 INFO:teuthology.orchestra.run.smithi096.stdout:Fetched 113 MB in 3s (41.2 MB/s) 2024-04-18T14:29:20.099 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package linux-modules-5.15.0-102-generic. 2024-04-18T14:29:20.584 INFO:teuthology.orchestra.run.smithi086.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-generic amd64 5.15.0.102.99 [1,700 B] 2024-04-18T14:29:20.616 INFO:teuthology.orchestra.run.smithi086.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-generic amd64 5.15.0.102.99 [2,512 B] 2024-04-18T14:29:20.619 INFO:teuthology.orchestra.run.smithi086.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-102 all 5.15.0-102.112 [12.4 MB] 2024-04-18T14:29:21.083 INFO:teuthology.orchestra.run.smithi119.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-generic amd64 5.15.0.102.99 [1,700 B] 2024-04-18T14:29:21.083 INFO:teuthology.orchestra.run.smithi119.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-generic amd64 5.15.0.102.99 [2,512 B] 2024-04-18T14:29:21.083 INFO:teuthology.orchestra.run.smithi119.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-102 all 5.15.0-102.112 [12.4 MB] 2024-04-18T14:29:21.115 INFO:teuthology.orchestra.run.smithi086.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-102-generic amd64 5.15.0-102.112 [2,877 kB] 2024-04-18T14:29:21.251 INFO:teuthology.orchestra.run.smithi086.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-generic amd64 5.15.0.102.99 [2,360 B] 2024-04-18T14:29:21.558 INFO:teuthology.orchestra.run.smithi119.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-102-generic amd64 5.15.0-102.112 [2,877 kB] 2024-04-18T14:29:21.612 INFO:teuthology.orchestra.run.smithi119.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-generic amd64 5.15.0.102.99 [2,360 B] 2024-04-18T14:29:21.641 INFO:teuthology.orchestra.run.smithi086.stdout:Fetched 113 MB in 5s (23.3 MB/s) 2024-04-18T14:29:21.825 INFO:teuthology.orchestra.run.smithi134.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 129542 files and directories currently installed.) 2024-04-18T14:29:21.830 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package linux-modules-5.15.0-102-generic. 2024-04-18T14:29:21.831 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../0-linux-modules-5.15.0-102-generic_5.15.0-102.112_amd64.deb ... 2024-04-18T14:29:21.941 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking linux-modules-5.15.0-102-generic (5.15.0-102.112) ... 2024-04-18T14:29:22.008 INFO:teuthology.orchestra.run.smithi119.stdout:Fetched 113 MB in 5s (24.1 MB/s) 2024-04-18T14:29:22.131 INFO:teuthology.orchestra.run.smithi096.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 129542 files and directories currently installed.) 2024-04-18T14:29:22.135 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../0-linux-modules-5.15.0-102-generic_5.15.0-102.112_amd64.deb ... 2024-04-18T14:29:22.189 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package linux-modules-5.15.0-102-generic. 2024-04-18T14:29:22.263 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking linux-modules-5.15.0-102-generic (5.15.0-102.112) ... 2024-04-18T14:29:23.833 INFO:teuthology.orchestra.run.smithi086.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 129542 files and directories currently installed.) 2024-04-18T14:29:23.837 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../0-linux-modules-5.15.0-102-generic_5.15.0-102.112_amd64.deb ... 2024-04-18T14:29:23.935 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking linux-modules-5.15.0-102-generic (5.15.0-102.112) ... 2024-04-18T14:29:24.091 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package linux-image-5.15.0-102-generic. 2024-04-18T14:29:24.112 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../1-linux-image-5.15.0-102-generic_5.15.0-102.112_amd64.deb ... 2024-04-18T14:29:24.194 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking linux-image-5.15.0-102-generic (5.15.0-102.112) ... 2024-04-18T14:29:24.210 INFO:teuthology.orchestra.run.smithi119.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 129542 files and directories currently installed.) 2024-04-18T14:29:24.214 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../0-linux-modules-5.15.0-102-generic_5.15.0-102.112_amd64.deb ... 2024-04-18T14:29:24.370 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking linux-modules-5.15.0-102-generic (5.15.0-102.112) ... 2024-04-18T14:29:24.615 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package linux-image-5.15.0-102-generic. 2024-04-18T14:29:24.637 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../1-linux-image-5.15.0-102-generic_5.15.0-102.112_amd64.deb ... 2024-04-18T14:29:24.761 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking linux-image-5.15.0-102-generic (5.15.0-102.112) ... 2024-04-18T14:29:24.811 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package linux-modules-extra-5.15.0-102-generic. 2024-04-18T14:29:24.832 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../2-linux-modules-extra-5.15.0-102-generic_5.15.0-102.112_amd64.deb ... 2024-04-18T14:29:25.036 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking linux-modules-extra-5.15.0-102-generic (5.15.0-102.112) ... 2024-04-18T14:29:25.551 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package linux-modules-extra-5.15.0-102-generic. 2024-04-18T14:29:25.572 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../2-linux-modules-extra-5.15.0-102-generic_5.15.0-102.112_amd64.deb ... 2024-04-18T14:29:25.610 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking linux-modules-extra-5.15.0-102-generic (5.15.0-102.112) ... 2024-04-18T14:29:26.463 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package linux-image-5.15.0-102-generic. 2024-04-18T14:29:26.484 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../1-linux-image-5.15.0-102-generic_5.15.0-102.112_amd64.deb ... 2024-04-18T14:29:26.568 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking linux-image-5.15.0-102-generic (5.15.0-102.112) ... 2024-04-18T14:29:26.615 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package linux-image-5.15.0-102-generic. 2024-04-18T14:29:26.640 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../1-linux-image-5.15.0-102-generic_5.15.0-102.112_amd64.deb ... 2024-04-18T14:29:26.724 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking linux-image-5.15.0-102-generic (5.15.0-102.112) ... 2024-04-18T14:29:27.049 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package linux-modules-extra-5.15.0-102-generic. 2024-04-18T14:29:27.070 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../2-linux-modules-extra-5.15.0-102-generic_5.15.0-102.112_amd64.deb ... 2024-04-18T14:29:27.107 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking linux-modules-extra-5.15.0-102-generic (5.15.0-102.112) ... 2024-04-18T14:29:27.243 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package linux-modules-extra-5.15.0-102-generic. 2024-04-18T14:29:27.264 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../2-linux-modules-extra-5.15.0-102-generic_5.15.0-102.112_amd64.deb ... 2024-04-18T14:29:27.302 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking linux-modules-extra-5.15.0-102-generic (5.15.0-102.112) ... 2024-04-18T14:29:31.650 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../3-linux-generic_5.15.0.102.99_amd64.deb ... 2024-04-18T14:29:31.778 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking linux-generic (5.15.0.102.99) over (5.15.0.56.54) ... 2024-04-18T14:29:32.328 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../4-linux-image-generic_5.15.0.102.99_amd64.deb ... 2024-04-18T14:29:32.441 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking linux-image-generic (5.15.0.102.99) over (5.15.0.56.54) ... 2024-04-18T14:29:32.479 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../3-linux-generic_5.15.0.102.99_amd64.deb ... 2024-04-18T14:29:32.607 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking linux-generic (5.15.0.102.99) over (5.15.0.56.54) ... 2024-04-18T14:29:32.759 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package linux-headers-5.15.0-102. 2024-04-18T14:29:32.782 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../5-linux-headers-5.15.0-102_5.15.0-102.112_all.deb ... 2024-04-18T14:29:32.826 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking linux-headers-5.15.0-102 (5.15.0-102.112) ... 2024-04-18T14:29:32.948 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../4-linux-image-generic_5.15.0.102.99_amd64.deb ... 2024-04-18T14:29:33.077 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking linux-image-generic (5.15.0.102.99) over (5.15.0.56.54) ... 2024-04-18T14:29:33.405 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package linux-headers-5.15.0-102. 2024-04-18T14:29:33.428 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../5-linux-headers-5.15.0-102_5.15.0-102.112_all.deb ... 2024-04-18T14:29:33.496 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../3-linux-generic_5.15.0.102.99_amd64.deb ... 2024-04-18T14:29:33.497 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking linux-headers-5.15.0-102 (5.15.0-102.112) ... 2024-04-18T14:29:33.649 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking linux-generic (5.15.0.102.99) over (5.15.0.56.54) ... 2024-04-18T14:29:33.989 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../4-linux-image-generic_5.15.0.102.99_amd64.deb ... 2024-04-18T14:29:34.110 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking linux-image-generic (5.15.0.102.99) over (5.15.0.56.54) ... 2024-04-18T14:29:34.374 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../3-linux-generic_5.15.0.102.99_amd64.deb ... 2024-04-18T14:29:34.413 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package linux-headers-5.15.0-102. 2024-04-18T14:29:34.436 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../5-linux-headers-5.15.0-102_5.15.0-102.112_all.deb ... 2024-04-18T14:29:34.480 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking linux-headers-5.15.0-102 (5.15.0-102.112) ... 2024-04-18T14:29:34.527 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking linux-generic (5.15.0.102.99) over (5.15.0.56.54) ... 2024-04-18T14:29:34.893 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../4-linux-image-generic_5.15.0.102.99_amd64.deb ... 2024-04-18T14:29:35.038 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking linux-image-generic (5.15.0.102.99) over (5.15.0.56.54) ... 2024-04-18T14:29:35.350 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package linux-headers-5.15.0-102. 2024-04-18T14:29:35.372 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../5-linux-headers-5.15.0-102_5.15.0-102.112_all.deb ... 2024-04-18T14:29:35.408 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking linux-headers-5.15.0-102 (5.15.0-102.112) ... 2024-04-18T14:29:38.790 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package linux-headers-5.15.0-102-generic. 2024-04-18T14:29:38.827 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../6-linux-headers-5.15.0-102-generic_5.15.0-102.112_amd64.deb ... 2024-04-18T14:29:38.865 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking linux-headers-5.15.0-102-generic (5.15.0-102.112) ... 2024-04-18T14:29:39.090 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package linux-headers-5.15.0-102-generic. 2024-04-18T14:29:39.127 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../6-linux-headers-5.15.0-102-generic_5.15.0-102.112_amd64.deb ... 2024-04-18T14:29:39.164 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking linux-headers-5.15.0-102-generic (5.15.0-102.112) ... 2024-04-18T14:29:40.250 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package linux-headers-5.15.0-102-generic. 2024-04-18T14:29:40.286 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../6-linux-headers-5.15.0-102-generic_5.15.0-102.112_amd64.deb ... 2024-04-18T14:29:40.325 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking linux-headers-5.15.0-102-generic (5.15.0-102.112) ... 2024-04-18T14:29:41.239 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package linux-headers-5.15.0-102-generic. 2024-04-18T14:29:41.277 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../6-linux-headers-5.15.0-102-generic_5.15.0-102.112_amd64.deb ... 2024-04-18T14:29:41.314 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking linux-headers-5.15.0-102-generic (5.15.0-102.112) ... 2024-04-18T14:29:41.713 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../7-linux-headers-generic_5.15.0.102.99_amd64.deb ... 2024-04-18T14:29:41.837 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking linux-headers-generic (5.15.0.102.99) over (5.15.0.56.54) ... 2024-04-18T14:29:42.178 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up linux-headers-5.15.0-102 (5.15.0-102.112) ... 2024-04-18T14:29:42.300 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up linux-headers-5.15.0-102-generic (5.15.0-102.112) ... 2024-04-18T14:29:42.438 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up linux-headers-generic (5.15.0.102.99) ... 2024-04-18T14:29:42.468 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../7-linux-headers-generic_5.15.0.102.99_amd64.deb ... 2024-04-18T14:29:42.571 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up linux-image-5.15.0-102-generic (5.15.0-102.112) ... 2024-04-18T14:29:42.600 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking linux-headers-generic (5.15.0.102.99) over (5.15.0.56.54) ... 2024-04-18T14:29:42.975 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up linux-headers-5.15.0-102 (5.15.0-102.112) ... 2024-04-18T14:29:43.097 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up linux-headers-5.15.0-102-generic (5.15.0-102.112) ... 2024-04-18T14:29:43.221 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../7-linux-headers-generic_5.15.0.102.99_amd64.deb ... 2024-04-18T14:29:43.247 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up linux-headers-generic (5.15.0.102.99) ... 2024-04-18T14:29:43.368 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking linux-headers-generic (5.15.0.102.99) over (5.15.0.56.54) ... 2024-04-18T14:29:43.376 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up linux-image-5.15.0-102-generic (5.15.0-102.112) ... 2024-04-18T14:29:43.718 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up linux-headers-5.15.0-102 (5.15.0-102.112) ... 2024-04-18T14:29:43.839 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up linux-headers-5.15.0-102-generic (5.15.0-102.112) ... 2024-04-18T14:29:43.902 INFO:teuthology.orchestra.run.smithi134.stdout:I: /vmlinuz.old is now a symlink to boot/vmlinuz-5.15.0-56-generic 2024-04-18T14:29:43.902 INFO:teuthology.orchestra.run.smithi134.stdout:I: /initrd.img.old is now a symlink to boot/initrd.img-5.15.0-56-generic 2024-04-18T14:29:43.902 INFO:teuthology.orchestra.run.smithi134.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.15.0-102-generic 2024-04-18T14:29:43.903 INFO:teuthology.orchestra.run.smithi134.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.15.0-102-generic 2024-04-18T14:29:43.982 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up linux-headers-generic (5.15.0.102.99) ... 2024-04-18T14:29:44.066 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up linux-modules-5.15.0-102-generic (5.15.0-102.112) ... 2024-04-18T14:29:44.094 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up linux-image-5.15.0-102-generic (5.15.0-102.112) ... 2024-04-18T14:29:44.720 INFO:teuthology.orchestra.run.smithi096.stdout:I: /vmlinuz.old is now a symlink to boot/vmlinuz-5.15.0-56-generic 2024-04-18T14:29:44.720 INFO:teuthology.orchestra.run.smithi096.stdout:I: /initrd.img.old is now a symlink to boot/initrd.img-5.15.0-56-generic 2024-04-18T14:29:44.720 INFO:teuthology.orchestra.run.smithi096.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.15.0-102-generic 2024-04-18T14:29:44.720 INFO:teuthology.orchestra.run.smithi096.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.15.0-102-generic 2024-04-18T14:29:44.919 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up linux-modules-5.15.0-102-generic (5.15.0-102.112) ... 2024-04-18T14:29:45.119 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../7-linux-headers-generic_5.15.0.102.99_amd64.deb ... 2024-04-18T14:29:45.267 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking linux-headers-generic (5.15.0.102.99) over (5.15.0.56.54) ... 2024-04-18T14:29:45.399 INFO:teuthology.orchestra.run.smithi086.stdout:I: /vmlinuz.old is now a symlink to boot/vmlinuz-5.15.0-56-generic 2024-04-18T14:29:45.399 INFO:teuthology.orchestra.run.smithi086.stdout:I: /initrd.img.old is now a symlink to boot/initrd.img-5.15.0-56-generic 2024-04-18T14:29:45.399 INFO:teuthology.orchestra.run.smithi086.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.15.0-102-generic 2024-04-18T14:29:45.399 INFO:teuthology.orchestra.run.smithi086.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.15.0-102-generic 2024-04-18T14:29:45.442 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up linux-modules-extra-5.15.0-102-generic (5.15.0-102.112) ... 2024-04-18T14:29:45.562 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up linux-modules-5.15.0-102-generic (5.15.0-102.112) ... 2024-04-18T14:29:45.650 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up linux-headers-5.15.0-102 (5.15.0-102.112) ... 2024-04-18T14:29:45.788 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up linux-headers-5.15.0-102-generic (5.15.0-102.112) ... 2024-04-18T14:29:45.922 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up linux-headers-generic (5.15.0.102.99) ... 2024-04-18T14:29:46.076 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up linux-image-5.15.0-102-generic (5.15.0-102.112) ... 2024-04-18T14:29:46.304 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up linux-modules-extra-5.15.0-102-generic (5.15.0-102.112) ... 2024-04-18T14:29:47.374 INFO:teuthology.orchestra.run.smithi119.stdout:I: /vmlinuz.old is now a symlink to boot/vmlinuz-5.15.0-56-generic 2024-04-18T14:29:47.374 INFO:teuthology.orchestra.run.smithi119.stdout:I: /initrd.img.old is now a symlink to boot/initrd.img-5.15.0-56-generic 2024-04-18T14:29:47.374 INFO:teuthology.orchestra.run.smithi119.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.15.0-102-generic 2024-04-18T14:29:47.374 INFO:teuthology.orchestra.run.smithi119.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.15.0-102-generic 2024-04-18T14:29:47.553 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up linux-modules-5.15.0-102-generic (5.15.0-102.112) ... 2024-04-18T14:29:47.672 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up linux-image-generic (5.15.0.102.99) ... 2024-04-18T14:29:47.831 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up linux-generic (5.15.0.102.99) ... 2024-04-18T14:29:47.947 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up linux-modules-extra-5.15.0-102-generic (5.15.0-102.112) ... 2024-04-18T14:29:47.957 INFO:teuthology.orchestra.run.smithi096.stdout:Processing triggers for linux-image-5.15.0-102-generic (5.15.0-102.112) ... 2024-04-18T14:29:48.016 INFO:teuthology.orchestra.run.smithi096.stdout:/etc/kernel/postinst.d/initramfs-tools: 2024-04-18T14:29:48.016 INFO:teuthology.orchestra.run.smithi096.stdout:update-initramfs: Generating /boot/initrd.img-5.15.0-102-generic 2024-04-18T14:29:48.094 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up linux-image-generic (5.15.0.102.99) ... 2024-04-18T14:29:48.220 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up linux-generic (5.15.0.102.99) ... 2024-04-18T14:29:48.346 INFO:teuthology.orchestra.run.smithi134.stdout:Processing triggers for linux-image-5.15.0-102-generic (5.15.0-102.112) ... 2024-04-18T14:29:48.416 INFO:teuthology.orchestra.run.smithi134.stdout:/etc/kernel/postinst.d/initramfs-tools: 2024-04-18T14:29:48.416 INFO:teuthology.orchestra.run.smithi134.stdout:update-initramfs: Generating /boot/initrd.img-5.15.0-102-generic 2024-04-18T14:29:49.171 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up linux-modules-extra-5.15.0-102-generic (5.15.0-102.112) ... 2024-04-18T14:29:49.357 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up linux-image-generic (5.15.0.102.99) ... 2024-04-18T14:29:49.466 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up linux-generic (5.15.0.102.99) ... 2024-04-18T14:29:49.575 INFO:teuthology.orchestra.run.smithi086.stdout:Processing triggers for linux-image-5.15.0-102-generic (5.15.0-102.112) ... 2024-04-18T14:29:49.625 INFO:teuthology.orchestra.run.smithi086.stdout:/etc/kernel/postinst.d/initramfs-tools: 2024-04-18T14:29:49.625 INFO:teuthology.orchestra.run.smithi086.stdout:update-initramfs: Generating /boot/initrd.img-5.15.0-102-generic 2024-04-18T14:29:50.839 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up linux-image-generic (5.15.0.102.99) ... 2024-04-18T14:29:50.973 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up linux-generic (5.15.0.102.99) ... 2024-04-18T14:29:51.124 INFO:teuthology.orchestra.run.smithi119.stdout:Processing triggers for linux-image-5.15.0-102-generic (5.15.0-102.112) ... 2024-04-18T14:29:51.191 INFO:teuthology.orchestra.run.smithi119.stdout:/etc/kernel/postinst.d/initramfs-tools: 2024-04-18T14:29:51.191 INFO:teuthology.orchestra.run.smithi119.stdout:update-initramfs: Generating /boot/initrd.img-5.15.0-102-generic 2024-04-18T14:30:02.608 INFO:teuthology.orchestra.run.smithi096.stdout:/etc/kernel/postinst.d/zz-update-grub: 2024-04-18T14:30:02.609 INFO:teuthology.orchestra.run.smithi096.stdout:Sourcing file `/etc/default/grub' 2024-04-18T14:30:02.621 INFO:teuthology.orchestra.run.smithi096.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-04-18T14:30:02.646 INFO:teuthology.orchestra.run.smithi096.stdout:Generating grub configuration file ... 2024-04-18T14:30:02.667 INFO:teuthology.orchestra.run.smithi134.stdout:/etc/kernel/postinst.d/zz-update-grub: 2024-04-18T14:30:02.668 INFO:teuthology.orchestra.run.smithi134.stdout:Sourcing file `/etc/default/grub' 2024-04-18T14:30:02.684 INFO:teuthology.orchestra.run.smithi134.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-04-18T14:30:02.703 INFO:teuthology.orchestra.run.smithi134.stdout:Generating grub configuration file ... 2024-04-18T14:30:03.054 INFO:teuthology.orchestra.run.smithi096.stdout:Found linux image: /boot/vmlinuz-5.15.0-102-generic 2024-04-18T14:30:03.062 INFO:teuthology.orchestra.run.smithi134.stdout:Found linux image: /boot/vmlinuz-5.15.0-102-generic 2024-04-18T14:30:03.079 INFO:teuthology.orchestra.run.smithi096.stdout:Found initrd image: /boot/initrd.img-5.15.0-102-generic 2024-04-18T14:30:03.088 INFO:teuthology.orchestra.run.smithi134.stdout:Found initrd image: /boot/initrd.img-5.15.0-102-generic 2024-04-18T14:30:03.451 INFO:teuthology.orchestra.run.smithi134.stdout:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-04-18T14:30:03.457 INFO:teuthology.orchestra.run.smithi134.stdout:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-04-18T14:30:03.500 INFO:teuthology.orchestra.run.smithi096.stdout:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-04-18T14:30:03.508 INFO:teuthology.orchestra.run.smithi096.stdout:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-04-18T14:30:03.527 INFO:teuthology.orchestra.run.smithi134.stdout:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-04-18T14:30:03.533 INFO:teuthology.orchestra.run.smithi134.stdout:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-04-18T14:30:03.571 INFO:teuthology.orchestra.run.smithi096.stdout:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-04-18T14:30:03.577 INFO:teuthology.orchestra.run.smithi096.stdout:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-04-18T14:30:03.577 INFO:teuthology.orchestra.run.smithi086.stdout:/etc/kernel/postinst.d/zz-update-grub: 2024-04-18T14:30:03.577 INFO:teuthology.orchestra.run.smithi086.stdout:Sourcing file `/etc/default/grub' 2024-04-18T14:30:03.595 INFO:teuthology.orchestra.run.smithi086.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-04-18T14:30:03.613 INFO:teuthology.orchestra.run.smithi086.stdout:Generating grub configuration file ... 2024-04-18T14:30:03.715 INFO:teuthology.orchestra.run.smithi134.stdout:Warning: os-prober will not be executed to detect other bootable partitions. 2024-04-18T14:30:03.715 INFO:teuthology.orchestra.run.smithi134.stdout:Systems on them will not be added to the GRUB boot configuration. 2024-04-18T14:30:03.715 INFO:teuthology.orchestra.run.smithi134.stdout:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-04-18T14:30:03.741 INFO:teuthology.orchestra.run.smithi096.stdout:Warning: os-prober will not be executed to detect other bootable partitions. 2024-04-18T14:30:03.741 INFO:teuthology.orchestra.run.smithi096.stdout:Systems on them will not be added to the GRUB boot configuration. 2024-04-18T14:30:03.741 INFO:teuthology.orchestra.run.smithi096.stdout:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-04-18T14:30:03.762 INFO:teuthology.orchestra.run.smithi134.stdout:done 2024-04-18T14:30:03.779 INFO:teuthology.orchestra.run.smithi096.stdout:done 2024-04-18T14:30:03.889 INFO:teuthology.orchestra.run.smithi086.stdout:Found linux image: /boot/vmlinuz-5.15.0-102-generic 2024-04-18T14:30:03.908 INFO:teuthology.orchestra.run.smithi086.stdout:Found initrd image: /boot/initrd.img-5.15.0-102-generic 2024-04-18T14:30:04.203 INFO:teuthology.orchestra.run.smithi086.stdout:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-04-18T14:30:04.209 INFO:teuthology.orchestra.run.smithi086.stdout:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-04-18T14:30:04.261 DEBUG:teuthology.orchestra.run.smithi096:> dpkg -s linux-image-generic 2024-04-18T14:30:04.262 DEBUG:teuthology.orchestra.run.smithi134:> dpkg -s linux-image-generic 2024-04-18T14:30:04.280 INFO:teuthology.orchestra.run.smithi096.stdout:Package: linux-image-generic 2024-04-18T14:30:04.280 INFO:teuthology.orchestra.run.smithi096.stdout:Status: install ok installed 2024-04-18T14:30:04.280 INFO:teuthology.orchestra.run.smithi096.stdout:Priority: optional 2024-04-18T14:30:04.280 INFO:teuthology.orchestra.run.smithi096.stdout:Section: kernel 2024-04-18T14:30:04.280 INFO:teuthology.orchestra.run.smithi096.stdout:Installed-Size: 21 2024-04-18T14:30:04.280 INFO:teuthology.orchestra.run.smithi096.stdout:Maintainer: Ubuntu Kernel Team 2024-04-18T14:30:04.280 INFO:teuthology.orchestra.run.smithi096.stdout:Architecture: amd64 2024-04-18T14:30:04.280 INFO:teuthology.orchestra.run.smithi096.stdout:Source: linux-meta 2024-04-18T14:30:04.280 INFO:teuthology.orchestra.run.smithi096.stdout:Version: 5.15.0.102.99 2024-04-18T14:30:04.281 INFO:teuthology.orchestra.run.smithi096.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.3), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-102), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.3) 2024-04-18T14:30:04.281 INFO:teuthology.orchestra.run.smithi096.stdout:Depends: linux-image-5.15.0-102-generic, linux-modules-extra-5.15.0-102-generic, linux-firmware, intel-microcode, amd64-microcode 2024-04-18T14:30:04.281 INFO:teuthology.orchestra.run.smithi096.stdout:Recommends: thermald 2024-04-18T14:30:04.281 INFO:teuthology.orchestra.run.smithi096.stdout:Description: Generic Linux kernel image 2024-04-18T14:30:04.281 INFO:teuthology.orchestra.run.smithi096.stdout: This package will always depend on the latest generic kernel image 2024-04-18T14:30:04.281 INFO:teuthology.orchestra.run.smithi096.stdout: available. 2024-04-18T14:30:04.281 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.15.0-56-generic Expected: 5.15.0-102-generic 2024-04-18T14:30:04.281 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-04-18T14:30:04.281 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-04-18T14:30:04.281 INFO:teuthology.task.kernel:Installing distro kernel on mon.b... 2024-04-18T14:30:04.281 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi096.front.sepia.ceph.com, path=None, version=distro) 2024-04-18T14:30:04.282 DEBUG:teuthology.orchestra.run.smithi096:> sudo apt-get clean 2024-04-18T14:30:04.282 INFO:teuthology.orchestra.run.smithi086.stdout:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-04-18T14:30:04.285 INFO:teuthology.orchestra.run.smithi134.stdout:Package: linux-image-generic 2024-04-18T14:30:04.286 INFO:teuthology.orchestra.run.smithi134.stdout:Status: install ok installed 2024-04-18T14:30:04.286 INFO:teuthology.orchestra.run.smithi134.stdout:Priority: optional 2024-04-18T14:30:04.286 INFO:teuthology.orchestra.run.smithi134.stdout:Section: kernel 2024-04-18T14:30:04.286 INFO:teuthology.orchestra.run.smithi134.stdout:Installed-Size: 21 2024-04-18T14:30:04.286 INFO:teuthology.orchestra.run.smithi134.stdout:Maintainer: Ubuntu Kernel Team 2024-04-18T14:30:04.287 INFO:teuthology.orchestra.run.smithi134.stdout:Architecture: amd64 2024-04-18T14:30:04.287 INFO:teuthology.orchestra.run.smithi134.stdout:Source: linux-meta 2024-04-18T14:30:04.287 INFO:teuthology.orchestra.run.smithi134.stdout:Version: 5.15.0.102.99 2024-04-18T14:30:04.287 INFO:teuthology.orchestra.run.smithi134.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.3), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-102), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.3) 2024-04-18T14:30:04.287 INFO:teuthology.orchestra.run.smithi134.stdout:Depends: linux-image-5.15.0-102-generic, linux-modules-extra-5.15.0-102-generic, linux-firmware, intel-microcode, amd64-microcode 2024-04-18T14:30:04.287 INFO:teuthology.orchestra.run.smithi134.stdout:Recommends: thermald 2024-04-18T14:30:04.287 INFO:teuthology.orchestra.run.smithi134.stdout:Description: Generic Linux kernel image 2024-04-18T14:30:04.288 INFO:teuthology.orchestra.run.smithi134.stdout: This package will always depend on the latest generic kernel image 2024-04-18T14:30:04.288 INFO:teuthology.orchestra.run.smithi134.stdout: available. 2024-04-18T14:30:04.288 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.15.0-56-generic Expected: 5.15.0-102-generic 2024-04-18T14:30:04.288 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-04-18T14:30:04.289 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-04-18T14:30:04.289 INFO:teuthology.task.kernel:Installing distro kernel on mgr.x... 2024-04-18T14:30:04.289 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi134.front.sepia.ceph.com, path=None, version=distro) 2024-04-18T14:30:04.289 DEBUG:teuthology.orchestra.run.smithi134:> sudo apt-get clean 2024-04-18T14:30:04.290 INFO:teuthology.orchestra.run.smithi086.stdout:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-04-18T14:30:04.464 DEBUG:teuthology.orchestra.run.smithi096:> sudo apt-get update 2024-04-18T14:30:04.470 INFO:teuthology.orchestra.run.smithi086.stdout:Warning: os-prober will not be executed to detect other bootable partitions. 2024-04-18T14:30:04.470 INFO:teuthology.orchestra.run.smithi086.stdout:Systems on them will not be added to the GRUB boot configuration. 2024-04-18T14:30:04.470 INFO:teuthology.orchestra.run.smithi086.stdout:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-04-18T14:30:04.476 DEBUG:teuthology.orchestra.run.smithi134:> sudo apt-get update 2024-04-18T14:30:04.516 INFO:teuthology.orchestra.run.smithi086.stdout:done 2024-04-18T14:30:04.605 INFO:teuthology.orchestra.run.smithi096.stdout:Hit:1 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-04-18T14:30:04.615 INFO:teuthology.orchestra.run.smithi134.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-04-18T14:30:04.632 INFO:teuthology.orchestra.run.smithi134.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-04-18T14:30:04.661 INFO:teuthology.orchestra.run.smithi134.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-04-18T14:30:04.704 INFO:teuthology.orchestra.run.smithi096.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-04-18T14:30:04.711 INFO:teuthology.orchestra.run.smithi134.stdout:Hit:4 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-04-18T14:30:04.786 INFO:teuthology.orchestra.run.smithi096.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-04-18T14:30:04.866 INFO:teuthology.orchestra.run.smithi096.stdout:Hit:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-04-18T14:30:04.970 DEBUG:teuthology.orchestra.run.smithi086:> dpkg -s linux-image-generic 2024-04-18T14:30:05.002 INFO:teuthology.orchestra.run.smithi086.stdout:Package: linux-image-generic 2024-04-18T14:30:05.002 INFO:teuthology.orchestra.run.smithi086.stdout:Status: install ok installed 2024-04-18T14:30:05.002 INFO:teuthology.orchestra.run.smithi086.stdout:Priority: optional 2024-04-18T14:30:05.002 INFO:teuthology.orchestra.run.smithi086.stdout:Section: kernel 2024-04-18T14:30:05.002 INFO:teuthology.orchestra.run.smithi086.stdout:Installed-Size: 21 2024-04-18T14:30:05.002 INFO:teuthology.orchestra.run.smithi086.stdout:Maintainer: Ubuntu Kernel Team 2024-04-18T14:30:05.002 INFO:teuthology.orchestra.run.smithi086.stdout:Architecture: amd64 2024-04-18T14:30:05.002 INFO:teuthology.orchestra.run.smithi086.stdout:Source: linux-meta 2024-04-18T14:30:05.002 INFO:teuthology.orchestra.run.smithi086.stdout:Version: 5.15.0.102.99 2024-04-18T14:30:05.003 INFO:teuthology.orchestra.run.smithi086.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.3), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-102), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.3) 2024-04-18T14:30:05.003 INFO:teuthology.orchestra.run.smithi086.stdout:Depends: linux-image-5.15.0-102-generic, linux-modules-extra-5.15.0-102-generic, linux-firmware, intel-microcode, amd64-microcode 2024-04-18T14:30:05.003 INFO:teuthology.orchestra.run.smithi086.stdout:Recommends: thermald 2024-04-18T14:30:05.003 INFO:teuthology.orchestra.run.smithi086.stdout:Description: Generic Linux kernel image 2024-04-18T14:30:05.003 INFO:teuthology.orchestra.run.smithi086.stdout: This package will always depend on the latest generic kernel image 2024-04-18T14:30:05.003 INFO:teuthology.orchestra.run.smithi086.stdout: available. 2024-04-18T14:30:05.003 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.15.0-56-generic Expected: 5.15.0-102-generic 2024-04-18T14:30:05.003 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-04-18T14:30:05.003 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-04-18T14:30:05.003 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2024-04-18T14:30:05.003 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi086.front.sepia.ceph.com, path=None, version=distro) 2024-04-18T14:30:05.003 DEBUG:teuthology.orchestra.run.smithi086:> sudo apt-get clean 2024-04-18T14:30:05.082 INFO:teuthology.orchestra.run.smithi119.stdout:/etc/kernel/postinst.d/zz-update-grub: 2024-04-18T14:30:05.082 INFO:teuthology.orchestra.run.smithi119.stdout:Sourcing file `/etc/default/grub' 2024-04-18T14:30:05.115 INFO:teuthology.orchestra.run.smithi119.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-04-18T14:30:05.134 INFO:teuthology.orchestra.run.smithi119.stdout:Generating grub configuration file ... 2024-04-18T14:30:05.177 DEBUG:teuthology.orchestra.run.smithi086:> sudo apt-get update 2024-04-18T14:30:05.321 INFO:teuthology.orchestra.run.smithi086.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-04-18T14:30:05.321 INFO:teuthology.orchestra.run.smithi086.stdout:Hit:2 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-04-18T14:30:05.333 INFO:teuthology.orchestra.run.smithi086.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-04-18T14:30:05.355 INFO:teuthology.orchestra.run.smithi086.stdout:Hit:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-04-18T14:30:05.467 INFO:teuthology.orchestra.run.smithi119.stdout:Found linux image: /boot/vmlinuz-5.15.0-102-generic 2024-04-18T14:30:05.491 INFO:teuthology.orchestra.run.smithi119.stdout:Found initrd image: /boot/initrd.img-5.15.0-102-generic 2024-04-18T14:30:05.833 INFO:teuthology.orchestra.run.smithi119.stdout:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-04-18T14:30:05.839 INFO:teuthology.orchestra.run.smithi119.stdout:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-04-18T14:30:05.885 INFO:teuthology.orchestra.run.smithi134.stdout:Reading package lists... 2024-04-18T14:30:05.904 DEBUG:teuthology.orchestra.run.smithi134:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-04-18T14:30:05.911 INFO:teuthology.orchestra.run.smithi119.stdout:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-04-18T14:30:05.918 INFO:teuthology.orchestra.run.smithi119.stdout:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-04-18T14:30:05.944 INFO:teuthology.orchestra.run.smithi096.stdout:Reading package lists... 2024-04-18T14:30:05.956 INFO:teuthology.orchestra.run.smithi134.stdout:Reading package lists... 2024-04-18T14:30:05.963 DEBUG:teuthology.orchestra.run.smithi096:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-04-18T14:30:06.014 INFO:teuthology.orchestra.run.smithi096.stdout:Reading package lists... 2024-04-18T14:30:06.139 INFO:teuthology.orchestra.run.smithi134.stdout:Building dependency tree... 2024-04-18T14:30:06.139 INFO:teuthology.orchestra.run.smithi134.stdout:Reading state information... 2024-04-18T14:30:06.140 INFO:teuthology.orchestra.run.smithi119.stdout:Warning: os-prober will not be executed to detect other bootable partitions. 2024-04-18T14:30:06.140 INFO:teuthology.orchestra.run.smithi119.stdout:Systems on them will not be added to the GRUB boot configuration. 2024-04-18T14:30:06.140 INFO:teuthology.orchestra.run.smithi119.stdout:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-04-18T14:30:06.174 INFO:teuthology.orchestra.run.smithi119.stdout:done 2024-04-18T14:30:06.190 INFO:teuthology.orchestra.run.smithi096.stdout:Building dependency tree... 2024-04-18T14:30:06.190 INFO:teuthology.orchestra.run.smithi096.stdout:Reading state information... 2024-04-18T14:30:06.298 INFO:teuthology.orchestra.run.smithi134.stdout:linux-image-generic is already the newest version (5.15.0.102.99). 2024-04-18T14:30:06.299 INFO:teuthology.orchestra.run.smithi134.stdout:The following packages were automatically installed and are no longer required: 2024-04-18T14:30:06.299 INFO:teuthology.orchestra.run.smithi134.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-04-18T14:30:06.299 INFO:teuthology.orchestra.run.smithi134.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-04-18T14:30:06.299 INFO:teuthology.orchestra.run.smithi134.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-04-18T14:30:06.300 INFO:teuthology.orchestra.run.smithi134.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-04-18T14:30:06.300 INFO:teuthology.orchestra.run.smithi134.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-04-18T14:30:06.300 INFO:teuthology.orchestra.run.smithi134.stdout:Use 'sudo apt autoremove' to remove them. 2024-04-18T14:30:06.337 INFO:teuthology.orchestra.run.smithi134.stdout:0 upgraded, 0 newly installed, 0 to remove and 315 not upgraded. 2024-04-18T14:30:06.339 DEBUG:teuthology.orchestra.run.smithi134:> dpkg -s linux-image-generic 2024-04-18T14:30:06.343 INFO:teuthology.orchestra.run.smithi096.stdout:linux-image-generic is already the newest version (5.15.0.102.99). 2024-04-18T14:30:06.343 INFO:teuthology.orchestra.run.smithi096.stdout:The following packages were automatically installed and are no longer required: 2024-04-18T14:30:06.343 INFO:teuthology.orchestra.run.smithi096.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-04-18T14:30:06.343 INFO:teuthology.orchestra.run.smithi096.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-04-18T14:30:06.343 INFO:teuthology.orchestra.run.smithi096.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-04-18T14:30:06.344 INFO:teuthology.orchestra.run.smithi096.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-04-18T14:30:06.344 INFO:teuthology.orchestra.run.smithi096.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-04-18T14:30:06.344 INFO:teuthology.orchestra.run.smithi096.stdout:Use 'sudo apt autoremove' to remove them. 2024-04-18T14:30:06.384 INFO:teuthology.orchestra.run.smithi096.stdout:0 upgraded, 0 newly installed, 0 to remove and 315 not upgraded. 2024-04-18T14:30:06.386 DEBUG:teuthology.orchestra.run.smithi096:> dpkg -s linux-image-generic 2024-04-18T14:30:06.399 INFO:teuthology.orchestra.run.smithi134.stdout:Package: linux-image-generic 2024-04-18T14:30:06.400 INFO:teuthology.orchestra.run.smithi134.stdout:Status: install ok installed 2024-04-18T14:30:06.400 INFO:teuthology.orchestra.run.smithi134.stdout:Priority: optional 2024-04-18T14:30:06.400 INFO:teuthology.orchestra.run.smithi134.stdout:Section: kernel 2024-04-18T14:30:06.400 INFO:teuthology.orchestra.run.smithi134.stdout:Installed-Size: 21 2024-04-18T14:30:06.400 INFO:teuthology.orchestra.run.smithi134.stdout:Maintainer: Ubuntu Kernel Team 2024-04-18T14:30:06.400 INFO:teuthology.orchestra.run.smithi134.stdout:Architecture: amd64 2024-04-18T14:30:06.400 INFO:teuthology.orchestra.run.smithi134.stdout:Source: linux-meta 2024-04-18T14:30:06.400 INFO:teuthology.orchestra.run.smithi134.stdout:Version: 5.15.0.102.99 2024-04-18T14:30:06.400 INFO:teuthology.orchestra.run.smithi134.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.3), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-102), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.3) 2024-04-18T14:30:06.400 INFO:teuthology.orchestra.run.smithi134.stdout:Depends: linux-image-5.15.0-102-generic, linux-modules-extra-5.15.0-102-generic, linux-firmware, intel-microcode, amd64-microcode 2024-04-18T14:30:06.400 INFO:teuthology.orchestra.run.smithi134.stdout:Recommends: thermald 2024-04-18T14:30:06.400 INFO:teuthology.orchestra.run.smithi134.stdout:Description: Generic Linux kernel image 2024-04-18T14:30:06.400 INFO:teuthology.orchestra.run.smithi134.stdout: This package will always depend on the latest generic kernel image 2024-04-18T14:30:06.401 INFO:teuthology.orchestra.run.smithi134.stdout: available. 2024-04-18T14:30:06.401 DEBUG:teuthology.orchestra.run.smithi134:> mktemp 2024-04-18T14:30:06.445 INFO:teuthology.orchestra.run.smithi134.stdout:/tmp/tmp.3aMfjWHQYt 2024-04-18T14:30:06.445 DEBUG:teuthology.orchestra.run.smithi134:> sudo cp /boot/grub/grub.cfg /tmp/tmp.3aMfjWHQYt 2024-04-18T14:30:06.446 INFO:teuthology.orchestra.run.smithi096.stdout:Package: linux-image-generic 2024-04-18T14:30:06.446 INFO:teuthology.orchestra.run.smithi096.stdout:Status: install ok installed 2024-04-18T14:30:06.447 INFO:teuthology.orchestra.run.smithi096.stdout:Priority: optional 2024-04-18T14:30:06.447 INFO:teuthology.orchestra.run.smithi096.stdout:Section: kernel 2024-04-18T14:30:06.447 INFO:teuthology.orchestra.run.smithi096.stdout:Installed-Size: 21 2024-04-18T14:30:06.447 INFO:teuthology.orchestra.run.smithi096.stdout:Maintainer: Ubuntu Kernel Team 2024-04-18T14:30:06.447 INFO:teuthology.orchestra.run.smithi096.stdout:Architecture: amd64 2024-04-18T14:30:06.447 INFO:teuthology.orchestra.run.smithi096.stdout:Source: linux-meta 2024-04-18T14:30:06.447 INFO:teuthology.orchestra.run.smithi096.stdout:Version: 5.15.0.102.99 2024-04-18T14:30:06.447 INFO:teuthology.orchestra.run.smithi096.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.3), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-102), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.3) 2024-04-18T14:30:06.447 INFO:teuthology.orchestra.run.smithi096.stdout:Depends: linux-image-5.15.0-102-generic, linux-modules-extra-5.15.0-102-generic, linux-firmware, intel-microcode, amd64-microcode 2024-04-18T14:30:06.447 INFO:teuthology.orchestra.run.smithi096.stdout:Recommends: thermald 2024-04-18T14:30:06.447 INFO:teuthology.orchestra.run.smithi096.stdout:Description: Generic Linux kernel image 2024-04-18T14:30:06.447 INFO:teuthology.orchestra.run.smithi096.stdout: This package will always depend on the latest generic kernel image 2024-04-18T14:30:06.447 INFO:teuthology.orchestra.run.smithi096.stdout: available. 2024-04-18T14:30:06.448 DEBUG:teuthology.orchestra.run.smithi096:> mktemp 2024-04-18T14:30:06.492 INFO:teuthology.orchestra.run.smithi096.stdout:/tmp/tmp.4DZddsuzbY 2024-04-18T14:30:06.492 DEBUG:teuthology.orchestra.run.smithi096:> sudo cp /boot/grub/grub.cfg /tmp/tmp.4DZddsuzbY 2024-04-18T14:30:06.501 DEBUG:teuthology.orchestra.run.smithi134:> sudo chmod 0666 /tmp/tmp.3aMfjWHQYt 2024-04-18T14:30:06.548 DEBUG:teuthology.orchestra.run.smithi096:> sudo chmod 0666 /tmp/tmp.4DZddsuzbY 2024-04-18T14:30:06.616 DEBUG:teuthology.orchestra.remote:smithi134:/tmp/tmp.3aMfjWHQYt is 10KB 2024-04-18T14:30:06.618 DEBUG:teuthology.orchestra.run.smithi119:> dpkg -s linux-image-generic 2024-04-18T14:30:06.630 DEBUG:teuthology.orchestra.run.smithi134:> rm -fr /tmp/tmp.3aMfjWHQYt 2024-04-18T14:30:06.636 DEBUG:teuthology.orchestra.run.smithi134:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2024-04-18T14:30:06.638 INFO:teuthology.orchestra.run.smithi119.stdout:Package: linux-image-generic 2024-04-18T14:30:06.638 INFO:teuthology.orchestra.run.smithi119.stdout:Status: install ok installed 2024-04-18T14:30:06.639 INFO:teuthology.orchestra.run.smithi119.stdout:Priority: optional 2024-04-18T14:30:06.639 INFO:teuthology.orchestra.run.smithi119.stdout:Section: kernel 2024-04-18T14:30:06.639 INFO:teuthology.orchestra.run.smithi119.stdout:Installed-Size: 21 2024-04-18T14:30:06.639 INFO:teuthology.orchestra.run.smithi119.stdout:Maintainer: Ubuntu Kernel Team 2024-04-18T14:30:06.639 INFO:teuthology.orchestra.run.smithi119.stdout:Architecture: amd64 2024-04-18T14:30:06.639 INFO:teuthology.orchestra.run.smithi119.stdout:Source: linux-meta 2024-04-18T14:30:06.639 INFO:teuthology.orchestra.run.smithi119.stdout:Version: 5.15.0.102.99 2024-04-18T14:30:06.639 INFO:teuthology.orchestra.run.smithi119.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.3), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-102), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.3) 2024-04-18T14:30:06.639 INFO:teuthology.orchestra.run.smithi119.stdout:Depends: linux-image-5.15.0-102-generic, linux-modules-extra-5.15.0-102-generic, linux-firmware, intel-microcode, amd64-microcode 2024-04-18T14:30:06.639 INFO:teuthology.orchestra.run.smithi119.stdout:Recommends: thermald 2024-04-18T14:30:06.639 INFO:teuthology.orchestra.run.smithi119.stdout:Description: Generic Linux kernel image 2024-04-18T14:30:06.639 INFO:teuthology.orchestra.run.smithi119.stdout: This package will always depend on the latest generic kernel image 2024-04-18T14:30:06.639 INFO:teuthology.orchestra.run.smithi119.stdout: available. 2024-04-18T14:30:06.639 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.15.0-56-generic Expected: 5.15.0-102-generic 2024-04-18T14:30:06.640 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-04-18T14:30:06.640 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-04-18T14:30:06.640 INFO:teuthology.task.kernel:Installing distro kernel on mon.c... 2024-04-18T14:30:06.640 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi119.front.sepia.ceph.com, path=None, version=distro) 2024-04-18T14:30:06.640 DEBUG:teuthology.orchestra.run.smithi119:> sudo apt-get clean 2024-04-18T14:30:06.681 DEBUG:teuthology.orchestra.remote:smithi096:/tmp/tmp.4DZddsuzbY is 10KB 2024-04-18T14:30:06.688 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-04-18T14:30:06.688 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd of=/etc/grub.d/01_ceph_kernel 2024-04-18T14:30:06.688 DEBUG:teuthology.orchestra.run.smithi134:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2024-04-18T14:30:06.694 DEBUG:teuthology.orchestra.run.smithi096:> rm -fr /tmp/tmp.4DZddsuzbY 2024-04-18T14:30:06.701 DEBUG:teuthology.orchestra.run.smithi096:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2024-04-18T14:30:06.710 INFO:teuthology.orchestra.run.smithi086.stdout:Reading package lists... 2024-04-18T14:30:06.728 DEBUG:teuthology.orchestra.run.smithi086:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-04-18T14:30:06.750 INFO:teuthology.task.kernel:Distro Kernel Version: 5.15.0-102-generic 2024-04-18T14:30:06.750 DEBUG:teuthology.orchestra.run.smithi134:> sudo update-grub 2024-04-18T14:30:06.757 DEBUG:teuthology.orchestra.run.smithi096:> set -ex 2024-04-18T14:30:06.757 DEBUG:teuthology.orchestra.run.smithi096:> sudo dd of=/etc/grub.d/01_ceph_kernel 2024-04-18T14:30:06.757 DEBUG:teuthology.orchestra.run.smithi096:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2024-04-18T14:30:06.791 INFO:teuthology.orchestra.run.smithi086.stdout:Reading package lists... 2024-04-18T14:30:06.831 DEBUG:teuthology.orchestra.run.smithi119:> sudo apt-get update 2024-04-18T14:30:06.835 INFO:teuthology.task.kernel:Distro Kernel Version: 5.15.0-102-generic 2024-04-18T14:30:06.835 DEBUG:teuthology.orchestra.run.smithi096:> sudo update-grub 2024-04-18T14:30:06.992 INFO:teuthology.orchestra.run.smithi086.stdout:Building dependency tree... 2024-04-18T14:30:06.993 INFO:teuthology.orchestra.run.smithi086.stdout:Reading state information... 2024-04-18T14:30:07.075 INFO:teuthology.orchestra.run.smithi119.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-04-18T14:30:07.075 INFO:teuthology.orchestra.run.smithi119.stdout:Hit:2 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-04-18T14:30:07.141 INFO:teuthology.orchestra.run.smithi119.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-04-18T14:30:07.171 INFO:teuthology.orchestra.run.smithi086.stdout:linux-image-generic is already the newest version (5.15.0.102.99). 2024-04-18T14:30:07.171 INFO:teuthology.orchestra.run.smithi086.stdout:The following packages were automatically installed and are no longer required: 2024-04-18T14:30:07.171 INFO:teuthology.orchestra.run.smithi086.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-04-18T14:30:07.171 INFO:teuthology.orchestra.run.smithi086.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-04-18T14:30:07.171 INFO:teuthology.orchestra.run.smithi086.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-04-18T14:30:07.172 INFO:teuthology.orchestra.run.smithi086.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-04-18T14:30:07.172 INFO:teuthology.orchestra.run.smithi086.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-04-18T14:30:07.172 INFO:teuthology.orchestra.run.smithi086.stdout:Use 'sudo apt autoremove' to remove them. 2024-04-18T14:30:07.214 INFO:teuthology.orchestra.run.smithi086.stdout:0 upgraded, 0 newly installed, 0 to remove and 315 not upgraded. 2024-04-18T14:30:07.216 DEBUG:teuthology.orchestra.run.smithi086:> dpkg -s linux-image-generic 2024-04-18T14:30:07.223 INFO:teuthology.orchestra.run.smithi119.stdout:Hit:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-04-18T14:30:07.232 INFO:teuthology.orchestra.run.smithi086.stdout:Package: linux-image-generic 2024-04-18T14:30:07.232 INFO:teuthology.orchestra.run.smithi086.stdout:Status: install ok installed 2024-04-18T14:30:07.233 INFO:teuthology.orchestra.run.smithi086.stdout:Priority: optional 2024-04-18T14:30:07.233 INFO:teuthology.orchestra.run.smithi086.stdout:Section: kernel 2024-04-18T14:30:07.233 INFO:teuthology.orchestra.run.smithi086.stdout:Installed-Size: 21 2024-04-18T14:30:07.233 INFO:teuthology.orchestra.run.smithi086.stdout:Maintainer: Ubuntu Kernel Team 2024-04-18T14:30:07.233 INFO:teuthology.orchestra.run.smithi086.stdout:Architecture: amd64 2024-04-18T14:30:07.233 INFO:teuthology.orchestra.run.smithi086.stdout:Source: linux-meta 2024-04-18T14:30:07.233 INFO:teuthology.orchestra.run.smithi086.stdout:Version: 5.15.0.102.99 2024-04-18T14:30:07.233 INFO:teuthology.orchestra.run.smithi086.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.3), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-102), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.3) 2024-04-18T14:30:07.233 INFO:teuthology.orchestra.run.smithi086.stdout:Depends: linux-image-5.15.0-102-generic, linux-modules-extra-5.15.0-102-generic, linux-firmware, intel-microcode, amd64-microcode 2024-04-18T14:30:07.233 INFO:teuthology.orchestra.run.smithi086.stdout:Recommends: thermald 2024-04-18T14:30:07.233 INFO:teuthology.orchestra.run.smithi086.stdout:Description: Generic Linux kernel image 2024-04-18T14:30:07.233 INFO:teuthology.orchestra.run.smithi086.stdout: This package will always depend on the latest generic kernel image 2024-04-18T14:30:07.233 INFO:teuthology.orchestra.run.smithi086.stdout: available. 2024-04-18T14:30:07.234 DEBUG:teuthology.orchestra.run.smithi086:> mktemp 2024-04-18T14:30:07.282 INFO:teuthology.orchestra.run.smithi086.stdout:/tmp/tmp.ig6gpHHujm 2024-04-18T14:30:07.282 DEBUG:teuthology.orchestra.run.smithi086:> sudo cp /boot/grub/grub.cfg /tmp/tmp.ig6gpHHujm 2024-04-18T14:30:07.349 DEBUG:teuthology.orchestra.run.smithi086:> sudo chmod 0666 /tmp/tmp.ig6gpHHujm 2024-04-18T14:30:07.474 DEBUG:teuthology.orchestra.remote:smithi086:/tmp/tmp.ig6gpHHujm is 10KB 2024-04-18T14:30:07.487 DEBUG:teuthology.orchestra.run.smithi086:> rm -fr /tmp/tmp.ig6gpHHujm 2024-04-18T14:30:07.493 DEBUG:teuthology.orchestra.run.smithi086:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2024-04-18T14:30:07.546 DEBUG:teuthology.orchestra.run.smithi086:> set -ex 2024-04-18T14:30:07.547 DEBUG:teuthology.orchestra.run.smithi086:> sudo dd of=/etc/grub.d/01_ceph_kernel 2024-04-18T14:30:07.547 DEBUG:teuthology.orchestra.run.smithi086:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2024-04-18T14:30:07.623 INFO:teuthology.task.kernel:Distro Kernel Version: 5.15.0-102-generic 2024-04-18T14:30:07.623 DEBUG:teuthology.orchestra.run.smithi086:> sudo update-grub 2024-04-18T14:30:08.158 INFO:teuthology.orchestra.run.smithi134.stderr:Sourcing file `/etc/default/grub' 2024-04-18T14:30:08.158 INFO:teuthology.orchestra.run.smithi134.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-04-18T14:30:08.165 INFO:teuthology.orchestra.run.smithi134.stderr:Generating grub configuration file ... 2024-04-18T14:30:08.257 INFO:teuthology.orchestra.run.smithi096.stderr:Sourcing file `/etc/default/grub' 2024-04-18T14:30:08.258 INFO:teuthology.orchestra.run.smithi096.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-04-18T14:30:08.262 INFO:teuthology.orchestra.run.smithi096.stderr:Generating grub configuration file ... 2024-04-18T14:30:08.442 INFO:teuthology.orchestra.run.smithi134.stderr:Found linux image: /boot/vmlinuz-5.15.0-102-generic 2024-04-18T14:30:08.448 INFO:teuthology.orchestra.run.smithi134.stderr:Found initrd image: /boot/initrd.img-5.15.0-102-generic 2024-04-18T14:30:08.459 INFO:teuthology.orchestra.run.smithi119.stdout:Reading package lists... 2024-04-18T14:30:08.478 DEBUG:teuthology.orchestra.run.smithi119:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-04-18T14:30:08.540 INFO:teuthology.orchestra.run.smithi119.stdout:Reading package lists... 2024-04-18T14:30:08.581 INFO:teuthology.orchestra.run.smithi096.stderr:Found linux image: /boot/vmlinuz-5.15.0-102-generic 2024-04-18T14:30:08.587 INFO:teuthology.orchestra.run.smithi096.stderr:Found initrd image: /boot/initrd.img-5.15.0-102-generic 2024-04-18T14:30:08.682 INFO:teuthology.orchestra.run.smithi134.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-04-18T14:30:08.688 INFO:teuthology.orchestra.run.smithi134.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-04-18T14:30:08.729 INFO:teuthology.orchestra.run.smithi134.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-04-18T14:30:08.734 INFO:teuthology.orchestra.run.smithi134.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-04-18T14:30:08.740 INFO:teuthology.orchestra.run.smithi119.stdout:Building dependency tree... 2024-04-18T14:30:08.741 INFO:teuthology.orchestra.run.smithi119.stdout:Reading state information... 2024-04-18T14:30:08.741 INFO:teuthology.orchestra.run.smithi086.stderr:Sourcing file `/etc/default/grub' 2024-04-18T14:30:08.742 INFO:teuthology.orchestra.run.smithi086.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-04-18T14:30:08.745 INFO:teuthology.orchestra.run.smithi086.stderr:Generating grub configuration file ... 2024-04-18T14:30:08.853 INFO:teuthology.orchestra.run.smithi134.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-04-18T14:30:08.854 INFO:teuthology.orchestra.run.smithi134.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-04-18T14:30:08.854 INFO:teuthology.orchestra.run.smithi134.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-04-18T14:30:08.883 INFO:teuthology.orchestra.run.smithi134.stderr:done 2024-04-18T14:30:08.892 DEBUG:teuthology.orchestra.run.smithi134:> sudo shutdown -r now 2024-04-18T14:30:08.914 INFO:teuthology.orchestra.run.smithi119.stdout:linux-image-generic is already the newest version (5.15.0.102.99). 2024-04-18T14:30:08.914 INFO:teuthology.orchestra.run.smithi119.stdout:The following packages were automatically installed and are no longer required: 2024-04-18T14:30:08.914 INFO:teuthology.orchestra.run.smithi119.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-04-18T14:30:08.915 INFO:teuthology.orchestra.run.smithi119.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-04-18T14:30:08.915 INFO:teuthology.orchestra.run.smithi119.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-04-18T14:30:08.915 INFO:teuthology.orchestra.run.smithi119.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-04-18T14:30:08.915 INFO:teuthology.orchestra.run.smithi119.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-04-18T14:30:08.915 INFO:teuthology.orchestra.run.smithi119.stdout:Use 'sudo apt autoremove' to remove them. 2024-04-18T14:30:08.915 INFO:teuthology.orchestra.run.smithi096.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-04-18T14:30:08.920 INFO:teuthology.orchestra.run.smithi096.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-04-18T14:30:08.935 INFO:teuthology.orchestra.run.smithi086.stderr:Found linux image: /boot/vmlinuz-5.15.0-102-generic 2024-04-18T14:30:08.941 INFO:teuthology.orchestra.run.smithi086.stderr:Found initrd image: /boot/initrd.img-5.15.0-102-generic 2024-04-18T14:30:08.956 INFO:teuthology.orchestra.run.smithi119.stdout:0 upgraded, 0 newly installed, 0 to remove and 315 not upgraded. 2024-04-18T14:30:08.958 DEBUG:teuthology.orchestra.run.smithi119:> dpkg -s linux-image-generic 2024-04-18T14:30:08.962 INFO:teuthology.orchestra.run.smithi096.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-04-18T14:30:08.967 INFO:teuthology.orchestra.run.smithi096.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-04-18T14:30:08.973 INFO:teuthology.orchestra.run.smithi119.stdout:Package: linux-image-generic 2024-04-18T14:30:08.973 INFO:teuthology.orchestra.run.smithi119.stdout:Status: install ok installed 2024-04-18T14:30:08.973 INFO:teuthology.orchestra.run.smithi119.stdout:Priority: optional 2024-04-18T14:30:08.973 INFO:teuthology.orchestra.run.smithi119.stdout:Section: kernel 2024-04-18T14:30:08.973 INFO:teuthology.orchestra.run.smithi119.stdout:Installed-Size: 21 2024-04-18T14:30:08.973 INFO:teuthology.orchestra.run.smithi119.stdout:Maintainer: Ubuntu Kernel Team 2024-04-18T14:30:08.973 INFO:teuthology.orchestra.run.smithi119.stdout:Architecture: amd64 2024-04-18T14:30:08.973 INFO:teuthology.orchestra.run.smithi119.stdout:Source: linux-meta 2024-04-18T14:30:08.973 INFO:teuthology.orchestra.run.smithi119.stdout:Version: 5.15.0.102.99 2024-04-18T14:30:08.974 INFO:teuthology.orchestra.run.smithi119.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.3), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-102), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.3) 2024-04-18T14:30:08.974 INFO:teuthology.orchestra.run.smithi119.stdout:Depends: linux-image-5.15.0-102-generic, linux-modules-extra-5.15.0-102-generic, linux-firmware, intel-microcode, amd64-microcode 2024-04-18T14:30:08.974 INFO:teuthology.orchestra.run.smithi119.stdout:Recommends: thermald 2024-04-18T14:30:08.974 INFO:teuthology.orchestra.run.smithi119.stdout:Description: Generic Linux kernel image 2024-04-18T14:30:08.974 INFO:teuthology.orchestra.run.smithi119.stdout: This package will always depend on the latest generic kernel image 2024-04-18T14:30:08.974 INFO:teuthology.orchestra.run.smithi119.stdout: available. 2024-04-18T14:30:08.975 DEBUG:teuthology.orchestra.run.smithi119:> mktemp 2024-04-18T14:30:09.023 INFO:teuthology.orchestra.run.smithi119.stdout:/tmp/tmp.lzd5hjfgJO 2024-04-18T14:30:09.024 DEBUG:teuthology.orchestra.run.smithi119:> sudo cp /boot/grub/grub.cfg /tmp/tmp.lzd5hjfgJO 2024-04-18T14:30:09.079 DEBUG:teuthology.orchestra.run.smithi119:> sudo chmod 0666 /tmp/tmp.lzd5hjfgJO 2024-04-18T14:30:09.119 INFO:teuthology.orchestra.run.smithi096.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-04-18T14:30:09.119 INFO:teuthology.orchestra.run.smithi096.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-04-18T14:30:09.119 INFO:teuthology.orchestra.run.smithi096.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-04-18T14:30:09.132 INFO:teuthology.orchestra.run.smithi096.stderr:done 2024-04-18T14:30:09.135 DEBUG:teuthology.orchestra.run.smithi096:> sudo shutdown -r now 2024-04-18T14:30:09.202 DEBUG:teuthology.orchestra.remote:smithi119:/tmp/tmp.lzd5hjfgJO is 10KB 2024-04-18T14:30:09.214 DEBUG:teuthology.orchestra.run.smithi119:> rm -fr /tmp/tmp.lzd5hjfgJO 2024-04-18T14:30:09.216 INFO:teuthology.orchestra.run.smithi086.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-04-18T14:30:09.220 DEBUG:teuthology.orchestra.run.smithi119:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2024-04-18T14:30:09.221 INFO:teuthology.orchestra.run.smithi086.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-04-18T14:30:09.260 INFO:teuthology.orchestra.run.smithi086.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-04-18T14:30:09.265 INFO:teuthology.orchestra.run.smithi086.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-04-18T14:30:09.275 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2024-04-18T14:30:09.275 DEBUG:teuthology.orchestra.run.smithi119:> sudo dd of=/etc/grub.d/01_ceph_kernel 2024-04-18T14:30:09.275 DEBUG:teuthology.orchestra.run.smithi119:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2024-04-18T14:30:09.358 INFO:teuthology.task.kernel:Distro Kernel Version: 5.15.0-102-generic 2024-04-18T14:30:09.358 DEBUG:teuthology.orchestra.run.smithi119:> sudo update-grub 2024-04-18T14:30:09.387 INFO:teuthology.orchestra.run.smithi086.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-04-18T14:30:09.387 INFO:teuthology.orchestra.run.smithi086.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-04-18T14:30:09.387 INFO:teuthology.orchestra.run.smithi086.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-04-18T14:30:09.401 INFO:teuthology.orchestra.run.smithi086.stderr:done 2024-04-18T14:30:09.411 DEBUG:teuthology.orchestra.run.smithi086:> sudo shutdown -r now 2024-04-18T14:30:10.710 INFO:teuthology.orchestra.run.smithi119.stderr:Sourcing file `/etc/default/grub' 2024-04-18T14:30:10.712 INFO:teuthology.orchestra.run.smithi119.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-04-18T14:30:10.723 INFO:teuthology.orchestra.run.smithi119.stderr:Generating grub configuration file ... 2024-04-18T14:30:10.991 INFO:teuthology.orchestra.run.smithi119.stderr:Found linux image: /boot/vmlinuz-5.15.0-102-generic 2024-04-18T14:30:10.998 INFO:teuthology.orchestra.run.smithi119.stderr:Found initrd image: /boot/initrd.img-5.15.0-102-generic 2024-04-18T14:30:11.271 INFO:teuthology.orchestra.run.smithi119.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-04-18T14:30:11.276 INFO:teuthology.orchestra.run.smithi119.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-04-18T14:30:11.318 INFO:teuthology.orchestra.run.smithi119.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-04-18T14:30:11.324 INFO:teuthology.orchestra.run.smithi119.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-04-18T14:30:11.453 INFO:teuthology.orchestra.run.smithi119.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-04-18T14:30:11.454 INFO:teuthology.orchestra.run.smithi119.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-04-18T14:30:11.454 INFO:teuthology.orchestra.run.smithi119.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-04-18T14:30:11.464 INFO:teuthology.orchestra.run.smithi119.stderr:done 2024-04-18T14:30:11.466 DEBUG:teuthology.orchestra.run.smithi119:> sudo shutdown -r now 2024-04-18T14:30:38.962 INFO:teuthology.task.kernel:Checking client mgr.x for new kernel version... 2024-04-18T14:30:38.962 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi134.front.sepia.ceph.com' 2024-04-18T14:30:38.963 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi134.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T14:30:39.178 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2024-04-18T14:30:39.178 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi096.front.sepia.ceph.com' 2024-04-18T14:30:39.179 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi096.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T14:30:39.413 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-04-18T14:30:39.414 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi086.front.sepia.ceph.com' 2024-04-18T14:30:39.414 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi086.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T14:30:41.514 INFO:teuthology.task.kernel:Checking client mon.c for new kernel version... 2024-04-18T14:30:41.514 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi119.front.sepia.ceph.com' 2024-04-18T14:30:41.515 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T14:31:13.694 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.96 2024-04-18T14:31:13.950 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.86 2024-04-18T14:31:16.002 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.119 2024-04-18T14:31:22.702 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi096.front.sepia.ceph.com' 2024-04-18T14:31:22.703 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi096.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T14:31:22.951 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi086.front.sepia.ceph.com' 2024-04-18T14:31:22.952 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi086.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T14:31:25.005 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi119.front.sepia.ceph.com' 2024-04-18T14:31:25.006 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T14:31:38.978 DEBUG:teuthology.orchestra.remote:timed out 2024-04-18T14:31:41.086 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.96 2024-04-18T14:31:41.346 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.86 2024-04-18T14:31:43.390 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.119 2024-04-18T14:31:47.982 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi134.front.sepia.ceph.com' 2024-04-18T14:31:47.983 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi134.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T14:31:47.984 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.134 2024-04-18T14:31:53.090 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi096.front.sepia.ceph.com' 2024-04-18T14:31:53.091 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi096.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T14:31:53.347 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi086.front.sepia.ceph.com' 2024-04-18T14:31:53.347 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi086.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T14:31:53.465 DEBUG:teuthology.orchestra.run.smithi096:> true 2024-04-18T14:31:53.841 DEBUG:teuthology.orchestra.run.smithi086:> true 2024-04-18T14:31:54.280 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi096.front.sepia.ceph.com' 2024-04-18T14:31:54.280 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.15.0-102-generic"... 2024-04-18T14:31:54.280 DEBUG:teuthology.orchestra.run.smithi096:> uname -r 2024-04-18T14:31:54.327 INFO:teuthology.orchestra.run.smithi096.stdout:5.15.0-102-generic 2024-04-18T14:31:54.327 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-102-generic vs 5.15.0-102-generic 2024-04-18T14:31:54.327 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-04-18T14:31:54.327 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-04-18T14:31:55.019 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi086.front.sepia.ceph.com' 2024-04-18T14:31:55.019 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.15.0-102-generic"... 2024-04-18T14:31:55.019 DEBUG:teuthology.orchestra.run.smithi086:> uname -r 2024-04-18T14:31:55.070 INFO:teuthology.orchestra.run.smithi086.stdout:5.15.0-102-generic 2024-04-18T14:31:55.070 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-102-generic vs 5.15.0-102-generic 2024-04-18T14:31:55.070 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-04-18T14:31:55.070 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-04-18T14:31:55.328 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2024-04-18T14:31:55.328 DEBUG:teuthology.orchestra.run.smithi096:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-04-18T14:31:55.391 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi119.front.sepia.ceph.com' 2024-04-18T14:31:55.392 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T14:31:55.393 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.119 2024-04-18T14:31:55.412 INFO:teuthology.orchestra.run.smithi096.stdout:ttyS1 2024-04-18T14:31:55.440 DEBUG:teuthology.parallel:result is None 2024-04-18T14:31:56.072 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2024-04-18T14:31:56.072 DEBUG:teuthology.orchestra.run.smithi086:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-04-18T14:31:56.215 INFO:teuthology.orchestra.run.smithi086.stdout:ttyS1 2024-04-18T14:31:56.248 DEBUG:teuthology.parallel:result is None 2024-04-18T14:31:59.985 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi134.front.sepia.ceph.com' 2024-04-18T14:31:59.986 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi134.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T14:32:00.285 DEBUG:teuthology.orchestra.run.smithi134:> true 2024-04-18T14:32:00.849 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi134.front.sepia.ceph.com' 2024-04-18T14:32:00.849 INFO:teuthology.task.kernel:Checking kernel version of mgr.x, want "5.15.0-102-generic"... 2024-04-18T14:32:00.850 DEBUG:teuthology.orchestra.run.smithi134:> uname -r 2024-04-18T14:32:00.896 INFO:teuthology.orchestra.run.smithi134.stdout:5.15.0-102-generic 2024-04-18T14:32:00.896 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-102-generic vs 5.15.0-102-generic 2024-04-18T14:32:00.897 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-04-18T14:32:00.897 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-04-18T14:32:01.898 INFO:teuthology.task.kernel:Enabling kdb on mgr.x... 2024-04-18T14:32:01.898 DEBUG:teuthology.orchestra.run.smithi134:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-04-18T14:32:02.246 INFO:teuthology.orchestra.run.smithi134.stdout:ttyS1 2024-04-18T14:32:02.270 DEBUG:teuthology.parallel:result is None 2024-04-18T14:32:10.394 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi119.front.sepia.ceph.com' 2024-04-18T14:32:10.395 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T14:32:10.660 DEBUG:teuthology.orchestra.run.smithi119:> true 2024-04-18T14:32:11.218 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi119.front.sepia.ceph.com' 2024-04-18T14:32:11.218 INFO:teuthology.task.kernel:Checking kernel version of mon.c, want "5.15.0-102-generic"... 2024-04-18T14:32:11.218 DEBUG:teuthology.orchestra.run.smithi119:> uname -r 2024-04-18T14:32:11.267 INFO:teuthology.orchestra.run.smithi119.stdout:5.15.0-102-generic 2024-04-18T14:32:11.267 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-102-generic vs 5.15.0-102-generic 2024-04-18T14:32:11.267 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-04-18T14:32:11.267 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-04-18T14:32:12.268 INFO:teuthology.task.kernel:Enabling kdb on mon.c... 2024-04-18T14:32:12.268 DEBUG:teuthology.orchestra.run.smithi119:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-04-18T14:32:12.651 INFO:teuthology.orchestra.run.smithi119.stdout:ttyS1 2024-04-18T14:32:12.683 DEBUG:teuthology.parallel:result is None 2024-04-18T14:32:12.684 INFO:teuthology.run_tasks:Running task internal.base... 2024-04-18T14:32:12.691 INFO:teuthology.task.internal:Creating test directory... 2024-04-18T14:32:12.691 DEBUG:teuthology.orchestra.run.smithi086:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-04-18T14:32:12.694 DEBUG:teuthology.orchestra.run.smithi096:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-04-18T14:32:12.696 DEBUG:teuthology.orchestra.run.smithi119:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-04-18T14:32:12.698 DEBUG:teuthology.orchestra.run.smithi134:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-04-18T14:32:12.705 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-04-18T14:32:12.711 INFO:teuthology.run_tasks:Running task internal.archive... 2024-04-18T14:32:12.719 INFO:teuthology.task.internal:Creating archive directory... 2024-04-18T14:32:12.719 DEBUG:teuthology.orchestra.run.smithi086:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-04-18T14:32:12.743 DEBUG:teuthology.orchestra.run.smithi096:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-04-18T14:32:12.746 DEBUG:teuthology.orchestra.run.smithi119:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-04-18T14:32:12.750 DEBUG:teuthology.orchestra.run.smithi134:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-04-18T14:32:12.844 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-04-18T14:32:12.851 INFO:teuthology.task.internal:Enabling coredump saving... 2024-04-18T14:32:12.851 DEBUG:teuthology.orchestra.run.smithi086:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-04-18T14:32:12.853 DEBUG:teuthology.orchestra.run.smithi096:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-04-18T14:32:12.856 DEBUG:teuthology.orchestra.run.smithi119:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-04-18T14:32:12.859 DEBUG:teuthology.orchestra.run.smithi134:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-04-18T14:32:12.871 INFO:teuthology.orchestra.run.smithi096.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-18T14:32:12.873 INFO:teuthology.orchestra.run.smithi086.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-18T14:32:12.877 INFO:teuthology.orchestra.run.smithi119.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-18T14:32:12.879 INFO:teuthology.orchestra.run.smithi096.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-18T14:32:12.881 INFO:teuthology.orchestra.run.smithi086.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-18T14:32:12.882 INFO:teuthology.orchestra.run.smithi134.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-18T14:32:12.885 INFO:teuthology.orchestra.run.smithi119.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-18T14:32:12.891 INFO:teuthology.orchestra.run.smithi134.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-18T14:32:12.892 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-04-18T14:32:12.900 INFO:teuthology.task.internal:Configuring sudo... 2024-04-18T14:32:12.900 DEBUG:teuthology.orchestra.run.smithi086:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-04-18T14:32:12.927 DEBUG:teuthology.orchestra.run.smithi096:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-04-18T14:32:12.930 DEBUG:teuthology.orchestra.run.smithi119:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-04-18T14:32:12.933 DEBUG:teuthology.orchestra.run.smithi134:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-04-18T14:32:12.953 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-04-18T14:32:12.965 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-04-18T14:32:12.966 DEBUG:teuthology.orchestra.run.smithi086:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-04-18T14:32:12.983 DEBUG:teuthology.orchestra.run.smithi096:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-04-18T14:32:12.992 DEBUG:teuthology.orchestra.run.smithi119:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-04-18T14:32:12.998 DEBUG:teuthology.orchestra.run.smithi134:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-04-18T14:32:13.004 DEBUG:teuthology.orchestra.run.smithi086:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-18T14:32:13.034 DEBUG:teuthology.orchestra.run.smithi086:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-18T14:32:13.082 DEBUG:teuthology.orchestra.run.smithi086:> set -ex 2024-04-18T14:32:13.082 DEBUG:teuthology.orchestra.run.smithi086:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-04-18T14:32:13.144 DEBUG:teuthology.orchestra.run.smithi096:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-18T14:32:13.150 DEBUG:teuthology.orchestra.run.smithi096:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-18T14:32:13.199 DEBUG:teuthology.orchestra.run.smithi096:> set -ex 2024-04-18T14:32:13.199 DEBUG:teuthology.orchestra.run.smithi096:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-04-18T14:32:13.265 DEBUG:teuthology.orchestra.run.smithi119:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-18T14:32:13.271 DEBUG:teuthology.orchestra.run.smithi119:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-18T14:32:13.318 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2024-04-18T14:32:13.318 DEBUG:teuthology.orchestra.run.smithi119:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-04-18T14:32:13.388 DEBUG:teuthology.orchestra.run.smithi134:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-18T14:32:13.394 DEBUG:teuthology.orchestra.run.smithi134:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-18T14:32:13.441 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-04-18T14:32:13.441 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-04-18T14:32:13.507 DEBUG:teuthology.orchestra.run.smithi086:> sudo service rsyslog restart 2024-04-18T14:32:13.510 DEBUG:teuthology.orchestra.run.smithi096:> sudo service rsyslog restart 2024-04-18T14:32:13.512 DEBUG:teuthology.orchestra.run.smithi119:> sudo service rsyslog restart 2024-04-18T14:32:13.515 DEBUG:teuthology.orchestra.run.smithi134:> sudo service rsyslog restart 2024-04-18T14:32:13.591 INFO:teuthology.run_tasks:Running task internal.timer... 2024-04-18T14:32:13.600 INFO:teuthology.task.internal:Starting timer... 2024-04-18T14:32:13.600 INFO:teuthology.run_tasks:Running task pcp... 2024-04-18T14:32:13.691 INFO:teuthology.run_tasks:Running task selinux... 2024-04-18T14:32:13.700 DEBUG:teuthology.task.selinux:Excluding smithi086: OS 'ubuntu' does not support SELinux 2024-04-18T14:32:13.700 DEBUG:teuthology.task.selinux:Excluding smithi096: OS 'ubuntu' does not support SELinux 2024-04-18T14:32:13.700 DEBUG:teuthology.task.selinux:Excluding smithi119: OS 'ubuntu' does not support SELinux 2024-04-18T14:32:13.700 DEBUG:teuthology.task.selinux:Excluding smithi134: OS 'ubuntu' does not support SELinux 2024-04-18T14:32:13.700 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-04-18T14:32:13.700 DEBUG:teuthology.task.selinux:Existing SELinux modes: {} 2024-04-18T14:32:13.700 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-04-18T14:32:13.701 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-04-18T14:32:13.721 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-04-18T14:32:13.741 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-04-18T14:32:13.742 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi086.front.sepia.ceph.com,smithi096.front.sepia.ceph.com,smithi119.front.sepia.ceph.com,smithi134.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-04-18T14:39:28.238 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi086.front.sepia.ceph.com'), Remote(name='ubuntu@smithi096.front.sepia.ceph.com'), Remote(name='ubuntu@smithi119.front.sepia.ceph.com'), Remote(name='ubuntu@smithi134.front.sepia.ceph.com')] 2024-04-18T14:39:28.239 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi086.front.sepia.ceph.com' 2024-04-18T14:39:28.240 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi086.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T14:39:28.319 DEBUG:teuthology.orchestra.run.smithi086:> true 2024-04-18T14:39:28.394 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi086.front.sepia.ceph.com' 2024-04-18T14:39:28.394 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi096.front.sepia.ceph.com' 2024-04-18T14:39:28.395 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi096.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T14:39:28.478 DEBUG:teuthology.orchestra.run.smithi096:> true 2024-04-18T14:39:28.554 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi096.front.sepia.ceph.com' 2024-04-18T14:39:28.555 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi119.front.sepia.ceph.com' 2024-04-18T14:39:28.555 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T14:39:28.635 DEBUG:teuthology.orchestra.run.smithi119:> true 2024-04-18T14:39:28.710 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi119.front.sepia.ceph.com' 2024-04-18T14:39:28.710 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi134.front.sepia.ceph.com' 2024-04-18T14:39:28.711 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi134.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T14:39:28.813 DEBUG:teuthology.orchestra.run.smithi134:> true 2024-04-18T14:39:28.891 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi134.front.sepia.ceph.com' 2024-04-18T14:39:28.892 INFO:teuthology.run_tasks:Running task clock... 2024-04-18T14:39:28.905 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-04-18T14:39:28.905 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-04-18T14:39:28.905 DEBUG:teuthology.orchestra.run.smithi086:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-18T14:39:28.908 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-04-18T14:39:28.908 DEBUG:teuthology.orchestra.run.smithi096:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-18T14:39:28.911 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-04-18T14:39:28.911 DEBUG:teuthology.orchestra.run.smithi119:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-18T14:39:28.914 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-04-18T14:39:28.914 DEBUG:teuthology.orchestra.run.smithi134:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-18T14:39:28.933 INFO:teuthology.orchestra.run.smithi086.stdout:18 Apr 14:39:28 ntpd[17180]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2024-04-18T14:39:28.934 INFO:teuthology.orchestra.run.smithi086.stdout:18 Apr 14:39:28 ntpd[17180]: Command line: ntpd -gq 2024-04-18T14:39:28.934 INFO:teuthology.orchestra.run.smithi086.stdout:18 Apr 14:39:28 ntpd[17180]: ---------------------------------------------------- 2024-04-18T14:39:28.934 INFO:teuthology.orchestra.run.smithi086.stdout:18 Apr 14:39:28 ntpd[17180]: ntp-4 is maintained by Network Time Foundation, 2024-04-18T14:39:28.934 INFO:teuthology.orchestra.run.smithi086.stdout:18 Apr 14:39:28 ntpd[17180]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2024-04-18T14:39:28.934 INFO:teuthology.orchestra.run.smithi086.stdout:18 Apr 14:39:28 ntpd[17180]: corporation. Support and training for ntp-4 are 2024-04-18T14:39:28.934 INFO:teuthology.orchestra.run.smithi086.stdout:18 Apr 14:39:28 ntpd[17180]: available at https://www.nwtime.org/support 2024-04-18T14:39:28.934 INFO:teuthology.orchestra.run.smithi086.stdout:18 Apr 14:39:28 ntpd[17180]: ---------------------------------------------------- 2024-04-18T14:39:28.936 INFO:teuthology.orchestra.run.smithi086.stdout:18 Apr 14:39:28 ntpd[17180]: proto: precision = 0.045 usec (-24) 2024-04-18T14:39:28.936 INFO:teuthology.orchestra.run.smithi086.stdout:18 Apr 14:39:28 ntpd[17180]: basedate set to 2022-02-04 2024-04-18T14:39:28.936 INFO:teuthology.orchestra.run.smithi086.stdout:18 Apr 14:39:28 ntpd[17180]: gps base set to 2022-02-06 (week 2196) 2024-04-18T14:39:28.937 INFO:teuthology.orchestra.run.smithi086.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-04-18T14:39:28.937 INFO:teuthology.orchestra.run.smithi086.stdout:18 Apr 14:39:28 ntpd[17180]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-04-18T14:39:28.937 INFO:teuthology.orchestra.run.smithi086.stdout:18 Apr 14:39:28 ntpd[17180]: restrict ::: KOD does nothing without LIMITED. 2024-04-18T14:39:28.938 INFO:teuthology.orchestra.run.smithi086.stderr:restrict ::: KOD does nothing without LIMITED. 2024-04-18T14:39:28.939 INFO:teuthology.orchestra.run.smithi086.stdout:18 Apr 14:39:28 ntpd[17180]: Listen and drop on 0 v6wildcard [::]:123 2024-04-18T14:39:28.939 INFO:teuthology.orchestra.run.smithi086.stdout:18 Apr 14:39:28 ntpd[17180]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2024-04-18T14:39:28.939 INFO:teuthology.orchestra.run.smithi086.stdout:18 Apr 14:39:28 ntpd[17180]: Listen normally on 2 lo 127.0.0.1:123 2024-04-18T14:39:28.939 INFO:teuthology.orchestra.run.smithi086.stdout:18 Apr 14:39:28 ntpd[17180]: Listen normally on 3 enp3s0f1 172.21.15.86:123 2024-04-18T14:39:28.939 INFO:teuthology.orchestra.run.smithi086.stdout:18 Apr 14:39:28 ntpd[17180]: Listen normally on 4 lo [::1]:123 2024-04-18T14:39:28.940 INFO:teuthology.orchestra.run.smithi086.stdout:18 Apr 14:39:28 ntpd[17180]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe8f:d809%5]:123 2024-04-18T14:39:28.940 INFO:teuthology.orchestra.run.smithi086.stdout:18 Apr 14:39:28 ntpd[17180]: Listening on routing socket on fd #22 for interface updates 2024-04-18T14:39:28.941 INFO:teuthology.orchestra.run.smithi096.stdout:18 Apr 14:39:28 ntpd[17219]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2024-04-18T14:39:28.941 INFO:teuthology.orchestra.run.smithi096.stdout:18 Apr 14:39:28 ntpd[17219]: Command line: ntpd -gq 2024-04-18T14:39:28.942 INFO:teuthology.orchestra.run.smithi096.stdout:18 Apr 14:39:28 ntpd[17219]: ---------------------------------------------------- 2024-04-18T14:39:28.942 INFO:teuthology.orchestra.run.smithi096.stdout:18 Apr 14:39:28 ntpd[17219]: ntp-4 is maintained by Network Time Foundation, 2024-04-18T14:39:28.942 INFO:teuthology.orchestra.run.smithi096.stdout:18 Apr 14:39:28 ntpd[17219]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2024-04-18T14:39:28.942 INFO:teuthology.orchestra.run.smithi096.stdout:18 Apr 14:39:28 ntpd[17219]: corporation. Support and training for ntp-4 are 2024-04-18T14:39:28.942 INFO:teuthology.orchestra.run.smithi096.stdout:18 Apr 14:39:28 ntpd[17219]: available at https://www.nwtime.org/support 2024-04-18T14:39:28.942 INFO:teuthology.orchestra.run.smithi096.stdout:18 Apr 14:39:28 ntpd[17219]: ---------------------------------------------------- 2024-04-18T14:39:28.942 INFO:teuthology.orchestra.run.smithi096.stdout:18 Apr 14:39:28 ntpd[17219]: proto: precision = 0.057 usec (-24) 2024-04-18T14:39:28.942 INFO:teuthology.orchestra.run.smithi096.stdout:18 Apr 14:39:28 ntpd[17219]: basedate set to 2022-02-04 2024-04-18T14:39:28.942 INFO:teuthology.orchestra.run.smithi096.stdout:18 Apr 14:39:28 ntpd[17219]: gps base set to 2022-02-06 (week 2196) 2024-04-18T14:39:28.943 INFO:teuthology.orchestra.run.smithi096.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-04-18T14:39:28.943 INFO:teuthology.orchestra.run.smithi096.stdout:18 Apr 14:39:28 ntpd[17219]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-04-18T14:39:28.943 INFO:teuthology.orchestra.run.smithi096.stdout:18 Apr 14:39:28 ntpd[17219]: restrict ::: KOD does nothing without LIMITED. 2024-04-18T14:39:28.943 INFO:teuthology.orchestra.run.smithi096.stderr:restrict ::: KOD does nothing without LIMITED. 2024-04-18T14:39:28.944 INFO:teuthology.orchestra.run.smithi096.stdout:18 Apr 14:39:28 ntpd[17219]: Listen and drop on 0 v6wildcard [::]:123 2024-04-18T14:39:28.944 INFO:teuthology.orchestra.run.smithi096.stdout:18 Apr 14:39:28 ntpd[17219]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2024-04-18T14:39:28.944 INFO:teuthology.orchestra.run.smithi096.stdout:18 Apr 14:39:28 ntpd[17219]: Listen normally on 2 lo 127.0.0.1:123 2024-04-18T14:39:28.944 INFO:teuthology.orchestra.run.smithi096.stdout:18 Apr 14:39:28 ntpd[17219]: Listen normally on 3 enp3s0f1 172.21.15.96:123 2024-04-18T14:39:28.945 INFO:teuthology.orchestra.run.smithi096.stdout:18 Apr 14:39:28 ntpd[17219]: Listen normally on 4 lo [::1]:123 2024-04-18T14:39:28.945 INFO:teuthology.orchestra.run.smithi096.stdout:18 Apr 14:39:28 ntpd[17219]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe8f:cc0d%5]:123 2024-04-18T14:39:28.945 INFO:teuthology.orchestra.run.smithi096.stdout:18 Apr 14:39:28 ntpd[17219]: Listening on routing socket on fd #22 for interface updates 2024-04-18T14:39:28.946 INFO:teuthology.orchestra.run.smithi119.stdout:18 Apr 14:39:28 ntpd[17212]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2024-04-18T14:39:28.946 INFO:teuthology.orchestra.run.smithi119.stdout:18 Apr 14:39:28 ntpd[17212]: Command line: ntpd -gq 2024-04-18T14:39:28.946 INFO:teuthology.orchestra.run.smithi119.stdout:18 Apr 14:39:28 ntpd[17212]: ---------------------------------------------------- 2024-04-18T14:39:28.946 INFO:teuthology.orchestra.run.smithi119.stdout:18 Apr 14:39:28 ntpd[17212]: ntp-4 is maintained by Network Time Foundation, 2024-04-18T14:39:28.946 INFO:teuthology.orchestra.run.smithi119.stdout:18 Apr 14:39:28 ntpd[17212]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2024-04-18T14:39:28.946 INFO:teuthology.orchestra.run.smithi119.stdout:18 Apr 14:39:28 ntpd[17212]: corporation. Support and training for ntp-4 are 2024-04-18T14:39:28.946 INFO:teuthology.orchestra.run.smithi119.stdout:18 Apr 14:39:28 ntpd[17212]: available at https://www.nwtime.org/support 2024-04-18T14:39:28.946 INFO:teuthology.orchestra.run.smithi119.stdout:18 Apr 14:39:28 ntpd[17212]: ---------------------------------------------------- 2024-04-18T14:39:28.946 INFO:teuthology.orchestra.run.smithi119.stdout:18 Apr 14:39:28 ntpd[17212]: proto: precision = 0.058 usec (-24) 2024-04-18T14:39:28.947 INFO:teuthology.orchestra.run.smithi119.stdout:18 Apr 14:39:28 ntpd[17212]: basedate set to 2022-02-04 2024-04-18T14:39:28.947 INFO:teuthology.orchestra.run.smithi119.stdout:18 Apr 14:39:28 ntpd[17212]: gps base set to 2022-02-06 (week 2196) 2024-04-18T14:39:28.947 INFO:teuthology.orchestra.run.smithi119.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-04-18T14:39:28.947 INFO:teuthology.orchestra.run.smithi119.stdout:18 Apr 14:39:28 ntpd[17212]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-04-18T14:39:28.947 INFO:teuthology.orchestra.run.smithi119.stdout:18 Apr 14:39:28 ntpd[17212]: restrict ::: KOD does nothing without LIMITED. 2024-04-18T14:39:28.948 INFO:teuthology.orchestra.run.smithi119.stderr:restrict ::: KOD does nothing without LIMITED. 2024-04-18T14:39:28.949 INFO:teuthology.orchestra.run.smithi119.stdout:18 Apr 14:39:28 ntpd[17212]: Listen and drop on 0 v6wildcard [::]:123 2024-04-18T14:39:28.949 INFO:teuthology.orchestra.run.smithi119.stdout:18 Apr 14:39:28 ntpd[17212]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2024-04-18T14:39:28.949 INFO:teuthology.orchestra.run.smithi119.stdout:18 Apr 14:39:28 ntpd[17212]: Listen normally on 2 lo 127.0.0.1:123 2024-04-18T14:39:28.949 INFO:teuthology.orchestra.run.smithi119.stdout:18 Apr 14:39:28 ntpd[17212]: Listen normally on 3 enp3s0f1 172.21.15.119:123 2024-04-18T14:39:28.949 INFO:teuthology.orchestra.run.smithi119.stdout:18 Apr 14:39:28 ntpd[17212]: Listen normally on 4 lo [::1]:123 2024-04-18T14:39:28.949 INFO:teuthology.orchestra.run.smithi119.stdout:18 Apr 14:39:28 ntpd[17212]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe8f:d5ef%5]:123 2024-04-18T14:39:28.949 INFO:teuthology.orchestra.run.smithi119.stdout:18 Apr 14:39:28 ntpd[17212]: Listening on routing socket on fd #22 for interface updates 2024-04-18T14:39:28.964 INFO:teuthology.orchestra.run.smithi134.stdout:18 Apr 14:39:28 ntpd[17197]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2024-04-18T14:39:28.964 INFO:teuthology.orchestra.run.smithi134.stdout:18 Apr 14:39:28 ntpd[17197]: Command line: ntpd -gq 2024-04-18T14:39:28.964 INFO:teuthology.orchestra.run.smithi134.stdout:18 Apr 14:39:28 ntpd[17197]: ---------------------------------------------------- 2024-04-18T14:39:28.964 INFO:teuthology.orchestra.run.smithi134.stdout:18 Apr 14:39:28 ntpd[17197]: ntp-4 is maintained by Network Time Foundation, 2024-04-18T14:39:28.964 INFO:teuthology.orchestra.run.smithi134.stdout:18 Apr 14:39:28 ntpd[17197]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2024-04-18T14:39:28.965 INFO:teuthology.orchestra.run.smithi134.stdout:18 Apr 14:39:28 ntpd[17197]: corporation. Support and training for ntp-4 are 2024-04-18T14:39:28.965 INFO:teuthology.orchestra.run.smithi134.stdout:18 Apr 14:39:28 ntpd[17197]: available at https://www.nwtime.org/support 2024-04-18T14:39:28.965 INFO:teuthology.orchestra.run.smithi134.stdout:18 Apr 14:39:28 ntpd[17197]: ---------------------------------------------------- 2024-04-18T14:39:28.966 INFO:teuthology.orchestra.run.smithi134.stdout:18 Apr 14:39:28 ntpd[17197]: proto: precision = 0.061 usec (-24) 2024-04-18T14:39:28.966 INFO:teuthology.orchestra.run.smithi134.stdout:18 Apr 14:39:28 ntpd[17197]: basedate set to 2022-02-04 2024-04-18T14:39:28.966 INFO:teuthology.orchestra.run.smithi134.stdout:18 Apr 14:39:28 ntpd[17197]: gps base set to 2022-02-06 (week 2196) 2024-04-18T14:39:28.967 INFO:teuthology.orchestra.run.smithi134.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-04-18T14:39:28.967 INFO:teuthology.orchestra.run.smithi134.stdout:18 Apr 14:39:28 ntpd[17197]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-04-18T14:39:28.968 INFO:teuthology.orchestra.run.smithi134.stdout:18 Apr 14:39:28 ntpd[17197]: restrict ::: KOD does nothing without LIMITED. 2024-04-18T14:39:28.968 INFO:teuthology.orchestra.run.smithi134.stderr:restrict ::: KOD does nothing without LIMITED. 2024-04-18T14:39:28.970 INFO:teuthology.orchestra.run.smithi134.stdout:18 Apr 14:39:28 ntpd[17197]: Listen and drop on 0 v6wildcard [::]:123 2024-04-18T14:39:28.970 INFO:teuthology.orchestra.run.smithi134.stdout:18 Apr 14:39:28 ntpd[17197]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2024-04-18T14:39:28.970 INFO:teuthology.orchestra.run.smithi134.stdout:18 Apr 14:39:28 ntpd[17197]: Listen normally on 2 lo 127.0.0.1:123 2024-04-18T14:39:28.970 INFO:teuthology.orchestra.run.smithi134.stdout:18 Apr 14:39:28 ntpd[17197]: Listen normally on 3 enp3s0f1 172.21.15.134:123 2024-04-18T14:39:28.970 INFO:teuthology.orchestra.run.smithi134.stdout:18 Apr 14:39:28 ntpd[17197]: Listen normally on 4 lo [::1]:123 2024-04-18T14:39:28.971 INFO:teuthology.orchestra.run.smithi134.stdout:18 Apr 14:39:28 ntpd[17197]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe88:6de9%5]:123 2024-04-18T14:39:28.971 INFO:teuthology.orchestra.run.smithi134.stdout:18 Apr 14:39:28 ntpd[17197]: Listening on routing socket on fd #22 for interface updates 2024-04-18T14:39:29.941 INFO:teuthology.orchestra.run.smithi096.stderr:18 Apr 14:39:29 ntpd[17219]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-18T14:39:29.941 INFO:teuthology.orchestra.run.smithi096.stderr:18 Apr 14:39:29 ntpd[17219]: can't open /var/log/ntpstats/rawstats.20240418: Permission denied 2024-04-18T14:39:29.941 INFO:teuthology.orchestra.run.smithi096.stderr:18 Apr 14:39:29 ntpd[17219]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-18T14:39:29.941 INFO:teuthology.orchestra.run.smithi096.stderr:18 Apr 14:39:29 ntpd[17219]: can't open /var/log/ntpstats/rawstats.20240418: Permission denied 2024-04-18T14:39:29.941 INFO:teuthology.orchestra.run.smithi096.stderr:18 Apr 14:39:29 ntpd[17219]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-18T14:39:29.941 INFO:teuthology.orchestra.run.smithi096.stderr:18 Apr 14:39:29 ntpd[17219]: can't open /var/log/ntpstats/rawstats.20240418: Permission denied 2024-04-18T14:39:29.941 INFO:teuthology.orchestra.run.smithi096.stderr:18 Apr 14:39:29 ntpd[17219]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-18T14:39:29.941 INFO:teuthology.orchestra.run.smithi096.stderr:18 Apr 14:39:29 ntpd[17219]: can't open /var/log/ntpstats/rawstats.20240418: Permission denied 2024-04-18T14:39:29.942 INFO:teuthology.orchestra.run.smithi096.stderr:18 Apr 14:39:29 ntpd[17219]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-18T14:39:29.942 INFO:teuthology.orchestra.run.smithi096.stderr:18 Apr 14:39:29 ntpd[17219]: can't open /var/log/ntpstats/peerstats.20240418: Permission denied 2024-04-18T14:39:29.942 INFO:teuthology.orchestra.run.smithi096.stderr:18 Apr 14:39:29 ntpd[17219]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-18T14:39:29.942 INFO:teuthology.orchestra.run.smithi096.stderr:18 Apr 14:39:29 ntpd[17219]: can't open /var/log/ntpstats/rawstats.20240418: Permission denied 2024-04-18T14:39:29.942 INFO:teuthology.orchestra.run.smithi096.stderr:18 Apr 14:39:29 ntpd[17219]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-18T14:39:29.942 INFO:teuthology.orchestra.run.smithi096.stderr:18 Apr 14:39:29 ntpd[17219]: can't open /var/log/ntpstats/peerstats.20240418: Permission denied 2024-04-18T14:39:29.943 INFO:teuthology.orchestra.run.smithi119.stderr:18 Apr 14:39:29 ntpd[17212]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-18T14:39:29.943 INFO:teuthology.orchestra.run.smithi119.stderr:18 Apr 14:39:29 ntpd[17212]: can't open /var/log/ntpstats/rawstats.20240418: Permission denied 2024-04-18T14:39:29.943 INFO:teuthology.orchestra.run.smithi119.stderr:18 Apr 14:39:29 ntpd[17212]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-18T14:39:29.943 INFO:teuthology.orchestra.run.smithi119.stderr:18 Apr 14:39:29 ntpd[17212]: can't open /var/log/ntpstats/rawstats.20240418: Permission denied 2024-04-18T14:39:29.943 INFO:teuthology.orchestra.run.smithi119.stderr:18 Apr 14:39:29 ntpd[17212]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-18T14:39:29.943 INFO:teuthology.orchestra.run.smithi119.stderr:18 Apr 14:39:29 ntpd[17212]: can't open /var/log/ntpstats/peerstats.20240418: Permission denied 2024-04-18T14:39:29.964 INFO:teuthology.orchestra.run.smithi134.stderr:18 Apr 14:39:29 ntpd[17197]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-18T14:39:29.965 INFO:teuthology.orchestra.run.smithi134.stderr:18 Apr 14:39:29 ntpd[17197]: can't open /var/log/ntpstats/rawstats.20240418: Permission denied 2024-04-18T14:39:29.965 INFO:teuthology.orchestra.run.smithi134.stderr:18 Apr 14:39:29 ntpd[17197]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-18T14:39:29.965 INFO:teuthology.orchestra.run.smithi134.stderr:18 Apr 14:39:29 ntpd[17197]: can't open /var/log/ntpstats/rawstats.20240418: Permission denied 2024-04-18T14:39:29.965 INFO:teuthology.orchestra.run.smithi134.stderr:18 Apr 14:39:29 ntpd[17197]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-18T14:39:29.965 INFO:teuthology.orchestra.run.smithi134.stderr:18 Apr 14:39:29 ntpd[17197]: can't open /var/log/ntpstats/peerstats.20240418: Permission denied 2024-04-18T14:39:30.934 INFO:teuthology.orchestra.run.smithi086.stderr:18 Apr 14:39:30 ntpd[17180]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-18T14:39:30.934 INFO:teuthology.orchestra.run.smithi086.stderr:18 Apr 14:39:30 ntpd[17180]: can't open /var/log/ntpstats/rawstats.20240418: Permission denied 2024-04-18T14:39:30.934 INFO:teuthology.orchestra.run.smithi086.stderr:18 Apr 14:39:30 ntpd[17180]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-18T14:39:30.935 INFO:teuthology.orchestra.run.smithi086.stderr:18 Apr 14:39:30 ntpd[17180]: can't open /var/log/ntpstats/rawstats.20240418: Permission denied 2024-04-18T14:39:30.935 INFO:teuthology.orchestra.run.smithi086.stderr:18 Apr 14:39:30 ntpd[17180]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-18T14:39:30.935 INFO:teuthology.orchestra.run.smithi086.stderr:18 Apr 14:39:30 ntpd[17180]: can't open /var/log/ntpstats/peerstats.20240418: Permission denied 2024-04-18T14:39:30.942 INFO:teuthology.orchestra.run.smithi119.stderr:18 Apr 14:39:30 ntpd[17212]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-18T14:39:30.942 INFO:teuthology.orchestra.run.smithi119.stderr:18 Apr 14:39:30 ntpd[17212]: can't open /var/log/ntpstats/rawstats.20240418: Permission denied 2024-04-18T14:39:30.943 INFO:teuthology.orchestra.run.smithi119.stderr:18 Apr 14:39:30 ntpd[17212]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-18T14:39:30.943 INFO:teuthology.orchestra.run.smithi119.stderr:18 Apr 14:39:30 ntpd[17212]: can't open /var/log/ntpstats/rawstats.20240418: Permission denied 2024-04-18T14:39:30.943 INFO:teuthology.orchestra.run.smithi119.stderr:18 Apr 14:39:30 ntpd[17212]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-18T14:39:30.943 INFO:teuthology.orchestra.run.smithi119.stderr:18 Apr 14:39:30 ntpd[17212]: can't open /var/log/ntpstats/peerstats.20240418: Permission denied 2024-04-18T14:39:30.964 INFO:teuthology.orchestra.run.smithi134.stderr:18 Apr 14:39:30 ntpd[17197]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-18T14:39:30.964 INFO:teuthology.orchestra.run.smithi134.stderr:18 Apr 14:39:30 ntpd[17197]: can't open /var/log/ntpstats/rawstats.20240418: Permission denied 2024-04-18T14:39:31.935 INFO:teuthology.orchestra.run.smithi086.stderr:18 Apr 14:39:31 ntpd[17180]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-18T14:39:31.935 INFO:teuthology.orchestra.run.smithi086.stderr:18 Apr 14:39:31 ntpd[17180]: can't open /var/log/ntpstats/rawstats.20240418: Permission denied 2024-04-18T14:39:31.935 INFO:teuthology.orchestra.run.smithi086.stderr:18 Apr 14:39:31 ntpd[17180]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-18T14:39:31.935 INFO:teuthology.orchestra.run.smithi086.stderr:18 Apr 14:39:31 ntpd[17180]: can't open /var/log/ntpstats/rawstats.20240418: Permission denied 2024-04-18T14:39:31.935 INFO:teuthology.orchestra.run.smithi086.stderr:18 Apr 14:39:31 ntpd[17180]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-18T14:39:31.935 INFO:teuthology.orchestra.run.smithi086.stderr:18 Apr 14:39:31 ntpd[17180]: can't open /var/log/ntpstats/rawstats.20240418: Permission denied 2024-04-18T14:39:31.936 INFO:teuthology.orchestra.run.smithi086.stderr:18 Apr 14:39:31 ntpd[17180]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-18T14:39:31.936 INFO:teuthology.orchestra.run.smithi086.stderr:18 Apr 14:39:31 ntpd[17180]: can't open /var/log/ntpstats/peerstats.20240418: Permission denied 2024-04-18T14:39:31.936 INFO:teuthology.orchestra.run.smithi086.stderr:18 Apr 14:39:31 ntpd[17180]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-18T14:39:31.936 INFO:teuthology.orchestra.run.smithi086.stderr:18 Apr 14:39:31 ntpd[17180]: can't open /var/log/ntpstats/rawstats.20240418: Permission denied 2024-04-18T14:39:31.936 INFO:teuthology.orchestra.run.smithi086.stderr:18 Apr 14:39:31 ntpd[17180]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-18T14:39:31.936 INFO:teuthology.orchestra.run.smithi086.stderr:18 Apr 14:39:31 ntpd[17180]: can't open /var/log/ntpstats/peerstats.20240418: Permission denied 2024-04-18T14:39:31.940 INFO:teuthology.orchestra.run.smithi096.stderr:18 Apr 14:39:31 ntpd[17219]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-18T14:39:31.940 INFO:teuthology.orchestra.run.smithi096.stderr:18 Apr 14:39:31 ntpd[17219]: can't open /var/log/ntpstats/rawstats.20240418: Permission denied 2024-04-18T14:39:31.941 INFO:teuthology.orchestra.run.smithi096.stderr:18 Apr 14:39:31 ntpd[17219]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-18T14:39:31.941 INFO:teuthology.orchestra.run.smithi096.stderr:18 Apr 14:39:31 ntpd[17219]: can't open /var/log/ntpstats/rawstats.20240418: Permission denied 2024-04-18T14:39:31.941 INFO:teuthology.orchestra.run.smithi096.stderr:18 Apr 14:39:31 ntpd[17219]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-18T14:39:31.941 INFO:teuthology.orchestra.run.smithi096.stderr:18 Apr 14:39:31 ntpd[17219]: can't open /var/log/ntpstats/rawstats.20240418: Permission denied 2024-04-18T14:39:31.941 INFO:teuthology.orchestra.run.smithi096.stderr:18 Apr 14:39:31 ntpd[17219]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-18T14:39:31.941 INFO:teuthology.orchestra.run.smithi096.stderr:18 Apr 14:39:31 ntpd[17219]: can't open /var/log/ntpstats/peerstats.20240418: Permission denied 2024-04-18T14:39:31.941 INFO:teuthology.orchestra.run.smithi096.stderr:18 Apr 14:39:31 ntpd[17219]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-18T14:39:31.941 INFO:teuthology.orchestra.run.smithi096.stderr:18 Apr 14:39:31 ntpd[17219]: can't open /var/log/ntpstats/rawstats.20240418: Permission denied 2024-04-18T14:39:31.941 INFO:teuthology.orchestra.run.smithi096.stderr:18 Apr 14:39:31 ntpd[17219]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-18T14:39:31.941 INFO:teuthology.orchestra.run.smithi096.stderr:18 Apr 14:39:31 ntpd[17219]: can't open /var/log/ntpstats/peerstats.20240418: Permission denied 2024-04-18T14:39:31.943 INFO:teuthology.orchestra.run.smithi119.stderr:18 Apr 14:39:31 ntpd[17212]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-18T14:39:31.943 INFO:teuthology.orchestra.run.smithi119.stderr:18 Apr 14:39:31 ntpd[17212]: can't open /var/log/ntpstats/rawstats.20240418: Permission denied 2024-04-18T14:39:31.943 INFO:teuthology.orchestra.run.smithi119.stderr:18 Apr 14:39:31 ntpd[17212]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-18T14:39:31.943 INFO:teuthology.orchestra.run.smithi119.stderr:18 Apr 14:39:31 ntpd[17212]: can't open /var/log/ntpstats/rawstats.20240418: Permission denied 2024-04-18T14:39:31.943 INFO:teuthology.orchestra.run.smithi119.stderr:18 Apr 14:39:31 ntpd[17212]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-18T14:39:31.943 INFO:teuthology.orchestra.run.smithi119.stderr:18 Apr 14:39:31 ntpd[17212]: can't open /var/log/ntpstats/rawstats.20240418: Permission denied 2024-04-18T14:39:31.943 INFO:teuthology.orchestra.run.smithi119.stderr:18 Apr 14:39:31 ntpd[17212]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-18T14:39:31.943 INFO:teuthology.orchestra.run.smithi119.stderr:18 Apr 14:39:31 ntpd[17212]: can't open /var/log/ntpstats/peerstats.20240418: Permission denied 2024-04-18T14:39:31.943 INFO:teuthology.orchestra.run.smithi119.stderr:18 Apr 14:39:31 ntpd[17212]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-18T14:39:31.943 INFO:teuthology.orchestra.run.smithi119.stderr:18 Apr 14:39:31 ntpd[17212]: can't open /var/log/ntpstats/rawstats.20240418: Permission denied 2024-04-18T14:39:31.943 INFO:teuthology.orchestra.run.smithi119.stderr:18 Apr 14:39:31 ntpd[17212]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-18T14:39:31.943 INFO:teuthology.orchestra.run.smithi119.stderr:18 Apr 14:39:31 ntpd[17212]: can't open /var/log/ntpstats/peerstats.20240418: Permission denied 2024-04-18T14:39:31.965 INFO:teuthology.orchestra.run.smithi134.stderr:18 Apr 14:39:31 ntpd[17197]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-18T14:39:31.965 INFO:teuthology.orchestra.run.smithi134.stderr:18 Apr 14:39:31 ntpd[17197]: can't open /var/log/ntpstats/rawstats.20240418: Permission denied 2024-04-18T14:39:31.965 INFO:teuthology.orchestra.run.smithi134.stderr:18 Apr 14:39:31 ntpd[17197]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-18T14:39:31.965 INFO:teuthology.orchestra.run.smithi134.stderr:18 Apr 14:39:31 ntpd[17197]: can't open /var/log/ntpstats/rawstats.20240418: Permission denied 2024-04-18T14:39:31.965 INFO:teuthology.orchestra.run.smithi134.stderr:18 Apr 14:39:31 ntpd[17197]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-18T14:39:31.966 INFO:teuthology.orchestra.run.smithi134.stderr:18 Apr 14:39:31 ntpd[17197]: can't open /var/log/ntpstats/rawstats.20240418: Permission denied 2024-04-18T14:39:31.966 INFO:teuthology.orchestra.run.smithi134.stderr:18 Apr 14:39:31 ntpd[17197]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-18T14:39:31.966 INFO:teuthology.orchestra.run.smithi134.stderr:18 Apr 14:39:31 ntpd[17197]: can't open /var/log/ntpstats/peerstats.20240418: Permission denied 2024-04-18T14:39:31.966 INFO:teuthology.orchestra.run.smithi134.stderr:18 Apr 14:39:31 ntpd[17197]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-18T14:39:31.966 INFO:teuthology.orchestra.run.smithi134.stderr:18 Apr 14:39:31 ntpd[17197]: can't open /var/log/ntpstats/rawstats.20240418: Permission denied 2024-04-18T14:39:31.966 INFO:teuthology.orchestra.run.smithi134.stderr:18 Apr 14:39:31 ntpd[17197]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-18T14:39:31.966 INFO:teuthology.orchestra.run.smithi134.stderr:18 Apr 14:39:31 ntpd[17197]: can't open /var/log/ntpstats/peerstats.20240418: Permission denied 2024-04-18T14:39:32.934 INFO:teuthology.orchestra.run.smithi086.stderr:18 Apr 14:39:32 ntpd[17180]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-18T14:39:32.934 INFO:teuthology.orchestra.run.smithi086.stderr:18 Apr 14:39:32 ntpd[17180]: can't open /var/log/ntpstats/rawstats.20240418: Permission denied 2024-04-18T14:39:32.935 INFO:teuthology.orchestra.run.smithi086.stderr:18 Apr 14:39:32 ntpd[17180]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-18T14:39:32.935 INFO:teuthology.orchestra.run.smithi086.stderr:18 Apr 14:39:32 ntpd[17180]: can't open /var/log/ntpstats/rawstats.20240418: Permission denied 2024-04-18T14:39:32.935 INFO:teuthology.orchestra.run.smithi086.stderr:18 Apr 14:39:32 ntpd[17180]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-18T14:39:32.935 INFO:teuthology.orchestra.run.smithi086.stderr:18 Apr 14:39:32 ntpd[17180]: can't open /var/log/ntpstats/peerstats.20240418: Permission denied 2024-04-18T14:39:32.940 INFO:teuthology.orchestra.run.smithi096.stderr:18 Apr 14:39:32 ntpd[17219]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-18T14:39:32.940 INFO:teuthology.orchestra.run.smithi096.stderr:18 Apr 14:39:32 ntpd[17219]: can't open /var/log/ntpstats/rawstats.20240418: Permission denied 2024-04-18T14:39:32.940 INFO:teuthology.orchestra.run.smithi096.stderr:18 Apr 14:39:32 ntpd[17219]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-18T14:39:32.940 INFO:teuthology.orchestra.run.smithi096.stderr:18 Apr 14:39:32 ntpd[17219]: can't open /var/log/ntpstats/rawstats.20240418: Permission denied 2024-04-18T14:39:32.940 INFO:teuthology.orchestra.run.smithi096.stderr:18 Apr 14:39:32 ntpd[17219]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-18T14:39:32.940 INFO:teuthology.orchestra.run.smithi096.stderr:18 Apr 14:39:32 ntpd[17219]: can't open /var/log/ntpstats/peerstats.20240418: Permission denied 2024-04-18T14:39:32.942 INFO:teuthology.orchestra.run.smithi119.stderr:18 Apr 14:39:32 ntpd[17212]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-18T14:39:32.942 INFO:teuthology.orchestra.run.smithi119.stderr:18 Apr 14:39:32 ntpd[17212]: can't open /var/log/ntpstats/rawstats.20240418: Permission denied 2024-04-18T14:39:32.942 INFO:teuthology.orchestra.run.smithi119.stderr:18 Apr 14:39:32 ntpd[17212]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-18T14:39:32.942 INFO:teuthology.orchestra.run.smithi119.stderr:18 Apr 14:39:32 ntpd[17212]: can't open /var/log/ntpstats/rawstats.20240418: Permission denied 2024-04-18T14:39:32.943 INFO:teuthology.orchestra.run.smithi119.stderr:18 Apr 14:39:32 ntpd[17212]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-18T14:39:32.943 INFO:teuthology.orchestra.run.smithi119.stderr:18 Apr 14:39:32 ntpd[17212]: can't open /var/log/ntpstats/rawstats.20240418: Permission denied 2024-04-18T14:39:32.943 INFO:teuthology.orchestra.run.smithi119.stderr:18 Apr 14:39:32 ntpd[17212]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-18T14:39:32.943 INFO:teuthology.orchestra.run.smithi119.stderr:18 Apr 14:39:32 ntpd[17212]: can't open /var/log/ntpstats/peerstats.20240418: Permission denied 2024-04-18T14:39:32.965 INFO:teuthology.orchestra.run.smithi134.stderr:18 Apr 14:39:32 ntpd[17197]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-18T14:39:32.965 INFO:teuthology.orchestra.run.smithi134.stderr:18 Apr 14:39:32 ntpd[17197]: can't open /var/log/ntpstats/rawstats.20240418: Permission denied 2024-04-18T14:39:32.965 INFO:teuthology.orchestra.run.smithi134.stderr:18 Apr 14:39:32 ntpd[17197]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-18T14:39:32.965 INFO:teuthology.orchestra.run.smithi134.stderr:18 Apr 14:39:32 ntpd[17197]: can't open /var/log/ntpstats/rawstats.20240418: Permission denied 2024-04-18T14:39:32.965 INFO:teuthology.orchestra.run.smithi134.stderr:18 Apr 14:39:32 ntpd[17197]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-18T14:39:32.965 INFO:teuthology.orchestra.run.smithi134.stderr:18 Apr 14:39:32 ntpd[17197]: can't open /var/log/ntpstats/peerstats.20240418: Permission denied 2024-04-18T14:39:33.935 INFO:teuthology.orchestra.run.smithi086.stderr:18 Apr 14:39:33 ntpd[17180]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-18T14:39:33.935 INFO:teuthology.orchestra.run.smithi086.stderr:18 Apr 14:39:33 ntpd[17180]: can't open /var/log/ntpstats/rawstats.20240418: Permission denied 2024-04-18T14:39:33.935 INFO:teuthology.orchestra.run.smithi086.stderr:18 Apr 14:39:33 ntpd[17180]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-18T14:39:33.935 INFO:teuthology.orchestra.run.smithi086.stderr:18 Apr 14:39:33 ntpd[17180]: can't open /var/log/ntpstats/rawstats.20240418: Permission denied 2024-04-18T14:39:33.935 INFO:teuthology.orchestra.run.smithi086.stderr:18 Apr 14:39:33 ntpd[17180]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-18T14:39:33.935 INFO:teuthology.orchestra.run.smithi086.stderr:18 Apr 14:39:33 ntpd[17180]: can't open /var/log/ntpstats/rawstats.20240418: Permission denied 2024-04-18T14:39:33.935 INFO:teuthology.orchestra.run.smithi086.stderr:18 Apr 14:39:33 ntpd[17180]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-18T14:39:33.936 INFO:teuthology.orchestra.run.smithi086.stderr:18 Apr 14:39:33 ntpd[17180]: can't open /var/log/ntpstats/rawstats.20240418: Permission denied 2024-04-18T14:39:33.936 INFO:teuthology.orchestra.run.smithi086.stderr:18 Apr 14:39:33 ntpd[17180]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-18T14:39:33.936 INFO:teuthology.orchestra.run.smithi086.stderr:18 Apr 14:39:33 ntpd[17180]: can't open /var/log/ntpstats/peerstats.20240418: Permission denied 2024-04-18T14:39:33.936 INFO:teuthology.orchestra.run.smithi086.stderr:18 Apr 14:39:33 ntpd[17180]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-18T14:39:33.936 INFO:teuthology.orchestra.run.smithi086.stderr:18 Apr 14:39:33 ntpd[17180]: can't open /var/log/ntpstats/rawstats.20240418: Permission denied 2024-04-18T14:39:33.936 INFO:teuthology.orchestra.run.smithi086.stderr:18 Apr 14:39:33 ntpd[17180]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-18T14:39:33.936 INFO:teuthology.orchestra.run.smithi086.stderr:18 Apr 14:39:33 ntpd[17180]: can't open /var/log/ntpstats/peerstats.20240418: Permission denied 2024-04-18T14:39:33.940 INFO:teuthology.orchestra.run.smithi096.stderr:18 Apr 14:39:33 ntpd[17219]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-18T14:39:33.940 INFO:teuthology.orchestra.run.smithi096.stderr:18 Apr 14:39:33 ntpd[17219]: can't open /var/log/ntpstats/rawstats.20240418: Permission denied 2024-04-18T14:39:33.941 INFO:teuthology.orchestra.run.smithi096.stderr:18 Apr 14:39:33 ntpd[17219]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-18T14:39:33.941 INFO:teuthology.orchestra.run.smithi096.stderr:18 Apr 14:39:33 ntpd[17219]: can't open /var/log/ntpstats/rawstats.20240418: Permission denied 2024-04-18T14:39:33.941 INFO:teuthology.orchestra.run.smithi096.stderr:18 Apr 14:39:33 ntpd[17219]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-18T14:39:33.941 INFO:teuthology.orchestra.run.smithi096.stderr:18 Apr 14:39:33 ntpd[17219]: can't open /var/log/ntpstats/rawstats.20240418: Permission denied 2024-04-18T14:39:33.941 INFO:teuthology.orchestra.run.smithi096.stderr:18 Apr 14:39:33 ntpd[17219]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-18T14:39:33.941 INFO:teuthology.orchestra.run.smithi096.stderr:18 Apr 14:39:33 ntpd[17219]: can't open /var/log/ntpstats/peerstats.20240418: Permission denied 2024-04-18T14:39:33.941 INFO:teuthology.orchestra.run.smithi096.stderr:18 Apr 14:39:33 ntpd[17219]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-18T14:39:33.941 INFO:teuthology.orchestra.run.smithi096.stderr:18 Apr 14:39:33 ntpd[17219]: can't open /var/log/ntpstats/rawstats.20240418: Permission denied 2024-04-18T14:39:33.941 INFO:teuthology.orchestra.run.smithi096.stderr:18 Apr 14:39:33 ntpd[17219]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-18T14:39:33.941 INFO:teuthology.orchestra.run.smithi096.stderr:18 Apr 14:39:33 ntpd[17219]: can't open /var/log/ntpstats/peerstats.20240418: Permission denied 2024-04-18T14:39:33.943 INFO:teuthology.orchestra.run.smithi119.stderr:18 Apr 14:39:33 ntpd[17212]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-18T14:39:33.943 INFO:teuthology.orchestra.run.smithi119.stderr:18 Apr 14:39:33 ntpd[17212]: can't open /var/log/ntpstats/rawstats.20240418: Permission denied 2024-04-18T14:39:33.943 INFO:teuthology.orchestra.run.smithi119.stderr:18 Apr 14:39:33 ntpd[17212]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-18T14:39:33.944 INFO:teuthology.orchestra.run.smithi119.stderr:18 Apr 14:39:33 ntpd[17212]: can't open /var/log/ntpstats/rawstats.20240418: Permission denied 2024-04-18T14:39:33.944 INFO:teuthology.orchestra.run.smithi119.stderr:18 Apr 14:39:33 ntpd[17212]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-18T14:39:33.944 INFO:teuthology.orchestra.run.smithi119.stderr:18 Apr 14:39:33 ntpd[17212]: can't open /var/log/ntpstats/rawstats.20240418: Permission denied 2024-04-18T14:39:33.944 INFO:teuthology.orchestra.run.smithi119.stderr:18 Apr 14:39:33 ntpd[17212]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-18T14:39:33.944 INFO:teuthology.orchestra.run.smithi119.stderr:18 Apr 14:39:33 ntpd[17212]: can't open /var/log/ntpstats/peerstats.20240418: Permission denied 2024-04-18T14:39:33.944 INFO:teuthology.orchestra.run.smithi119.stderr:18 Apr 14:39:33 ntpd[17212]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-18T14:39:33.944 INFO:teuthology.orchestra.run.smithi119.stderr:18 Apr 14:39:33 ntpd[17212]: can't open /var/log/ntpstats/rawstats.20240418: Permission denied 2024-04-18T14:39:33.944 INFO:teuthology.orchestra.run.smithi119.stderr:18 Apr 14:39:33 ntpd[17212]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-18T14:39:33.944 INFO:teuthology.orchestra.run.smithi119.stderr:18 Apr 14:39:33 ntpd[17212]: can't open /var/log/ntpstats/peerstats.20240418: Permission denied 2024-04-18T14:39:33.965 INFO:teuthology.orchestra.run.smithi134.stderr:18 Apr 14:39:33 ntpd[17197]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-18T14:39:33.965 INFO:teuthology.orchestra.run.smithi134.stderr:18 Apr 14:39:33 ntpd[17197]: can't open /var/log/ntpstats/rawstats.20240418: Permission denied 2024-04-18T14:39:33.965 INFO:teuthology.orchestra.run.smithi134.stderr:18 Apr 14:39:33 ntpd[17197]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-18T14:39:33.966 INFO:teuthology.orchestra.run.smithi134.stderr:18 Apr 14:39:33 ntpd[17197]: can't open /var/log/ntpstats/rawstats.20240418: Permission denied 2024-04-18T14:39:33.966 INFO:teuthology.orchestra.run.smithi134.stderr:18 Apr 14:39:33 ntpd[17197]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-18T14:39:33.966 INFO:teuthology.orchestra.run.smithi134.stderr:18 Apr 14:39:33 ntpd[17197]: can't open /var/log/ntpstats/rawstats.20240418: Permission denied 2024-04-18T14:39:33.966 INFO:teuthology.orchestra.run.smithi134.stderr:18 Apr 14:39:33 ntpd[17197]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-18T14:39:33.966 INFO:teuthology.orchestra.run.smithi134.stderr:18 Apr 14:39:33 ntpd[17197]: can't open /var/log/ntpstats/peerstats.20240418: Permission denied 2024-04-18T14:39:33.966 INFO:teuthology.orchestra.run.smithi134.stderr:18 Apr 14:39:33 ntpd[17197]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-18T14:39:33.966 INFO:teuthology.orchestra.run.smithi134.stderr:18 Apr 14:39:33 ntpd[17197]: can't open /var/log/ntpstats/rawstats.20240418: Permission denied 2024-04-18T14:39:33.966 INFO:teuthology.orchestra.run.smithi134.stderr:18 Apr 14:39:33 ntpd[17197]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-18T14:39:33.966 INFO:teuthology.orchestra.run.smithi134.stderr:18 Apr 14:39:33 ntpd[17197]: can't open /var/log/ntpstats/peerstats.20240418: Permission denied 2024-04-18T14:39:34.934 INFO:teuthology.orchestra.run.smithi086.stderr:18 Apr 14:39:34 ntpd[17180]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-18T14:39:34.934 INFO:teuthology.orchestra.run.smithi086.stderr:18 Apr 14:39:34 ntpd[17180]: can't open /var/log/ntpstats/rawstats.20240418: Permission denied 2024-04-18T14:39:34.935 INFO:teuthology.orchestra.run.smithi086.stderr:18 Apr 14:39:34 ntpd[17180]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-18T14:39:34.935 INFO:teuthology.orchestra.run.smithi086.stderr:18 Apr 14:39:34 ntpd[17180]: can't open /var/log/ntpstats/rawstats.20240418: Permission denied 2024-04-18T14:39:34.935 INFO:teuthology.orchestra.run.smithi086.stderr:18 Apr 14:39:34 ntpd[17180]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-18T14:39:34.935 INFO:teuthology.orchestra.run.smithi086.stderr:18 Apr 14:39:34 ntpd[17180]: can't open /var/log/ntpstats/peerstats.20240418: Permission denied 2024-04-18T14:39:34.940 INFO:teuthology.orchestra.run.smithi096.stderr:18 Apr 14:39:34 ntpd[17219]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-18T14:39:34.940 INFO:teuthology.orchestra.run.smithi096.stderr:18 Apr 14:39:34 ntpd[17219]: can't open /var/log/ntpstats/rawstats.20240418: Permission denied 2024-04-18T14:39:34.940 INFO:teuthology.orchestra.run.smithi096.stderr:18 Apr 14:39:34 ntpd[17219]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-18T14:39:34.940 INFO:teuthology.orchestra.run.smithi096.stderr:18 Apr 14:39:34 ntpd[17219]: can't open /var/log/ntpstats/rawstats.20240418: Permission denied 2024-04-18T14:39:34.940 INFO:teuthology.orchestra.run.smithi096.stderr:18 Apr 14:39:34 ntpd[17219]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-18T14:39:34.940 INFO:teuthology.orchestra.run.smithi096.stderr:18 Apr 14:39:34 ntpd[17219]: can't open /var/log/ntpstats/peerstats.20240418: Permission denied 2024-04-18T14:39:34.942 INFO:teuthology.orchestra.run.smithi119.stderr:18 Apr 14:39:34 ntpd[17212]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-18T14:39:34.942 INFO:teuthology.orchestra.run.smithi119.stderr:18 Apr 14:39:34 ntpd[17212]: can't open /var/log/ntpstats/rawstats.20240418: Permission denied 2024-04-18T14:39:34.942 INFO:teuthology.orchestra.run.smithi119.stderr:18 Apr 14:39:34 ntpd[17212]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-18T14:39:34.942 INFO:teuthology.orchestra.run.smithi119.stderr:18 Apr 14:39:34 ntpd[17212]: can't open /var/log/ntpstats/rawstats.20240418: Permission denied 2024-04-18T14:39:34.942 INFO:teuthology.orchestra.run.smithi119.stderr:18 Apr 14:39:34 ntpd[17212]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-18T14:39:34.942 INFO:teuthology.orchestra.run.smithi119.stderr:18 Apr 14:39:34 ntpd[17212]: can't open /var/log/ntpstats/peerstats.20240418: Permission denied 2024-04-18T14:39:34.965 INFO:teuthology.orchestra.run.smithi134.stderr:18 Apr 14:39:34 ntpd[17197]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-18T14:39:34.965 INFO:teuthology.orchestra.run.smithi134.stderr:18 Apr 14:39:34 ntpd[17197]: can't open /var/log/ntpstats/rawstats.20240418: Permission denied 2024-04-18T14:39:34.965 INFO:teuthology.orchestra.run.smithi134.stderr:18 Apr 14:39:34 ntpd[17197]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-18T14:39:34.965 INFO:teuthology.orchestra.run.smithi134.stderr:18 Apr 14:39:34 ntpd[17197]: can't open /var/log/ntpstats/rawstats.20240418: Permission denied 2024-04-18T14:39:34.965 INFO:teuthology.orchestra.run.smithi134.stderr:18 Apr 14:39:34 ntpd[17197]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-18T14:39:34.965 INFO:teuthology.orchestra.run.smithi134.stderr:18 Apr 14:39:34 ntpd[17197]: can't open /var/log/ntpstats/peerstats.20240418: Permission denied 2024-04-18T14:39:35.935 INFO:teuthology.orchestra.run.smithi086.stderr:18 Apr 14:39:35 ntpd[17180]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-18T14:39:35.935 INFO:teuthology.orchestra.run.smithi086.stderr:18 Apr 14:39:35 ntpd[17180]: can't open /var/log/ntpstats/rawstats.20240418: Permission denied 2024-04-18T14:39:35.935 INFO:teuthology.orchestra.run.smithi086.stderr:18 Apr 14:39:35 ntpd[17180]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-18T14:39:35.936 INFO:teuthology.orchestra.run.smithi086.stderr:18 Apr 14:39:35 ntpd[17180]: can't open /var/log/ntpstats/rawstats.20240418: Permission denied 2024-04-18T14:39:35.936 INFO:teuthology.orchestra.run.smithi086.stderr:18 Apr 14:39:35 ntpd[17180]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-18T14:39:35.936 INFO:teuthology.orchestra.run.smithi086.stderr:18 Apr 14:39:35 ntpd[17180]: can't open /var/log/ntpstats/rawstats.20240418: Permission denied 2024-04-18T14:39:35.936 INFO:teuthology.orchestra.run.smithi086.stderr:18 Apr 14:39:35 ntpd[17180]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-18T14:39:35.936 INFO:teuthology.orchestra.run.smithi086.stderr:18 Apr 14:39:35 ntpd[17180]: can't open /var/log/ntpstats/peerstats.20240418: Permission denied 2024-04-18T14:39:35.936 INFO:teuthology.orchestra.run.smithi086.stderr:18 Apr 14:39:35 ntpd[17180]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-18T14:39:35.936 INFO:teuthology.orchestra.run.smithi086.stderr:18 Apr 14:39:35 ntpd[17180]: can't open /var/log/ntpstats/rawstats.20240418: Permission denied 2024-04-18T14:39:35.936 INFO:teuthology.orchestra.run.smithi086.stderr:18 Apr 14:39:35 ntpd[17180]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-18T14:39:35.936 INFO:teuthology.orchestra.run.smithi086.stderr:18 Apr 14:39:35 ntpd[17180]: can't open /var/log/ntpstats/peerstats.20240418: Permission denied 2024-04-18T14:39:35.940 INFO:teuthology.orchestra.run.smithi096.stderr:18 Apr 14:39:35 ntpd[17219]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-18T14:39:35.940 INFO:teuthology.orchestra.run.smithi096.stderr:18 Apr 14:39:35 ntpd[17219]: can't open /var/log/ntpstats/rawstats.20240418: Permission denied 2024-04-18T14:39:35.941 INFO:teuthology.orchestra.run.smithi096.stderr:18 Apr 14:39:35 ntpd[17219]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-18T14:39:35.941 INFO:teuthology.orchestra.run.smithi096.stderr:18 Apr 14:39:35 ntpd[17219]: can't open /var/log/ntpstats/rawstats.20240418: Permission denied 2024-04-18T14:39:35.941 INFO:teuthology.orchestra.run.smithi096.stderr:18 Apr 14:39:35 ntpd[17219]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-18T14:39:35.941 INFO:teuthology.orchestra.run.smithi096.stderr:18 Apr 14:39:35 ntpd[17219]: can't open /var/log/ntpstats/rawstats.20240418: Permission denied 2024-04-18T14:39:35.941 INFO:teuthology.orchestra.run.smithi096.stderr:18 Apr 14:39:35 ntpd[17219]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-18T14:39:35.941 INFO:teuthology.orchestra.run.smithi096.stderr:18 Apr 14:39:35 ntpd[17219]: can't open /var/log/ntpstats/peerstats.20240418: Permission denied 2024-04-18T14:39:35.942 INFO:teuthology.orchestra.run.smithi096.stdout:18 Apr 14:39:35 ntpd[17219]: ntpd: time slew +0.001685 s 2024-04-18T14:39:35.942 INFO:teuthology.orchestra.run.smithi096.stdout:ntpd: time slew +0.001685s 2024-04-18T14:39:35.942 INFO:teuthology.orchestra.run.smithi096.stderr:18 Apr 14:39:35 ntpd[17219]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2024-04-18T14:39:35.943 INFO:teuthology.orchestra.run.smithi096.stderr:18 Apr 14:39:35 ntpd[17219]: can't open /var/log/ntpstats/loopstats.20240418: Permission denied 2024-04-18T14:39:35.944 INFO:teuthology.orchestra.run.smithi119.stderr:18 Apr 14:39:35 ntpd[17212]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-18T14:39:35.944 INFO:teuthology.orchestra.run.smithi119.stderr:18 Apr 14:39:35 ntpd[17212]: can't open /var/log/ntpstats/rawstats.20240418: Permission denied 2024-04-18T14:39:35.944 INFO:teuthology.orchestra.run.smithi119.stderr:18 Apr 14:39:35 ntpd[17212]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-18T14:39:35.944 INFO:teuthology.orchestra.run.smithi119.stderr:18 Apr 14:39:35 ntpd[17212]: can't open /var/log/ntpstats/rawstats.20240418: Permission denied 2024-04-18T14:39:35.945 INFO:teuthology.orchestra.run.smithi119.stderr:18 Apr 14:39:35 ntpd[17212]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-18T14:39:35.945 INFO:teuthology.orchestra.run.smithi119.stderr:18 Apr 14:39:35 ntpd[17212]: can't open /var/log/ntpstats/rawstats.20240418: Permission denied 2024-04-18T14:39:35.945 INFO:teuthology.orchestra.run.smithi119.stderr:18 Apr 14:39:35 ntpd[17212]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-18T14:39:35.945 INFO:teuthology.orchestra.run.smithi119.stderr:18 Apr 14:39:35 ntpd[17212]: can't open /var/log/ntpstats/peerstats.20240418: Permission denied 2024-04-18T14:39:35.945 INFO:teuthology.orchestra.run.smithi119.stderr:18 Apr 14:39:35 ntpd[17212]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-18T14:39:35.945 INFO:teuthology.orchestra.run.smithi119.stderr:18 Apr 14:39:35 ntpd[17212]: can't open /var/log/ntpstats/rawstats.20240418: Permission denied 2024-04-18T14:39:35.945 INFO:teuthology.orchestra.run.smithi119.stderr:18 Apr 14:39:35 ntpd[17212]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-18T14:39:35.945 INFO:teuthology.orchestra.run.smithi119.stderr:18 Apr 14:39:35 ntpd[17212]: can't open /var/log/ntpstats/peerstats.20240418: Permission denied 2024-04-18T14:39:35.945 INFO:teuthology.orchestra.run.smithi119.stdout:18 Apr 14:39:35 ntpd[17212]: ntpd: time slew -0.007249 s 2024-04-18T14:39:35.945 INFO:teuthology.orchestra.run.smithi119.stdout:ntpd: time slew -0.007249s 2024-04-18T14:39:35.946 INFO:teuthology.orchestra.run.smithi119.stderr:18 Apr 14:39:35 ntpd[17212]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2024-04-18T14:39:35.946 INFO:teuthology.orchestra.run.smithi119.stderr:18 Apr 14:39:35 ntpd[17212]: can't open /var/log/ntpstats/loopstats.20240418: Permission denied 2024-04-18T14:39:35.966 INFO:teuthology.orchestra.run.smithi134.stderr:18 Apr 14:39:35 ntpd[17197]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-18T14:39:35.966 INFO:teuthology.orchestra.run.smithi134.stderr:18 Apr 14:39:35 ntpd[17197]: can't open /var/log/ntpstats/rawstats.20240418: Permission denied 2024-04-18T14:39:35.966 INFO:teuthology.orchestra.run.smithi134.stderr:18 Apr 14:39:35 ntpd[17197]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-18T14:39:35.966 INFO:teuthology.orchestra.run.smithi134.stderr:18 Apr 14:39:35 ntpd[17197]: can't open /var/log/ntpstats/rawstats.20240418: Permission denied 2024-04-18T14:39:35.966 INFO:teuthology.orchestra.run.smithi134.stderr:18 Apr 14:39:35 ntpd[17197]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-18T14:39:35.966 INFO:teuthology.orchestra.run.smithi134.stderr:18 Apr 14:39:35 ntpd[17197]: can't open /var/log/ntpstats/rawstats.20240418: Permission denied 2024-04-18T14:39:35.966 INFO:teuthology.orchestra.run.smithi134.stderr:18 Apr 14:39:35 ntpd[17197]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-18T14:39:35.966 INFO:teuthology.orchestra.run.smithi134.stderr:18 Apr 14:39:35 ntpd[17197]: can't open /var/log/ntpstats/peerstats.20240418: Permission denied 2024-04-18T14:39:35.966 INFO:teuthology.orchestra.run.smithi134.stderr:18 Apr 14:39:35 ntpd[17197]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-18T14:39:35.967 INFO:teuthology.orchestra.run.smithi134.stderr:18 Apr 14:39:35 ntpd[17197]: can't open /var/log/ntpstats/rawstats.20240418: Permission denied 2024-04-18T14:39:35.967 INFO:teuthology.orchestra.run.smithi134.stderr:18 Apr 14:39:35 ntpd[17197]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-18T14:39:35.967 INFO:teuthology.orchestra.run.smithi134.stderr:18 Apr 14:39:35 ntpd[17197]: can't open /var/log/ntpstats/peerstats.20240418: Permission denied 2024-04-18T14:39:35.967 INFO:teuthology.orchestra.run.smithi134.stdout:18 Apr 14:39:35 ntpd[17197]: ntpd: time slew -0.007661 s 2024-04-18T14:39:35.967 INFO:teuthology.orchestra.run.smithi134.stdout:ntpd: time slew -0.007661s 2024-04-18T14:39:35.968 INFO:teuthology.orchestra.run.smithi134.stderr:18 Apr 14:39:35 ntpd[17197]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2024-04-18T14:39:35.968 INFO:teuthology.orchestra.run.smithi134.stderr:18 Apr 14:39:35 ntpd[17197]: can't open /var/log/ntpstats/loopstats.20240418: Permission denied 2024-04-18T14:39:35.994 INFO:teuthology.orchestra.run.smithi096.stdout: remote refid st t when poll reach delay offset jitter 2024-04-18T14:39:35.994 INFO:teuthology.orchestra.run.smithi096.stdout:============================================================================== 2024-04-18T14:39:35.994 INFO:teuthology.orchestra.run.smithi096.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-18T14:39:35.994 INFO:teuthology.orchestra.run.smithi096.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-18T14:39:35.994 INFO:teuthology.orchestra.run.smithi096.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-18T14:39:35.994 INFO:teuthology.orchestra.run.smithi096.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-18T14:39:35.996 INFO:teuthology.orchestra.run.smithi119.stdout: remote refid st t when poll reach delay offset jitter 2024-04-18T14:39:35.996 INFO:teuthology.orchestra.run.smithi119.stdout:============================================================================== 2024-04-18T14:39:35.996 INFO:teuthology.orchestra.run.smithi119.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-18T14:39:35.996 INFO:teuthology.orchestra.run.smithi119.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-18T14:39:35.996 INFO:teuthology.orchestra.run.smithi119.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-18T14:39:35.996 INFO:teuthology.orchestra.run.smithi119.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-18T14:39:36.015 INFO:teuthology.orchestra.run.smithi134.stdout: remote refid st t when poll reach delay offset jitter 2024-04-18T14:39:36.015 INFO:teuthology.orchestra.run.smithi134.stdout:============================================================================== 2024-04-18T14:39:36.015 INFO:teuthology.orchestra.run.smithi134.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-18T14:39:36.015 INFO:teuthology.orchestra.run.smithi134.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-18T14:39:36.015 INFO:teuthology.orchestra.run.smithi134.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-18T14:39:36.015 INFO:teuthology.orchestra.run.smithi134.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-18T14:39:36.934 INFO:teuthology.orchestra.run.smithi086.stderr:18 Apr 14:39:36 ntpd[17180]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-18T14:39:36.934 INFO:teuthology.orchestra.run.smithi086.stderr:18 Apr 14:39:36 ntpd[17180]: can't open /var/log/ntpstats/rawstats.20240418: Permission denied 2024-04-18T14:39:36.935 INFO:teuthology.orchestra.run.smithi086.stderr:18 Apr 14:39:36 ntpd[17180]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-18T14:39:36.935 INFO:teuthology.orchestra.run.smithi086.stderr:18 Apr 14:39:36 ntpd[17180]: can't open /var/log/ntpstats/rawstats.20240418: Permission denied 2024-04-18T14:39:36.935 INFO:teuthology.orchestra.run.smithi086.stderr:18 Apr 14:39:36 ntpd[17180]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-18T14:39:36.935 INFO:teuthology.orchestra.run.smithi086.stderr:18 Apr 14:39:36 ntpd[17180]: can't open /var/log/ntpstats/peerstats.20240418: Permission denied 2024-04-18T14:39:36.935 INFO:teuthology.orchestra.run.smithi086.stdout:18 Apr 14:39:36 ntpd[17180]: ntpd: time slew +0.004950 s 2024-04-18T14:39:36.935 INFO:teuthology.orchestra.run.smithi086.stdout:ntpd: time slew +0.004950s 2024-04-18T14:39:36.936 INFO:teuthology.orchestra.run.smithi086.stderr:18 Apr 14:39:36 ntpd[17180]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2024-04-18T14:39:36.936 INFO:teuthology.orchestra.run.smithi086.stderr:18 Apr 14:39:36 ntpd[17180]: can't open /var/log/ntpstats/loopstats.20240418: Permission denied 2024-04-18T14:39:36.987 INFO:teuthology.orchestra.run.smithi086.stdout: remote refid st t when poll reach delay offset jitter 2024-04-18T14:39:36.987 INFO:teuthology.orchestra.run.smithi086.stdout:============================================================================== 2024-04-18T14:39:36.987 INFO:teuthology.orchestra.run.smithi086.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-18T14:39:36.987 INFO:teuthology.orchestra.run.smithi086.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-18T14:39:36.988 INFO:teuthology.orchestra.run.smithi086.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-18T14:39:36.988 INFO:teuthology.orchestra.run.smithi086.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-18T14:39:36.989 INFO:teuthology.run_tasks:Running task install... 2024-04-18T14:39:36.997 DEBUG:teuthology.task.install:project ceph 2024-04-18T14:39:36.997 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '6a7528e4aecd36b18c4b41cee6012e9f92aa7ab0'}} 2024-04-18T14:39:36.997 DEBUG:teuthology.task.install:config {'flavor': 'default', 'sha1': '6a7528e4aecd36b18c4b41cee6012e9f92aa7ab0'} 2024-04-18T14:39:36.998 INFO:teuthology.task.install:Using flavor: default 2024-04-18T14:39:37.003 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-04-18T14:39:37.004 INFO:teuthology.task.install:extra packages: [] 2024-04-18T14:39:37.004 DEBUG:teuthology.orchestra.run.smithi086:> sudo apt-key list | grep Ceph 2024-04-18T14:39:37.004 DEBUG:teuthology.orchestra.run.smithi096:> sudo apt-key list | grep Ceph 2024-04-18T14:39:37.005 DEBUG:teuthology.orchestra.run.smithi119:> sudo apt-key list | grep Ceph 2024-04-18T14:39:37.005 DEBUG:teuthology.orchestra.run.smithi134:> sudo apt-key list | grep Ceph 2024-04-18T14:39:37.067 INFO:teuthology.orchestra.run.smithi096.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2024-04-18T14:39:37.068 INFO:teuthology.orchestra.run.smithi134.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2024-04-18T14:39:37.068 INFO:teuthology.orchestra.run.smithi119.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2024-04-18T14:39:37.089 INFO:teuthology.orchestra.run.smithi086.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2024-04-18T14:39:37.093 INFO:teuthology.orchestra.run.smithi096.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2024-04-18T14:39:37.093 INFO:teuthology.orchestra.run.smithi096.stdout:uid [ unknown] Ceph.com (release key) 2024-04-18T14:39:37.095 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse on remote deb x86_64 2024-04-18T14:39:37.095 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=6a7528e4aecd36b18c4b41cee6012e9f92aa7ab0 2024-04-18T14:39:37.100 INFO:teuthology.orchestra.run.smithi119.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2024-04-18T14:39:37.101 INFO:teuthology.orchestra.run.smithi119.stdout:uid [ unknown] Ceph.com (release key) 2024-04-18T14:39:37.101 INFO:teuthology.orchestra.run.smithi134.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2024-04-18T14:39:37.101 INFO:teuthology.orchestra.run.smithi134.stdout:uid [ unknown] Ceph.com (release key) 2024-04-18T14:39:37.101 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse on remote deb x86_64 2024-04-18T14:39:37.101 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=6a7528e4aecd36b18c4b41cee6012e9f92aa7ab0 2024-04-18T14:39:37.102 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse on remote deb x86_64 2024-04-18T14:39:37.103 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=6a7528e4aecd36b18c4b41cee6012e9f92aa7ab0 2024-04-18T14:39:37.118 INFO:teuthology.orchestra.run.smithi086.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2024-04-18T14:39:37.118 INFO:teuthology.orchestra.run.smithi086.stdout:uid [ unknown] Ceph.com (release key) 2024-04-18T14:39:37.118 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse on remote deb x86_64 2024-04-18T14:39:37.118 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=6a7528e4aecd36b18c4b41cee6012e9f92aa7ab0 2024-04-18T14:39:37.242 INFO:teuthology.task.install.deb:Pulling from https://3.chacra.ceph.com/r/ceph/wip-yuri2-testing-2024-04-17-0823-reef/6a7528e4aecd36b18c4b41cee6012e9f92aa7ab0/ubuntu/jammy/flavors/default/ 2024-04-18T14:39:37.242 INFO:teuthology.task.install.deb:Package version is 18.2.2-1240-g6a7528e4-1jammy 2024-04-18T14:39:37.254 INFO:teuthology.task.install.deb:Pulling from https://3.chacra.ceph.com/r/ceph/wip-yuri2-testing-2024-04-17-0823-reef/6a7528e4aecd36b18c4b41cee6012e9f92aa7ab0/ubuntu/jammy/flavors/default/ 2024-04-18T14:39:37.254 INFO:teuthology.task.install.deb:Package version is 18.2.2-1240-g6a7528e4-1jammy 2024-04-18T14:39:37.258 INFO:teuthology.task.install.deb:Pulling from https://3.chacra.ceph.com/r/ceph/wip-yuri2-testing-2024-04-17-0823-reef/6a7528e4aecd36b18c4b41cee6012e9f92aa7ab0/ubuntu/jammy/flavors/default/ 2024-04-18T14:39:37.258 INFO:teuthology.task.install.deb:Package version is 18.2.2-1240-g6a7528e4-1jammy 2024-04-18T14:39:37.380 INFO:teuthology.task.install.deb:Pulling from https://3.chacra.ceph.com/r/ceph/wip-yuri2-testing-2024-04-17-0823-reef/6a7528e4aecd36b18c4b41cee6012e9f92aa7ab0/ubuntu/jammy/flavors/default/ 2024-04-18T14:39:37.381 INFO:teuthology.task.install.deb:Package version is 18.2.2-1240-g6a7528e4-1jammy 2024-04-18T14:39:37.539 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2024-04-18T14:39:37.539 DEBUG:teuthology.orchestra.run.smithi119:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2024-04-18T14:39:37.541 DEBUG:teuthology.orchestra.run.smithi086:> set -ex 2024-04-18T14:39:37.541 DEBUG:teuthology.orchestra.run.smithi086:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2024-04-18T14:39:37.553 DEBUG:teuthology.orchestra.run.smithi119:> sudo apt-get update 2024-04-18T14:39:37.555 DEBUG:teuthology.orchestra.run.smithi086:> sudo apt-get update 2024-04-18T14:39:37.562 DEBUG:teuthology.orchestra.run.smithi096:> set -ex 2024-04-18T14:39:37.562 DEBUG:teuthology.orchestra.run.smithi096:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2024-04-18T14:39:37.576 DEBUG:teuthology.orchestra.run.smithi096:> sudo apt-get update 2024-04-18T14:39:37.672 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-04-18T14:39:37.672 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2024-04-18T14:39:37.686 DEBUG:teuthology.orchestra.run.smithi134:> sudo apt-get update 2024-04-18T14:39:37.727 INFO:teuthology.orchestra.run.smithi119.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-04-18T14:39:37.728 INFO:teuthology.orchestra.run.smithi086.stdout:Hit:1 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-04-18T14:39:37.742 INFO:teuthology.orchestra.run.smithi119.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-04-18T14:39:37.753 INFO:teuthology.orchestra.run.smithi096.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-04-18T14:39:37.754 INFO:teuthology.orchestra.run.smithi096.stdout:Hit:2 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-04-18T14:39:37.763 INFO:teuthology.orchestra.run.smithi119.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-04-18T14:39:37.766 INFO:teuthology.orchestra.run.smithi096.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-04-18T14:39:37.787 INFO:teuthology.orchestra.run.smithi096.stdout:Hit:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-04-18T14:39:37.839 INFO:teuthology.orchestra.run.smithi119.stdout:Hit:4 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-04-18T14:39:37.841 INFO:teuthology.orchestra.run.smithi086.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-04-18T14:39:37.855 INFO:teuthology.orchestra.run.smithi134.stdout:Hit:1 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-04-18T14:39:37.855 INFO:teuthology.orchestra.run.smithi134.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-04-18T14:39:37.870 INFO:teuthology.orchestra.run.smithi134.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-04-18T14:39:37.892 INFO:teuthology.orchestra.run.smithi134.stdout:Hit:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-04-18T14:39:37.923 INFO:teuthology.orchestra.run.smithi086.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-04-18T14:39:37.952 INFO:teuthology.orchestra.run.smithi086.stdout:Ign:4 https://3.chacra.ceph.com/r/ceph/wip-yuri2-testing-2024-04-17-0823-reef/6a7528e4aecd36b18c4b41cee6012e9f92aa7ab0/ubuntu/jammy/flavors/default jammy InRelease 2024-04-18T14:39:38.004 INFO:teuthology.orchestra.run.smithi086.stdout:Hit:5 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-04-18T14:39:38.017 INFO:teuthology.orchestra.run.smithi119.stdout:Ign:5 https://3.chacra.ceph.com/r/ceph/wip-yuri2-testing-2024-04-17-0823-reef/6a7528e4aecd36b18c4b41cee6012e9f92aa7ab0/ubuntu/jammy/flavors/default jammy InRelease 2024-04-18T14:39:38.020 INFO:teuthology.orchestra.run.smithi086.stdout:Get:6 https://3.chacra.ceph.com/r/ceph/wip-yuri2-testing-2024-04-17-0823-reef/6a7528e4aecd36b18c4b41cee6012e9f92aa7ab0/ubuntu/jammy/flavors/default jammy Release [7,662 B] 2024-04-18T14:39:38.042 INFO:teuthology.orchestra.run.smithi096.stdout:Ign:5 https://3.chacra.ceph.com/r/ceph/wip-yuri2-testing-2024-04-17-0823-reef/6a7528e4aecd36b18c4b41cee6012e9f92aa7ab0/ubuntu/jammy/flavors/default jammy InRelease 2024-04-18T14:39:38.089 INFO:teuthology.orchestra.run.smithi134.stdout:Ign:5 https://3.chacra.ceph.com/r/ceph/wip-yuri2-testing-2024-04-17-0823-reef/6a7528e4aecd36b18c4b41cee6012e9f92aa7ab0/ubuntu/jammy/flavors/default jammy InRelease 2024-04-18T14:39:38.089 INFO:teuthology.orchestra.run.smithi086.stdout:Ign:7 https://3.chacra.ceph.com/r/ceph/wip-yuri2-testing-2024-04-17-0823-reef/6a7528e4aecd36b18c4b41cee6012e9f92aa7ab0/ubuntu/jammy/flavors/default jammy Release.gpg 2024-04-18T14:39:38.102 INFO:teuthology.orchestra.run.smithi119.stdout:Get:6 https://3.chacra.ceph.com/r/ceph/wip-yuri2-testing-2024-04-17-0823-reef/6a7528e4aecd36b18c4b41cee6012e9f92aa7ab0/ubuntu/jammy/flavors/default jammy Release [7,662 B] 2024-04-18T14:39:38.126 INFO:teuthology.orchestra.run.smithi096.stdout:Get:6 https://3.chacra.ceph.com/r/ceph/wip-yuri2-testing-2024-04-17-0823-reef/6a7528e4aecd36b18c4b41cee6012e9f92aa7ab0/ubuntu/jammy/flavors/default jammy Release [7,662 B] 2024-04-18T14:39:38.158 INFO:teuthology.orchestra.run.smithi134.stdout:Get:6 https://3.chacra.ceph.com/r/ceph/wip-yuri2-testing-2024-04-17-0823-reef/6a7528e4aecd36b18c4b41cee6012e9f92aa7ab0/ubuntu/jammy/flavors/default jammy Release [7,662 B] 2024-04-18T14:39:38.159 INFO:teuthology.orchestra.run.smithi086.stdout:Get:8 https://3.chacra.ceph.com/r/ceph/wip-yuri2-testing-2024-04-17-0823-reef/6a7528e4aecd36b18c4b41cee6012e9f92aa7ab0/ubuntu/jammy/flavors/default jammy/main amd64 Packages [17.7 kB] 2024-04-18T14:39:38.188 INFO:teuthology.orchestra.run.smithi119.stdout:Ign:7 https://3.chacra.ceph.com/r/ceph/wip-yuri2-testing-2024-04-17-0823-reef/6a7528e4aecd36b18c4b41cee6012e9f92aa7ab0/ubuntu/jammy/flavors/default jammy Release.gpg 2024-04-18T14:39:38.213 INFO:teuthology.orchestra.run.smithi096.stdout:Ign:7 https://3.chacra.ceph.com/r/ceph/wip-yuri2-testing-2024-04-17-0823-reef/6a7528e4aecd36b18c4b41cee6012e9f92aa7ab0/ubuntu/jammy/flavors/default jammy Release.gpg 2024-04-18T14:39:38.228 INFO:teuthology.orchestra.run.smithi134.stdout:Ign:7 https://3.chacra.ceph.com/r/ceph/wip-yuri2-testing-2024-04-17-0823-reef/6a7528e4aecd36b18c4b41cee6012e9f92aa7ab0/ubuntu/jammy/flavors/default jammy Release.gpg 2024-04-18T14:39:38.273 INFO:teuthology.orchestra.run.smithi119.stdout:Get:8 https://3.chacra.ceph.com/r/ceph/wip-yuri2-testing-2024-04-17-0823-reef/6a7528e4aecd36b18c4b41cee6012e9f92aa7ab0/ubuntu/jammy/flavors/default jammy/main amd64 Packages [17.7 kB] 2024-04-18T14:39:38.298 INFO:teuthology.orchestra.run.smithi096.stdout:Get:8 https://3.chacra.ceph.com/r/ceph/wip-yuri2-testing-2024-04-17-0823-reef/6a7528e4aecd36b18c4b41cee6012e9f92aa7ab0/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,414 B] 2024-04-18T14:39:38.299 INFO:teuthology.orchestra.run.smithi134.stdout:Get:8 https://3.chacra.ceph.com/r/ceph/wip-yuri2-testing-2024-04-17-0823-reef/6a7528e4aecd36b18c4b41cee6012e9f92aa7ab0/ubuntu/jammy/flavors/default jammy/main amd64 Packages [17.7 kB] 2024-04-18T14:39:38.309 INFO:teuthology.orchestra.run.smithi086.stdout:Get:9 https://3.chacra.ceph.com/r/ceph/wip-yuri2-testing-2024-04-17-0823-reef/6a7528e4aecd36b18c4b41cee6012e9f92aa7ab0/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,414 B] 2024-04-18T14:39:38.368 INFO:teuthology.orchestra.run.smithi119.stdout:Get:9 https://3.chacra.ceph.com/r/ceph/wip-yuri2-testing-2024-04-17-0823-reef/6a7528e4aecd36b18c4b41cee6012e9f92aa7ab0/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,414 B] 2024-04-18T14:39:38.379 INFO:teuthology.orchestra.run.smithi134.stdout:Get:9 https://3.chacra.ceph.com/r/ceph/wip-yuri2-testing-2024-04-17-0823-reef/6a7528e4aecd36b18c4b41cee6012e9f92aa7ab0/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,414 B] 2024-04-18T14:39:38.393 INFO:teuthology.orchestra.run.smithi086.stdout:Fetched 28.8 kB in 1s (44.2 kB/s) 2024-04-18T14:39:38.394 INFO:teuthology.orchestra.run.smithi096.stdout:Get:9 https://3.chacra.ceph.com/r/ceph/wip-yuri2-testing-2024-04-17-0823-reef/6a7528e4aecd36b18c4b41cee6012e9f92aa7ab0/ubuntu/jammy/flavors/default jammy/main amd64 Packages [17.7 kB] 2024-04-18T14:39:38.463 INFO:teuthology.orchestra.run.smithi119.stdout:Fetched 28.8 kB in 1s (40.5 kB/s) 2024-04-18T14:39:38.464 INFO:teuthology.orchestra.run.smithi134.stdout:Fetched 28.8 kB in 1s (48.8 kB/s) 2024-04-18T14:39:38.483 INFO:teuthology.orchestra.run.smithi096.stdout:Fetched 28.8 kB in 1s (40.2 kB/s) 2024-04-18T14:39:39.367 INFO:teuthology.orchestra.run.smithi086.stdout:Reading package lists... 2024-04-18T14:39:39.383 DEBUG:teuthology.orchestra.run.smithi086:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=18.2.2-1240-g6a7528e4-1jammy cephadm=18.2.2-1240-g6a7528e4-1jammy ceph-mds=18.2.2-1240-g6a7528e4-1jammy ceph-mgr=18.2.2-1240-g6a7528e4-1jammy ceph-common=18.2.2-1240-g6a7528e4-1jammy ceph-fuse=18.2.2-1240-g6a7528e4-1jammy ceph-test=18.2.2-1240-g6a7528e4-1jammy ceph-volume=18.2.2-1240-g6a7528e4-1jammy radosgw=18.2.2-1240-g6a7528e4-1jammy python3-rados=18.2.2-1240-g6a7528e4-1jammy python3-rgw=18.2.2-1240-g6a7528e4-1jammy python3-cephfs=18.2.2-1240-g6a7528e4-1jammy python3-rbd=18.2.2-1240-g6a7528e4-1jammy libcephfs2=18.2.2-1240-g6a7528e4-1jammy libcephfs-dev=18.2.2-1240-g6a7528e4-1jammy librados2=18.2.2-1240-g6a7528e4-1jammy librbd1=18.2.2-1240-g6a7528e4-1jammy rbd-fuse=18.2.2-1240-g6a7528e4-1jammy 2024-04-18T14:39:39.435 INFO:teuthology.orchestra.run.smithi086.stdout:Reading package lists... 2024-04-18T14:39:39.437 INFO:teuthology.orchestra.run.smithi134.stdout:Reading package lists... 2024-04-18T14:39:39.453 DEBUG:teuthology.orchestra.run.smithi134:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=18.2.2-1240-g6a7528e4-1jammy cephadm=18.2.2-1240-g6a7528e4-1jammy ceph-mds=18.2.2-1240-g6a7528e4-1jammy ceph-mgr=18.2.2-1240-g6a7528e4-1jammy ceph-common=18.2.2-1240-g6a7528e4-1jammy ceph-fuse=18.2.2-1240-g6a7528e4-1jammy ceph-test=18.2.2-1240-g6a7528e4-1jammy ceph-volume=18.2.2-1240-g6a7528e4-1jammy radosgw=18.2.2-1240-g6a7528e4-1jammy python3-rados=18.2.2-1240-g6a7528e4-1jammy python3-rgw=18.2.2-1240-g6a7528e4-1jammy python3-cephfs=18.2.2-1240-g6a7528e4-1jammy python3-rbd=18.2.2-1240-g6a7528e4-1jammy libcephfs2=18.2.2-1240-g6a7528e4-1jammy libcephfs-dev=18.2.2-1240-g6a7528e4-1jammy librados2=18.2.2-1240-g6a7528e4-1jammy librbd1=18.2.2-1240-g6a7528e4-1jammy rbd-fuse=18.2.2-1240-g6a7528e4-1jammy 2024-04-18T14:39:39.455 INFO:teuthology.orchestra.run.smithi119.stdout:Reading package lists... 2024-04-18T14:39:39.456 INFO:teuthology.orchestra.run.smithi096.stdout:Reading package lists... 2024-04-18T14:39:39.470 DEBUG:teuthology.orchestra.run.smithi119:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=18.2.2-1240-g6a7528e4-1jammy cephadm=18.2.2-1240-g6a7528e4-1jammy ceph-mds=18.2.2-1240-g6a7528e4-1jammy ceph-mgr=18.2.2-1240-g6a7528e4-1jammy ceph-common=18.2.2-1240-g6a7528e4-1jammy ceph-fuse=18.2.2-1240-g6a7528e4-1jammy ceph-test=18.2.2-1240-g6a7528e4-1jammy ceph-volume=18.2.2-1240-g6a7528e4-1jammy radosgw=18.2.2-1240-g6a7528e4-1jammy python3-rados=18.2.2-1240-g6a7528e4-1jammy python3-rgw=18.2.2-1240-g6a7528e4-1jammy python3-cephfs=18.2.2-1240-g6a7528e4-1jammy python3-rbd=18.2.2-1240-g6a7528e4-1jammy libcephfs2=18.2.2-1240-g6a7528e4-1jammy libcephfs-dev=18.2.2-1240-g6a7528e4-1jammy librados2=18.2.2-1240-g6a7528e4-1jammy librbd1=18.2.2-1240-g6a7528e4-1jammy rbd-fuse=18.2.2-1240-g6a7528e4-1jammy 2024-04-18T14:39:39.472 DEBUG:teuthology.orchestra.run.smithi096:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=18.2.2-1240-g6a7528e4-1jammy cephadm=18.2.2-1240-g6a7528e4-1jammy ceph-mds=18.2.2-1240-g6a7528e4-1jammy ceph-mgr=18.2.2-1240-g6a7528e4-1jammy ceph-common=18.2.2-1240-g6a7528e4-1jammy ceph-fuse=18.2.2-1240-g6a7528e4-1jammy ceph-test=18.2.2-1240-g6a7528e4-1jammy ceph-volume=18.2.2-1240-g6a7528e4-1jammy radosgw=18.2.2-1240-g6a7528e4-1jammy python3-rados=18.2.2-1240-g6a7528e4-1jammy python3-rgw=18.2.2-1240-g6a7528e4-1jammy python3-cephfs=18.2.2-1240-g6a7528e4-1jammy python3-rbd=18.2.2-1240-g6a7528e4-1jammy libcephfs2=18.2.2-1240-g6a7528e4-1jammy libcephfs-dev=18.2.2-1240-g6a7528e4-1jammy librados2=18.2.2-1240-g6a7528e4-1jammy librbd1=18.2.2-1240-g6a7528e4-1jammy rbd-fuse=18.2.2-1240-g6a7528e4-1jammy 2024-04-18T14:39:39.514 INFO:teuthology.orchestra.run.smithi134.stdout:Reading package lists... 2024-04-18T14:39:39.523 INFO:teuthology.orchestra.run.smithi096.stdout:Reading package lists... 2024-04-18T14:39:39.531 INFO:teuthology.orchestra.run.smithi119.stdout:Reading package lists... 2024-04-18T14:39:39.618 INFO:teuthology.orchestra.run.smithi086.stdout:Building dependency tree... 2024-04-18T14:39:39.619 INFO:teuthology.orchestra.run.smithi086.stdout:Reading state information... 2024-04-18T14:39:39.699 INFO:teuthology.orchestra.run.smithi096.stdout:Building dependency tree... 2024-04-18T14:39:39.700 INFO:teuthology.orchestra.run.smithi096.stdout:Reading state information... 2024-04-18T14:39:39.713 INFO:teuthology.orchestra.run.smithi134.stdout:Building dependency tree... 2024-04-18T14:39:39.713 INFO:teuthology.orchestra.run.smithi134.stdout:Reading state information... 2024-04-18T14:39:39.729 INFO:teuthology.orchestra.run.smithi119.stdout:Building dependency tree... 2024-04-18T14:39:39.730 INFO:teuthology.orchestra.run.smithi119.stdout:Reading state information... 2024-04-18T14:39:39.794 INFO:teuthology.orchestra.run.smithi086.stdout:The following packages were automatically installed and are no longer required: 2024-04-18T14:39:39.794 INFO:teuthology.orchestra.run.smithi086.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-04-18T14:39:39.794 INFO:teuthology.orchestra.run.smithi086.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-04-18T14:39:39.794 INFO:teuthology.orchestra.run.smithi086.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-04-18T14:39:39.795 INFO:teuthology.orchestra.run.smithi086.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-04-18T14:39:39.795 INFO:teuthology.orchestra.run.smithi086.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-04-18T14:39:39.795 INFO:teuthology.orchestra.run.smithi086.stdout:Use 'sudo apt autoremove' to remove them. 2024-04-18T14:39:39.796 INFO:teuthology.orchestra.run.smithi086.stdout:The following additional packages will be installed: 2024-04-18T14:39:39.796 INFO:teuthology.orchestra.run.smithi086.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2024-04-18T14:39:39.796 INFO:teuthology.orchestra.run.smithi086.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2024-04-18T14:39:39.796 INFO:teuthology.orchestra.run.smithi086.stdout: libdouble-conversion3 libfmt8 libjq1 liblttng-ust1 liboath0 libonig5 2024-04-18T14:39:39.796 INFO:teuthology.orchestra.run.smithi086.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 libradosstriper1 2024-04-18T14:39:39.797 INFO:teuthology.orchestra.run.smithi086.stdout: librdkafka1 librgw2 libsqlite3-mod-ceph libthrift-0.16.0 nvme-cli 2024-04-18T14:39:39.797 INFO:teuthology.orchestra.run.smithi086.stdout: python-asyncssh-doc python-babel-localedata python-pastedeploy-tpl 2024-04-18T14:39:39.797 INFO:teuthology.orchestra.run.smithi086.stdout: python3-asyncssh python3-babel python3-bcrypt python3-cachetools 2024-04-18T14:39:39.797 INFO:teuthology.orchestra.run.smithi086.stdout: python3-ceph-argparse python3-ceph-common python3-certifi python3-cheroot 2024-04-18T14:39:39.798 INFO:teuthology.orchestra.run.smithi086.stdout: python3-cherrypy3 python3-google-auth python3-idna python3-iniconfig 2024-04-18T14:39:39.798 INFO:teuthology.orchestra.run.smithi086.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-04-18T14:39:39.798 INFO:teuthology.orchestra.run.smithi086.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-04-18T14:39:39.798 INFO:teuthology.orchestra.run.smithi086.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-04-18T14:39:39.798 INFO:teuthology.orchestra.run.smithi086.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-04-18T14:39:39.798 INFO:teuthology.orchestra.run.smithi086.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-04-18T14:39:39.798 INFO:teuthology.orchestra.run.smithi086.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-04-18T14:39:39.798 INFO:teuthology.orchestra.run.smithi086.stdout: python3-pygments python3-pyinotify python3-pytest python3-repoze.lru 2024-04-18T14:39:39.798 INFO:teuthology.orchestra.run.smithi086.stdout: python3-requests python3-requests-oauthlib python3-routes python3-rsa 2024-04-18T14:39:39.798 INFO:teuthology.orchestra.run.smithi086.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2024-04-18T14:39:39.798 INFO:teuthology.orchestra.run.smithi086.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2024-04-18T14:39:39.798 INFO:teuthology.orchestra.run.smithi086.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2024-04-18T14:39:39.798 INFO:teuthology.orchestra.run.smithi086.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2024-04-18T14:39:39.799 INFO:teuthology.orchestra.run.smithi086.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n socat xmlstarlet 2024-04-18T14:39:39.799 INFO:teuthology.orchestra.run.smithi086.stdout:Suggested packages: 2024-04-18T14:39:39.799 INFO:teuthology.orchestra.run.smithi086.stdout: python3-influxdb python-jinja2-doc python3-beaker python-mako-doc 2024-04-18T14:39:39.799 INFO:teuthology.orchestra.run.smithi086.stdout: python-natsort-doc python-openssl-doc python3-openssl-dbg httpd-wsgi 2024-04-18T14:39:39.799 INFO:teuthology.orchestra.run.smithi086.stdout: libapache2-mod-python libapache2-mod-scgi libjs-mochikit python-pecan-doc 2024-04-18T14:39:39.799 INFO:teuthology.orchestra.run.smithi086.stdout: python-psutil-doc subversion python-pygments-doc python-pyinotify-doc 2024-04-18T14:39:39.799 INFO:teuthology.orchestra.run.smithi086.stdout: python3-socks python-requests-doc python3-dap python-sklearn-doc ipython3 2024-04-18T14:39:39.799 INFO:teuthology.orchestra.run.smithi086.stdout: python-waitress-doc python-webob-doc python-webtest-doc python-werkzeug-doc 2024-04-18T14:39:39.799 INFO:teuthology.orchestra.run.smithi086.stdout: python3-watchdog 2024-04-18T14:39:39.799 INFO:teuthology.orchestra.run.smithi086.stdout:Recommended packages: 2024-04-18T14:39:39.800 INFO:teuthology.orchestra.run.smithi086.stdout: btrfs-tools 2024-04-18T14:39:39.870 INFO:teuthology.orchestra.run.smithi096.stdout:The following packages were automatically installed and are no longer required: 2024-04-18T14:39:39.870 INFO:teuthology.orchestra.run.smithi096.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-04-18T14:39:39.870 INFO:teuthology.orchestra.run.smithi096.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-04-18T14:39:39.871 INFO:teuthology.orchestra.run.smithi096.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-04-18T14:39:39.871 INFO:teuthology.orchestra.run.smithi096.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-04-18T14:39:39.871 INFO:teuthology.orchestra.run.smithi096.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-04-18T14:39:39.871 INFO:teuthology.orchestra.run.smithi096.stdout:Use 'sudo apt autoremove' to remove them. 2024-04-18T14:39:39.872 INFO:teuthology.orchestra.run.smithi096.stdout:The following additional packages will be installed: 2024-04-18T14:39:39.872 INFO:teuthology.orchestra.run.smithi096.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2024-04-18T14:39:39.872 INFO:teuthology.orchestra.run.smithi096.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2024-04-18T14:39:39.872 INFO:teuthology.orchestra.run.smithi096.stdout: libdouble-conversion3 libfmt8 libjq1 liblttng-ust1 liboath0 libonig5 2024-04-18T14:39:39.872 INFO:teuthology.orchestra.run.smithi096.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 libradosstriper1 2024-04-18T14:39:39.872 INFO:teuthology.orchestra.run.smithi096.stdout: librdkafka1 librgw2 libsqlite3-mod-ceph libthrift-0.16.0 nvme-cli 2024-04-18T14:39:39.873 INFO:teuthology.orchestra.run.smithi096.stdout: python-asyncssh-doc python-babel-localedata python-pastedeploy-tpl 2024-04-18T14:39:39.873 INFO:teuthology.orchestra.run.smithi096.stdout: python3-asyncssh python3-babel python3-bcrypt python3-cachetools 2024-04-18T14:39:39.873 INFO:teuthology.orchestra.run.smithi096.stdout: python3-ceph-argparse python3-ceph-common python3-certifi python3-cheroot 2024-04-18T14:39:39.873 INFO:teuthology.orchestra.run.smithi096.stdout: python3-cherrypy3 python3-google-auth python3-idna python3-iniconfig 2024-04-18T14:39:39.873 INFO:teuthology.orchestra.run.smithi096.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-04-18T14:39:39.873 INFO:teuthology.orchestra.run.smithi096.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-04-18T14:39:39.873 INFO:teuthology.orchestra.run.smithi096.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-04-18T14:39:39.873 INFO:teuthology.orchestra.run.smithi096.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-04-18T14:39:39.873 INFO:teuthology.orchestra.run.smithi096.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-04-18T14:39:39.873 INFO:teuthology.orchestra.run.smithi096.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-04-18T14:39:39.873 INFO:teuthology.orchestra.run.smithi096.stdout: python3-pygments python3-pyinotify python3-pytest python3-repoze.lru 2024-04-18T14:39:39.873 INFO:teuthology.orchestra.run.smithi096.stdout: python3-requests python3-requests-oauthlib python3-routes python3-rsa 2024-04-18T14:39:39.873 INFO:teuthology.orchestra.run.smithi096.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2024-04-18T14:39:39.874 INFO:teuthology.orchestra.run.smithi096.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2024-04-18T14:39:39.874 INFO:teuthology.orchestra.run.smithi096.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2024-04-18T14:39:39.874 INFO:teuthology.orchestra.run.smithi096.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2024-04-18T14:39:39.874 INFO:teuthology.orchestra.run.smithi096.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n socat xmlstarlet 2024-04-18T14:39:39.874 INFO:teuthology.orchestra.run.smithi096.stdout:Suggested packages: 2024-04-18T14:39:39.874 INFO:teuthology.orchestra.run.smithi096.stdout: python3-influxdb python-jinja2-doc python3-beaker python-mako-doc 2024-04-18T14:39:39.875 INFO:teuthology.orchestra.run.smithi096.stdout: python-natsort-doc python-openssl-doc python3-openssl-dbg httpd-wsgi 2024-04-18T14:39:39.875 INFO:teuthology.orchestra.run.smithi096.stdout: libapache2-mod-python libapache2-mod-scgi libjs-mochikit python-pecan-doc 2024-04-18T14:39:39.875 INFO:teuthology.orchestra.run.smithi096.stdout: python-psutil-doc subversion python-pygments-doc python-pyinotify-doc 2024-04-18T14:39:39.875 INFO:teuthology.orchestra.run.smithi096.stdout: python3-socks python-requests-doc python3-dap python-sklearn-doc ipython3 2024-04-18T14:39:39.875 INFO:teuthology.orchestra.run.smithi096.stdout: python-waitress-doc python-webob-doc python-webtest-doc python-werkzeug-doc 2024-04-18T14:39:39.875 INFO:teuthology.orchestra.run.smithi096.stdout: python3-watchdog 2024-04-18T14:39:39.875 INFO:teuthology.orchestra.run.smithi096.stdout:Recommended packages: 2024-04-18T14:39:39.875 INFO:teuthology.orchestra.run.smithi096.stdout: btrfs-tools 2024-04-18T14:39:39.896 INFO:teuthology.orchestra.run.smithi086.stdout:The following NEW packages will be installed: 2024-04-18T14:39:39.897 INFO:teuthology.orchestra.run.smithi086.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2024-04-18T14:39:39.897 INFO:teuthology.orchestra.run.smithi086.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2024-04-18T14:39:39.897 INFO:teuthology.orchestra.run.smithi086.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm jq 2024-04-18T14:39:39.897 INFO:teuthology.orchestra.run.smithi086.stdout: libcephfs-dev libcephfs2 libdouble-conversion3 libfmt8 libjq1 liblttng-ust1 2024-04-18T14:39:39.897 INFO:teuthology.orchestra.run.smithi086.stdout: liboath0 libonig5 libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 2024-04-18T14:39:39.897 INFO:teuthology.orchestra.run.smithi086.stdout: librados2 libradosstriper1 librbd1 librdkafka1 librgw2 libsqlite3-mod-ceph 2024-04-18T14:39:39.898 INFO:teuthology.orchestra.run.smithi086.stdout: libthrift-0.16.0 nvme-cli python-asyncssh-doc python-babel-localedata 2024-04-18T14:39:39.898 INFO:teuthology.orchestra.run.smithi086.stdout: python-pastedeploy-tpl python3-asyncssh python3-babel python3-bcrypt 2024-04-18T14:39:39.899 INFO:teuthology.orchestra.run.smithi086.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common python3-cephfs 2024-04-18T14:39:39.899 INFO:teuthology.orchestra.run.smithi086.stdout: python3-certifi python3-cheroot python3-cherrypy3 python3-google-auth 2024-04-18T14:39:39.899 INFO:teuthology.orchestra.run.smithi086.stdout: python3-idna python3-iniconfig python3-jaraco.classes 2024-04-18T14:39:39.899 INFO:teuthology.orchestra.run.smithi086.stdout: python3-jaraco.collections python3-jaraco.functools python3-jaraco.text 2024-04-18T14:39:39.899 INFO:teuthology.orchestra.run.smithi086.stdout: python3-jinja2 python3-joblib python3-kubernetes python3-logutils 2024-04-18T14:39:39.899 INFO:teuthology.orchestra.run.smithi086.stdout: python3-mako python3-markupsafe python3-natsort python3-openssl 2024-04-18T14:39:39.899 INFO:teuthology.orchestra.run.smithi086.stdout: python3-paste python3-pastedeploy python3-pastescript python3-pecan 2024-04-18T14:39:39.899 INFO:teuthology.orchestra.run.smithi086.stdout: python3-pluggy python3-portend python3-prettytable python3-psutil python3-py 2024-04-18T14:39:39.899 INFO:teuthology.orchestra.run.smithi086.stdout: python3-pyasn1 python3-pyasn1-modules python3-pygments python3-pyinotify 2024-04-18T14:39:39.899 INFO:teuthology.orchestra.run.smithi086.stdout: python3-pytest python3-rados python3-rbd python3-repoze.lru python3-requests 2024-04-18T14:39:39.900 INFO:teuthology.orchestra.run.smithi086.stdout: python3-requests-oauthlib python3-rgw python3-routes python3-rsa 2024-04-18T14:39:39.900 INFO:teuthology.orchestra.run.smithi086.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2024-04-18T14:39:39.900 INFO:teuthology.orchestra.run.smithi086.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2024-04-18T14:39:39.900 INFO:teuthology.orchestra.run.smithi086.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2024-04-18T14:39:39.900 INFO:teuthology.orchestra.run.smithi086.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2024-04-18T14:39:39.900 INFO:teuthology.orchestra.run.smithi086.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n radosgw rbd-fuse 2024-04-18T14:39:39.900 INFO:teuthology.orchestra.run.smithi086.stdout: socat xmlstarlet 2024-04-18T14:39:39.908 INFO:teuthology.orchestra.run.smithi134.stdout:The following packages were automatically installed and are no longer required: 2024-04-18T14:39:39.909 INFO:teuthology.orchestra.run.smithi134.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-04-18T14:39:39.909 INFO:teuthology.orchestra.run.smithi134.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-04-18T14:39:39.909 INFO:teuthology.orchestra.run.smithi134.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-04-18T14:39:39.909 INFO:teuthology.orchestra.run.smithi134.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-04-18T14:39:39.909 INFO:teuthology.orchestra.run.smithi134.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-04-18T14:39:39.909 INFO:teuthology.orchestra.run.smithi134.stdout:Use 'sudo apt autoremove' to remove them. 2024-04-18T14:39:39.910 INFO:teuthology.orchestra.run.smithi134.stdout:The following additional packages will be installed: 2024-04-18T14:39:39.910 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2024-04-18T14:39:39.911 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2024-04-18T14:39:39.911 INFO:teuthology.orchestra.run.smithi134.stdout: libdouble-conversion3 libfmt8 libjq1 liblttng-ust1 liboath0 libonig5 2024-04-18T14:39:39.911 INFO:teuthology.orchestra.run.smithi134.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 libradosstriper1 2024-04-18T14:39:39.911 INFO:teuthology.orchestra.run.smithi134.stdout: librdkafka1 librgw2 libsqlite3-mod-ceph libthrift-0.16.0 nvme-cli 2024-04-18T14:39:39.911 INFO:teuthology.orchestra.run.smithi134.stdout: python-asyncssh-doc python-babel-localedata python-pastedeploy-tpl 2024-04-18T14:39:39.911 INFO:teuthology.orchestra.run.smithi134.stdout: python3-asyncssh python3-babel python3-bcrypt python3-cachetools 2024-04-18T14:39:39.912 INFO:teuthology.orchestra.run.smithi134.stdout: python3-ceph-argparse python3-ceph-common python3-certifi python3-cheroot 2024-04-18T14:39:39.912 INFO:teuthology.orchestra.run.smithi134.stdout: python3-cherrypy3 python3-google-auth python3-idna python3-iniconfig 2024-04-18T14:39:39.912 INFO:teuthology.orchestra.run.smithi134.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-04-18T14:39:39.912 INFO:teuthology.orchestra.run.smithi134.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-04-18T14:39:39.912 INFO:teuthology.orchestra.run.smithi134.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-04-18T14:39:39.912 INFO:teuthology.orchestra.run.smithi134.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-04-18T14:39:39.912 INFO:teuthology.orchestra.run.smithi134.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-04-18T14:39:39.912 INFO:teuthology.orchestra.run.smithi134.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-04-18T14:39:39.913 INFO:teuthology.orchestra.run.smithi134.stdout: python3-pygments python3-pyinotify python3-pytest python3-repoze.lru 2024-04-18T14:39:39.913 INFO:teuthology.orchestra.run.smithi134.stdout: python3-requests python3-requests-oauthlib python3-routes python3-rsa 2024-04-18T14:39:39.913 INFO:teuthology.orchestra.run.smithi134.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2024-04-18T14:39:39.913 INFO:teuthology.orchestra.run.smithi134.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2024-04-18T14:39:39.913 INFO:teuthology.orchestra.run.smithi134.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2024-04-18T14:39:39.913 INFO:teuthology.orchestra.run.smithi134.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2024-04-18T14:39:39.913 INFO:teuthology.orchestra.run.smithi134.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n socat xmlstarlet 2024-04-18T14:39:39.913 INFO:teuthology.orchestra.run.smithi134.stdout:Suggested packages: 2024-04-18T14:39:39.913 INFO:teuthology.orchestra.run.smithi134.stdout: python3-influxdb python-jinja2-doc python3-beaker python-mako-doc 2024-04-18T14:39:39.914 INFO:teuthology.orchestra.run.smithi134.stdout: python-natsort-doc python-openssl-doc python3-openssl-dbg httpd-wsgi 2024-04-18T14:39:39.914 INFO:teuthology.orchestra.run.smithi134.stdout: libapache2-mod-python libapache2-mod-scgi libjs-mochikit python-pecan-doc 2024-04-18T14:39:39.914 INFO:teuthology.orchestra.run.smithi134.stdout: python-psutil-doc subversion python-pygments-doc python-pyinotify-doc 2024-04-18T14:39:39.914 INFO:teuthology.orchestra.run.smithi134.stdout: python3-socks python-requests-doc python3-dap python-sklearn-doc ipython3 2024-04-18T14:39:39.914 INFO:teuthology.orchestra.run.smithi134.stdout: python-waitress-doc python-webob-doc python-webtest-doc python-werkzeug-doc 2024-04-18T14:39:39.914 INFO:teuthology.orchestra.run.smithi134.stdout: python3-watchdog 2024-04-18T14:39:39.914 INFO:teuthology.orchestra.run.smithi134.stdout:Recommended packages: 2024-04-18T14:39:39.914 INFO:teuthology.orchestra.run.smithi134.stdout: btrfs-tools 2024-04-18T14:39:39.922 INFO:teuthology.orchestra.run.smithi119.stdout:The following packages were automatically installed and are no longer required: 2024-04-18T14:39:39.922 INFO:teuthology.orchestra.run.smithi119.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-04-18T14:39:39.922 INFO:teuthology.orchestra.run.smithi119.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-04-18T14:39:39.923 INFO:teuthology.orchestra.run.smithi119.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-04-18T14:39:39.923 INFO:teuthology.orchestra.run.smithi119.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-04-18T14:39:39.923 INFO:teuthology.orchestra.run.smithi119.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-04-18T14:39:39.923 INFO:teuthology.orchestra.run.smithi119.stdout:Use 'sudo apt autoremove' to remove them. 2024-04-18T14:39:39.923 INFO:teuthology.orchestra.run.smithi119.stdout:The following additional packages will be installed: 2024-04-18T14:39:39.923 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2024-04-18T14:39:39.924 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2024-04-18T14:39:39.925 INFO:teuthology.orchestra.run.smithi119.stdout: libdouble-conversion3 libfmt8 libjq1 liblttng-ust1 liboath0 libonig5 2024-04-18T14:39:39.925 INFO:teuthology.orchestra.run.smithi119.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 libradosstriper1 2024-04-18T14:39:39.925 INFO:teuthology.orchestra.run.smithi119.stdout: librdkafka1 librgw2 libsqlite3-mod-ceph libthrift-0.16.0 nvme-cli 2024-04-18T14:39:39.926 INFO:teuthology.orchestra.run.smithi119.stdout: python-asyncssh-doc python-babel-localedata python-pastedeploy-tpl 2024-04-18T14:39:39.926 INFO:teuthology.orchestra.run.smithi119.stdout: python3-asyncssh python3-babel python3-bcrypt python3-cachetools 2024-04-18T14:39:39.926 INFO:teuthology.orchestra.run.smithi119.stdout: python3-ceph-argparse python3-ceph-common python3-certifi python3-cheroot 2024-04-18T14:39:39.926 INFO:teuthology.orchestra.run.smithi119.stdout: python3-cherrypy3 python3-google-auth python3-idna python3-iniconfig 2024-04-18T14:39:39.926 INFO:teuthology.orchestra.run.smithi119.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-04-18T14:39:39.926 INFO:teuthology.orchestra.run.smithi119.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-04-18T14:39:39.926 INFO:teuthology.orchestra.run.smithi119.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-04-18T14:39:39.926 INFO:teuthology.orchestra.run.smithi119.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-04-18T14:39:39.926 INFO:teuthology.orchestra.run.smithi119.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-04-18T14:39:39.926 INFO:teuthology.orchestra.run.smithi119.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-04-18T14:39:39.926 INFO:teuthology.orchestra.run.smithi119.stdout: python3-pygments python3-pyinotify python3-pytest python3-repoze.lru 2024-04-18T14:39:39.926 INFO:teuthology.orchestra.run.smithi119.stdout: python3-requests python3-requests-oauthlib python3-routes python3-rsa 2024-04-18T14:39:39.926 INFO:teuthology.orchestra.run.smithi119.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2024-04-18T14:39:39.926 INFO:teuthology.orchestra.run.smithi119.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2024-04-18T14:39:39.927 INFO:teuthology.orchestra.run.smithi119.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2024-04-18T14:39:39.927 INFO:teuthology.orchestra.run.smithi119.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2024-04-18T14:39:39.927 INFO:teuthology.orchestra.run.smithi119.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n socat xmlstarlet 2024-04-18T14:39:39.927 INFO:teuthology.orchestra.run.smithi119.stdout:Suggested packages: 2024-04-18T14:39:39.927 INFO:teuthology.orchestra.run.smithi119.stdout: python3-influxdb python-jinja2-doc python3-beaker python-mako-doc 2024-04-18T14:39:39.927 INFO:teuthology.orchestra.run.smithi119.stdout: python-natsort-doc python-openssl-doc python3-openssl-dbg httpd-wsgi 2024-04-18T14:39:39.927 INFO:teuthology.orchestra.run.smithi119.stdout: libapache2-mod-python libapache2-mod-scgi libjs-mochikit python-pecan-doc 2024-04-18T14:39:39.928 INFO:teuthology.orchestra.run.smithi119.stdout: python-psutil-doc subversion python-pygments-doc python-pyinotify-doc 2024-04-18T14:39:39.928 INFO:teuthology.orchestra.run.smithi119.stdout: python3-socks python-requests-doc python3-dap python-sklearn-doc ipython3 2024-04-18T14:39:39.928 INFO:teuthology.orchestra.run.smithi119.stdout: python-waitress-doc python-webob-doc python-webtest-doc python-werkzeug-doc 2024-04-18T14:39:39.928 INFO:teuthology.orchestra.run.smithi119.stdout: python3-watchdog 2024-04-18T14:39:39.928 INFO:teuthology.orchestra.run.smithi119.stdout:Recommended packages: 2024-04-18T14:39:39.928 INFO:teuthology.orchestra.run.smithi119.stdout: btrfs-tools 2024-04-18T14:39:39.962 INFO:teuthology.orchestra.run.smithi086.stdout:0 upgraded, 109 newly installed, 0 to remove and 302 not upgraded. 2024-04-18T14:39:39.963 INFO:teuthology.orchestra.run.smithi086.stdout:Need to get 162 MB of archives. 2024-04-18T14:39:39.963 INFO:teuthology.orchestra.run.smithi086.stdout:After this operation, 743 MB of additional disk space will be used. 2024-04-18T14:39:39.963 INFO:teuthology.orchestra.run.smithi086.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libfmt8 amd64 8.1.1+ds1-2 [60.2 kB] 2024-04-18T14:39:39.970 INFO:teuthology.orchestra.run.smithi096.stdout:The following NEW packages will be installed: 2024-04-18T14:39:39.970 INFO:teuthology.orchestra.run.smithi096.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2024-04-18T14:39:39.970 INFO:teuthology.orchestra.run.smithi096.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2024-04-18T14:39:39.970 INFO:teuthology.orchestra.run.smithi096.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm jq 2024-04-18T14:39:39.970 INFO:teuthology.orchestra.run.smithi096.stdout: libcephfs-dev libcephfs2 libdouble-conversion3 libfmt8 libjq1 liblttng-ust1 2024-04-18T14:39:39.970 INFO:teuthology.orchestra.run.smithi096.stdout: liboath0 libonig5 libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 2024-04-18T14:39:39.971 INFO:teuthology.orchestra.run.smithi096.stdout: librados2 libradosstriper1 librbd1 librdkafka1 librgw2 libsqlite3-mod-ceph 2024-04-18T14:39:39.972 INFO:teuthology.orchestra.run.smithi096.stdout: libthrift-0.16.0 nvme-cli python-asyncssh-doc python-babel-localedata 2024-04-18T14:39:39.972 INFO:teuthology.orchestra.run.smithi096.stdout: python-pastedeploy-tpl python3-asyncssh python3-babel python3-bcrypt 2024-04-18T14:39:39.972 INFO:teuthology.orchestra.run.smithi096.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common python3-cephfs 2024-04-18T14:39:39.972 INFO:teuthology.orchestra.run.smithi096.stdout: python3-certifi python3-cheroot python3-cherrypy3 python3-google-auth 2024-04-18T14:39:39.972 INFO:teuthology.orchestra.run.smithi096.stdout: python3-idna python3-iniconfig python3-jaraco.classes 2024-04-18T14:39:39.972 INFO:teuthology.orchestra.run.smithi096.stdout: python3-jaraco.collections python3-jaraco.functools python3-jaraco.text 2024-04-18T14:39:39.972 INFO:teuthology.orchestra.run.smithi096.stdout: python3-jinja2 python3-joblib python3-kubernetes python3-logutils 2024-04-18T14:39:39.973 INFO:teuthology.orchestra.run.smithi096.stdout: python3-mako python3-markupsafe python3-natsort python3-openssl 2024-04-18T14:39:39.973 INFO:teuthology.orchestra.run.smithi096.stdout: python3-paste python3-pastedeploy python3-pastescript python3-pecan 2024-04-18T14:39:39.973 INFO:teuthology.orchestra.run.smithi096.stdout: python3-pluggy python3-portend python3-prettytable python3-psutil python3-py 2024-04-18T14:39:39.973 INFO:teuthology.orchestra.run.smithi096.stdout: python3-pyasn1 python3-pyasn1-modules python3-pygments python3-pyinotify 2024-04-18T14:39:39.973 INFO:teuthology.orchestra.run.smithi096.stdout: python3-pytest python3-rados python3-rbd python3-repoze.lru python3-requests 2024-04-18T14:39:39.973 INFO:teuthology.orchestra.run.smithi096.stdout: python3-requests-oauthlib python3-rgw python3-routes python3-rsa 2024-04-18T14:39:39.973 INFO:teuthology.orchestra.run.smithi096.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2024-04-18T14:39:39.973 INFO:teuthology.orchestra.run.smithi096.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2024-04-18T14:39:39.973 INFO:teuthology.orchestra.run.smithi096.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2024-04-18T14:39:39.973 INFO:teuthology.orchestra.run.smithi096.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2024-04-18T14:39:39.974 INFO:teuthology.orchestra.run.smithi096.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n radosgw rbd-fuse 2024-04-18T14:39:39.974 INFO:teuthology.orchestra.run.smithi096.stdout: socat xmlstarlet 2024-04-18T14:39:40.011 INFO:teuthology.orchestra.run.smithi134.stdout:The following NEW packages will be installed: 2024-04-18T14:39:40.011 INFO:teuthology.orchestra.run.smithi134.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2024-04-18T14:39:40.011 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2024-04-18T14:39:40.012 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm jq 2024-04-18T14:39:40.012 INFO:teuthology.orchestra.run.smithi134.stdout: libcephfs-dev libcephfs2 libdouble-conversion3 libfmt8 libjq1 liblttng-ust1 2024-04-18T14:39:40.012 INFO:teuthology.orchestra.run.smithi134.stdout: liboath0 libonig5 libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 2024-04-18T14:39:40.012 INFO:teuthology.orchestra.run.smithi134.stdout: librados2 libradosstriper1 librbd1 librdkafka1 librgw2 libsqlite3-mod-ceph 2024-04-18T14:39:40.013 INFO:teuthology.orchestra.run.smithi134.stdout: libthrift-0.16.0 nvme-cli python-asyncssh-doc python-babel-localedata 2024-04-18T14:39:40.013 INFO:teuthology.orchestra.run.smithi134.stdout: python-pastedeploy-tpl python3-asyncssh python3-babel python3-bcrypt 2024-04-18T14:39:40.013 INFO:teuthology.orchestra.run.smithi134.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common python3-cephfs 2024-04-18T14:39:40.013 INFO:teuthology.orchestra.run.smithi134.stdout: python3-certifi python3-cheroot python3-cherrypy3 python3-google-auth 2024-04-18T14:39:40.013 INFO:teuthology.orchestra.run.smithi134.stdout: python3-idna python3-iniconfig python3-jaraco.classes 2024-04-18T14:39:40.013 INFO:teuthology.orchestra.run.smithi134.stdout: python3-jaraco.collections python3-jaraco.functools python3-jaraco.text 2024-04-18T14:39:40.013 INFO:teuthology.orchestra.run.smithi134.stdout: python3-jinja2 python3-joblib python3-kubernetes python3-logutils 2024-04-18T14:39:40.014 INFO:teuthology.orchestra.run.smithi134.stdout: python3-mako python3-markupsafe python3-natsort python3-openssl 2024-04-18T14:39:40.014 INFO:teuthology.orchestra.run.smithi134.stdout: python3-paste python3-pastedeploy python3-pastescript python3-pecan 2024-04-18T14:39:40.014 INFO:teuthology.orchestra.run.smithi134.stdout: python3-pluggy python3-portend python3-prettytable python3-psutil python3-py 2024-04-18T14:39:40.014 INFO:teuthology.orchestra.run.smithi134.stdout: python3-pyasn1 python3-pyasn1-modules python3-pygments python3-pyinotify 2024-04-18T14:39:40.014 INFO:teuthology.orchestra.run.smithi134.stdout: python3-pytest python3-rados python3-rbd python3-repoze.lru python3-requests 2024-04-18T14:39:40.014 INFO:teuthology.orchestra.run.smithi134.stdout: python3-requests-oauthlib python3-rgw python3-routes python3-rsa 2024-04-18T14:39:40.014 INFO:teuthology.orchestra.run.smithi134.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2024-04-18T14:39:40.014 INFO:teuthology.orchestra.run.smithi134.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2024-04-18T14:39:40.014 INFO:teuthology.orchestra.run.smithi134.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2024-04-18T14:39:40.014 INFO:teuthology.orchestra.run.smithi134.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2024-04-18T14:39:40.014 INFO:teuthology.orchestra.run.smithi134.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n radosgw rbd-fuse 2024-04-18T14:39:40.014 INFO:teuthology.orchestra.run.smithi134.stdout: socat xmlstarlet 2024-04-18T14:39:40.025 INFO:teuthology.orchestra.run.smithi119.stdout:The following NEW packages will be installed: 2024-04-18T14:39:40.025 INFO:teuthology.orchestra.run.smithi119.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2024-04-18T14:39:40.026 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2024-04-18T14:39:40.026 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm jq 2024-04-18T14:39:40.028 INFO:teuthology.orchestra.run.smithi119.stdout: libcephfs-dev libcephfs2 libdouble-conversion3 libfmt8 libjq1 liblttng-ust1 2024-04-18T14:39:40.028 INFO:teuthology.orchestra.run.smithi119.stdout: liboath0 libonig5 libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 2024-04-18T14:39:40.028 INFO:teuthology.orchestra.run.smithi119.stdout: librados2 libradosstriper1 librbd1 librdkafka1 librgw2 libsqlite3-mod-ceph 2024-04-18T14:39:40.028 INFO:teuthology.orchestra.run.smithi119.stdout: libthrift-0.16.0 nvme-cli python-asyncssh-doc python-babel-localedata 2024-04-18T14:39:40.028 INFO:teuthology.orchestra.run.smithi119.stdout: python-pastedeploy-tpl python3-asyncssh python3-babel python3-bcrypt 2024-04-18T14:39:40.028 INFO:teuthology.orchestra.run.smithi119.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common python3-cephfs 2024-04-18T14:39:40.028 INFO:teuthology.orchestra.run.smithi119.stdout: python3-certifi python3-cheroot python3-cherrypy3 python3-google-auth 2024-04-18T14:39:40.028 INFO:teuthology.orchestra.run.smithi119.stdout: python3-idna python3-iniconfig python3-jaraco.classes 2024-04-18T14:39:40.028 INFO:teuthology.orchestra.run.smithi119.stdout: python3-jaraco.collections python3-jaraco.functools python3-jaraco.text 2024-04-18T14:39:40.029 INFO:teuthology.orchestra.run.smithi119.stdout: python3-jinja2 python3-joblib python3-kubernetes python3-logutils 2024-04-18T14:39:40.029 INFO:teuthology.orchestra.run.smithi119.stdout: python3-mako python3-markupsafe python3-natsort python3-openssl 2024-04-18T14:39:40.029 INFO:teuthology.orchestra.run.smithi119.stdout: python3-paste python3-pastedeploy python3-pastescript python3-pecan 2024-04-18T14:39:40.029 INFO:teuthology.orchestra.run.smithi119.stdout: python3-pluggy python3-portend python3-prettytable python3-psutil python3-py 2024-04-18T14:39:40.029 INFO:teuthology.orchestra.run.smithi119.stdout: python3-pyasn1 python3-pyasn1-modules python3-pygments python3-pyinotify 2024-04-18T14:39:40.029 INFO:teuthology.orchestra.run.smithi119.stdout: python3-pytest python3-rados python3-rbd python3-repoze.lru python3-requests 2024-04-18T14:39:40.029 INFO:teuthology.orchestra.run.smithi119.stdout: python3-requests-oauthlib python3-rgw python3-routes python3-rsa 2024-04-18T14:39:40.029 INFO:teuthology.orchestra.run.smithi119.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2024-04-18T14:39:40.029 INFO:teuthology.orchestra.run.smithi119.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2024-04-18T14:39:40.029 INFO:teuthology.orchestra.run.smithi119.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2024-04-18T14:39:40.029 INFO:teuthology.orchestra.run.smithi119.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2024-04-18T14:39:40.029 INFO:teuthology.orchestra.run.smithi119.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n radosgw rbd-fuse 2024-04-18T14:39:40.029 INFO:teuthology.orchestra.run.smithi119.stdout: socat xmlstarlet 2024-04-18T14:39:40.032 INFO:teuthology.orchestra.run.smithi086.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2024-04-18T14:39:40.077 INFO:teuthology.orchestra.run.smithi086.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2024-04-18T14:39:40.080 INFO:teuthology.orchestra.run.smithi134.stdout:0 upgraded, 109 newly installed, 0 to remove and 302 not upgraded. 2024-04-18T14:39:40.080 INFO:teuthology.orchestra.run.smithi134.stdout:Need to get 162 MB of archives. 2024-04-18T14:39:40.080 INFO:teuthology.orchestra.run.smithi134.stdout:After this operation, 743 MB of additional disk space will be used. 2024-04-18T14:39:40.080 INFO:teuthology.orchestra.run.smithi134.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libfmt8 amd64 8.1.1+ds1-2 [60.2 kB] 2024-04-18T14:39:40.081 INFO:teuthology.orchestra.run.smithi086.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2024-04-18T14:39:40.091 INFO:teuthology.orchestra.run.smithi119.stdout:0 upgraded, 109 newly installed, 0 to remove and 302 not upgraded. 2024-04-18T14:39:40.091 INFO:teuthology.orchestra.run.smithi119.stdout:Need to get 162 MB of archives. 2024-04-18T14:39:40.091 INFO:teuthology.orchestra.run.smithi119.stdout:After this operation, 743 MB of additional disk space will be used. 2024-04-18T14:39:40.091 INFO:teuthology.orchestra.run.smithi119.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libfmt8 amd64 8.1.1+ds1-2 [60.2 kB] 2024-04-18T14:39:40.098 INFO:teuthology.orchestra.run.smithi086.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2024-04-18T14:39:40.113 INFO:teuthology.orchestra.run.smithi086.stdout:Get:6 https://3.chacra.ceph.com/r/ceph/wip-yuri2-testing-2024-04-17-0823-reef/6a7528e4aecd36b18c4b41cee6012e9f92aa7ab0/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 18.2.2-1240-g6a7528e4-1jammy [3,440 kB] 2024-04-18T14:39:40.114 INFO:teuthology.orchestra.run.smithi096.stdout:0 upgraded, 109 newly installed, 0 to remove and 302 not upgraded. 2024-04-18T14:39:40.114 INFO:teuthology.orchestra.run.smithi096.stdout:Need to get 162 MB of archives. 2024-04-18T14:39:40.114 INFO:teuthology.orchestra.run.smithi096.stdout:After this operation, 743 MB of additional disk space will be used. 2024-04-18T14:39:40.114 INFO:teuthology.orchestra.run.smithi096.stdout:Get:1 https://3.chacra.ceph.com/r/ceph/wip-yuri2-testing-2024-04-17-0823-reef/6a7528e4aecd36b18c4b41cee6012e9f92aa7ab0/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 18.2.2-1240-g6a7528e4-1jammy [3,440 kB] 2024-04-18T14:39:40.153 INFO:teuthology.orchestra.run.smithi134.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2024-04-18T14:39:40.156 INFO:teuthology.orchestra.run.smithi086.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2024-04-18T14:39:40.159 INFO:teuthology.orchestra.run.smithi096.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libfmt8 amd64 8.1.1+ds1-2 [60.2 kB] 2024-04-18T14:39:40.160 INFO:teuthology.orchestra.run.smithi086.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2024-04-18T14:39:40.161 INFO:teuthology.orchestra.run.smithi119.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2024-04-18T14:39:40.172 INFO:teuthology.orchestra.run.smithi086.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2024-04-18T14:39:40.177 INFO:teuthology.orchestra.run.smithi086.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2024-04-18T14:39:40.177 INFO:teuthology.orchestra.run.smithi086.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2024-04-18T14:39:40.178 INFO:teuthology.orchestra.run.smithi086.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2024-04-18T14:39:40.186 INFO:teuthology.orchestra.run.smithi086.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2024-04-18T14:39:40.187 INFO:teuthology.orchestra.run.smithi086.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2024-04-18T14:39:40.187 INFO:teuthology.orchestra.run.smithi086.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2024-04-18T14:39:40.188 INFO:teuthology.orchestra.run.smithi086.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2024-04-18T14:39:40.198 INFO:teuthology.orchestra.run.smithi134.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2024-04-18T14:39:40.201 INFO:teuthology.orchestra.run.smithi086.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2024-04-18T14:39:40.202 INFO:teuthology.orchestra.run.smithi086.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2024-04-18T14:39:40.202 INFO:teuthology.orchestra.run.smithi086.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2024-04-18T14:39:40.203 INFO:teuthology.orchestra.run.smithi134.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2024-04-18T14:39:40.203 INFO:teuthology.orchestra.run.smithi086.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2024-04-18T14:39:40.203 INFO:teuthology.orchestra.run.smithi119.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2024-04-18T14:39:40.207 INFO:teuthology.orchestra.run.smithi119.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2024-04-18T14:39:40.222 INFO:teuthology.orchestra.run.smithi134.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2024-04-18T14:39:40.223 INFO:teuthology.orchestra.run.smithi086.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2024-04-18T14:39:40.224 INFO:teuthology.orchestra.run.smithi086.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2024-04-18T14:39:40.226 INFO:teuthology.orchestra.run.smithi086.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2024-04-18T14:39:40.227 INFO:teuthology.orchestra.run.smithi086.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2024-04-18T14:39:40.227 INFO:teuthology.orchestra.run.smithi086.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2024-04-18T14:39:40.228 INFO:teuthology.orchestra.run.smithi086.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2024-04-18T14:39:40.228 INFO:teuthology.orchestra.run.smithi119.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2024-04-18T14:39:40.238 INFO:teuthology.orchestra.run.smithi134.stdout:Get:6 https://3.chacra.ceph.com/r/ceph/wip-yuri2-testing-2024-04-17-0823-reef/6a7528e4aecd36b18c4b41cee6012e9f92aa7ab0/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 18.2.2-1240-g6a7528e4-1jammy [3,440 kB] 2024-04-18T14:39:40.244 INFO:teuthology.orchestra.run.smithi086.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2024-04-18T14:39:40.245 INFO:teuthology.orchestra.run.smithi086.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2024-04-18T14:39:40.245 INFO:teuthology.orchestra.run.smithi086.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webob all 1:1.8.6-1.1 [85.2 kB] 2024-04-18T14:39:40.246 INFO:teuthology.orchestra.run.smithi119.stdout:Get:6 https://3.chacra.ceph.com/r/ceph/wip-yuri2-testing-2024-04-17-0823-reef/6a7528e4aecd36b18c4b41cee6012e9f92aa7ab0/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 18.2.2-1240-g6a7528e4-1jammy [3,440 kB] 2024-04-18T14:39:40.247 INFO:teuthology.orchestra.run.smithi086.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2024-04-18T14:39:40.267 INFO:teuthology.orchestra.run.smithi086.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2024-04-18T14:39:40.267 INFO:teuthology.orchestra.run.smithi086.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2024-04-18T14:39:40.274 INFO:teuthology.orchestra.run.smithi086.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2024-04-18T14:39:40.274 INFO:teuthology.orchestra.run.smithi086.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2024-04-18T14:39:40.274 INFO:teuthology.orchestra.run.smithi086.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2024-04-18T14:39:40.275 INFO:teuthology.orchestra.run.smithi086.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2024-04-18T14:39:40.288 INFO:teuthology.orchestra.run.smithi134.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2024-04-18T14:39:40.292 INFO:teuthology.orchestra.run.smithi119.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2024-04-18T14:39:40.293 INFO:teuthology.orchestra.run.smithi134.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2024-04-18T14:39:40.297 INFO:teuthology.orchestra.run.smithi119.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2024-04-18T14:39:40.308 INFO:teuthology.orchestra.run.smithi134.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2024-04-18T14:39:40.309 INFO:teuthology.orchestra.run.smithi086.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2024-04-18T14:39:40.312 INFO:teuthology.orchestra.run.smithi086.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-idna all 3.3-1 [49.3 kB] 2024-04-18T14:39:40.314 INFO:teuthology.orchestra.run.smithi086.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-urllib3 all 1.26.5-1~exp1ubuntu0.1 [98.2 kB] 2024-04-18T14:39:40.314 INFO:teuthology.orchestra.run.smithi119.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2024-04-18T14:39:40.315 INFO:teuthology.orchestra.run.smithi134.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2024-04-18T14:39:40.316 INFO:teuthology.orchestra.run.smithi086.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2024-04-18T14:39:40.317 INFO:teuthology.orchestra.run.smithi134.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2024-04-18T14:39:40.318 INFO:teuthology.orchestra.run.smithi134.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2024-04-18T14:39:40.321 INFO:teuthology.orchestra.run.smithi119.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2024-04-18T14:39:40.321 INFO:teuthology.orchestra.run.smithi119.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2024-04-18T14:39:40.322 INFO:teuthology.orchestra.run.smithi119.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2024-04-18T14:39:40.332 INFO:teuthology.orchestra.run.smithi134.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2024-04-18T14:39:40.333 INFO:teuthology.orchestra.run.smithi134.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2024-04-18T14:39:40.334 INFO:teuthology.orchestra.run.smithi134.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2024-04-18T14:39:40.335 INFO:teuthology.orchestra.run.smithi119.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2024-04-18T14:39:40.336 INFO:teuthology.orchestra.run.smithi119.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2024-04-18T14:39:40.337 INFO:teuthology.orchestra.run.smithi119.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2024-04-18T14:39:40.338 INFO:teuthology.orchestra.run.smithi134.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2024-04-18T14:39:40.339 INFO:teuthology.orchestra.run.smithi119.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2024-04-18T14:39:40.343 INFO:teuthology.orchestra.run.smithi086.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.1 [181 kB] 2024-04-18T14:39:40.348 INFO:teuthology.orchestra.run.smithi086.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2024-04-18T14:39:40.349 INFO:teuthology.orchestra.run.smithi086.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2024-04-18T14:39:40.350 INFO:teuthology.orchestra.run.smithi086.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2024-04-18T14:39:40.351 INFO:teuthology.orchestra.run.smithi096.stdout:Get:3 https://3.chacra.ceph.com/r/ceph/wip-yuri2-testing-2024-04-17-0823-reef/6a7528e4aecd36b18c4b41cee6012e9f92aa7ab0/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 18.2.2-1240-g6a7528e4-1jammy [3,106 kB] 2024-04-18T14:39:40.355 INFO:teuthology.orchestra.run.smithi086.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2024-04-18T14:39:40.379 INFO:teuthology.orchestra.run.smithi134.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2024-04-18T14:39:40.380 INFO:teuthology.orchestra.run.smithi134.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2024-04-18T14:39:40.380 INFO:teuthology.orchestra.run.smithi134.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2024-04-18T14:39:40.381 INFO:teuthology.orchestra.run.smithi134.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2024-04-18T14:39:40.382 INFO:teuthology.orchestra.run.smithi134.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2024-04-18T14:39:40.382 INFO:teuthology.orchestra.run.smithi119.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2024-04-18T14:39:40.382 INFO:teuthology.orchestra.run.smithi134.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2024-04-18T14:39:40.383 INFO:teuthology.orchestra.run.smithi119.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2024-04-18T14:39:40.383 INFO:teuthology.orchestra.run.smithi119.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2024-04-18T14:39:40.384 INFO:teuthology.orchestra.run.smithi119.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2024-04-18T14:39:40.385 INFO:teuthology.orchestra.run.smithi119.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2024-04-18T14:39:40.385 INFO:teuthology.orchestra.run.smithi119.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2024-04-18T14:39:40.386 INFO:teuthology.orchestra.run.smithi134.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2024-04-18T14:39:40.387 INFO:teuthology.orchestra.run.smithi134.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2024-04-18T14:39:40.388 INFO:teuthology.orchestra.run.smithi134.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2024-04-18T14:39:40.389 INFO:teuthology.orchestra.run.smithi119.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2024-04-18T14:39:40.390 INFO:teuthology.orchestra.run.smithi119.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2024-04-18T14:39:40.391 INFO:teuthology.orchestra.run.smithi119.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2024-04-18T14:39:40.411 INFO:teuthology.orchestra.run.smithi119.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2024-04-18T14:39:40.411 INFO:teuthology.orchestra.run.smithi134.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2024-04-18T14:39:40.413 INFO:teuthology.orchestra.run.smithi134.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2024-04-18T14:39:40.414 INFO:teuthology.orchestra.run.smithi134.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2024-04-18T14:39:40.415 INFO:teuthology.orchestra.run.smithi134.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webob all 1:1.8.6-1.1 [85.2 kB] 2024-04-18T14:39:40.424 INFO:teuthology.orchestra.run.smithi119.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2024-04-18T14:39:40.425 INFO:teuthology.orchestra.run.smithi119.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2024-04-18T14:39:40.425 INFO:teuthology.orchestra.run.smithi119.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webob all 1:1.8.6-1.1 [85.2 kB] 2024-04-18T14:39:40.427 INFO:teuthology.orchestra.run.smithi119.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2024-04-18T14:39:40.428 INFO:teuthology.orchestra.run.smithi119.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2024-04-18T14:39:40.429 INFO:teuthology.orchestra.run.smithi119.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2024-04-18T14:39:40.430 INFO:teuthology.orchestra.run.smithi086.stdout:Get:46 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2024-04-18T14:39:40.430 INFO:teuthology.orchestra.run.smithi086.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-jinja2 all 3.0.3-1ubuntu0.1 [108 kB] 2024-04-18T14:39:40.432 INFO:teuthology.orchestra.run.smithi096.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2024-04-18T14:39:40.432 INFO:teuthology.orchestra.run.smithi086.stdout:Get:48 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2024-04-18T14:39:40.432 INFO:teuthology.orchestra.run.smithi086.stdout:Get:49 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2024-04-18T14:39:40.433 INFO:teuthology.orchestra.run.smithi086.stdout:Get:50 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2024-04-18T14:39:40.434 INFO:teuthology.orchestra.run.smithi086.stdout:Get:51 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2024-04-18T14:39:40.434 INFO:teuthology.orchestra.run.smithi086.stdout:Get:52 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2024-04-18T14:39:40.436 INFO:teuthology.orchestra.run.smithi086.stdout:Get:53 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2024-04-18T14:39:40.436 INFO:teuthology.orchestra.run.smithi086.stdout:Get:54 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2024-04-18T14:39:40.438 INFO:teuthology.orchestra.run.smithi134.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2024-04-18T14:39:40.440 INFO:teuthology.orchestra.run.smithi119.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2024-04-18T14:39:40.440 INFO:teuthology.orchestra.run.smithi134.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2024-04-18T14:39:40.441 INFO:teuthology.orchestra.run.smithi119.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2024-04-18T14:39:40.441 INFO:teuthology.orchestra.run.smithi134.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2024-04-18T14:39:40.442 INFO:teuthology.orchestra.run.smithi119.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2024-04-18T14:39:40.451 INFO:teuthology.orchestra.run.smithi134.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2024-04-18T14:39:40.452 INFO:teuthology.orchestra.run.smithi134.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2024-04-18T14:39:40.452 INFO:teuthology.orchestra.run.smithi086.stdout:Get:55 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2024-04-18T14:39:40.453 INFO:teuthology.orchestra.run.smithi134.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2024-04-18T14:39:40.466 INFO:teuthology.orchestra.run.smithi119.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2024-04-18T14:39:40.469 INFO:teuthology.orchestra.run.smithi119.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2024-04-18T14:39:40.472 INFO:teuthology.orchestra.run.smithi134.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2024-04-18T14:39:40.473 INFO:teuthology.orchestra.run.smithi119.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-idna all 3.3-1 [49.3 kB] 2024-04-18T14:39:40.475 INFO:teuthology.orchestra.run.smithi119.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-urllib3 all 1.26.5-1~exp1ubuntu0.1 [98.2 kB] 2024-04-18T14:39:40.475 INFO:teuthology.orchestra.run.smithi134.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2024-04-18T14:39:40.478 INFO:teuthology.orchestra.run.smithi119.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2024-04-18T14:39:40.479 INFO:teuthology.orchestra.run.smithi086.stdout:Get:56 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2024-04-18T14:39:40.480 INFO:teuthology.orchestra.run.smithi119.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.1 [181 kB] 2024-04-18T14:39:40.481 INFO:teuthology.orchestra.run.smithi134.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-idna all 3.3-1 [49.3 kB] 2024-04-18T14:39:40.482 INFO:teuthology.orchestra.run.smithi086.stdout:Get:57 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2024-04-18T14:39:40.483 INFO:teuthology.orchestra.run.smithi134.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-urllib3 all 1.26.5-1~exp1ubuntu0.1 [98.2 kB] 2024-04-18T14:39:40.483 INFO:teuthology.orchestra.run.smithi086.stdout:Get:58 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2024-04-18T14:39:40.508 INFO:teuthology.orchestra.run.smithi086.stdout:Get:59 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2024-04-18T14:39:40.508 INFO:teuthology.orchestra.run.smithi086.stdout:Get:60 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2024-04-18T14:39:40.509 INFO:teuthology.orchestra.run.smithi119.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2024-04-18T14:39:40.509 INFO:teuthology.orchestra.run.smithi086.stdout:Get:61 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2024-04-18T14:39:40.510 INFO:teuthology.orchestra.run.smithi119.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2024-04-18T14:39:40.511 INFO:teuthology.orchestra.run.smithi119.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2024-04-18T14:39:40.514 INFO:teuthology.orchestra.run.smithi086.stdout:Get:62 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2024-04-18T14:39:40.515 INFO:teuthology.orchestra.run.smithi086.stdout:Get:63 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2024-04-18T14:39:40.515 INFO:teuthology.orchestra.run.smithi086.stdout:Get:64 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2024-04-18T14:39:40.516 INFO:teuthology.orchestra.run.smithi119.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2024-04-18T14:39:40.521 INFO:teuthology.orchestra.run.smithi134.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2024-04-18T14:39:40.522 INFO:teuthology.orchestra.run.smithi134.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.1 [181 kB] 2024-04-18T14:39:40.527 INFO:teuthology.orchestra.run.smithi134.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2024-04-18T14:39:40.528 INFO:teuthology.orchestra.run.smithi134.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2024-04-18T14:39:40.530 INFO:teuthology.orchestra.run.smithi134.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2024-04-18T14:39:40.534 INFO:teuthology.orchestra.run.smithi134.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2024-04-18T14:39:40.553 INFO:teuthology.orchestra.run.smithi096.stdout:Get:5 https://3.chacra.ceph.com/r/ceph/wip-yuri2-testing-2024-04-17-0823-reef/6a7528e4aecd36b18c4b41cee6012e9f92aa7ab0/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 18.2.2-1240-g6a7528e4-1jammy [679 kB] 2024-04-18T14:39:40.561 INFO:teuthology.orchestra.run.smithi086.stdout:Get:65 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2024-04-18T14:39:40.562 INFO:teuthology.orchestra.run.smithi086.stdout:Get:66 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2024-04-18T14:39:40.566 INFO:teuthology.orchestra.run.smithi096.stdout:Get:6 https://3.chacra.ceph.com/r/ceph/wip-yuri2-testing-2024-04-17-0823-reef/6a7528e4aecd36b18c4b41cee6012e9f92aa7ab0/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 18.2.2-1240-g6a7528e4-1jammy [356 kB] 2024-04-18T14:39:40.573 INFO:teuthology.orchestra.run.smithi096.stdout:Get:7 https://3.chacra.ceph.com/r/ceph/wip-yuri2-testing-2024-04-17-0823-reef/6a7528e4aecd36b18c4b41cee6012e9f92aa7ab0/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 18.2.2-1240-g6a7528e4-1jammy [32.8 kB] 2024-04-18T14:39:40.574 INFO:teuthology.orchestra.run.smithi096.stdout:Get:8 https://3.chacra.ceph.com/r/ceph/wip-yuri2-testing-2024-04-17-0823-reef/6a7528e4aecd36b18c4b41cee6012e9f92aa7ab0/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 18.2.2-1240-g6a7528e4-1jammy [180 kB] 2024-04-18T14:39:40.578 INFO:teuthology.orchestra.run.smithi096.stdout:Get:9 https://3.chacra.ceph.com/r/ceph/wip-yuri2-testing-2024-04-17-0823-reef/6a7528e4aecd36b18c4b41cee6012e9f92aa7ab0/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 18.2.2-1240-g6a7528e4-1jammy [63.7 kB] 2024-04-18T14:39:40.580 INFO:teuthology.orchestra.run.smithi096.stdout:Get:10 https://3.chacra.ceph.com/r/ceph/wip-yuri2-testing-2024-04-17-0823-reef/6a7528e4aecd36b18c4b41cee6012e9f92aa7ab0/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 18.2.2-1240-g6a7528e4-1jammy [330 kB] 2024-04-18T14:39:40.586 INFO:teuthology.orchestra.run.smithi096.stdout:Get:11 https://3.chacra.ceph.com/r/ceph/wip-yuri2-testing-2024-04-17-0823-reef/6a7528e4aecd36b18c4b41cee6012e9f92aa7ab0/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 18.2.2-1240-g6a7528e4-1jammy [5,891 kB] 2024-04-18T14:39:40.603 INFO:teuthology.orchestra.run.smithi096.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2024-04-18T14:39:40.616 INFO:teuthology.orchestra.run.smithi096.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2024-04-18T14:39:40.646 INFO:teuthology.orchestra.run.smithi086.stdout:Get:67 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2024-04-18T14:39:40.649 INFO:teuthology.orchestra.run.smithi086.stdout:Get:68 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2024-04-18T14:39:40.652 INFO:teuthology.orchestra.run.smithi086.stdout:Get:69 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2024-04-18T14:39:40.653 INFO:teuthology.orchestra.run.smithi086.stdout:Get:70 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2024-04-18T14:39:40.660 INFO:teuthology.orchestra.run.smithi086.stdout:Get:71 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2024-04-18T14:39:40.665 INFO:teuthology.orchestra.run.smithi086.stdout:Get:72 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.1 [474 kB] 2024-04-18T14:39:40.672 INFO:teuthology.orchestra.run.smithi119.stdout:Get:46 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2024-04-18T14:39:40.673 INFO:teuthology.orchestra.run.smithi119.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-jinja2 all 3.0.3-1ubuntu0.1 [108 kB] 2024-04-18T14:39:40.674 INFO:teuthology.orchestra.run.smithi086.stdout:Get:73 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2024-04-18T14:39:40.675 INFO:teuthology.orchestra.run.smithi119.stdout:Get:48 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2024-04-18T14:39:40.676 INFO:teuthology.orchestra.run.smithi119.stdout:Get:49 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2024-04-18T14:39:40.677 INFO:teuthology.orchestra.run.smithi119.stdout:Get:50 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2024-04-18T14:39:40.677 INFO:teuthology.orchestra.run.smithi119.stdout:Get:51 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2024-04-18T14:39:40.678 INFO:teuthology.orchestra.run.smithi119.stdout:Get:52 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2024-04-18T14:39:40.680 INFO:teuthology.orchestra.run.smithi086.stdout:Get:74 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2024-04-18T14:39:40.681 INFO:teuthology.orchestra.run.smithi086.stdout:Get:75 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2024-04-18T14:39:40.682 INFO:teuthology.orchestra.run.smithi119.stdout:Get:53 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2024-04-18T14:39:40.682 INFO:teuthology.orchestra.run.smithi119.stdout:Get:54 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2024-04-18T14:39:40.684 INFO:teuthology.orchestra.run.smithi086.stdout:Get:76 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2024-04-18T14:39:40.689 INFO:teuthology.orchestra.run.smithi096.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2024-04-18T14:39:40.695 INFO:teuthology.orchestra.run.smithi119.stdout:Get:55 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2024-04-18T14:39:40.702 INFO:teuthology.orchestra.run.smithi086.stdout:Get:77 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2024-04-18T14:39:40.703 INFO:teuthology.orchestra.run.smithi086.stdout:Get:78 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2024-04-18T14:39:40.704 INFO:teuthology.orchestra.run.smithi086.stdout:Get:79 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2024-04-18T14:39:40.710 INFO:teuthology.orchestra.run.smithi134.stdout:Get:46 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2024-04-18T14:39:40.711 INFO:teuthology.orchestra.run.smithi134.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-jinja2 all 3.0.3-1ubuntu0.1 [108 kB] 2024-04-18T14:39:40.713 INFO:teuthology.orchestra.run.smithi134.stdout:Get:48 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2024-04-18T14:39:40.713 INFO:teuthology.orchestra.run.smithi134.stdout:Get:49 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2024-04-18T14:39:40.716 INFO:teuthology.orchestra.run.smithi134.stdout:Get:50 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2024-04-18T14:39:40.716 INFO:teuthology.orchestra.run.smithi134.stdout:Get:51 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2024-04-18T14:39:40.716 INFO:teuthology.orchestra.run.smithi134.stdout:Get:52 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2024-04-18T14:39:40.719 INFO:teuthology.orchestra.run.smithi134.stdout:Get:53 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2024-04-18T14:39:40.719 INFO:teuthology.orchestra.run.smithi134.stdout:Get:54 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2024-04-18T14:39:40.741 INFO:teuthology.orchestra.run.smithi134.stdout:Get:55 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2024-04-18T14:39:40.755 INFO:teuthology.orchestra.run.smithi119.stdout:Get:56 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2024-04-18T14:39:40.762 INFO:teuthology.orchestra.run.smithi119.stdout:Get:57 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2024-04-18T14:39:40.763 INFO:teuthology.orchestra.run.smithi119.stdout:Get:58 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2024-04-18T14:39:40.769 INFO:teuthology.orchestra.run.smithi134.stdout:Get:56 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2024-04-18T14:39:40.772 INFO:teuthology.orchestra.run.smithi134.stdout:Get:57 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2024-04-18T14:39:40.773 INFO:teuthology.orchestra.run.smithi134.stdout:Get:58 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2024-04-18T14:39:40.777 INFO:teuthology.orchestra.run.smithi086.stdout:Get:80 https://3.chacra.ceph.com/r/ceph/wip-yuri2-testing-2024-04-17-0823-reef/6a7528e4aecd36b18c4b41cee6012e9f92aa7ab0/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 18.2.2-1240-g6a7528e4-1jammy [3,106 kB] 2024-04-18T14:39:40.808 INFO:teuthology.orchestra.run.smithi134.stdout:Get:59 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2024-04-18T14:39:40.808 INFO:teuthology.orchestra.run.smithi134.stdout:Get:60 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2024-04-18T14:39:40.809 INFO:teuthology.orchestra.run.smithi134.stdout:Get:61 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2024-04-18T14:39:40.810 INFO:teuthology.orchestra.run.smithi134.stdout:Get:62 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2024-04-18T14:39:40.811 INFO:teuthology.orchestra.run.smithi134.stdout:Get:63 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2024-04-18T14:39:40.812 INFO:teuthology.orchestra.run.smithi134.stdout:Get:64 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2024-04-18T14:39:40.818 INFO:teuthology.orchestra.run.smithi119.stdout:Get:59 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2024-04-18T14:39:40.819 INFO:teuthology.orchestra.run.smithi119.stdout:Get:60 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2024-04-18T14:39:40.820 INFO:teuthology.orchestra.run.smithi119.stdout:Get:61 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2024-04-18T14:39:40.821 INFO:teuthology.orchestra.run.smithi119.stdout:Get:62 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2024-04-18T14:39:40.822 INFO:teuthology.orchestra.run.smithi134.stdout:Get:65 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2024-04-18T14:39:40.822 INFO:teuthology.orchestra.run.smithi119.stdout:Get:63 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2024-04-18T14:39:40.822 INFO:teuthology.orchestra.run.smithi134.stdout:Get:66 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2024-04-18T14:39:40.823 INFO:teuthology.orchestra.run.smithi119.stdout:Get:64 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2024-04-18T14:39:40.824 INFO:teuthology.orchestra.run.smithi119.stdout:Get:65 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2024-04-18T14:39:40.827 INFO:teuthology.orchestra.run.smithi134.stdout:Get:67 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2024-04-18T14:39:40.831 INFO:teuthology.orchestra.run.smithi119.stdout:Get:66 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2024-04-18T14:39:40.837 INFO:teuthology.orchestra.run.smithi119.stdout:Get:67 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2024-04-18T14:39:40.842 INFO:teuthology.orchestra.run.smithi134.stdout:Get:68 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2024-04-18T14:39:40.844 INFO:teuthology.orchestra.run.smithi134.stdout:Get:69 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2024-04-18T14:39:40.845 INFO:teuthology.orchestra.run.smithi134.stdout:Get:70 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2024-04-18T14:39:40.850 INFO:teuthology.orchestra.run.smithi134.stdout:Get:71 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2024-04-18T14:39:40.853 INFO:teuthology.orchestra.run.smithi096.stdout:Get:15 https://3.chacra.ceph.com/r/ceph/wip-yuri2-testing-2024-04-17-0823-reef/6a7528e4aecd36b18c4b41cee6012e9f92aa7ab0/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 18.2.2-1240-g6a7528e4-1jammy [112 kB] 2024-04-18T14:39:40.854 INFO:teuthology.orchestra.run.smithi134.stdout:Get:72 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.1 [474 kB] 2024-04-18T14:39:40.857 INFO:teuthology.orchestra.run.smithi096.stdout:Get:16 https://3.chacra.ceph.com/r/ceph/wip-yuri2-testing-2024-04-17-0823-reef/6a7528e4aecd36b18c4b41cee6012e9f92aa7ab0/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 18.2.2-1240-g6a7528e4-1jammy [442 kB] 2024-04-18T14:39:40.859 INFO:teuthology.orchestra.run.smithi119.stdout:Get:68 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2024-04-18T14:39:40.861 INFO:teuthology.orchestra.run.smithi134.stdout:Get:73 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2024-04-18T14:39:40.862 INFO:teuthology.orchestra.run.smithi119.stdout:Get:69 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2024-04-18T14:39:40.863 INFO:teuthology.orchestra.run.smithi119.stdout:Get:70 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2024-04-18T14:39:40.865 INFO:teuthology.orchestra.run.smithi134.stdout:Get:74 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2024-04-18T14:39:40.868 INFO:teuthology.orchestra.run.smithi134.stdout:Get:75 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2024-04-18T14:39:40.869 INFO:teuthology.orchestra.run.smithi119.stdout:Get:71 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2024-04-18T14:39:40.870 INFO:teuthology.orchestra.run.smithi134.stdout:Get:76 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2024-04-18T14:39:40.874 INFO:teuthology.orchestra.run.smithi119.stdout:Get:72 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.1 [474 kB] 2024-04-18T14:39:40.878 INFO:teuthology.orchestra.run.smithi096.stdout:Get:17 https://3.chacra.ceph.com/r/ceph/wip-yuri2-testing-2024-04-17-0823-reef/6a7528e4aecd36b18c4b41cee6012e9f92aa7ab0/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 18.2.2-1240-g6a7528e4-1jammy [21.9 MB] 2024-04-18T14:39:40.881 INFO:teuthology.orchestra.run.smithi134.stdout:Get:77 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2024-04-18T14:39:40.883 INFO:teuthology.orchestra.run.smithi096.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2024-04-18T14:39:40.886 INFO:teuthology.orchestra.run.smithi119.stdout:Get:73 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2024-04-18T14:39:40.892 INFO:teuthology.orchestra.run.smithi119.stdout:Get:74 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2024-04-18T14:39:40.893 INFO:teuthology.orchestra.run.smithi119.stdout:Get:75 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2024-04-18T14:39:40.894 INFO:teuthology.orchestra.run.smithi096.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2024-04-18T14:39:40.894 INFO:teuthology.orchestra.run.smithi134.stdout:Get:78 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2024-04-18T14:39:40.895 INFO:teuthology.orchestra.run.smithi134.stdout:Get:79 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2024-04-18T14:39:40.896 INFO:teuthology.orchestra.run.smithi119.stdout:Get:76 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2024-04-18T14:39:40.922 INFO:teuthology.orchestra.run.smithi096.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2024-04-18T14:39:40.927 INFO:teuthology.orchestra.run.smithi119.stdout:Get:77 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2024-04-18T14:39:40.928 INFO:teuthology.orchestra.run.smithi119.stdout:Get:78 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2024-04-18T14:39:40.929 INFO:teuthology.orchestra.run.smithi119.stdout:Get:79 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2024-04-18T14:39:40.931 INFO:teuthology.orchestra.run.smithi096.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2024-04-18T14:39:40.932 INFO:teuthology.orchestra.run.smithi096.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2024-04-18T14:39:40.933 INFO:teuthology.orchestra.run.smithi096.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2024-04-18T14:39:41.114 INFO:teuthology.orchestra.run.smithi096.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2024-04-18T14:39:41.143 INFO:teuthology.orchestra.run.smithi086.stdout:Get:81 https://3.chacra.ceph.com/r/ceph/wip-yuri2-testing-2024-04-17-0823-reef/6a7528e4aecd36b18c4b41cee6012e9f92aa7ab0/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 18.2.2-1240-g6a7528e4-1jammy [679 kB] 2024-04-18T14:39:41.222 INFO:teuthology.orchestra.run.smithi086.stdout:Get:82 https://3.chacra.ceph.com/r/ceph/wip-yuri2-testing-2024-04-17-0823-reef/6a7528e4aecd36b18c4b41cee6012e9f92aa7ab0/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 18.2.2-1240-g6a7528e4-1jammy [356 kB] 2024-04-18T14:39:41.276 INFO:teuthology.orchestra.run.smithi086.stdout:Get:83 https://3.chacra.ceph.com/r/ceph/wip-yuri2-testing-2024-04-17-0823-reef/6a7528e4aecd36b18c4b41cee6012e9f92aa7ab0/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 18.2.2-1240-g6a7528e4-1jammy [32.8 kB] 2024-04-18T14:39:41.278 INFO:teuthology.orchestra.run.smithi086.stdout:Get:84 https://3.chacra.ceph.com/r/ceph/wip-yuri2-testing-2024-04-17-0823-reef/6a7528e4aecd36b18c4b41cee6012e9f92aa7ab0/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 18.2.2-1240-g6a7528e4-1jammy [180 kB] 2024-04-18T14:39:41.293 INFO:teuthology.orchestra.run.smithi086.stdout:Get:85 https://3.chacra.ceph.com/r/ceph/wip-yuri2-testing-2024-04-17-0823-reef/6a7528e4aecd36b18c4b41cee6012e9f92aa7ab0/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 18.2.2-1240-g6a7528e4-1jammy [63.7 kB] 2024-04-18T14:39:41.297 INFO:teuthology.orchestra.run.smithi086.stdout:Get:86 https://3.chacra.ceph.com/r/ceph/wip-yuri2-testing-2024-04-17-0823-reef/6a7528e4aecd36b18c4b41cee6012e9f92aa7ab0/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 18.2.2-1240-g6a7528e4-1jammy [330 kB] 2024-04-18T14:39:41.351 INFO:teuthology.orchestra.run.smithi086.stdout:Get:87 https://3.chacra.ceph.com/r/ceph/wip-yuri2-testing-2024-04-17-0823-reef/6a7528e4aecd36b18c4b41cee6012e9f92aa7ab0/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 18.2.2-1240-g6a7528e4-1jammy [5,891 kB] 2024-04-18T14:39:41.362 INFO:teuthology.orchestra.run.smithi096.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2024-04-18T14:39:41.370 INFO:teuthology.orchestra.run.smithi096.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2024-04-18T14:39:41.470 INFO:teuthology.orchestra.run.smithi096.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2024-04-18T14:39:41.478 INFO:teuthology.orchestra.run.smithi096.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2024-04-18T14:39:41.487 INFO:teuthology.orchestra.run.smithi096.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2024-04-18T14:39:41.500 INFO:teuthology.orchestra.run.smithi096.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2024-04-18T14:39:41.512 INFO:teuthology.orchestra.run.smithi096.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2024-04-18T14:39:41.519 INFO:teuthology.orchestra.run.smithi096.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2024-04-18T14:39:41.528 INFO:teuthology.orchestra.run.smithi096.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2024-04-18T14:39:41.626 INFO:teuthology.orchestra.run.smithi096.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2024-04-18T14:39:41.799 INFO:teuthology.orchestra.run.smithi096.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2024-04-18T14:39:41.968 INFO:teuthology.orchestra.run.smithi096.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2024-04-18T14:39:41.992 INFO:teuthology.orchestra.run.smithi096.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2024-04-18T14:39:42.092 INFO:teuthology.orchestra.run.smithi096.stdout:Get:38 https://3.chacra.ceph.com/r/ceph/wip-yuri2-testing-2024-04-17-0823-reef/6a7528e4aecd36b18c4b41cee6012e9f92aa7ab0/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 18.2.2-1240-g6a7528e4-1jammy [5,002 kB] 2024-04-18T14:39:42.111 INFO:teuthology.orchestra.run.smithi086.stdout:Get:88 https://3.chacra.ceph.com/r/ceph/wip-yuri2-testing-2024-04-17-0823-reef/6a7528e4aecd36b18c4b41cee6012e9f92aa7ab0/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 18.2.2-1240-g6a7528e4-1jammy [112 kB] 2024-04-18T14:39:42.114 INFO:teuthology.orchestra.run.smithi086.stdout:Get:89 https://3.chacra.ceph.com/r/ceph/wip-yuri2-testing-2024-04-17-0823-reef/6a7528e4aecd36b18c4b41cee6012e9f92aa7ab0/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 18.2.2-1240-g6a7528e4-1jammy [442 kB] 2024-04-18T14:39:42.122 INFO:teuthology.orchestra.run.smithi096.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2024-04-18T14:39:42.142 INFO:teuthology.orchestra.run.smithi096.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2024-04-18T14:39:42.147 INFO:teuthology.orchestra.run.smithi086.stdout:Get:90 https://3.chacra.ceph.com/r/ceph/wip-yuri2-testing-2024-04-17-0823-reef/6a7528e4aecd36b18c4b41cee6012e9f92aa7ab0/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 18.2.2-1240-g6a7528e4-1jammy [21.9 MB] 2024-04-18T14:39:42.149 INFO:teuthology.orchestra.run.smithi096.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webob all 1:1.8.6-1.1 [85.2 kB] 2024-04-18T14:39:42.221 INFO:teuthology.orchestra.run.smithi096.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2024-04-18T14:39:42.248 INFO:teuthology.orchestra.run.smithi096.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2024-04-18T14:39:42.255 INFO:teuthology.orchestra.run.smithi096.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2024-04-18T14:39:42.311 INFO:teuthology.orchestra.run.smithi096.stdout:Get:45 https://3.chacra.ceph.com/r/ceph/wip-yuri2-testing-2024-04-17-0823-reef/6a7528e4aecd36b18c4b41cee6012e9f92aa7ab0/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 18.2.2-1240-g6a7528e4-1jammy [241 kB] 2024-04-18T14:39:42.323 INFO:teuthology.orchestra.run.smithi096.stdout:Get:46 https://3.chacra.ceph.com/r/ceph/wip-yuri2-testing-2024-04-17-0823-reef/6a7528e4aecd36b18c4b41cee6012e9f92aa7ab0/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 18.2.2-1240-g6a7528e4-1jammy [130 kB] 2024-04-18T14:39:42.331 INFO:teuthology.orchestra.run.smithi096.stdout:Get:47 https://3.chacra.ceph.com/r/ceph/wip-yuri2-testing-2024-04-17-0823-reef/6a7528e4aecd36b18c4b41cee6012e9f92aa7ab0/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 18.2.2-1240-g6a7528e4-1jammy [1,490 kB] 2024-04-18T14:39:42.379 INFO:teuthology.orchestra.run.smithi096.stdout:Get:48 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2024-04-18T14:39:42.380 INFO:teuthology.orchestra.run.smithi096.stdout:Get:49 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2024-04-18T14:39:42.413 INFO:teuthology.orchestra.run.smithi096.stdout:Get:50 https://3.chacra.ceph.com/r/ceph/wip-yuri2-testing-2024-04-17-0823-reef/6a7528e4aecd36b18c4b41cee6012e9f92aa7ab0/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 18.2.2-1240-g6a7528e4-1jammy [6,079 kB] 2024-04-18T14:39:42.548 INFO:teuthology.orchestra.run.smithi096.stdout:Get:51 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2024-04-18T14:39:42.745 INFO:teuthology.orchestra.run.smithi096.stdout:Get:52 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2024-04-18T14:39:42.747 INFO:teuthology.orchestra.run.smithi096.stdout:Get:53 https://3.chacra.ceph.com/r/ceph/wip-yuri2-testing-2024-04-17-0823-reef/6a7528e4aecd36b18c4b41cee6012e9f92aa7ab0/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 18.2.2-1240-g6a7528e4-1jammy [22.3 MB] 2024-04-18T14:39:42.905 INFO:teuthology.orchestra.run.smithi096.stdout:Get:54 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2024-04-18T14:39:43.010 INFO:teuthology.orchestra.run.smithi096.stdout:Get:55 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-idna all 3.3-1 [49.3 kB] 2024-04-18T14:39:43.032 INFO:teuthology.orchestra.run.smithi096.stdout:Get:56 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-urllib3 all 1.26.5-1~exp1ubuntu0.1 [98.2 kB] 2024-04-18T14:39:43.065 INFO:teuthology.orchestra.run.smithi096.stdout:Get:57 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2024-04-18T14:39:43.078 INFO:teuthology.orchestra.run.smithi096.stdout:Get:58 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.1 [181 kB] 2024-04-18T14:39:43.118 INFO:teuthology.orchestra.run.smithi096.stdout:Get:59 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2024-04-18T14:39:43.125 INFO:teuthology.orchestra.run.smithi096.stdout:Get:60 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2024-04-18T14:39:43.133 INFO:teuthology.orchestra.run.smithi096.stdout:Get:61 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2024-04-18T14:39:43.161 INFO:teuthology.orchestra.run.smithi096.stdout:Get:62 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2024-04-18T14:39:43.552 INFO:teuthology.orchestra.run.smithi096.stdout:Get:63 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2024-04-18T14:39:43.732 INFO:teuthology.orchestra.run.smithi119.stdout:Get:80 https://3.chacra.ceph.com/r/ceph/wip-yuri2-testing-2024-04-17-0823-reef/6a7528e4aecd36b18c4b41cee6012e9f92aa7ab0/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 18.2.2-1240-g6a7528e4-1jammy [3,106 kB] 2024-04-18T14:39:43.868 INFO:teuthology.orchestra.run.smithi096.stdout:Get:64 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-jinja2 all 3.0.3-1ubuntu0.1 [108 kB] 2024-04-18T14:39:43.956 INFO:teuthology.orchestra.run.smithi096.stdout:Get:65 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2024-04-18T14:39:44.020 INFO:teuthology.orchestra.run.smithi134.stdout:Get:80 https://3.chacra.ceph.com/r/ceph/wip-yuri2-testing-2024-04-17-0823-reef/6a7528e4aecd36b18c4b41cee6012e9f92aa7ab0/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 18.2.2-1240-g6a7528e4-1jammy [3,106 kB] 2024-04-18T14:39:44.039 INFO:teuthology.orchestra.run.smithi096.stdout:Get:66 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2024-04-18T14:39:44.041 INFO:teuthology.orchestra.run.smithi096.stdout:Get:67 https://3.chacra.ceph.com/r/ceph/wip-yuri2-testing-2024-04-17-0823-reef/6a7528e4aecd36b18c4b41cee6012e9f92aa7ab0/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 18.2.2-1240-g6a7528e4-1jammy [14.1 kB] 2024-04-18T14:39:44.041 INFO:teuthology.orchestra.run.smithi096.stdout:Get:68 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2024-04-18T14:39:44.041 INFO:teuthology.orchestra.run.smithi096.stdout:Get:69 https://3.chacra.ceph.com/r/ceph/wip-yuri2-testing-2024-04-17-0823-reef/6a7528e4aecd36b18c4b41cee6012e9f92aa7ab0/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 18.2.2-1240-g6a7528e4-1jammy [831 kB] 2024-04-18T14:39:44.042 INFO:teuthology.orchestra.run.smithi096.stdout:Get:70 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2024-04-18T14:39:44.043 INFO:teuthology.orchestra.run.smithi096.stdout:Get:71 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2024-04-18T14:39:44.057 INFO:teuthology.orchestra.run.smithi096.stdout:Get:72 https://3.chacra.ceph.com/r/ceph/wip-yuri2-testing-2024-04-17-0823-reef/6a7528e4aecd36b18c4b41cee6012e9f92aa7ab0/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 18.2.2-1240-g6a7528e4-1jammy [2,153 kB] 2024-04-18T14:39:44.099 INFO:teuthology.orchestra.run.smithi096.stdout:Get:73 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2024-04-18T14:39:44.104 INFO:teuthology.orchestra.run.smithi096.stdout:Get:74 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2024-04-18T14:39:44.126 INFO:teuthology.orchestra.run.smithi096.stdout:Get:75 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2024-04-18T14:39:44.136 INFO:teuthology.orchestra.run.smithi096.stdout:Get:76 https://3.chacra.ceph.com/r/ceph/wip-yuri2-testing-2024-04-17-0823-reef/6a7528e4aecd36b18c4b41cee6012e9f92aa7ab0/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 18.2.2-1240-g6a7528e4-1jammy [238 kB] 2024-04-18T14:39:44.221 INFO:teuthology.orchestra.run.smithi096.stdout:Get:77 https://3.chacra.ceph.com/r/ceph/wip-yuri2-testing-2024-04-17-0823-reef/6a7528e4aecd36b18c4b41cee6012e9f92aa7ab0/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 18.2.2-1240-g6a7528e4-1jammy [144 kB] 2024-04-18T14:39:44.224 INFO:teuthology.orchestra.run.smithi096.stdout:Get:78 https://3.chacra.ceph.com/r/ceph/wip-yuri2-testing-2024-04-17-0823-reef/6a7528e4aecd36b18c4b41cee6012e9f92aa7ab0/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 18.2.2-1240-g6a7528e4-1jammy [2,237 kB] 2024-04-18T14:39:44.286 INFO:teuthology.orchestra.run.smithi096.stdout:Get:79 https://3.chacra.ceph.com/r/ceph/wip-yuri2-testing-2024-04-17-0823-reef/6a7528e4aecd36b18c4b41cee6012e9f92aa7ab0/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 18.2.2-1240-g6a7528e4-1jammy [8,625 kB] 2024-04-18T14:39:44.303 INFO:teuthology.orchestra.run.smithi096.stdout:Get:80 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2024-04-18T14:39:44.475 INFO:teuthology.orchestra.run.smithi096.stdout:Get:81 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2024-04-18T14:39:44.647 INFO:teuthology.orchestra.run.smithi096.stdout:Get:82 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2024-04-18T14:39:44.776 INFO:teuthology.orchestra.run.smithi096.stdout:Get:83 https://3.chacra.ceph.com/r/ceph/wip-yuri2-testing-2024-04-17-0823-reef/6a7528e4aecd36b18c4b41cee6012e9f92aa7ab0/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 18.2.2-1240-g6a7528e4-1jammy [14.3 kB] 2024-04-18T14:39:44.776 INFO:teuthology.orchestra.run.smithi096.stdout:Get:84 https://3.chacra.ceph.com/r/ceph/wip-yuri2-testing-2024-04-17-0823-reef/6a7528e4aecd36b18c4b41cee6012e9f92aa7ab0/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 18.2.2-1240-g6a7528e4-1jammy [42.6 MB] 2024-04-18T14:39:44.880 INFO:teuthology.orchestra.run.smithi086.stdout:Get:91 https://3.chacra.ceph.com/r/ceph/wip-yuri2-testing-2024-04-17-0823-reef/6a7528e4aecd36b18c4b41cee6012e9f92aa7ab0/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 18.2.2-1240-g6a7528e4-1jammy [5,002 kB] 2024-04-18T14:39:45.152 INFO:teuthology.orchestra.run.smithi096.stdout:Get:85 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2024-04-18T14:39:45.153 INFO:teuthology.orchestra.run.smithi096.stdout:Get:86 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2024-04-18T14:39:45.155 INFO:teuthology.orchestra.run.smithi096.stdout:Get:87 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2024-04-18T14:39:45.157 INFO:teuthology.orchestra.run.smithi096.stdout:Get:88 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2024-04-18T14:39:45.159 INFO:teuthology.orchestra.run.smithi096.stdout:Get:89 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2024-04-18T14:39:45.161 INFO:teuthology.orchestra.run.smithi096.stdout:Get:90 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2024-04-18T14:39:45.162 INFO:teuthology.orchestra.run.smithi096.stdout:Get:91 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2024-04-18T14:39:45.164 INFO:teuthology.orchestra.run.smithi096.stdout:Get:92 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2024-04-18T14:39:45.183 INFO:teuthology.orchestra.run.smithi096.stdout:Get:93 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2024-04-18T14:39:45.355 INFO:teuthology.orchestra.run.smithi096.stdout:Get:94 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2024-04-18T14:39:45.448 INFO:teuthology.orchestra.run.smithi086.stdout:Get:92 https://3.chacra.ceph.com/r/ceph/wip-yuri2-testing-2024-04-17-0823-reef/6a7528e4aecd36b18c4b41cee6012e9f92aa7ab0/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 18.2.2-1240-g6a7528e4-1jammy [241 kB] 2024-04-18T14:39:45.468 INFO:teuthology.orchestra.run.smithi086.stdout:Get:93 https://3.chacra.ceph.com/r/ceph/wip-yuri2-testing-2024-04-17-0823-reef/6a7528e4aecd36b18c4b41cee6012e9f92aa7ab0/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 18.2.2-1240-g6a7528e4-1jammy [130 kB] 2024-04-18T14:39:45.497 INFO:teuthology.orchestra.run.smithi086.stdout:Get:94 https://3.chacra.ceph.com/r/ceph/wip-yuri2-testing-2024-04-17-0823-reef/6a7528e4aecd36b18c4b41cee6012e9f92aa7ab0/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 18.2.2-1240-g6a7528e4-1jammy [1,490 kB] 2024-04-18T14:39:45.679 INFO:teuthology.orchestra.run.smithi086.stdout:Get:95 https://3.chacra.ceph.com/r/ceph/wip-yuri2-testing-2024-04-17-0823-reef/6a7528e4aecd36b18c4b41cee6012e9f92aa7ab0/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 18.2.2-1240-g6a7528e4-1jammy [6,079 kB] 2024-04-18T14:39:45.728 INFO:teuthology.orchestra.run.smithi096.stdout:Get:95 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2024-04-18T14:39:45.753 INFO:teuthology.orchestra.run.smithi096.stdout:Get:96 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2024-04-18T14:39:45.904 INFO:teuthology.orchestra.run.smithi096.stdout:Get:97 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2024-04-18T14:39:45.955 INFO:teuthology.orchestra.run.smithi096.stdout:Get:98 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.1 [474 kB] 2024-04-18T14:39:46.004 INFO:teuthology.orchestra.run.smithi119.stdout:Get:81 https://3.chacra.ceph.com/r/ceph/wip-yuri2-testing-2024-04-17-0823-reef/6a7528e4aecd36b18c4b41cee6012e9f92aa7ab0/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 18.2.2-1240-g6a7528e4-1jammy [679 kB] 2024-04-18T14:39:46.016 INFO:teuthology.orchestra.run.smithi096.stdout:Get:99 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2024-04-18T14:39:46.042 INFO:teuthology.orchestra.run.smithi096.stdout:Get:100 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2024-04-18T14:39:46.046 INFO:teuthology.orchestra.run.smithi096.stdout:Get:101 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2024-04-18T14:39:46.058 INFO:teuthology.orchestra.run.smithi096.stdout:Get:102 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2024-04-18T14:39:46.104 INFO:teuthology.orchestra.run.smithi096.stdout:Get:103 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2024-04-18T14:39:46.105 INFO:teuthology.orchestra.run.smithi096.stdout:Get:104 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2024-04-18T14:39:46.271 INFO:teuthology.orchestra.run.smithi096.stdout:Get:105 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2024-04-18T14:39:46.357 INFO:teuthology.orchestra.run.smithi134.stdout:Get:81 https://3.chacra.ceph.com/r/ceph/wip-yuri2-testing-2024-04-17-0823-reef/6a7528e4aecd36b18c4b41cee6012e9f92aa7ab0/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 18.2.2-1240-g6a7528e4-1jammy [679 kB] 2024-04-18T14:39:46.430 INFO:teuthology.orchestra.run.smithi086.stdout:Get:96 https://3.chacra.ceph.com/r/ceph/wip-yuri2-testing-2024-04-17-0823-reef/6a7528e4aecd36b18c4b41cee6012e9f92aa7ab0/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 18.2.2-1240-g6a7528e4-1jammy [22.3 MB] 2024-04-18T14:39:46.442 INFO:teuthology.orchestra.run.smithi119.stdout:Get:82 https://3.chacra.ceph.com/r/ceph/wip-yuri2-testing-2024-04-17-0823-reef/6a7528e4aecd36b18c4b41cee6012e9f92aa7ab0/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 18.2.2-1240-g6a7528e4-1jammy [356 kB] 2024-04-18T14:39:46.723 INFO:teuthology.orchestra.run.smithi119.stdout:Get:83 https://3.chacra.ceph.com/r/ceph/wip-yuri2-testing-2024-04-17-0823-reef/6a7528e4aecd36b18c4b41cee6012e9f92aa7ab0/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 18.2.2-1240-g6a7528e4-1jammy [32.8 kB] 2024-04-18T14:39:46.753 INFO:teuthology.orchestra.run.smithi119.stdout:Get:84 https://3.chacra.ceph.com/r/ceph/wip-yuri2-testing-2024-04-17-0823-reef/6a7528e4aecd36b18c4b41cee6012e9f92aa7ab0/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 18.2.2-1240-g6a7528e4-1jammy [180 kB] 2024-04-18T14:39:46.844 INFO:teuthology.orchestra.run.smithi119.stdout:Get:85 https://3.chacra.ceph.com/r/ceph/wip-yuri2-testing-2024-04-17-0823-reef/6a7528e4aecd36b18c4b41cee6012e9f92aa7ab0/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 18.2.2-1240-g6a7528e4-1jammy [63.7 kB] 2024-04-18T14:39:46.882 INFO:teuthology.orchestra.run.smithi134.stdout:Get:82 https://3.chacra.ceph.com/r/ceph/wip-yuri2-testing-2024-04-17-0823-reef/6a7528e4aecd36b18c4b41cee6012e9f92aa7ab0/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 18.2.2-1240-g6a7528e4-1jammy [356 kB] 2024-04-18T14:39:46.927 INFO:teuthology.orchestra.run.smithi119.stdout:Get:86 https://3.chacra.ceph.com/r/ceph/wip-yuri2-testing-2024-04-17-0823-reef/6a7528e4aecd36b18c4b41cee6012e9f92aa7ab0/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 18.2.2-1240-g6a7528e4-1jammy [330 kB] 2024-04-18T14:39:47.150 INFO:teuthology.orchestra.run.smithi134.stdout:Get:83 https://3.chacra.ceph.com/r/ceph/wip-yuri2-testing-2024-04-17-0823-reef/6a7528e4aecd36b18c4b41cee6012e9f92aa7ab0/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 18.2.2-1240-g6a7528e4-1jammy [32.8 kB] 2024-04-18T14:39:47.152 INFO:teuthology.orchestra.run.smithi119.stdout:Get:87 https://3.chacra.ceph.com/r/ceph/wip-yuri2-testing-2024-04-17-0823-reef/6a7528e4aecd36b18c4b41cee6012e9f92aa7ab0/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 18.2.2-1240-g6a7528e4-1jammy [5,891 kB] 2024-04-18T14:39:47.153 INFO:teuthology.orchestra.run.smithi134.stdout:Get:84 https://3.chacra.ceph.com/r/ceph/wip-yuri2-testing-2024-04-17-0823-reef/6a7528e4aecd36b18c4b41cee6012e9f92aa7ab0/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 18.2.2-1240-g6a7528e4-1jammy [180 kB] 2024-04-18T14:39:47.331 INFO:teuthology.orchestra.run.smithi134.stdout:Get:85 https://3.chacra.ceph.com/r/ceph/wip-yuri2-testing-2024-04-17-0823-reef/6a7528e4aecd36b18c4b41cee6012e9f92aa7ab0/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 18.2.2-1240-g6a7528e4-1jammy [63.7 kB] 2024-04-18T14:39:47.336 INFO:teuthology.orchestra.run.smithi134.stdout:Get:86 https://3.chacra.ceph.com/r/ceph/wip-yuri2-testing-2024-04-17-0823-reef/6a7528e4aecd36b18c4b41cee6012e9f92aa7ab0/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 18.2.2-1240-g6a7528e4-1jammy [330 kB] 2024-04-18T14:39:47.501 INFO:teuthology.orchestra.run.smithi096.stdout:Get:106 https://3.chacra.ceph.com/r/ceph/wip-yuri2-testing-2024-04-17-0823-reef/6a7528e4aecd36b18c4b41cee6012e9f92aa7ab0/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 18.2.2-1240-g6a7528e4-1jammy [121 kB] 2024-04-18T14:39:47.503 INFO:teuthology.orchestra.run.smithi096.stdout:Get:107 https://3.chacra.ceph.com/r/ceph/wip-yuri2-testing-2024-04-17-0823-reef/6a7528e4aecd36b18c4b41cee6012e9f92aa7ab0/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 18.2.2-1240-g6a7528e4-1jammy [38.3 kB] 2024-04-18T14:39:47.504 INFO:teuthology.orchestra.run.smithi096.stdout:Get:108 https://3.chacra.ceph.com/r/ceph/wip-yuri2-testing-2024-04-17-0823-reef/6a7528e4aecd36b18c4b41cee6012e9f92aa7ab0/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 18.2.2-1240-g6a7528e4-1jammy [11.6 MB] 2024-04-18T14:39:47.596 INFO:teuthology.orchestra.run.smithi134.stdout:Get:87 https://3.chacra.ceph.com/r/ceph/wip-yuri2-testing-2024-04-17-0823-reef/6a7528e4aecd36b18c4b41cee6012e9f92aa7ab0/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 18.2.2-1240-g6a7528e4-1jammy [5,891 kB] 2024-04-18T14:39:48.278 INFO:teuthology.orchestra.run.smithi096.stdout:Get:109 https://3.chacra.ceph.com/r/ceph/wip-yuri2-testing-2024-04-17-0823-reef/6a7528e4aecd36b18c4b41cee6012e9f92aa7ab0/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 18.2.2-1240-g6a7528e4-1jammy [93.1 kB] 2024-04-18T14:39:48.847 INFO:teuthology.orchestra.run.smithi096.stdout:Fetched 162 MB in 8s (19.5 MB/s) 2024-04-18T14:39:48.982 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package libfmt8:amd64. 2024-04-18T14:39:49.069 INFO:teuthology.orchestra.run.smithi096.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 165995 files and directories currently installed.) 2024-04-18T14:39:49.074 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../000-libfmt8_8.1.1+ds1-2_amd64.deb ... 2024-04-18T14:39:49.156 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking libfmt8:amd64 (8.1.1+ds1-2) ... 2024-04-18T14:39:49.467 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2024-04-18T14:39:49.494 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../001-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2024-04-18T14:39:49.534 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-04-18T14:39:49.716 INFO:teuthology.orchestra.run.smithi086.stdout:Get:97 https://3.chacra.ceph.com/r/ceph/wip-yuri2-testing-2024-04-17-0823-reef/6a7528e4aecd36b18c4b41cee6012e9f92aa7ab0/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 18.2.2-1240-g6a7528e4-1jammy [14.1 kB] 2024-04-18T14:39:49.717 INFO:teuthology.orchestra.run.smithi086.stdout:Get:98 https://3.chacra.ceph.com/r/ceph/wip-yuri2-testing-2024-04-17-0823-reef/6a7528e4aecd36b18c4b41cee6012e9f92aa7ab0/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 18.2.2-1240-g6a7528e4-1jammy [831 kB] 2024-04-18T14:39:49.871 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2024-04-18T14:39:49.894 INFO:teuthology.orchestra.run.smithi086.stdout:Get:99 https://3.chacra.ceph.com/r/ceph/wip-yuri2-testing-2024-04-17-0823-reef/6a7528e4aecd36b18c4b41cee6012e9f92aa7ab0/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 18.2.2-1240-g6a7528e4-1jammy [2,153 kB] 2024-04-18T14:39:49.897 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../002-libdouble-conversion3_3.1.7-4_amd64.deb ... 2024-04-18T14:39:49.929 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2024-04-18T14:39:50.165 INFO:teuthology.orchestra.run.smithi086.stdout:Get:100 https://3.chacra.ceph.com/r/ceph/wip-yuri2-testing-2024-04-17-0823-reef/6a7528e4aecd36b18c4b41cee6012e9f92aa7ab0/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 18.2.2-1240-g6a7528e4-1jammy [238 kB] 2024-04-18T14:39:50.215 INFO:teuthology.orchestra.run.smithi086.stdout:Get:101 https://3.chacra.ceph.com/r/ceph/wip-yuri2-testing-2024-04-17-0823-reef/6a7528e4aecd36b18c4b41cee6012e9f92aa7ab0/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 18.2.2-1240-g6a7528e4-1jammy [144 kB] 2024-04-18T14:39:50.238 INFO:teuthology.orchestra.run.smithi086.stdout:Get:102 https://3.chacra.ceph.com/r/ceph/wip-yuri2-testing-2024-04-17-0823-reef/6a7528e4aecd36b18c4b41cee6012e9f92aa7ab0/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 18.2.2-1240-g6a7528e4-1jammy [2,237 kB] 2024-04-18T14:39:50.265 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2024-04-18T14:39:50.292 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../003-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2024-04-18T14:39:50.332 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-04-18T14:39:50.676 INFO:teuthology.orchestra.run.smithi086.stdout:Get:103 https://3.chacra.ceph.com/r/ceph/wip-yuri2-testing-2024-04-17-0823-reef/6a7528e4aecd36b18c4b41cee6012e9f92aa7ab0/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 18.2.2-1240-g6a7528e4-1jammy [8,625 kB] 2024-04-18T14:39:50.810 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package libqt5core5a:amd64. 2024-04-18T14:39:50.837 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../004-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-04-18T14:39:50.847 INFO:teuthology.orchestra.run.smithi134.stdout:Get:88 https://3.chacra.ceph.com/r/ceph/wip-yuri2-testing-2024-04-17-0823-reef/6a7528e4aecd36b18c4b41cee6012e9f92aa7ab0/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 18.2.2-1240-g6a7528e4-1jammy [112 kB] 2024-04-18T14:39:50.893 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-18T14:39:50.910 INFO:teuthology.orchestra.run.smithi134.stdout:Get:89 https://3.chacra.ceph.com/r/ceph/wip-yuri2-testing-2024-04-17-0823-reef/6a7528e4aecd36b18c4b41cee6012e9f92aa7ab0/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 18.2.2-1240-g6a7528e4-1jammy [442 kB] 2024-04-18T14:39:51.161 INFO:teuthology.orchestra.run.smithi134.stdout:Get:90 https://3.chacra.ceph.com/r/ceph/wip-yuri2-testing-2024-04-17-0823-reef/6a7528e4aecd36b18c4b41cee6012e9f92aa7ab0/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 18.2.2-1240-g6a7528e4-1jammy [21.9 MB] 2024-04-18T14:39:51.196 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2024-04-18T14:39:51.223 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../005-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-04-18T14:39:51.276 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-18T14:39:51.347 INFO:teuthology.orchestra.run.smithi119.stdout:Get:88 https://3.chacra.ceph.com/r/ceph/wip-yuri2-testing-2024-04-17-0823-reef/6a7528e4aecd36b18c4b41cee6012e9f92aa7ab0/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 18.2.2-1240-g6a7528e4-1jammy [112 kB] 2024-04-18T14:39:51.473 INFO:teuthology.orchestra.run.smithi119.stdout:Get:89 https://3.chacra.ceph.com/r/ceph/wip-yuri2-testing-2024-04-17-0823-reef/6a7528e4aecd36b18c4b41cee6012e9f92aa7ab0/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 18.2.2-1240-g6a7528e4-1jammy [442 kB] 2024-04-18T14:39:51.616 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package libqt5network5:amd64. 2024-04-18T14:39:51.643 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../006-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-04-18T14:39:51.683 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-18T14:39:51.814 INFO:teuthology.orchestra.run.smithi119.stdout:Get:90 https://3.chacra.ceph.com/r/ceph/wip-yuri2-testing-2024-04-17-0823-reef/6a7528e4aecd36b18c4b41cee6012e9f92aa7ab0/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 18.2.2-1240-g6a7528e4-1jammy [21.9 MB] 2024-04-18T14:39:52.036 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2024-04-18T14:39:52.062 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../007-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2024-04-18T14:39:52.102 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-04-18T14:39:52.277 INFO:teuthology.orchestra.run.smithi086.stdout:Get:104 https://3.chacra.ceph.com/r/ceph/wip-yuri2-testing-2024-04-17-0823-reef/6a7528e4aecd36b18c4b41cee6012e9f92aa7ab0/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 18.2.2-1240-g6a7528e4-1jammy [14.3 kB] 2024-04-18T14:39:52.278 INFO:teuthology.orchestra.run.smithi086.stdout:Get:105 https://3.chacra.ceph.com/r/ceph/wip-yuri2-testing-2024-04-17-0823-reef/6a7528e4aecd36b18c4b41cee6012e9f92aa7ab0/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 18.2.2-1240-g6a7528e4-1jammy [42.6 MB] 2024-04-18T14:39:52.380 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package librados2. 2024-04-18T14:39:52.407 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../008-librados2_18.2.2-1240-g6a7528e4-1jammy_amd64.deb ... 2024-04-18T14:39:52.430 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking librados2 (18.2.2-1240-g6a7528e4-1jammy) ... 2024-04-18T14:39:52.858 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package librbd1. 2024-04-18T14:39:52.884 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../009-librbd1_18.2.2-1240-g6a7528e4-1jammy_amd64.deb ... 2024-04-18T14:39:52.924 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking librbd1 (18.2.2-1240-g6a7528e4-1jammy) ... 2024-04-18T14:39:53.369 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package libcephfs2. 2024-04-18T14:39:53.396 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../010-libcephfs2_18.2.2-1240-g6a7528e4-1jammy_amd64.deb ... 2024-04-18T14:39:53.435 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking libcephfs2 (18.2.2-1240-g6a7528e4-1jammy) ... 2024-04-18T14:39:53.713 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-rados. 2024-04-18T14:39:53.739 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../011-python3-rados_18.2.2-1240-g6a7528e4-1jammy_amd64.deb ... 2024-04-18T14:39:53.779 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-rados (18.2.2-1240-g6a7528e4-1jammy) ... 2024-04-18T14:39:54.040 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-ceph-argparse. 2024-04-18T14:39:54.063 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../012-python3-ceph-argparse_18.2.2-1240-g6a7528e4-1jammy_all.deb ... 2024-04-18T14:39:54.098 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-ceph-argparse (18.2.2-1240-g6a7528e4-1jammy) ... 2024-04-18T14:39:54.334 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-cephfs. 2024-04-18T14:39:54.350 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../013-python3-cephfs_18.2.2-1240-g6a7528e4-1jammy_amd64.deb ... 2024-04-18T14:39:54.392 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-cephfs (18.2.2-1240-g6a7528e4-1jammy) ... 2024-04-18T14:39:54.703 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-ceph-common. 2024-04-18T14:39:54.730 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../014-python3-ceph-common_18.2.2-1240-g6a7528e4-1jammy_all.deb ... 2024-04-18T14:39:54.770 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-ceph-common (18.2.2-1240-g6a7528e4-1jammy) ... 2024-04-18T14:39:55.106 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-wcwidth. 2024-04-18T14:39:55.133 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../015-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2024-04-18T14:39:55.173 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2024-04-18T14:39:55.451 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-prettytable. 2024-04-18T14:39:55.477 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../016-python3-prettytable_2.5.0-2_all.deb ... 2024-04-18T14:39:55.509 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2024-04-18T14:39:55.761 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-rbd. 2024-04-18T14:39:55.788 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../017-python3-rbd_18.2.2-1240-g6a7528e4-1jammy_amd64.deb ... 2024-04-18T14:39:55.828 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-rbd (18.2.2-1240-g6a7528e4-1jammy) ... 2024-04-18T14:39:56.189 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package librdkafka1:amd64. 2024-04-18T14:39:56.216 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../018-librdkafka1_1.8.0-1build1_amd64.deb ... 2024-04-18T14:39:56.256 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2024-04-18T14:39:56.567 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package librgw2. 2024-04-18T14:39:56.594 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../019-librgw2_18.2.2-1240-g6a7528e4-1jammy_amd64.deb ... 2024-04-18T14:39:56.633 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking librgw2 (18.2.2-1240-g6a7528e4-1jammy) ... 2024-04-18T14:39:57.094 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-rgw. 2024-04-18T14:39:57.110 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../020-python3-rgw_18.2.2-1240-g6a7528e4-1jammy_amd64.deb ... 2024-04-18T14:39:57.144 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-rgw (18.2.2-1240-g6a7528e4-1jammy) ... 2024-04-18T14:39:57.438 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package liboath0:amd64. 2024-04-18T14:39:57.466 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../021-liboath0_2.6.7-3build1_amd64.deb ... 2024-04-18T14:39:57.505 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2024-04-18T14:39:57.816 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package libradosstriper1. 2024-04-18T14:39:57.843 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../022-libradosstriper1_18.2.2-1240-g6a7528e4-1jammy_amd64.deb ... 2024-04-18T14:39:57.883 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking libradosstriper1 (18.2.2-1240-g6a7528e4-1jammy) ... 2024-04-18T14:39:58.286 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package ceph-common. 2024-04-18T14:39:58.313 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../023-ceph-common_18.2.2-1240-g6a7528e4-1jammy_amd64.deb ... 2024-04-18T14:39:58.344 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking ceph-common (18.2.2-1240-g6a7528e4-1jammy) ... 2024-04-18T14:39:59.566 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package ceph-base. 2024-04-18T14:39:59.593 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../024-ceph-base_18.2.2-1240-g6a7528e4-1jammy_amd64.deb ... 2024-04-18T14:39:59.642 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking ceph-base (18.2.2-1240-g6a7528e4-1jammy) ... 2024-04-18T14:40:00.154 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-jaraco.functools. 2024-04-18T14:40:00.181 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../025-python3-jaraco.functools_3.4.0-2_all.deb ... 2024-04-18T14:40:00.212 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2024-04-18T14:40:00.506 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-cheroot. 2024-04-18T14:40:00.533 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../026-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2024-04-18T14:40:00.573 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-04-18T14:40:01.126 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-jaraco.classes. 2024-04-18T14:40:01.153 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../027-python3-jaraco.classes_3.2.1-3_all.deb ... 2024-04-18T14:40:01.192 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2024-04-18T14:40:01.495 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-jaraco.text. 2024-04-18T14:40:01.522 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../028-python3-jaraco.text_3.6.0-2_all.deb ... 2024-04-18T14:40:01.561 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2024-04-18T14:40:01.831 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-jaraco.collections. 2024-04-18T14:40:01.858 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../029-python3-jaraco.collections_3.4.0-2_all.deb ... 2024-04-18T14:40:01.889 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2024-04-18T14:40:02.217 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-tempora. 2024-04-18T14:40:02.244 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../030-python3-tempora_4.1.2-1_all.deb ... 2024-04-18T14:40:02.283 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-tempora (4.1.2-1) ... 2024-04-18T14:40:02.570 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-portend. 2024-04-18T14:40:02.597 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../031-python3-portend_3.0.0-1_all.deb ... 2024-04-18T14:40:02.636 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-portend (3.0.0-1) ... 2024-04-18T14:40:02.931 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-zc.lockfile. 2024-04-18T14:40:02.958 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../032-python3-zc.lockfile_2.0-1_all.deb ... 2024-04-18T14:40:02.997 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2024-04-18T14:40:03.259 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-cherrypy3. 2024-04-18T14:40:03.285 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../033-python3-cherrypy3_18.6.1-4_all.deb ... 2024-04-18T14:40:03.325 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2024-04-18T14:40:03.399 INFO:teuthology.orchestra.run.smithi134.stdout:Get:91 https://3.chacra.ceph.com/r/ceph/wip-yuri2-testing-2024-04-17-0823-reef/6a7528e4aecd36b18c4b41cee6012e9f92aa7ab0/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 18.2.2-1240-g6a7528e4-1jammy [5,002 kB] 2024-04-18T14:40:03.670 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-natsort. 2024-04-18T14:40:03.697 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../034-python3-natsort_8.0.2-1_all.deb ... 2024-04-18T14:40:03.737 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-natsort (8.0.2-1) ... 2024-04-18T14:40:03.990 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-logutils. 2024-04-18T14:40:04.016 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../035-python3-logutils_0.3.3-8_all.deb ... 2024-04-18T14:40:04.048 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-logutils (0.3.3-8) ... 2024-04-18T14:40:04.317 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-markupsafe. 2024-04-18T14:40:04.344 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../036-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2024-04-18T14:40:04.384 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2024-04-18T14:40:04.687 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-mako. 2024-04-18T14:40:04.714 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../037-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2024-04-18T14:40:04.753 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-04-18T14:40:05.082 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-simplegeneric. 2024-04-18T14:40:05.108 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../038-python3-simplegeneric_0.8.1-3_all.deb ... 2024-04-18T14:40:05.148 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2024-04-18T14:40:05.434 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-singledispatch. 2024-04-18T14:40:05.450 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../039-python3-singledispatch_3.4.0.3-3_all.deb ... 2024-04-18T14:40:05.478 INFO:teuthology.orchestra.run.smithi134.stdout:Get:92 https://3.chacra.ceph.com/r/ceph/wip-yuri2-testing-2024-04-17-0823-reef/6a7528e4aecd36b18c4b41cee6012e9f92aa7ab0/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 18.2.2-1240-g6a7528e4-1jammy [241 kB] 2024-04-18T14:40:05.484 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2024-04-18T14:40:05.550 INFO:teuthology.orchestra.run.smithi134.stdout:Get:93 https://3.chacra.ceph.com/r/ceph/wip-yuri2-testing-2024-04-17-0823-reef/6a7528e4aecd36b18c4b41cee6012e9f92aa7ab0/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 18.2.2-1240-g6a7528e4-1jammy [130 kB] 2024-04-18T14:40:05.590 INFO:teuthology.orchestra.run.smithi134.stdout:Get:94 https://3.chacra.ceph.com/r/ceph/wip-yuri2-testing-2024-04-17-0823-reef/6a7528e4aecd36b18c4b41cee6012e9f92aa7ab0/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 18.2.2-1240-g6a7528e4-1jammy [1,490 kB] 2024-04-18T14:40:05.778 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-webob. 2024-04-18T14:40:05.805 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../040-python3-webob_1%3a1.8.6-1.1_all.deb ... 2024-04-18T14:40:05.845 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-webob (1:1.8.6-1.1) ... 2024-04-18T14:40:05.953 INFO:teuthology.orchestra.run.smithi119.stdout:Get:91 https://3.chacra.ceph.com/r/ceph/wip-yuri2-testing-2024-04-17-0823-reef/6a7528e4aecd36b18c4b41cee6012e9f92aa7ab0/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 18.2.2-1240-g6a7528e4-1jammy [5,002 kB] 2024-04-18T14:40:06.053 INFO:teuthology.orchestra.run.smithi134.stdout:Get:95 https://3.chacra.ceph.com/r/ceph/wip-yuri2-testing-2024-04-17-0823-reef/6a7528e4aecd36b18c4b41cee6012e9f92aa7ab0/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 18.2.2-1240-g6a7528e4-1jammy [6,079 kB] 2024-04-18T14:40:06.315 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-waitress. 2024-04-18T14:40:06.342 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../041-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2024-04-18T14:40:06.384 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2024-04-18T14:40:06.693 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-tempita. 2024-04-18T14:40:06.719 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../042-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2024-04-18T14:40:06.759 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2024-04-18T14:40:07.045 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-paste. 2024-04-18T14:40:07.071 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../043-python3-paste_3.5.0+dfsg1-1_all.deb ... 2024-04-18T14:40:07.111 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2024-04-18T14:40:07.290 INFO:teuthology.orchestra.run.smithi119.stdout:Get:92 https://3.chacra.ceph.com/r/ceph/wip-yuri2-testing-2024-04-17-0823-reef/6a7528e4aecd36b18c4b41cee6012e9f92aa7ab0/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 18.2.2-1240-g6a7528e4-1jammy [241 kB] 2024-04-18T14:40:07.367 INFO:teuthology.orchestra.run.smithi119.stdout:Get:93 https://3.chacra.ceph.com/r/ceph/wip-yuri2-testing-2024-04-17-0823-reef/6a7528e4aecd36b18c4b41cee6012e9f92aa7ab0/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 18.2.2-1240-g6a7528e4-1jammy [130 kB] 2024-04-18T14:40:07.381 INFO:teuthology.orchestra.run.smithi119.stdout:Get:94 https://3.chacra.ceph.com/r/ceph/wip-yuri2-testing-2024-04-17-0823-reef/6a7528e4aecd36b18c4b41cee6012e9f92aa7ab0/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 18.2.2-1240-g6a7528e4-1jammy [1,490 kB] 2024-04-18T14:40:07.431 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2024-04-18T14:40:07.458 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../044-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2024-04-18T14:40:07.498 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2024-04-18T14:40:07.734 INFO:teuthology.orchestra.run.smithi134.stdout:Get:96 https://3.chacra.ceph.com/r/ceph/wip-yuri2-testing-2024-04-17-0823-reef/6a7528e4aecd36b18c4b41cee6012e9f92aa7ab0/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 18.2.2-1240-g6a7528e4-1jammy [22.3 MB] 2024-04-18T14:40:07.774 INFO:teuthology.orchestra.run.smithi119.stdout:Get:95 https://3.chacra.ceph.com/r/ceph/wip-yuri2-testing-2024-04-17-0823-reef/6a7528e4aecd36b18c4b41cee6012e9f92aa7ab0/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 18.2.2-1240-g6a7528e4-1jammy [6,079 kB] 2024-04-18T14:40:07.800 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-pastedeploy. 2024-04-18T14:40:07.827 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../045-python3-pastedeploy_2.1.1-1_all.deb ... 2024-04-18T14:40:07.867 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2024-04-18T14:40:08.162 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-webtest. 2024-04-18T14:40:08.188 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../046-python3-webtest_2.0.35-1_all.deb ... 2024-04-18T14:40:08.220 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-webtest (2.0.35-1) ... 2024-04-18T14:40:08.489 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-pecan. 2024-04-18T14:40:08.516 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../047-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2024-04-18T14:40:08.556 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2024-04-18T14:40:08.902 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-certifi. 2024-04-18T14:40:08.929 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../048-python3-certifi_2020.6.20-1_all.deb ... 2024-04-18T14:40:08.969 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2024-04-18T14:40:09.184 INFO:teuthology.orchestra.run.smithi086.stdout:Get:106 https://3.chacra.ceph.com/r/ceph/wip-yuri2-testing-2024-04-17-0823-reef/6a7528e4aecd36b18c4b41cee6012e9f92aa7ab0/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 18.2.2-1240-g6a7528e4-1jammy [121 kB] 2024-04-18T14:40:09.186 INFO:teuthology.orchestra.run.smithi086.stdout:Get:107 https://3.chacra.ceph.com/r/ceph/wip-yuri2-testing-2024-04-17-0823-reef/6a7528e4aecd36b18c4b41cee6012e9f92aa7ab0/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 18.2.2-1240-g6a7528e4-1jammy [38.3 kB] 2024-04-18T14:40:09.187 INFO:teuthology.orchestra.run.smithi086.stdout:Get:108 https://3.chacra.ceph.com/r/ceph/wip-yuri2-testing-2024-04-17-0823-reef/6a7528e4aecd36b18c4b41cee6012e9f92aa7ab0/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 18.2.2-1240-g6a7528e4-1jammy [11.6 MB] 2024-04-18T14:40:09.322 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-idna. 2024-04-18T14:40:09.348 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../049-python3-idna_3.3-1_all.deb ... 2024-04-18T14:40:09.358 INFO:teuthology.orchestra.run.smithi119.stdout:Get:96 https://3.chacra.ceph.com/r/ceph/wip-yuri2-testing-2024-04-17-0823-reef/6a7528e4aecd36b18c4b41cee6012e9f92aa7ab0/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 18.2.2-1240-g6a7528e4-1jammy [22.3 MB] 2024-04-18T14:40:09.396 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-idna (3.3-1) ... 2024-04-18T14:40:09.708 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-urllib3. 2024-04-18T14:40:09.735 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../050-python3-urllib3_1.26.5-1~exp1ubuntu0.1_all.deb ... 2024-04-18T14:40:09.774 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-04-18T14:40:10.102 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-requests. 2024-04-18T14:40:10.129 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../051-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2024-04-18T14:40:10.169 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-04-18T14:40:10.447 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-werkzeug. 2024-04-18T14:40:10.474 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../052-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.1_all.deb ... 2024-04-18T14:40:10.505 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2024-04-18T14:40:10.783 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2024-04-18T14:40:10.798 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../053-ceph-mgr-modules-core_18.2.2-1240-g6a7528e4-1jammy_all.deb ... 2024-04-18T14:40:10.841 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking ceph-mgr-modules-core (18.2.2-1240-g6a7528e4-1jammy) ... 2024-04-18T14:40:11.129 INFO:teuthology.orchestra.run.smithi086.stdout:Get:109 https://3.chacra.ceph.com/r/ceph/wip-yuri2-testing-2024-04-17-0823-reef/6a7528e4aecd36b18c4b41cee6012e9f92aa7ab0/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 18.2.2-1240-g6a7528e4-1jammy [93.1 kB] 2024-04-18T14:40:11.221 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2024-04-18T14:40:11.248 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../054-libsqlite3-mod-ceph_18.2.2-1240-g6a7528e4-1jammy_amd64.deb ... 2024-04-18T14:40:11.287 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking libsqlite3-mod-ceph (18.2.2-1240-g6a7528e4-1jammy) ... 2024-04-18T14:40:11.598 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-bcrypt. 2024-04-18T14:40:11.625 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../055-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2024-04-18T14:40:11.665 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2024-04-18T14:40:11.684 INFO:teuthology.orchestra.run.smithi086.stdout:Fetched 162 MB in 31s (5,192 kB/s) 2024-04-18T14:40:11.822 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package libfmt8:amd64. 2024-04-18T14:40:11.921 INFO:teuthology.orchestra.run.smithi086.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 165995 files and directories currently installed.) 2024-04-18T14:40:11.927 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../000-libfmt8_8.1.1+ds1-2_amd64.deb ... 2024-04-18T14:40:12.013 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking libfmt8:amd64 (8.1.1+ds1-2) ... 2024-04-18T14:40:12.277 INFO:teuthology.orchestra.run.smithi134.stdout:Get:97 https://3.chacra.ceph.com/r/ceph/wip-yuri2-testing-2024-04-17-0823-reef/6a7528e4aecd36b18c4b41cee6012e9f92aa7ab0/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 18.2.2-1240-g6a7528e4-1jammy [14.1 kB] 2024-04-18T14:40:12.278 INFO:teuthology.orchestra.run.smithi134.stdout:Get:98 https://3.chacra.ceph.com/r/ceph/wip-yuri2-testing-2024-04-17-0823-reef/6a7528e4aecd36b18c4b41cee6012e9f92aa7ab0/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 18.2.2-1240-g6a7528e4-1jammy [831 kB] 2024-04-18T14:40:12.340 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2024-04-18T14:40:12.357 INFO:teuthology.orchestra.run.smithi134.stdout:Get:99 https://3.chacra.ceph.com/r/ceph/wip-yuri2-testing-2024-04-17-0823-reef/6a7528e4aecd36b18c4b41cee6012e9f92aa7ab0/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 18.2.2-1240-g6a7528e4-1jammy [2,153 kB] 2024-04-18T14:40:12.366 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../001-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2024-04-18T14:40:12.416 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-04-18T14:40:12.515 INFO:teuthology.orchestra.run.smithi134.stdout:Get:100 https://3.chacra.ceph.com/r/ceph/wip-yuri2-testing-2024-04-17-0823-reef/6a7528e4aecd36b18c4b41cee6012e9f92aa7ab0/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 18.2.2-1240-g6a7528e4-1jammy [238 kB] 2024-04-18T14:40:12.520 INFO:teuthology.orchestra.run.smithi134.stdout:Get:101 https://3.chacra.ceph.com/r/ceph/wip-yuri2-testing-2024-04-17-0823-reef/6a7528e4aecd36b18c4b41cee6012e9f92aa7ab0/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 18.2.2-1240-g6a7528e4-1jammy [144 kB] 2024-04-18T14:40:12.523 INFO:teuthology.orchestra.run.smithi134.stdout:Get:102 https://3.chacra.ceph.com/r/ceph/wip-yuri2-testing-2024-04-17-0823-reef/6a7528e4aecd36b18c4b41cee6012e9f92aa7ab0/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 18.2.2-1240-g6a7528e4-1jammy [2,237 kB] 2024-04-18T14:40:12.684 INFO:teuthology.orchestra.run.smithi134.stdout:Get:103 https://3.chacra.ceph.com/r/ceph/wip-yuri2-testing-2024-04-17-0823-reef/6a7528e4aecd36b18c4b41cee6012e9f92aa7ab0/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 18.2.2-1240-g6a7528e4-1jammy [8,625 kB] 2024-04-18T14:40:12.719 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2024-04-18T14:40:12.745 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../002-libdouble-conversion3_3.1.7-4_amd64.deb ... 2024-04-18T14:40:12.777 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2024-04-18T14:40:12.802 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-openssl. 2024-04-18T14:40:12.829 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../056-python3-openssl_21.0.0-1_all.deb ... 2024-04-18T14:40:12.838 INFO:teuthology.orchestra.run.smithi119.stdout:Get:97 https://3.chacra.ceph.com/r/ceph/wip-yuri2-testing-2024-04-17-0823-reef/6a7528e4aecd36b18c4b41cee6012e9f92aa7ab0/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 18.2.2-1240-g6a7528e4-1jammy [14.1 kB] 2024-04-18T14:40:12.865 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-openssl (21.0.0-1) ... 2024-04-18T14:40:12.866 INFO:teuthology.orchestra.run.smithi119.stdout:Get:98 https://3.chacra.ceph.com/r/ceph/wip-yuri2-testing-2024-04-17-0823-reef/6a7528e4aecd36b18c4b41cee6012e9f92aa7ab0/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 18.2.2-1240-g6a7528e4-1jammy [831 kB] 2024-04-18T14:40:12.866 INFO:teuthology.orchestra.run.smithi119.stdout:Get:99 https://3.chacra.ceph.com/r/ceph/wip-yuri2-testing-2024-04-17-0823-reef/6a7528e4aecd36b18c4b41cee6012e9f92aa7ab0/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 18.2.2-1240-g6a7528e4-1jammy [2,153 kB] 2024-04-18T14:40:13.050 INFO:teuthology.orchestra.run.smithi119.stdout:Get:100 https://3.chacra.ceph.com/r/ceph/wip-yuri2-testing-2024-04-17-0823-reef/6a7528e4aecd36b18c4b41cee6012e9f92aa7ab0/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 18.2.2-1240-g6a7528e4-1jammy [238 kB] 2024-04-18T14:40:13.083 INFO:teuthology.orchestra.run.smithi119.stdout:Get:101 https://3.chacra.ceph.com/r/ceph/wip-yuri2-testing-2024-04-17-0823-reef/6a7528e4aecd36b18c4b41cee6012e9f92aa7ab0/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 18.2.2-1240-g6a7528e4-1jammy [144 kB] 2024-04-18T14:40:13.088 INFO:teuthology.orchestra.run.smithi119.stdout:Get:102 https://3.chacra.ceph.com/r/ceph/wip-yuri2-testing-2024-04-17-0823-reef/6a7528e4aecd36b18c4b41cee6012e9f92aa7ab0/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 18.2.2-1240-g6a7528e4-1jammy [2,237 kB] 2024-04-18T14:40:13.179 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package ceph-mgr. 2024-04-18T14:40:13.206 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../057-ceph-mgr_18.2.2-1240-g6a7528e4-1jammy_amd64.deb ... 2024-04-18T14:40:13.246 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking ceph-mgr (18.2.2-1240-g6a7528e4-1jammy) ... 2024-04-18T14:40:13.287 INFO:teuthology.orchestra.run.smithi119.stdout:Get:103 https://3.chacra.ceph.com/r/ceph/wip-yuri2-testing-2024-04-17-0823-reef/6a7528e4aecd36b18c4b41cee6012e9f92aa7ab0/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 18.2.2-1240-g6a7528e4-1jammy [8,625 kB] 2024-04-18T14:40:13.381 INFO:teuthology.orchestra.run.smithi134.stdout:Get:104 https://3.chacra.ceph.com/r/ceph/wip-yuri2-testing-2024-04-17-0823-reef/6a7528e4aecd36b18c4b41cee6012e9f92aa7ab0/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 18.2.2-1240-g6a7528e4-1jammy [14.3 kB] 2024-04-18T14:40:13.382 INFO:teuthology.orchestra.run.smithi134.stdout:Get:105 https://3.chacra.ceph.com/r/ceph/wip-yuri2-testing-2024-04-17-0823-reef/6a7528e4aecd36b18c4b41cee6012e9f92aa7ab0/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 18.2.2-1240-g6a7528e4-1jammy [42.6 MB] 2024-04-18T14:40:13.635 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package ceph-mon. 2024-04-18T14:40:13.661 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../058-ceph-mon_18.2.2-1240-g6a7528e4-1jammy_amd64.deb ... 2024-04-18T14:40:13.701 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking ceph-mon (18.2.2-1240-g6a7528e4-1jammy) ... 2024-04-18T14:40:13.855 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2024-04-18T14:40:13.882 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../003-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2024-04-18T14:40:13.922 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-04-18T14:40:13.948 INFO:teuthology.orchestra.run.smithi119.stdout:Get:104 https://3.chacra.ceph.com/r/ceph/wip-yuri2-testing-2024-04-17-0823-reef/6a7528e4aecd36b18c4b41cee6012e9f92aa7ab0/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 18.2.2-1240-g6a7528e4-1jammy [14.3 kB] 2024-04-18T14:40:13.948 INFO:teuthology.orchestra.run.smithi119.stdout:Get:105 https://3.chacra.ceph.com/r/ceph/wip-yuri2-testing-2024-04-17-0823-reef/6a7528e4aecd36b18c4b41cee6012e9f92aa7ab0/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 18.2.2-1240-g6a7528e4-1jammy [42.6 MB] 2024-04-18T14:40:14.237 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package ceph-osd. 2024-04-18T14:40:14.253 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../059-ceph-osd_18.2.2-1240-g6a7528e4-1jammy_amd64.deb ... 2024-04-18T14:40:14.296 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking ceph-osd (18.2.2-1240-g6a7528e4-1jammy) ... 2024-04-18T14:40:14.317 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package libqt5core5a:amd64. 2024-04-18T14:40:14.343 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../004-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-04-18T14:40:14.392 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-18T14:40:14.820 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2024-04-18T14:40:14.846 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../005-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-04-18T14:40:14.887 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-18T14:40:15.223 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package libqt5network5:amd64. 2024-04-18T14:40:15.249 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../006-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-04-18T14:40:15.290 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-18T14:40:15.358 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package ceph. 2024-04-18T14:40:15.384 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../060-ceph_18.2.2-1240-g6a7528e4-1jammy_amd64.deb ... 2024-04-18T14:40:15.424 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking ceph (18.2.2-1240-g6a7528e4-1jammy) ... 2024-04-18T14:40:15.594 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2024-04-18T14:40:15.619 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../007-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2024-04-18T14:40:15.659 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-04-18T14:40:15.743 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package ceph-fuse. 2024-04-18T14:40:15.770 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../061-ceph-fuse_18.2.2-1240-g6a7528e4-1jammy_amd64.deb ... 2024-04-18T14:40:15.810 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking ceph-fuse (18.2.2-1240-g6a7528e4-1jammy) ... 2024-04-18T14:40:15.970 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package librados2. 2024-04-18T14:40:15.997 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../008-librados2_18.2.2-1240-g6a7528e4-1jammy_amd64.deb ... 2024-04-18T14:40:16.037 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking librados2 (18.2.2-1240-g6a7528e4-1jammy) ... 2024-04-18T14:40:16.138 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package ceph-mds. 2024-04-18T14:40:16.165 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../062-ceph-mds_18.2.2-1240-g6a7528e4-1jammy_amd64.deb ... 2024-04-18T14:40:16.196 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking ceph-mds (18.2.2-1240-g6a7528e4-1jammy) ... 2024-04-18T14:40:16.441 INFO:teuthology.orchestra.run.smithi134.stdout:Get:106 https://3.chacra.ceph.com/r/ceph/wip-yuri2-testing-2024-04-17-0823-reef/6a7528e4aecd36b18c4b41cee6012e9f92aa7ab0/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 18.2.2-1240-g6a7528e4-1jammy [121 kB] 2024-04-18T14:40:16.443 INFO:teuthology.orchestra.run.smithi134.stdout:Get:107 https://3.chacra.ceph.com/r/ceph/wip-yuri2-testing-2024-04-17-0823-reef/6a7528e4aecd36b18c4b41cee6012e9f92aa7ab0/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 18.2.2-1240-g6a7528e4-1jammy [38.3 kB] 2024-04-18T14:40:16.445 INFO:teuthology.orchestra.run.smithi134.stdout:Get:108 https://3.chacra.ceph.com/r/ceph/wip-yuri2-testing-2024-04-17-0823-reef/6a7528e4aecd36b18c4b41cee6012e9f92aa7ab0/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 18.2.2-1240-g6a7528e4-1jammy [11.6 MB] 2024-04-18T14:40:16.498 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package librbd1. 2024-04-18T14:40:16.524 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../009-librbd1_18.2.2-1240-g6a7528e4-1jammy_amd64.deb ... 2024-04-18T14:40:16.565 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking librbd1 (18.2.2-1240-g6a7528e4-1jammy) ... 2024-04-18T14:40:16.724 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package cephadm. 2024-04-18T14:40:16.751 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../063-cephadm_18.2.2-1240-g6a7528e4-1jammy_amd64.deb ... 2024-04-18T14:40:16.824 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking cephadm (18.2.2-1240-g6a7528e4-1jammy) ... 2024-04-18T14:40:16.944 INFO:teuthology.orchestra.run.smithi119.stdout:Get:106 https://3.chacra.ceph.com/r/ceph/wip-yuri2-testing-2024-04-17-0823-reef/6a7528e4aecd36b18c4b41cee6012e9f92aa7ab0/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 18.2.2-1240-g6a7528e4-1jammy [121 kB] 2024-04-18T14:40:16.947 INFO:teuthology.orchestra.run.smithi119.stdout:Get:107 https://3.chacra.ceph.com/r/ceph/wip-yuri2-testing-2024-04-17-0823-reef/6a7528e4aecd36b18c4b41cee6012e9f92aa7ab0/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 18.2.2-1240-g6a7528e4-1jammy [38.3 kB] 2024-04-18T14:40:16.948 INFO:teuthology.orchestra.run.smithi119.stdout:Get:108 https://3.chacra.ceph.com/r/ceph/wip-yuri2-testing-2024-04-17-0823-reef/6a7528e4aecd36b18c4b41cee6012e9f92aa7ab0/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 18.2.2-1240-g6a7528e4-1jammy [11.6 MB] 2024-04-18T14:40:16.970 INFO:teuthology.orchestra.run.smithi134.stdout:Get:109 https://3.chacra.ceph.com/r/ceph/wip-yuri2-testing-2024-04-17-0823-reef/6a7528e4aecd36b18c4b41cee6012e9f92aa7ab0/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 18.2.2-1240-g6a7528e4-1jammy [93.1 kB] 2024-04-18T14:40:17.126 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package libcephfs2. 2024-04-18T14:40:17.135 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-asyncssh. 2024-04-18T14:40:17.152 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../010-libcephfs2_18.2.2-1240-g6a7528e4-1jammy_amd64.deb ... 2024-04-18T14:40:17.162 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../064-python3-asyncssh_2.5.0-1_all.deb ... 2024-04-18T14:40:17.193 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking libcephfs2 (18.2.2-1240-g6a7528e4-1jammy) ... 2024-04-18T14:40:17.202 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2024-04-18T14:40:17.326 INFO:teuthology.orchestra.run.smithi119.stdout:Get:109 https://3.chacra.ceph.com/r/ceph/wip-yuri2-testing-2024-04-17-0823-reef/6a7528e4aecd36b18c4b41cee6012e9f92aa7ab0/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 18.2.2-1240-g6a7528e4-1jammy [93.1 kB] 2024-04-18T14:40:17.436 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package python3-rados. 2024-04-18T14:40:17.452 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../011-python3-rados_18.2.2-1240-g6a7528e4-1jammy_amd64.deb ... 2024-04-18T14:40:17.495 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking python3-rados (18.2.2-1240-g6a7528e4-1jammy) ... 2024-04-18T14:40:17.513 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python-babel-localedata. 2024-04-18T14:40:17.528 INFO:teuthology.orchestra.run.smithi134.stdout:Fetched 162 MB in 37s (4,388 kB/s) 2024-04-18T14:40:17.539 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../065-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2024-04-18T14:40:17.579 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-04-18T14:40:17.644 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package libfmt8:amd64. 2024-04-18T14:40:17.740 INFO:teuthology.orchestra.run.smithi134.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 165995 files and directories currently installed.) 2024-04-18T14:40:17.746 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../000-libfmt8_8.1.1+ds1-2_amd64.deb ... 2024-04-18T14:40:17.806 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package python3-ceph-argparse. 2024-04-18T14:40:17.817 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking libfmt8:amd64 (8.1.1+ds1-2) ... 2024-04-18T14:40:17.832 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../012-python3-ceph-argparse_18.2.2-1240-g6a7528e4-1jammy_all.deb ... 2024-04-18T14:40:17.872 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking python3-ceph-argparse (18.2.2-1240-g6a7528e4-1jammy) ... 2024-04-18T14:40:17.895 INFO:teuthology.orchestra.run.smithi119.stdout:Fetched 162 MB in 37s (4,348 kB/s) 2024-04-18T14:40:18.007 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package libfmt8:amd64. 2024-04-18T14:40:18.091 INFO:teuthology.orchestra.run.smithi119.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 165995 files and directories currently installed.) 2024-04-18T14:40:18.097 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../000-libfmt8_8.1.1+ds1-2_amd64.deb ... 2024-04-18T14:40:18.145 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2024-04-18T14:40:18.159 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package python3-cephfs. 2024-04-18T14:40:18.171 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../001-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2024-04-18T14:40:18.181 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking libfmt8:amd64 (8.1.1+ds1-2) ... 2024-04-18T14:40:18.185 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../013-python3-cephfs_18.2.2-1240-g6a7528e4-1jammy_amd64.deb ... 2024-04-18T14:40:18.211 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-04-18T14:40:18.225 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking python3-cephfs (18.2.2-1240-g6a7528e4-1jammy) ... 2024-04-18T14:40:18.509 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2024-04-18T14:40:18.511 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package python3-ceph-common. 2024-04-18T14:40:18.536 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../001-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2024-04-18T14:40:18.537 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../014-python3-ceph-common_18.2.2-1240-g6a7528e4-1jammy_all.deb ... 2024-04-18T14:40:18.540 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2024-04-18T14:40:18.566 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../002-libdouble-conversion3_3.1.7-4_amd64.deb ... 2024-04-18T14:40:18.576 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-04-18T14:40:18.577 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking python3-ceph-common (18.2.2-1240-g6a7528e4-1jammy) ... 2024-04-18T14:40:18.584 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-babel. 2024-04-18T14:40:18.606 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2024-04-18T14:40:18.611 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../066-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2024-04-18T14:40:18.642 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2024-04-18T14:40:18.864 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package python3-wcwidth. 2024-04-18T14:40:18.890 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../015-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2024-04-18T14:40:18.909 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2024-04-18T14:40:18.913 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2024-04-18T14:40:18.921 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-jinja2. 2024-04-18T14:40:18.922 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2024-04-18T14:40:18.935 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../003-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2024-04-18T14:40:18.939 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../002-libdouble-conversion3_3.1.7-4_amd64.deb ... 2024-04-18T14:40:18.947 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../067-python3-jinja2_3.0.3-1ubuntu0.1_all.deb ... 2024-04-18T14:40:18.976 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-04-18T14:40:18.978 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-jinja2 (3.0.3-1ubuntu0.1) ... 2024-04-18T14:40:18.979 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2024-04-18T14:40:19.225 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package python3-prettytable. 2024-04-18T14:40:19.241 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2024-04-18T14:40:19.251 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../016-python3-prettytable_2.5.0-2_all.deb ... 2024-04-18T14:40:19.267 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../003-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2024-04-18T14:40:19.282 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2024-04-18T14:40:19.291 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2024-04-18T14:40:19.307 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-04-18T14:40:19.309 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../068-ceph-mgr-cephadm_18.2.2-1240-g6a7528e4-1jammy_all.deb ... 2024-04-18T14:40:19.349 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking ceph-mgr-cephadm (18.2.2-1240-g6a7528e4-1jammy) ... 2024-04-18T14:40:19.396 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package libqt5core5a:amd64. 2024-04-18T14:40:19.422 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../004-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-04-18T14:40:19.471 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-18T14:40:19.552 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package python3-rbd. 2024-04-18T14:40:19.567 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../017-python3-rbd_18.2.2-1240-g6a7528e4-1jammy_amd64.deb ... 2024-04-18T14:40:19.610 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking python3-rbd (18.2.2-1240-g6a7528e4-1jammy) ... 2024-04-18T14:40:19.635 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-pluggy. 2024-04-18T14:40:19.662 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../069-python3-pluggy_0.13.0-7.1_all.deb ... 2024-04-18T14:40:19.702 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2024-04-18T14:40:19.736 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package libqt5core5a:amd64. 2024-04-18T14:40:19.762 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../004-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-04-18T14:40:19.810 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-18T14:40:19.866 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2024-04-18T14:40:19.881 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../005-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-04-18T14:40:19.916 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-18T14:40:19.955 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package librdkafka1:amd64. 2024-04-18T14:40:19.982 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../018-librdkafka1_1.8.0-1build1_amd64.deb ... 2024-04-18T14:40:20.022 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2024-04-18T14:40:20.038 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-py. 2024-04-18T14:40:20.065 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../070-python3-py_1.10.0-1_all.deb ... 2024-04-18T14:40:20.104 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-py (1.10.0-1) ... 2024-04-18T14:40:20.214 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2024-04-18T14:40:20.240 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../005-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-04-18T14:40:20.244 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package libqt5network5:amd64. 2024-04-18T14:40:20.270 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../006-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-04-18T14:40:20.285 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-18T14:40:20.310 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-18T14:40:20.327 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package librgw2. 2024-04-18T14:40:20.353 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../019-librgw2_18.2.2-1240-g6a7528e4-1jammy_amd64.deb ... 2024-04-18T14:40:20.393 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking librgw2 (18.2.2-1240-g6a7528e4-1jammy) ... 2024-04-18T14:40:20.416 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-iniconfig. 2024-04-18T14:40:20.443 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../071-python3-iniconfig_1.1.1-2_all.deb ... 2024-04-18T14:40:20.483 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2024-04-18T14:40:20.592 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package libqt5network5:amd64. 2024-04-18T14:40:20.618 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../006-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-04-18T14:40:20.658 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-18T14:40:20.672 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2024-04-18T14:40:20.698 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../007-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2024-04-18T14:40:20.738 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-04-18T14:40:20.786 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-toml. 2024-04-18T14:40:20.812 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../072-python3-toml_0.10.2-1_all.deb ... 2024-04-18T14:40:20.852 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-toml (0.10.2-1) ... 2024-04-18T14:40:20.887 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package python3-rgw. 2024-04-18T14:40:20.902 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../020-python3-rgw_18.2.2-1240-g6a7528e4-1jammy_amd64.deb ... 2024-04-18T14:40:20.945 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking python3-rgw (18.2.2-1240-g6a7528e4-1jammy) ... 2024-04-18T14:40:20.995 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2024-04-18T14:40:21.021 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../007-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2024-04-18T14:40:21.049 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package librados2. 2024-04-18T14:40:21.061 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-04-18T14:40:21.065 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../008-librados2_18.2.2-1240-g6a7528e4-1jammy_amd64.deb ... 2024-04-18T14:40:21.099 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking librados2 (18.2.2-1240-g6a7528e4-1jammy) ... 2024-04-18T14:40:21.113 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-pytest. 2024-04-18T14:40:21.140 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../073-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2024-04-18T14:40:21.171 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2024-04-18T14:40:21.281 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package liboath0:amd64. 2024-04-18T14:40:21.307 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../021-liboath0_2.6.7-3build1_amd64.deb ... 2024-04-18T14:40:21.348 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2024-04-18T14:40:21.406 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package librados2. 2024-04-18T14:40:21.432 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../008-librados2_18.2.2-1240-g6a7528e4-1jammy_amd64.deb ... 2024-04-18T14:40:21.472 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking librados2 (18.2.2-1240-g6a7528e4-1jammy) ... 2024-04-18T14:40:21.494 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package librbd1. 2024-04-18T14:40:21.509 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../009-librbd1_18.2.2-1240-g6a7528e4-1jammy_amd64.deb ... 2024-04-18T14:40:21.525 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-repoze.lru. 2024-04-18T14:40:21.552 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../074-python3-repoze.lru_0.7-2_all.deb ... 2024-04-18T14:40:21.591 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2024-04-18T14:40:21.617 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package libradosstriper1. 2024-04-18T14:40:21.632 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../022-libradosstriper1_18.2.2-1240-g6a7528e4-1jammy_amd64.deb ... 2024-04-18T14:40:21.667 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking libradosstriper1 (18.2.2-1240-g6a7528e4-1jammy) ... 2024-04-18T14:40:21.710 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking librbd1 (18.2.2-1240-g6a7528e4-1jammy) ... 2024-04-18T14:40:21.861 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-routes. 2024-04-18T14:40:21.877 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../075-python3-routes_2.5.1-1ubuntu1_all.deb ... 2024-04-18T14:40:21.883 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package librbd1. 2024-04-18T14:40:21.899 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../009-librbd1_18.2.2-1240-g6a7528e4-1jammy_amd64.deb ... 2024-04-18T14:40:21.910 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2024-04-18T14:40:21.934 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking librbd1 (18.2.2-1240-g6a7528e4-1jammy) ... 2024-04-18T14:40:22.120 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package ceph-common. 2024-04-18T14:40:22.138 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package libcephfs2. 2024-04-18T14:40:22.147 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../023-ceph-common_18.2.2-1240-g6a7528e4-1jammy_amd64.deb ... 2024-04-18T14:40:22.165 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../010-libcephfs2_18.2.2-1240-g6a7528e4-1jammy_amd64.deb ... 2024-04-18T14:40:22.186 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking ceph-common (18.2.2-1240-g6a7528e4-1jammy) ... 2024-04-18T14:40:22.205 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking libcephfs2 (18.2.2-1240-g6a7528e4-1jammy) ... 2024-04-18T14:40:22.249 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2024-04-18T14:40:22.275 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../076-ceph-mgr-dashboard_18.2.2-1240-g6a7528e4-1jammy_all.deb ... 2024-04-18T14:40:22.314 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking ceph-mgr-dashboard (18.2.2-1240-g6a7528e4-1jammy) ... 2024-04-18T14:40:22.319 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package libcephfs2. 2024-04-18T14:40:22.346 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../010-libcephfs2_18.2.2-1240-g6a7528e4-1jammy_amd64.deb ... 2024-04-18T14:40:22.378 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking libcephfs2 (18.2.2-1240-g6a7528e4-1jammy) ... 2024-04-18T14:40:22.474 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-rados. 2024-04-18T14:40:22.489 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../011-python3-rados_18.2.2-1240-g6a7528e4-1jammy_amd64.deb ... 2024-04-18T14:40:22.532 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-rados (18.2.2-1240-g6a7528e4-1jammy) ... 2024-04-18T14:40:22.791 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-rados. 2024-04-18T14:40:22.817 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../011-python3-rados_18.2.2-1240-g6a7528e4-1jammy_amd64.deb ... 2024-04-18T14:40:22.844 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-ceph-argparse. 2024-04-18T14:40:22.857 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-rados (18.2.2-1240-g6a7528e4-1jammy) ... 2024-04-18T14:40:22.869 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../012-python3-ceph-argparse_18.2.2-1240-g6a7528e4-1jammy_all.deb ... 2024-04-18T14:40:22.910 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-ceph-argparse (18.2.2-1240-g6a7528e4-1jammy) ... 2024-04-18T14:40:23.145 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-cephfs. 2024-04-18T14:40:23.161 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../013-python3-cephfs_18.2.2-1240-g6a7528e4-1jammy_amd64.deb ... 2024-04-18T14:40:23.177 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-ceph-argparse. 2024-04-18T14:40:23.195 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-cephfs (18.2.2-1240-g6a7528e4-1jammy) ... 2024-04-18T14:40:23.203 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../012-python3-ceph-argparse_18.2.2-1240-g6a7528e4-1jammy_all.deb ... 2024-04-18T14:40:23.243 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-ceph-argparse (18.2.2-1240-g6a7528e4-1jammy) ... 2024-04-18T14:40:23.467 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package ceph-base. 2024-04-18T14:40:23.479 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-cephfs. 2024-04-18T14:40:23.493 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../024-ceph-base_18.2.2-1240-g6a7528e4-1jammy_amd64.deb ... 2024-04-18T14:40:23.494 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../013-python3-cephfs_18.2.2-1240-g6a7528e4-1jammy_amd64.deb ... 2024-04-18T14:40:23.506 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-ceph-common. 2024-04-18T14:40:23.529 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-cephfs (18.2.2-1240-g6a7528e4-1jammy) ... 2024-04-18T14:40:23.533 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../014-python3-ceph-common_18.2.2-1240-g6a7528e4-1jammy_all.deb ... 2024-04-18T14:40:23.543 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking ceph-base (18.2.2-1240-g6a7528e4-1jammy) ... 2024-04-18T14:40:23.573 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-ceph-common (18.2.2-1240-g6a7528e4-1jammy) ... 2024-04-18T14:40:23.711 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2024-04-18T14:40:23.738 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../077-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2024-04-18T14:40:23.777 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-04-18T14:40:23.832 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-ceph-common. 2024-04-18T14:40:23.859 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../014-python3-ceph-common_18.2.2-1240-g6a7528e4-1jammy_all.deb ... 2024-04-18T14:40:23.899 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-ceph-common (18.2.2-1240-g6a7528e4-1jammy) ... 2024-04-18T14:40:23.910 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-wcwidth. 2024-04-18T14:40:23.936 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../015-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2024-04-18T14:40:23.976 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2024-04-18T14:40:24.088 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package python3-jaraco.functools. 2024-04-18T14:40:24.114 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../025-python3-jaraco.functools_3.4.0-2_all.deb ... 2024-04-18T14:40:24.154 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2024-04-18T14:40:24.218 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-wcwidth. 2024-04-18T14:40:24.245 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../015-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2024-04-18T14:40:24.256 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-joblib. 2024-04-18T14:40:24.283 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../078-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2024-04-18T14:40:24.285 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2024-04-18T14:40:24.304 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-prettytable. 2024-04-18T14:40:24.322 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2024-04-18T14:40:24.330 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../016-python3-prettytable_2.5.0-2_all.deb ... 2024-04-18T14:40:24.370 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2024-04-18T14:40:24.440 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package python3-cheroot. 2024-04-18T14:40:24.466 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../026-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2024-04-18T14:40:24.506 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-04-18T14:40:24.597 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-prettytable. 2024-04-18T14:40:24.606 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-rbd. 2024-04-18T14:40:24.621 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../017-python3-rbd_18.2.2-1240-g6a7528e4-1jammy_amd64.deb ... 2024-04-18T14:40:24.622 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../016-python3-prettytable_2.5.0-2_all.deb ... 2024-04-18T14:40:24.656 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-rbd (18.2.2-1240-g6a7528e4-1jammy) ... 2024-04-18T14:40:24.659 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-threadpoolctl. 2024-04-18T14:40:24.662 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2024-04-18T14:40:24.687 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../079-python3-threadpoolctl_3.1.0-1_all.deb ... 2024-04-18T14:40:24.726 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2024-04-18T14:40:24.826 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package python3-jaraco.classes. 2024-04-18T14:40:24.852 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../027-python3-jaraco.classes_3.2.1-3_all.deb ... 2024-04-18T14:40:24.882 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-rbd. 2024-04-18T14:40:24.892 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2024-04-18T14:40:24.897 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../017-python3-rbd_18.2.2-1240-g6a7528e4-1jammy_amd64.deb ... 2024-04-18T14:40:24.932 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-rbd (18.2.2-1240-g6a7528e4-1jammy) ... 2024-04-18T14:40:24.994 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package librdkafka1:amd64. 2024-04-18T14:40:25.021 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../018-librdkafka1_1.8.0-1build1_amd64.deb ... 2024-04-18T14:40:25.029 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-sklearn. 2024-04-18T14:40:25.056 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../080-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2024-04-18T14:40:25.061 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2024-04-18T14:40:25.095 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2024-04-18T14:40:25.204 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package python3-jaraco.text. 2024-04-18T14:40:25.230 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../028-python3-jaraco.text_3.6.0-2_all.deb ... 2024-04-18T14:40:25.252 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package librdkafka1:amd64. 2024-04-18T14:40:25.270 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2024-04-18T14:40:25.278 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../018-librdkafka1_1.8.0-1build1_amd64.deb ... 2024-04-18T14:40:25.318 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2024-04-18T14:40:25.380 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package librgw2. 2024-04-18T14:40:25.407 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../019-librgw2_18.2.2-1240-g6a7528e4-1jammy_amd64.deb ... 2024-04-18T14:40:25.447 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking librgw2 (18.2.2-1240-g6a7528e4-1jammy) ... 2024-04-18T14:40:25.531 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package python3-jaraco.collections. 2024-04-18T14:40:25.558 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../029-python3-jaraco.collections_3.4.0-2_all.deb ... 2024-04-18T14:40:25.590 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2024-04-18T14:40:25.663 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package librgw2. 2024-04-18T14:40:25.689 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../019-librgw2_18.2.2-1240-g6a7528e4-1jammy_amd64.deb ... 2024-04-18T14:40:25.729 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking librgw2 (18.2.2-1240-g6a7528e4-1jammy) ... 2024-04-18T14:40:25.762 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2024-04-18T14:40:25.789 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../081-ceph-mgr-diskprediction-local_18.2.2-1240-g6a7528e4-1jammy_all.deb ... 2024-04-18T14:40:25.828 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking ceph-mgr-diskprediction-local (18.2.2-1240-g6a7528e4-1jammy) ... 2024-04-18T14:40:25.900 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package python3-tempora. 2024-04-18T14:40:25.924 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-rgw. 2024-04-18T14:40:25.928 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../030-python3-tempora_4.1.2-1_all.deb ... 2024-04-18T14:40:25.940 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../020-python3-rgw_18.2.2-1240-g6a7528e4-1jammy_amd64.deb ... 2024-04-18T14:40:25.967 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking python3-tempora (4.1.2-1) ... 2024-04-18T14:40:25.974 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-rgw (18.2.2-1240-g6a7528e4-1jammy) ... 2024-04-18T14:40:26.232 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-rgw. 2024-04-18T14:40:26.258 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../020-python3-rgw_18.2.2-1240-g6a7528e4-1jammy_amd64.deb ... 2024-04-18T14:40:26.278 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package python3-portend. 2024-04-18T14:40:26.298 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-rgw (18.2.2-1240-g6a7528e4-1jammy) ... 2024-04-18T14:40:26.304 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../031-python3-portend_3.0.0-1_all.deb ... 2024-04-18T14:40:26.310 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package liboath0:amd64. 2024-04-18T14:40:26.337 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../021-liboath0_2.6.7-3build1_amd64.deb ... 2024-04-18T14:40:26.345 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking python3-portend (3.0.0-1) ... 2024-04-18T14:40:26.377 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2024-04-18T14:40:26.576 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package liboath0:amd64. 2024-04-18T14:40:26.602 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../021-liboath0_2.6.7-3build1_amd64.deb ... 2024-04-18T14:40:26.631 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package python3-zc.lockfile. 2024-04-18T14:40:26.643 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2024-04-18T14:40:26.657 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../032-python3-zc.lockfile_2.0-1_all.deb ... 2024-04-18T14:40:26.697 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2024-04-18T14:40:26.705 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package libradosstriper1. 2024-04-18T14:40:26.731 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../022-libradosstriper1_18.2.2-1240-g6a7528e4-1jammy_amd64.deb ... 2024-04-18T14:40:26.739 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-cachetools. 2024-04-18T14:40:26.763 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../082-python3-cachetools_5.0.0-1_all.deb ... 2024-04-18T14:40:26.771 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking libradosstriper1 (18.2.2-1240-g6a7528e4-1jammy) ... 2024-04-18T14:40:26.797 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2024-04-18T14:40:26.945 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package libradosstriper1. 2024-04-18T14:40:26.958 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package python3-cherrypy3. 2024-04-18T14:40:26.972 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../022-libradosstriper1_18.2.2-1240-g6a7528e4-1jammy_amd64.deb ... 2024-04-18T14:40:26.985 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../033-python3-cherrypy3_18.6.1-4_all.deb ... 2024-04-18T14:40:27.012 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking libradosstriper1 (18.2.2-1240-g6a7528e4-1jammy) ... 2024-04-18T14:40:27.025 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2024-04-18T14:40:27.141 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package ceph-common. 2024-04-18T14:40:27.165 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../023-ceph-common_18.2.2-1240-g6a7528e4-1jammy_amd64.deb ... 2024-04-18T14:40:27.200 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking ceph-common (18.2.2-1240-g6a7528e4-1jammy) ... 2024-04-18T14:40:27.327 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-pyasn1. 2024-04-18T14:40:27.354 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../083-python3-pyasn1_0.4.8-1_all.deb ... 2024-04-18T14:40:27.393 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2024-04-18T14:40:27.441 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package ceph-common. 2024-04-18T14:40:27.467 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../023-ceph-common_18.2.2-1240-g6a7528e4-1jammy_amd64.deb ... 2024-04-18T14:40:27.507 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking ceph-common (18.2.2-1240-g6a7528e4-1jammy) ... 2024-04-18T14:40:27.512 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package python3-natsort. 2024-04-18T14:40:27.538 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../034-python3-natsort_8.0.2-1_all.deb ... 2024-04-18T14:40:27.578 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking python3-natsort (8.0.2-1) ... 2024-04-18T14:40:27.722 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-pyasn1-modules. 2024-04-18T14:40:27.749 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../084-python3-pyasn1-modules_0.2.1-1_all.deb ... 2024-04-18T14:40:27.788 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2024-04-18T14:40:27.839 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package python3-logutils. 2024-04-18T14:40:27.863 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../035-python3-logutils_0.3.3-8_all.deb ... 2024-04-18T14:40:27.897 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking python3-logutils (0.3.3-8) ... 2024-04-18T14:40:28.108 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-rsa. 2024-04-18T14:40:28.135 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../085-python3-rsa_4.8-1_all.deb ... 2024-04-18T14:40:28.174 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-rsa (4.8-1) ... 2024-04-18T14:40:28.175 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package python3-markupsafe. 2024-04-18T14:40:28.202 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../036-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2024-04-18T14:40:28.242 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2024-04-18T14:40:28.463 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package ceph-base. 2024-04-18T14:40:28.490 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../024-ceph-base_18.2.2-1240-g6a7528e4-1jammy_amd64.deb ... 2024-04-18T14:40:28.495 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-google-auth. 2024-04-18T14:40:28.522 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../086-python3-google-auth_1.5.1-3_all.deb ... 2024-04-18T14:40:28.536 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package python3-mako. 2024-04-18T14:40:28.539 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking ceph-base (18.2.2-1240-g6a7528e4-1jammy) ... 2024-04-18T14:40:28.561 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2024-04-18T14:40:28.563 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../037-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2024-04-18T14:40:28.603 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-04-18T14:40:28.746 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package ceph-base. 2024-04-18T14:40:28.772 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../024-ceph-base_18.2.2-1240-g6a7528e4-1jammy_amd64.deb ... 2024-04-18T14:40:28.822 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking ceph-base (18.2.2-1240-g6a7528e4-1jammy) ... 2024-04-18T14:40:28.839 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-requests-oauthlib. 2024-04-18T14:40:28.866 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../087-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2024-04-18T14:40:28.897 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-04-18T14:40:28.914 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package python3-simplegeneric. 2024-04-18T14:40:28.941 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../038-python3-simplegeneric_0.8.1-3_all.deb ... 2024-04-18T14:40:28.980 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2024-04-18T14:40:29.117 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-jaraco.functools. 2024-04-18T14:40:29.144 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../025-python3-jaraco.functools_3.4.0-2_all.deb ... 2024-04-18T14:40:29.184 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2024-04-18T14:40:29.192 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-websocket. 2024-04-18T14:40:29.220 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../088-python3-websocket_1.2.3-1_all.deb ... 2024-04-18T14:40:29.259 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-websocket (1.2.3-1) ... 2024-04-18T14:40:29.275 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package python3-singledispatch. 2024-04-18T14:40:29.301 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../039-python3-singledispatch_3.4.0.3-3_all.deb ... 2024-04-18T14:40:29.341 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2024-04-18T14:40:29.376 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-jaraco.functools. 2024-04-18T14:40:29.402 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../025-python3-jaraco.functools_3.4.0-2_all.deb ... 2024-04-18T14:40:29.434 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2024-04-18T14:40:29.487 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-cheroot. 2024-04-18T14:40:29.514 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../026-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2024-04-18T14:40:29.553 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-04-18T14:40:29.579 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-kubernetes. 2024-04-18T14:40:29.606 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../089-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2024-04-18T14:40:29.646 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2024-04-18T14:40:29.652 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package python3-webob. 2024-04-18T14:40:29.679 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../040-python3-webob_1%3a1.8.6-1.1_all.deb ... 2024-04-18T14:40:29.719 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking python3-webob (1:1.8.6-1.1) ... 2024-04-18T14:40:29.745 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-cheroot. 2024-04-18T14:40:29.771 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../026-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2024-04-18T14:40:29.812 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-04-18T14:40:29.881 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-jaraco.classes. 2024-04-18T14:40:29.897 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../027-python3-jaraco.classes_3.2.1-3_all.deb ... 2024-04-18T14:40:29.931 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2024-04-18T14:40:30.047 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package python3-waitress. 2024-04-18T14:40:30.073 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../041-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2024-04-18T14:40:30.117 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2024-04-18T14:40:30.123 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-jaraco.classes. 2024-04-18T14:40:30.149 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../027-python3-jaraco.classes_3.2.1-3_all.deb ... 2024-04-18T14:40:30.190 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2024-04-18T14:40:30.201 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-jaraco.text. 2024-04-18T14:40:30.227 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../028-python3-jaraco.text_3.6.0-2_all.deb ... 2024-04-18T14:40:30.267 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2024-04-18T14:40:30.334 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2024-04-18T14:40:30.350 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../090-ceph-mgr-k8sevents_18.2.2-1240-g6a7528e4-1jammy_all.deb ... 2024-04-18T14:40:30.392 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking ceph-mgr-k8sevents (18.2.2-1240-g6a7528e4-1jammy) ... 2024-04-18T14:40:30.424 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package python3-tempita. 2024-04-18T14:40:30.451 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../042-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2024-04-18T14:40:30.491 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2024-04-18T14:40:30.492 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-jaraco.text. 2024-04-18T14:40:30.519 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../028-python3-jaraco.text_3.6.0-2_all.deb ... 2024-04-18T14:40:30.559 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2024-04-18T14:40:30.562 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-jaraco.collections. 2024-04-18T14:40:30.588 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../029-python3-jaraco.collections_3.4.0-2_all.deb ... 2024-04-18T14:40:30.628 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2024-04-18T14:40:30.711 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package libonig5:amd64. 2024-04-18T14:40:30.739 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../091-libonig5_6.9.7.1-2build1_amd64.deb ... 2024-04-18T14:40:30.769 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2024-04-18T14:40:30.802 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package python3-paste. 2024-04-18T14:40:30.829 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../043-python3-paste_3.5.0+dfsg1-1_all.deb ... 2024-04-18T14:40:30.862 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-jaraco.collections. 2024-04-18T14:40:30.868 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2024-04-18T14:40:30.888 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../029-python3-jaraco.collections_3.4.0-2_all.deb ... 2024-04-18T14:40:30.928 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2024-04-18T14:40:30.931 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-tempora. 2024-04-18T14:40:30.957 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../030-python3-tempora_4.1.2-1_all.deb ... 2024-04-18T14:40:30.998 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-tempora (4.1.2-1) ... 2024-04-18T14:40:31.097 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package libjq1:amd64. 2024-04-18T14:40:31.125 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../092-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2024-04-18T14:40:31.165 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-04-18T14:40:31.213 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2024-04-18T14:40:31.214 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-tempora. 2024-04-18T14:40:31.240 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../044-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2024-04-18T14:40:31.241 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../030-python3-tempora_4.1.2-1_all.deb ... 2024-04-18T14:40:31.259 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-portend. 2024-04-18T14:40:31.280 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2024-04-18T14:40:31.281 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-tempora (4.1.2-1) ... 2024-04-18T14:40:31.285 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../031-python3-portend_3.0.0-1_all.deb ... 2024-04-18T14:40:31.317 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-portend (3.0.0-1) ... 2024-04-18T14:40:31.425 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package jq. 2024-04-18T14:40:31.452 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../093-jq_1.6-2.1ubuntu3_amd64.deb ... 2024-04-18T14:40:31.491 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2024-04-18T14:40:31.551 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-portend. 2024-04-18T14:40:31.577 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../031-python3-portend_3.0.0-1_all.deb ... 2024-04-18T14:40:31.582 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package python3-pastedeploy. 2024-04-18T14:40:31.609 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../045-python3-pastedeploy_2.1.1-1_all.deb ... 2024-04-18T14:40:31.611 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-zc.lockfile. 2024-04-18T14:40:31.617 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-portend (3.0.0-1) ... 2024-04-18T14:40:31.638 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../032-python3-zc.lockfile_2.0-1_all.deb ... 2024-04-18T14:40:31.649 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2024-04-18T14:40:31.678 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2024-04-18T14:40:31.753 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package socat. 2024-04-18T14:40:31.781 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../094-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2024-04-18T14:40:31.819 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2024-04-18T14:40:31.920 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-zc.lockfile. 2024-04-18T14:40:31.946 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../032-python3-zc.lockfile_2.0-1_all.deb ... 2024-04-18T14:40:31.951 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package python3-webtest. 2024-04-18T14:40:31.978 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../046-python3-webtest_2.0.35-1_all.deb ... 2024-04-18T14:40:31.981 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-cherrypy3. 2024-04-18T14:40:31.986 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2024-04-18T14:40:32.007 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../033-python3-cherrypy3_18.6.1-4_all.deb ... 2024-04-18T14:40:32.018 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking python3-webtest (2.0.35-1) ... 2024-04-18T14:40:32.105 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package xmlstarlet. 2024-04-18T14:40:32.121 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../095-xmlstarlet_1.6.1-2.1_amd64.deb ... 2024-04-18T14:40:32.155 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2024-04-18T14:40:32.197 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2024-04-18T14:40:32.290 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-cherrypy3. 2024-04-18T14:40:32.313 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package python3-pecan. 2024-04-18T14:40:32.316 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../033-python3-cherrypy3_18.6.1-4_all.deb ... 2024-04-18T14:40:32.339 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../047-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2024-04-18T14:40:32.356 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2024-04-18T14:40:32.371 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2024-04-18T14:40:32.518 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-natsort. 2024-04-18T14:40:32.526 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package ceph-test. 2024-04-18T14:40:32.544 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../034-python3-natsort_8.0.2-1_all.deb ... 2024-04-18T14:40:32.554 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../096-ceph-test_18.2.2-1240-g6a7528e4-1jammy_amd64.deb ... 2024-04-18T14:40:32.593 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking ceph-test (18.2.2-1240-g6a7528e4-1jammy) ... 2024-04-18T14:40:32.593 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-natsort (8.0.2-1) ... 2024-04-18T14:40:32.667 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package python3-certifi. 2024-04-18T14:40:32.693 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../048-python3-certifi_2020.6.20-1_all.deb ... 2024-04-18T14:40:32.718 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-natsort. 2024-04-18T14:40:32.725 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2024-04-18T14:40:32.745 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../034-python3-natsort_8.0.2-1_all.deb ... 2024-04-18T14:40:32.785 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-natsort (8.0.2-1) ... 2024-04-18T14:40:32.904 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-logutils. 2024-04-18T14:40:32.922 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../035-python3-logutils_0.3.3-8_all.deb ... 2024-04-18T14:40:32.962 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-logutils (0.3.3-8) ... 2024-04-18T14:40:33.078 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package python3-idna. 2024-04-18T14:40:33.105 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../049-python3-idna_3.3-1_all.deb ... 2024-04-18T14:40:33.130 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-logutils. 2024-04-18T14:40:33.156 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../035-python3-logutils_0.3.3-8_all.deb ... 2024-04-18T14:40:33.228 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking python3-idna (3.3-1) ... 2024-04-18T14:40:33.254 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-logutils (0.3.3-8) ... 2024-04-18T14:40:33.448 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-markupsafe. 2024-04-18T14:40:33.475 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../036-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2024-04-18T14:40:33.515 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2024-04-18T14:40:33.564 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package python3-urllib3. 2024-04-18T14:40:33.566 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-markupsafe. 2024-04-18T14:40:33.590 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../050-python3-urllib3_1.26.5-1~exp1ubuntu0.1_all.deb ... 2024-04-18T14:40:33.592 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../036-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2024-04-18T14:40:33.630 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-04-18T14:40:33.649 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2024-04-18T14:40:33.784 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-mako. 2024-04-18T14:40:33.799 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../037-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2024-04-18T14:40:33.843 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-04-18T14:40:33.927 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-mako. 2024-04-18T14:40:33.954 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../037-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2024-04-18T14:40:33.958 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package python3-requests. 2024-04-18T14:40:33.985 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../051-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2024-04-18T14:40:33.985 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-04-18T14:40:34.025 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-04-18T14:40:34.154 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-simplegeneric. 2024-04-18T14:40:34.181 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../038-python3-simplegeneric_0.8.1-3_all.deb ... 2024-04-18T14:40:34.221 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2024-04-18T14:40:34.305 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-simplegeneric. 2024-04-18T14:40:34.332 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../038-python3-simplegeneric_0.8.1-3_all.deb ... 2024-04-18T14:40:34.344 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package python3-werkzeug. 2024-04-18T14:40:34.371 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../052-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.1_all.deb ... 2024-04-18T14:40:34.372 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2024-04-18T14:40:34.411 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2024-04-18T14:40:34.488 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package ceph-volume. 2024-04-18T14:40:34.504 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../097-ceph-volume_18.2.2-1240-g6a7528e4-1jammy_all.deb ... 2024-04-18T14:40:34.523 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-singledispatch. 2024-04-18T14:40:34.538 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking ceph-volume (18.2.2-1240-g6a7528e4-1jammy) ... 2024-04-18T14:40:34.539 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../039-python3-singledispatch_3.4.0.3-3_all.deb ... 2024-04-18T14:40:34.581 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2024-04-18T14:40:34.675 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-singledispatch. 2024-04-18T14:40:34.701 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../039-python3-singledispatch_3.4.0.3-3_all.deb ... 2024-04-18T14:40:34.705 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2024-04-18T14:40:34.732 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../053-ceph-mgr-modules-core_18.2.2-1240-g6a7528e4-1jammy_all.deb ... 2024-04-18T14:40:34.741 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2024-04-18T14:40:34.773 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking ceph-mgr-modules-core (18.2.2-1240-g6a7528e4-1jammy) ... 2024-04-18T14:40:34.800 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package libcephfs-dev. 2024-04-18T14:40:34.816 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../098-libcephfs-dev_18.2.2-1240-g6a7528e4-1jammy_amd64.deb ... 2024-04-18T14:40:34.826 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-webob. 2024-04-18T14:40:34.842 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../040-python3-webob_1%3a1.8.6-1.1_all.deb ... 2024-04-18T14:40:34.850 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking libcephfs-dev (18.2.2-1240-g6a7528e4-1jammy) ... 2024-04-18T14:40:34.876 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-webob (1:1.8.6-1.1) ... 2024-04-18T14:40:35.044 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-webob. 2024-04-18T14:40:35.071 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../040-python3-webob_1%3a1.8.6-1.1_all.deb ... 2024-04-18T14:40:35.110 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2024-04-18T14:40:35.110 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-webob (1:1.8.6-1.1) ... 2024-04-18T14:40:35.136 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../054-libsqlite3-mod-ceph_18.2.2-1240-g6a7528e4-1jammy_amd64.deb ... 2024-04-18T14:40:35.168 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking libsqlite3-mod-ceph (18.2.2-1240-g6a7528e4-1jammy) ... 2024-04-18T14:40:35.179 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-waitress. 2024-04-18T14:40:35.194 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../041-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2024-04-18T14:40:35.211 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package nvme-cli. 2024-04-18T14:40:35.232 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2024-04-18T14:40:35.238 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../099-nvme-cli_1.16-3ubuntu0.1_amd64.deb ... 2024-04-18T14:40:35.278 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking nvme-cli (1.16-3ubuntu0.1) ... 2024-04-18T14:40:35.439 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-waitress. 2024-04-18T14:40:35.465 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../041-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2024-04-18T14:40:35.487 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package python3-bcrypt. 2024-04-18T14:40:35.508 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2024-04-18T14:40:35.514 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../055-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2024-04-18T14:40:35.523 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-tempita. 2024-04-18T14:40:35.550 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../042-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2024-04-18T14:40:35.553 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2024-04-18T14:40:35.590 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2024-04-18T14:40:35.633 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python-asyncssh-doc. 2024-04-18T14:40:35.660 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../100-python-asyncssh-doc_2.5.0-1_all.deb ... 2024-04-18T14:40:35.699 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2024-04-18T14:40:35.775 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-tempita. 2024-04-18T14:40:35.802 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../042-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2024-04-18T14:40:35.840 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package python3-openssl. 2024-04-18T14:40:35.841 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2024-04-18T14:40:35.866 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../056-python3-openssl_21.0.0-1_all.deb ... 2024-04-18T14:40:35.876 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-paste. 2024-04-18T14:40:35.902 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../043-python3-paste_3.5.0+dfsg1-1_all.deb ... 2024-04-18T14:40:35.906 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking python3-openssl (21.0.0-1) ... 2024-04-18T14:40:35.942 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2024-04-18T14:40:36.111 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-pastescript. 2024-04-18T14:40:36.138 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../101-python3-pastescript_2.0.2-4_all.deb ... 2024-04-18T14:40:36.145 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-paste. 2024-04-18T14:40:36.171 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../043-python3-paste_3.5.0+dfsg1-1_all.deb ... 2024-04-18T14:40:36.177 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2024-04-18T14:40:36.211 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2024-04-18T14:40:36.229 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2024-04-18T14:40:36.242 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package ceph-mgr. 2024-04-18T14:40:36.255 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../044-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2024-04-18T14:40:36.269 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../057-ceph-mgr_18.2.2-1240-g6a7528e4-1jammy_amd64.deb ... 2024-04-18T14:40:36.291 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2024-04-18T14:40:36.309 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking ceph-mgr (18.2.2-1240-g6a7528e4-1jammy) ... 2024-04-18T14:40:36.505 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-psutil. 2024-04-18T14:40:36.522 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2024-04-18T14:40:36.533 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../102-python3-psutil_5.9.0-1build1_amd64.deb ... 2024-04-18T14:40:36.549 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../044-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2024-04-18T14:40:36.572 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2024-04-18T14:40:36.580 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2024-04-18T14:40:36.590 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-pastedeploy. 2024-04-18T14:40:36.617 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../045-python3-pastedeploy_2.1.1-1_all.deb ... 2024-04-18T14:40:36.645 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package ceph-mon. 2024-04-18T14:40:36.656 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2024-04-18T14:40:36.672 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../058-ceph-mon_18.2.2-1240-g6a7528e4-1jammy_amd64.deb ... 2024-04-18T14:40:36.703 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking ceph-mon (18.2.2-1240-g6a7528e4-1jammy) ... 2024-04-18T14:40:36.892 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-pastedeploy. 2024-04-18T14:40:36.917 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-pygments. 2024-04-18T14:40:36.918 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../045-python3-pastedeploy_2.1.1-1_all.deb ... 2024-04-18T14:40:36.944 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../103-python3-pygments_2.11.2+dfsg-2_all.deb ... 2024-04-18T14:40:36.958 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2024-04-18T14:40:36.959 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-webtest. 2024-04-18T14:40:36.983 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2024-04-18T14:40:36.986 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../046-python3-webtest_2.0.35-1_all.deb ... 2024-04-18T14:40:37.026 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-webtest (2.0.35-1) ... 2024-04-18T14:40:37.261 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-webtest. 2024-04-18T14:40:37.288 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../046-python3-webtest_2.0.35-1_all.deb ... 2024-04-18T14:40:37.328 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-webtest (2.0.35-1) ... 2024-04-18T14:40:37.340 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package ceph-osd. 2024-04-18T14:40:37.346 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-pecan. 2024-04-18T14:40:37.367 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../059-ceph-osd_18.2.2-1240-g6a7528e4-1jammy_amd64.deb ... 2024-04-18T14:40:37.372 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../047-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2024-04-18T14:40:37.406 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking ceph-osd (18.2.2-1240-g6a7528e4-1jammy) ... 2024-04-18T14:40:37.412 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2024-04-18T14:40:37.420 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-pyinotify. 2024-04-18T14:40:37.448 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../104-python3-pyinotify_0.9.6-1.3_all.deb ... 2024-04-18T14:40:37.486 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2024-04-18T14:40:37.639 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-pecan. 2024-04-18T14:40:37.666 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../047-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2024-04-18T14:40:37.727 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2024-04-18T14:40:37.775 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-certifi. 2024-04-18T14:40:37.802 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../048-python3-certifi_2020.6.20-1_all.deb ... 2024-04-18T14:40:37.841 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2024-04-18T14:40:38.022 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-simplejson. 2024-04-18T14:40:38.038 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../105-python3-simplejson_3.17.6-1build1_amd64.deb ... 2024-04-18T14:40:38.072 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2024-04-18T14:40:38.086 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-certifi. 2024-04-18T14:40:38.112 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../048-python3-certifi_2020.6.20-1_all.deb ... 2024-04-18T14:40:38.152 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2024-04-18T14:40:38.170 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-idna. 2024-04-18T14:40:38.196 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../049-python3-idna_3.3-1_all.deb ... 2024-04-18T14:40:38.236 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-idna (3.3-1) ... 2024-04-18T14:40:38.325 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package qttranslations5-l10n. 2024-04-18T14:40:38.341 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../106-qttranslations5-l10n_5.15.3-1_all.deb ... 2024-04-18T14:40:38.383 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2024-04-18T14:40:38.426 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package ceph. 2024-04-18T14:40:38.442 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../060-ceph_18.2.2-1240-g6a7528e4-1jammy_amd64.deb ... 2024-04-18T14:40:38.447 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-idna. 2024-04-18T14:40:38.473 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../049-python3-idna_3.3-1_all.deb ... 2024-04-18T14:40:38.484 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking ceph (18.2.2-1240-g6a7528e4-1jammy) ... 2024-04-18T14:40:38.506 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-urllib3. 2024-04-18T14:40:38.513 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-idna (3.3-1) ... 2024-04-18T14:40:38.532 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../050-python3-urllib3_1.26.5-1~exp1ubuntu0.1_all.deb ... 2024-04-18T14:40:38.564 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-04-18T14:40:38.762 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package ceph-fuse. 2024-04-18T14:40:38.789 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../061-ceph-fuse_18.2.2-1240-g6a7528e4-1jammy_amd64.deb ... 2024-04-18T14:40:38.820 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking ceph-fuse (18.2.2-1240-g6a7528e4-1jammy) ... 2024-04-18T14:40:38.841 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-urllib3. 2024-04-18T14:40:38.850 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-requests. 2024-04-18T14:40:38.868 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../050-python3-urllib3_1.26.5-1~exp1ubuntu0.1_all.deb ... 2024-04-18T14:40:38.877 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../051-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2024-04-18T14:40:38.908 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-04-18T14:40:38.908 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-04-18T14:40:39.129 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package radosgw. 2024-04-18T14:40:39.156 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../107-radosgw_18.2.2-1240-g6a7528e4-1jammy_amd64.deb ... 2024-04-18T14:40:39.157 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package ceph-mds. 2024-04-18T14:40:39.184 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../062-ceph-mds_18.2.2-1240-g6a7528e4-1jammy_amd64.deb ... 2024-04-18T14:40:39.186 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-werkzeug. 2024-04-18T14:40:39.195 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking radosgw (18.2.2-1240-g6a7528e4-1jammy) ... 2024-04-18T14:40:39.211 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-requests. 2024-04-18T14:40:39.213 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../052-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.1_all.deb ... 2024-04-18T14:40:39.223 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking ceph-mds (18.2.2-1240-g6a7528e4-1jammy) ... 2024-04-18T14:40:39.238 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../051-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2024-04-18T14:40:39.253 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2024-04-18T14:40:39.277 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-04-18T14:40:39.547 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2024-04-18T14:40:39.563 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../053-ceph-mgr-modules-core_18.2.2-1240-g6a7528e4-1jammy_all.deb ... 2024-04-18T14:40:39.580 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-werkzeug. 2024-04-18T14:40:39.584 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package cephadm. 2024-04-18T14:40:39.598 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking ceph-mgr-modules-core (18.2.2-1240-g6a7528e4-1jammy) ... 2024-04-18T14:40:39.600 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../063-cephadm_18.2.2-1240-g6a7528e4-1jammy_amd64.deb ... 2024-04-18T14:40:39.607 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../052-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.1_all.deb ... 2024-04-18T14:40:39.634 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking cephadm (18.2.2-1240-g6a7528e4-1jammy) ... 2024-04-18T14:40:39.647 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2024-04-18T14:40:39.898 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package rbd-fuse. 2024-04-18T14:40:39.912 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package python3-asyncssh. 2024-04-18T14:40:39.914 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../108-rbd-fuse_18.2.2-1240-g6a7528e4-1jammy_amd64.deb ... 2024-04-18T14:40:39.939 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../064-python3-asyncssh_2.5.0-1_all.deb ... 2024-04-18T14:40:39.950 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2024-04-18T14:40:39.956 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking rbd-fuse (18.2.2-1240-g6a7528e4-1jammy) ... 2024-04-18T14:40:39.977 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../053-ceph-mgr-modules-core_18.2.2-1240-g6a7528e4-1jammy_all.deb ... 2024-04-18T14:40:39.978 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2024-04-18T14:40:40.011 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2024-04-18T14:40:40.016 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking ceph-mgr-modules-core (18.2.2-1240-g6a7528e4-1jammy) ... 2024-04-18T14:40:40.038 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../054-libsqlite3-mod-ceph_18.2.2-1240-g6a7528e4-1jammy_amd64.deb ... 2024-04-18T14:40:40.077 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking libsqlite3-mod-ceph (18.2.2-1240-g6a7528e4-1jammy) ... 2024-04-18T14:40:40.251 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2024-04-18T14:40:40.273 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package python-babel-localedata. 2024-04-18T14:40:40.289 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../065-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2024-04-18T14:40:40.323 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-04-18T14:40:40.363 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-bcrypt. 2024-04-18T14:40:40.390 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../055-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2024-04-18T14:40:40.405 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2024-04-18T14:40:40.430 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2024-04-18T14:40:40.431 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../054-libsqlite3-mod-ceph_18.2.2-1240-g6a7528e4-1jammy_amd64.deb ... 2024-04-18T14:40:40.471 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking libsqlite3-mod-ceph (18.2.2-1240-g6a7528e4-1jammy) ... 2024-04-18T14:40:40.502 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2024-04-18T14:40:40.603 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up nvme-cli (1.16-3ubuntu0.1) ... 2024-04-18T14:40:40.666 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-openssl. 2024-04-18T14:40:40.693 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../056-python3-openssl_21.0.0-1_all.deb ... 2024-04-18T14:40:40.732 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-openssl (21.0.0-1) ... 2024-04-18T14:40:40.766 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-bcrypt. 2024-04-18T14:40:40.793 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../055-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2024-04-18T14:40:40.832 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2024-04-18T14:40:40.853 INFO:teuthology.orchestra.run.smithi096.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2024-04-18T14:40:41.069 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package ceph-mgr. 2024-04-18T14:40:41.095 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../057-ceph-mgr_18.2.2-1240-g6a7528e4-1jammy_amd64.deb ... 2024-04-18T14:40:41.135 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-openssl. 2024-04-18T14:40:41.144 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking ceph-mgr (18.2.2-1240-g6a7528e4-1jammy) ... 2024-04-18T14:40:41.150 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../056-python3-openssl_21.0.0-1_all.deb ... 2024-04-18T14:40:41.179 INFO:teuthology.orchestra.run.smithi096.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2024-04-18T14:40:41.193 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-openssl (21.0.0-1) ... 2024-04-18T14:40:41.345 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package python3-babel. 2024-04-18T14:40:41.371 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../066-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2024-04-18T14:40:41.402 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2024-04-18T14:40:41.513 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package ceph-mgr. 2024-04-18T14:40:41.540 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../057-ceph-mgr_18.2.2-1240-g6a7528e4-1jammy_amd64.deb ... 2024-04-18T14:40:41.547 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package ceph-mon. 2024-04-18T14:40:41.573 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../058-ceph-mon_18.2.2-1240-g6a7528e4-1jammy_amd64.deb ... 2024-04-18T14:40:41.579 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking ceph-mgr (18.2.2-1240-g6a7528e4-1jammy) ... 2024-04-18T14:40:41.597 INFO:teuthology.orchestra.run.smithi096.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2024-04-18T14:40:41.613 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking ceph-mon (18.2.2-1240-g6a7528e4-1jammy) ... 2024-04-18T14:40:41.671 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up cephadm (18.2.2-1240-g6a7528e4-1jammy) ... 2024-04-18T14:40:41.689 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package python3-jinja2. 2024-04-18T14:40:41.704 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../067-python3-jinja2_3.0.3-1ubuntu0.1_all.deb ... 2024-04-18T14:40:41.739 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking python3-jinja2 (3.0.3-1ubuntu0.1) ... 2024-04-18T14:40:41.974 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package ceph-mon. 2024-04-18T14:40:42.001 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../058-ceph-mon_18.2.2-1240-g6a7528e4-1jammy_amd64.deb ... 2024-04-18T14:40:42.032 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking ceph-mon (18.2.2-1240-g6a7528e4-1jammy) ... 2024-04-18T14:40:42.033 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2024-04-18T14:40:42.049 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../068-ceph-mgr-cephadm_18.2.2-1240-g6a7528e4-1jammy_all.deb ... 2024-04-18T14:40:42.091 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking ceph-mgr-cephadm (18.2.2-1240-g6a7528e4-1jammy) ... 2024-04-18T14:40:42.150 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package ceph-osd. 2024-04-18T14:40:42.162 INFO:teuthology.orchestra.run.smithi096.stdout:Adding system user cephadm....done 2024-04-18T14:40:42.177 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../059-ceph-osd_18.2.2-1240-g6a7528e4-1jammy_amd64.deb ... 2024-04-18T14:40:42.208 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking ceph-osd (18.2.2-1240-g6a7528e4-1jammy) ... 2024-04-18T14:40:42.310 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2024-04-18T14:40:42.395 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package python3-pluggy. 2024-04-18T14:40:42.422 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../069-python3-pluggy_0.13.0-7.1_all.deb ... 2024-04-18T14:40:42.462 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2024-04-18T14:40:42.587 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2024-04-18T14:40:42.620 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package ceph-osd. 2024-04-18T14:40:42.646 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../059-ceph-osd_18.2.2-1240-g6a7528e4-1jammy_amd64.deb ... 2024-04-18T14:40:42.686 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking ceph-osd (18.2.2-1240-g6a7528e4-1jammy) ... 2024-04-18T14:40:42.838 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2024-04-18T14:40:42.964 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2024-04-18T14:40:42.981 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package python3-py. 2024-04-18T14:40:43.008 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../070-python3-py_1.10.0-1_all.deb ... 2024-04-18T14:40:43.047 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking python3-py (1.10.0-1) ... 2024-04-18T14:40:43.215 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-repoze.lru (0.7-2) ... 2024-04-18T14:40:43.278 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package ceph. 2024-04-18T14:40:43.305 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../060-ceph_18.2.2-1240-g6a7528e4-1jammy_amd64.deb ... 2024-04-18T14:40:43.345 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking ceph (18.2.2-1240-g6a7528e4-1jammy) ... 2024-04-18T14:40:43.376 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package python3-iniconfig. 2024-04-18T14:40:43.402 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../071-python3-iniconfig_1.1.1-2_all.deb ... 2024-04-18T14:40:43.442 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2024-04-18T14:40:43.459 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2024-04-18T14:40:43.567 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-py (1.10.0-1) ... 2024-04-18T14:40:43.664 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package ceph-fuse. 2024-04-18T14:40:43.691 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../061-ceph-fuse_18.2.2-1240-g6a7528e4-1jammy_amd64.deb ... 2024-04-18T14:40:43.730 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking ceph-fuse (18.2.2-1240-g6a7528e4-1jammy) ... 2024-04-18T14:40:43.737 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package python3-toml. 2024-04-18T14:40:43.764 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../072-python3-toml_0.10.2-1_all.deb ... 2024-04-18T14:40:43.803 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking python3-toml (0.10.2-1) ... 2024-04-18T14:40:43.806 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package ceph. 2024-04-18T14:40:43.821 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../060-ceph_18.2.2-1240-g6a7528e4-1jammy_amd64.deb ... 2024-04-18T14:40:43.860 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2024-04-18T14:40:43.864 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking ceph (18.2.2-1240-g6a7528e4-1jammy) ... 2024-04-18T14:40:44.050 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package ceph-mds. 2024-04-18T14:40:44.066 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../062-ceph-mds_18.2.2-1240-g6a7528e4-1jammy_amd64.deb ... 2024-04-18T14:40:44.081 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package python3-pytest. 2024-04-18T14:40:44.100 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking ceph-mds (18.2.2-1240-g6a7528e4-1jammy) ... 2024-04-18T14:40:44.108 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../073-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2024-04-18T14:40:44.147 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2024-04-18T14:40:44.175 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package ceph-fuse. 2024-04-18T14:40:44.202 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../061-ceph-fuse_18.2.2-1240-g6a7528e4-1jammy_amd64.deb ... 2024-04-18T14:40:44.229 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-cachetools (5.0.0-1) ... 2024-04-18T14:40:44.242 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking ceph-fuse (18.2.2-1240-g6a7528e4-1jammy) ... 2024-04-18T14:40:44.480 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-openssl (21.0.0-1) ... 2024-04-18T14:40:44.501 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package python3-repoze.lru. 2024-04-18T14:40:44.504 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package cephadm. 2024-04-18T14:40:44.528 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../074-python3-repoze.lru_0.7-2_all.deb ... 2024-04-18T14:40:44.530 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../063-cephadm_18.2.2-1240-g6a7528e4-1jammy_amd64.deb ... 2024-04-18T14:40:44.567 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2024-04-18T14:40:44.570 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking cephadm (18.2.2-1240-g6a7528e4-1jammy) ... 2024-04-18T14:40:44.612 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package ceph-mds. 2024-04-18T14:40:44.638 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../062-ceph-mds_18.2.2-1240-g6a7528e4-1jammy_amd64.deb ... 2024-04-18T14:40:44.678 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking ceph-mds (18.2.2-1240-g6a7528e4-1jammy) ... 2024-04-18T14:40:44.765 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2024-04-18T14:40:44.870 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package python3-routes. 2024-04-18T14:40:44.890 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-asyncssh. 2024-04-18T14:40:44.897 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../075-python3-routes_2.5.1-1ubuntu1_all.deb ... 2024-04-18T14:40:44.917 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../064-python3-asyncssh_2.5.0-1_all.deb ... 2024-04-18T14:40:44.937 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2024-04-18T14:40:44.956 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2024-04-18T14:40:44.999 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2024-04-18T14:40:45.040 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package cephadm. 2024-04-18T14:40:45.066 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../063-cephadm_18.2.2-1240-g6a7528e4-1jammy_amd64.deb ... 2024-04-18T14:40:45.106 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking cephadm (18.2.2-1240-g6a7528e4-1jammy) ... 2024-04-18T14:40:45.265 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2024-04-18T14:40:45.267 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python-babel-localedata. 2024-04-18T14:40:45.275 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2024-04-18T14:40:45.282 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../065-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2024-04-18T14:40:45.292 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../076-ceph-mgr-dashboard_18.2.2-1240-g6a7528e4-1jammy_all.deb ... 2024-04-18T14:40:45.325 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-04-18T14:40:45.331 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking ceph-mgr-dashboard (18.2.2-1240-g6a7528e4-1jammy) ... 2024-04-18T14:40:45.418 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-asyncssh. 2024-04-18T14:40:45.444 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../064-python3-asyncssh_2.5.0-1_all.deb ... 2024-04-18T14:40:45.484 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2024-04-18T14:40:45.518 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-ceph-argparse (18.2.2-1240-g6a7528e4-1jammy) ... 2024-04-18T14:40:45.760 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-04-18T14:40:45.795 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python-babel-localedata. 2024-04-18T14:40:45.811 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../065-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2024-04-18T14:40:45.845 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-04-18T14:40:45.886 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2024-04-18T14:40:46.137 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-04-18T14:40:46.263 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2024-04-18T14:40:46.347 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-babel. 2024-04-18T14:40:46.374 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../066-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2024-04-18T14:40:46.422 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2024-04-18T14:40:46.520 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2024-04-18T14:40:46.536 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../077-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2024-04-18T14:40:46.578 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-04-18T14:40:46.656 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-04-18T14:40:46.725 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-jinja2. 2024-04-18T14:40:46.752 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../067-python3-jinja2_3.0.3-1ubuntu0.1_all.deb ... 2024-04-18T14:40:46.782 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-natsort (8.0.2-1) ... 2024-04-18T14:40:46.791 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-jinja2 (3.0.3-1ubuntu0.1) ... 2024-04-18T14:40:46.901 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-babel. 2024-04-18T14:40:46.928 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../066-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2024-04-18T14:40:46.967 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2024-04-18T14:40:47.041 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2024-04-18T14:40:47.090 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package python3-joblib. 2024-04-18T14:40:47.117 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../078-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2024-04-18T14:40:47.130 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2024-04-18T14:40:47.155 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../068-ceph-mgr-cephadm_18.2.2-1240-g6a7528e4-1jammy_all.deb ... 2024-04-18T14:40:47.156 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2024-04-18T14:40:47.195 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking ceph-mgr-cephadm (18.2.2-1240-g6a7528e4-1jammy) ... 2024-04-18T14:40:47.270 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-jinja2. 2024-04-18T14:40:47.297 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../067-python3-jinja2_3.0.3-1ubuntu0.1_all.deb ... 2024-04-18T14:40:47.301 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2024-04-18T14:40:47.337 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-jinja2 (3.0.3-1ubuntu0.1) ... 2024-04-18T14:40:47.510 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package python3-threadpoolctl. 2024-04-18T14:40:47.539 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../079-python3-threadpoolctl_3.1.0-1_all.deb ... 2024-04-18T14:40:47.548 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-pluggy. 2024-04-18T14:40:47.575 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../069-python3-pluggy_0.13.0-7.1_all.deb ... 2024-04-18T14:40:47.576 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2024-04-18T14:40:47.586 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2024-04-18T14:40:47.614 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2024-04-18T14:40:47.682 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2024-04-18T14:40:47.709 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../068-ceph-mgr-cephadm_18.2.2-1240-g6a7528e4-1jammy_all.deb ... 2024-04-18T14:40:47.748 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking ceph-mgr-cephadm (18.2.2-1240-g6a7528e4-1jammy) ... 2024-04-18T14:40:47.887 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package python3-sklearn. 2024-04-18T14:40:47.914 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../080-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2024-04-18T14:40:47.926 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-py. 2024-04-18T14:40:47.953 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../070-python3-py_1.10.0-1_all.deb ... 2024-04-18T14:40:47.953 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2024-04-18T14:40:47.992 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-py (1.10.0-1) ... 2024-04-18T14:40:48.102 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-pluggy. 2024-04-18T14:40:48.129 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../069-python3-pluggy_0.13.0-7.1_all.deb ... 2024-04-18T14:40:48.169 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2024-04-18T14:40:48.321 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2024-04-18T14:40:48.321 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-iniconfig. 2024-04-18T14:40:48.348 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../071-python3-iniconfig_1.1.1-2_all.deb ... 2024-04-18T14:40:48.387 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2024-04-18T14:40:48.505 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-py. 2024-04-18T14:40:48.531 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../070-python3-py_1.10.0-1_all.deb ... 2024-04-18T14:40:48.572 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-py (1.10.0-1) ... 2024-04-18T14:40:48.587 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2024-04-18T14:40:48.588 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2024-04-18T14:40:48.614 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../081-ceph-mgr-diskprediction-local_18.2.2-1240-g6a7528e4-1jammy_all.deb ... 2024-04-18T14:40:48.662 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking ceph-mgr-diskprediction-local (18.2.2-1240-g6a7528e4-1jammy) ... 2024-04-18T14:40:48.673 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-toml. 2024-04-18T14:40:48.689 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../072-python3-toml_0.10.2-1_all.deb ... 2024-04-18T14:40:48.723 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-toml (0.10.2-1) ... 2024-04-18T14:40:48.740 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2024-04-18T14:40:48.866 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2024-04-18T14:40:48.900 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-iniconfig. 2024-04-18T14:40:48.927 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../071-python3-iniconfig_1.1.1-2_all.deb ... 2024-04-18T14:40:48.966 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2024-04-18T14:40:49.010 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-pytest. 2024-04-18T14:40:49.036 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../073-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2024-04-18T14:40:49.076 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2024-04-18T14:40:49.158 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2024-04-18T14:40:49.269 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-toml. 2024-04-18T14:40:49.296 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../072-python3-toml_0.10.2-1_all.deb ... 2024-04-18T14:40:49.336 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-toml (0.10.2-1) ... 2024-04-18T14:40:49.396 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-repoze.lru. 2024-04-18T14:40:49.412 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../074-python3-repoze.lru_0.7-2_all.deb ... 2024-04-18T14:40:49.446 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2024-04-18T14:40:49.535 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-certifi (2020.6.20-1) ... 2024-04-18T14:40:49.598 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package python3-cachetools. 2024-04-18T14:40:49.625 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../082-python3-cachetools_5.0.0-1_all.deb ... 2024-04-18T14:40:49.639 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-pytest. 2024-04-18T14:40:49.664 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2024-04-18T14:40:49.665 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../073-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2024-04-18T14:40:49.705 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2024-04-18T14:40:49.757 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-routes. 2024-04-18T14:40:49.769 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2024-04-18T14:40:49.784 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../075-python3-routes_2.5.1-1ubuntu1_all.deb ... 2024-04-18T14:40:49.824 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2024-04-18T14:40:50.044 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package python3-pyasn1. 2024-04-18T14:40:50.072 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../083-python3-pyasn1_0.4.8-1_all.deb ... 2024-04-18T14:40:50.076 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-repoze.lru. 2024-04-18T14:40:50.103 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../074-python3-repoze.lru_0.7-2_all.deb ... 2024-04-18T14:40:50.109 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2024-04-18T14:40:50.129 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-04-18T14:40:50.142 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2024-04-18T14:40:50.153 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2024-04-18T14:40:50.179 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../076-ceph-mgr-dashboard_18.2.2-1240-g6a7528e4-1jammy_all.deb ... 2024-04-18T14:40:50.219 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking ceph-mgr-dashboard (18.2.2-1240-g6a7528e4-1jammy) ... 2024-04-18T14:40:50.429 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-routes. 2024-04-18T14:40:50.430 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2024-04-18T14:40:50.438 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package python3-pyasn1-modules. 2024-04-18T14:40:50.455 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../075-python3-routes_2.5.1-1ubuntu1_all.deb ... 2024-04-18T14:40:50.465 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../084-python3-pyasn1-modules_0.2.1-1_all.deb ... 2024-04-18T14:40:50.495 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2024-04-18T14:40:50.505 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2024-04-18T14:40:50.765 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2024-04-18T14:40:50.818 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package python3-rsa. 2024-04-18T14:40:50.840 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2024-04-18T14:40:50.842 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../085-python3-rsa_4.8-1_all.deb ... 2024-04-18T14:40:50.867 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../076-ceph-mgr-dashboard_18.2.2-1240-g6a7528e4-1jammy_all.deb ... 2024-04-18T14:40:50.883 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking python3-rsa (4.8-1) ... 2024-04-18T14:40:50.906 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking ceph-mgr-dashboard (18.2.2-1240-g6a7528e4-1jammy) ... 2024-04-18T14:40:51.026 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2024-04-18T14:40:51.125 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-ceph-common (18.2.2-1240-g6a7528e4-1jammy) ... 2024-04-18T14:40:51.194 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package python3-google-auth. 2024-04-18T14:40:51.221 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../086-python3-google-auth_1.5.1-3_all.deb ... 2024-04-18T14:40:51.261 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2024-04-18T14:40:51.410 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-idna (3.3-1) ... 2024-04-18T14:40:51.449 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2024-04-18T14:40:51.465 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../077-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2024-04-18T14:40:51.507 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-04-18T14:40:51.597 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package python3-requests-oauthlib. 2024-04-18T14:40:51.613 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../087-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2024-04-18T14:40:51.647 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-04-18T14:40:51.719 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2024-04-18T14:40:51.908 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package python3-websocket. 2024-04-18T14:40:51.935 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../088-python3-websocket_1.2.3-1_all.deb ... 2024-04-18T14:40:51.974 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking python3-websocket (1.2.3-1) ... 2024-04-18T14:40:52.003 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-joblib. 2024-04-18T14:40:52.030 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../078-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2024-04-18T14:40:52.061 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2024-04-18T14:40:52.087 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2024-04-18T14:40:52.102 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../077-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2024-04-18T14:40:52.136 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-04-18T14:40:52.286 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package python3-kubernetes. 2024-04-18T14:40:52.313 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../089-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2024-04-18T14:40:52.352 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2024-04-18T14:40:52.398 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-threadpoolctl. 2024-04-18T14:40:52.424 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../079-python3-threadpoolctl_3.1.0-1_all.deb ... 2024-04-18T14:40:52.464 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2024-04-18T14:40:52.599 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-joblib. 2024-04-18T14:40:52.625 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../078-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2024-04-18T14:40:52.667 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2024-04-18T14:40:52.725 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-sklearn. 2024-04-18T14:40:52.752 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../080-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2024-04-18T14:40:52.783 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2024-04-18T14:40:52.900 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-18T14:40:53.009 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-toml (0.10.2-1) ... 2024-04-18T14:40:53.024 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2024-04-18T14:40:53.041 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../090-ceph-mgr-k8sevents_18.2.2-1240-g6a7528e4-1jammy_all.deb ... 2024-04-18T14:40:53.044 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-threadpoolctl. 2024-04-18T14:40:53.074 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../079-python3-threadpoolctl_3.1.0-1_all.deb ... 2024-04-18T14:40:53.074 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking ceph-mgr-k8sevents (18.2.2-1240-g6a7528e4-1jammy) ... 2024-04-18T14:40:53.110 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2024-04-18T14:40:53.260 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2024-04-18T14:40:53.318 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package libonig5:amd64. 2024-04-18T14:40:53.345 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../091-libonig5_6.9.7.1-2build1_amd64.deb ... 2024-04-18T14:40:53.376 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2024-04-18T14:40:53.386 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2024-04-18T14:40:53.413 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-sklearn. 2024-04-18T14:40:53.440 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../080-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2024-04-18T14:40:53.479 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2024-04-18T14:40:53.492 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2024-04-18T14:40:53.512 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-04-18T14:40:53.519 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../081-ceph-mgr-diskprediction-local_18.2.2-1240-g6a7528e4-1jammy_all.deb ... 2024-04-18T14:40:53.558 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking ceph-mgr-diskprediction-local (18.2.2-1240-g6a7528e4-1jammy) ... 2024-04-18T14:40:53.721 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package libjq1:amd64. 2024-04-18T14:40:53.748 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../092-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2024-04-18T14:40:53.787 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-04-18T14:40:53.814 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2024-04-18T14:40:54.048 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package jq. 2024-04-18T14:40:54.064 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../093-jq_1.6-2.1ubuntu3_amd64.deb ... 2024-04-18T14:40:54.073 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2024-04-18T14:40:54.106 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2024-04-18T14:40:54.147 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2024-04-18T14:40:54.174 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../081-ceph-mgr-diskprediction-local_18.2.2-1240-g6a7528e4-1jammy_all.deb ... 2024-04-18T14:40:54.213 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking ceph-mgr-diskprediction-local (18.2.2-1240-g6a7528e4-1jammy) ... 2024-04-18T14:40:54.324 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-18T14:40:54.350 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package socat. 2024-04-18T14:40:54.375 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../094-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2024-04-18T14:40:54.409 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2024-04-18T14:40:54.450 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up libfmt8:amd64 (8.1.1+ds1-2) ... 2024-04-18T14:40:54.570 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-cachetools. 2024-04-18T14:40:54.597 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../082-python3-cachetools_5.0.0-1_all.deb ... 2024-04-18T14:40:54.601 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2024-04-18T14:40:54.636 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2024-04-18T14:40:54.704 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package xmlstarlet. 2024-04-18T14:40:54.731 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../095-xmlstarlet_1.6.1-2.1_amd64.deb ... 2024-04-18T14:40:54.770 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2024-04-18T14:40:54.902 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2024-04-18T14:40:55.024 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-pyasn1. 2024-04-18T14:40:55.051 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../083-python3-pyasn1_0.4.8-1_all.deb ... 2024-04-18T14:40:55.090 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2024-04-18T14:40:55.132 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package ceph-test. 2024-04-18T14:40:55.148 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../096-ceph-test_18.2.2-1240-g6a7528e4-1jammy_amd64.deb ... 2024-04-18T14:40:55.162 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-logutils (0.3.3-8) ... 2024-04-18T14:40:55.175 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-cachetools. 2024-04-18T14:40:55.191 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking ceph-test (18.2.2-1240-g6a7528e4-1jammy) ... 2024-04-18T14:40:55.202 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../082-python3-cachetools_5.0.0-1_all.deb ... 2024-04-18T14:40:55.241 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2024-04-18T14:40:55.421 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-tempora (4.1.2-1) ... 2024-04-18T14:40:55.427 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-pyasn1-modules. 2024-04-18T14:40:55.454 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../084-python3-pyasn1-modules_0.2.1-1_all.deb ... 2024-04-18T14:40:55.502 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2024-04-18T14:40:55.596 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-pyasn1. 2024-04-18T14:40:55.623 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../083-python3-pyasn1_0.4.8-1_all.deb ... 2024-04-18T14:40:55.654 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2024-04-18T14:40:55.672 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2024-04-18T14:40:55.813 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-rsa. 2024-04-18T14:40:55.841 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../085-python3-rsa_4.8-1_all.deb ... 2024-04-18T14:40:55.880 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-rsa (4.8-1) ... 2024-04-18T14:40:55.915 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-prettytable (2.5.0-2) ... 2024-04-18T14:40:55.983 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-pyasn1-modules. 2024-04-18T14:40:56.010 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../084-python3-pyasn1-modules_0.2.1-1_all.deb ... 2024-04-18T14:40:56.049 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2024-04-18T14:40:56.142 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-google-auth. 2024-04-18T14:40:56.157 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../086-python3-google-auth_1.5.1-3_all.deb ... 2024-04-18T14:40:56.174 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-04-18T14:40:56.191 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2024-04-18T14:40:56.300 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-websocket (1.2.3-1) ... 2024-04-18T14:40:56.369 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-rsa. 2024-04-18T14:40:56.396 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../085-python3-rsa_4.8-1_all.deb ... 2024-04-18T14:40:56.435 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-rsa (4.8-1) ... 2024-04-18T14:40:56.553 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-requests-oauthlib. 2024-04-18T14:40:56.576 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2024-04-18T14:40:56.581 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../087-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2024-04-18T14:40:56.628 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-04-18T14:40:56.702 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-04-18T14:40:56.705 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-google-auth. 2024-04-18T14:40:56.721 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../086-python3-google-auth_1.5.1-3_all.deb ... 2024-04-18T14:40:56.758 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2024-04-18T14:40:56.989 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-websocket. 2024-04-18T14:40:57.004 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-webob (1:1.8.6-1.1) ... 2024-04-18T14:40:57.017 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../088-python3-websocket_1.2.3-1_all.deb ... 2024-04-18T14:40:57.043 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-requests-oauthlib. 2024-04-18T14:40:57.047 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-websocket (1.2.3-1) ... 2024-04-18T14:40:57.052 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package ceph-volume. 2024-04-18T14:40:57.070 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../087-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2024-04-18T14:40:57.080 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../097-ceph-volume_18.2.2-1240-g6a7528e4-1jammy_all.deb ... 2024-04-18T14:40:57.100 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-04-18T14:40:57.119 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking ceph-volume (18.2.2-1240-g6a7528e4-1jammy) ... 2024-04-18T14:40:57.307 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2024-04-18T14:40:57.309 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-kubernetes. 2024-04-18T14:40:57.336 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../089-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2024-04-18T14:40:57.375 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2024-04-18T14:40:57.404 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-websocket. 2024-04-18T14:40:57.406 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package libcephfs-dev. 2024-04-18T14:40:57.422 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../098-libcephfs-dev_18.2.2-1240-g6a7528e4-1jammy_amd64.deb ... 2024-04-18T14:40:57.431 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../088-python3-websocket_1.2.3-1_all.deb ... 2024-04-18T14:40:57.464 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking libcephfs-dev (18.2.2-1240-g6a7528e4-1jammy) ... 2024-04-18T14:40:57.470 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-websocket (1.2.3-1) ... 2024-04-18T14:40:57.558 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2024-04-18T14:40:57.782 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-kubernetes. 2024-04-18T14:40:57.809 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../089-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2024-04-18T14:40:57.848 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2024-04-18T14:40:57.851 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package nvme-cli. 2024-04-18T14:40:57.879 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../099-nvme-cli_1.16-3ubuntu0.1_amd64.deb ... 2024-04-18T14:40:57.917 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking nvme-cli (1.16-3ubuntu0.1) ... 2024-04-18T14:40:57.949 INFO:teuthology.orchestra.run.smithi096.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2024-04-18T14:40:58.006 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2024-04-18T14:40:58.022 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../090-ceph-mgr-k8sevents_18.2.2-1240-g6a7528e4-1jammy_all.deb ... 2024-04-18T14:40:58.064 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking ceph-mgr-k8sevents (18.2.2-1240-g6a7528e4-1jammy) ... 2024-04-18T14:40:58.194 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-04-18T14:40:58.247 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package python-asyncssh-doc. 2024-04-18T14:40:58.263 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../100-python-asyncssh-doc_2.5.0-1_all.deb ... 2024-04-18T14:40:58.305 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2024-04-18T14:40:58.320 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2024-04-18T14:40:58.367 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package libonig5:amd64. 2024-04-18T14:40:58.395 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../091-libonig5_6.9.7.1-2build1_amd64.deb ... 2024-04-18T14:40:58.433 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2024-04-18T14:40:58.537 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2024-04-18T14:40:58.553 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../090-ceph-mgr-k8sevents_18.2.2-1240-g6a7528e4-1jammy_all.deb ... 2024-04-18T14:40:58.595 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking ceph-mgr-k8sevents (18.2.2-1240-g6a7528e4-1jammy) ... 2024-04-18T14:40:58.691 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package python3-pastescript. 2024-04-18T14:40:58.705 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2024-04-18T14:40:58.719 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../101-python3-pastescript_2.0.2-4_all.deb ... 2024-04-18T14:40:58.757 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2024-04-18T14:40:58.770 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package libjq1:amd64. 2024-04-18T14:40:58.798 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../092-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2024-04-18T14:40:58.836 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-04-18T14:40:58.865 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package libonig5:amd64. 2024-04-18T14:40:58.892 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../091-libonig5_6.9.7.1-2build1_amd64.deb ... 2024-04-18T14:40:58.923 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2024-04-18T14:40:58.973 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-portend (3.0.0-1) ... 2024-04-18T14:40:59.094 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package python3-psutil. 2024-04-18T14:40:59.105 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package jq. 2024-04-18T14:40:59.122 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../102-python3-psutil_5.9.0-1build1_amd64.deb ... 2024-04-18T14:40:59.122 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../093-jq_1.6-2.1ubuntu3_amd64.deb ... 2024-04-18T14:40:59.160 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2024-04-18T14:40:59.163 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2024-04-18T14:40:59.216 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-18T14:40:59.253 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package libjq1:amd64. 2024-04-18T14:40:59.280 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../092-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2024-04-18T14:40:59.319 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-04-18T14:40:59.342 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-jinja2 (3.0.3-1ubuntu0.1) ... 2024-04-18T14:40:59.416 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package socat. 2024-04-18T14:40:59.443 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../094-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2024-04-18T14:40:59.483 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2024-04-18T14:40:59.499 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package python3-pygments. 2024-04-18T14:40:59.526 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../103-python3-pygments_2.11.2+dfsg-2_all.deb ... 2024-04-18T14:40:59.565 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2024-04-18T14:40:59.572 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package jq. 2024-04-18T14:40:59.599 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../093-jq_1.6-2.1ubuntu3_amd64.deb ... 2024-04-18T14:40:59.639 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2024-04-18T14:40:59.685 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2024-04-18T14:40:59.824 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package socat. 2024-04-18T14:40:59.836 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package xmlstarlet. 2024-04-18T14:40:59.840 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../094-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2024-04-18T14:40:59.853 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../095-xmlstarlet_1.6.1-2.1_amd64.deb ... 2024-04-18T14:40:59.874 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2024-04-18T14:40:59.886 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2024-04-18T14:40:59.994 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-04-18T14:41:00.019 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package python3-pyinotify. 2024-04-18T14:41:00.033 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../104-python3-pyinotify_0.9.6-1.3_all.deb ... 2024-04-18T14:41:00.069 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2024-04-18T14:41:00.195 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package xmlstarlet. 2024-04-18T14:41:00.222 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../095-xmlstarlet_1.6.1-2.1_amd64.deb ... 2024-04-18T14:41:00.248 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package ceph-test. 2024-04-18T14:41:00.261 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2024-04-18T14:41:00.265 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../096-ceph-test_18.2.2-1240-g6a7528e4-1jammy_amd64.deb ... 2024-04-18T14:41:00.270 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2024-04-18T14:41:00.307 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking ceph-test (18.2.2-1240-g6a7528e4-1jammy) ... 2024-04-18T14:41:00.371 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package python3-simplejson. 2024-04-18T14:41:00.380 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-rsa (4.8-1) ... 2024-04-18T14:41:00.399 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../105-python3-simplejson_3.17.6-1build1_amd64.deb ... 2024-04-18T14:41:00.438 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2024-04-18T14:41:00.615 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package ceph-test. 2024-04-18T14:41:00.631 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-webtest (2.0.35-1) ... 2024-04-18T14:41:00.631 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../096-ceph-test_18.2.2-1240-g6a7528e4-1jammy_amd64.deb ... 2024-04-18T14:41:00.674 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking ceph-test (18.2.2-1240-g6a7528e4-1jammy) ... 2024-04-18T14:41:00.707 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package qttranslations5-l10n. 2024-04-18T14:41:00.722 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../106-qttranslations5-l10n_5.15.3-1_all.deb ... 2024-04-18T14:41:00.765 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2024-04-18T14:41:00.899 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-04-18T14:41:01.159 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2024-04-18T14:41:01.435 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package radosgw. 2024-04-18T14:41:01.463 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../107-radosgw_18.2.2-1240-g6a7528e4-1jammy_amd64.deb ... 2024-04-18T14:41:01.502 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking radosgw (18.2.2-1240-g6a7528e4-1jammy) ... 2024-04-18T14:41:01.552 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-pastescript (2.0.2-4) ... 2024-04-18T14:41:01.837 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2024-04-18T14:41:02.171 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package rbd-fuse. 2024-04-18T14:41:02.172 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-04-18T14:41:02.177 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package ceph-volume. 2024-04-18T14:41:02.199 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../108-rbd-fuse_18.2.2-1240-g6a7528e4-1jammy_amd64.deb ... 2024-04-18T14:41:02.204 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../097-ceph-volume_18.2.2-1240-g6a7528e4-1jammy_all.deb ... 2024-04-18T14:41:02.238 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking rbd-fuse (18.2.2-1240-g6a7528e4-1jammy) ... 2024-04-18T14:41:02.246 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking ceph-volume (18.2.2-1240-g6a7528e4-1jammy) ... 2024-04-18T14:41:02.298 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up librados2 (18.2.2-1240-g6a7528e4-1jammy) ... 2024-04-18T14:41:02.424 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up librgw2 (18.2.2-1240-g6a7528e4-1jammy) ... 2024-04-18T14:41:02.517 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package libcephfs-dev. 2024-04-18T14:41:02.533 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2024-04-18T14:41:02.536 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package ceph-volume. 2024-04-18T14:41:02.544 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../098-libcephfs-dev_18.2.2-1240-g6a7528e4-1jammy_amd64.deb ... 2024-04-18T14:41:02.550 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up libsqlite3-mod-ceph (18.2.2-1240-g6a7528e4-1jammy) ... 2024-04-18T14:41:02.564 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../097-ceph-volume_18.2.2-1240-g6a7528e4-1jammy_all.deb ... 2024-04-18T14:41:02.583 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking libcephfs-dev (18.2.2-1240-g6a7528e4-1jammy) ... 2024-04-18T14:41:02.602 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking ceph-volume (18.2.2-1240-g6a7528e4-1jammy) ... 2024-04-18T14:41:02.676 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up libcephfs2 (18.2.2-1240-g6a7528e4-1jammy) ... 2024-04-18T14:41:02.775 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2024-04-18T14:41:02.802 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up libradosstriper1 (18.2.2-1240-g6a7528e4-1jammy) ... 2024-04-18T14:41:02.901 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up nvme-cli (1.16-3ubuntu0.1) ... 2024-04-18T14:41:02.906 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package libcephfs-dev. 2024-04-18T14:41:02.934 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../098-libcephfs-dev_18.2.2-1240-g6a7528e4-1jammy_amd64.deb ... 2024-04-18T14:41:02.961 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package nvme-cli. 2024-04-18T14:41:02.973 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking libcephfs-dev (18.2.2-1240-g6a7528e4-1jammy) ... 2024-04-18T14:41:02.989 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../099-nvme-cli_1.16-3ubuntu0.1_amd64.deb ... 2024-04-18T14:41:03.022 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-google-auth (1.5.1-3) ... 2024-04-18T14:41:03.158 INFO:teuthology.orchestra.run.smithi086.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2024-04-18T14:41:03.294 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking nvme-cli (1.16-3ubuntu0.1) ... 2024-04-18T14:41:03.299 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up librbd1 (18.2.2-1240-g6a7528e4-1jammy) ... 2024-04-18T14:41:03.360 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package nvme-cli. 2024-04-18T14:41:03.387 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../099-nvme-cli_1.16-3ubuntu0.1_amd64.deb ... 2024-04-18T14:41:03.425 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up ceph-mgr-modules-core (18.2.2-1240-g6a7528e4-1jammy) ... 2024-04-18T14:41:03.426 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking nvme-cli (1.16-3ubuntu0.1) ... 2024-04-18T14:41:03.467 INFO:teuthology.orchestra.run.smithi086.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2024-04-18T14:41:03.551 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up ceph-fuse (18.2.2-1240-g6a7528e4-1jammy) ... 2024-04-18T14:41:03.650 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python-asyncssh-doc. 2024-04-18T14:41:03.678 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../100-python-asyncssh-doc_2.5.0-1_all.deb ... 2024-04-18T14:41:03.716 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2024-04-18T14:41:03.765 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python-asyncssh-doc. 2024-04-18T14:41:03.768 INFO:teuthology.orchestra.run.smithi096.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-04-18T14:41:03.768 INFO:teuthology.orchestra.run.smithi096.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-04-18T14:41:03.792 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../100-python-asyncssh-doc_2.5.0-1_all.deb ... 2024-04-18T14:41:03.831 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2024-04-18T14:41:03.898 INFO:teuthology.orchestra.run.smithi086.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2024-04-18T14:41:04.129 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up cephadm (18.2.2-1240-g6a7528e4-1jammy) ... 2024-04-18T14:41:04.161 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-pastescript. 2024-04-18T14:41:04.188 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../101-python3-pastescript_2.0.2-4_all.deb ... 2024-04-18T14:41:04.227 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2024-04-18T14:41:04.236 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up libcephfs-dev (18.2.2-1240-g6a7528e4-1jammy) ... 2024-04-18T14:41:04.251 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-pastescript. 2024-04-18T14:41:04.278 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../101-python3-pastescript_2.0.2-4_all.deb ... 2024-04-18T14:41:04.317 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2024-04-18T14:41:04.354 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-rados (18.2.2-1240-g6a7528e4-1jammy) ... 2024-04-18T14:41:04.471 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2024-04-18T14:41:04.531 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-psutil. 2024-04-18T14:41:04.559 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../102-python3-psutil_5.9.0-1build1_amd64.deb ... 2024-04-18T14:41:04.597 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2024-04-18T14:41:04.638 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-psutil. 2024-04-18T14:41:04.665 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../102-python3-psutil_5.9.0-1build1_amd64.deb ... 2024-04-18T14:41:04.670 INFO:teuthology.orchestra.run.smithi086.stdout:Adding system user cephadm....done 2024-04-18T14:41:04.704 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2024-04-18T14:41:04.818 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2024-04-18T14:41:04.942 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-pygments. 2024-04-18T14:41:04.970 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../103-python3-pygments_2.11.2+dfsg-2_all.deb ... 2024-04-18T14:41:05.008 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2024-04-18T14:41:05.040 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-pygments. 2024-04-18T14:41:05.068 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../103-python3-pygments_2.11.2+dfsg-2_all.deb ... 2024-04-18T14:41:05.094 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2024-04-18T14:41:05.115 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2024-04-18T14:41:05.345 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2024-04-18T14:41:05.471 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2024-04-18T14:41:05.496 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-pyinotify. 2024-04-18T14:41:05.524 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../104-python3-pyinotify_0.9.6-1.3_all.deb ... 2024-04-18T14:41:05.571 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2024-04-18T14:41:05.603 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-pyinotify. 2024-04-18T14:41:05.630 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../104-python3-pyinotify_0.9.6-1.3_all.deb ... 2024-04-18T14:41:05.661 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2024-04-18T14:41:05.667 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-rbd (18.2.2-1240-g6a7528e4-1jammy) ... 2024-04-18T14:41:05.731 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up python3-repoze.lru (0.7-2) ... 2024-04-18T14:41:05.794 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up rbd-fuse (18.2.2-1240-g6a7528e4-1jammy) ... 2024-04-18T14:41:05.899 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-simplejson. 2024-04-18T14:41:05.920 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-rgw (18.2.2-1240-g6a7528e4-1jammy) ... 2024-04-18T14:41:05.927 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../105-python3-simplejson_3.17.6-1build1_amd64.deb ... 2024-04-18T14:41:05.955 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-simplejson. 2024-04-18T14:41:05.965 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2024-04-18T14:41:05.966 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2024-04-18T14:41:05.983 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../105-python3-simplejson_3.17.6-1build1_amd64.deb ... 2024-04-18T14:41:06.022 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2024-04-18T14:41:06.029 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-cephfs (18.2.2-1240-g6a7528e4-1jammy) ... 2024-04-18T14:41:06.066 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up python3-py (1.10.0-1) ... 2024-04-18T14:41:06.130 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up ceph-common (18.2.2-1240-g6a7528e4-1jammy) ... 2024-04-18T14:41:06.235 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package qttranslations5-l10n. 2024-04-18T14:41:06.258 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package qttranslations5-l10n. 2024-04-18T14:41:06.262 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../106-qttranslations5-l10n_5.15.3-1_all.deb ... 2024-04-18T14:41:06.273 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../106-qttranslations5-l10n_5.15.3-1_all.deb ... 2024-04-18T14:41:06.301 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2024-04-18T14:41:06.307 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2024-04-18T14:41:06.359 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2024-04-18T14:41:06.674 INFO:teuthology.orchestra.run.smithi096.stdout:Adding group ceph....done 2024-04-18T14:41:06.720 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up python3-cachetools (5.0.0-1) ... 2024-04-18T14:41:06.987 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up python3-openssl (21.0.0-1) ... 2024-04-18T14:41:07.016 INFO:teuthology.orchestra.run.smithi096.stdout:Adding system user ceph....done 2024-04-18T14:41:07.054 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package radosgw. 2024-04-18T14:41:07.064 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package radosgw. 2024-04-18T14:41:07.081 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../107-radosgw_18.2.2-1240-g6a7528e4-1jammy_amd64.deb ... 2024-04-18T14:41:07.091 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../107-radosgw_18.2.2-1240-g6a7528e4-1jammy_amd64.deb ... 2024-04-18T14:41:07.120 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking radosgw (18.2.2-1240-g6a7528e4-1jammy) ... 2024-04-18T14:41:07.130 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking radosgw (18.2.2-1240-g6a7528e4-1jammy) ... 2024-04-18T14:41:07.161 INFO:teuthology.orchestra.run.smithi096.stdout:Setting system user ceph properties....done 2024-04-18T14:41:07.179 INFO:teuthology.orchestra.run.smithi096.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2024-04-18T14:41:07.272 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2024-04-18T14:41:07.316 INFO:teuthology.orchestra.run.smithi096.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2024-04-18T14:41:07.514 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2024-04-18T14:41:07.657 INFO:teuthology.orchestra.run.smithi096.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2024-04-18T14:41:07.749 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2024-04-18T14:41:07.781 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package rbd-fuse. 2024-04-18T14:41:07.797 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../108-rbd-fuse_18.2.2-1240-g6a7528e4-1jammy_amd64.deb ... 2024-04-18T14:41:07.833 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package rbd-fuse. 2024-04-18T14:41:07.839 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking rbd-fuse (18.2.2-1240-g6a7528e4-1jammy) ... 2024-04-18T14:41:07.849 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../108-rbd-fuse_18.2.2-1240-g6a7528e4-1jammy_amd64.deb ... 2024-04-18T14:41:07.891 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking rbd-fuse (18.2.2-1240-g6a7528e4-1jammy) ... 2024-04-18T14:41:08.000 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up python3-ceph-argparse (18.2.2-1240-g6a7528e4-1jammy) ... 2024-04-18T14:41:08.116 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up ceph-test (18.2.2-1240-g6a7528e4-1jammy) ... 2024-04-18T14:41:08.126 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2024-04-18T14:41:08.195 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2024-04-18T14:41:08.241 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up radosgw (18.2.2-1240-g6a7528e4-1jammy) ... 2024-04-18T14:41:08.251 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-04-18T14:41:08.377 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2024-04-18T14:41:08.446 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2024-04-18T14:41:08.463 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2024-04-18T14:41:08.503 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up nvme-cli (1.16-3ubuntu0.1) ... 2024-04-18T14:41:08.572 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up nvme-cli (1.16-3ubuntu0.1) ... 2024-04-18T14:41:08.695 INFO:teuthology.orchestra.run.smithi096.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-04-18T14:41:08.695 INFO:teuthology.orchestra.run.smithi096.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-04-18T14:41:08.763 INFO:teuthology.orchestra.run.smithi119.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2024-04-18T14:41:08.769 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-04-18T14:41:08.805 INFO:teuthology.orchestra.run.smithi134.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2024-04-18T14:41:08.895 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2024-04-18T14:41:09.079 INFO:teuthology.orchestra.run.smithi119.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2024-04-18T14:41:09.124 INFO:teuthology.orchestra.run.smithi134.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2024-04-18T14:41:09.185 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up ceph-base (18.2.2-1240-g6a7528e4-1jammy) ... 2024-04-18T14:41:09.271 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-04-18T14:41:09.397 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up python3-natsort (8.0.2-1) ... 2024-04-18T14:41:09.535 INFO:teuthology.orchestra.run.smithi134.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2024-04-18T14:41:09.540 INFO:teuthology.orchestra.run.smithi096.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2024-04-18T14:41:09.541 INFO:teuthology.orchestra.run.smithi119.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2024-04-18T14:41:09.591 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up cephadm (18.2.2-1240-g6a7528e4-1jammy) ... 2024-04-18T14:41:09.648 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2024-04-18T14:41:09.882 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up cephadm (18.2.2-1240-g6a7528e4-1jammy) ... 2024-04-18T14:41:09.891 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2024-04-18T14:41:09.995 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up ceph-mds (18.2.2-1240-g6a7528e4-1jammy) ... 2024-04-18T14:41:10.140 INFO:teuthology.orchestra.run.smithi134.stdout:Adding system user cephadm....done 2024-04-18T14:41:10.192 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2024-04-18T14:41:10.214 INFO:teuthology.orchestra.run.smithi096.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-04-18T14:41:10.214 INFO:teuthology.orchestra.run.smithi096.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-04-18T14:41:10.288 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2024-04-18T14:41:10.548 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2024-04-18T14:41:10.680 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up ceph-mgr (18.2.2-1240-g6a7528e4-1jammy) ... 2024-04-18T14:41:10.728 INFO:teuthology.orchestra.run.smithi119.stdout:Adding system user cephadm....done 2024-04-18T14:41:10.774 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2024-04-18T14:41:10.852 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2024-04-18T14:41:10.900 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2024-04-18T14:41:10.902 INFO:teuthology.orchestra.run.smithi096.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-04-18T14:41:10.902 INFO:teuthology.orchestra.run.smithi096.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-04-18T14:41:11.019 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2024-04-18T14:41:11.111 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2024-04-18T14:41:11.151 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-repoze.lru (0.7-2) ... 2024-04-18T14:41:11.237 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2024-04-18T14:41:11.339 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2024-04-18T14:41:11.372 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2024-04-18T14:41:11.381 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up ceph-osd (18.2.2-1240-g6a7528e4-1jammy) ... 2024-04-18T14:41:11.411 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2024-04-18T14:41:11.537 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-py (1.10.0-1) ... 2024-04-18T14:41:11.591 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2024-04-18T14:41:11.653 INFO:teuthology.orchestra.run.smithi096.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-04-18T14:41:11.653 INFO:teuthology.orchestra.run.smithi096.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-04-18T14:41:11.673 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2024-04-18T14:41:11.718 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2024-04-18T14:41:11.855 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2024-04-18T14:41:11.985 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-repoze.lru (0.7-2) ... 2024-04-18T14:41:12.074 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up python3-certifi (2020.6.20-1) ... 2024-04-18T14:41:12.117 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up ceph-mgr-k8sevents (18.2.2-1240-g6a7528e4-1jammy) ... 2024-04-18T14:41:12.191 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-cachetools (5.0.0-1) ... 2024-04-18T14:41:12.243 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up ceph-mgr-diskprediction-local (18.2.2-1240-g6a7528e4-1jammy) ... 2024-04-18T14:41:12.244 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2024-04-18T14:41:12.309 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2024-04-18T14:41:12.371 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-py (1.10.0-1) ... 2024-04-18T14:41:12.385 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up ceph-mon (18.2.2-1240-g6a7528e4-1jammy) ... 2024-04-18T14:41:12.442 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-openssl (21.0.0-1) ... 2024-04-18T14:41:12.586 INFO:teuthology.orchestra.run.smithi096.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-04-18T14:41:12.586 INFO:teuthology.orchestra.run.smithi096.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-04-18T14:41:12.693 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-04-18T14:41:12.697 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2024-04-18T14:41:12.710 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2024-04-18T14:41:12.961 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2024-04-18T14:41:12.986 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2024-04-18T14:41:13.058 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-cachetools (5.0.0-1) ... 2024-04-18T14:41:13.070 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up ceph-mgr-cephadm (18.2.2-1240-g6a7528e4-1jammy) ... 2024-04-18T14:41:13.196 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up ceph (18.2.2-1240-g6a7528e4-1jammy) ... 2024-04-18T14:41:13.245 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2024-04-18T14:41:13.292 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-openssl (21.0.0-1) ... 2024-04-18T14:41:13.322 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up ceph-mgr-dashboard (18.2.2-1240-g6a7528e4-1jammy) ... 2024-04-18T14:41:13.329 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2024-04-18T14:41:13.473 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up ceph-volume (18.2.2-1240-g6a7528e4-1jammy) ... 2024-04-18T14:41:13.513 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-ceph-argparse (18.2.2-1240-g6a7528e4-1jammy) ... 2024-04-18T14:41:13.577 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2024-04-18T14:41:13.755 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2024-04-18T14:41:13.772 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-04-18T14:41:13.818 INFO:teuthology.orchestra.run.smithi096.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-04-18T14:41:13.881 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up python3-ceph-common (18.2.2-1240-g6a7528e4-1jammy) ... 2024-04-18T14:41:13.898 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2024-04-18T14:41:13.905 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2024-04-18T14:41:14.149 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-04-18T14:41:14.165 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up python3-idna (3.3-1) ... 2024-04-18T14:41:14.271 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2024-04-18T14:41:14.275 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2024-04-18T14:41:14.466 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2024-04-18T14:41:14.643 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-04-18T14:41:14.769 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-natsort (8.0.2-1) ... 2024-04-18T14:41:14.771 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-ceph-argparse (18.2.2-1240-g6a7528e4-1jammy) ... 2024-04-18T14:41:14.870 INFO:teuthology.orchestra.run.smithi096.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-04-18T14:41:15.037 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2024-04-18T14:41:15.039 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-04-18T14:41:15.157 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2024-04-18T14:41:15.322 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2024-04-18T14:41:15.341 INFO:teuthology.orchestra.run.smithi096.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-04-18T14:41:15.347 DEBUG:teuthology.parallel:result is None 2024-04-18T14:41:15.408 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-04-18T14:41:15.517 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2024-04-18T14:41:15.598 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2024-04-18T14:41:15.663 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-18T14:41:15.773 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up python3-toml (0.10.2-1) ... 2024-04-18T14:41:15.877 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-04-18T14:41:15.986 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-natsort (8.0.2-1) ... 2024-04-18T14:41:16.016 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2024-04-18T14:41:16.125 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2024-04-18T14:41:16.246 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2024-04-18T14:41:16.250 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-04-18T14:41:16.292 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2024-04-18T14:41:16.505 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2024-04-18T14:41:16.552 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2024-04-18T14:41:16.576 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2024-04-18T14:41:16.702 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2024-04-18T14:41:16.803 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2024-04-18T14:41:16.823 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2024-04-18T14:41:16.828 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2024-04-18T14:41:17.062 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-18T14:41:17.129 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2024-04-18T14:41:17.188 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up libfmt8:amd64 (8.1.1+ds1-2) ... 2024-04-18T14:41:17.298 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2024-04-18T14:41:17.475 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2024-04-18T14:41:17.506 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-certifi (2020.6.20-1) ... 2024-04-18T14:41:17.599 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2024-04-18T14:41:17.726 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2024-04-18T14:41:17.740 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2024-04-18T14:41:17.833 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up python3-logutils (0.3.3-8) ... 2024-04-18T14:41:17.852 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2024-04-18T14:41:17.978 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2024-04-18T14:41:18.092 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up python3-tempora (4.1.2-1) ... 2024-04-18T14:41:18.133 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-04-18T14:41:18.273 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2024-04-18T14:41:18.343 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2024-04-18T14:41:18.426 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2024-04-18T14:41:18.594 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up python3-prettytable (2.5.0-2) ... 2024-04-18T14:41:18.687 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-certifi (2020.6.20-1) ... 2024-04-18T14:41:18.769 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2024-04-18T14:41:18.862 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-04-18T14:41:18.940 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2024-04-18T14:41:18.988 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up python3-websocket (1.2.3-1) ... 2024-04-18T14:41:19.020 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2024-04-18T14:41:19.138 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-ceph-common (18.2.2-1240-g6a7528e4-1jammy) ... 2024-04-18T14:41:19.273 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2024-04-18T14:41:19.308 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-04-18T14:41:19.406 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-idna (3.3-1) ... 2024-04-18T14:41:19.407 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-04-18T14:41:19.584 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2024-04-18T14:41:19.674 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up python3-webob (1:1.8.6-1.1) ... 2024-04-18T14:41:19.699 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2024-04-18T14:41:19.928 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2024-04-18T14:41:19.959 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2024-04-18T14:41:20.170 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2024-04-18T14:41:20.210 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2024-04-18T14:41:20.279 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-ceph-common (18.2.2-1240-g6a7528e4-1jammy) ... 2024-04-18T14:41:20.581 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-idna (3.3-1) ... 2024-04-18T14:41:20.608 INFO:teuthology.orchestra.run.smithi086.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2024-04-18T14:41:20.847 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-18T14:41:20.862 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-04-18T14:41:20.890 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2024-04-18T14:41:20.956 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-toml (0.10.2-1) ... 2024-04-18T14:41:20.989 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2024-04-18T14:41:21.198 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2024-04-18T14:41:21.324 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2024-04-18T14:41:21.356 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2024-04-18T14:41:21.450 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-04-18T14:41:21.591 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up python3-portend (3.0.0-1) ... 2024-04-18T14:41:21.754 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2024-04-18T14:41:21.842 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-18T14:41:21.968 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up python3-jinja2 (3.0.3-1ubuntu0.1) ... 2024-04-18T14:41:22.011 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2024-04-18T14:41:22.063 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-18T14:41:22.197 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-toml (0.10.2-1) ... 2024-04-18T14:41:22.262 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-18T14:41:22.294 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2024-04-18T14:41:22.372 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up libfmt8:amd64 (8.1.1+ds1-2) ... 2024-04-18T14:41:22.456 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2024-04-18T14:41:22.473 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2024-04-18T14:41:22.582 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2024-04-18T14:41:22.586 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-04-18T14:41:22.708 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-04-18T14:41:22.766 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2024-04-18T14:41:22.871 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2024-04-18T14:41:22.997 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up python3-rsa (4.8-1) ... 2024-04-18T14:41:23.025 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-logutils (0.3.3-8) ... 2024-04-18T14:41:23.035 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2024-04-18T14:41:23.256 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up python3-webtest (2.0.35-1) ... 2024-04-18T14:41:23.285 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-tempora (4.1.2-1) ... 2024-04-18T14:41:23.286 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2024-04-18T14:41:23.507 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-04-18T14:41:23.520 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-18T14:41:23.536 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2024-04-18T14:41:23.646 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up libfmt8:amd64 (8.1.1+ds1-2) ... 2024-04-18T14:41:23.750 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2024-04-18T14:41:23.772 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2024-04-18T14:41:23.795 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-prettytable (2.5.0-2) ... 2024-04-18T14:41:24.063 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-04-18T14:41:24.090 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2024-04-18T14:41:24.143 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up python3-pastescript (2.0.2-4) ... 2024-04-18T14:41:24.164 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-websocket (1.2.3-1) ... 2024-04-18T14:41:24.325 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-logutils (0.3.3-8) ... 2024-04-18T14:41:24.426 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2024-04-18T14:41:24.427 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2024-04-18T14:41:24.550 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-04-18T14:41:24.576 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-tempora (4.1.2-1) ... 2024-04-18T14:41:24.763 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-04-18T14:41:24.836 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2024-04-18T14:41:24.851 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-webob (1:1.8.6-1.1) ... 2024-04-18T14:41:24.897 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up librados2 (18.2.2-1240-g6a7528e4-1jammy) ... 2024-04-18T14:41:24.998 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up librgw2 (18.2.2-1240-g6a7528e4-1jammy) ... 2024-04-18T14:41:25.070 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-prettytable (2.5.0-2) ... 2024-04-18T14:41:25.099 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up libsqlite3-mod-ceph (18.2.2-1240-g6a7528e4-1jammy) ... 2024-04-18T14:41:25.160 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2024-04-18T14:41:25.208 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up libcephfs2 (18.2.2-1240-g6a7528e4-1jammy) ... 2024-04-18T14:41:25.334 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up libradosstriper1 (18.2.2-1240-g6a7528e4-1jammy) ... 2024-04-18T14:41:25.337 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-04-18T14:41:25.420 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2024-04-18T14:41:25.472 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-websocket (1.2.3-1) ... 2024-04-18T14:41:25.537 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up python3-google-auth (1.5.1-3) ... 2024-04-18T14:41:25.748 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2024-04-18T14:41:25.813 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up librbd1 (18.2.2-1240-g6a7528e4-1jammy) ... 2024-04-18T14:41:25.827 INFO:teuthology.orchestra.run.smithi134.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2024-04-18T14:41:25.857 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-04-18T14:41:25.923 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up ceph-mgr-modules-core (18.2.2-1240-g6a7528e4-1jammy) ... 2024-04-18T14:41:26.025 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up ceph-fuse (18.2.2-1240-g6a7528e4-1jammy) ... 2024-04-18T14:41:26.064 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-04-18T14:41:26.125 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-webob (1:1.8.6-1.1) ... 2024-04-18T14:41:26.190 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2024-04-18T14:41:26.238 INFO:teuthology.orchestra.run.smithi086.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-04-18T14:41:26.238 INFO:teuthology.orchestra.run.smithi086.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-04-18T14:41:26.435 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2024-04-18T14:41:26.575 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2024-04-18T14:41:26.686 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2024-04-18T14:41:26.692 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up libcephfs-dev (18.2.2-1240-g6a7528e4-1jammy) ... 2024-04-18T14:41:26.818 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up python3-rados (18.2.2-1240-g6a7528e4-1jammy) ... 2024-04-18T14:41:26.835 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-portend (3.0.0-1) ... 2024-04-18T14:41:26.944 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2024-04-18T14:41:27.086 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-18T14:41:27.135 INFO:teuthology.orchestra.run.smithi119.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2024-04-18T14:41:27.212 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-jinja2 (3.0.3-1ubuntu0.1) ... 2024-04-18T14:41:27.405 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-04-18T14:41:27.530 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2024-04-18T14:41:27.531 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2024-04-18T14:41:27.814 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-04-18T14:41:27.916 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2024-04-18T14:41:28.082 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2024-04-18T14:41:28.098 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up python3-rbd (18.2.2-1240-g6a7528e4-1jammy) ... 2024-04-18T14:41:28.193 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-portend (3.0.0-1) ... 2024-04-18T14:41:28.207 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up rbd-fuse (18.2.2-1240-g6a7528e4-1jammy) ... 2024-04-18T14:41:28.208 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-rsa (4.8-1) ... 2024-04-18T14:41:28.333 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up python3-rgw (18.2.2-1240-g6a7528e4-1jammy) ... 2024-04-18T14:41:28.443 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-18T14:41:28.459 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up python3-cephfs (18.2.2-1240-g6a7528e4-1jammy) ... 2024-04-18T14:41:28.476 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-webtest (2.0.35-1) ... 2024-04-18T14:41:28.569 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-jinja2 (3.0.3-1ubuntu0.1) ... 2024-04-18T14:41:28.585 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up ceph-common (18.2.2-1240-g6a7528e4-1jammy) ... 2024-04-18T14:41:28.743 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-04-18T14:41:28.887 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2024-04-18T14:41:29.036 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2024-04-18T14:41:29.144 INFO:teuthology.orchestra.run.smithi086.stdout:Adding group ceph....done 2024-04-18T14:41:29.188 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-04-18T14:41:29.430 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-pastescript (2.0.2-4) ... 2024-04-18T14:41:29.479 INFO:teuthology.orchestra.run.smithi086.stdout:Adding system user ceph....done 2024-04-18T14:41:29.506 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2024-04-18T14:41:29.632 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-rsa (4.8-1) ... 2024-04-18T14:41:29.647 INFO:teuthology.orchestra.run.smithi086.stdout:Setting system user ceph properties....done 2024-04-18T14:41:29.661 INFO:teuthology.orchestra.run.smithi086.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2024-04-18T14:41:29.689 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2024-04-18T14:41:29.795 INFO:teuthology.orchestra.run.smithi086.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2024-04-18T14:41:29.899 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-webtest (2.0.35-1) ... 2024-04-18T14:41:30.033 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-04-18T14:41:30.096 INFO:teuthology.orchestra.run.smithi086.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2024-04-18T14:41:30.161 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up librados2 (18.2.2-1240-g6a7528e4-1jammy) ... 2024-04-18T14:41:30.176 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-04-18T14:41:30.285 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up librgw2 (18.2.2-1240-g6a7528e4-1jammy) ... 2024-04-18T14:41:30.411 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up libsqlite3-mod-ceph (18.2.2-1240-g6a7528e4-1jammy) ... 2024-04-18T14:41:30.436 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2024-04-18T14:41:30.537 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up libcephfs2 (18.2.2-1240-g6a7528e4-1jammy) ... 2024-04-18T14:41:30.552 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up ceph-test (18.2.2-1240-g6a7528e4-1jammy) ... 2024-04-18T14:41:30.655 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up libradosstriper1 (18.2.2-1240-g6a7528e4-1jammy) ... 2024-04-18T14:41:30.678 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up radosgw (18.2.2-1240-g6a7528e4-1jammy) ... 2024-04-18T14:41:30.829 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-pastescript (2.0.2-4) ... 2024-04-18T14:41:30.866 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-google-auth (1.5.1-3) ... 2024-04-18T14:41:31.128 INFO:teuthology.orchestra.run.smithi086.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-04-18T14:41:31.128 INFO:teuthology.orchestra.run.smithi086.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-04-18T14:41:31.130 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2024-04-18T14:41:31.176 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up librbd1 (18.2.2-1240-g6a7528e4-1jammy) ... 2024-04-18T14:41:31.302 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up ceph-mgr-modules-core (18.2.2-1240-g6a7528e4-1jammy) ... 2024-04-18T14:41:31.428 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up ceph-fuse (18.2.2-1240-g6a7528e4-1jammy) ... 2024-04-18T14:41:31.465 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-04-18T14:41:31.575 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up librados2 (18.2.2-1240-g6a7528e4-1jammy) ... 2024-04-18T14:41:31.588 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up ceph-base (18.2.2-1240-g6a7528e4-1jammy) ... 2024-04-18T14:41:31.643 INFO:teuthology.orchestra.run.smithi134.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-04-18T14:41:31.643 INFO:teuthology.orchestra.run.smithi134.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-04-18T14:41:31.701 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up librgw2 (18.2.2-1240-g6a7528e4-1jammy) ... 2024-04-18T14:41:31.827 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up libsqlite3-mod-ceph (18.2.2-1240-g6a7528e4-1jammy) ... 2024-04-18T14:41:31.912 INFO:teuthology.orchestra.run.smithi086.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2024-04-18T14:41:31.953 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up libcephfs2 (18.2.2-1240-g6a7528e4-1jammy) ... 2024-04-18T14:41:32.079 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up libradosstriper1 (18.2.2-1240-g6a7528e4-1jammy) ... 2024-04-18T14:41:32.097 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up libcephfs-dev (18.2.2-1240-g6a7528e4-1jammy) ... 2024-04-18T14:41:32.214 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-rados (18.2.2-1240-g6a7528e4-1jammy) ... 2024-04-18T14:41:32.282 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-google-auth (1.5.1-3) ... 2024-04-18T14:41:32.340 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2024-04-18T14:41:32.357 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up ceph-mds (18.2.2-1240-g6a7528e4-1jammy) ... 2024-04-18T14:41:32.542 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up librbd1 (18.2.2-1240-g6a7528e4-1jammy) ... 2024-04-18T14:41:32.567 INFO:teuthology.orchestra.run.smithi086.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-04-18T14:41:32.567 INFO:teuthology.orchestra.run.smithi086.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-04-18T14:41:32.676 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up ceph-mgr-modules-core (18.2.2-1240-g6a7528e4-1jammy) ... 2024-04-18T14:41:32.802 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up ceph-fuse (18.2.2-1240-g6a7528e4-1jammy) ... 2024-04-18T14:41:33.002 INFO:teuthology.orchestra.run.smithi119.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-04-18T14:41:33.002 INFO:teuthology.orchestra.run.smithi119.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-04-18T14:41:33.033 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up ceph-mgr (18.2.2-1240-g6a7528e4-1jammy) ... 2024-04-18T14:41:33.259 INFO:teuthology.orchestra.run.smithi086.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-04-18T14:41:33.260 INFO:teuthology.orchestra.run.smithi086.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-04-18T14:41:33.504 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up libcephfs-dev (18.2.2-1240-g6a7528e4-1jammy) ... 2024-04-18T14:41:33.570 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-rbd (18.2.2-1240-g6a7528e4-1jammy) ... 2024-04-18T14:41:33.630 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-rados (18.2.2-1240-g6a7528e4-1jammy) ... 2024-04-18T14:41:33.696 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up rbd-fuse (18.2.2-1240-g6a7528e4-1jammy) ... 2024-04-18T14:41:33.726 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up ceph-osd (18.2.2-1240-g6a7528e4-1jammy) ... 2024-04-18T14:41:33.756 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2024-04-18T14:41:33.797 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-rgw (18.2.2-1240-g6a7528e4-1jammy) ... 2024-04-18T14:41:33.898 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-cephfs (18.2.2-1240-g6a7528e4-1jammy) ... 2024-04-18T14:41:34.011 INFO:teuthology.orchestra.run.smithi086.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-04-18T14:41:34.012 INFO:teuthology.orchestra.run.smithi086.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-04-18T14:41:34.033 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up ceph-common (18.2.2-1240-g6a7528e4-1jammy) ... 2024-04-18T14:41:34.511 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up ceph-mgr-k8sevents (18.2.2-1240-g6a7528e4-1jammy) ... 2024-04-18T14:41:34.585 INFO:teuthology.orchestra.run.smithi134.stdout:Adding group ceph....done 2024-04-18T14:41:34.637 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up ceph-mgr-diskprediction-local (18.2.2-1240-g6a7528e4-1jammy) ... 2024-04-18T14:41:34.796 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up ceph-mon (18.2.2-1240-g6a7528e4-1jammy) ... 2024-04-18T14:41:34.886 INFO:teuthology.orchestra.run.smithi134.stdout:Adding system user ceph....done 2024-04-18T14:41:34.994 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-rbd (18.2.2-1240-g6a7528e4-1jammy) ... 2024-04-18T14:41:35.009 INFO:teuthology.orchestra.run.smithi086.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-04-18T14:41:35.010 INFO:teuthology.orchestra.run.smithi086.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-04-18T14:41:35.054 INFO:teuthology.orchestra.run.smithi134.stdout:Setting system user ceph properties....done 2024-04-18T14:41:35.066 INFO:teuthology.orchestra.run.smithi134.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2024-04-18T14:41:35.145 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up rbd-fuse (18.2.2-1240-g6a7528e4-1jammy) ... 2024-04-18T14:41:35.204 INFO:teuthology.orchestra.run.smithi134.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2024-04-18T14:41:35.271 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-rgw (18.2.2-1240-g6a7528e4-1jammy) ... 2024-04-18T14:41:35.397 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-cephfs (18.2.2-1240-g6a7528e4-1jammy) ... 2024-04-18T14:41:35.447 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up ceph-mgr-cephadm (18.2.2-1240-g6a7528e4-1jammy) ... 2024-04-18T14:41:35.494 INFO:teuthology.orchestra.run.smithi134.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2024-04-18T14:41:35.523 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up ceph-common (18.2.2-1240-g6a7528e4-1jammy) ... 2024-04-18T14:41:35.760 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up ceph (18.2.2-1240-g6a7528e4-1jammy) ... 2024-04-18T14:41:35.885 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up ceph-mgr-dashboard (18.2.2-1240-g6a7528e4-1jammy) ... 2024-04-18T14:41:35.959 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up ceph-test (18.2.2-1240-g6a7528e4-1jammy) ... 2024-04-18T14:41:36.032 INFO:teuthology.orchestra.run.smithi119.stdout:Adding group ceph....done 2024-04-18T14:41:36.036 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up ceph-volume (18.2.2-1240-g6a7528e4-1jammy) ... 2024-04-18T14:41:36.085 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up radosgw (18.2.2-1240-g6a7528e4-1jammy) ... 2024-04-18T14:41:36.389 INFO:teuthology.orchestra.run.smithi086.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-04-18T14:41:36.401 INFO:teuthology.orchestra.run.smithi119.stdout:Adding system user ceph....done 2024-04-18T14:41:36.552 INFO:teuthology.orchestra.run.smithi134.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-04-18T14:41:36.552 INFO:teuthology.orchestra.run.smithi134.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-04-18T14:41:36.569 INFO:teuthology.orchestra.run.smithi119.stdout:Setting system user ceph properties....done 2024-04-18T14:41:36.586 INFO:teuthology.orchestra.run.smithi119.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2024-04-18T14:41:36.723 INFO:teuthology.orchestra.run.smithi119.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2024-04-18T14:41:37.012 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up ceph-base (18.2.2-1240-g6a7528e4-1jammy) ... 2024-04-18T14:41:37.057 INFO:teuthology.orchestra.run.smithi119.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2024-04-18T14:41:37.328 INFO:teuthology.orchestra.run.smithi134.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2024-04-18T14:41:37.414 INFO:teuthology.orchestra.run.smithi086.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-04-18T14:41:37.516 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up ceph-test (18.2.2-1240-g6a7528e4-1jammy) ... 2024-04-18T14:41:37.633 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up radosgw (18.2.2-1240-g6a7528e4-1jammy) ... 2024-04-18T14:41:37.805 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up ceph-mds (18.2.2-1240-g6a7528e4-1jammy) ... 2024-04-18T14:41:37.864 INFO:teuthology.orchestra.run.smithi086.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-04-18T14:41:37.869 DEBUG:teuthology.parallel:result is None 2024-04-18T14:41:38.050 INFO:teuthology.orchestra.run.smithi134.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-04-18T14:41:38.050 INFO:teuthology.orchestra.run.smithi134.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-04-18T14:41:38.114 INFO:teuthology.orchestra.run.smithi119.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-04-18T14:41:38.114 INFO:teuthology.orchestra.run.smithi119.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-04-18T14:41:38.507 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up ceph-mgr (18.2.2-1240-g6a7528e4-1jammy) ... 2024-04-18T14:41:38.610 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up ceph-base (18.2.2-1240-g6a7528e4-1jammy) ... 2024-04-18T14:41:38.717 INFO:teuthology.orchestra.run.smithi134.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-04-18T14:41:38.717 INFO:teuthology.orchestra.run.smithi134.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-04-18T14:41:38.966 INFO:teuthology.orchestra.run.smithi119.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2024-04-18T14:41:39.437 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up ceph-mds (18.2.2-1240-g6a7528e4-1jammy) ... 2024-04-18T14:41:39.471 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up ceph-osd (18.2.2-1240-g6a7528e4-1jammy) ... 2024-04-18T14:41:39.673 INFO:teuthology.orchestra.run.smithi119.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-04-18T14:41:39.673 INFO:teuthology.orchestra.run.smithi119.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-04-18T14:41:39.798 INFO:teuthology.orchestra.run.smithi134.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-04-18T14:41:39.798 INFO:teuthology.orchestra.run.smithi134.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-04-18T14:41:40.139 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up ceph-mgr (18.2.2-1240-g6a7528e4-1jammy) ... 2024-04-18T14:41:40.260 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up ceph-mgr-k8sevents (18.2.2-1240-g6a7528e4-1jammy) ... 2024-04-18T14:41:40.357 INFO:teuthology.orchestra.run.smithi119.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-04-18T14:41:40.357 INFO:teuthology.orchestra.run.smithi119.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-04-18T14:41:40.386 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up ceph-mgr-diskprediction-local (18.2.2-1240-g6a7528e4-1jammy) ... 2024-04-18T14:41:40.529 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up ceph-mon (18.2.2-1240-g6a7528e4-1jammy) ... 2024-04-18T14:41:40.741 INFO:teuthology.orchestra.run.smithi134.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-04-18T14:41:40.741 INFO:teuthology.orchestra.run.smithi134.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-04-18T14:41:40.848 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up ceph-osd (18.2.2-1240-g6a7528e4-1jammy) ... 2024-04-18T14:41:41.127 INFO:teuthology.orchestra.run.smithi119.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-04-18T14:41:41.127 INFO:teuthology.orchestra.run.smithi119.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-04-18T14:41:41.172 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up ceph-mgr-cephadm (18.2.2-1240-g6a7528e4-1jammy) ... 2024-04-18T14:41:41.315 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up ceph (18.2.2-1240-g6a7528e4-1jammy) ... 2024-04-18T14:41:41.442 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up ceph-mgr-dashboard (18.2.2-1240-g6a7528e4-1jammy) ... 2024-04-18T14:41:41.592 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up ceph-volume (18.2.2-1240-g6a7528e4-1jammy) ... 2024-04-18T14:41:41.609 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up ceph-mgr-k8sevents (18.2.2-1240-g6a7528e4-1jammy) ... 2024-04-18T14:41:41.735 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up ceph-mgr-diskprediction-local (18.2.2-1240-g6a7528e4-1jammy) ... 2024-04-18T14:41:41.886 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up ceph-mon (18.2.2-1240-g6a7528e4-1jammy) ... 2024-04-18T14:41:41.937 INFO:teuthology.orchestra.run.smithi134.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-04-18T14:41:42.098 INFO:teuthology.orchestra.run.smithi119.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-04-18T14:41:42.098 INFO:teuthology.orchestra.run.smithi119.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-04-18T14:41:42.562 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up ceph-mgr-cephadm (18.2.2-1240-g6a7528e4-1jammy) ... 2024-04-18T14:41:42.713 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up ceph (18.2.2-1240-g6a7528e4-1jammy) ... 2024-04-18T14:41:42.830 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up ceph-mgr-dashboard (18.2.2-1240-g6a7528e4-1jammy) ... 2024-04-18T14:41:42.973 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up ceph-volume (18.2.2-1240-g6a7528e4-1jammy) ... 2024-04-18T14:41:42.996 INFO:teuthology.orchestra.run.smithi134.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-04-18T14:41:43.301 INFO:teuthology.orchestra.run.smithi119.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-04-18T14:41:43.450 INFO:teuthology.orchestra.run.smithi134.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-04-18T14:41:43.455 DEBUG:teuthology.parallel:result is None 2024-04-18T14:41:44.085 INFO:teuthology.orchestra.run.smithi119.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-04-18T14:41:44.543 INFO:teuthology.orchestra.run.smithi119.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-04-18T14:41:44.547 DEBUG:teuthology.parallel:result is None 2024-04-18T14:41:44.548 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=6a7528e4aecd36b18c4b41cee6012e9f92aa7ab0 2024-04-18T14:41:44.697 DEBUG:teuthology.orchestra.run.smithi086:> dpkg-query -W -f '${Version}' ceph 2024-04-18T14:41:44.717 INFO:teuthology.orchestra.run.smithi086.stdout:18.2.2-1240-g6a7528e4-1jammy 2024-04-18T14:41:44.717 INFO:teuthology.packaging:The installed version of ceph is 18.2.2-1240-g6a7528e4-1jammy 2024-04-18T14:41:44.717 INFO:teuthology.task.install:The correct ceph version 18.2.2-1240-g6a7528e4-1jammy is installed. 2024-04-18T14:41:44.722 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=6a7528e4aecd36b18c4b41cee6012e9f92aa7ab0 2024-04-18T14:41:44.941 DEBUG:teuthology.orchestra.run.smithi096:> dpkg-query -W -f '${Version}' ceph 2024-04-18T14:41:44.960 INFO:teuthology.orchestra.run.smithi096.stdout:18.2.2-1240-g6a7528e4-1jammy 2024-04-18T14:41:44.960 INFO:teuthology.packaging:The installed version of ceph is 18.2.2-1240-g6a7528e4-1jammy 2024-04-18T14:41:44.960 INFO:teuthology.task.install:The correct ceph version 18.2.2-1240-g6a7528e4-1jammy is installed. 2024-04-18T14:41:44.963 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=6a7528e4aecd36b18c4b41cee6012e9f92aa7ab0 2024-04-18T14:41:45.108 DEBUG:teuthology.orchestra.run.smithi119:> dpkg-query -W -f '${Version}' ceph 2024-04-18T14:41:45.127 INFO:teuthology.orchestra.run.smithi119.stdout:18.2.2-1240-g6a7528e4-1jammy 2024-04-18T14:41:45.127 INFO:teuthology.packaging:The installed version of ceph is 18.2.2-1240-g6a7528e4-1jammy 2024-04-18T14:41:45.127 INFO:teuthology.task.install:The correct ceph version 18.2.2-1240-g6a7528e4-1jammy is installed. 2024-04-18T14:41:45.130 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=6a7528e4aecd36b18c4b41cee6012e9f92aa7ab0 2024-04-18T14:41:45.276 DEBUG:teuthology.orchestra.run.smithi134:> dpkg-query -W -f '${Version}' ceph 2024-04-18T14:41:45.295 INFO:teuthology.orchestra.run.smithi134.stdout:18.2.2-1240-g6a7528e4-1jammy 2024-04-18T14:41:45.295 INFO:teuthology.packaging:The installed version of ceph is 18.2.2-1240-g6a7528e4-1jammy 2024-04-18T14:41:45.296 INFO:teuthology.task.install:The correct ceph version 18.2.2-1240-g6a7528e4-1jammy is installed. 2024-04-18T14:41:45.297 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-04-18T14:41:45.298 DEBUG:teuthology.orchestra.run.smithi086:> set -ex 2024-04-18T14:41:45.298 DEBUG:teuthology.orchestra.run.smithi086:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-04-18T14:41:45.312 DEBUG:teuthology.orchestra.run.smithi096:> set -ex 2024-04-18T14:41:45.313 DEBUG:teuthology.orchestra.run.smithi096:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-04-18T14:41:45.326 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2024-04-18T14:41:45.326 DEBUG:teuthology.orchestra.run.smithi119:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-04-18T14:41:45.340 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-04-18T14:41:45.340 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-04-18T14:41:45.353 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-04-18T14:41:45.353 DEBUG:teuthology.orchestra.run.smithi086:> set -ex 2024-04-18T14:41:45.354 DEBUG:teuthology.orchestra.run.smithi086:> sudo dd of=/usr/bin/daemon-helper 2024-04-18T14:41:45.369 DEBUG:teuthology.orchestra.run.smithi086:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-04-18T14:41:45.424 DEBUG:teuthology.orchestra.run.smithi096:> set -ex 2024-04-18T14:41:45.424 DEBUG:teuthology.orchestra.run.smithi096:> sudo dd of=/usr/bin/daemon-helper 2024-04-18T14:41:45.437 DEBUG:teuthology.orchestra.run.smithi096:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-04-18T14:41:45.496 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2024-04-18T14:41:45.496 DEBUG:teuthology.orchestra.run.smithi119:> sudo dd of=/usr/bin/daemon-helper 2024-04-18T14:41:45.509 DEBUG:teuthology.orchestra.run.smithi119:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-04-18T14:41:45.562 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-04-18T14:41:45.562 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd of=/usr/bin/daemon-helper 2024-04-18T14:41:45.575 DEBUG:teuthology.orchestra.run.smithi134:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-04-18T14:41:45.629 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-04-18T14:41:45.630 DEBUG:teuthology.orchestra.run.smithi086:> set -ex 2024-04-18T14:41:45.630 DEBUG:teuthology.orchestra.run.smithi086:> sudo dd of=/usr/bin/adjust-ulimits 2024-04-18T14:41:45.643 DEBUG:teuthology.orchestra.run.smithi086:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-04-18T14:41:45.696 DEBUG:teuthology.orchestra.run.smithi096:> set -ex 2024-04-18T14:41:45.696 DEBUG:teuthology.orchestra.run.smithi096:> sudo dd of=/usr/bin/adjust-ulimits 2024-04-18T14:41:45.709 DEBUG:teuthology.orchestra.run.smithi096:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-04-18T14:41:45.764 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2024-04-18T14:41:45.764 DEBUG:teuthology.orchestra.run.smithi119:> sudo dd of=/usr/bin/adjust-ulimits 2024-04-18T14:41:45.778 DEBUG:teuthology.orchestra.run.smithi119:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-04-18T14:41:45.833 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-04-18T14:41:45.834 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd of=/usr/bin/adjust-ulimits 2024-04-18T14:41:45.847 DEBUG:teuthology.orchestra.run.smithi134:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-04-18T14:41:45.901 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-04-18T14:41:45.901 DEBUG:teuthology.orchestra.run.smithi086:> set -ex 2024-04-18T14:41:45.901 DEBUG:teuthology.orchestra.run.smithi086:> sudo dd of=/usr/bin/stdin-killer 2024-04-18T14:41:45.915 DEBUG:teuthology.orchestra.run.smithi086:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-04-18T14:41:45.968 DEBUG:teuthology.orchestra.run.smithi096:> set -ex 2024-04-18T14:41:45.968 DEBUG:teuthology.orchestra.run.smithi096:> sudo dd of=/usr/bin/stdin-killer 2024-04-18T14:41:45.981 DEBUG:teuthology.orchestra.run.smithi096:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-04-18T14:41:46.036 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2024-04-18T14:41:46.036 DEBUG:teuthology.orchestra.run.smithi119:> sudo dd of=/usr/bin/stdin-killer 2024-04-18T14:41:46.050 DEBUG:teuthology.orchestra.run.smithi119:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-04-18T14:41:46.107 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-04-18T14:41:46.107 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd of=/usr/bin/stdin-killer 2024-04-18T14:41:46.120 DEBUG:teuthology.orchestra.run.smithi134:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-04-18T14:41:46.173 INFO:teuthology.run_tasks:Running task ceph... 2024-04-18T14:41:46.266 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-04-18T14:41:46.267 DEBUG:teuthology.orchestra.run.smithi086:> sudo chmod 777 /var/log/ceph 2024-04-18T14:41:46.270 DEBUG:teuthology.orchestra.run.smithi096:> sudo chmod 777 /var/log/ceph 2024-04-18T14:41:46.273 DEBUG:teuthology.orchestra.run.smithi119:> sudo chmod 777 /var/log/ceph 2024-04-18T14:41:46.276 DEBUG:teuthology.orchestra.run.smithi134:> sudo chmod 777 /var/log/ceph 2024-04-18T14:41:46.290 INFO:tasks.ceph:Disabling ceph logrotate... 2024-04-18T14:41:46.290 DEBUG:teuthology.orchestra.run.smithi086:> sudo rm -f -- /etc/logrotate.d/ceph 2024-04-18T14:41:46.326 DEBUG:teuthology.orchestra.run.smithi096:> sudo rm -f -- /etc/logrotate.d/ceph 2024-04-18T14:41:46.330 DEBUG:teuthology.orchestra.run.smithi119:> sudo rm -f -- /etc/logrotate.d/ceph 2024-04-18T14:41:46.333 DEBUG:teuthology.orchestra.run.smithi134:> sudo rm -f -- /etc/logrotate.d/ceph 2024-04-18T14:41:46.345 INFO:tasks.ceph:Creating extra log directories... 2024-04-18T14:41:46.346 DEBUG:teuthology.orchestra.run.smithi086:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-04-18T14:41:46.382 DEBUG:teuthology.orchestra.run.smithi096:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-04-18T14:41:46.387 DEBUG:teuthology.orchestra.run.smithi119:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-04-18T14:41:46.390 DEBUG:teuthology.orchestra.run.smithi134:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-04-18T14:41:46.418 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-04-18T14:41:46.418 INFO:tasks.ceph:config {'conf': {'osd': {'debug monc': 20, 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'stupid', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'bluestore zero block detection': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd blocked scrub grace period': 3600, 'osd debug reject backfill probability': 0.3, 'osd debug verify cached snaps': True, 'osd debug verify missing on start': True, 'osd failsafe full ratio': 0.95, 'osd heartbeat use min delay socket': True, 'osd max backfills': 3, 'osd max markdown count': 1000, 'osd mclock override recovery settings': True, 'osd mclock profile': 'high_recovery_ops', 'osd objectstore': 'bluestore', 'osd op queue': 'debug_random', 'osd op queue cut off': 'debug_random', 'osd scrub max interval': 120, 'osd scrub min interval': 60, 'osd shutdown pgref assert': True}, 'global': {'mon client directed command retry': 5, 'mon election default strategy': 1, 'ms inject socket failures': 5000}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon scrub interval': 300}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(OSD_SLOW_PING_TIME', 'but it is still running', 'objects unfound and apparently lost', 'slow request', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', '\\(SLOW_OPS\\)', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-04-18T14:41:46.419 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/yuriw-2024-04-18_14:15:21-rados-wip-yuri2-testing-2024-04-17-0823-reef-distro-default-smithi/7662103', 'branch': 'wip-yuri2-testing-2024-04-17-0823-reef', 'description': 'rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/classic msgr-failures/few objectstore/bluestore-stupid rados recovery-overrides/{default} supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2}', 'email': 'yweinste@redhat.com', 'first_in_suite': False, 'job_id': '7662103', 'kernel': {'kdb': 1, 'sha1': 'distro'}, 'ktype': 'distro', 'last_in_suite': False, 'machine_type': 'smithi', 'name': 'yuriw-2024-04-18_14:15:21-rados-wip-yuri2-testing-2024-04-17-0823-reef-distro-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 10}}], 'os_type': 'ubuntu', 'os_version': '22.04', 'overrides': {'admin_socket': {'branch': 'wip-yuri2-testing-2024-04-17-0823-reef'}, 'ceph': {'conf': {'global': {'mon client directed command retry': 5, 'mon election default strategy': 1, 'ms inject socket failures': 5000}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon scrub interval': 300}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'stupid', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'bluestore zero block detection': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd blocked scrub grace period': 3600, 'osd debug reject backfill probability': 0.3, 'osd debug verify cached snaps': True, 'osd debug verify missing on start': True, 'osd failsafe full ratio': 0.95, 'osd heartbeat use min delay socket': True, 'osd max backfills': 3, 'osd max markdown count': 1000, 'osd mclock override recovery settings': True, 'osd mclock profile': 'high_recovery_ops', 'osd objectstore': 'bluestore', 'osd op queue': 'debug_random', 'osd op queue cut off': 'debug_random', 'osd scrub max interval': 120, 'osd scrub min interval': 60, 'osd shutdown pgref assert': True}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(OSD_SLOW_PING_TIME', 'but it is still running', 'objects unfound and apparently lost', 'slow request', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', '\\(SLOW_OPS\\)', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from'], 'sha1': '6a7528e4aecd36b18c4b41cee6012e9f92aa7ab0'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': '6a7528e4aecd36b18c4b41cee6012e9f92aa7ab0'}}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-yuri2-testing-2024-04-17-0823-reef', 'sha1': '6a7528e4aecd36b18c4b41cee6012e9f92aa7ab0'}}, 'owner': 'scheduled_yuriw@teuthology', 'priority': 75, 'repo': 'https://github.com/ceph/ceph-ci.git', 'roles': [['mon.a', 'mgr.y', 'osd.0', 'osd.4', 'osd.8', 'osd.12'], ['mon.b', 'osd.1', 'osd.5', 'osd.9', 'osd.13'], ['mon.c', 'osd.2', 'osd.6', 'osd.10', 'osd.14'], ['mgr.x', 'osd.3', 'osd.7', 'osd.11', 'osd.15', 'client.0']], 'seed': 400, 'sha1': '6a7528e4aecd36b18c4b41cee6012e9f92aa7ab0', 'sleep_before_teardown': 0, 'subset': '111/120000', 'suite': 'rados', 'suite_branch': 'wip-yuri2-testing-2024-04-17-0823-reef', 'suite_path': '/home/teuthworker/src/github.com_ceph_ceph-c_6a7528e4aecd36b18c4b41cee6012e9f92aa7ab0/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://github.com/ceph/ceph-ci.git', 'suite_sha1': '6a7528e4aecd36b18c4b41cee6012e9f92aa7ab0', 'targets': {'smithi086.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBAFHCSwZshUquelH2RH/eCH33F5R6VkY1s0tq4s5Aa+0YH1B7AU3VMQzdyFi9F4Dz90hYyeChQSBS3ldjwcbTCs=', 'smithi096.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBGVhDLNLAPvVASgjD/Bp9bUGYiKjehC+HF7GbNof5wULz61p/pN8O5Cbpb8rkR3A92bdsHKIQHq91QrPYUJGc7Y=', 'smithi119.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJDd9poIuqlwXxtxjXWvgCa/Jf5tYYWDVJz6CW9q3mP/9rc7gFG9jSzjtZ/FJK6juz60g8iFwDOQlVJPyeKTU14=', 'smithi134.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBG76MFDcDfRRvMjHdI3K9ehbCKKaXuNQyIUBBDrOB9AH63imyNkrwmbU7hKqmbj0qgPebvJ91SPqBhkoqlnaz1U='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'kdb': 1, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': None}, {'ceph': {'conf': {'osd': {'debug monc': 20, 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'stupid', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'bluestore zero block detection': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd blocked scrub grace period': 3600, 'osd debug reject backfill probability': 0.3, 'osd debug verify cached snaps': True, 'osd debug verify missing on start': True, 'osd failsafe full ratio': 0.95, 'osd heartbeat use min delay socket': True, 'osd max backfills': 3, 'osd max markdown count': 1000, 'osd mclock override recovery settings': True, 'osd mclock profile': 'high_recovery_ops', 'osd objectstore': 'bluestore', 'osd op queue': 'debug_random', 'osd op queue cut off': 'debug_random', 'osd scrub max interval': 120, 'osd scrub min interval': 60, 'osd shutdown pgref assert': True}, 'global': {'mon client directed command retry': 5, 'mon election default strategy': 1, 'ms inject socket failures': 5000}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon scrub interval': 300}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(OSD_SLOW_PING_TIME', 'but it is still running', 'objects unfound and apparently lost', 'slow request', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', '\\(SLOW_OPS\\)', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from'], 'sha1': '6a7528e4aecd36b18c4b41cee6012e9f92aa7ab0', 'cluster': 'ceph'}}, {'thrashosds': {'aggressive_pg_num_changes': False, 'chance_pgnum_grow': 1, 'chance_pgnum_shrink': 1, 'chance_pgpnum_fix': 1, 'min_in': 8, 'timeout': 1200}}, {'rados': {'clients': ['client.0'], 'ec_pool': True, 'erasure_code_profile': {'c': 2, 'crush-failure-domain': 'osd', 'k': 4, 'm': 3, 'name': 'shecprofile', 'plugin': 'shec'}, 'objects': 50, 'op_weights': {'append': 100, 'copy_from': 50, 'delete': 50, 'read': 100, 'rmattr': 25, 'rollback': 50, 'setattr': 25, 'snap_create': 50, 'snap_remove': 50, 'write': 0}, 'ops': 400, 'write_append_excl': False}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': []}, 'teuthology_branch': 'main', 'teuthology_sha1': '9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17', 'timestamp': '2024-04-18_14:15:21', 'tube': 'smithi', 'user': 'yuriw', 'verbose': True, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885'} 2024-04-18T14:41:46.419 DEBUG:teuthology.orchestra.run.smithi086:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-04-18T14:41:46.438 DEBUG:teuthology.orchestra.run.smithi096:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-04-18T14:41:46.442 DEBUG:teuthology.orchestra.run.smithi119:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-04-18T14:41:46.445 DEBUG:teuthology.orchestra.run.smithi134:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-04-18T14:41:46.451 DEBUG:teuthology.orchestra.run.smithi086:> sudo install -d -m0777 -- /var/run/ceph 2024-04-18T14:41:46.486 DEBUG:teuthology.orchestra.run.smithi096:> sudo install -d -m0777 -- /var/run/ceph 2024-04-18T14:41:46.490 DEBUG:teuthology.orchestra.run.smithi119:> sudo install -d -m0777 -- /var/run/ceph 2024-04-18T14:41:46.496 DEBUG:teuthology.orchestra.run.smithi134:> sudo install -d -m0777 -- /var/run/ceph 2024-04-18T14:41:46.510 DEBUG:teuthology.orchestra.run.smithi086:> set -ex 2024-04-18T14:41:46.510 DEBUG:teuthology.orchestra.run.smithi086:> dd if=/scratch_devs of=/dev/stdout 2024-04-18T14:41:46.545 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-04-18T14:41:46.545 DEBUG:teuthology.orchestra.run.smithi086:> stat /dev/vg_nvme/lv_1 2024-04-18T14:41:46.593 INFO:teuthology.orchestra.run.smithi086.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-04-18T14:41:46.593 INFO:teuthology.orchestra.run.smithi086.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-18T14:41:46.593 INFO:teuthology.orchestra.run.smithi086.stdout:Device: 5h/5d Inode: 888 Links: 1 2024-04-18T14:41:46.593 INFO:teuthology.orchestra.run.smithi086.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-18T14:41:46.593 INFO:teuthology.orchestra.run.smithi086.stdout:Access: 2024-04-18 14:36:06.822641558 +0000 2024-04-18T14:41:46.593 INFO:teuthology.orchestra.run.smithi086.stdout:Modify: 2024-04-18 14:36:06.566643839 +0000 2024-04-18T14:41:46.593 INFO:teuthology.orchestra.run.smithi086.stdout:Change: 2024-04-18 14:36:06.566643839 +0000 2024-04-18T14:41:46.593 INFO:teuthology.orchestra.run.smithi086.stdout: Birth: - 2024-04-18T14:41:46.594 DEBUG:teuthology.orchestra.run.smithi086:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-04-18T14:41:46.647 INFO:teuthology.orchestra.run.smithi086.stderr:1+0 records in 2024-04-18T14:41:46.647 INFO:teuthology.orchestra.run.smithi086.stderr:1+0 records out 2024-04-18T14:41:46.647 INFO:teuthology.orchestra.run.smithi086.stderr:512 bytes copied, 0.000339845 s, 1.5 MB/s 2024-04-18T14:41:46.648 DEBUG:teuthology.orchestra.run.smithi086:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-04-18T14:41:46.698 DEBUG:teuthology.orchestra.run.smithi086:> stat /dev/vg_nvme/lv_2 2024-04-18T14:41:46.744 INFO:teuthology.orchestra.run.smithi086.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-04-18T14:41:46.745 INFO:teuthology.orchestra.run.smithi086.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-18T14:41:46.745 INFO:teuthology.orchestra.run.smithi086.stdout:Device: 5h/5d Inode: 905 Links: 1 2024-04-18T14:41:46.745 INFO:teuthology.orchestra.run.smithi086.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-18T14:41:46.745 INFO:teuthology.orchestra.run.smithi086.stdout:Access: 2024-04-18 14:36:07.298637316 +0000 2024-04-18T14:41:46.745 INFO:teuthology.orchestra.run.smithi086.stdout:Modify: 2024-04-18 14:36:07.034639669 +0000 2024-04-18T14:41:46.745 INFO:teuthology.orchestra.run.smithi086.stdout:Change: 2024-04-18 14:36:07.034639669 +0000 2024-04-18T14:41:46.745 INFO:teuthology.orchestra.run.smithi086.stdout: Birth: - 2024-04-18T14:41:46.745 DEBUG:teuthology.orchestra.run.smithi086:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-04-18T14:41:46.798 INFO:teuthology.orchestra.run.smithi086.stderr:1+0 records in 2024-04-18T14:41:46.798 INFO:teuthology.orchestra.run.smithi086.stderr:1+0 records out 2024-04-18T14:41:46.798 INFO:teuthology.orchestra.run.smithi086.stderr:512 bytes copied, 0.000308706 s, 1.7 MB/s 2024-04-18T14:41:46.799 DEBUG:teuthology.orchestra.run.smithi086:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-04-18T14:41:46.846 DEBUG:teuthology.orchestra.run.smithi086:> stat /dev/vg_nvme/lv_3 2024-04-18T14:41:46.893 INFO:teuthology.orchestra.run.smithi086.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-04-18T14:41:46.893 INFO:teuthology.orchestra.run.smithi086.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-18T14:41:46.893 INFO:teuthology.orchestra.run.smithi086.stdout:Device: 5h/5d Inode: 920 Links: 1 2024-04-18T14:41:46.893 INFO:teuthology.orchestra.run.smithi086.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-18T14:41:46.893 INFO:teuthology.orchestra.run.smithi086.stdout:Access: 2024-04-18 14:36:07.810632755 +0000 2024-04-18T14:41:46.893 INFO:teuthology.orchestra.run.smithi086.stdout:Modify: 2024-04-18 14:36:07.542635143 +0000 2024-04-18T14:41:46.893 INFO:teuthology.orchestra.run.smithi086.stdout:Change: 2024-04-18 14:36:07.542635143 +0000 2024-04-18T14:41:46.894 INFO:teuthology.orchestra.run.smithi086.stdout: Birth: - 2024-04-18T14:41:46.894 DEBUG:teuthology.orchestra.run.smithi086:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-04-18T14:41:46.946 INFO:teuthology.orchestra.run.smithi086.stderr:1+0 records in 2024-04-18T14:41:46.946 INFO:teuthology.orchestra.run.smithi086.stderr:1+0 records out 2024-04-18T14:41:46.946 INFO:teuthology.orchestra.run.smithi086.stderr:512 bytes copied, 0.000314335 s, 1.6 MB/s 2024-04-18T14:41:46.947 DEBUG:teuthology.orchestra.run.smithi086:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-04-18T14:41:46.995 DEBUG:teuthology.orchestra.run.smithi086:> stat /dev/vg_nvme/lv_4 2024-04-18T14:41:47.041 INFO:teuthology.orchestra.run.smithi086.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-04-18T14:41:47.041 INFO:teuthology.orchestra.run.smithi086.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-18T14:41:47.042 INFO:teuthology.orchestra.run.smithi086.stdout:Device: 5h/5d Inode: 940 Links: 1 2024-04-18T14:41:47.042 INFO:teuthology.orchestra.run.smithi086.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-18T14:41:47.042 INFO:teuthology.orchestra.run.smithi086.stdout:Access: 2024-04-18 14:36:08.310628301 +0000 2024-04-18T14:41:47.042 INFO:teuthology.orchestra.run.smithi086.stdout:Modify: 2024-04-18 14:36:08.026630831 +0000 2024-04-18T14:41:47.042 INFO:teuthology.orchestra.run.smithi086.stdout:Change: 2024-04-18 14:36:08.026630831 +0000 2024-04-18T14:41:47.042 INFO:teuthology.orchestra.run.smithi086.stdout: Birth: - 2024-04-18T14:41:47.042 DEBUG:teuthology.orchestra.run.smithi086:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-04-18T14:41:47.095 INFO:teuthology.orchestra.run.smithi086.stderr:1+0 records in 2024-04-18T14:41:47.095 INFO:teuthology.orchestra.run.smithi086.stderr:1+0 records out 2024-04-18T14:41:47.095 INFO:teuthology.orchestra.run.smithi086.stderr:512 bytes copied, 0.000299781 s, 1.7 MB/s 2024-04-18T14:41:47.096 DEBUG:teuthology.orchestra.run.smithi086:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-04-18T14:41:47.147 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.4': '/dev/vg_nvme/lv_2', 'osd.8': '/dev/vg_nvme/lv_3', 'osd.12': '/dev/vg_nvme/lv_4'} 2024-04-18T14:41:47.147 DEBUG:teuthology.orchestra.run.smithi096:> set -ex 2024-04-18T14:41:47.147 DEBUG:teuthology.orchestra.run.smithi096:> dd if=/scratch_devs of=/dev/stdout 2024-04-18T14:41:47.154 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-04-18T14:41:47.154 DEBUG:teuthology.orchestra.run.smithi096:> stat /dev/vg_nvme/lv_1 2024-04-18T14:41:47.201 INFO:teuthology.orchestra.run.smithi096.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-04-18T14:41:47.201 INFO:teuthology.orchestra.run.smithi096.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-18T14:41:47.201 INFO:teuthology.orchestra.run.smithi096.stdout:Device: 5h/5d Inode: 881 Links: 1 2024-04-18T14:41:47.202 INFO:teuthology.orchestra.run.smithi096.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-18T14:41:47.202 INFO:teuthology.orchestra.run.smithi096.stdout:Access: 2024-04-18 14:36:07.839116302 +0000 2024-04-18T14:41:47.202 INFO:teuthology.orchestra.run.smithi096.stdout:Modify: 2024-04-18 14:36:07.567118731 +0000 2024-04-18T14:41:47.202 INFO:teuthology.orchestra.run.smithi096.stdout:Change: 2024-04-18 14:36:07.567118731 +0000 2024-04-18T14:41:47.202 INFO:teuthology.orchestra.run.smithi096.stdout: Birth: - 2024-04-18T14:41:47.202 DEBUG:teuthology.orchestra.run.smithi096:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-04-18T14:41:47.256 INFO:teuthology.orchestra.run.smithi096.stderr:1+0 records in 2024-04-18T14:41:47.256 INFO:teuthology.orchestra.run.smithi096.stderr:1+0 records out 2024-04-18T14:41:47.256 INFO:teuthology.orchestra.run.smithi096.stderr:512 bytes copied, 0.000429187 s, 1.2 MB/s 2024-04-18T14:41:47.257 DEBUG:teuthology.orchestra.run.smithi096:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-04-18T14:41:47.310 DEBUG:teuthology.orchestra.run.smithi096:> stat /dev/vg_nvme/lv_2 2024-04-18T14:41:47.357 INFO:teuthology.orchestra.run.smithi096.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-04-18T14:41:47.357 INFO:teuthology.orchestra.run.smithi096.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-18T14:41:47.357 INFO:teuthology.orchestra.run.smithi096.stdout:Device: 5h/5d Inode: 904 Links: 1 2024-04-18T14:41:47.357 INFO:teuthology.orchestra.run.smithi096.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-18T14:41:47.357 INFO:teuthology.orchestra.run.smithi096.stdout:Access: 2024-04-18 14:36:08.343111800 +0000 2024-04-18T14:41:47.357 INFO:teuthology.orchestra.run.smithi096.stdout:Modify: 2024-04-18 14:36:08.071114230 +0000 2024-04-18T14:41:47.357 INFO:teuthology.orchestra.run.smithi096.stdout:Change: 2024-04-18 14:36:08.071114230 +0000 2024-04-18T14:41:47.357 INFO:teuthology.orchestra.run.smithi096.stdout: Birth: - 2024-04-18T14:41:47.357 DEBUG:teuthology.orchestra.run.smithi096:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-04-18T14:41:47.412 INFO:teuthology.orchestra.run.smithi096.stderr:1+0 records in 2024-04-18T14:41:47.412 INFO:teuthology.orchestra.run.smithi096.stderr:1+0 records out 2024-04-18T14:41:47.412 INFO:teuthology.orchestra.run.smithi096.stderr:512 bytes copied, 0.000441943 s, 1.2 MB/s 2024-04-18T14:41:47.413 DEBUG:teuthology.orchestra.run.smithi096:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-04-18T14:41:47.462 DEBUG:teuthology.orchestra.run.smithi096:> stat /dev/vg_nvme/lv_3 2024-04-18T14:41:47.509 INFO:teuthology.orchestra.run.smithi096.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-04-18T14:41:47.509 INFO:teuthology.orchestra.run.smithi096.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-18T14:41:47.509 INFO:teuthology.orchestra.run.smithi096.stdout:Device: 5h/5d Inode: 920 Links: 1 2024-04-18T14:41:47.509 INFO:teuthology.orchestra.run.smithi096.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-18T14:41:47.509 INFO:teuthology.orchestra.run.smithi096.stdout:Access: 2024-04-18 14:36:08.555109907 +0000 2024-04-18T14:41:47.509 INFO:teuthology.orchestra.run.smithi096.stdout:Modify: 2024-04-18 14:36:08.551109942 +0000 2024-04-18T14:41:47.509 INFO:teuthology.orchestra.run.smithi096.stdout:Change: 2024-04-18 14:36:08.551109942 +0000 2024-04-18T14:41:47.509 INFO:teuthology.orchestra.run.smithi096.stdout: Birth: - 2024-04-18T14:41:47.510 DEBUG:teuthology.orchestra.run.smithi096:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-04-18T14:41:47.567 INFO:teuthology.orchestra.run.smithi096.stderr:1+0 records in 2024-04-18T14:41:47.567 INFO:teuthology.orchestra.run.smithi096.stderr:1+0 records out 2024-04-18T14:41:47.567 INFO:teuthology.orchestra.run.smithi096.stderr:512 bytes copied, 0.000400273 s, 1.3 MB/s 2024-04-18T14:41:47.568 DEBUG:teuthology.orchestra.run.smithi096:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-04-18T14:41:47.618 DEBUG:teuthology.orchestra.run.smithi096:> stat /dev/vg_nvme/lv_4 2024-04-18T14:41:47.665 INFO:teuthology.orchestra.run.smithi096.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-04-18T14:41:47.665 INFO:teuthology.orchestra.run.smithi096.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-18T14:41:47.665 INFO:teuthology.orchestra.run.smithi096.stdout:Device: 5h/5d Inode: 937 Links: 1 2024-04-18T14:41:47.665 INFO:teuthology.orchestra.run.smithi096.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-18T14:41:47.665 INFO:teuthology.orchestra.run.smithi096.stdout:Access: 2024-04-18 14:36:09.299103261 +0000 2024-04-18T14:41:47.665 INFO:teuthology.orchestra.run.smithi096.stdout:Modify: 2024-04-18 14:36:09.043105547 +0000 2024-04-18T14:41:47.666 INFO:teuthology.orchestra.run.smithi096.stdout:Change: 2024-04-18 14:36:09.043105547 +0000 2024-04-18T14:41:47.666 INFO:teuthology.orchestra.run.smithi096.stdout: Birth: - 2024-04-18T14:41:47.666 DEBUG:teuthology.orchestra.run.smithi096:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-04-18T14:41:47.719 INFO:teuthology.orchestra.run.smithi096.stderr:1+0 records in 2024-04-18T14:41:47.719 INFO:teuthology.orchestra.run.smithi096.stderr:1+0 records out 2024-04-18T14:41:47.719 INFO:teuthology.orchestra.run.smithi096.stderr:512 bytes copied, 0.000344391 s, 1.5 MB/s 2024-04-18T14:41:47.720 DEBUG:teuthology.orchestra.run.smithi096:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-04-18T14:41:47.771 INFO:tasks.ceph:osd dev map: {'osd.1': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.9': '/dev/vg_nvme/lv_3', 'osd.13': '/dev/vg_nvme/lv_4'} 2024-04-18T14:41:47.771 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2024-04-18T14:41:47.771 DEBUG:teuthology.orchestra.run.smithi119:> dd if=/scratch_devs of=/dev/stdout 2024-04-18T14:41:47.777 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-04-18T14:41:47.777 DEBUG:teuthology.orchestra.run.smithi119:> stat /dev/vg_nvme/lv_1 2024-04-18T14:41:47.823 INFO:teuthology.orchestra.run.smithi119.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-04-18T14:41:47.824 INFO:teuthology.orchestra.run.smithi119.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-18T14:41:47.824 INFO:teuthology.orchestra.run.smithi119.stdout:Device: 5h/5d Inode: 889 Links: 1 2024-04-18T14:41:47.824 INFO:teuthology.orchestra.run.smithi119.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-18T14:41:47.824 INFO:teuthology.orchestra.run.smithi119.stdout:Access: 2024-04-18 14:36:09.115417690 +0000 2024-04-18T14:41:47.824 INFO:teuthology.orchestra.run.smithi119.stdout:Modify: 2024-04-18 14:36:08.855420012 +0000 2024-04-18T14:41:47.824 INFO:teuthology.orchestra.run.smithi119.stdout:Change: 2024-04-18 14:36:08.855420012 +0000 2024-04-18T14:41:47.824 INFO:teuthology.orchestra.run.smithi119.stdout: Birth: - 2024-04-18T14:41:47.824 DEBUG:teuthology.orchestra.run.smithi119:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-04-18T14:41:47.877 INFO:teuthology.orchestra.run.smithi119.stderr:1+0 records in 2024-04-18T14:41:47.878 INFO:teuthology.orchestra.run.smithi119.stderr:1+0 records out 2024-04-18T14:41:47.878 INFO:teuthology.orchestra.run.smithi119.stderr:512 bytes copied, 0.00038344 s, 1.3 MB/s 2024-04-18T14:41:47.879 DEBUG:teuthology.orchestra.run.smithi119:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-04-18T14:41:47.928 DEBUG:teuthology.orchestra.run.smithi119:> stat /dev/vg_nvme/lv_2 2024-04-18T14:41:47.975 INFO:teuthology.orchestra.run.smithi119.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-04-18T14:41:47.975 INFO:teuthology.orchestra.run.smithi119.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-18T14:41:47.975 INFO:teuthology.orchestra.run.smithi119.stdout:Device: 5h/5d Inode: 906 Links: 1 2024-04-18T14:41:47.975 INFO:teuthology.orchestra.run.smithi119.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-18T14:41:47.975 INFO:teuthology.orchestra.run.smithi119.stdout:Access: 2024-04-18 14:36:09.663412795 +0000 2024-04-18T14:41:47.975 INFO:teuthology.orchestra.run.smithi119.stdout:Modify: 2024-04-18 14:36:09.387415261 +0000 2024-04-18T14:41:47.975 INFO:teuthology.orchestra.run.smithi119.stdout:Change: 2024-04-18 14:36:09.387415261 +0000 2024-04-18T14:41:47.975 INFO:teuthology.orchestra.run.smithi119.stdout: Birth: - 2024-04-18T14:41:47.976 DEBUG:teuthology.orchestra.run.smithi119:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-04-18T14:41:48.033 INFO:teuthology.orchestra.run.smithi119.stderr:1+0 records in 2024-04-18T14:41:48.033 INFO:teuthology.orchestra.run.smithi119.stderr:1+0 records out 2024-04-18T14:41:48.033 INFO:teuthology.orchestra.run.smithi119.stderr:512 bytes copied, 0.000332377 s, 1.5 MB/s 2024-04-18T14:41:48.034 DEBUG:teuthology.orchestra.run.smithi119:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-04-18T14:41:48.088 DEBUG:teuthology.orchestra.run.smithi119:> stat /dev/vg_nvme/lv_3 2024-04-18T14:41:48.135 INFO:teuthology.orchestra.run.smithi119.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-04-18T14:41:48.135 INFO:teuthology.orchestra.run.smithi119.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-18T14:41:48.135 INFO:teuthology.orchestra.run.smithi119.stdout:Device: 5h/5d Inode: 915 Links: 1 2024-04-18T14:41:48.135 INFO:teuthology.orchestra.run.smithi119.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-18T14:41:48.135 INFO:teuthology.orchestra.run.smithi119.stdout:Access: 2024-04-18 14:36:10.155408401 +0000 2024-04-18T14:41:48.136 INFO:teuthology.orchestra.run.smithi119.stdout:Modify: 2024-04-18 14:36:09.899410687 +0000 2024-04-18T14:41:48.136 INFO:teuthology.orchestra.run.smithi119.stdout:Change: 2024-04-18 14:36:09.899410687 +0000 2024-04-18T14:41:48.136 INFO:teuthology.orchestra.run.smithi119.stdout: Birth: - 2024-04-18T14:41:48.136 DEBUG:teuthology.orchestra.run.smithi119:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-04-18T14:41:48.189 INFO:teuthology.orchestra.run.smithi119.stderr:1+0 records in 2024-04-18T14:41:48.190 INFO:teuthology.orchestra.run.smithi119.stderr:1+0 records out 2024-04-18T14:41:48.190 INFO:teuthology.orchestra.run.smithi119.stderr:512 bytes copied, 0.000366134 s, 1.4 MB/s 2024-04-18T14:41:48.191 DEBUG:teuthology.orchestra.run.smithi119:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-04-18T14:41:48.241 DEBUG:teuthology.orchestra.run.smithi119:> stat /dev/vg_nvme/lv_4 2024-04-18T14:41:48.287 INFO:teuthology.orchestra.run.smithi119.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-04-18T14:41:48.287 INFO:teuthology.orchestra.run.smithi119.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-18T14:41:48.287 INFO:teuthology.orchestra.run.smithi119.stdout:Device: 5h/5d Inode: 940 Links: 1 2024-04-18T14:41:48.287 INFO:teuthology.orchestra.run.smithi119.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-18T14:41:48.287 INFO:teuthology.orchestra.run.smithi119.stdout:Access: 2024-04-18 14:36:10.639404078 +0000 2024-04-18T14:41:48.287 INFO:teuthology.orchestra.run.smithi119.stdout:Modify: 2024-04-18 14:36:10.391406293 +0000 2024-04-18T14:41:48.287 INFO:teuthology.orchestra.run.smithi119.stdout:Change: 2024-04-18 14:36:10.391406293 +0000 2024-04-18T14:41:48.287 INFO:teuthology.orchestra.run.smithi119.stdout: Birth: - 2024-04-18T14:41:48.288 DEBUG:teuthology.orchestra.run.smithi119:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-04-18T14:41:48.341 INFO:teuthology.orchestra.run.smithi119.stderr:1+0 records in 2024-04-18T14:41:48.341 INFO:teuthology.orchestra.run.smithi119.stderr:1+0 records out 2024-04-18T14:41:48.341 INFO:teuthology.orchestra.run.smithi119.stderr:512 bytes copied, 0.000378182 s, 1.4 MB/s 2024-04-18T14:41:48.342 DEBUG:teuthology.orchestra.run.smithi119:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-04-18T14:41:48.392 INFO:tasks.ceph:osd dev map: {'osd.2': '/dev/vg_nvme/lv_1', 'osd.6': '/dev/vg_nvme/lv_2', 'osd.10': '/dev/vg_nvme/lv_3', 'osd.14': '/dev/vg_nvme/lv_4'} 2024-04-18T14:41:48.392 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-04-18T14:41:48.392 DEBUG:teuthology.orchestra.run.smithi134:> dd if=/scratch_devs of=/dev/stdout 2024-04-18T14:41:48.400 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-04-18T14:41:48.401 DEBUG:teuthology.orchestra.run.smithi134:> stat /dev/vg_nvme/lv_1 2024-04-18T14:41:48.447 INFO:teuthology.orchestra.run.smithi134.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-04-18T14:41:48.447 INFO:teuthology.orchestra.run.smithi134.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-18T14:41:48.447 INFO:teuthology.orchestra.run.smithi134.stdout:Device: 5h/5d Inode: 887 Links: 1 2024-04-18T14:41:48.447 INFO:teuthology.orchestra.run.smithi134.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-18T14:41:48.447 INFO:teuthology.orchestra.run.smithi134.stdout:Access: 2024-04-18 14:36:11.740517628 +0000 2024-04-18T14:41:48.447 INFO:teuthology.orchestra.run.smithi134.stdout:Modify: 2024-04-18 14:36:11.496519807 +0000 2024-04-18T14:41:48.447 INFO:teuthology.orchestra.run.smithi134.stdout:Change: 2024-04-18 14:36:11.496519807 +0000 2024-04-18T14:41:48.447 INFO:teuthology.orchestra.run.smithi134.stdout: Birth: - 2024-04-18T14:41:48.448 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-04-18T14:41:48.501 INFO:teuthology.orchestra.run.smithi134.stderr:1+0 records in 2024-04-18T14:41:48.501 INFO:teuthology.orchestra.run.smithi134.stderr:1+0 records out 2024-04-18T14:41:48.501 INFO:teuthology.orchestra.run.smithi134.stderr:512 bytes copied, 0.000312726 s, 1.6 MB/s 2024-04-18T14:41:48.502 DEBUG:teuthology.orchestra.run.smithi134:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-04-18T14:41:48.552 DEBUG:teuthology.orchestra.run.smithi134:> stat /dev/vg_nvme/lv_2 2024-04-18T14:41:48.599 INFO:teuthology.orchestra.run.smithi134.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-04-18T14:41:48.599 INFO:teuthology.orchestra.run.smithi134.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-18T14:41:48.599 INFO:teuthology.orchestra.run.smithi134.stdout:Device: 5h/5d Inode: 903 Links: 1 2024-04-18T14:41:48.599 INFO:teuthology.orchestra.run.smithi134.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-18T14:41:48.599 INFO:teuthology.orchestra.run.smithi134.stdout:Access: 2024-04-18 14:36:12.264512948 +0000 2024-04-18T14:41:48.599 INFO:teuthology.orchestra.run.smithi134.stdout:Modify: 2024-04-18 14:36:11.984515447 +0000 2024-04-18T14:41:48.599 INFO:teuthology.orchestra.run.smithi134.stdout:Change: 2024-04-18 14:36:11.984515447 +0000 2024-04-18T14:41:48.599 INFO:teuthology.orchestra.run.smithi134.stdout: Birth: - 2024-04-18T14:41:48.599 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-04-18T14:41:48.653 INFO:teuthology.orchestra.run.smithi134.stderr:1+0 records in 2024-04-18T14:41:48.653 INFO:teuthology.orchestra.run.smithi134.stderr:1+0 records out 2024-04-18T14:41:48.654 INFO:teuthology.orchestra.run.smithi134.stderr:512 bytes copied, 0.00044622 s, 1.1 MB/s 2024-04-18T14:41:48.655 DEBUG:teuthology.orchestra.run.smithi134:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-04-18T14:41:48.708 DEBUG:teuthology.orchestra.run.smithi134:> stat /dev/vg_nvme/lv_3 2024-04-18T14:41:48.755 INFO:teuthology.orchestra.run.smithi134.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-04-18T14:41:48.756 INFO:teuthology.orchestra.run.smithi134.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-18T14:41:48.756 INFO:teuthology.orchestra.run.smithi134.stdout:Device: 5h/5d Inode: 921 Links: 1 2024-04-18T14:41:48.756 INFO:teuthology.orchestra.run.smithi134.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-18T14:41:48.756 INFO:teuthology.orchestra.run.smithi134.stdout:Access: 2024-04-18 14:36:12.768508446 +0000 2024-04-18T14:41:48.756 INFO:teuthology.orchestra.run.smithi134.stdout:Modify: 2024-04-18 14:36:12.508510767 +0000 2024-04-18T14:41:48.756 INFO:teuthology.orchestra.run.smithi134.stdout:Change: 2024-04-18 14:36:12.508510767 +0000 2024-04-18T14:41:48.757 INFO:teuthology.orchestra.run.smithi134.stdout: Birth: - 2024-04-18T14:41:48.757 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-04-18T14:41:48.809 INFO:teuthology.orchestra.run.smithi134.stderr:1+0 records in 2024-04-18T14:41:48.809 INFO:teuthology.orchestra.run.smithi134.stderr:1+0 records out 2024-04-18T14:41:48.809 INFO:teuthology.orchestra.run.smithi134.stderr:512 bytes copied, 0.000418161 s, 1.2 MB/s 2024-04-18T14:41:48.810 DEBUG:teuthology.orchestra.run.smithi134:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-04-18T14:41:48.865 DEBUG:teuthology.orchestra.run.smithi134:> stat /dev/vg_nvme/lv_4 2024-04-18T14:41:48.910 INFO:teuthology.orchestra.run.smithi134.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-04-18T14:41:48.911 INFO:teuthology.orchestra.run.smithi134.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-18T14:41:48.911 INFO:teuthology.orchestra.run.smithi134.stdout:Device: 5h/5d Inode: 937 Links: 1 2024-04-18T14:41:48.911 INFO:teuthology.orchestra.run.smithi134.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-18T14:41:48.911 INFO:teuthology.orchestra.run.smithi134.stdout:Access: 2024-04-18 14:36:13.304503658 +0000 2024-04-18T14:41:48.911 INFO:teuthology.orchestra.run.smithi134.stdout:Modify: 2024-04-18 14:36:13.024506160 +0000 2024-04-18T14:41:48.911 INFO:teuthology.orchestra.run.smithi134.stdout:Change: 2024-04-18 14:36:13.024506160 +0000 2024-04-18T14:41:48.911 INFO:teuthology.orchestra.run.smithi134.stdout: Birth: - 2024-04-18T14:41:48.911 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-04-18T14:41:48.964 INFO:teuthology.orchestra.run.smithi134.stderr:1+0 records in 2024-04-18T14:41:48.964 INFO:teuthology.orchestra.run.smithi134.stderr:1+0 records out 2024-04-18T14:41:48.965 INFO:teuthology.orchestra.run.smithi134.stderr:512 bytes copied, 0.000276691 s, 1.9 MB/s 2024-04-18T14:41:48.966 DEBUG:teuthology.orchestra.run.smithi134:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-04-18T14:41:49.016 INFO:tasks.ceph:osd dev map: {'osd.3': '/dev/vg_nvme/lv_1', 'osd.7': '/dev/vg_nvme/lv_2', 'osd.11': '/dev/vg_nvme/lv_3', 'osd.15': '/dev/vg_nvme/lv_4'} 2024-04-18T14:41:49.016 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi086.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.4': '/dev/vg_nvme/lv_2', 'osd.8': '/dev/vg_nvme/lv_3', 'osd.12': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi096.front.sepia.ceph.com'): {'osd.1': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.9': '/dev/vg_nvme/lv_3', 'osd.13': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi119.front.sepia.ceph.com'): {'osd.2': '/dev/vg_nvme/lv_1', 'osd.6': '/dev/vg_nvme/lv_2', 'osd.10': '/dev/vg_nvme/lv_3', 'osd.14': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi134.front.sepia.ceph.com'): {'osd.3': '/dev/vg_nvme/lv_1', 'osd.7': '/dev/vg_nvme/lv_2', 'osd.11': '/dev/vg_nvme/lv_3', 'osd.15': '/dev/vg_nvme/lv_4'}} 2024-04-18T14:41:49.016 INFO:tasks.ceph:Generating config... 2024-04-18T14:41:49.017 INFO:tasks.ceph:[osd] debug monc = 20 2024-04-18T14:41:49.017 INFO:tasks.ceph:[osd] bdev async discard = True 2024-04-18T14:41:49.018 INFO:tasks.ceph:[osd] bdev enable discard = True 2024-04-18T14:41:49.018 INFO:tasks.ceph:[osd] bluestore allocator = stupid 2024-04-18T14:41:49.018 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-04-18T14:41:49.018 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-04-18T14:41:49.018 INFO:tasks.ceph:[osd] bluestore zero block detection = True 2024-04-18T14:41:49.018 INFO:tasks.ceph:[osd] debug bluefs = 20 2024-04-18T14:41:49.018 INFO:tasks.ceph:[osd] debug bluestore = 20 2024-04-18T14:41:49.018 INFO:tasks.ceph:[osd] debug ms = 1 2024-04-18T14:41:49.018 INFO:tasks.ceph:[osd] debug osd = 20 2024-04-18T14:41:49.018 INFO:tasks.ceph:[osd] debug rocksdb = 10 2024-04-18T14:41:49.018 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-04-18T14:41:49.019 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-04-18T14:41:49.019 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-04-18T14:41:49.019 INFO:tasks.ceph:[osd] osd blocked scrub grace period = 3600 2024-04-18T14:41:49.019 INFO:tasks.ceph:[osd] osd debug reject backfill probability = 0.3 2024-04-18T14:41:49.019 INFO:tasks.ceph:[osd] osd debug verify cached snaps = True 2024-04-18T14:41:49.019 INFO:tasks.ceph:[osd] osd debug verify missing on start = True 2024-04-18T14:41:49.019 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-04-18T14:41:49.019 INFO:tasks.ceph:[osd] osd heartbeat use min delay socket = True 2024-04-18T14:41:49.019 INFO:tasks.ceph:[osd] osd max backfills = 3 2024-04-18T14:41:49.019 INFO:tasks.ceph:[osd] osd max markdown count = 1000 2024-04-18T14:41:49.019 INFO:tasks.ceph:[osd] osd mclock override recovery settings = True 2024-04-18T14:41:49.019 INFO:tasks.ceph:[osd] osd mclock profile = high_recovery_ops 2024-04-18T14:41:49.020 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-04-18T14:41:49.020 INFO:tasks.ceph:[osd] osd op queue = debug_random 2024-04-18T14:41:49.020 INFO:tasks.ceph:[osd] osd op queue cut off = debug_random 2024-04-18T14:41:49.020 INFO:tasks.ceph:[osd] osd scrub max interval = 120 2024-04-18T14:41:49.020 INFO:tasks.ceph:[osd] osd scrub min interval = 60 2024-04-18T14:41:49.020 INFO:tasks.ceph:[osd] osd shutdown pgref assert = True 2024-04-18T14:41:49.020 INFO:tasks.ceph:[global] mon client directed command retry = 5 2024-04-18T14:41:49.020 INFO:tasks.ceph:[global] mon election default strategy = 1 2024-04-18T14:41:49.020 INFO:tasks.ceph:[global] ms inject socket failures = 5000 2024-04-18T14:41:49.020 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-04-18T14:41:49.020 INFO:tasks.ceph:[mgr] debug ms = 1 2024-04-18T14:41:49.020 INFO:tasks.ceph:[mon] debug mon = 20 2024-04-18T14:41:49.021 INFO:tasks.ceph:[mon] debug ms = 1 2024-04-18T14:41:49.021 INFO:tasks.ceph:[mon] debug paxos = 20 2024-04-18T14:41:49.021 INFO:tasks.ceph:[mon] mon scrub interval = 300 2024-04-18T14:41:49.021 INFO:tasks.ceph:Setting up mon.a... 2024-04-18T14:41:49.021 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-04-18T14:41:49.055 INFO:teuthology.orchestra.run.smithi086.stdout:creating /etc/ceph/ceph.keyring 2024-04-18T14:41:49.068 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-04-18T14:41:49.148 DEBUG:teuthology.orchestra.run.smithi086:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-04-18T14:41:49.204 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.86'), ('mon.b', '172.21.15.96'), ('mon.c', '172.21.15.119')] 2024-04-18T14:41:49.204 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.86,172.21.15.96,172.21.15.119', 'mon client directed command retry': 5, 'mon election default strategy': 1, 'ms inject socket failures': 5000}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': 120, 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'debug monc': 20, 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'stupid', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'bluestore zero block detection': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd blocked scrub grace period': 3600, 'osd debug reject backfill probability': 0.3, 'osd debug verify cached snaps': True, 'osd debug verify missing on start': True, 'osd failsafe full ratio': 0.95, 'osd heartbeat use min delay socket': True, 'osd max backfills': 3, 'osd max markdown count': 1000, 'osd mclock override recovery settings': True, 'osd objectstore': 'bluestore', 'osd op queue': 'debug_random', 'osd op queue cut off': 'debug_random', 'osd scrub min interval': 60, 'osd shutdown pgref assert': True}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon scrub interval': 300}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok'}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}} 2024-04-18T14:41:49.205 DEBUG:teuthology.orchestra.run.smithi086:> set -ex 2024-04-18T14:41:49.205 DEBUG:teuthology.orchestra.run.smithi086:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-04-18T14:41:49.254 DEBUG:teuthology.orchestra.run.smithi086:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.86 --add b 172.21.15.96 --add c 172.21.15.119 --print /home/ubuntu/cephtest/ceph.monmap 2024-04-18T14:41:49.337 INFO:teuthology.orchestra.run.smithi086.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-04-18T14:41:49.337 INFO:teuthology.orchestra.run.smithi086.stdout:monmaptool: generated fsid ac90c892-1809-401c-a743-76948b63c51a 2024-04-18T14:41:49.337 INFO:teuthology.orchestra.run.smithi086.stdout:setting min_mon_release = pacific 2024-04-18T14:41:49.338 INFO:teuthology.orchestra.run.smithi086.stdout:epoch 0 2024-04-18T14:41:49.338 INFO:teuthology.orchestra.run.smithi086.stdout:fsid ac90c892-1809-401c-a743-76948b63c51a 2024-04-18T14:41:49.338 INFO:teuthology.orchestra.run.smithi086.stdout:last_changed 2024-04-18T14:41:49.342107+0000 2024-04-18T14:41:49.338 INFO:teuthology.orchestra.run.smithi086.stdout:created 2024-04-18T14:41:49.342107+0000 2024-04-18T14:41:49.338 INFO:teuthology.orchestra.run.smithi086.stdout:min_mon_release 16 (pacific) 2024-04-18T14:41:49.338 INFO:teuthology.orchestra.run.smithi086.stdout:election_strategy: 1 2024-04-18T14:41:49.338 INFO:teuthology.orchestra.run.smithi086.stdout:0: [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] mon.a 2024-04-18T14:41:49.338 INFO:teuthology.orchestra.run.smithi086.stdout:1: [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] mon.b 2024-04-18T14:41:49.338 INFO:teuthology.orchestra.run.smithi086.stdout:2: [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] mon.c 2024-04-18T14:41:49.338 INFO:teuthology.orchestra.run.smithi086.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2024-04-18T14:41:49.339 DEBUG:teuthology.orchestra.run.smithi086:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-04-18T14:41:49.384 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID ac90c892-1809-401c-a743-76948b63c51a... 2024-04-18T14:41:49.385 DEBUG:teuthology.orchestra.run.smithi086:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-04-18T14:41:49.430 DEBUG:teuthology.orchestra.run.smithi096:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-04-18T14:41:49.432 DEBUG:teuthology.orchestra.run.smithi119:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-04-18T14:41:49.435 DEBUG:teuthology.orchestra.run.smithi134:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-04-18T14:41:49.458 INFO:teuthology.orchestra.run.smithi086.stdout:[global] 2024-04-18T14:41:49.458 INFO:teuthology.orchestra.run.smithi086.stdout: chdir = "" 2024-04-18T14:41:49.458 INFO:teuthology.orchestra.run.smithi086.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-04-18T14:41:49.458 INFO:teuthology.orchestra.run.smithi086.stdout: auth supported = cephx 2024-04-18T14:41:49.459 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-04-18T14:41:49.459 INFO:teuthology.orchestra.run.smithi086.stdout: filestore xattr use omap = true 2024-04-18T14:41:49.459 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-04-18T14:41:49.459 INFO:teuthology.orchestra.run.smithi086.stdout: mon clock drift allowed = 1.000 2024-04-18T14:41:49.459 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-04-18T14:41:49.459 INFO:teuthology.orchestra.run.smithi086.stdout: osd crush chooseleaf type = 0 2024-04-18T14:41:49.459 INFO:teuthology.orchestra.run.smithi086.stdout: auth debug = true 2024-04-18T14:41:49.459 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-04-18T14:41:49.459 INFO:teuthology.orchestra.run.smithi086.stdout: ms die on old message = true 2024-04-18T14:41:49.459 INFO:teuthology.orchestra.run.smithi086.stdout: ms die on bug = true 2024-04-18T14:41:49.459 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-04-18T14:41:49.459 INFO:teuthology.orchestra.run.smithi086.stdout: mon max pg per osd = 10000 # >= luminous 2024-04-18T14:41:49.459 INFO:teuthology.orchestra.run.smithi086.stdout: mon pg warn max object skew = 0 2024-04-18T14:41:49.459 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-04-18T14:41:49.459 INFO:teuthology.orchestra.run.smithi086.stdout: # disable pg_autoscaler by default for new pools 2024-04-18T14:41:49.460 INFO:teuthology.orchestra.run.smithi086.stdout: osd_pool_default_pg_autoscale_mode = off 2024-04-18T14:41:49.460 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-04-18T14:41:49.460 INFO:teuthology.orchestra.run.smithi086.stdout: osd pool default size = 2 2024-04-18T14:41:49.460 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-04-18T14:41:49.460 INFO:teuthology.orchestra.run.smithi086.stdout: mon osd allow primary affinity = true 2024-04-18T14:41:49.460 INFO:teuthology.orchestra.run.smithi086.stdout: mon osd allow pg remap = true 2024-04-18T14:41:49.460 INFO:teuthology.orchestra.run.smithi086.stdout: mon warn on legacy crush tunables = false 2024-04-18T14:41:49.460 INFO:teuthology.orchestra.run.smithi086.stdout: mon warn on crush straw calc version zero = false 2024-04-18T14:41:49.460 INFO:teuthology.orchestra.run.smithi086.stdout: mon warn on no sortbitwise = false 2024-04-18T14:41:49.460 INFO:teuthology.orchestra.run.smithi086.stdout: mon warn on osd down out interval zero = false 2024-04-18T14:41:49.460 INFO:teuthology.orchestra.run.smithi086.stdout: mon warn on too few osds = false 2024-04-18T14:41:49.460 INFO:teuthology.orchestra.run.smithi086.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-04-18T14:41:49.460 INFO:teuthology.orchestra.run.smithi086.stdout: mon_warn_on_pool_no_redundancy = false 2024-04-18T14:41:49.461 INFO:teuthology.orchestra.run.smithi086.stdout: mon_allow_pool_size_one = true 2024-04-18T14:41:49.461 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-04-18T14:41:49.461 INFO:teuthology.orchestra.run.smithi086.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-04-18T14:41:49.461 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-04-18T14:41:49.461 INFO:teuthology.orchestra.run.smithi086.stdout: osd default data pool replay window = 5 2024-04-18T14:41:49.461 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-04-18T14:41:49.461 INFO:teuthology.orchestra.run.smithi086.stdout: mon allow pool delete = true 2024-04-18T14:41:49.461 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-04-18T14:41:49.461 INFO:teuthology.orchestra.run.smithi086.stdout: mon cluster log file level = debug 2024-04-18T14:41:49.461 INFO:teuthology.orchestra.run.smithi086.stdout: debug asserts on shutdown = true 2024-04-18T14:41:49.461 INFO:teuthology.orchestra.run.smithi086.stdout: mon health detail to clog = false 2024-04-18T14:41:49.461 INFO:teuthology.orchestra.run.smithi086.stdout: mon host = "172.21.15.86,172.21.15.96,172.21.15.119" 2024-04-18T14:41:49.461 INFO:teuthology.orchestra.run.smithi086.stdout: mon client directed command retry = 5 2024-04-18T14:41:49.461 INFO:teuthology.orchestra.run.smithi086.stdout: mon election default strategy = 1 2024-04-18T14:41:49.461 INFO:teuthology.orchestra.run.smithi086.stdout: ms inject socket failures = 5000 2024-04-18T14:41:49.461 INFO:teuthology.orchestra.run.smithi086.stdout: fsid = ac90c892-1809-401c-a743-76948b63c51a 2024-04-18T14:41:49.462 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-04-18T14:41:49.462 INFO:teuthology.orchestra.run.smithi086.stdout:[osd] 2024-04-18T14:41:49.462 INFO:teuthology.orchestra.run.smithi086.stdout: osd journal size = 100 2024-04-18T14:41:49.462 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-04-18T14:41:49.462 INFO:teuthology.orchestra.run.smithi086.stdout: osd scrub load threshold = 5.0 2024-04-18T14:41:49.462 INFO:teuthology.orchestra.run.smithi086.stdout: osd scrub max interval = 120 2024-04-18T14:41:49.462 INFO:teuthology.orchestra.run.smithi086.stdout: osd mclock profile = high_recovery_ops 2024-04-18T14:41:49.462 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-04-18T14:41:49.462 INFO:teuthology.orchestra.run.smithi086.stdout: osd recover clone overlap = true 2024-04-18T14:41:49.463 INFO:teuthology.orchestra.run.smithi086.stdout: osd recovery max chunk = 1048576 2024-04-18T14:41:49.463 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-04-18T14:41:49.463 INFO:teuthology.orchestra.run.smithi086.stdout: osd debug shutdown = true 2024-04-18T14:41:49.463 INFO:teuthology.orchestra.run.smithi086.stdout: osd debug op order = true 2024-04-18T14:41:49.463 INFO:teuthology.orchestra.run.smithi086.stdout: osd debug verify stray on activate = true 2024-04-18T14:41:49.463 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-04-18T14:41:49.463 INFO:teuthology.orchestra.run.smithi086.stdout: osd open classes on start = true 2024-04-18T14:41:49.463 INFO:teuthology.orchestra.run.smithi086.stdout: osd debug pg log writeout = true 2024-04-18T14:41:49.463 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-04-18T14:41:49.463 INFO:teuthology.orchestra.run.smithi086.stdout: osd deep scrub update digest min age = 30 2024-04-18T14:41:49.463 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-04-18T14:41:49.463 INFO:teuthology.orchestra.run.smithi086.stdout: osd map max advance = 10 2024-04-18T14:41:49.464 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-04-18T14:41:49.464 INFO:teuthology.orchestra.run.smithi086.stdout: journal zero on create = true 2024-04-18T14:41:49.464 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-04-18T14:41:49.464 INFO:teuthology.orchestra.run.smithi086.stdout: filestore ondisk finisher threads = 3 2024-04-18T14:41:49.464 INFO:teuthology.orchestra.run.smithi086.stdout: filestore apply finisher threads = 3 2024-04-18T14:41:49.464 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-04-18T14:41:49.464 INFO:teuthology.orchestra.run.smithi086.stdout: bdev debug aio = true 2024-04-18T14:41:49.464 INFO:teuthology.orchestra.run.smithi086.stdout: osd debug misdirected ops = true 2024-04-18T14:41:49.464 INFO:teuthology.orchestra.run.smithi086.stdout: debug monc = 20 2024-04-18T14:41:49.464 INFO:teuthology.orchestra.run.smithi086.stdout: bdev async discard = True 2024-04-18T14:41:49.464 INFO:teuthology.orchestra.run.smithi086.stdout: bdev enable discard = True 2024-04-18T14:41:49.464 INFO:teuthology.orchestra.run.smithi086.stdout: bluestore allocator = stupid 2024-04-18T14:41:49.464 INFO:teuthology.orchestra.run.smithi086.stdout: bluestore block size = 96636764160 2024-04-18T14:41:49.464 INFO:teuthology.orchestra.run.smithi086.stdout: bluestore fsck on mount = True 2024-04-18T14:41:49.464 INFO:teuthology.orchestra.run.smithi086.stdout: bluestore zero block detection = True 2024-04-18T14:41:49.465 INFO:teuthology.orchestra.run.smithi086.stdout: debug bluefs = 20 2024-04-18T14:41:49.465 INFO:teuthology.orchestra.run.smithi086.stdout: debug bluestore = 20 2024-04-18T14:41:49.465 INFO:teuthology.orchestra.run.smithi086.stdout: debug ms = 1 2024-04-18T14:41:49.465 INFO:teuthology.orchestra.run.smithi086.stdout: debug osd = 20 2024-04-18T14:41:49.465 INFO:teuthology.orchestra.run.smithi086.stdout: debug rocksdb = 10 2024-04-18T14:41:49.465 INFO:teuthology.orchestra.run.smithi086.stdout: mon osd backfillfull_ratio = 0.85 2024-04-18T14:41:49.465 INFO:teuthology.orchestra.run.smithi086.stdout: mon osd full ratio = 0.9 2024-04-18T14:41:49.465 INFO:teuthology.orchestra.run.smithi086.stdout: mon osd nearfull ratio = 0.8 2024-04-18T14:41:49.465 INFO:teuthology.orchestra.run.smithi086.stdout: osd blocked scrub grace period = 3600 2024-04-18T14:41:49.465 INFO:teuthology.orchestra.run.smithi086.stdout: osd debug reject backfill probability = 0.3 2024-04-18T14:41:49.465 INFO:teuthology.orchestra.run.smithi086.stdout: osd debug verify cached snaps = True 2024-04-18T14:41:49.465 INFO:teuthology.orchestra.run.smithi086.stdout: osd debug verify missing on start = True 2024-04-18T14:41:49.465 INFO:teuthology.orchestra.run.smithi086.stdout: osd failsafe full ratio = 0.95 2024-04-18T14:41:49.465 INFO:teuthology.orchestra.run.smithi086.stdout: osd heartbeat use min delay socket = True 2024-04-18T14:41:49.466 INFO:teuthology.orchestra.run.smithi086.stdout: osd max backfills = 3 2024-04-18T14:41:49.466 INFO:teuthology.orchestra.run.smithi086.stdout: osd max markdown count = 1000 2024-04-18T14:41:49.466 INFO:teuthology.orchestra.run.smithi086.stdout: osd mclock override recovery settings = True 2024-04-18T14:41:49.466 INFO:teuthology.orchestra.run.smithi086.stdout: osd objectstore = bluestore 2024-04-18T14:41:49.466 INFO:teuthology.orchestra.run.smithi086.stdout: osd op queue = debug_random 2024-04-18T14:41:49.466 INFO:teuthology.orchestra.run.smithi086.stdout: osd op queue cut off = debug_random 2024-04-18T14:41:49.466 INFO:teuthology.orchestra.run.smithi086.stdout: osd scrub min interval = 60 2024-04-18T14:41:49.466 INFO:teuthology.orchestra.run.smithi086.stdout: osd shutdown pgref assert = True 2024-04-18T14:41:49.466 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-04-18T14:41:49.466 INFO:teuthology.orchestra.run.smithi086.stdout:[mgr] 2024-04-18T14:41:49.466 INFO:teuthology.orchestra.run.smithi086.stdout: debug ms = 1 2024-04-18T14:41:49.466 INFO:teuthology.orchestra.run.smithi086.stdout: debug mgr = 20 2024-04-18T14:41:49.466 INFO:teuthology.orchestra.run.smithi086.stdout: debug mon = 20 2024-04-18T14:41:49.466 INFO:teuthology.orchestra.run.smithi086.stdout: debug auth = 20 2024-04-18T14:41:49.467 INFO:teuthology.orchestra.run.smithi086.stdout: mon reweight min pgs per osd = 4 2024-04-18T14:41:49.467 INFO:teuthology.orchestra.run.smithi086.stdout: mon reweight min bytes per osd = 10 2024-04-18T14:41:49.467 INFO:teuthology.orchestra.run.smithi086.stdout: mgr/telemetry/nag = false 2024-04-18T14:41:49.467 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-04-18T14:41:49.467 INFO:teuthology.orchestra.run.smithi086.stdout:[mon] 2024-04-18T14:41:49.467 INFO:teuthology.orchestra.run.smithi086.stdout: debug ms = 1 2024-04-18T14:41:49.467 INFO:teuthology.orchestra.run.smithi086.stdout: debug mon = 20 2024-04-18T14:41:49.467 INFO:teuthology.orchestra.run.smithi086.stdout: debug paxos = 20 2024-04-18T14:41:49.467 INFO:teuthology.orchestra.run.smithi086.stdout: debug auth = 20 2024-04-18T14:41:49.467 INFO:teuthology.orchestra.run.smithi086.stdout: mon data avail warn = 5 2024-04-18T14:41:49.467 INFO:teuthology.orchestra.run.smithi086.stdout: mon mgr mkfs grace = 240 2024-04-18T14:41:49.467 INFO:teuthology.orchestra.run.smithi086.stdout: mon reweight min pgs per osd = 4 2024-04-18T14:41:49.467 INFO:teuthology.orchestra.run.smithi086.stdout: mon osd reporter subtree level = osd 2024-04-18T14:41:49.467 INFO:teuthology.orchestra.run.smithi086.stdout: mon osd prime pg temp = true 2024-04-18T14:41:49.467 INFO:teuthology.orchestra.run.smithi086.stdout: mon reweight min bytes per osd = 10 2024-04-18T14:41:49.468 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-04-18T14:41:49.468 INFO:teuthology.orchestra.run.smithi086.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-04-18T14:41:49.468 INFO:teuthology.orchestra.run.smithi086.stdout: auth mon ticket ttl = 660 # 11m 2024-04-18T14:41:49.468 INFO:teuthology.orchestra.run.smithi086.stdout: auth service ticket ttl = 240 # 4m 2024-04-18T14:41:49.468 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-04-18T14:41:49.468 INFO:teuthology.orchestra.run.smithi086.stdout: # don't complain about insecure global_id in the test suite 2024-04-18T14:41:49.468 INFO:teuthology.orchestra.run.smithi086.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-04-18T14:41:49.468 INFO:teuthology.orchestra.run.smithi086.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-04-18T14:41:49.468 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-04-18T14:41:49.468 INFO:teuthology.orchestra.run.smithi086.stdout: # 1m isn't quite enough 2024-04-18T14:41:49.468 INFO:teuthology.orchestra.run.smithi086.stdout: mon_down_mkfs_grace = 2m 2024-04-18T14:41:49.468 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-04-18T14:41:49.468 INFO:teuthology.orchestra.run.smithi086.stdout: mon_warn_on_filestore_osds = false 2024-04-18T14:41:49.468 INFO:teuthology.orchestra.run.smithi086.stdout: mon scrub interval = 300 2024-04-18T14:41:49.468 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-04-18T14:41:49.469 INFO:teuthology.orchestra.run.smithi086.stdout:[client] 2024-04-18T14:41:49.469 INFO:teuthology.orchestra.run.smithi086.stdout: rgw cache enabled = true 2024-04-18T14:41:49.469 INFO:teuthology.orchestra.run.smithi086.stdout: rgw enable ops log = true 2024-04-18T14:41:49.469 INFO:teuthology.orchestra.run.smithi086.stdout: rgw enable usage log = true 2024-04-18T14:41:49.469 INFO:teuthology.orchestra.run.smithi086.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-04-18T14:41:49.469 INFO:teuthology.orchestra.run.smithi086.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-04-18T14:41:49.469 INFO:teuthology.orchestra.run.smithi086.stdout:[mon.a] 2024-04-18T14:41:49.469 INFO:teuthology.orchestra.run.smithi086.stdout:[mon.b] 2024-04-18T14:41:49.469 INFO:teuthology.orchestra.run.smithi086.stdout:[mon.c] 2024-04-18T14:41:49.470 INFO:teuthology.orchestra.run.smithi134.stdout:[global] 2024-04-18T14:41:49.470 INFO:teuthology.orchestra.run.smithi134.stdout: chdir = "" 2024-04-18T14:41:49.470 INFO:teuthology.orchestra.run.smithi134.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-04-18T14:41:49.470 INFO:teuthology.orchestra.run.smithi134.stdout: auth supported = cephx 2024-04-18T14:41:49.470 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-04-18T14:41:49.471 INFO:teuthology.orchestra.run.smithi134.stdout: filestore xattr use omap = true 2024-04-18T14:41:49.471 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-04-18T14:41:49.471 INFO:teuthology.orchestra.run.smithi134.stdout: mon clock drift allowed = 1.000 2024-04-18T14:41:49.471 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-04-18T14:41:49.471 INFO:teuthology.orchestra.run.smithi134.stdout: osd crush chooseleaf type = 0 2024-04-18T14:41:49.471 INFO:teuthology.orchestra.run.smithi134.stdout: auth debug = true 2024-04-18T14:41:49.471 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-04-18T14:41:49.471 INFO:teuthology.orchestra.run.smithi134.stdout: ms die on old message = true 2024-04-18T14:41:49.471 INFO:teuthology.orchestra.run.smithi134.stdout: ms die on bug = true 2024-04-18T14:41:49.471 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-04-18T14:41:49.471 INFO:teuthology.orchestra.run.smithi134.stdout: mon max pg per osd = 10000 # >= luminous 2024-04-18T14:41:49.471 INFO:teuthology.orchestra.run.smithi134.stdout: mon pg warn max object skew = 0 2024-04-18T14:41:49.471 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-04-18T14:41:49.471 INFO:teuthology.orchestra.run.smithi134.stdout: # disable pg_autoscaler by default for new pools 2024-04-18T14:41:49.471 INFO:teuthology.orchestra.run.smithi134.stdout: osd_pool_default_pg_autoscale_mode = off 2024-04-18T14:41:49.472 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-04-18T14:41:49.472 INFO:teuthology.orchestra.run.smithi134.stdout: osd pool default size = 2 2024-04-18T14:41:49.472 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-04-18T14:41:49.472 INFO:teuthology.orchestra.run.smithi134.stdout: mon osd allow primary affinity = true 2024-04-18T14:41:49.472 INFO:teuthology.orchestra.run.smithi134.stdout: mon osd allow pg remap = true 2024-04-18T14:41:49.472 INFO:teuthology.orchestra.run.smithi134.stdout: mon warn on legacy crush tunables = false 2024-04-18T14:41:49.472 INFO:teuthology.orchestra.run.smithi134.stdout: mon warn on crush straw calc version zero = false 2024-04-18T14:41:49.472 INFO:teuthology.orchestra.run.smithi134.stdout: mon warn on no sortbitwise = false 2024-04-18T14:41:49.472 INFO:teuthology.orchestra.run.smithi134.stdout: mon warn on osd down out interval zero = false 2024-04-18T14:41:49.472 INFO:teuthology.orchestra.run.smithi134.stdout: mon warn on too few osds = false 2024-04-18T14:41:49.472 INFO:teuthology.orchestra.run.smithi134.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-04-18T14:41:49.472 INFO:teuthology.orchestra.run.smithi134.stdout: mon_warn_on_pool_no_redundancy = false 2024-04-18T14:41:49.472 INFO:teuthology.orchestra.run.smithi134.stdout: mon_allow_pool_size_one = true 2024-04-18T14:41:49.472 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-04-18T14:41:49.473 INFO:teuthology.orchestra.run.smithi134.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-04-18T14:41:49.473 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-04-18T14:41:49.473 INFO:teuthology.orchestra.run.smithi134.stdout: osd default data pool replay window = 5 2024-04-18T14:41:49.473 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-04-18T14:41:49.473 INFO:teuthology.orchestra.run.smithi134.stdout: mon allow pool delete = true 2024-04-18T14:41:49.473 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-04-18T14:41:49.473 INFO:teuthology.orchestra.run.smithi134.stdout: mon cluster log file level = debug 2024-04-18T14:41:49.473 INFO:teuthology.orchestra.run.smithi134.stdout: debug asserts on shutdown = true 2024-04-18T14:41:49.473 INFO:teuthology.orchestra.run.smithi134.stdout: mon health detail to clog = false 2024-04-18T14:41:49.473 INFO:teuthology.orchestra.run.smithi134.stdout: mon host = "172.21.15.86,172.21.15.96,172.21.15.119" 2024-04-18T14:41:49.473 INFO:teuthology.orchestra.run.smithi134.stdout: mon client directed command retry = 5 2024-04-18T14:41:49.473 INFO:teuthology.orchestra.run.smithi134.stdout: mon election default strategy = 1 2024-04-18T14:41:49.473 INFO:teuthology.orchestra.run.smithi134.stdout: ms inject socket failures = 5000 2024-04-18T14:41:49.473 INFO:teuthology.orchestra.run.smithi134.stdout: fsid = ac90c892-1809-401c-a743-76948b63c51a 2024-04-18T14:41:49.474 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-04-18T14:41:49.474 INFO:teuthology.orchestra.run.smithi134.stdout:[osd] 2024-04-18T14:41:49.474 INFO:teuthology.orchestra.run.smithi134.stdout: osd journal size = 100 2024-04-18T14:41:49.474 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-04-18T14:41:49.474 INFO:teuthology.orchestra.run.smithi134.stdout: osd scrub load threshold = 5.0 2024-04-18T14:41:49.474 INFO:teuthology.orchestra.run.smithi134.stdout: osd scrub max interval = 120 2024-04-18T14:41:49.474 INFO:teuthology.orchestra.run.smithi134.stdout: osd mclock profile = high_recovery_ops 2024-04-18T14:41:49.474 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-04-18T14:41:49.474 INFO:teuthology.orchestra.run.smithi134.stdout: osd recover clone overlap = true 2024-04-18T14:41:49.474 INFO:teuthology.orchestra.run.smithi134.stdout: osd recovery max chunk = 1048576 2024-04-18T14:41:49.474 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-04-18T14:41:49.474 INFO:teuthology.orchestra.run.smithi134.stdout: osd debug shutdown = true 2024-04-18T14:41:49.474 INFO:teuthology.orchestra.run.smithi134.stdout: osd debug op order = true 2024-04-18T14:41:49.474 INFO:teuthology.orchestra.run.smithi134.stdout: osd debug verify stray on activate = true 2024-04-18T14:41:49.475 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-04-18T14:41:49.475 INFO:teuthology.orchestra.run.smithi134.stdout: osd open classes on start = true 2024-04-18T14:41:49.475 INFO:teuthology.orchestra.run.smithi134.stdout: osd debug pg log writeout = true 2024-04-18T14:41:49.475 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-04-18T14:41:49.475 INFO:teuthology.orchestra.run.smithi134.stdout: osd deep scrub update digest min age = 30 2024-04-18T14:41:49.475 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-04-18T14:41:49.475 INFO:teuthology.orchestra.run.smithi134.stdout: osd map max advance = 10 2024-04-18T14:41:49.475 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-04-18T14:41:49.475 INFO:teuthology.orchestra.run.smithi134.stdout: journal zero on create = true 2024-04-18T14:41:49.475 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-04-18T14:41:49.475 INFO:teuthology.orchestra.run.smithi134.stdout: filestore ondisk finisher threads = 3 2024-04-18T14:41:49.475 INFO:teuthology.orchestra.run.smithi134.stdout: filestore apply finisher threads = 3 2024-04-18T14:41:49.475 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-04-18T14:41:49.475 INFO:teuthology.orchestra.run.smithi134.stdout: bdev debug aio = true 2024-04-18T14:41:49.475 INFO:teuthology.orchestra.run.smithi134.stdout: osd debug misdirected ops = true 2024-04-18T14:41:49.475 INFO:teuthology.orchestra.run.smithi134.stdout: debug monc = 20 2024-04-18T14:41:49.476 INFO:teuthology.orchestra.run.smithi134.stdout: bdev async discard = True 2024-04-18T14:41:49.476 INFO:teuthology.orchestra.run.smithi134.stdout: bdev enable discard = True 2024-04-18T14:41:49.476 INFO:teuthology.orchestra.run.smithi134.stdout: bluestore allocator = stupid 2024-04-18T14:41:49.476 INFO:teuthology.orchestra.run.smithi134.stdout: bluestore block size = 96636764160 2024-04-18T14:41:49.476 INFO:teuthology.orchestra.run.smithi134.stdout: bluestore fsck on mount = True 2024-04-18T14:41:49.476 INFO:teuthology.orchestra.run.smithi134.stdout: bluestore zero block detection = True 2024-04-18T14:41:49.476 INFO:teuthology.orchestra.run.smithi134.stdout: debug bluefs = 20 2024-04-18T14:41:49.476 INFO:teuthology.orchestra.run.smithi134.stdout: debug bluestore = 20 2024-04-18T14:41:49.476 INFO:teuthology.orchestra.run.smithi134.stdout: debug ms = 1 2024-04-18T14:41:49.476 INFO:teuthology.orchestra.run.smithi134.stdout: debug osd = 20 2024-04-18T14:41:49.476 INFO:teuthology.orchestra.run.smithi134.stdout: debug rocksdb = 10 2024-04-18T14:41:49.476 INFO:teuthology.orchestra.run.smithi134.stdout: mon osd backfillfull_ratio = 0.85 2024-04-18T14:41:49.476 INFO:teuthology.orchestra.run.smithi134.stdout: mon osd full ratio = 0.9 2024-04-18T14:41:49.476 INFO:teuthology.orchestra.run.smithi134.stdout: mon osd nearfull ratio = 0.8 2024-04-18T14:41:49.476 INFO:teuthology.orchestra.run.smithi134.stdout: osd blocked scrub grace period = 3600 2024-04-18T14:41:49.477 INFO:teuthology.orchestra.run.smithi134.stdout: osd debug reject backfill probability = 0.3 2024-04-18T14:41:49.477 INFO:teuthology.orchestra.run.smithi134.stdout: osd debug verify cached snaps = True 2024-04-18T14:41:49.477 INFO:teuthology.orchestra.run.smithi134.stdout: osd debug verify missing on start = True 2024-04-18T14:41:49.477 INFO:teuthology.orchestra.run.smithi134.stdout: osd failsafe full ratio = 0.95 2024-04-18T14:41:49.477 INFO:teuthology.orchestra.run.smithi134.stdout: osd heartbeat use min delay socket = True 2024-04-18T14:41:49.477 INFO:teuthology.orchestra.run.smithi134.stdout: osd max backfills = 3 2024-04-18T14:41:49.477 INFO:teuthology.orchestra.run.smithi134.stdout: osd max markdown count = 1000 2024-04-18T14:41:49.477 INFO:teuthology.orchestra.run.smithi134.stdout: osd mclock override recovery settings = True 2024-04-18T14:41:49.477 INFO:teuthology.orchestra.run.smithi134.stdout: osd objectstore = bluestore 2024-04-18T14:41:49.477 INFO:teuthology.orchestra.run.smithi134.stdout: osd op queue = debug_random 2024-04-18T14:41:49.477 INFO:teuthology.orchestra.run.smithi134.stdout: osd op queue cut off = debug_random 2024-04-18T14:41:49.477 INFO:teuthology.orchestra.run.smithi134.stdout: osd scrub min interval = 60 2024-04-18T14:41:49.477 INFO:teuthology.orchestra.run.smithi134.stdout: osd shutdown pgref assert = True 2024-04-18T14:41:49.477 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-04-18T14:41:49.477 INFO:teuthology.orchestra.run.smithi134.stdout:[mgr] 2024-04-18T14:41:49.478 INFO:teuthology.orchestra.run.smithi134.stdout: debug ms = 1 2024-04-18T14:41:49.478 INFO:teuthology.orchestra.run.smithi134.stdout: debug mgr = 20 2024-04-18T14:41:49.478 INFO:teuthology.orchestra.run.smithi134.stdout: debug mon = 20 2024-04-18T14:41:49.478 INFO:teuthology.orchestra.run.smithi134.stdout: debug auth = 20 2024-04-18T14:41:49.478 INFO:teuthology.orchestra.run.smithi134.stdout: mon reweight min pgs per osd = 4 2024-04-18T14:41:49.478 INFO:teuthology.orchestra.run.smithi134.stdout: mon reweight min bytes per osd = 10 2024-04-18T14:41:49.478 INFO:teuthology.orchestra.run.smithi134.stdout: mgr/telemetry/nag = false 2024-04-18T14:41:49.478 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-04-18T14:41:49.478 INFO:teuthology.orchestra.run.smithi134.stdout:[mon] 2024-04-18T14:41:49.478 INFO:teuthology.orchestra.run.smithi134.stdout: debug ms = 1 2024-04-18T14:41:49.478 INFO:teuthology.orchestra.run.smithi134.stdout: debug mon = 20 2024-04-18T14:41:49.478 INFO:teuthology.orchestra.run.smithi134.stdout: debug paxos = 20 2024-04-18T14:41:49.478 INFO:teuthology.orchestra.run.smithi134.stdout: debug auth = 20 2024-04-18T14:41:49.478 INFO:teuthology.orchestra.run.smithi134.stdout: mon data avail warn = 5 2024-04-18T14:41:49.478 INFO:teuthology.orchestra.run.smithi134.stdout: mon mgr mkfs grace = 240 2024-04-18T14:41:49.479 INFO:teuthology.orchestra.run.smithi134.stdout: mon reweight min pgs per osd = 4 2024-04-18T14:41:49.479 INFO:teuthology.orchestra.run.smithi134.stdout: mon osd reporter subtree level = osd 2024-04-18T14:41:49.479 INFO:teuthology.orchestra.run.smithi134.stdout: mon osd prime pg temp = true 2024-04-18T14:41:49.479 INFO:teuthology.orchestra.run.smithi134.stdout: mon reweight min bytes per osd = 10 2024-04-18T14:41:49.479 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-04-18T14:41:49.479 INFO:teuthology.orchestra.run.smithi134.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-04-18T14:41:49.479 INFO:teuthology.orchestra.run.smithi134.stdout: auth mon ticket ttl = 660 # 11m 2024-04-18T14:41:49.479 INFO:teuthology.orchestra.run.smithi134.stdout: auth service ticket ttl = 240 # 4m 2024-04-18T14:41:49.479 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-04-18T14:41:49.479 INFO:teuthology.orchestra.run.smithi134.stdout: # don't complain about insecure global_id in the test suite 2024-04-18T14:41:49.479 INFO:teuthology.orchestra.run.smithi134.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-04-18T14:41:49.479 INFO:teuthology.orchestra.run.smithi134.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-04-18T14:41:49.479 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-04-18T14:41:49.479 INFO:teuthology.orchestra.run.smithi134.stdout: # 1m isn't quite enough 2024-04-18T14:41:49.480 INFO:teuthology.orchestra.run.smithi134.stdout: mon_down_mkfs_grace = 2m 2024-04-18T14:41:49.480 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-04-18T14:41:49.480 INFO:teuthology.orchestra.run.smithi134.stdout: mon_warn_on_filestore_osds = false 2024-04-18T14:41:49.480 INFO:teuthology.orchestra.run.smithi134.stdout: mon scrub interval = 300 2024-04-18T14:41:49.480 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-04-18T14:41:49.480 INFO:teuthology.orchestra.run.smithi134.stdout:[client] 2024-04-18T14:41:49.480 INFO:teuthology.orchestra.run.smithi134.stdout: rgw cache enabled = true 2024-04-18T14:41:49.480 INFO:teuthology.orchestra.run.smithi134.stdout: rgw enable ops log = true 2024-04-18T14:41:49.480 INFO:teuthology.orchestra.run.smithi134.stdout: rgw enable usage log = true 2024-04-18T14:41:49.480 INFO:teuthology.orchestra.run.smithi134.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-04-18T14:41:49.480 INFO:teuthology.orchestra.run.smithi134.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-04-18T14:41:49.480 INFO:teuthology.orchestra.run.smithi134.stdout:[mon.a] 2024-04-18T14:41:49.480 INFO:teuthology.orchestra.run.smithi134.stdout:[mon.b] 2024-04-18T14:41:49.480 INFO:teuthology.orchestra.run.smithi134.stdout:[mon.c] 2024-04-18T14:41:49.480 INFO:teuthology.orchestra.run.smithi119.stdout:[global] 2024-04-18T14:41:49.481 INFO:teuthology.orchestra.run.smithi119.stdout: chdir = "" 2024-04-18T14:41:49.481 INFO:teuthology.orchestra.run.smithi119.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-04-18T14:41:49.481 INFO:teuthology.orchestra.run.smithi119.stdout: auth supported = cephx 2024-04-18T14:41:49.481 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-04-18T14:41:49.481 INFO:teuthology.orchestra.run.smithi119.stdout: filestore xattr use omap = true 2024-04-18T14:41:49.481 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-04-18T14:41:49.481 INFO:teuthology.orchestra.run.smithi119.stdout: mon clock drift allowed = 1.000 2024-04-18T14:41:49.481 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-04-18T14:41:49.481 INFO:teuthology.orchestra.run.smithi119.stdout: osd crush chooseleaf type = 0 2024-04-18T14:41:49.481 INFO:teuthology.orchestra.run.smithi119.stdout: auth debug = true 2024-04-18T14:41:49.481 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-04-18T14:41:49.481 INFO:teuthology.orchestra.run.smithi119.stdout: ms die on old message = true 2024-04-18T14:41:49.481 INFO:teuthology.orchestra.run.smithi119.stdout: ms die on bug = true 2024-04-18T14:41:49.481 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-04-18T14:41:49.481 INFO:teuthology.orchestra.run.smithi119.stdout: mon max pg per osd = 10000 # >= luminous 2024-04-18T14:41:49.482 INFO:teuthology.orchestra.run.smithi119.stdout: mon pg warn max object skew = 0 2024-04-18T14:41:49.482 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-04-18T14:41:49.482 INFO:teuthology.orchestra.run.smithi119.stdout: # disable pg_autoscaler by default for new pools 2024-04-18T14:41:49.482 INFO:teuthology.orchestra.run.smithi119.stdout: osd_pool_default_pg_autoscale_mode = off 2024-04-18T14:41:49.482 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-04-18T14:41:49.482 INFO:teuthology.orchestra.run.smithi119.stdout: osd pool default size = 2 2024-04-18T14:41:49.482 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-04-18T14:41:49.482 INFO:teuthology.orchestra.run.smithi119.stdout: mon osd allow primary affinity = true 2024-04-18T14:41:49.482 INFO:teuthology.orchestra.run.smithi119.stdout: mon osd allow pg remap = true 2024-04-18T14:41:49.482 INFO:teuthology.orchestra.run.smithi119.stdout: mon warn on legacy crush tunables = false 2024-04-18T14:41:49.482 INFO:teuthology.orchestra.run.smithi119.stdout: mon warn on crush straw calc version zero = false 2024-04-18T14:41:49.482 INFO:teuthology.orchestra.run.smithi119.stdout: mon warn on no sortbitwise = false 2024-04-18T14:41:49.482 INFO:teuthology.orchestra.run.smithi119.stdout: mon warn on osd down out interval zero = false 2024-04-18T14:41:49.482 INFO:teuthology.orchestra.run.smithi119.stdout: mon warn on too few osds = false 2024-04-18T14:41:49.483 INFO:teuthology.orchestra.run.smithi119.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-04-18T14:41:49.483 INFO:teuthology.orchestra.run.smithi119.stdout: mon_warn_on_pool_no_redundancy = false 2024-04-18T14:41:49.483 INFO:teuthology.orchestra.run.smithi119.stdout: mon_allow_pool_size_one = true 2024-04-18T14:41:49.483 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-04-18T14:41:49.483 INFO:teuthology.orchestra.run.smithi119.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-04-18T14:41:49.483 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-04-18T14:41:49.483 INFO:teuthology.orchestra.run.smithi119.stdout: osd default data pool replay window = 5 2024-04-18T14:41:49.483 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-04-18T14:41:49.483 INFO:teuthology.orchestra.run.smithi119.stdout: mon allow pool delete = true 2024-04-18T14:41:49.483 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-04-18T14:41:49.483 INFO:teuthology.orchestra.run.smithi119.stdout: mon cluster log file level = debug 2024-04-18T14:41:49.483 INFO:teuthology.orchestra.run.smithi119.stdout: debug asserts on shutdown = true 2024-04-18T14:41:49.483 INFO:teuthology.orchestra.run.smithi119.stdout: mon health detail to clog = false 2024-04-18T14:41:49.483 INFO:teuthology.orchestra.run.smithi119.stdout: mon host = "172.21.15.86,172.21.15.96,172.21.15.119" 2024-04-18T14:41:49.484 INFO:teuthology.orchestra.run.smithi119.stdout: mon client directed command retry = 5 2024-04-18T14:41:49.484 INFO:teuthology.orchestra.run.smithi119.stdout: mon election default strategy = 1 2024-04-18T14:41:49.484 INFO:teuthology.orchestra.run.smithi119.stdout: ms inject socket failures = 5000 2024-04-18T14:41:49.484 INFO:teuthology.orchestra.run.smithi119.stdout: fsid = ac90c892-1809-401c-a743-76948b63c51a 2024-04-18T14:41:49.484 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-04-18T14:41:49.484 INFO:teuthology.orchestra.run.smithi119.stdout:[osd] 2024-04-18T14:41:49.484 INFO:teuthology.orchestra.run.smithi119.stdout: osd journal size = 100 2024-04-18T14:41:49.484 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-04-18T14:41:49.484 INFO:teuthology.orchestra.run.smithi119.stdout: osd scrub load threshold = 5.0 2024-04-18T14:41:49.484 INFO:teuthology.orchestra.run.smithi119.stdout: osd scrub max interval = 120 2024-04-18T14:41:49.484 INFO:teuthology.orchestra.run.smithi119.stdout: osd mclock profile = high_recovery_ops 2024-04-18T14:41:49.484 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-04-18T14:41:49.484 INFO:teuthology.orchestra.run.smithi119.stdout: osd recover clone overlap = true 2024-04-18T14:41:49.484 INFO:teuthology.orchestra.run.smithi119.stdout: osd recovery max chunk = 1048576 2024-04-18T14:41:49.484 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-04-18T14:41:49.484 INFO:teuthology.orchestra.run.smithi119.stdout: osd debug shutdown = true 2024-04-18T14:41:49.485 INFO:teuthology.orchestra.run.smithi119.stdout: osd debug op order = true 2024-04-18T14:41:49.485 INFO:teuthology.orchestra.run.smithi119.stdout: osd debug verify stray on activate = true 2024-04-18T14:41:49.485 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-04-18T14:41:49.485 INFO:teuthology.orchestra.run.smithi119.stdout: osd open classes on start = true 2024-04-18T14:41:49.485 INFO:teuthology.orchestra.run.smithi119.stdout: osd debug pg log writeout = true 2024-04-18T14:41:49.485 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-04-18T14:41:49.485 INFO:teuthology.orchestra.run.smithi119.stdout: osd deep scrub update digest min age = 30 2024-04-18T14:41:49.485 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-04-18T14:41:49.485 INFO:teuthology.orchestra.run.smithi119.stdout: osd map max advance = 10 2024-04-18T14:41:49.485 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-04-18T14:41:49.485 INFO:teuthology.orchestra.run.smithi119.stdout: journal zero on create = true 2024-04-18T14:41:49.485 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-04-18T14:41:49.485 INFO:teuthology.orchestra.run.smithi119.stdout: filestore ondisk finisher threads = 3 2024-04-18T14:41:49.485 INFO:teuthology.orchestra.run.smithi119.stdout: filestore apply finisher threads = 3 2024-04-18T14:41:49.485 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-04-18T14:41:49.486 INFO:teuthology.orchestra.run.smithi119.stdout: bdev debug aio = true 2024-04-18T14:41:49.486 INFO:teuthology.orchestra.run.smithi119.stdout: osd debug misdirected ops = true 2024-04-18T14:41:49.486 INFO:teuthology.orchestra.run.smithi119.stdout: debug monc = 20 2024-04-18T14:41:49.486 INFO:teuthology.orchestra.run.smithi119.stdout: bdev async discard = True 2024-04-18T14:41:49.486 INFO:teuthology.orchestra.run.smithi119.stdout: bdev enable discard = True 2024-04-18T14:41:49.486 INFO:teuthology.orchestra.run.smithi119.stdout: bluestore allocator = stupid 2024-04-18T14:41:49.486 INFO:teuthology.orchestra.run.smithi119.stdout: bluestore block size = 96636764160 2024-04-18T14:41:49.486 INFO:teuthology.orchestra.run.smithi119.stdout: bluestore fsck on mount = True 2024-04-18T14:41:49.486 INFO:teuthology.orchestra.run.smithi119.stdout: bluestore zero block detection = True 2024-04-18T14:41:49.486 INFO:teuthology.orchestra.run.smithi119.stdout: debug bluefs = 20 2024-04-18T14:41:49.486 INFO:teuthology.orchestra.run.smithi119.stdout: debug bluestore = 20 2024-04-18T14:41:49.486 INFO:teuthology.orchestra.run.smithi119.stdout: debug ms = 1 2024-04-18T14:41:49.486 INFO:teuthology.orchestra.run.smithi119.stdout: debug osd = 20 2024-04-18T14:41:49.486 INFO:teuthology.orchestra.run.smithi119.stdout: debug rocksdb = 10 2024-04-18T14:41:49.486 INFO:teuthology.orchestra.run.smithi119.stdout: mon osd backfillfull_ratio = 0.85 2024-04-18T14:41:49.487 INFO:teuthology.orchestra.run.smithi119.stdout: mon osd full ratio = 0.9 2024-04-18T14:41:49.487 INFO:teuthology.orchestra.run.smithi119.stdout: mon osd nearfull ratio = 0.8 2024-04-18T14:41:49.487 INFO:teuthology.orchestra.run.smithi119.stdout: osd blocked scrub grace period = 3600 2024-04-18T14:41:49.487 INFO:teuthology.orchestra.run.smithi119.stdout: osd debug reject backfill probability = 0.3 2024-04-18T14:41:49.487 INFO:teuthology.orchestra.run.smithi119.stdout: osd debug verify cached snaps = True 2024-04-18T14:41:49.487 INFO:teuthology.orchestra.run.smithi119.stdout: osd debug verify missing on start = True 2024-04-18T14:41:49.487 INFO:teuthology.orchestra.run.smithi119.stdout: osd failsafe full ratio = 0.95 2024-04-18T14:41:49.487 INFO:teuthology.orchestra.run.smithi119.stdout: osd heartbeat use min delay socket = True 2024-04-18T14:41:49.487 INFO:teuthology.orchestra.run.smithi119.stdout: osd max backfills = 3 2024-04-18T14:41:49.487 INFO:teuthology.orchestra.run.smithi119.stdout: osd max markdown count = 1000 2024-04-18T14:41:49.487 INFO:teuthology.orchestra.run.smithi119.stdout: osd mclock override recovery settings = True 2024-04-18T14:41:49.487 INFO:teuthology.orchestra.run.smithi119.stdout: osd objectstore = bluestore 2024-04-18T14:41:49.487 INFO:teuthology.orchestra.run.smithi119.stdout: osd op queue = debug_random 2024-04-18T14:41:49.487 INFO:teuthology.orchestra.run.smithi119.stdout: osd op queue cut off = debug_random 2024-04-18T14:41:49.488 INFO:teuthology.orchestra.run.smithi119.stdout: osd scrub min interval = 60 2024-04-18T14:41:49.488 INFO:teuthology.orchestra.run.smithi119.stdout: osd shutdown pgref assert = True 2024-04-18T14:41:49.488 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-04-18T14:41:49.488 INFO:teuthology.orchestra.run.smithi119.stdout:[mgr] 2024-04-18T14:41:49.488 INFO:teuthology.orchestra.run.smithi119.stdout: debug ms = 1 2024-04-18T14:41:49.488 INFO:teuthology.orchestra.run.smithi119.stdout: debug mgr = 20 2024-04-18T14:41:49.488 INFO:teuthology.orchestra.run.smithi119.stdout: debug mon = 20 2024-04-18T14:41:49.488 INFO:teuthology.orchestra.run.smithi119.stdout: debug auth = 20 2024-04-18T14:41:49.488 INFO:teuthology.orchestra.run.smithi119.stdout: mon reweight min pgs per osd = 4 2024-04-18T14:41:49.488 INFO:teuthology.orchestra.run.smithi119.stdout: mon reweight min bytes per osd = 10 2024-04-18T14:41:49.488 INFO:teuthology.orchestra.run.smithi119.stdout: mgr/telemetry/nag = false 2024-04-18T14:41:49.488 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-04-18T14:41:49.488 INFO:teuthology.orchestra.run.smithi119.stdout:[mon] 2024-04-18T14:41:49.488 INFO:teuthology.orchestra.run.smithi119.stdout: debug ms = 1 2024-04-18T14:41:49.488 INFO:teuthology.orchestra.run.smithi119.stdout: debug mon = 20 2024-04-18T14:41:49.489 INFO:teuthology.orchestra.run.smithi119.stdout: debug paxos = 20 2024-04-18T14:41:49.489 INFO:teuthology.orchestra.run.smithi119.stdout: debug auth = 20 2024-04-18T14:41:49.489 INFO:teuthology.orchestra.run.smithi119.stdout: mon data avail warn = 5 2024-04-18T14:41:49.489 INFO:teuthology.orchestra.run.smithi119.stdout: mon mgr mkfs grace = 240 2024-04-18T14:41:49.489 INFO:teuthology.orchestra.run.smithi119.stdout: mon reweight min pgs per osd = 4 2024-04-18T14:41:49.489 INFO:teuthology.orchestra.run.smithi119.stdout: mon osd reporter subtree level = osd 2024-04-18T14:41:49.489 INFO:teuthology.orchestra.run.smithi119.stdout: mon osd prime pg temp = true 2024-04-18T14:41:49.489 INFO:teuthology.orchestra.run.smithi119.stdout: mon reweight min bytes per osd = 10 2024-04-18T14:41:49.489 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-04-18T14:41:49.489 INFO:teuthology.orchestra.run.smithi119.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-04-18T14:41:49.489 INFO:teuthology.orchestra.run.smithi119.stdout: auth mon ticket ttl = 660 # 11m 2024-04-18T14:41:49.489 INFO:teuthology.orchestra.run.smithi119.stdout: auth service ticket ttl = 240 # 4m 2024-04-18T14:41:49.489 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-04-18T14:41:49.489 INFO:teuthology.orchestra.run.smithi119.stdout: # don't complain about insecure global_id in the test suite 2024-04-18T14:41:49.489 INFO:teuthology.orchestra.run.smithi119.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-04-18T14:41:49.489 INFO:teuthology.orchestra.run.smithi119.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-04-18T14:41:49.490 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-04-18T14:41:49.490 INFO:teuthology.orchestra.run.smithi119.stdout: # 1m isn't quite enough 2024-04-18T14:41:49.490 INFO:teuthology.orchestra.run.smithi119.stdout: mon_down_mkfs_grace = 2m 2024-04-18T14:41:49.490 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-04-18T14:41:49.490 INFO:teuthology.orchestra.run.smithi119.stdout: mon_warn_on_filestore_osds = false 2024-04-18T14:41:49.490 INFO:teuthology.orchestra.run.smithi119.stdout: mon scrub interval = 300 2024-04-18T14:41:49.490 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-04-18T14:41:49.490 INFO:teuthology.orchestra.run.smithi119.stdout:[client] 2024-04-18T14:41:49.490 INFO:teuthology.orchestra.run.smithi119.stdout: rgw cache enabled = true 2024-04-18T14:41:49.490 INFO:teuthology.orchestra.run.smithi119.stdout: rgw enable ops log = true 2024-04-18T14:41:49.490 INFO:teuthology.orchestra.run.smithi119.stdout: rgw enable usage log = true 2024-04-18T14:41:49.490 INFO:teuthology.orchestra.run.smithi119.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-04-18T14:41:49.490 INFO:teuthology.orchestra.run.smithi119.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-04-18T14:41:49.490 INFO:teuthology.orchestra.run.smithi119.stdout:[mon.a] 2024-04-18T14:41:49.490 INFO:teuthology.orchestra.run.smithi119.stdout:[mon.b] 2024-04-18T14:41:49.491 INFO:teuthology.orchestra.run.smithi119.stdout:[mon.c] 2024-04-18T14:41:49.491 INFO:teuthology.orchestra.run.smithi096.stdout:[global] 2024-04-18T14:41:49.491 INFO:teuthology.orchestra.run.smithi096.stdout: chdir = "" 2024-04-18T14:41:49.491 INFO:teuthology.orchestra.run.smithi096.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-04-18T14:41:49.491 INFO:teuthology.orchestra.run.smithi096.stdout: auth supported = cephx 2024-04-18T14:41:49.491 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-04-18T14:41:49.491 INFO:teuthology.orchestra.run.smithi096.stdout: filestore xattr use omap = true 2024-04-18T14:41:49.491 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-04-18T14:41:49.491 INFO:teuthology.orchestra.run.smithi096.stdout: mon clock drift allowed = 1.000 2024-04-18T14:41:49.491 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-04-18T14:41:49.491 INFO:teuthology.orchestra.run.smithi096.stdout: osd crush chooseleaf type = 0 2024-04-18T14:41:49.491 INFO:teuthology.orchestra.run.smithi096.stdout: auth debug = true 2024-04-18T14:41:49.491 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-04-18T14:41:49.492 INFO:teuthology.orchestra.run.smithi096.stdout: ms die on old message = true 2024-04-18T14:41:49.492 INFO:teuthology.orchestra.run.smithi096.stdout: ms die on bug = true 2024-04-18T14:41:49.492 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-04-18T14:41:49.492 INFO:teuthology.orchestra.run.smithi096.stdout: mon max pg per osd = 10000 # >= luminous 2024-04-18T14:41:49.492 INFO:teuthology.orchestra.run.smithi096.stdout: mon pg warn max object skew = 0 2024-04-18T14:41:49.492 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-04-18T14:41:49.492 INFO:teuthology.orchestra.run.smithi096.stdout: # disable pg_autoscaler by default for new pools 2024-04-18T14:41:49.492 INFO:teuthology.orchestra.run.smithi096.stdout: osd_pool_default_pg_autoscale_mode = off 2024-04-18T14:41:49.492 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-04-18T14:41:49.492 INFO:teuthology.orchestra.run.smithi096.stdout: osd pool default size = 2 2024-04-18T14:41:49.492 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-04-18T14:41:49.492 INFO:teuthology.orchestra.run.smithi096.stdout: mon osd allow primary affinity = true 2024-04-18T14:41:49.492 INFO:teuthology.orchestra.run.smithi096.stdout: mon osd allow pg remap = true 2024-04-18T14:41:49.492 INFO:teuthology.orchestra.run.smithi096.stdout: mon warn on legacy crush tunables = false 2024-04-18T14:41:49.492 INFO:teuthology.orchestra.run.smithi096.stdout: mon warn on crush straw calc version zero = false 2024-04-18T14:41:49.493 INFO:teuthology.orchestra.run.smithi096.stdout: mon warn on no sortbitwise = false 2024-04-18T14:41:49.493 INFO:teuthology.orchestra.run.smithi096.stdout: mon warn on osd down out interval zero = false 2024-04-18T14:41:49.493 INFO:teuthology.orchestra.run.smithi096.stdout: mon warn on too few osds = false 2024-04-18T14:41:49.493 INFO:teuthology.orchestra.run.smithi096.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-04-18T14:41:49.493 INFO:teuthology.orchestra.run.smithi096.stdout: mon_warn_on_pool_no_redundancy = false 2024-04-18T14:41:49.493 INFO:teuthology.orchestra.run.smithi096.stdout: mon_allow_pool_size_one = true 2024-04-18T14:41:49.493 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-04-18T14:41:49.493 INFO:teuthology.orchestra.run.smithi096.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-04-18T14:41:49.493 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-04-18T14:41:49.493 INFO:teuthology.orchestra.run.smithi096.stdout: osd default data pool replay window = 5 2024-04-18T14:41:49.493 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-04-18T14:41:49.493 INFO:teuthology.orchestra.run.smithi096.stdout: mon allow pool delete = true 2024-04-18T14:41:49.493 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-04-18T14:41:49.493 INFO:teuthology.orchestra.run.smithi096.stdout: mon cluster log file level = debug 2024-04-18T14:41:49.494 INFO:teuthology.orchestra.run.smithi096.stdout: debug asserts on shutdown = true 2024-04-18T14:41:49.494 INFO:teuthology.orchestra.run.smithi096.stdout: mon health detail to clog = false 2024-04-18T14:41:49.494 INFO:teuthology.orchestra.run.smithi096.stdout: mon host = "172.21.15.86,172.21.15.96,172.21.15.119" 2024-04-18T14:41:49.494 INFO:teuthology.orchestra.run.smithi096.stdout: mon client directed command retry = 5 2024-04-18T14:41:49.494 INFO:teuthology.orchestra.run.smithi096.stdout: mon election default strategy = 1 2024-04-18T14:41:49.494 INFO:teuthology.orchestra.run.smithi096.stdout: ms inject socket failures = 5000 2024-04-18T14:41:49.494 INFO:teuthology.orchestra.run.smithi096.stdout: fsid = ac90c892-1809-401c-a743-76948b63c51a 2024-04-18T14:41:49.494 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-04-18T14:41:49.494 INFO:teuthology.orchestra.run.smithi096.stdout:[osd] 2024-04-18T14:41:49.494 INFO:teuthology.orchestra.run.smithi096.stdout: osd journal size = 100 2024-04-18T14:41:49.494 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-04-18T14:41:49.494 INFO:teuthology.orchestra.run.smithi096.stdout: osd scrub load threshold = 5.0 2024-04-18T14:41:49.494 INFO:teuthology.orchestra.run.smithi096.stdout: osd scrub max interval = 120 2024-04-18T14:41:49.494 INFO:teuthology.orchestra.run.smithi096.stdout: osd mclock profile = high_recovery_ops 2024-04-18T14:41:49.494 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-04-18T14:41:49.495 INFO:teuthology.orchestra.run.smithi096.stdout: osd recover clone overlap = true 2024-04-18T14:41:49.495 INFO:teuthology.orchestra.run.smithi096.stdout: osd recovery max chunk = 1048576 2024-04-18T14:41:49.495 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-04-18T14:41:49.495 INFO:teuthology.orchestra.run.smithi096.stdout: osd debug shutdown = true 2024-04-18T14:41:49.495 INFO:teuthology.orchestra.run.smithi096.stdout: osd debug op order = true 2024-04-18T14:41:49.495 INFO:teuthology.orchestra.run.smithi096.stdout: osd debug verify stray on activate = true 2024-04-18T14:41:49.495 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-04-18T14:41:49.495 INFO:teuthology.orchestra.run.smithi096.stdout: osd open classes on start = true 2024-04-18T14:41:49.495 INFO:teuthology.orchestra.run.smithi096.stdout: osd debug pg log writeout = true 2024-04-18T14:41:49.495 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-04-18T14:41:49.495 INFO:teuthology.orchestra.run.smithi096.stdout: osd deep scrub update digest min age = 30 2024-04-18T14:41:49.495 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-04-18T14:41:49.495 INFO:teuthology.orchestra.run.smithi096.stdout: osd map max advance = 10 2024-04-18T14:41:49.495 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-04-18T14:41:49.495 INFO:teuthology.orchestra.run.smithi096.stdout: journal zero on create = true 2024-04-18T14:41:49.496 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-04-18T14:41:49.496 INFO:teuthology.orchestra.run.smithi096.stdout: filestore ondisk finisher threads = 3 2024-04-18T14:41:49.496 INFO:teuthology.orchestra.run.smithi096.stdout: filestore apply finisher threads = 3 2024-04-18T14:41:49.496 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-04-18T14:41:49.496 INFO:teuthology.orchestra.run.smithi096.stdout: bdev debug aio = true 2024-04-18T14:41:49.496 INFO:teuthology.orchestra.run.smithi096.stdout: osd debug misdirected ops = true 2024-04-18T14:41:49.496 INFO:teuthology.orchestra.run.smithi096.stdout: debug monc = 20 2024-04-18T14:41:49.496 INFO:teuthology.orchestra.run.smithi096.stdout: bdev async discard = True 2024-04-18T14:41:49.496 INFO:teuthology.orchestra.run.smithi096.stdout: bdev enable discard = True 2024-04-18T14:41:49.496 INFO:teuthology.orchestra.run.smithi096.stdout: bluestore allocator = stupid 2024-04-18T14:41:49.496 INFO:teuthology.orchestra.run.smithi096.stdout: bluestore block size = 96636764160 2024-04-18T14:41:49.496 INFO:teuthology.orchestra.run.smithi096.stdout: bluestore fsck on mount = True 2024-04-18T14:41:49.496 INFO:teuthology.orchestra.run.smithi096.stdout: bluestore zero block detection = True 2024-04-18T14:41:49.496 INFO:teuthology.orchestra.run.smithi096.stdout: debug bluefs = 20 2024-04-18T14:41:49.496 INFO:teuthology.orchestra.run.smithi096.stdout: debug bluestore = 20 2024-04-18T14:41:49.497 INFO:teuthology.orchestra.run.smithi096.stdout: debug ms = 1 2024-04-18T14:41:49.497 INFO:teuthology.orchestra.run.smithi096.stdout: debug osd = 20 2024-04-18T14:41:49.497 INFO:teuthology.orchestra.run.smithi096.stdout: debug rocksdb = 10 2024-04-18T14:41:49.497 INFO:teuthology.orchestra.run.smithi096.stdout: mon osd backfillfull_ratio = 0.85 2024-04-18T14:41:49.497 INFO:teuthology.orchestra.run.smithi096.stdout: mon osd full ratio = 0.9 2024-04-18T14:41:49.497 INFO:teuthology.orchestra.run.smithi096.stdout: mon osd nearfull ratio = 0.8 2024-04-18T14:41:49.497 INFO:teuthology.orchestra.run.smithi096.stdout: osd blocked scrub grace period = 3600 2024-04-18T14:41:49.497 INFO:teuthology.orchestra.run.smithi096.stdout: osd debug reject backfill probability = 0.3 2024-04-18T14:41:49.497 INFO:teuthology.orchestra.run.smithi096.stdout: osd debug verify cached snaps = True 2024-04-18T14:41:49.497 INFO:teuthology.orchestra.run.smithi096.stdout: osd debug verify missing on start = True 2024-04-18T14:41:49.497 INFO:teuthology.orchestra.run.smithi096.stdout: osd failsafe full ratio = 0.95 2024-04-18T14:41:49.497 INFO:teuthology.orchestra.run.smithi096.stdout: osd heartbeat use min delay socket = True 2024-04-18T14:41:49.497 INFO:teuthology.orchestra.run.smithi096.stdout: osd max backfills = 3 2024-04-18T14:41:49.497 INFO:teuthology.orchestra.run.smithi096.stdout: osd max markdown count = 1000 2024-04-18T14:41:49.497 INFO:teuthology.orchestra.run.smithi096.stdout: osd mclock override recovery settings = True 2024-04-18T14:41:49.498 INFO:teuthology.orchestra.run.smithi096.stdout: osd objectstore = bluestore 2024-04-18T14:41:49.498 INFO:teuthology.orchestra.run.smithi096.stdout: osd op queue = debug_random 2024-04-18T14:41:49.498 INFO:teuthology.orchestra.run.smithi096.stdout: osd op queue cut off = debug_random 2024-04-18T14:41:49.498 INFO:teuthology.orchestra.run.smithi096.stdout: osd scrub min interval = 60 2024-04-18T14:41:49.498 INFO:teuthology.orchestra.run.smithi096.stdout: osd shutdown pgref assert = True 2024-04-18T14:41:49.498 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-04-18T14:41:49.498 INFO:teuthology.orchestra.run.smithi096.stdout:[mgr] 2024-04-18T14:41:49.498 INFO:teuthology.orchestra.run.smithi096.stdout: debug ms = 1 2024-04-18T14:41:49.498 INFO:teuthology.orchestra.run.smithi096.stdout: debug mgr = 20 2024-04-18T14:41:49.498 INFO:teuthology.orchestra.run.smithi096.stdout: debug mon = 20 2024-04-18T14:41:49.498 INFO:teuthology.orchestra.run.smithi096.stdout: debug auth = 20 2024-04-18T14:41:49.498 INFO:teuthology.orchestra.run.smithi096.stdout: mon reweight min pgs per osd = 4 2024-04-18T14:41:49.498 INFO:teuthology.orchestra.run.smithi096.stdout: mon reweight min bytes per osd = 10 2024-04-18T14:41:49.498 INFO:teuthology.orchestra.run.smithi096.stdout: mgr/telemetry/nag = false 2024-04-18T14:41:49.498 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-04-18T14:41:49.499 INFO:teuthology.orchestra.run.smithi096.stdout:[mon] 2024-04-18T14:41:49.499 INFO:teuthology.orchestra.run.smithi096.stdout: debug ms = 1 2024-04-18T14:41:49.499 INFO:teuthology.orchestra.run.smithi096.stdout: debug mon = 20 2024-04-18T14:41:49.499 INFO:teuthology.orchestra.run.smithi096.stdout: debug paxos = 20 2024-04-18T14:41:49.499 INFO:teuthology.orchestra.run.smithi096.stdout: debug auth = 20 2024-04-18T14:41:49.499 INFO:teuthology.orchestra.run.smithi096.stdout: mon data avail warn = 5 2024-04-18T14:41:49.499 INFO:teuthology.orchestra.run.smithi096.stdout: mon mgr mkfs grace = 240 2024-04-18T14:41:49.499 INFO:teuthology.orchestra.run.smithi096.stdout: mon reweight min pgs per osd = 4 2024-04-18T14:41:49.499 INFO:teuthology.orchestra.run.smithi096.stdout: mon osd reporter subtree level = osd 2024-04-18T14:41:49.499 INFO:teuthology.orchestra.run.smithi096.stdout: mon osd prime pg temp = true 2024-04-18T14:41:49.499 INFO:teuthology.orchestra.run.smithi096.stdout: mon reweight min bytes per osd = 10 2024-04-18T14:41:49.499 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-04-18T14:41:49.499 INFO:teuthology.orchestra.run.smithi096.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-04-18T14:41:49.499 INFO:teuthology.orchestra.run.smithi096.stdout: auth mon ticket ttl = 660 # 11m 2024-04-18T14:41:49.499 INFO:teuthology.orchestra.run.smithi096.stdout: auth service ticket ttl = 240 # 4m 2024-04-18T14:41:49.500 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-04-18T14:41:49.500 INFO:teuthology.orchestra.run.smithi096.stdout: # don't complain about insecure global_id in the test suite 2024-04-18T14:41:49.500 INFO:teuthology.orchestra.run.smithi096.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-04-18T14:41:49.500 INFO:teuthology.orchestra.run.smithi096.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-04-18T14:41:49.500 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-04-18T14:41:49.500 INFO:teuthology.orchestra.run.smithi096.stdout: # 1m isn't quite enough 2024-04-18T14:41:49.500 INFO:teuthology.orchestra.run.smithi096.stdout: mon_down_mkfs_grace = 2m 2024-04-18T14:41:49.500 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-04-18T14:41:49.500 INFO:teuthology.orchestra.run.smithi096.stdout: mon_warn_on_filestore_osds = false 2024-04-18T14:41:49.500 INFO:teuthology.orchestra.run.smithi096.stdout: mon scrub interval = 300 2024-04-18T14:41:49.500 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-04-18T14:41:49.500 INFO:teuthology.orchestra.run.smithi096.stdout:[client] 2024-04-18T14:41:49.500 INFO:teuthology.orchestra.run.smithi096.stdout: rgw cache enabled = true 2024-04-18T14:41:49.500 INFO:teuthology.orchestra.run.smithi096.stdout: rgw enable ops log = true 2024-04-18T14:41:49.500 INFO:teuthology.orchestra.run.smithi096.stdout: rgw enable usage log = true 2024-04-18T14:41:49.500 INFO:teuthology.orchestra.run.smithi096.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-04-18T14:41:49.501 INFO:teuthology.orchestra.run.smithi096.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-04-18T14:41:49.501 INFO:teuthology.orchestra.run.smithi096.stdout:[mon.a] 2024-04-18T14:41:49.501 INFO:teuthology.orchestra.run.smithi096.stdout:[mon.b] 2024-04-18T14:41:49.501 INFO:teuthology.orchestra.run.smithi096.stdout:[mon.c] 2024-04-18T14:41:49.503 INFO:tasks.ceph:Creating admin key on mon.a... 2024-04-18T14:41:49.503 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-04-18T14:41:49.593 INFO:tasks.ceph:Copying monmap to all nodes... 2024-04-18T14:41:49.593 DEBUG:teuthology.orchestra.run.smithi086:> set -ex 2024-04-18T14:41:49.593 DEBUG:teuthology.orchestra.run.smithi086:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-04-18T14:41:49.599 DEBUG:teuthology.orchestra.run.smithi086:> set -ex 2024-04-18T14:41:49.599 DEBUG:teuthology.orchestra.run.smithi086:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-04-18T14:41:49.645 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi086.front.sepia.ceph.com 2024-04-18T14:41:49.645 DEBUG:teuthology.orchestra.run.smithi086:> set -ex 2024-04-18T14:41:49.645 DEBUG:teuthology.orchestra.run.smithi086:> sudo dd of=/etc/ceph/ceph.keyring 2024-04-18T14:41:49.645 DEBUG:teuthology.orchestra.run.smithi086:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-04-18T14:41:49.710 DEBUG:teuthology.orchestra.run.smithi086:> set -ex 2024-04-18T14:41:49.710 DEBUG:teuthology.orchestra.run.smithi086:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-04-18T14:41:49.758 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi096.front.sepia.ceph.com 2024-04-18T14:41:49.758 DEBUG:teuthology.orchestra.run.smithi096:> set -ex 2024-04-18T14:41:49.759 DEBUG:teuthology.orchestra.run.smithi096:> sudo dd of=/etc/ceph/ceph.keyring 2024-04-18T14:41:49.759 DEBUG:teuthology.orchestra.run.smithi096:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-04-18T14:41:49.781 DEBUG:teuthology.orchestra.run.smithi096:> set -ex 2024-04-18T14:41:49.781 DEBUG:teuthology.orchestra.run.smithi096:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-04-18T14:41:49.829 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi119.front.sepia.ceph.com 2024-04-18T14:41:49.829 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2024-04-18T14:41:49.829 DEBUG:teuthology.orchestra.run.smithi119:> sudo dd of=/etc/ceph/ceph.keyring 2024-04-18T14:41:49.829 DEBUG:teuthology.orchestra.run.smithi119:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-04-18T14:41:49.852 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2024-04-18T14:41:49.852 DEBUG:teuthology.orchestra.run.smithi119:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-04-18T14:41:49.899 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi134.front.sepia.ceph.com 2024-04-18T14:41:49.899 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-04-18T14:41:49.899 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd of=/etc/ceph/ceph.keyring 2024-04-18T14:41:49.899 DEBUG:teuthology.orchestra.run.smithi134:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-04-18T14:41:49.922 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-04-18T14:41:49.922 DEBUG:teuthology.orchestra.run.smithi134:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-04-18T14:41:49.971 INFO:tasks.ceph:Setting up mon nodes... 2024-04-18T14:41:49.971 INFO:tasks.ceph:Setting up mgr nodes... 2024-04-18T14:41:49.971 DEBUG:teuthology.orchestra.run.smithi086:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2024-04-18T14:41:50.014 INFO:teuthology.orchestra.run.smithi086.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2024-04-18T14:41:50.017 DEBUG:teuthology.orchestra.run.smithi134:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-04-18T14:41:50.059 INFO:teuthology.orchestra.run.smithi134.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-04-18T14:41:50.071 INFO:tasks.ceph:Setting up mds nodes... 2024-04-18T14:41:50.071 INFO:tasks.ceph_client:Setting up client nodes... 2024-04-18T14:41:50.072 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-04-18T14:41:50.145 INFO:teuthology.orchestra.run.smithi134.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-04-18T14:41:50.155 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-04-18T14:41:50.155 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi086.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.4': '/dev/vg_nvme/lv_2', 'osd.8': '/dev/vg_nvme/lv_3', 'osd.12': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi096.front.sepia.ceph.com'): {'osd.1': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.9': '/dev/vg_nvme/lv_3', 'osd.13': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi119.front.sepia.ceph.com'): {'osd.2': '/dev/vg_nvme/lv_1', 'osd.6': '/dev/vg_nvme/lv_2', 'osd.10': '/dev/vg_nvme/lv_3', 'osd.14': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi134.front.sepia.ceph.com'): {'osd.3': '/dev/vg_nvme/lv_1', 'osd.7': '/dev/vg_nvme/lv_2', 'osd.11': '/dev/vg_nvme/lv_3', 'osd.15': '/dev/vg_nvme/lv_4'}} 2024-04-18T14:41:50.156 DEBUG:teuthology.orchestra.run.smithi086:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-04-18T14:41:50.170 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.4': '/dev/vg_nvme/lv_2', 'osd.8': '/dev/vg_nvme/lv_3', 'osd.12': '/dev/vg_nvme/lv_4'} 2024-04-18T14:41:50.171 INFO:tasks.ceph:role: osd.0 2024-04-18T14:41:50.171 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi086.front.sepia.ceph.com 2024-04-18T14:41:50.171 DEBUG:teuthology.orchestra.run.smithi086:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-04-18T14:41:50.234 INFO:teuthology.orchestra.run.smithi086.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-04-18T14:41:50.235 INFO:teuthology.orchestra.run.smithi086.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-18T14:41:50.235 INFO:teuthology.orchestra.run.smithi086.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-18T14:41:50.235 INFO:teuthology.orchestra.run.smithi086.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-04-18T14:41:50.235 INFO:teuthology.orchestra.run.smithi086.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-18T14:41:50.235 INFO:teuthology.orchestra.run.smithi086.stdout: = sunit=0 swidth=0 blks 2024-04-18T14:41:50.235 INFO:teuthology.orchestra.run.smithi086.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-18T14:41:50.235 INFO:teuthology.orchestra.run.smithi086.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-04-18T14:41:50.235 INFO:teuthology.orchestra.run.smithi086.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-18T14:41:50.235 INFO:teuthology.orchestra.run.smithi086.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-18T14:41:50.691 INFO:teuthology.orchestra.run.smithi086.stdout:Discarding blocks...Done. 2024-04-18T14:41:50.693 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi086.front.sepia.ceph.com -o noatime 2024-04-18T14:41:50.693 DEBUG:teuthology.orchestra.run.smithi086:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-04-18T14:41:50.793 DEBUG:teuthology.orchestra.run.smithi086:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-04-18T14:41:50.803 INFO:teuthology.orchestra.run.smithi086.stderr:sudo: /sbin/restorecon: command not found 2024-04-18T14:41:50.803 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-18T14:41:50.804 DEBUG:teuthology.orchestra.run.smithi086:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2024-04-18T14:41:50.858 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.4': '/dev/vg_nvme/lv_2', 'osd.8': '/dev/vg_nvme/lv_3', 'osd.12': '/dev/vg_nvme/lv_4'} 2024-04-18T14:41:50.859 INFO:tasks.ceph:role: osd.4 2024-04-18T14:41:50.859 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi086.front.sepia.ceph.com 2024-04-18T14:41:50.859 DEBUG:teuthology.orchestra.run.smithi086:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-04-18T14:41:50.921 INFO:teuthology.orchestra.run.smithi086.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-04-18T14:41:50.921 INFO:teuthology.orchestra.run.smithi086.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-18T14:41:50.921 INFO:teuthology.orchestra.run.smithi086.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-18T14:41:50.921 INFO:teuthology.orchestra.run.smithi086.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-04-18T14:41:50.921 INFO:teuthology.orchestra.run.smithi086.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-18T14:41:50.921 INFO:teuthology.orchestra.run.smithi086.stdout: = sunit=0 swidth=0 blks 2024-04-18T14:41:50.921 INFO:teuthology.orchestra.run.smithi086.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-18T14:41:50.921 INFO:teuthology.orchestra.run.smithi086.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-04-18T14:41:50.921 INFO:teuthology.orchestra.run.smithi086.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-18T14:41:50.921 INFO:teuthology.orchestra.run.smithi086.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-18T14:41:51.398 INFO:teuthology.orchestra.run.smithi086.stdout:Discarding blocks...Done. 2024-04-18T14:41:51.399 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi086.front.sepia.ceph.com -o noatime 2024-04-18T14:41:51.399 DEBUG:teuthology.orchestra.run.smithi086:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-4 2024-04-18T14:41:51.556 DEBUG:teuthology.orchestra.run.smithi086:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2024-04-18T14:41:51.565 INFO:teuthology.orchestra.run.smithi086.stderr:sudo: /sbin/restorecon: command not found 2024-04-18T14:41:51.566 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-18T14:41:51.566 DEBUG:teuthology.orchestra.run.smithi086:> sudo mkdir -p /var/lib/ceph/osd/ceph-8 2024-04-18T14:41:51.620 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.4': '/dev/vg_nvme/lv_2', 'osd.8': '/dev/vg_nvme/lv_3', 'osd.12': '/dev/vg_nvme/lv_4'} 2024-04-18T14:41:51.620 INFO:tasks.ceph:role: osd.8 2024-04-18T14:41:51.620 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi086.front.sepia.ceph.com 2024-04-18T14:41:51.620 DEBUG:teuthology.orchestra.run.smithi086:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-04-18T14:41:51.687 INFO:teuthology.orchestra.run.smithi086.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-04-18T14:41:51.687 INFO:teuthology.orchestra.run.smithi086.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-18T14:41:51.687 INFO:teuthology.orchestra.run.smithi086.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-18T14:41:51.687 INFO:teuthology.orchestra.run.smithi086.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-04-18T14:41:51.687 INFO:teuthology.orchestra.run.smithi086.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-18T14:41:51.688 INFO:teuthology.orchestra.run.smithi086.stdout: = sunit=0 swidth=0 blks 2024-04-18T14:41:51.688 INFO:teuthology.orchestra.run.smithi086.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-18T14:41:51.688 INFO:teuthology.orchestra.run.smithi086.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-04-18T14:41:51.688 INFO:teuthology.orchestra.run.smithi086.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-18T14:41:51.688 INFO:teuthology.orchestra.run.smithi086.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-18T14:41:52.144 INFO:teuthology.orchestra.run.smithi086.stdout:Discarding blocks...Done. 2024-04-18T14:41:52.147 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi086.front.sepia.ceph.com -o noatime 2024-04-18T14:41:52.147 DEBUG:teuthology.orchestra.run.smithi086:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-8 2024-04-18T14:41:52.288 DEBUG:teuthology.orchestra.run.smithi086:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-8 2024-04-18T14:41:52.299 INFO:teuthology.orchestra.run.smithi086.stderr:sudo: /sbin/restorecon: command not found 2024-04-18T14:41:52.300 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-18T14:41:52.300 DEBUG:teuthology.orchestra.run.smithi086:> sudo mkdir -p /var/lib/ceph/osd/ceph-12 2024-04-18T14:41:52.356 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.4': '/dev/vg_nvme/lv_2', 'osd.8': '/dev/vg_nvme/lv_3', 'osd.12': '/dev/vg_nvme/lv_4'} 2024-04-18T14:41:52.356 INFO:tasks.ceph:role: osd.12 2024-04-18T14:41:52.356 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi086.front.sepia.ceph.com 2024-04-18T14:41:52.356 DEBUG:teuthology.orchestra.run.smithi086:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-04-18T14:41:52.420 INFO:teuthology.orchestra.run.smithi086.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-04-18T14:41:52.420 INFO:teuthology.orchestra.run.smithi086.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-18T14:41:52.420 INFO:teuthology.orchestra.run.smithi086.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-18T14:41:52.420 INFO:teuthology.orchestra.run.smithi086.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-04-18T14:41:52.421 INFO:teuthology.orchestra.run.smithi086.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-18T14:41:52.421 INFO:teuthology.orchestra.run.smithi086.stdout: = sunit=0 swidth=0 blks 2024-04-18T14:41:52.421 INFO:teuthology.orchestra.run.smithi086.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-18T14:41:52.421 INFO:teuthology.orchestra.run.smithi086.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-04-18T14:41:52.421 INFO:teuthology.orchestra.run.smithi086.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-18T14:41:52.421 INFO:teuthology.orchestra.run.smithi086.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-18T14:41:52.845 INFO:teuthology.orchestra.run.smithi086.stdout:Discarding blocks...Done. 2024-04-18T14:41:52.847 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi086.front.sepia.ceph.com -o noatime 2024-04-18T14:41:52.847 DEBUG:teuthology.orchestra.run.smithi086:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-12 2024-04-18T14:41:52.933 DEBUG:teuthology.orchestra.run.smithi086:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-12 2024-04-18T14:41:52.984 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-18T14:41:52.985 INFO:teuthology.orchestra.run.smithi086.stderr:sudo: /sbin/restorecon: command not found 2024-04-18T14:41:52.985 DEBUG:teuthology.orchestra.run.smithi086:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-18T14:41:53.090 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-18T14:41:53.092+0000 7fae2c2807c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-04-18T14:41:53.093 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-18T14:41:53.096+0000 7fae2c2807c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-04-18T14:41:53.093 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-18T14:41:53.096+0000 7fae2c2807c0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-04-18T14:41:53.093 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-18T14:41:53.096+0000 7fae2c2807c0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-04-18T14:41:53.093 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-18T14:41:53.096+0000 7fae2c2807c0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-04-18T14:41:53.096 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-18T14:41:53.100+0000 7fae2c2807c0 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2024-04-18T14:41:56.078 DEBUG:teuthology.orchestra.run.smithi086:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-04-18T14:41:56.091 DEBUG:teuthology.orchestra.run.smithi086:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-18T14:41:56.170 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-18T14:41:56.172+0000 7f09992857c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2024-04-18T14:41:56.171 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-18T14:41:56.172+0000 7f09992857c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2024-04-18T14:41:56.171 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-18T14:41:56.172+0000 7f09992857c0 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-04-18T14:41:56.171 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-18T14:41:56.172+0000 7f09992857c0 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-04-18T14:41:56.171 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-18T14:41:56.172+0000 7f09992857c0 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-04-18T14:41:56.172 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-18T14:41:56.172+0000 7f09992857c0 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2024-04-18T14:41:59.139 DEBUG:teuthology.orchestra.run.smithi086:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-04-18T14:41:59.193 DEBUG:teuthology.orchestra.run.smithi086:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 8 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-18T14:41:59.273 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-18T14:41:59.276+0000 7f5bb5afc7c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-8/keyring: can't open /var/lib/ceph/osd/ceph-8/keyring: (2) No such file or directory 2024-04-18T14:41:59.274 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-18T14:41:59.276+0000 7f5bb5afc7c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-8/keyring 2024-04-18T14:41:59.274 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-18T14:41:59.276+0000 7f5bb5afc7c0 -1 bluestore(/var/lib/ceph/osd/ceph-8/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-8/block: (2) No such file or directory 2024-04-18T14:41:59.274 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-18T14:41:59.276+0000 7f5bb5afc7c0 -1 bluestore(/var/lib/ceph/osd/ceph-8/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-8/block: (2) No such file or directory 2024-04-18T14:41:59.274 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-18T14:41:59.276+0000 7f5bb5afc7c0 -1 bluestore(/var/lib/ceph/osd/ceph-8/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-8/block: (2) No such file or directory 2024-04-18T14:41:59.275 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-18T14:41:59.276+0000 7f5bb5afc7c0 -1 bluestore(/var/lib/ceph/osd/ceph-8) _read_fsid unparsable uuid 2024-04-18T14:42:02.251 DEBUG:teuthology.orchestra.run.smithi086:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-8 2024-04-18T14:42:02.308 DEBUG:teuthology.orchestra.run.smithi086:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 12 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-18T14:42:02.390 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-18T14:42:02.392+0000 7fa7988f17c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-12/keyring: can't open /var/lib/ceph/osd/ceph-12/keyring: (2) No such file or directory 2024-04-18T14:42:02.390 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-18T14:42:02.392+0000 7fa7988f17c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-12/keyring 2024-04-18T14:42:02.390 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-18T14:42:02.392+0000 7fa7988f17c0 -1 bluestore(/var/lib/ceph/osd/ceph-12/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-12/block: (2) No such file or directory 2024-04-18T14:42:02.390 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-18T14:42:02.392+0000 7fa7988f17c0 -1 bluestore(/var/lib/ceph/osd/ceph-12/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-12/block: (2) No such file or directory 2024-04-18T14:42:02.390 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-18T14:42:02.392+0000 7fa7988f17c0 -1 bluestore(/var/lib/ceph/osd/ceph-12/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-12/block: (2) No such file or directory 2024-04-18T14:42:02.391 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-18T14:42:02.392+0000 7fa7988f17c0 -1 bluestore(/var/lib/ceph/osd/ceph-12) _read_fsid unparsable uuid 2024-04-18T14:42:05.396 DEBUG:teuthology.orchestra.run.smithi086:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-12 2024-04-18T14:42:05.452 DEBUG:teuthology.orchestra.run.smithi096:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-04-18T14:42:05.468 INFO:tasks.ceph:roles_to_devs: {'osd.1': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.9': '/dev/vg_nvme/lv_3', 'osd.13': '/dev/vg_nvme/lv_4'} 2024-04-18T14:42:05.468 INFO:tasks.ceph:role: osd.1 2024-04-18T14:42:05.468 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi096.front.sepia.ceph.com 2024-04-18T14:42:05.468 DEBUG:teuthology.orchestra.run.smithi096:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-04-18T14:42:05.533 INFO:teuthology.orchestra.run.smithi096.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-04-18T14:42:05.533 INFO:teuthology.orchestra.run.smithi096.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-18T14:42:05.533 INFO:teuthology.orchestra.run.smithi096.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-18T14:42:05.533 INFO:teuthology.orchestra.run.smithi096.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-04-18T14:42:05.533 INFO:teuthology.orchestra.run.smithi096.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-18T14:42:05.533 INFO:teuthology.orchestra.run.smithi096.stdout: = sunit=0 swidth=0 blks 2024-04-18T14:42:05.533 INFO:teuthology.orchestra.run.smithi096.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-18T14:42:05.533 INFO:teuthology.orchestra.run.smithi096.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-04-18T14:42:05.533 INFO:teuthology.orchestra.run.smithi096.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-18T14:42:05.533 INFO:teuthology.orchestra.run.smithi096.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-18T14:42:05.989 INFO:teuthology.orchestra.run.smithi096.stdout:Discarding blocks...Done. 2024-04-18T14:42:05.991 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi096.front.sepia.ceph.com -o noatime 2024-04-18T14:42:05.991 DEBUG:teuthology.orchestra.run.smithi096:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-1 2024-04-18T14:42:06.090 DEBUG:teuthology.orchestra.run.smithi096:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-04-18T14:42:06.100 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-18T14:42:06.100 INFO:teuthology.orchestra.run.smithi096.stderr:sudo: /sbin/restorecon: command not found 2024-04-18T14:42:06.101 DEBUG:teuthology.orchestra.run.smithi096:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2024-04-18T14:42:06.154 INFO:tasks.ceph:roles_to_devs: {'osd.1': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.9': '/dev/vg_nvme/lv_3', 'osd.13': '/dev/vg_nvme/lv_4'} 2024-04-18T14:42:06.154 INFO:tasks.ceph:role: osd.5 2024-04-18T14:42:06.154 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi096.front.sepia.ceph.com 2024-04-18T14:42:06.154 DEBUG:teuthology.orchestra.run.smithi096:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-04-18T14:42:06.216 INFO:teuthology.orchestra.run.smithi096.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-04-18T14:42:06.216 INFO:teuthology.orchestra.run.smithi096.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-18T14:42:06.217 INFO:teuthology.orchestra.run.smithi096.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-18T14:42:06.217 INFO:teuthology.orchestra.run.smithi096.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-04-18T14:42:06.217 INFO:teuthology.orchestra.run.smithi096.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-18T14:42:06.217 INFO:teuthology.orchestra.run.smithi096.stdout: = sunit=0 swidth=0 blks 2024-04-18T14:42:06.217 INFO:teuthology.orchestra.run.smithi096.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-18T14:42:06.217 INFO:teuthology.orchestra.run.smithi096.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-04-18T14:42:06.217 INFO:teuthology.orchestra.run.smithi096.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-18T14:42:06.217 INFO:teuthology.orchestra.run.smithi096.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-18T14:42:06.687 INFO:teuthology.orchestra.run.smithi096.stdout:Discarding blocks...Done. 2024-04-18T14:42:06.689 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi096.front.sepia.ceph.com -o noatime 2024-04-18T14:42:06.689 DEBUG:teuthology.orchestra.run.smithi096:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2024-04-18T14:42:06.849 DEBUG:teuthology.orchestra.run.smithi096:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2024-04-18T14:42:06.860 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-18T14:42:06.860 INFO:teuthology.orchestra.run.smithi096.stderr:sudo: /sbin/restorecon: command not found 2024-04-18T14:42:06.861 DEBUG:teuthology.orchestra.run.smithi096:> sudo mkdir -p /var/lib/ceph/osd/ceph-9 2024-04-18T14:42:06.916 INFO:tasks.ceph:roles_to_devs: {'osd.1': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.9': '/dev/vg_nvme/lv_3', 'osd.13': '/dev/vg_nvme/lv_4'} 2024-04-18T14:42:06.916 INFO:tasks.ceph:role: osd.9 2024-04-18T14:42:06.916 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi096.front.sepia.ceph.com 2024-04-18T14:42:06.917 DEBUG:teuthology.orchestra.run.smithi096:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-04-18T14:42:06.979 INFO:teuthology.orchestra.run.smithi096.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-04-18T14:42:06.979 INFO:teuthology.orchestra.run.smithi096.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-18T14:42:06.979 INFO:teuthology.orchestra.run.smithi096.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-18T14:42:06.979 INFO:teuthology.orchestra.run.smithi096.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-04-18T14:42:06.979 INFO:teuthology.orchestra.run.smithi096.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-18T14:42:06.980 INFO:teuthology.orchestra.run.smithi096.stdout: = sunit=0 swidth=0 blks 2024-04-18T14:42:06.980 INFO:teuthology.orchestra.run.smithi096.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-18T14:42:06.980 INFO:teuthology.orchestra.run.smithi096.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-04-18T14:42:06.980 INFO:teuthology.orchestra.run.smithi096.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-18T14:42:06.980 INFO:teuthology.orchestra.run.smithi096.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-18T14:42:07.438 INFO:teuthology.orchestra.run.smithi096.stdout:Discarding blocks...Done. 2024-04-18T14:42:07.440 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi096.front.sepia.ceph.com -o noatime 2024-04-18T14:42:07.440 DEBUG:teuthology.orchestra.run.smithi096:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-9 2024-04-18T14:42:07.582 DEBUG:teuthology.orchestra.run.smithi096:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-9 2024-04-18T14:42:07.592 INFO:teuthology.orchestra.run.smithi096.stderr:sudo: /sbin/restorecon: command not found 2024-04-18T14:42:07.592 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-18T14:42:07.593 DEBUG:teuthology.orchestra.run.smithi096:> sudo mkdir -p /var/lib/ceph/osd/ceph-13 2024-04-18T14:42:07.651 INFO:tasks.ceph:roles_to_devs: {'osd.1': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.9': '/dev/vg_nvme/lv_3', 'osd.13': '/dev/vg_nvme/lv_4'} 2024-04-18T14:42:07.651 INFO:tasks.ceph:role: osd.13 2024-04-18T14:42:07.651 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi096.front.sepia.ceph.com 2024-04-18T14:42:07.651 DEBUG:teuthology.orchestra.run.smithi096:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-04-18T14:42:07.715 INFO:teuthology.orchestra.run.smithi096.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-04-18T14:42:07.715 INFO:teuthology.orchestra.run.smithi096.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-18T14:42:07.715 INFO:teuthology.orchestra.run.smithi096.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-18T14:42:07.715 INFO:teuthology.orchestra.run.smithi096.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-04-18T14:42:07.715 INFO:teuthology.orchestra.run.smithi096.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-18T14:42:07.715 INFO:teuthology.orchestra.run.smithi096.stdout: = sunit=0 swidth=0 blks 2024-04-18T14:42:07.716 INFO:teuthology.orchestra.run.smithi096.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-18T14:42:07.716 INFO:teuthology.orchestra.run.smithi096.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-04-18T14:42:07.716 INFO:teuthology.orchestra.run.smithi096.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-18T14:42:07.716 INFO:teuthology.orchestra.run.smithi096.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-18T14:42:08.143 INFO:teuthology.orchestra.run.smithi096.stdout:Discarding blocks...Done. 2024-04-18T14:42:08.145 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi096.front.sepia.ceph.com -o noatime 2024-04-18T14:42:08.145 DEBUG:teuthology.orchestra.run.smithi096:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-13 2024-04-18T14:42:08.236 DEBUG:teuthology.orchestra.run.smithi096:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-13 2024-04-18T14:42:08.289 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-18T14:42:08.290 INFO:teuthology.orchestra.run.smithi096.stderr:sudo: /sbin/restorecon: command not found 2024-04-18T14:42:08.290 DEBUG:teuthology.orchestra.run.smithi096:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-18T14:42:08.398 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T14:42:08.400+0000 7fb2772eb7c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-04-18T14:42:08.399 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T14:42:08.400+0000 7fb2772eb7c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-04-18T14:42:08.400 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T14:42:08.400+0000 7fb2772eb7c0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-04-18T14:42:08.400 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T14:42:08.400+0000 7fb2772eb7c0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-04-18T14:42:08.400 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T14:42:08.400+0000 7fb2772eb7c0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-04-18T14:42:08.400 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T14:42:08.404+0000 7fb2772eb7c0 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2024-04-18T14:42:11.383 DEBUG:teuthology.orchestra.run.smithi096:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-04-18T14:42:11.397 DEBUG:teuthology.orchestra.run.smithi096:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-18T14:42:11.478 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T14:42:11.480+0000 7f16b34bb7c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2024-04-18T14:42:11.479 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T14:42:11.480+0000 7f16b34bb7c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2024-04-18T14:42:11.479 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T14:42:11.480+0000 7f16b34bb7c0 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-04-18T14:42:11.479 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T14:42:11.480+0000 7f16b34bb7c0 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-04-18T14:42:11.479 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T14:42:11.480+0000 7f16b34bb7c0 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-04-18T14:42:11.479 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T14:42:11.480+0000 7f16b34bb7c0 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2024-04-18T14:42:14.464 DEBUG:teuthology.orchestra.run.smithi096:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-04-18T14:42:14.520 DEBUG:teuthology.orchestra.run.smithi096:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 9 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-18T14:42:14.600 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T14:42:14.604+0000 7f7336a277c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-9/keyring: can't open /var/lib/ceph/osd/ceph-9/keyring: (2) No such file or directory 2024-04-18T14:42:14.601 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T14:42:14.604+0000 7f7336a277c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-9/keyring 2024-04-18T14:42:14.601 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T14:42:14.604+0000 7f7336a277c0 -1 bluestore(/var/lib/ceph/osd/ceph-9/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-9/block: (2) No such file or directory 2024-04-18T14:42:14.601 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T14:42:14.604+0000 7f7336a277c0 -1 bluestore(/var/lib/ceph/osd/ceph-9/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-9/block: (2) No such file or directory 2024-04-18T14:42:14.601 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T14:42:14.604+0000 7f7336a277c0 -1 bluestore(/var/lib/ceph/osd/ceph-9/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-9/block: (2) No such file or directory 2024-04-18T14:42:14.602 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T14:42:14.604+0000 7f7336a277c0 -1 bluestore(/var/lib/ceph/osd/ceph-9) _read_fsid unparsable uuid 2024-04-18T14:42:17.583 DEBUG:teuthology.orchestra.run.smithi096:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-9 2024-04-18T14:42:17.636 DEBUG:teuthology.orchestra.run.smithi096:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 13 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-18T14:42:17.718 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T14:42:17.720+0000 7f18740f77c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-13/keyring: can't open /var/lib/ceph/osd/ceph-13/keyring: (2) No such file or directory 2024-04-18T14:42:17.719 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T14:42:17.720+0000 7f18740f77c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-13/keyring 2024-04-18T14:42:17.719 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T14:42:17.720+0000 7f18740f77c0 -1 bluestore(/var/lib/ceph/osd/ceph-13/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-13/block: (2) No such file or directory 2024-04-18T14:42:17.719 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T14:42:17.720+0000 7f18740f77c0 -1 bluestore(/var/lib/ceph/osd/ceph-13/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-13/block: (2) No such file or directory 2024-04-18T14:42:17.720 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T14:42:17.720+0000 7f18740f77c0 -1 bluestore(/var/lib/ceph/osd/ceph-13/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-13/block: (2) No such file or directory 2024-04-18T14:42:17.720 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T14:42:17.720+0000 7f18740f77c0 -1 bluestore(/var/lib/ceph/osd/ceph-13) _read_fsid unparsable uuid 2024-04-18T14:42:20.682 DEBUG:teuthology.orchestra.run.smithi096:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-13 2024-04-18T14:42:20.737 DEBUG:teuthology.orchestra.run.smithi119:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-04-18T14:42:20.751 INFO:tasks.ceph:roles_to_devs: {'osd.2': '/dev/vg_nvme/lv_1', 'osd.6': '/dev/vg_nvme/lv_2', 'osd.10': '/dev/vg_nvme/lv_3', 'osd.14': '/dev/vg_nvme/lv_4'} 2024-04-18T14:42:20.752 INFO:tasks.ceph:role: osd.2 2024-04-18T14:42:20.752 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi119.front.sepia.ceph.com 2024-04-18T14:42:20.752 DEBUG:teuthology.orchestra.run.smithi119:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-04-18T14:42:20.814 INFO:teuthology.orchestra.run.smithi119.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-04-18T14:42:20.815 INFO:teuthology.orchestra.run.smithi119.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-18T14:42:20.815 INFO:teuthology.orchestra.run.smithi119.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-18T14:42:20.815 INFO:teuthology.orchestra.run.smithi119.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-04-18T14:42:20.815 INFO:teuthology.orchestra.run.smithi119.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-18T14:42:20.815 INFO:teuthology.orchestra.run.smithi119.stdout: = sunit=0 swidth=0 blks 2024-04-18T14:42:20.815 INFO:teuthology.orchestra.run.smithi119.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-18T14:42:20.815 INFO:teuthology.orchestra.run.smithi119.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-04-18T14:42:20.815 INFO:teuthology.orchestra.run.smithi119.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-18T14:42:20.815 INFO:teuthology.orchestra.run.smithi119.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-18T14:42:21.295 INFO:teuthology.orchestra.run.smithi119.stdout:Discarding blocks...Done. 2024-04-18T14:42:21.297 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi119.front.sepia.ceph.com -o noatime 2024-04-18T14:42:21.297 DEBUG:teuthology.orchestra.run.smithi119:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-2 2024-04-18T14:42:21.420 DEBUG:teuthology.orchestra.run.smithi119:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-04-18T14:42:21.432 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-18T14:42:21.432 INFO:teuthology.orchestra.run.smithi119.stderr:sudo: /sbin/restorecon: command not found 2024-04-18T14:42:21.433 DEBUG:teuthology.orchestra.run.smithi119:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2024-04-18T14:42:21.484 INFO:tasks.ceph:roles_to_devs: {'osd.2': '/dev/vg_nvme/lv_1', 'osd.6': '/dev/vg_nvme/lv_2', 'osd.10': '/dev/vg_nvme/lv_3', 'osd.14': '/dev/vg_nvme/lv_4'} 2024-04-18T14:42:21.484 INFO:tasks.ceph:role: osd.6 2024-04-18T14:42:21.484 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi119.front.sepia.ceph.com 2024-04-18T14:42:21.485 DEBUG:teuthology.orchestra.run.smithi119:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-04-18T14:42:21.546 INFO:teuthology.orchestra.run.smithi119.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-04-18T14:42:21.546 INFO:teuthology.orchestra.run.smithi119.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-18T14:42:21.546 INFO:teuthology.orchestra.run.smithi119.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-18T14:42:21.546 INFO:teuthology.orchestra.run.smithi119.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-04-18T14:42:21.546 INFO:teuthology.orchestra.run.smithi119.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-18T14:42:21.546 INFO:teuthology.orchestra.run.smithi119.stdout: = sunit=0 swidth=0 blks 2024-04-18T14:42:21.546 INFO:teuthology.orchestra.run.smithi119.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-18T14:42:21.546 INFO:teuthology.orchestra.run.smithi119.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-04-18T14:42:21.546 INFO:teuthology.orchestra.run.smithi119.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-18T14:42:21.546 INFO:teuthology.orchestra.run.smithi119.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-18T14:42:21.972 INFO:teuthology.orchestra.run.smithi119.stdout:Discarding blocks...Done. 2024-04-18T14:42:21.975 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi119.front.sepia.ceph.com -o noatime 2024-04-18T14:42:21.975 DEBUG:teuthology.orchestra.run.smithi119:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-6 2024-04-18T14:42:22.043 DEBUG:teuthology.orchestra.run.smithi119:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2024-04-18T14:42:22.094 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-18T14:42:22.095 INFO:teuthology.orchestra.run.smithi119.stderr:sudo: /sbin/restorecon: command not found 2024-04-18T14:42:22.095 DEBUG:teuthology.orchestra.run.smithi119:> sudo mkdir -p /var/lib/ceph/osd/ceph-10 2024-04-18T14:42:22.149 INFO:tasks.ceph:roles_to_devs: {'osd.2': '/dev/vg_nvme/lv_1', 'osd.6': '/dev/vg_nvme/lv_2', 'osd.10': '/dev/vg_nvme/lv_3', 'osd.14': '/dev/vg_nvme/lv_4'} 2024-04-18T14:42:22.149 INFO:tasks.ceph:role: osd.10 2024-04-18T14:42:22.149 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi119.front.sepia.ceph.com 2024-04-18T14:42:22.150 DEBUG:teuthology.orchestra.run.smithi119:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-04-18T14:42:22.213 INFO:teuthology.orchestra.run.smithi119.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-04-18T14:42:22.213 INFO:teuthology.orchestra.run.smithi119.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-18T14:42:22.213 INFO:teuthology.orchestra.run.smithi119.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-18T14:42:22.213 INFO:teuthology.orchestra.run.smithi119.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-04-18T14:42:22.213 INFO:teuthology.orchestra.run.smithi119.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-18T14:42:22.213 INFO:teuthology.orchestra.run.smithi119.stdout: = sunit=0 swidth=0 blks 2024-04-18T14:42:22.213 INFO:teuthology.orchestra.run.smithi119.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-18T14:42:22.213 INFO:teuthology.orchestra.run.smithi119.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-04-18T14:42:22.213 INFO:teuthology.orchestra.run.smithi119.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-18T14:42:22.213 INFO:teuthology.orchestra.run.smithi119.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-18T14:42:22.682 INFO:teuthology.orchestra.run.smithi119.stdout:Discarding blocks...Done. 2024-04-18T14:42:22.684 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi119.front.sepia.ceph.com -o noatime 2024-04-18T14:42:22.684 DEBUG:teuthology.orchestra.run.smithi119:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-10 2024-04-18T14:42:22.785 DEBUG:teuthology.orchestra.run.smithi119:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-10 2024-04-18T14:42:22.796 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-18T14:42:22.797 INFO:teuthology.orchestra.run.smithi119.stderr:sudo: /sbin/restorecon: command not found 2024-04-18T14:42:22.797 DEBUG:teuthology.orchestra.run.smithi119:> sudo mkdir -p /var/lib/ceph/osd/ceph-14 2024-04-18T14:42:22.854 INFO:tasks.ceph:roles_to_devs: {'osd.2': '/dev/vg_nvme/lv_1', 'osd.6': '/dev/vg_nvme/lv_2', 'osd.10': '/dev/vg_nvme/lv_3', 'osd.14': '/dev/vg_nvme/lv_4'} 2024-04-18T14:42:22.854 INFO:tasks.ceph:role: osd.14 2024-04-18T14:42:22.854 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi119.front.sepia.ceph.com 2024-04-18T14:42:22.854 DEBUG:teuthology.orchestra.run.smithi119:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-04-18T14:42:22.918 INFO:teuthology.orchestra.run.smithi119.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-04-18T14:42:22.918 INFO:teuthology.orchestra.run.smithi119.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-18T14:42:22.918 INFO:teuthology.orchestra.run.smithi119.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-18T14:42:22.918 INFO:teuthology.orchestra.run.smithi119.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-04-18T14:42:22.919 INFO:teuthology.orchestra.run.smithi119.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-18T14:42:22.919 INFO:teuthology.orchestra.run.smithi119.stdout: = sunit=0 swidth=0 blks 2024-04-18T14:42:22.919 INFO:teuthology.orchestra.run.smithi119.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-18T14:42:22.919 INFO:teuthology.orchestra.run.smithi119.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-04-18T14:42:22.919 INFO:teuthology.orchestra.run.smithi119.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-18T14:42:22.919 INFO:teuthology.orchestra.run.smithi119.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-18T14:42:23.379 INFO:teuthology.orchestra.run.smithi119.stdout:Discarding blocks...Done. 2024-04-18T14:42:23.381 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi119.front.sepia.ceph.com -o noatime 2024-04-18T14:42:23.381 DEBUG:teuthology.orchestra.run.smithi119:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-14 2024-04-18T14:42:23.528 DEBUG:teuthology.orchestra.run.smithi119:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-14 2024-04-18T14:42:23.540 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-18T14:42:23.540 INFO:teuthology.orchestra.run.smithi119.stderr:sudo: /sbin/restorecon: command not found 2024-04-18T14:42:23.540 DEBUG:teuthology.orchestra.run.smithi119:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-18T14:42:23.658 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-18T14:42:23.656+0000 7fe174dd77c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-04-18T14:42:23.660 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-18T14:42:23.656+0000 7fe174dd77c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-04-18T14:42:23.660 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-18T14:42:23.656+0000 7fe174dd77c0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-04-18T14:42:23.661 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-18T14:42:23.656+0000 7fe174dd77c0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-04-18T14:42:23.661 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-18T14:42:23.656+0000 7fe174dd77c0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-04-18T14:42:23.667 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-18T14:42:23.664+0000 7fe174dd77c0 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2024-04-18T14:42:26.650 DEBUG:teuthology.orchestra.run.smithi119:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-04-18T14:42:26.664 DEBUG:teuthology.orchestra.run.smithi119:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-18T14:42:26.742 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-18T14:42:26.740+0000 7f5a07e687c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2024-04-18T14:42:26.743 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-18T14:42:26.740+0000 7f5a07e687c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2024-04-18T14:42:26.743 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-18T14:42:26.740+0000 7f5a07e687c0 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-04-18T14:42:26.743 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-18T14:42:26.740+0000 7f5a07e687c0 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-04-18T14:42:26.743 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-18T14:42:26.740+0000 7f5a07e687c0 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-04-18T14:42:26.744 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-18T14:42:26.740+0000 7f5a07e687c0 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2024-04-18T14:42:29.710 DEBUG:teuthology.orchestra.run.smithi119:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2024-04-18T14:42:29.765 DEBUG:teuthology.orchestra.run.smithi119:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 10 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-18T14:42:29.848 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-18T14:42:29.844+0000 7f181031f7c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-10/keyring: can't open /var/lib/ceph/osd/ceph-10/keyring: (2) No such file or directory 2024-04-18T14:42:29.849 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-18T14:42:29.844+0000 7f181031f7c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-10/keyring 2024-04-18T14:42:29.849 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-18T14:42:29.844+0000 7f181031f7c0 -1 bluestore(/var/lib/ceph/osd/ceph-10/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-10/block: (2) No such file or directory 2024-04-18T14:42:29.849 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-18T14:42:29.844+0000 7f181031f7c0 -1 bluestore(/var/lib/ceph/osd/ceph-10/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-10/block: (2) No such file or directory 2024-04-18T14:42:29.849 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-18T14:42:29.844+0000 7f181031f7c0 -1 bluestore(/var/lib/ceph/osd/ceph-10/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-10/block: (2) No such file or directory 2024-04-18T14:42:29.849 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-18T14:42:29.848+0000 7f181031f7c0 -1 bluestore(/var/lib/ceph/osd/ceph-10) _read_fsid unparsable uuid 2024-04-18T14:42:32.836 DEBUG:teuthology.orchestra.run.smithi119:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-10 2024-04-18T14:42:32.891 DEBUG:teuthology.orchestra.run.smithi119:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 14 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-18T14:42:32.973 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-18T14:42:32.967+0000 7f2c0c7827c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-14/keyring: can't open /var/lib/ceph/osd/ceph-14/keyring: (2) No such file or directory 2024-04-18T14:42:32.973 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-18T14:42:32.971+0000 7f2c0c7827c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-14/keyring 2024-04-18T14:42:32.974 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-18T14:42:32.971+0000 7f2c0c7827c0 -1 bluestore(/var/lib/ceph/osd/ceph-14/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-14/block: (2) No such file or directory 2024-04-18T14:42:32.974 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-18T14:42:32.971+0000 7f2c0c7827c0 -1 bluestore(/var/lib/ceph/osd/ceph-14/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-14/block: (2) No such file or directory 2024-04-18T14:42:32.974 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-18T14:42:32.971+0000 7f2c0c7827c0 -1 bluestore(/var/lib/ceph/osd/ceph-14/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-14/block: (2) No such file or directory 2024-04-18T14:42:32.974 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-18T14:42:32.971+0000 7f2c0c7827c0 -1 bluestore(/var/lib/ceph/osd/ceph-14) _read_fsid unparsable uuid 2024-04-18T14:42:35.960 DEBUG:teuthology.orchestra.run.smithi119:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-14 2024-04-18T14:42:36.014 DEBUG:teuthology.orchestra.run.smithi134:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2024-04-18T14:42:36.028 INFO:tasks.ceph:roles_to_devs: {'osd.3': '/dev/vg_nvme/lv_1', 'osd.7': '/dev/vg_nvme/lv_2', 'osd.11': '/dev/vg_nvme/lv_3', 'osd.15': '/dev/vg_nvme/lv_4'} 2024-04-18T14:42:36.029 INFO:tasks.ceph:role: osd.3 2024-04-18T14:42:36.029 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi134.front.sepia.ceph.com 2024-04-18T14:42:36.029 DEBUG:teuthology.orchestra.run.smithi134:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-04-18T14:42:36.093 INFO:teuthology.orchestra.run.smithi134.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-04-18T14:42:36.093 INFO:teuthology.orchestra.run.smithi134.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-18T14:42:36.094 INFO:teuthology.orchestra.run.smithi134.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-18T14:42:36.094 INFO:teuthology.orchestra.run.smithi134.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-04-18T14:42:36.094 INFO:teuthology.orchestra.run.smithi134.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-18T14:42:36.094 INFO:teuthology.orchestra.run.smithi134.stdout: = sunit=0 swidth=0 blks 2024-04-18T14:42:36.094 INFO:teuthology.orchestra.run.smithi134.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-18T14:42:36.094 INFO:teuthology.orchestra.run.smithi134.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-04-18T14:42:36.094 INFO:teuthology.orchestra.run.smithi134.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-18T14:42:36.094 INFO:teuthology.orchestra.run.smithi134.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-18T14:42:36.569 INFO:teuthology.orchestra.run.smithi134.stdout:Discarding blocks...Done. 2024-04-18T14:42:36.572 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi134.front.sepia.ceph.com -o noatime 2024-04-18T14:42:36.572 DEBUG:teuthology.orchestra.run.smithi134:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-3 2024-04-18T14:42:36.730 DEBUG:teuthology.orchestra.run.smithi134:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2024-04-18T14:42:36.742 INFO:teuthology.orchestra.run.smithi134.stderr:sudo: /sbin/restorecon: command not found 2024-04-18T14:42:36.742 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-18T14:42:36.743 DEBUG:teuthology.orchestra.run.smithi134:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2024-04-18T14:42:36.797 INFO:tasks.ceph:roles_to_devs: {'osd.3': '/dev/vg_nvme/lv_1', 'osd.7': '/dev/vg_nvme/lv_2', 'osd.11': '/dev/vg_nvme/lv_3', 'osd.15': '/dev/vg_nvme/lv_4'} 2024-04-18T14:42:36.797 INFO:tasks.ceph:role: osd.7 2024-04-18T14:42:36.797 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi134.front.sepia.ceph.com 2024-04-18T14:42:36.797 DEBUG:teuthology.orchestra.run.smithi134:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-04-18T14:42:36.861 INFO:teuthology.orchestra.run.smithi134.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-04-18T14:42:36.861 INFO:teuthology.orchestra.run.smithi134.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-18T14:42:36.861 INFO:teuthology.orchestra.run.smithi134.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-18T14:42:36.861 INFO:teuthology.orchestra.run.smithi134.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-04-18T14:42:36.861 INFO:teuthology.orchestra.run.smithi134.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-18T14:42:36.861 INFO:teuthology.orchestra.run.smithi134.stdout: = sunit=0 swidth=0 blks 2024-04-18T14:42:36.861 INFO:teuthology.orchestra.run.smithi134.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-18T14:42:36.861 INFO:teuthology.orchestra.run.smithi134.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-04-18T14:42:36.861 INFO:teuthology.orchestra.run.smithi134.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-18T14:42:36.861 INFO:teuthology.orchestra.run.smithi134.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-18T14:42:37.300 INFO:teuthology.orchestra.run.smithi134.stdout:Discarding blocks...Done. 2024-04-18T14:42:37.302 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi134.front.sepia.ceph.com -o noatime 2024-04-18T14:42:37.302 DEBUG:teuthology.orchestra.run.smithi134:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-7 2024-04-18T14:42:37.390 DEBUG:teuthology.orchestra.run.smithi134:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2024-04-18T14:42:37.399 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-18T14:42:37.400 INFO:teuthology.orchestra.run.smithi134.stderr:sudo: /sbin/restorecon: command not found 2024-04-18T14:42:37.400 DEBUG:teuthology.orchestra.run.smithi134:> sudo mkdir -p /var/lib/ceph/osd/ceph-11 2024-04-18T14:42:37.451 INFO:tasks.ceph:roles_to_devs: {'osd.3': '/dev/vg_nvme/lv_1', 'osd.7': '/dev/vg_nvme/lv_2', 'osd.11': '/dev/vg_nvme/lv_3', 'osd.15': '/dev/vg_nvme/lv_4'} 2024-04-18T14:42:37.451 INFO:tasks.ceph:role: osd.11 2024-04-18T14:42:37.451 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi134.front.sepia.ceph.com 2024-04-18T14:42:37.451 DEBUG:teuthology.orchestra.run.smithi134:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-04-18T14:42:37.512 INFO:teuthology.orchestra.run.smithi134.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-04-18T14:42:37.512 INFO:teuthology.orchestra.run.smithi134.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-18T14:42:37.512 INFO:teuthology.orchestra.run.smithi134.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-18T14:42:37.512 INFO:teuthology.orchestra.run.smithi134.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-04-18T14:42:37.512 INFO:teuthology.orchestra.run.smithi134.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-18T14:42:37.512 INFO:teuthology.orchestra.run.smithi134.stdout: = sunit=0 swidth=0 blks 2024-04-18T14:42:37.512 INFO:teuthology.orchestra.run.smithi134.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-18T14:42:37.512 INFO:teuthology.orchestra.run.smithi134.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-04-18T14:42:37.512 INFO:teuthology.orchestra.run.smithi134.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-18T14:42:37.512 INFO:teuthology.orchestra.run.smithi134.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-18T14:42:37.971 INFO:teuthology.orchestra.run.smithi134.stdout:Discarding blocks...Done. 2024-04-18T14:42:37.973 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi134.front.sepia.ceph.com -o noatime 2024-04-18T14:42:37.973 DEBUG:teuthology.orchestra.run.smithi134:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-11 2024-04-18T14:42:38.063 DEBUG:teuthology.orchestra.run.smithi134:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-11 2024-04-18T14:42:38.072 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-18T14:42:38.072 INFO:teuthology.orchestra.run.smithi134.stderr:sudo: /sbin/restorecon: command not found 2024-04-18T14:42:38.073 DEBUG:teuthology.orchestra.run.smithi134:> sudo mkdir -p /var/lib/ceph/osd/ceph-15 2024-04-18T14:42:38.126 INFO:tasks.ceph:roles_to_devs: {'osd.3': '/dev/vg_nvme/lv_1', 'osd.7': '/dev/vg_nvme/lv_2', 'osd.11': '/dev/vg_nvme/lv_3', 'osd.15': '/dev/vg_nvme/lv_4'} 2024-04-18T14:42:38.127 INFO:tasks.ceph:role: osd.15 2024-04-18T14:42:38.127 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi134.front.sepia.ceph.com 2024-04-18T14:42:38.127 DEBUG:teuthology.orchestra.run.smithi134:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-04-18T14:42:38.189 INFO:teuthology.orchestra.run.smithi134.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-04-18T14:42:38.189 INFO:teuthology.orchestra.run.smithi134.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-18T14:42:38.189 INFO:teuthology.orchestra.run.smithi134.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-18T14:42:38.189 INFO:teuthology.orchestra.run.smithi134.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-04-18T14:42:38.189 INFO:teuthology.orchestra.run.smithi134.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-18T14:42:38.189 INFO:teuthology.orchestra.run.smithi134.stdout: = sunit=0 swidth=0 blks 2024-04-18T14:42:38.189 INFO:teuthology.orchestra.run.smithi134.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-18T14:42:38.189 INFO:teuthology.orchestra.run.smithi134.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-04-18T14:42:38.189 INFO:teuthology.orchestra.run.smithi134.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-18T14:42:38.189 INFO:teuthology.orchestra.run.smithi134.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-18T14:42:38.676 INFO:teuthology.orchestra.run.smithi134.stdout:Discarding blocks...Done. 2024-04-18T14:42:38.678 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi134.front.sepia.ceph.com -o noatime 2024-04-18T14:42:38.678 DEBUG:teuthology.orchestra.run.smithi134:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-15 2024-04-18T14:42:38.820 DEBUG:teuthology.orchestra.run.smithi134:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-15 2024-04-18T14:42:38.832 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-18T14:42:38.832 INFO:teuthology.orchestra.run.smithi134.stderr:sudo: /sbin/restorecon: command not found 2024-04-18T14:42:38.833 DEBUG:teuthology.orchestra.run.smithi134:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-18T14:42:39.040 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-18T14:42:39.033+0000 7f3fb55ea7c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2024-04-18T14:42:39.043 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-18T14:42:39.037+0000 7f3fb55ea7c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2024-04-18T14:42:39.043 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-18T14:42:39.037+0000 7f3fb55ea7c0 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-04-18T14:42:39.043 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-18T14:42:39.037+0000 7f3fb55ea7c0 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-04-18T14:42:39.043 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-18T14:42:39.037+0000 7f3fb55ea7c0 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-04-18T14:42:39.044 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-18T14:42:39.037+0000 7f3fb55ea7c0 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2024-04-18T14:42:42.027 DEBUG:teuthology.orchestra.run.smithi134:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-04-18T14:42:42.040 DEBUG:teuthology.orchestra.run.smithi134:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-18T14:42:42.123 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-18T14:42:42.117+0000 7f1bf51a07c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2024-04-18T14:42:42.124 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-18T14:42:42.117+0000 7f1bf51a07c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2024-04-18T14:42:42.124 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-18T14:42:42.117+0000 7f1bf51a07c0 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-04-18T14:42:42.124 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-18T14:42:42.117+0000 7f1bf51a07c0 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-04-18T14:42:42.124 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-18T14:42:42.117+0000 7f1bf51a07c0 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-04-18T14:42:42.124 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-18T14:42:42.121+0000 7f1bf51a07c0 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2024-04-18T14:42:45.103 DEBUG:teuthology.orchestra.run.smithi134:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2024-04-18T14:42:45.161 DEBUG:teuthology.orchestra.run.smithi134:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 11 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-18T14:42:45.242 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-18T14:42:45.237+0000 7ff10eee87c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-11/keyring: can't open /var/lib/ceph/osd/ceph-11/keyring: (2) No such file or directory 2024-04-18T14:42:45.242 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-18T14:42:45.237+0000 7ff10eee87c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-11/keyring 2024-04-18T14:42:45.242 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-18T14:42:45.237+0000 7ff10eee87c0 -1 bluestore(/var/lib/ceph/osd/ceph-11/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-11/block: (2) No such file or directory 2024-04-18T14:42:45.242 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-18T14:42:45.237+0000 7ff10eee87c0 -1 bluestore(/var/lib/ceph/osd/ceph-11/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-11/block: (2) No such file or directory 2024-04-18T14:42:45.243 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-18T14:42:45.237+0000 7ff10eee87c0 -1 bluestore(/var/lib/ceph/osd/ceph-11/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-11/block: (2) No such file or directory 2024-04-18T14:42:45.243 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-18T14:42:45.237+0000 7ff10eee87c0 -1 bluestore(/var/lib/ceph/osd/ceph-11) _read_fsid unparsable uuid 2024-04-18T14:42:48.216 DEBUG:teuthology.orchestra.run.smithi134:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-11 2024-04-18T14:42:48.274 DEBUG:teuthology.orchestra.run.smithi134:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 15 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-18T14:42:48.355 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-18T14:42:48.349+0000 7f3ef08917c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-15/keyring: can't open /var/lib/ceph/osd/ceph-15/keyring: (2) No such file or directory 2024-04-18T14:42:48.356 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-18T14:42:48.349+0000 7f3ef08917c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-15/keyring 2024-04-18T14:42:48.356 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-18T14:42:48.349+0000 7f3ef08917c0 -1 bluestore(/var/lib/ceph/osd/ceph-15/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-15/block: (2) No such file or directory 2024-04-18T14:42:48.356 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-18T14:42:48.349+0000 7f3ef08917c0 -1 bluestore(/var/lib/ceph/osd/ceph-15/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-15/block: (2) No such file or directory 2024-04-18T14:42:48.356 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-18T14:42:48.349+0000 7f3ef08917c0 -1 bluestore(/var/lib/ceph/osd/ceph-15/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-15/block: (2) No such file or directory 2024-04-18T14:42:48.356 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-18T14:42:48.353+0000 7f3ef08917c0 -1 bluestore(/var/lib/ceph/osd/ceph-15) _read_fsid unparsable uuid 2024-04-18T14:42:51.322 DEBUG:teuthology.orchestra.run.smithi134:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-15 2024-04-18T14:42:51.377 INFO:tasks.ceph:Reading keys from all nodes... 2024-04-18T14:42:51.378 DEBUG:teuthology.orchestra.run.smithi086:> set -ex 2024-04-18T14:42:51.378 DEBUG:teuthology.orchestra.run.smithi086:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2024-04-18T14:42:51.392 DEBUG:teuthology.orchestra.run.smithi086:> set -ex 2024-04-18T14:42:51.392 DEBUG:teuthology.orchestra.run.smithi086:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-04-18T14:42:51.447 DEBUG:teuthology.orchestra.run.smithi086:> set -ex 2024-04-18T14:42:51.447 DEBUG:teuthology.orchestra.run.smithi086:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2024-04-18T14:42:51.502 DEBUG:teuthology.orchestra.run.smithi086:> set -ex 2024-04-18T14:42:51.502 DEBUG:teuthology.orchestra.run.smithi086:> sudo dd if=/var/lib/ceph/osd/ceph-8/keyring of=/dev/stdout 2024-04-18T14:42:51.555 DEBUG:teuthology.orchestra.run.smithi086:> set -ex 2024-04-18T14:42:51.555 DEBUG:teuthology.orchestra.run.smithi086:> sudo dd if=/var/lib/ceph/osd/ceph-12/keyring of=/dev/stdout 2024-04-18T14:42:51.611 DEBUG:teuthology.orchestra.run.smithi096:> set -ex 2024-04-18T14:42:51.611 DEBUG:teuthology.orchestra.run.smithi096:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-04-18T14:42:51.625 DEBUG:teuthology.orchestra.run.smithi096:> set -ex 2024-04-18T14:42:51.625 DEBUG:teuthology.orchestra.run.smithi096:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2024-04-18T14:42:51.679 DEBUG:teuthology.orchestra.run.smithi096:> set -ex 2024-04-18T14:42:51.679 DEBUG:teuthology.orchestra.run.smithi096:> sudo dd if=/var/lib/ceph/osd/ceph-9/keyring of=/dev/stdout 2024-04-18T14:42:51.737 DEBUG:teuthology.orchestra.run.smithi096:> set -ex 2024-04-18T14:42:51.737 DEBUG:teuthology.orchestra.run.smithi096:> sudo dd if=/var/lib/ceph/osd/ceph-13/keyring of=/dev/stdout 2024-04-18T14:42:51.790 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2024-04-18T14:42:51.791 DEBUG:teuthology.orchestra.run.smithi119:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-04-18T14:42:51.805 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2024-04-18T14:42:51.805 DEBUG:teuthology.orchestra.run.smithi119:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2024-04-18T14:42:51.861 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2024-04-18T14:42:51.861 DEBUG:teuthology.orchestra.run.smithi119:> sudo dd if=/var/lib/ceph/osd/ceph-10/keyring of=/dev/stdout 2024-04-18T14:42:51.917 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2024-04-18T14:42:51.917 DEBUG:teuthology.orchestra.run.smithi119:> sudo dd if=/var/lib/ceph/osd/ceph-14/keyring of=/dev/stdout 2024-04-18T14:42:51.973 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-04-18T14:42:51.973 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-04-18T14:42:51.986 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-04-18T14:42:51.986 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2024-04-18T14:42:52.042 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-04-18T14:42:52.042 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2024-04-18T14:42:52.100 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-04-18T14:42:52.100 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd if=/var/lib/ceph/osd/ceph-11/keyring of=/dev/stdout 2024-04-18T14:42:52.157 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-04-18T14:42:52.157 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd if=/var/lib/ceph/osd/ceph-15/keyring of=/dev/stdout 2024-04-18T14:42:52.211 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-04-18T14:42:52.211 DEBUG:teuthology.orchestra.run.smithi134:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-04-18T14:42:52.257 INFO:tasks.ceph:Adding keys to all mons... 2024-04-18T14:42:52.257 DEBUG:teuthology.orchestra.run.smithi086:> sudo tee -a /etc/ceph/ceph.keyring 2024-04-18T14:42:52.259 DEBUG:teuthology.orchestra.run.smithi096:> sudo tee -a /etc/ceph/ceph.keyring 2024-04-18T14:42:52.262 DEBUG:teuthology.orchestra.run.smithi119:> sudo tee -a /etc/ceph/ceph.keyring 2024-04-18T14:42:52.269 INFO:teuthology.orchestra.run.smithi086.stdout:[mgr.y] 2024-04-18T14:42:52.269 INFO:teuthology.orchestra.run.smithi086.stdout: key = AQAuMSFm6cUjARAANBtwFf3rw51EQYPJEjXUfA== 2024-04-18T14:42:52.269 INFO:teuthology.orchestra.run.smithi086.stdout:[osd.0] 2024-04-18T14:42:52.269 INFO:teuthology.orchestra.run.smithi086.stdout: key = AQAxMSFmgQmrBRAAsCQEnnINDcRZ8UdybHGkTA== 2024-04-18T14:42:52.269 INFO:teuthology.orchestra.run.smithi086.stdout:[osd.4] 2024-04-18T14:42:52.269 INFO:teuthology.orchestra.run.smithi086.stdout: key = AQA0MSFmiRV3ChAAGJdsJa5dp4D+GIJoUd8eOA== 2024-04-18T14:42:52.269 INFO:teuthology.orchestra.run.smithi086.stdout:[osd.8] 2024-04-18T14:42:52.269 INFO:teuthology.orchestra.run.smithi086.stdout: key = AQA3MSFmQlKfEBAAs1pCLscidFpbc3qFOWRsYw== 2024-04-18T14:42:52.269 INFO:teuthology.orchestra.run.smithi086.stdout:[osd.12] 2024-04-18T14:42:52.269 INFO:teuthology.orchestra.run.smithi086.stdout: key = AQA6MSFm8TGOFxAAP9kV5dP0+N73wY2Bis+4wg== 2024-04-18T14:42:52.269 INFO:teuthology.orchestra.run.smithi086.stdout:[osd.1] 2024-04-18T14:42:52.270 INFO:teuthology.orchestra.run.smithi086.stdout: key = AQBAMSFm/f4PGBAATW43d/N9RP5ecpW1eCJzXg== 2024-04-18T14:42:52.270 INFO:teuthology.orchestra.run.smithi086.stdout:[osd.5] 2024-04-18T14:42:52.270 INFO:teuthology.orchestra.run.smithi086.stdout: key = AQBDMSFm4HfYHBAAuJ7ukefOsLVGtVe+iAuTkA== 2024-04-18T14:42:52.270 INFO:teuthology.orchestra.run.smithi086.stdout:[osd.9] 2024-04-18T14:42:52.270 INFO:teuthology.orchestra.run.smithi086.stdout: key = AQBGMSFmQnwmJBAAq6lOP/4X0Hg3hCseieKnRQ== 2024-04-18T14:42:52.270 INFO:teuthology.orchestra.run.smithi086.stdout:[osd.13] 2024-04-18T14:42:52.270 INFO:teuthology.orchestra.run.smithi086.stdout: key = AQBJMSFmwg0kKxAAMLMkhfh7yXOxtM0RzhJa+g== 2024-04-18T14:42:52.271 INFO:teuthology.orchestra.run.smithi086.stdout:[osd.2] 2024-04-18T14:42:52.271 INFO:teuthology.orchestra.run.smithi086.stdout: key = AQBPMSFmskA5JxAA6AMWYQrDi/YwIEXMYCYnDQ== 2024-04-18T14:42:52.271 INFO:teuthology.orchestra.run.smithi086.stdout:[osd.6] 2024-04-18T14:42:52.271 INFO:teuthology.orchestra.run.smithi086.stdout: key = AQBSMSFmtLY6LBAAuFy1AqPk2JRQBv7eepGC7Q== 2024-04-18T14:42:52.271 INFO:teuthology.orchestra.run.smithi086.stdout:[osd.10] 2024-04-18T14:42:52.271 INFO:teuthology.orchestra.run.smithi086.stdout: key = AQBVMSFmQwSIMhAAR0fqkJxM0aaXka7l6hjLZA== 2024-04-18T14:42:52.271 INFO:teuthology.orchestra.run.smithi086.stdout:[osd.14] 2024-04-18T14:42:52.271 INFO:teuthology.orchestra.run.smithi086.stdout: key = AQBYMSFmWsX3ORAAIXg3zTL10cL6otSYpeClUw== 2024-04-18T14:42:52.271 INFO:teuthology.orchestra.run.smithi086.stdout:[mgr.x] 2024-04-18T14:42:52.271 INFO:teuthology.orchestra.run.smithi086.stdout: key = AQAuMSFmrw1yAxAAA+SKU2M3FSzWmkyBJ1oj/Q== 2024-04-18T14:42:52.271 INFO:teuthology.orchestra.run.smithi086.stdout:[osd.3] 2024-04-18T14:42:52.271 INFO:teuthology.orchestra.run.smithi086.stdout: key = AQBfMSFmj6ZbAhAAdMfEOvFsN4FXzzK0I47LTw== 2024-04-18T14:42:52.271 INFO:teuthology.orchestra.run.smithi086.stdout:[osd.7] 2024-04-18T14:42:52.272 INFO:teuthology.orchestra.run.smithi086.stdout: key = AQBiMSFmJKdXBxAAQFRRR8LXWZFAZx2YB4dvaQ== 2024-04-18T14:42:52.272 INFO:teuthology.orchestra.run.smithi086.stdout:[osd.11] 2024-04-18T14:42:52.272 INFO:teuthology.orchestra.run.smithi086.stdout: key = AQBlMSFmWyFnDhAAwYj/OpzU4zIrBXh2hfso4w== 2024-04-18T14:42:52.272 INFO:teuthology.orchestra.run.smithi086.stdout:[osd.15] 2024-04-18T14:42:52.272 INFO:teuthology.orchestra.run.smithi086.stdout: key = AQBoMSFmjGwpFRAADRUOcP6yrkyODI8alHeNfw== 2024-04-18T14:42:52.272 INFO:teuthology.orchestra.run.smithi086.stdout:[client.0] 2024-04-18T14:42:52.272 INFO:teuthology.orchestra.run.smithi086.stdout: key = AQAuMSFmUguWCBAASDdSxwfp+y+eK+c8/k2MQA== 2024-04-18T14:42:52.274 INFO:teuthology.orchestra.run.smithi096.stdout:[mgr.y] 2024-04-18T14:42:52.274 INFO:teuthology.orchestra.run.smithi096.stdout: key = AQAuMSFm6cUjARAANBtwFf3rw51EQYPJEjXUfA== 2024-04-18T14:42:52.274 INFO:teuthology.orchestra.run.smithi096.stdout:[osd.0] 2024-04-18T14:42:52.274 INFO:teuthology.orchestra.run.smithi096.stdout: key = AQAxMSFmgQmrBRAAsCQEnnINDcRZ8UdybHGkTA== 2024-04-18T14:42:52.274 INFO:teuthology.orchestra.run.smithi096.stdout:[osd.4] 2024-04-18T14:42:52.274 INFO:teuthology.orchestra.run.smithi096.stdout: key = AQA0MSFmiRV3ChAAGJdsJa5dp4D+GIJoUd8eOA== 2024-04-18T14:42:52.274 INFO:teuthology.orchestra.run.smithi096.stdout:[osd.8] 2024-04-18T14:42:52.275 INFO:teuthology.orchestra.run.smithi096.stdout: key = AQA3MSFmQlKfEBAAs1pCLscidFpbc3qFOWRsYw== 2024-04-18T14:42:52.275 INFO:teuthology.orchestra.run.smithi096.stdout:[osd.12] 2024-04-18T14:42:52.275 INFO:teuthology.orchestra.run.smithi096.stdout: key = AQA6MSFm8TGOFxAAP9kV5dP0+N73wY2Bis+4wg== 2024-04-18T14:42:52.275 INFO:teuthology.orchestra.run.smithi096.stdout:[osd.1] 2024-04-18T14:42:52.275 INFO:teuthology.orchestra.run.smithi096.stdout: key = AQBAMSFm/f4PGBAATW43d/N9RP5ecpW1eCJzXg== 2024-04-18T14:42:52.275 INFO:teuthology.orchestra.run.smithi096.stdout:[osd.5] 2024-04-18T14:42:52.275 INFO:teuthology.orchestra.run.smithi096.stdout: key = AQBDMSFm4HfYHBAAuJ7ukefOsLVGtVe+iAuTkA== 2024-04-18T14:42:52.275 INFO:teuthology.orchestra.run.smithi096.stdout:[osd.9] 2024-04-18T14:42:52.275 INFO:teuthology.orchestra.run.smithi096.stdout: key = AQBGMSFmQnwmJBAAq6lOP/4X0Hg3hCseieKnRQ== 2024-04-18T14:42:52.275 INFO:teuthology.orchestra.run.smithi096.stdout:[osd.13] 2024-04-18T14:42:52.275 INFO:teuthology.orchestra.run.smithi096.stdout: key = AQBJMSFmwg0kKxAAMLMkhfh7yXOxtM0RzhJa+g== 2024-04-18T14:42:52.275 INFO:teuthology.orchestra.run.smithi096.stdout:[osd.2] 2024-04-18T14:42:52.275 INFO:teuthology.orchestra.run.smithi096.stdout: key = AQBPMSFmskA5JxAA6AMWYQrDi/YwIEXMYCYnDQ== 2024-04-18T14:42:52.275 INFO:teuthology.orchestra.run.smithi096.stdout:[osd.6] 2024-04-18T14:42:52.275 INFO:teuthology.orchestra.run.smithi096.stdout: key = AQBSMSFmtLY6LBAAuFy1AqPk2JRQBv7eepGC7Q== 2024-04-18T14:42:52.276 INFO:teuthology.orchestra.run.smithi096.stdout:[osd.10] 2024-04-18T14:42:52.276 INFO:teuthology.orchestra.run.smithi096.stdout: key = AQBVMSFmQwSIMhAAR0fqkJxM0aaXka7l6hjLZA== 2024-04-18T14:42:52.276 INFO:teuthology.orchestra.run.smithi096.stdout:[osd.14] 2024-04-18T14:42:52.276 INFO:teuthology.orchestra.run.smithi096.stdout: key = AQBYMSFmWsX3ORAAIXg3zTL10cL6otSYpeClUw== 2024-04-18T14:42:52.276 INFO:teuthology.orchestra.run.smithi096.stdout:[mgr.x] 2024-04-18T14:42:52.276 INFO:teuthology.orchestra.run.smithi096.stdout: key = AQAuMSFmrw1yAxAAA+SKU2M3FSzWmkyBJ1oj/Q== 2024-04-18T14:42:52.276 INFO:teuthology.orchestra.run.smithi096.stdout:[osd.3] 2024-04-18T14:42:52.276 INFO:teuthology.orchestra.run.smithi096.stdout: key = AQBfMSFmj6ZbAhAAdMfEOvFsN4FXzzK0I47LTw== 2024-04-18T14:42:52.276 INFO:teuthology.orchestra.run.smithi096.stdout:[osd.7] 2024-04-18T14:42:52.276 INFO:teuthology.orchestra.run.smithi096.stdout: key = AQBiMSFmJKdXBxAAQFRRR8LXWZFAZx2YB4dvaQ== 2024-04-18T14:42:52.276 INFO:teuthology.orchestra.run.smithi096.stdout:[osd.11] 2024-04-18T14:42:52.277 INFO:teuthology.orchestra.run.smithi096.stdout: key = AQBlMSFmWyFnDhAAwYj/OpzU4zIrBXh2hfso4w== 2024-04-18T14:42:52.277 INFO:teuthology.orchestra.run.smithi096.stdout:[osd.15] 2024-04-18T14:42:52.277 INFO:teuthology.orchestra.run.smithi096.stdout: key = AQBoMSFmjGwpFRAADRUOcP6yrkyODI8alHeNfw== 2024-04-18T14:42:52.277 INFO:teuthology.orchestra.run.smithi096.stdout:[client.0] 2024-04-18T14:42:52.277 INFO:teuthology.orchestra.run.smithi096.stdout: key = AQAuMSFmUguWCBAASDdSxwfp+y+eK+c8/k2MQA== 2024-04-18T14:42:52.278 INFO:teuthology.orchestra.run.smithi119.stdout:[mgr.y] 2024-04-18T14:42:52.278 INFO:teuthology.orchestra.run.smithi119.stdout: key = AQAuMSFm6cUjARAANBtwFf3rw51EQYPJEjXUfA== 2024-04-18T14:42:52.278 INFO:teuthology.orchestra.run.smithi119.stdout:[osd.0] 2024-04-18T14:42:52.278 INFO:teuthology.orchestra.run.smithi119.stdout: key = AQAxMSFmgQmrBRAAsCQEnnINDcRZ8UdybHGkTA== 2024-04-18T14:42:52.278 INFO:teuthology.orchestra.run.smithi119.stdout:[osd.4] 2024-04-18T14:42:52.278 INFO:teuthology.orchestra.run.smithi119.stdout: key = AQA0MSFmiRV3ChAAGJdsJa5dp4D+GIJoUd8eOA== 2024-04-18T14:42:52.278 INFO:teuthology.orchestra.run.smithi119.stdout:[osd.8] 2024-04-18T14:42:52.278 INFO:teuthology.orchestra.run.smithi119.stdout: key = AQA3MSFmQlKfEBAAs1pCLscidFpbc3qFOWRsYw== 2024-04-18T14:42:52.278 INFO:teuthology.orchestra.run.smithi119.stdout:[osd.12] 2024-04-18T14:42:52.279 INFO:teuthology.orchestra.run.smithi119.stdout: key = AQA6MSFm8TGOFxAAP9kV5dP0+N73wY2Bis+4wg== 2024-04-18T14:42:52.279 INFO:teuthology.orchestra.run.smithi119.stdout:[osd.1] 2024-04-18T14:42:52.279 INFO:teuthology.orchestra.run.smithi119.stdout: key = AQBAMSFm/f4PGBAATW43d/N9RP5ecpW1eCJzXg== 2024-04-18T14:42:52.279 INFO:teuthology.orchestra.run.smithi119.stdout:[osd.5] 2024-04-18T14:42:52.279 INFO:teuthology.orchestra.run.smithi119.stdout: key = AQBDMSFm4HfYHBAAuJ7ukefOsLVGtVe+iAuTkA== 2024-04-18T14:42:52.279 INFO:teuthology.orchestra.run.smithi119.stdout:[osd.9] 2024-04-18T14:42:52.280 INFO:teuthology.orchestra.run.smithi119.stdout: key = AQBGMSFmQnwmJBAAq6lOP/4X0Hg3hCseieKnRQ== 2024-04-18T14:42:52.280 INFO:teuthology.orchestra.run.smithi119.stdout:[osd.13] 2024-04-18T14:42:52.280 INFO:teuthology.orchestra.run.smithi119.stdout: key = AQBJMSFmwg0kKxAAMLMkhfh7yXOxtM0RzhJa+g== 2024-04-18T14:42:52.280 INFO:teuthology.orchestra.run.smithi119.stdout:[osd.2] 2024-04-18T14:42:52.280 INFO:teuthology.orchestra.run.smithi119.stdout: key = AQBPMSFmskA5JxAA6AMWYQrDi/YwIEXMYCYnDQ== 2024-04-18T14:42:52.280 INFO:teuthology.orchestra.run.smithi119.stdout:[osd.6] 2024-04-18T14:42:52.280 INFO:teuthology.orchestra.run.smithi119.stdout: key = AQBSMSFmtLY6LBAAuFy1AqPk2JRQBv7eepGC7Q== 2024-04-18T14:42:52.280 INFO:teuthology.orchestra.run.smithi119.stdout:[osd.10] 2024-04-18T14:42:52.280 INFO:teuthology.orchestra.run.smithi119.stdout: key = AQBVMSFmQwSIMhAAR0fqkJxM0aaXka7l6hjLZA== 2024-04-18T14:42:52.280 INFO:teuthology.orchestra.run.smithi119.stdout:[osd.14] 2024-04-18T14:42:52.280 INFO:teuthology.orchestra.run.smithi119.stdout: key = AQBYMSFmWsX3ORAAIXg3zTL10cL6otSYpeClUw== 2024-04-18T14:42:52.280 INFO:teuthology.orchestra.run.smithi119.stdout:[mgr.x] 2024-04-18T14:42:52.280 INFO:teuthology.orchestra.run.smithi119.stdout: key = AQAuMSFmrw1yAxAAA+SKU2M3FSzWmkyBJ1oj/Q== 2024-04-18T14:42:52.280 INFO:teuthology.orchestra.run.smithi119.stdout:[osd.3] 2024-04-18T14:42:52.280 INFO:teuthology.orchestra.run.smithi119.stdout: key = AQBfMSFmj6ZbAhAAdMfEOvFsN4FXzzK0I47LTw== 2024-04-18T14:42:52.281 INFO:teuthology.orchestra.run.smithi119.stdout:[osd.7] 2024-04-18T14:42:52.281 INFO:teuthology.orchestra.run.smithi119.stdout: key = AQBiMSFmJKdXBxAAQFRRR8LXWZFAZx2YB4dvaQ== 2024-04-18T14:42:52.281 INFO:teuthology.orchestra.run.smithi119.stdout:[osd.11] 2024-04-18T14:42:52.281 INFO:teuthology.orchestra.run.smithi119.stdout: key = AQBlMSFmWyFnDhAAwYj/OpzU4zIrBXh2hfso4w== 2024-04-18T14:42:52.281 INFO:teuthology.orchestra.run.smithi119.stdout:[osd.15] 2024-04-18T14:42:52.281 INFO:teuthology.orchestra.run.smithi119.stdout: key = AQBoMSFmjGwpFRAADRUOcP6yrkyODI8alHeNfw== 2024-04-18T14:42:52.281 INFO:teuthology.orchestra.run.smithi119.stdout:[client.0] 2024-04-18T14:42:52.281 INFO:teuthology.orchestra.run.smithi119.stdout: key = AQAuMSFmUguWCBAASDdSxwfp+y+eK+c8/k2MQA== 2024-04-18T14:42:52.281 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-04-18T14:42:52.317 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-04-18T14:42:52.319 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-04-18T14:42:52.366 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-18T14:42:52.368 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-18T14:42:52.405 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-18T14:42:52.449 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-18T14:42:52.456 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-18T14:42:52.458 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-18T14:42:52.498 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.8 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-18T14:42:52.536 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.8 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-18T14:42:52.544 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.8 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-18T14:42:52.585 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.12 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-18T14:42:52.616 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.12 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-18T14:42:52.625 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.12 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-18T14:42:52.672 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-18T14:42:52.700 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-18T14:42:52.708 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-18T14:42:52.756 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-18T14:42:52.784 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-18T14:42:52.797 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-18T14:42:52.845 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.9 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-18T14:42:52.868 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.9 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-18T14:42:52.880 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.9 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-18T14:42:52.933 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.13 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-18T14:42:52.948 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.13 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-18T14:42:52.964 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.13 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-18T14:42:53.007 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-18T14:42:53.028 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-18T14:42:53.052 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-18T14:42:53.096 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-18T14:42:53.116 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-18T14:42:53.140 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-18T14:42:53.184 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.10 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-18T14:42:53.187 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.10 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-18T14:42:53.224 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.10 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-18T14:42:53.273 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.14 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-18T14:42:53.275 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.14 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-18T14:42:53.308 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.14 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-18T14:42:53.348 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-04-18T14:42:53.363 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-04-18T14:42:53.392 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-04-18T14:42:53.437 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-18T14:42:53.448 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-18T14:42:53.451 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-18T14:42:53.525 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-18T14:42:53.528 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-18T14:42:53.532 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-18T14:42:53.572 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.11 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-18T14:42:53.612 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.11 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-18T14:42:53.614 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.11 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-18T14:42:53.659 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.15 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-18T14:42:53.696 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.15 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-18T14:42:53.699 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.15 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-18T14:42:53.744 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-04-18T14:42:53.780 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-04-18T14:42:53.783 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-04-18T14:42:53.828 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-04-18T14:42:53.828 DEBUG:teuthology.orchestra.run.smithi086:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-04-18T14:42:53.872 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-04-18T14:42:53.963 DEBUG:teuthology.orchestra.run.smithi086:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-04-18T14:42:53.974 DEBUG:teuthology.orchestra.run.smithi096:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2024-04-18T14:42:53.988 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-04-18T14:42:54.081 DEBUG:teuthology.orchestra.run.smithi096:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2024-04-18T14:42:54.092 DEBUG:teuthology.orchestra.run.smithi119:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2024-04-18T14:42:54.106 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-04-18T14:42:54.199 DEBUG:teuthology.orchestra.run.smithi119:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2024-04-18T14:42:54.211 DEBUG:teuthology.orchestra.run.smithi086:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-04-18T14:42:54.214 DEBUG:teuthology.orchestra.run.smithi096:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-04-18T14:42:54.216 DEBUG:teuthology.orchestra.run.smithi119:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-04-18T14:42:54.261 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-04-18T14:42:54.261 INFO:tasks.ceph.mon.a:Restarting daemon 2024-04-18T14:42:54.261 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-04-18T14:42:54.263 INFO:tasks.ceph.mon.a:Started 2024-04-18T14:42:54.264 INFO:tasks.ceph.mon.b:Restarting daemon 2024-04-18T14:42:54.264 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2024-04-18T14:42:54.266 INFO:tasks.ceph.mon.b:Started 2024-04-18T14:42:54.266 INFO:tasks.ceph.mon.c:Restarting daemon 2024-04-18T14:42:54.267 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2024-04-18T14:42:54.310 INFO:tasks.ceph.mon.c:Started 2024-04-18T14:42:54.310 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-04-18T14:42:54.310 INFO:tasks.ceph.mgr.y:Restarting daemon 2024-04-18T14:42:54.311 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2024-04-18T14:42:54.313 INFO:tasks.ceph.mgr.y:Started 2024-04-18T14:42:54.313 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-04-18T14:42:54.313 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-04-18T14:42:54.316 INFO:tasks.ceph.mgr.x:Started 2024-04-18T14:42:54.316 INFO:tasks.ceph:Setting crush tunables to default 2024-04-18T14:42:54.316 DEBUG:teuthology.orchestra.run.smithi086:> sudo ceph --cluster ceph osd crush tunables default 2024-04-18T14:43:04.852 INFO:tasks.ceph.mgr.x.smithi134.stderr:2024-04-18T14:43:04.850+0000 7f8f06061180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-04-18T14:43:05.153 INFO:tasks.ceph.mgr.y.smithi086.stderr:2024-04-18T14:43:05.153+0000 7f83b2786180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-04-18T14:43:05.376 INFO:tasks.ceph.mgr.x.smithi134.stderr:2024-04-18T14:43:05.374+0000 7f8f06061180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-04-18T14:43:05.444 INFO:teuthology.orchestra.run.smithi086.stderr:adjusted tunables profile to default 2024-04-18T14:43:05.465 INFO:tasks.ceph:check_enable_crimson: False 2024-04-18T14:43:05.465 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-04-18T14:43:05.465 DEBUG:teuthology.orchestra.run.smithi086:> set -ex 2024-04-18T14:43:05.465 DEBUG:teuthology.orchestra.run.smithi086:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-04-18T14:43:05.477 DEBUG:teuthology.orchestra.run.smithi086:> set -ex 2024-04-18T14:43:05.477 DEBUG:teuthology.orchestra.run.smithi086:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2024-04-18T14:43:05.532 DEBUG:teuthology.orchestra.run.smithi086:> set -ex 2024-04-18T14:43:05.532 DEBUG:teuthology.orchestra.run.smithi086:> sudo dd if=/var/lib/ceph/osd/ceph-8/fsid of=/dev/stdout 2024-04-18T14:43:05.579 INFO:tasks.ceph.mgr.x.smithi134.stderr:2024-04-18T14:43:05.578+0000 7f8f06061180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-04-18T14:43:05.587 DEBUG:teuthology.orchestra.run.smithi086:> set -ex 2024-04-18T14:43:05.588 DEBUG:teuthology.orchestra.run.smithi086:> sudo dd if=/var/lib/ceph/osd/ceph-12/fsid of=/dev/stdout 2024-04-18T14:43:05.641 DEBUG:teuthology.orchestra.run.smithi096:> set -ex 2024-04-18T14:43:05.641 DEBUG:teuthology.orchestra.run.smithi096:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-04-18T14:43:05.658 DEBUG:teuthology.orchestra.run.smithi096:> set -ex 2024-04-18T14:43:05.658 DEBUG:teuthology.orchestra.run.smithi096:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2024-04-18T14:43:05.685 INFO:tasks.ceph.mgr.y.smithi086.stderr:2024-04-18T14:43:05.685+0000 7f83b2786180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-04-18T14:43:05.708 DEBUG:teuthology.orchestra.run.smithi096:> set -ex 2024-04-18T14:43:05.708 DEBUG:teuthology.orchestra.run.smithi096:> sudo dd if=/var/lib/ceph/osd/ceph-9/fsid of=/dev/stdout 2024-04-18T14:43:05.764 DEBUG:teuthology.orchestra.run.smithi096:> set -ex 2024-04-18T14:43:05.764 DEBUG:teuthology.orchestra.run.smithi096:> sudo dd if=/var/lib/ceph/osd/ceph-13/fsid of=/dev/stdout 2024-04-18T14:43:05.820 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2024-04-18T14:43:05.820 DEBUG:teuthology.orchestra.run.smithi119:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-04-18T14:43:05.835 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2024-04-18T14:43:05.835 DEBUG:teuthology.orchestra.run.smithi119:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2024-04-18T14:43:05.885 INFO:tasks.ceph.mgr.y.smithi086.stderr:2024-04-18T14:43:05.885+0000 7f83b2786180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-04-18T14:43:05.892 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2024-04-18T14:43:05.892 DEBUG:teuthology.orchestra.run.smithi119:> sudo dd if=/var/lib/ceph/osd/ceph-10/fsid of=/dev/stdout 2024-04-18T14:43:05.948 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2024-04-18T14:43:05.948 DEBUG:teuthology.orchestra.run.smithi119:> sudo dd if=/var/lib/ceph/osd/ceph-14/fsid of=/dev/stdout 2024-04-18T14:43:06.002 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-04-18T14:43:06.003 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2024-04-18T14:43:06.015 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-04-18T14:43:06.016 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2024-04-18T14:43:06.070 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-04-18T14:43:06.070 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd if=/var/lib/ceph/osd/ceph-11/fsid of=/dev/stdout 2024-04-18T14:43:06.125 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-04-18T14:43:06.125 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd if=/var/lib/ceph/osd/ceph-15/fsid of=/dev/stdout 2024-04-18T14:43:06.148 INFO:tasks.ceph.mgr.x.smithi134.stderr:2024-04-18T14:43:06.146+0000 7f8f06061180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-04-18T14:43:06.159 DEBUG:teuthology.orchestra.run.smithi134:> sudo ceph --cluster ceph osd new a2e10d33-3d09-4c39-aa08-15b3f6e81c8c 0 2024-04-18T14:43:06.212 INFO:tasks.ceph.mgr.x.smithi134.stderr:2024-04-18T14:43:06.210+0000 7f8f06061180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-04-18T14:43:06.266 INFO:tasks.ceph.mgr.x.smithi134.stderr:2024-04-18T14:43:06.262+0000 7f8f06061180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-04-18T14:43:06.347 INFO:tasks.ceph.mgr.x.smithi134.stderr:2024-04-18T14:43:06.346+0000 7f8f06061180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-04-18T14:43:06.400 INFO:tasks.ceph.mgr.x.smithi134.stderr:2024-04-18T14:43:06.398+0000 7f8f06061180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-04-18T14:43:06.419 INFO:teuthology.orchestra.run.smithi134.stdout:0 2024-04-18T14:43:06.436 DEBUG:teuthology.orchestra.run.smithi134:> sudo ceph --cluster ceph osd new 9a6146f9-1780-409a-a0a5-e411bc40d674 1 2024-04-18T14:43:06.460 INFO:tasks.ceph.mgr.y.smithi086.stderr:2024-04-18T14:43:06.457+0000 7f83b2786180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-04-18T14:43:06.480 INFO:tasks.ceph.mgr.x.smithi134.stderr:2024-04-18T14:43:06.478+0000 7f8f06061180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-04-18T14:43:06.516 INFO:tasks.ceph.mgr.y.smithi086.stderr:2024-04-18T14:43:06.513+0000 7f83b2786180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-04-18T14:43:06.533 INFO:tasks.ceph.mgr.x.smithi134.stderr:2024-04-18T14:43:06.530+0000 7f8f06061180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-04-18T14:43:06.568 INFO:tasks.ceph.mgr.y.smithi086.stderr:2024-04-18T14:43:06.565+0000 7f83b2786180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-04-18T14:43:06.646 INFO:tasks.ceph.mgr.y.smithi086.stderr:2024-04-18T14:43:06.645+0000 7f83b2786180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-04-18T14:43:06.688 INFO:tasks.ceph.mgr.x.smithi134.stderr:2024-04-18T14:43:06.686+0000 7f8f06061180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-04-18T14:43:06.697 INFO:tasks.ceph.mgr.y.smithi086.stderr:2024-04-18T14:43:06.697+0000 7f83b2786180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-04-18T14:43:06.749 INFO:tasks.ceph.mgr.x.smithi134.stderr:2024-04-18T14:43:06.746+0000 7f8f06061180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-04-18T14:43:06.772 INFO:teuthology.orchestra.run.smithi134.stdout:1 2024-04-18T14:43:06.775 INFO:tasks.ceph.mgr.y.smithi086.stderr:2024-04-18T14:43:06.773+0000 7f83b2786180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-04-18T14:43:06.789 DEBUG:teuthology.orchestra.run.smithi134:> sudo ceph --cluster ceph osd new 9c040397-fc12-4375-b34c-b7f3b5c299ae 2 2024-04-18T14:43:06.830 INFO:tasks.ceph.mgr.y.smithi086.stderr:2024-04-18T14:43:06.829+0000 7f83b2786180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-04-18T14:43:06.981 INFO:teuthology.orchestra.run.smithi134.stdout:2 2024-04-18T14:43:06.985 INFO:tasks.ceph.mgr.y.smithi086.stderr:2024-04-18T14:43:06.981+0000 7f83b2786180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-04-18T14:43:07.003 DEBUG:teuthology.orchestra.run.smithi134:> sudo ceph --cluster ceph osd new d6f346dc-57cc-4ad0-9db3-352ced49a170 3 2024-04-18T14:43:07.044 INFO:tasks.ceph.mgr.y.smithi086.stderr:2024-04-18T14:43:07.041+0000 7f83b2786180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-04-18T14:43:07.239 INFO:teuthology.orchestra.run.smithi134.stdout:3 2024-04-18T14:43:07.255 DEBUG:teuthology.orchestra.run.smithi134:> sudo ceph --cluster ceph osd new b4a1348c-ca08-4588-8c5e-1b6338672f3f 4 2024-04-18T14:43:07.376 INFO:tasks.ceph.mgr.x.smithi134.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2024-04-18T14:43:07.377 INFO:tasks.ceph.mgr.x.smithi134.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2024-04-18T14:43:07.377 INFO:tasks.ceph.mgr.x.smithi134.stderr: from numpy import show_config as show_numpy_config 2024-04-18T14:43:07.432 INFO:tasks.ceph.mgr.x.smithi134.stderr:2024-04-18T14:43:07.430+0000 7f8f06061180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-04-18T14:43:07.458 INFO:teuthology.orchestra.run.smithi134.stdout:4 2024-04-18T14:43:07.475 DEBUG:teuthology.orchestra.run.smithi134:> sudo ceph --cluster ceph osd new 2685cc4b-3fea-483c-a6ce-c74feae525a9 5 2024-04-18T14:43:07.587 INFO:tasks.ceph.mgr.x.smithi134.stderr:2024-04-18T14:43:07.586+0000 7f8f06061180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-04-18T14:43:07.670 INFO:teuthology.orchestra.run.smithi134.stdout:5 2024-04-18T14:43:07.680 INFO:tasks.ceph.mgr.y.smithi086.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2024-04-18T14:43:07.680 INFO:tasks.ceph.mgr.y.smithi086.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2024-04-18T14:43:07.681 INFO:tasks.ceph.mgr.y.smithi086.stderr: from numpy import show_config as show_numpy_config 2024-04-18T14:43:07.687 DEBUG:teuthology.orchestra.run.smithi134:> sudo ceph --cluster ceph osd new a8dab92a-d416-4383-b35f-6ac033677638 6 2024-04-18T14:43:07.720 INFO:tasks.ceph.mgr.y.smithi086.stderr:2024-04-18T14:43:07.717+0000 7f83b2786180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-04-18T14:43:07.763 INFO:tasks.ceph.mgr.x.smithi134.stderr:2024-04-18T14:43:07.762+0000 7f8f06061180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-04-18T14:43:07.829 INFO:tasks.ceph.mgr.x.smithi134.stderr:2024-04-18T14:43:07.826+0000 7f8f06061180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-04-18T14:43:07.869 INFO:tasks.ceph.mgr.y.smithi086.stderr:2024-04-18T14:43:07.869+0000 7f83b2786180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-04-18T14:43:07.885 INFO:teuthology.orchestra.run.smithi134.stdout:6 2024-04-18T14:43:07.901 DEBUG:teuthology.orchestra.run.smithi134:> sudo ceph --cluster ceph osd new 17e98ed9-593e-46df-82fa-80e4a36e6bf0 7 2024-04-18T14:43:07.967 INFO:tasks.ceph.mgr.x.smithi134.stderr:2024-04-18T14:43:07.966+0000 7f8f06061180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-04-18T14:43:08.036 INFO:tasks.ceph.mgr.y.smithi086.stderr:2024-04-18T14:43:08.033+0000 7f83b2786180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-04-18T14:43:08.090 INFO:teuthology.orchestra.run.smithi134.stdout:7 2024-04-18T14:43:08.100 INFO:tasks.ceph.mgr.y.smithi086.stderr:2024-04-18T14:43:08.097+0000 7f83b2786180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-04-18T14:43:08.106 DEBUG:teuthology.orchestra.run.smithi134:> sudo ceph --cluster ceph osd new be2c6ad5-ae83-463b-a8da-b8705b8c9ecd 8 2024-04-18T14:43:08.235 INFO:tasks.ceph.mgr.y.smithi086.stderr:2024-04-18T14:43:08.233+0000 7f83b2786180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-04-18T14:43:08.298 INFO:teuthology.orchestra.run.smithi134.stdout:8 2024-04-18T14:43:08.318 DEBUG:teuthology.orchestra.run.smithi134:> sudo ceph --cluster ceph osd new 441c6b04-1540-46ea-b180-4b8fceda9c5e 9 2024-04-18T14:43:08.513 INFO:teuthology.orchestra.run.smithi134.stdout:9 2024-04-18T14:43:08.530 DEBUG:teuthology.orchestra.run.smithi134:> sudo ceph --cluster ceph osd new 024a5dc2-0960-4540-89d5-7d40f5c4c2c8 10 2024-04-18T14:43:08.599 INFO:tasks.ceph.mgr.x.smithi134.stderr:2024-04-18T14:43:08.598+0000 7f8f06061180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-04-18T14:43:08.678 INFO:tasks.ceph.mgr.x.smithi134.stderr:2024-04-18T14:43:08.674+0000 7f8f06061180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-04-18T14:43:08.729 INFO:teuthology.orchestra.run.smithi134.stdout:10 2024-04-18T14:43:08.747 DEBUG:teuthology.orchestra.run.smithi134:> sudo ceph --cluster ceph osd new b46de3d2-dc85-4a95-b7d9-9bcdc0cbf035 11 2024-04-18T14:43:08.864 INFO:tasks.ceph.mgr.x.smithi134.stderr:2024-04-18T14:43:08.862+0000 7f8f06061180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-04-18T14:43:08.869 INFO:tasks.ceph.mgr.y.smithi086.stderr:2024-04-18T14:43:08.869+0000 7f83b2786180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-04-18T14:43:08.939 INFO:tasks.ceph.mgr.x.smithi134.stderr:2024-04-18T14:43:08.938+0000 7f8f06061180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-04-18T14:43:08.943 INFO:teuthology.orchestra.run.smithi134.stdout:11 2024-04-18T14:43:08.945 INFO:tasks.ceph.mgr.y.smithi086.stderr:2024-04-18T14:43:08.945+0000 7f83b2786180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-04-18T14:43:08.959 DEBUG:teuthology.orchestra.run.smithi134:> sudo ceph --cluster ceph osd new 29a50ae9-9c89-459b-b1de-a7f57905a6ca 12 2024-04-18T14:43:09.127 INFO:tasks.ceph.mgr.y.smithi086.stderr:2024-04-18T14:43:09.125+0000 7f83b2786180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-04-18T14:43:09.159 INFO:teuthology.orchestra.run.smithi134.stdout:12 2024-04-18T14:43:09.176 DEBUG:teuthology.orchestra.run.smithi134:> sudo ceph --cluster ceph osd new 4afcbb15-5c72-4b5f-bbd1-bddeba50b262 13 2024-04-18T14:43:09.202 INFO:tasks.ceph.mgr.y.smithi086.stderr:2024-04-18T14:43:09.201+0000 7f83b2786180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-04-18T14:43:09.240 INFO:tasks.ceph.mgr.x.smithi134.stderr:2024-04-18T14:43:09.238+0000 7f8f06061180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-04-18T14:43:09.304 INFO:tasks.ceph.mgr.x.smithi134.stderr:2024-04-18T14:43:09.302+0000 7f8f06061180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-04-18T14:43:09.374 INFO:teuthology.orchestra.run.smithi134.stdout:13 2024-04-18T14:43:09.393 DEBUG:teuthology.orchestra.run.smithi134:> sudo ceph --cluster ceph osd new d713adf7-4bce-443c-873c-3226cd6e5a50 14 2024-04-18T14:43:09.506 INFO:tasks.ceph.mgr.y.smithi086.stderr:2024-04-18T14:43:09.505+0000 7f83b2786180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-04-18T14:43:09.572 INFO:tasks.ceph.mgr.y.smithi086.stderr:2024-04-18T14:43:09.569+0000 7f83b2786180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-04-18T14:43:09.586 INFO:teuthology.orchestra.run.smithi134.stdout:14 2024-04-18T14:43:09.602 DEBUG:teuthology.orchestra.run.smithi134:> sudo ceph --cluster ceph osd new abfd15ca-bea7-4ed9-890d-c9d4add42879 15 2024-04-18T14:43:09.806 INFO:teuthology.orchestra.run.smithi134.stdout:15 2024-04-18T14:43:09.823 INFO:tasks.ceph.osd.0:Restarting daemon 2024-04-18T14:43:09.823 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2024-04-18T14:43:09.825 INFO:tasks.ceph.osd.0:Started 2024-04-18T14:43:09.826 INFO:tasks.ceph.osd.4:Restarting daemon 2024-04-18T14:43:09.826 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2024-04-18T14:43:09.828 INFO:tasks.ceph.osd.4:Started 2024-04-18T14:43:09.829 INFO:tasks.ceph.osd.8:Restarting daemon 2024-04-18T14:43:09.829 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 8 2024-04-18T14:43:09.831 INFO:tasks.ceph.osd.8:Started 2024-04-18T14:43:09.831 INFO:tasks.ceph.osd.12:Restarting daemon 2024-04-18T14:43:09.832 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 12 2024-04-18T14:43:09.834 INFO:tasks.ceph.osd.12:Started 2024-04-18T14:43:09.834 INFO:tasks.ceph.osd.1:Restarting daemon 2024-04-18T14:43:09.834 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2024-04-18T14:43:09.836 INFO:tasks.ceph.osd.1:Started 2024-04-18T14:43:09.836 INFO:tasks.ceph.osd.5:Restarting daemon 2024-04-18T14:43:09.837 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2024-04-18T14:43:09.840 INFO:tasks.ceph.osd.5:Started 2024-04-18T14:43:09.840 INFO:tasks.ceph.osd.9:Restarting daemon 2024-04-18T14:43:09.840 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 9 2024-04-18T14:43:09.842 INFO:tasks.ceph.osd.9:Started 2024-04-18T14:43:09.842 INFO:tasks.ceph.osd.13:Restarting daemon 2024-04-18T14:43:09.842 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 13 2024-04-18T14:43:09.845 INFO:tasks.ceph.osd.13:Started 2024-04-18T14:43:09.845 INFO:tasks.ceph.osd.2:Restarting daemon 2024-04-18T14:43:09.845 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2024-04-18T14:43:09.847 INFO:tasks.ceph.osd.2:Started 2024-04-18T14:43:09.848 INFO:tasks.ceph.osd.6:Restarting daemon 2024-04-18T14:43:09.848 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2024-04-18T14:43:09.850 INFO:tasks.ceph.osd.6:Started 2024-04-18T14:43:09.850 INFO:tasks.ceph.osd.10:Restarting daemon 2024-04-18T14:43:09.850 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 10 2024-04-18T14:43:09.853 INFO:tasks.ceph.osd.10:Started 2024-04-18T14:43:09.853 INFO:tasks.ceph.osd.14:Restarting daemon 2024-04-18T14:43:09.853 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 14 2024-04-18T14:43:09.855 INFO:tasks.ceph.osd.14:Started 2024-04-18T14:43:09.855 INFO:tasks.ceph.osd.3:Restarting daemon 2024-04-18T14:43:09.855 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2024-04-18T14:43:09.858 INFO:tasks.ceph.osd.3:Started 2024-04-18T14:43:09.858 INFO:tasks.ceph.osd.7:Restarting daemon 2024-04-18T14:43:09.858 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2024-04-18T14:43:09.860 INFO:tasks.ceph.osd.7:Started 2024-04-18T14:43:09.860 INFO:tasks.ceph.osd.11:Restarting daemon 2024-04-18T14:43:09.861 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 11 2024-04-18T14:43:09.863 INFO:tasks.ceph.osd.11:Started 2024-04-18T14:43:09.863 INFO:tasks.ceph.osd.15:Restarting daemon 2024-04-18T14:43:09.863 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 15 2024-04-18T14:43:09.866 INFO:tasks.ceph.osd.15:Started 2024-04-18T14:43:09.866 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-18T14:43:10.049 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-04-18T14:43:10.049 INFO:teuthology.orchestra.run.smithi086.stdout:{"epoch":18,"fsid":"ac90c892-1809-401c-a743-76948b63c51a","created":"2024-04-18T14:43:04.477846+0000","modified":"2024-04-18T14:43:09.805331+0000","last_up_change":"0.000000","last_in_change":"2024-04-18T14:43:09.805331+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":16,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"a2e10d33-3d09-4c39-aa08-15b3f6e81c8c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"9a6146f9-1780-409a-a0a5-e411bc40d674","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"9c040397-fc12-4375-b34c-b7f3b5c299ae","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"d6f346dc-57cc-4ad0-9db3-352ced49a170","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"b4a1348c-ca08-4588-8c5e-1b6338672f3f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"2685cc4b-3fea-483c-a6ce-c74feae525a9","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"a8dab92a-d416-4383-b35f-6ac033677638","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"17e98ed9-593e-46df-82fa-80e4a36e6bf0","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":8,"uuid":"be2c6ad5-ae83-463b-a8da-b8705b8c9ecd","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":9,"uuid":"441c6b04-1540-46ea-b180-4b8fceda9c5e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":10,"uuid":"024a5dc2-0960-4540-89d5-7d40f5c4c2c8","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":11,"uuid":"b46de3d2-dc85-4a95-b7d9-9bcdc0cbf035","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":12,"uuid":"29a50ae9-9c89-459b-b1de-a7f57905a6ca","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":13,"uuid":"4afcbb15-5c72-4b5f-bbd1-bddeba50b262","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":14,"uuid":"d713adf7-4bce-443c-873c-3226cd6e5a50","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":15,"uuid":"abfd15ca-bea7-4ed9-890d-c9d4add42879","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":12,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":13,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":14,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":15,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-18T14:43:10.065 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-04-18T14:43:10.065 INFO:tasks.ceph:Waiting for OSDs to come up 2024-04-18T14:43:10.348 INFO:tasks.ceph.mgr.x.smithi134.stderr:2024-04-18T14:43:10.346+0000 7f8ead519640 -1 mgr.server handle_report got status from non-daemon mon.b 2024-04-18T14:43:10.350 INFO:tasks.ceph.mgr.x.smithi134.stderr:2024-04-18T14:43:10.350+0000 7f8ead519640 -1 mgr.server handle_report got status from non-daemon mon.c 2024-04-18T14:43:10.472 INFO:tasks.ceph.osd.10.smithi119.stderr:2024-04-18T14:43:10.469+0000 7f6f284567c0 -1 Falling back to public interface 2024-04-18T14:43:10.475 INFO:tasks.ceph.osd.14.smithi119.stderr:2024-04-18T14:43:10.473+0000 7f1812ddd7c0 -1 Falling back to public interface 2024-04-18T14:43:10.483 INFO:tasks.ceph.osd.11.smithi134.stderr:2024-04-18T14:43:10.482+0000 7f2d3a7567c0 -1 Falling back to public interface 2024-04-18T14:43:10.484 INFO:tasks.ceph.osd.3.smithi134.stderr:2024-04-18T14:43:10.482+0000 7fe7a7c877c0 -1 Falling back to public interface 2024-04-18T14:43:10.484 INFO:tasks.ceph.osd.15.smithi134.stderr:2024-04-18T14:43:10.482+0000 7f08ea2957c0 -1 Falling back to public interface 2024-04-18T14:43:10.484 INFO:tasks.ceph.osd.7.smithi134.stderr:2024-04-18T14:43:10.482+0000 7fd7e1d8d7c0 -1 Falling back to public interface 2024-04-18T14:43:10.491 INFO:tasks.ceph.osd.6.smithi119.stderr:2024-04-18T14:43:10.489+0000 7fb7cf1017c0 -1 Falling back to public interface 2024-04-18T14:43:10.492 INFO:tasks.ceph.osd.2.smithi119.stderr:2024-04-18T14:43:10.489+0000 7fcbd69047c0 -1 Falling back to public interface 2024-04-18T14:43:10.539 INFO:tasks.ceph.osd.13.smithi096.stderr:2024-04-18T14:43:10.541+0000 7f7e767f17c0 -1 Falling back to public interface 2024-04-18T14:43:10.566 INFO:tasks.ceph.osd.9.smithi096.stderr:2024-04-18T14:43:10.569+0000 7fa2c55037c0 -1 Falling back to public interface 2024-04-18T14:43:10.567 INFO:tasks.ceph.osd.5.smithi096.stderr:2024-04-18T14:43:10.569+0000 7fc342a9f7c0 -1 Falling back to public interface 2024-04-18T14:43:10.574 INFO:tasks.ceph.osd.1.smithi096.stderr:2024-04-18T14:43:10.577+0000 7f56ab2dc7c0 -1 Falling back to public interface 2024-04-18T14:43:10.584 INFO:tasks.ceph.osd.12.smithi086.stderr:2024-04-18T14:43:10.581+0000 7f69081ac7c0 -1 Falling back to public interface 2024-04-18T14:43:10.584 INFO:tasks.ceph.osd.0.smithi086.stderr:2024-04-18T14:43:10.581+0000 7f7ce35bc7c0 -1 Falling back to public interface 2024-04-18T14:43:10.584 INFO:tasks.ceph.osd.4.smithi086.stderr:2024-04-18T14:43:10.581+0000 7f0c4fca67c0 -1 Falling back to public interface 2024-04-18T14:43:10.602 INFO:tasks.ceph.osd.8.smithi086.stderr:2024-04-18T14:43:10.601+0000 7f29fb3e17c0 -1 Falling back to public interface 2024-04-18T14:43:11.672 DEBUG:teuthology.orchestra.run.smithi086:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-04-18T14:43:11.962 INFO:teuthology.misc.health.smithi086.stdout: 2024-04-18T14:43:11.962 INFO:teuthology.misc.health.smithi086.stdout:{"epoch":18,"fsid":"ac90c892-1809-401c-a743-76948b63c51a","created":"2024-04-18T14:43:04.477846+0000","modified":"2024-04-18T14:43:09.805331+0000","last_up_change":"0.000000","last_in_change":"2024-04-18T14:43:09.805331+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":16,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"a2e10d33-3d09-4c39-aa08-15b3f6e81c8c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"9a6146f9-1780-409a-a0a5-e411bc40d674","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"9c040397-fc12-4375-b34c-b7f3b5c299ae","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"d6f346dc-57cc-4ad0-9db3-352ced49a170","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"b4a1348c-ca08-4588-8c5e-1b6338672f3f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"2685cc4b-3fea-483c-a6ce-c74feae525a9","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"a8dab92a-d416-4383-b35f-6ac033677638","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"17e98ed9-593e-46df-82fa-80e4a36e6bf0","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":8,"uuid":"be2c6ad5-ae83-463b-a8da-b8705b8c9ecd","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":9,"uuid":"441c6b04-1540-46ea-b180-4b8fceda9c5e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":10,"uuid":"024a5dc2-0960-4540-89d5-7d40f5c4c2c8","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":11,"uuid":"b46de3d2-dc85-4a95-b7d9-9bcdc0cbf035","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":12,"uuid":"29a50ae9-9c89-459b-b1de-a7f57905a6ca","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":13,"uuid":"4afcbb15-5c72-4b5f-bbd1-bddeba50b262","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":14,"uuid":"d713adf7-4bce-443c-873c-3226cd6e5a50","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":15,"uuid":"abfd15ca-bea7-4ed9-890d-c9d4add42879","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":12,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":13,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":14,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":15,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-18T14:43:11.978 DEBUG:teuthology.misc:0 of 16 OSDs are up 2024-04-18T14:43:14.173 INFO:tasks.ceph.osd.14.smithi119.stderr:2024-04-18T14:43:14.169+0000 7f1812ddd7c0 -1 osd.14 0 log_to_monitors true 2024-04-18T14:43:14.230 INFO:tasks.ceph.osd.11.smithi134.stderr:2024-04-18T14:43:14.231+0000 7f2d3a7567c0 -1 osd.11 0 log_to_monitors true 2024-04-18T14:43:14.244 INFO:tasks.ceph.osd.13.smithi096.stderr:2024-04-18T14:43:14.245+0000 7f7e767f17c0 -1 osd.13 0 log_to_monitors true 2024-04-18T14:43:14.316 INFO:tasks.ceph.osd.3.smithi134.stderr:2024-04-18T14:43:14.315+0000 7fe7a7c877c0 -1 osd.3 0 log_to_monitors true 2024-04-18T14:43:14.318 INFO:tasks.ceph.osd.6.smithi119.stderr:2024-04-18T14:43:14.313+0000 7fb7cf1017c0 -1 osd.6 0 log_to_monitors true 2024-04-18T14:43:14.337 INFO:tasks.ceph.osd.9.smithi096.stderr:2024-04-18T14:43:14.337+0000 7fa2c55037c0 -1 osd.9 0 log_to_monitors true 2024-04-18T14:43:14.347 INFO:tasks.ceph.osd.12.smithi086.stderr:2024-04-18T14:43:14.349+0000 7f69081ac7c0 -1 osd.12 0 log_to_monitors true 2024-04-18T14:43:14.348 INFO:tasks.ceph.osd.2.smithi119.stderr:2024-04-18T14:43:14.345+0000 7fcbd69047c0 -1 osd.2 0 log_to_monitors true 2024-04-18T14:43:14.391 INFO:tasks.ceph.osd.15.smithi134.stderr:2024-04-18T14:43:14.391+0000 7f08ea2957c0 -1 osd.15 0 log_to_monitors true 2024-04-18T14:43:14.407 INFO:tasks.ceph.osd.10.smithi119.stderr:2024-04-18T14:43:14.405+0000 7f6f284567c0 -1 osd.10 0 log_to_monitors true 2024-04-18T14:43:14.412 INFO:tasks.ceph.osd.7.smithi134.stderr:2024-04-18T14:43:14.411+0000 7fd7e1d8d7c0 -1 osd.7 0 log_to_monitors true 2024-04-18T14:43:14.439 INFO:tasks.ceph.osd.0.smithi086.stderr:2024-04-18T14:43:14.441+0000 7f7ce35bc7c0 -1 osd.0 0 log_to_monitors true 2024-04-18T14:43:14.441 INFO:tasks.ceph.osd.5.smithi096.stderr:2024-04-18T14:43:14.445+0000 7fc342a9f7c0 -1 osd.5 0 log_to_monitors true 2024-04-18T14:43:14.451 INFO:tasks.ceph.osd.1.smithi096.stderr:2024-04-18T14:43:14.453+0000 7f56ab2dc7c0 -1 osd.1 0 log_to_monitors true 2024-04-18T14:43:14.458 INFO:tasks.ceph.osd.4.smithi086.stderr:2024-04-18T14:43:14.461+0000 7f0c4fca67c0 -1 osd.4 0 log_to_monitors true 2024-04-18T14:43:14.537 INFO:tasks.ceph.osd.8.smithi086.stderr:2024-04-18T14:43:14.537+0000 7f29fb3e17c0 -1 osd.8 0 log_to_monitors true 2024-04-18T14:43:16.166 INFO:tasks.ceph.osd.14.smithi119.stderr:2024-04-18T14:43:16.165+0000 7f180e55f640 -1 osd.14 0 waiting for initial osdmap 2024-04-18T14:43:16.187 INFO:tasks.ceph.osd.14.smithi119.stderr:2024-04-18T14:43:16.185+0000 7f1806ba4640 -1 osd.14 20 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-18T14:43:16.261 INFO:tasks.ceph.osd.6.smithi119.stderr:2024-04-18T14:43:16.257+0000 7fb7ca883640 -1 osd.6 0 waiting for initial osdmap 2024-04-18T14:43:16.264 INFO:tasks.ceph.osd.2.smithi119.stderr:2024-04-18T14:43:16.261+0000 7fcbd2086640 -1 osd.2 0 waiting for initial osdmap 2024-04-18T14:43:16.265 INFO:tasks.ceph.osd.10.smithi119.stderr:2024-04-18T14:43:16.261+0000 7f6f23bd8640 -1 osd.10 0 waiting for initial osdmap 2024-04-18T14:43:16.266 INFO:tasks.ceph.osd.12.smithi086.stderr:2024-04-18T14:43:16.268+0000 7f690392e640 -1 osd.12 0 waiting for initial osdmap 2024-04-18T14:43:16.280 INFO:tasks.ceph.osd.2.smithi119.stderr:2024-04-18T14:43:16.277+0000 7fcbce6d3640 -1 osd.2 21 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-18T14:43:16.281 INFO:tasks.ceph.osd.4.smithi086.stderr:2024-04-18T14:43:16.280+0000 7f0c4b428640 -1 osd.4 0 waiting for initial osdmap 2024-04-18T14:43:16.281 INFO:tasks.ceph.osd.11.smithi134.stderr:2024-04-18T14:43:16.283+0000 7f2d35ed8640 -1 osd.11 0 waiting for initial osdmap 2024-04-18T14:43:16.283 INFO:tasks.ceph.osd.6.smithi119.stderr:2024-04-18T14:43:16.281+0000 7fb7c6ed0640 -1 osd.6 21 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-18T14:43:16.287 INFO:tasks.ceph.osd.10.smithi119.stderr:2024-04-18T14:43:16.285+0000 7f6f20225640 -1 osd.10 21 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-18T14:43:16.312 INFO:tasks.ceph.osd.11.smithi134.stderr:2024-04-18T14:43:16.311+0000 7f2d32525640 -1 osd.11 21 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-18T14:43:16.314 INFO:tasks.ceph.osd.12.smithi086.stderr:2024-04-18T14:43:16.316+0000 7f68fff7b640 -1 osd.12 21 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-18T14:43:16.336 INFO:tasks.ceph.osd.4.smithi086.stderr:2024-04-18T14:43:16.336+0000 7f0c47a75640 -1 osd.4 21 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-18T14:43:17.674 INFO:tasks.ceph.osd.8.smithi086.stderr:2024-04-18T14:43:17.676+0000 7f29f839e640 -1 osd.8 0 waiting for initial osdmap 2024-04-18T14:43:17.687 INFO:tasks.ceph.osd.0.smithi086.stderr:2024-04-18T14:43:17.688+0000 7f7cded3e640 -1 osd.0 0 waiting for initial osdmap 2024-04-18T14:43:17.706 INFO:tasks.ceph.osd.8.smithi086.stderr:2024-04-18T14:43:17.708+0000 7f29ef1a8640 -1 osd.8 22 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-18T14:43:17.714 INFO:tasks.ceph.osd.0.smithi086.stderr:2024-04-18T14:43:17.716+0000 7f7cd7383640 -1 osd.0 22 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-18T14:43:18.053 INFO:tasks.ceph.osd.3.smithi134.stderr:2024-04-18T14:43:18.055+0000 7fe7a4c44640 -1 osd.3 0 waiting for initial osdmap 2024-04-18T14:43:18.082 INFO:tasks.ceph.osd.3.smithi134.stderr:2024-04-18T14:43:18.083+0000 7fe79ba4e640 -1 osd.3 22 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-18T14:43:18.109 INFO:tasks.ceph.osd.7.smithi134.stderr:2024-04-18T14:43:18.111+0000 7fd7ded4a640 -1 osd.7 0 waiting for initial osdmap 2024-04-18T14:43:18.132 INFO:tasks.ceph.osd.15.smithi134.stderr:2024-04-18T14:43:18.131+0000 7f08e5a17640 -1 osd.15 0 waiting for initial osdmap 2024-04-18T14:43:18.134 INFO:tasks.ceph.osd.7.smithi134.stderr:2024-04-18T14:43:18.135+0000 7fd7d5b54640 -1 osd.7 22 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-18T14:43:18.170 INFO:tasks.ceph.osd.15.smithi134.stderr:2024-04-18T14:43:18.171+0000 7f08de05c640 -1 osd.15 22 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-18T14:43:18.534 INFO:tasks.ceph.osd.5.smithi096.stderr:2024-04-18T14:43:18.536+0000 7fc33fa5c640 -1 osd.5 0 waiting for initial osdmap 2024-04-18T14:43:18.560 INFO:tasks.ceph.osd.13.smithi096.stderr:2024-04-18T14:43:18.560+0000 7f7e71f73640 -1 osd.13 0 waiting for initial osdmap 2024-04-18T14:43:18.575 INFO:tasks.ceph.osd.5.smithi096.stderr:2024-04-18T14:43:18.576+0000 7fc336866640 -1 osd.5 23 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-18T14:43:18.576 INFO:tasks.ceph.osd.9.smithi096.stderr:2024-04-18T14:43:18.576+0000 7fa2c0c85640 -1 osd.9 0 waiting for initial osdmap 2024-04-18T14:43:18.581 INFO:tasks.ceph.osd.1.smithi096.stderr:2024-04-18T14:43:18.580+0000 7f56a8299640 -1 osd.1 0 waiting for initial osdmap 2024-04-18T14:43:18.598 INFO:tasks.ceph.osd.13.smithi096.stderr:2024-04-18T14:43:18.600+0000 7f7e6a5b8640 -1 osd.13 23 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-18T14:43:18.606 INFO:tasks.ceph.osd.1.smithi096.stderr:2024-04-18T14:43:18.608+0000 7f569f0a3640 -1 osd.1 23 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-18T14:43:18.607 INFO:tasks.ceph.osd.9.smithi096.stderr:2024-04-18T14:43:18.608+0000 7fa2b92ca640 -1 osd.9 23 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-18T14:43:19.594 DEBUG:teuthology.orchestra.run.smithi086:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-04-18T14:43:19.896 INFO:teuthology.misc.health.smithi086.stdout: 2024-04-18T14:43:19.896 INFO:teuthology.misc.health.smithi086.stdout:{"epoch":24,"fsid":"ac90c892-1809-401c-a743-76948b63c51a","created":"2024-04-18T14:43:04.477846+0000","modified":"2024-04-18T14:43:19.299757+0000","last_up_change":"2024-04-18T14:43:19.299757+0000","last_in_change":"2024-04-18T14:43:09.805331+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":16,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-18T14:43:17.412189+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":15.380000114440918,"score_stable":15.380000114440918,"optimal_score":0.12999999523162842,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a2e10d33-3d09-4c39-aa08-15b3f6e81c8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":23,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6804","nonce":24964},{"type":"v1","addr":"172.21.15.86:6806","nonce":24964}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6809","nonce":24964},{"type":"v1","addr":"172.21.15.86:6812","nonce":24964}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6819","nonce":24964},{"type":"v1","addr":"172.21.15.86:6821","nonce":24964}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6814","nonce":24964},{"type":"v1","addr":"172.21.15.86:6817","nonce":24964}]},"public_addr":"172.21.15.86:6806/24964","cluster_addr":"172.21.15.86:6812/24964","heartbeat_back_addr":"172.21.15.86:6821/24964","heartbeat_front_addr":"172.21.15.86:6817/24964","state":["exists","up"]},{"osd":1,"uuid":"9a6146f9-1780-409a-a0a5-e411bc40d674","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6824","nonce":24895},{"type":"v1","addr":"172.21.15.96:6825","nonce":24895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6826","nonce":24895},{"type":"v1","addr":"172.21.15.96:6827","nonce":24895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6830","nonce":24895},{"type":"v1","addr":"172.21.15.96:6831","nonce":24895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6828","nonce":24895},{"type":"v1","addr":"172.21.15.96:6829","nonce":24895}]},"public_addr":"172.21.15.96:6825/24895","cluster_addr":"172.21.15.96:6827/24895","heartbeat_back_addr":"172.21.15.96:6831/24895","heartbeat_front_addr":"172.21.15.96:6829/24895","state":["exists","up"]},{"osd":2,"uuid":"9c040397-fc12-4375-b34c-b7f3b5c299ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6817","nonce":24902},{"type":"v1","addr":"172.21.15.119:6819","nonce":24902}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6821","nonce":24902},{"type":"v1","addr":"172.21.15.119:6823","nonce":24902}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6829","nonce":24902},{"type":"v1","addr":"172.21.15.119:6831","nonce":24902}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6825","nonce":24902},{"type":"v1","addr":"172.21.15.119:6827","nonce":24902}]},"public_addr":"172.21.15.119:6819/24902","cluster_addr":"172.21.15.119:6823/24902","heartbeat_back_addr":"172.21.15.119:6831/24902","heartbeat_front_addr":"172.21.15.119:6827/24902","state":["exists","up"]},{"osd":3,"uuid":"d6f346dc-57cc-4ad0-9db3-352ced49a170","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":23,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":25220},{"type":"v1","addr":"172.21.15.134:6810","nonce":25220}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6816","nonce":25220},{"type":"v1","addr":"172.21.15.134:6820","nonce":25220}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6828","nonce":25220},{"type":"v1","addr":"172.21.15.134:6831","nonce":25220}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6822","nonce":25220},{"type":"v1","addr":"172.21.15.134:6825","nonce":25220}]},"public_addr":"172.21.15.134:6810/25220","cluster_addr":"172.21.15.134:6820/25220","heartbeat_back_addr":"172.21.15.134:6831/25220","heartbeat_front_addr":"172.21.15.134:6825/25220","state":["exists","up"]},{"osd":4,"uuid":"b4a1348c-ca08-4588-8c5e-1b6338672f3f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6805","nonce":24962},{"type":"v1","addr":"172.21.15.86:6808","nonce":24962}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6811","nonce":24962},{"type":"v1","addr":"172.21.15.86:6815","nonce":24962}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6822","nonce":24962},{"type":"v1","addr":"172.21.15.86:6823","nonce":24962}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6818","nonce":24962},{"type":"v1","addr":"172.21.15.86:6820","nonce":24962}]},"public_addr":"172.21.15.86:6808/24962","cluster_addr":"172.21.15.86:6815/24962","heartbeat_back_addr":"172.21.15.86:6823/24962","heartbeat_front_addr":"172.21.15.86:6820/24962","state":["exists","up"]},{"osd":5,"uuid":"2685cc4b-3fea-483c-a6ce-c74feae525a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6813","nonce":24898},{"type":"v1","addr":"172.21.15.96:6815","nonce":24898}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6818","nonce":24898},{"type":"v1","addr":"172.21.15.96:6819","nonce":24898}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6822","nonce":24898},{"type":"v1","addr":"172.21.15.96:6823","nonce":24898}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6820","nonce":24898},{"type":"v1","addr":"172.21.15.96:6821","nonce":24898}]},"public_addr":"172.21.15.96:6815/24898","cluster_addr":"172.21.15.96:6819/24898","heartbeat_back_addr":"172.21.15.96:6823/24898","heartbeat_front_addr":"172.21.15.96:6821/24898","state":["exists","up"]},{"osd":6,"uuid":"a8dab92a-d416-4383-b35f-6ac033677638","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6816","nonce":24903},{"type":"v1","addr":"172.21.15.119:6818","nonce":24903}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6820","nonce":24903},{"type":"v1","addr":"172.21.15.119:6822","nonce":24903}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6828","nonce":24903},{"type":"v1","addr":"172.21.15.119:6830","nonce":24903}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6824","nonce":24903},{"type":"v1","addr":"172.21.15.119:6826","nonce":24903}]},"public_addr":"172.21.15.119:6818/24903","cluster_addr":"172.21.15.119:6822/24903","heartbeat_back_addr":"172.21.15.119:6830/24903","heartbeat_front_addr":"172.21.15.119:6826/24903","state":["exists","up"]},{"osd":7,"uuid":"17e98ed9-593e-46df-82fa-80e4a36e6bf0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":23,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6809","nonce":25221},{"type":"v1","addr":"172.21.15.134:6814","nonce":25221}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6819","nonce":25221},{"type":"v1","addr":"172.21.15.134:6823","nonce":25221}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6832","nonce":25221},{"type":"v1","addr":"172.21.15.134:6833","nonce":25221}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6826","nonce":25221},{"type":"v1","addr":"172.21.15.134:6830","nonce":25221}]},"public_addr":"172.21.15.134:6814/25221","cluster_addr":"172.21.15.134:6823/25221","heartbeat_back_addr":"172.21.15.134:6833/25221","heartbeat_front_addr":"172.21.15.134:6830/25221","state":["exists","up"]},{"osd":8,"uuid":"be2c6ad5-ae83-463b-a8da-b8705b8c9ecd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":23,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6824","nonce":24967},{"type":"v1","addr":"172.21.15.86:6825","nonce":24967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6826","nonce":24967},{"type":"v1","addr":"172.21.15.86:6827","nonce":24967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6830","nonce":24967},{"type":"v1","addr":"172.21.15.86:6831","nonce":24967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6828","nonce":24967},{"type":"v1","addr":"172.21.15.86:6829","nonce":24967}]},"public_addr":"172.21.15.86:6825/24967","cluster_addr":"172.21.15.86:6827/24967","heartbeat_back_addr":"172.21.15.86:6831/24967","heartbeat_front_addr":"172.21.15.86:6829/24967","state":["exists","up"]},{"osd":9,"uuid":"441c6b04-1540-46ea-b180-4b8fceda9c5e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6808","nonce":24896},{"type":"v1","addr":"172.21.15.96:6809","nonce":24896}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6810","nonce":24896},{"type":"v1","addr":"172.21.15.96:6811","nonce":24896}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6816","nonce":24896},{"type":"v1","addr":"172.21.15.96:6817","nonce":24896}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6812","nonce":24896},{"type":"v1","addr":"172.21.15.96:6814","nonce":24896}]},"public_addr":"172.21.15.96:6809/24896","cluster_addr":"172.21.15.96:6811/24896","heartbeat_back_addr":"172.21.15.96:6817/24896","heartbeat_front_addr":"172.21.15.96:6814/24896","state":["exists","up"]},{"osd":10,"uuid":"024a5dc2-0960-4540-89d5-7d40f5c4c2c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6800","nonce":24904},{"type":"v1","addr":"172.21.15.119:6801","nonce":24904}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6802","nonce":24904},{"type":"v1","addr":"172.21.15.119:6803","nonce":24904}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6806","nonce":24904},{"type":"v1","addr":"172.21.15.119:6807","nonce":24904}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6804","nonce":24904},{"type":"v1","addr":"172.21.15.119:6805","nonce":24904}]},"public_addr":"172.21.15.119:6801/24904","cluster_addr":"172.21.15.119:6803/24904","heartbeat_back_addr":"172.21.15.119:6807/24904","heartbeat_front_addr":"172.21.15.119:6805/24904","state":["exists","up"]},{"osd":11,"uuid":"b46de3d2-dc85-4a95-b7d9-9bcdc0cbf035","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":25222},{"type":"v1","addr":"172.21.15.134:6803","nonce":25222}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":25222},{"type":"v1","addr":"172.21.15.134:6805","nonce":25222}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6813","nonce":25222},{"type":"v1","addr":"172.21.15.134:6817","nonce":25222}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6807","nonce":25222},{"type":"v1","addr":"172.21.15.134:6811","nonce":25222}]},"public_addr":"172.21.15.134:6803/25222","cluster_addr":"172.21.15.134:6805/25222","heartbeat_back_addr":"172.21.15.134:6817/25222","heartbeat_front_addr":"172.21.15.134:6811/25222","state":["exists","up"]},{"osd":12,"uuid":"29a50ae9-9c89-459b-b1de-a7f57905a6ca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6800","nonce":24965},{"type":"v1","addr":"172.21.15.86:6801","nonce":24965}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6802","nonce":24965},{"type":"v1","addr":"172.21.15.86:6803","nonce":24965}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6813","nonce":24965},{"type":"v1","addr":"172.21.15.86:6816","nonce":24965}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6807","nonce":24965},{"type":"v1","addr":"172.21.15.86:6810","nonce":24965}]},"public_addr":"172.21.15.86:6801/24965","cluster_addr":"172.21.15.86:6803/24965","heartbeat_back_addr":"172.21.15.86:6816/24965","heartbeat_front_addr":"172.21.15.86:6810/24965","state":["exists","up"]},{"osd":13,"uuid":"4afcbb15-5c72-4b5f-bbd1-bddeba50b262","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6800","nonce":24897},{"type":"v1","addr":"172.21.15.96:6801","nonce":24897}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6802","nonce":24897},{"type":"v1","addr":"172.21.15.96:6803","nonce":24897}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6806","nonce":24897},{"type":"v1","addr":"172.21.15.96:6807","nonce":24897}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6804","nonce":24897},{"type":"v1","addr":"172.21.15.96:6805","nonce":24897}]},"public_addr":"172.21.15.96:6801/24897","cluster_addr":"172.21.15.96:6803/24897","heartbeat_back_addr":"172.21.15.96:6807/24897","heartbeat_front_addr":"172.21.15.96:6805/24897","state":["exists","up"]},{"osd":14,"uuid":"d713adf7-4bce-443c-873c-3226cd6e5a50","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6808","nonce":24905},{"type":"v1","addr":"172.21.15.119:6809","nonce":24905}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6810","nonce":24905},{"type":"v1","addr":"172.21.15.119:6811","nonce":24905}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6814","nonce":24905},{"type":"v1","addr":"172.21.15.119:6815","nonce":24905}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6812","nonce":24905},{"type":"v1","addr":"172.21.15.119:6813","nonce":24905}]},"public_addr":"172.21.15.119:6809/24905","cluster_addr":"172.21.15.119:6811/24905","heartbeat_back_addr":"172.21.15.119:6815/24905","heartbeat_front_addr":"172.21.15.119:6813/24905","state":["exists","up"]},{"osd":15,"uuid":"abfd15ca-bea7-4ed9-890d-c9d4add42879","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":23,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6808","nonce":25223},{"type":"v1","addr":"172.21.15.134:6812","nonce":25223}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6815","nonce":25223},{"type":"v1","addr":"172.21.15.134:6818","nonce":25223}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6827","nonce":25223},{"type":"v1","addr":"172.21.15.134:6829","nonce":25223}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6821","nonce":25223},{"type":"v1","addr":"172.21.15.134:6824","nonce":25223}]},"public_addr":"172.21.15.134:6812/25223","cluster_addr":"172.21.15.134:6818/25223","heartbeat_back_addr":"172.21.15.134:6829/25223","heartbeat_front_addr":"172.21.15.134:6824/25223","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T14:43:15.360852+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T14:43:15.307798+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T14:43:15.441535+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T14:43:15.367390+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T14:43:15.465492+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T14:43:15.502850+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T14:43:15.381570+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T14:43:15.281246+0000","dead_epoch":0},{"osd":12,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T14:43:15.374069+0000","dead_epoch":0},{"osd":13,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":14,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T14:43:15.200225+0000","dead_epoch":0},{"osd":15,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T14:43:15.363752+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-18T14:43:19.914 DEBUG:teuthology.misc:16 of 16 OSDs are up 2024-04-18T14:43:19.914 INFO:tasks.ceph:Creating RBD pool 2024-04-18T14:43:19.914 DEBUG:teuthology.orchestra.run.smithi086:> sudo ceph --cluster ceph osd pool create rbd 8 2024-04-18T14:43:20.309 INFO:teuthology.orchestra.run.smithi086.stderr:pool 'rbd' created 2024-04-18T14:43:20.333 DEBUG:teuthology.orchestra.run.smithi086:> sudo ceph --cluster ceph osd pool application enable rbd rbd --yes-i-really-mean-it 2024-04-18T14:43:21.314 INFO:teuthology.orchestra.run.smithi086.stderr:enabled application 'rbd' on pool 'rbd' 2024-04-18T14:43:21.335 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-04-18T14:43:21.335 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-04-18T14:43:21.336 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-04-18T14:43:21.336 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-04-18T14:43:21.337 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-04-18T14:43:21.668 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-04-18T14:43:21.686 INFO:teuthology.orchestra.run.smithi086.stdout:{"epoch":4,"flags":0,"active_gid":4101,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6800","nonce":24704},{"type":"v1","addr":"172.21.15.134:6801","nonce":24704}]},"active_addr":"172.21.15.134:6801/24704","active_change":"2024-04-18T14:43:09.328145+0000","active_mgr_features":4540138322906710015,"available":true,"standbys":[{"gid":4107,"name":"y","mgr_features":4540138322906710015,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.0.0","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.0.0","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.134:0","nonce":3325451476}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.134:0","nonce":2510226301}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.134:0","nonce":2056818951}]}]} 2024-04-18T14:43:21.690 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-04-18T14:43:21.690 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-04-18T14:43:21.690 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-18T14:43:21.985 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-04-18T14:43:21.986 INFO:teuthology.orchestra.run.smithi086.stdout:{"epoch":26,"fsid":"ac90c892-1809-401c-a743-76948b63c51a","created":"2024-04-18T14:43:04.477846+0000","modified":"2024-04-18T14:43:21.310507+0000","last_up_change":"2024-04-18T14:43:19.299757+0000","last_in_change":"2024-04-18T14:43:09.805331+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":16,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-18T14:43:17.412189+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":15.380000114440918,"score_stable":15.380000114440918,"optimal_score":0.12999999523162842,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-04-18T14:43:20.259109+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":3.9900000095367432,"score_stable":3.9900000095367432,"optimal_score":0.68999999761581421,"raw_score_acting":2.75,"raw_score_stable":2.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a2e10d33-3d09-4c39-aa08-15b3f6e81c8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":23,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6804","nonce":24964},{"type":"v1","addr":"172.21.15.86:6806","nonce":24964}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6809","nonce":24964},{"type":"v1","addr":"172.21.15.86:6812","nonce":24964}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6819","nonce":24964},{"type":"v1","addr":"172.21.15.86:6821","nonce":24964}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6814","nonce":24964},{"type":"v1","addr":"172.21.15.86:6817","nonce":24964}]},"public_addr":"172.21.15.86:6806/24964","cluster_addr":"172.21.15.86:6812/24964","heartbeat_back_addr":"172.21.15.86:6821/24964","heartbeat_front_addr":"172.21.15.86:6817/24964","state":["exists","up"]},{"osd":1,"uuid":"9a6146f9-1780-409a-a0a5-e411bc40d674","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6824","nonce":24895},{"type":"v1","addr":"172.21.15.96:6825","nonce":24895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6826","nonce":24895},{"type":"v1","addr":"172.21.15.96:6827","nonce":24895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6830","nonce":24895},{"type":"v1","addr":"172.21.15.96:6831","nonce":24895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6828","nonce":24895},{"type":"v1","addr":"172.21.15.96:6829","nonce":24895}]},"public_addr":"172.21.15.96:6825/24895","cluster_addr":"172.21.15.96:6827/24895","heartbeat_back_addr":"172.21.15.96:6831/24895","heartbeat_front_addr":"172.21.15.96:6829/24895","state":["exists","up"]},{"osd":2,"uuid":"9c040397-fc12-4375-b34c-b7f3b5c299ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6817","nonce":24902},{"type":"v1","addr":"172.21.15.119:6819","nonce":24902}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6821","nonce":24902},{"type":"v1","addr":"172.21.15.119:6823","nonce":24902}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6829","nonce":24902},{"type":"v1","addr":"172.21.15.119:6831","nonce":24902}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6825","nonce":24902},{"type":"v1","addr":"172.21.15.119:6827","nonce":24902}]},"public_addr":"172.21.15.119:6819/24902","cluster_addr":"172.21.15.119:6823/24902","heartbeat_back_addr":"172.21.15.119:6831/24902","heartbeat_front_addr":"172.21.15.119:6827/24902","state":["exists","up"]},{"osd":3,"uuid":"d6f346dc-57cc-4ad0-9db3-352ced49a170","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":23,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":25220},{"type":"v1","addr":"172.21.15.134:6810","nonce":25220}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6816","nonce":25220},{"type":"v1","addr":"172.21.15.134:6820","nonce":25220}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6828","nonce":25220},{"type":"v1","addr":"172.21.15.134:6831","nonce":25220}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6822","nonce":25220},{"type":"v1","addr":"172.21.15.134:6825","nonce":25220}]},"public_addr":"172.21.15.134:6810/25220","cluster_addr":"172.21.15.134:6820/25220","heartbeat_back_addr":"172.21.15.134:6831/25220","heartbeat_front_addr":"172.21.15.134:6825/25220","state":["exists","up"]},{"osd":4,"uuid":"b4a1348c-ca08-4588-8c5e-1b6338672f3f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6805","nonce":24962},{"type":"v1","addr":"172.21.15.86:6808","nonce":24962}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6811","nonce":24962},{"type":"v1","addr":"172.21.15.86:6815","nonce":24962}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6822","nonce":24962},{"type":"v1","addr":"172.21.15.86:6823","nonce":24962}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6818","nonce":24962},{"type":"v1","addr":"172.21.15.86:6820","nonce":24962}]},"public_addr":"172.21.15.86:6808/24962","cluster_addr":"172.21.15.86:6815/24962","heartbeat_back_addr":"172.21.15.86:6823/24962","heartbeat_front_addr":"172.21.15.86:6820/24962","state":["exists","up"]},{"osd":5,"uuid":"2685cc4b-3fea-483c-a6ce-c74feae525a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6813","nonce":24898},{"type":"v1","addr":"172.21.15.96:6815","nonce":24898}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6818","nonce":24898},{"type":"v1","addr":"172.21.15.96:6819","nonce":24898}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6822","nonce":24898},{"type":"v1","addr":"172.21.15.96:6823","nonce":24898}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6820","nonce":24898},{"type":"v1","addr":"172.21.15.96:6821","nonce":24898}]},"public_addr":"172.21.15.96:6815/24898","cluster_addr":"172.21.15.96:6819/24898","heartbeat_back_addr":"172.21.15.96:6823/24898","heartbeat_front_addr":"172.21.15.96:6821/24898","state":["exists","up"]},{"osd":6,"uuid":"a8dab92a-d416-4383-b35f-6ac033677638","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6816","nonce":24903},{"type":"v1","addr":"172.21.15.119:6818","nonce":24903}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6820","nonce":24903},{"type":"v1","addr":"172.21.15.119:6822","nonce":24903}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6828","nonce":24903},{"type":"v1","addr":"172.21.15.119:6830","nonce":24903}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6824","nonce":24903},{"type":"v1","addr":"172.21.15.119:6826","nonce":24903}]},"public_addr":"172.21.15.119:6818/24903","cluster_addr":"172.21.15.119:6822/24903","heartbeat_back_addr":"172.21.15.119:6830/24903","heartbeat_front_addr":"172.21.15.119:6826/24903","state":["exists","up"]},{"osd":7,"uuid":"17e98ed9-593e-46df-82fa-80e4a36e6bf0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":23,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6809","nonce":25221},{"type":"v1","addr":"172.21.15.134:6814","nonce":25221}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6819","nonce":25221},{"type":"v1","addr":"172.21.15.134:6823","nonce":25221}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6832","nonce":25221},{"type":"v1","addr":"172.21.15.134:6833","nonce":25221}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6826","nonce":25221},{"type":"v1","addr":"172.21.15.134:6830","nonce":25221}]},"public_addr":"172.21.15.134:6814/25221","cluster_addr":"172.21.15.134:6823/25221","heartbeat_back_addr":"172.21.15.134:6833/25221","heartbeat_front_addr":"172.21.15.134:6830/25221","state":["exists","up"]},{"osd":8,"uuid":"be2c6ad5-ae83-463b-a8da-b8705b8c9ecd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":23,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6824","nonce":24967},{"type":"v1","addr":"172.21.15.86:6825","nonce":24967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6826","nonce":24967},{"type":"v1","addr":"172.21.15.86:6827","nonce":24967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6830","nonce":24967},{"type":"v1","addr":"172.21.15.86:6831","nonce":24967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6828","nonce":24967},{"type":"v1","addr":"172.21.15.86:6829","nonce":24967}]},"public_addr":"172.21.15.86:6825/24967","cluster_addr":"172.21.15.86:6827/24967","heartbeat_back_addr":"172.21.15.86:6831/24967","heartbeat_front_addr":"172.21.15.86:6829/24967","state":["exists","up"]},{"osd":9,"uuid":"441c6b04-1540-46ea-b180-4b8fceda9c5e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6808","nonce":24896},{"type":"v1","addr":"172.21.15.96:6809","nonce":24896}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6810","nonce":24896},{"type":"v1","addr":"172.21.15.96:6811","nonce":24896}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6816","nonce":24896},{"type":"v1","addr":"172.21.15.96:6817","nonce":24896}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6812","nonce":24896},{"type":"v1","addr":"172.21.15.96:6814","nonce":24896}]},"public_addr":"172.21.15.96:6809/24896","cluster_addr":"172.21.15.96:6811/24896","heartbeat_back_addr":"172.21.15.96:6817/24896","heartbeat_front_addr":"172.21.15.96:6814/24896","state":["exists","up"]},{"osd":10,"uuid":"024a5dc2-0960-4540-89d5-7d40f5c4c2c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6800","nonce":24904},{"type":"v1","addr":"172.21.15.119:6801","nonce":24904}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6802","nonce":24904},{"type":"v1","addr":"172.21.15.119:6803","nonce":24904}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6806","nonce":24904},{"type":"v1","addr":"172.21.15.119:6807","nonce":24904}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6804","nonce":24904},{"type":"v1","addr":"172.21.15.119:6805","nonce":24904}]},"public_addr":"172.21.15.119:6801/24904","cluster_addr":"172.21.15.119:6803/24904","heartbeat_back_addr":"172.21.15.119:6807/24904","heartbeat_front_addr":"172.21.15.119:6805/24904","state":["exists","up"]},{"osd":11,"uuid":"b46de3d2-dc85-4a95-b7d9-9bcdc0cbf035","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":25222},{"type":"v1","addr":"172.21.15.134:6803","nonce":25222}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":25222},{"type":"v1","addr":"172.21.15.134:6805","nonce":25222}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6813","nonce":25222},{"type":"v1","addr":"172.21.15.134:6817","nonce":25222}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6807","nonce":25222},{"type":"v1","addr":"172.21.15.134:6811","nonce":25222}]},"public_addr":"172.21.15.134:6803/25222","cluster_addr":"172.21.15.134:6805/25222","heartbeat_back_addr":"172.21.15.134:6817/25222","heartbeat_front_addr":"172.21.15.134:6811/25222","state":["exists","up"]},{"osd":12,"uuid":"29a50ae9-9c89-459b-b1de-a7f57905a6ca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6800","nonce":24965},{"type":"v1","addr":"172.21.15.86:6801","nonce":24965}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6802","nonce":24965},{"type":"v1","addr":"172.21.15.86:6803","nonce":24965}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6813","nonce":24965},{"type":"v1","addr":"172.21.15.86:6816","nonce":24965}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6807","nonce":24965},{"type":"v1","addr":"172.21.15.86:6810","nonce":24965}]},"public_addr":"172.21.15.86:6801/24965","cluster_addr":"172.21.15.86:6803/24965","heartbeat_back_addr":"172.21.15.86:6816/24965","heartbeat_front_addr":"172.21.15.86:6810/24965","state":["exists","up"]},{"osd":13,"uuid":"4afcbb15-5c72-4b5f-bbd1-bddeba50b262","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6800","nonce":24897},{"type":"v1","addr":"172.21.15.96:6801","nonce":24897}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6802","nonce":24897},{"type":"v1","addr":"172.21.15.96:6803","nonce":24897}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6806","nonce":24897},{"type":"v1","addr":"172.21.15.96:6807","nonce":24897}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6804","nonce":24897},{"type":"v1","addr":"172.21.15.96:6805","nonce":24897}]},"public_addr":"172.21.15.96:6801/24897","cluster_addr":"172.21.15.96:6803/24897","heartbeat_back_addr":"172.21.15.96:6807/24897","heartbeat_front_addr":"172.21.15.96:6805/24897","state":["exists","up"]},{"osd":14,"uuid":"d713adf7-4bce-443c-873c-3226cd6e5a50","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6808","nonce":24905},{"type":"v1","addr":"172.21.15.119:6809","nonce":24905}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6810","nonce":24905},{"type":"v1","addr":"172.21.15.119:6811","nonce":24905}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6814","nonce":24905},{"type":"v1","addr":"172.21.15.119:6815","nonce":24905}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6812","nonce":24905},{"type":"v1","addr":"172.21.15.119:6813","nonce":24905}]},"public_addr":"172.21.15.119:6809/24905","cluster_addr":"172.21.15.119:6811/24905","heartbeat_back_addr":"172.21.15.119:6815/24905","heartbeat_front_addr":"172.21.15.119:6813/24905","state":["exists","up"]},{"osd":15,"uuid":"abfd15ca-bea7-4ed9-890d-c9d4add42879","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":23,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6808","nonce":25223},{"type":"v1","addr":"172.21.15.134:6812","nonce":25223}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6815","nonce":25223},{"type":"v1","addr":"172.21.15.134:6818","nonce":25223}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6827","nonce":25223},{"type":"v1","addr":"172.21.15.134:6829","nonce":25223}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6821","nonce":25223},{"type":"v1","addr":"172.21.15.134:6824","nonce":25223}]},"public_addr":"172.21.15.134:6812/25223","cluster_addr":"172.21.15.134:6818/25223","heartbeat_back_addr":"172.21.15.134:6829/25223","heartbeat_front_addr":"172.21.15.134:6824/25223","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T14:43:15.486100+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T14:43:15.506438+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T14:43:15.360852+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T14:43:15.307798+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T14:43:15.441535+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T14:43:15.492500+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T14:43:15.367390+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T14:43:15.465492+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T14:43:15.502850+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T14:43:15.384186+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T14:43:15.381570+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T14:43:15.281246+0000","dead_epoch":0},{"osd":12,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T14:43:15.374069+0000","dead_epoch":0},{"osd":13,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T14:43:15.255730+0000","dead_epoch":0},{"osd":14,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T14:43:15.200225+0000","dead_epoch":0},{"osd":15,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T14:43:15.363752+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-18T14:43:22.004 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-04-18T14:43:22.004 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-18T14:43:22.303 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-04-18T14:43:22.303 INFO:teuthology.orchestra.run.smithi086.stdout:{"epoch":26,"fsid":"ac90c892-1809-401c-a743-76948b63c51a","created":"2024-04-18T14:43:04.477846+0000","modified":"2024-04-18T14:43:21.310507+0000","last_up_change":"2024-04-18T14:43:19.299757+0000","last_in_change":"2024-04-18T14:43:09.805331+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":16,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-18T14:43:17.412189+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":15.380000114440918,"score_stable":15.380000114440918,"optimal_score":0.12999999523162842,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-04-18T14:43:20.259109+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":3.9900000095367432,"score_stable":3.9900000095367432,"optimal_score":0.68999999761581421,"raw_score_acting":2.75,"raw_score_stable":2.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a2e10d33-3d09-4c39-aa08-15b3f6e81c8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":23,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6804","nonce":24964},{"type":"v1","addr":"172.21.15.86:6806","nonce":24964}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6809","nonce":24964},{"type":"v1","addr":"172.21.15.86:6812","nonce":24964}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6819","nonce":24964},{"type":"v1","addr":"172.21.15.86:6821","nonce":24964}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6814","nonce":24964},{"type":"v1","addr":"172.21.15.86:6817","nonce":24964}]},"public_addr":"172.21.15.86:6806/24964","cluster_addr":"172.21.15.86:6812/24964","heartbeat_back_addr":"172.21.15.86:6821/24964","heartbeat_front_addr":"172.21.15.86:6817/24964","state":["exists","up"]},{"osd":1,"uuid":"9a6146f9-1780-409a-a0a5-e411bc40d674","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6824","nonce":24895},{"type":"v1","addr":"172.21.15.96:6825","nonce":24895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6826","nonce":24895},{"type":"v1","addr":"172.21.15.96:6827","nonce":24895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6830","nonce":24895},{"type":"v1","addr":"172.21.15.96:6831","nonce":24895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6828","nonce":24895},{"type":"v1","addr":"172.21.15.96:6829","nonce":24895}]},"public_addr":"172.21.15.96:6825/24895","cluster_addr":"172.21.15.96:6827/24895","heartbeat_back_addr":"172.21.15.96:6831/24895","heartbeat_front_addr":"172.21.15.96:6829/24895","state":["exists","up"]},{"osd":2,"uuid":"9c040397-fc12-4375-b34c-b7f3b5c299ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6817","nonce":24902},{"type":"v1","addr":"172.21.15.119:6819","nonce":24902}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6821","nonce":24902},{"type":"v1","addr":"172.21.15.119:6823","nonce":24902}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6829","nonce":24902},{"type":"v1","addr":"172.21.15.119:6831","nonce":24902}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6825","nonce":24902},{"type":"v1","addr":"172.21.15.119:6827","nonce":24902}]},"public_addr":"172.21.15.119:6819/24902","cluster_addr":"172.21.15.119:6823/24902","heartbeat_back_addr":"172.21.15.119:6831/24902","heartbeat_front_addr":"172.21.15.119:6827/24902","state":["exists","up"]},{"osd":3,"uuid":"d6f346dc-57cc-4ad0-9db3-352ced49a170","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":23,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":25220},{"type":"v1","addr":"172.21.15.134:6810","nonce":25220}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6816","nonce":25220},{"type":"v1","addr":"172.21.15.134:6820","nonce":25220}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6828","nonce":25220},{"type":"v1","addr":"172.21.15.134:6831","nonce":25220}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6822","nonce":25220},{"type":"v1","addr":"172.21.15.134:6825","nonce":25220}]},"public_addr":"172.21.15.134:6810/25220","cluster_addr":"172.21.15.134:6820/25220","heartbeat_back_addr":"172.21.15.134:6831/25220","heartbeat_front_addr":"172.21.15.134:6825/25220","state":["exists","up"]},{"osd":4,"uuid":"b4a1348c-ca08-4588-8c5e-1b6338672f3f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6805","nonce":24962},{"type":"v1","addr":"172.21.15.86:6808","nonce":24962}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6811","nonce":24962},{"type":"v1","addr":"172.21.15.86:6815","nonce":24962}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6822","nonce":24962},{"type":"v1","addr":"172.21.15.86:6823","nonce":24962}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6818","nonce":24962},{"type":"v1","addr":"172.21.15.86:6820","nonce":24962}]},"public_addr":"172.21.15.86:6808/24962","cluster_addr":"172.21.15.86:6815/24962","heartbeat_back_addr":"172.21.15.86:6823/24962","heartbeat_front_addr":"172.21.15.86:6820/24962","state":["exists","up"]},{"osd":5,"uuid":"2685cc4b-3fea-483c-a6ce-c74feae525a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6813","nonce":24898},{"type":"v1","addr":"172.21.15.96:6815","nonce":24898}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6818","nonce":24898},{"type":"v1","addr":"172.21.15.96:6819","nonce":24898}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6822","nonce":24898},{"type":"v1","addr":"172.21.15.96:6823","nonce":24898}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6820","nonce":24898},{"type":"v1","addr":"172.21.15.96:6821","nonce":24898}]},"public_addr":"172.21.15.96:6815/24898","cluster_addr":"172.21.15.96:6819/24898","heartbeat_back_addr":"172.21.15.96:6823/24898","heartbeat_front_addr":"172.21.15.96:6821/24898","state":["exists","up"]},{"osd":6,"uuid":"a8dab92a-d416-4383-b35f-6ac033677638","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6816","nonce":24903},{"type":"v1","addr":"172.21.15.119:6818","nonce":24903}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6820","nonce":24903},{"type":"v1","addr":"172.21.15.119:6822","nonce":24903}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6828","nonce":24903},{"type":"v1","addr":"172.21.15.119:6830","nonce":24903}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6824","nonce":24903},{"type":"v1","addr":"172.21.15.119:6826","nonce":24903}]},"public_addr":"172.21.15.119:6818/24903","cluster_addr":"172.21.15.119:6822/24903","heartbeat_back_addr":"172.21.15.119:6830/24903","heartbeat_front_addr":"172.21.15.119:6826/24903","state":["exists","up"]},{"osd":7,"uuid":"17e98ed9-593e-46df-82fa-80e4a36e6bf0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":23,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6809","nonce":25221},{"type":"v1","addr":"172.21.15.134:6814","nonce":25221}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6819","nonce":25221},{"type":"v1","addr":"172.21.15.134:6823","nonce":25221}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6832","nonce":25221},{"type":"v1","addr":"172.21.15.134:6833","nonce":25221}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6826","nonce":25221},{"type":"v1","addr":"172.21.15.134:6830","nonce":25221}]},"public_addr":"172.21.15.134:6814/25221","cluster_addr":"172.21.15.134:6823/25221","heartbeat_back_addr":"172.21.15.134:6833/25221","heartbeat_front_addr":"172.21.15.134:6830/25221","state":["exists","up"]},{"osd":8,"uuid":"be2c6ad5-ae83-463b-a8da-b8705b8c9ecd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":23,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6824","nonce":24967},{"type":"v1","addr":"172.21.15.86:6825","nonce":24967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6826","nonce":24967},{"type":"v1","addr":"172.21.15.86:6827","nonce":24967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6830","nonce":24967},{"type":"v1","addr":"172.21.15.86:6831","nonce":24967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6828","nonce":24967},{"type":"v1","addr":"172.21.15.86:6829","nonce":24967}]},"public_addr":"172.21.15.86:6825/24967","cluster_addr":"172.21.15.86:6827/24967","heartbeat_back_addr":"172.21.15.86:6831/24967","heartbeat_front_addr":"172.21.15.86:6829/24967","state":["exists","up"]},{"osd":9,"uuid":"441c6b04-1540-46ea-b180-4b8fceda9c5e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6808","nonce":24896},{"type":"v1","addr":"172.21.15.96:6809","nonce":24896}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6810","nonce":24896},{"type":"v1","addr":"172.21.15.96:6811","nonce":24896}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6816","nonce":24896},{"type":"v1","addr":"172.21.15.96:6817","nonce":24896}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6812","nonce":24896},{"type":"v1","addr":"172.21.15.96:6814","nonce":24896}]},"public_addr":"172.21.15.96:6809/24896","cluster_addr":"172.21.15.96:6811/24896","heartbeat_back_addr":"172.21.15.96:6817/24896","heartbeat_front_addr":"172.21.15.96:6814/24896","state":["exists","up"]},{"osd":10,"uuid":"024a5dc2-0960-4540-89d5-7d40f5c4c2c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6800","nonce":24904},{"type":"v1","addr":"172.21.15.119:6801","nonce":24904}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6802","nonce":24904},{"type":"v1","addr":"172.21.15.119:6803","nonce":24904}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6806","nonce":24904},{"type":"v1","addr":"172.21.15.119:6807","nonce":24904}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6804","nonce":24904},{"type":"v1","addr":"172.21.15.119:6805","nonce":24904}]},"public_addr":"172.21.15.119:6801/24904","cluster_addr":"172.21.15.119:6803/24904","heartbeat_back_addr":"172.21.15.119:6807/24904","heartbeat_front_addr":"172.21.15.119:6805/24904","state":["exists","up"]},{"osd":11,"uuid":"b46de3d2-dc85-4a95-b7d9-9bcdc0cbf035","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":25222},{"type":"v1","addr":"172.21.15.134:6803","nonce":25222}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":25222},{"type":"v1","addr":"172.21.15.134:6805","nonce":25222}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6813","nonce":25222},{"type":"v1","addr":"172.21.15.134:6817","nonce":25222}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6807","nonce":25222},{"type":"v1","addr":"172.21.15.134:6811","nonce":25222}]},"public_addr":"172.21.15.134:6803/25222","cluster_addr":"172.21.15.134:6805/25222","heartbeat_back_addr":"172.21.15.134:6817/25222","heartbeat_front_addr":"172.21.15.134:6811/25222","state":["exists","up"]},{"osd":12,"uuid":"29a50ae9-9c89-459b-b1de-a7f57905a6ca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6800","nonce":24965},{"type":"v1","addr":"172.21.15.86:6801","nonce":24965}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6802","nonce":24965},{"type":"v1","addr":"172.21.15.86:6803","nonce":24965}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6813","nonce":24965},{"type":"v1","addr":"172.21.15.86:6816","nonce":24965}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6807","nonce":24965},{"type":"v1","addr":"172.21.15.86:6810","nonce":24965}]},"public_addr":"172.21.15.86:6801/24965","cluster_addr":"172.21.15.86:6803/24965","heartbeat_back_addr":"172.21.15.86:6816/24965","heartbeat_front_addr":"172.21.15.86:6810/24965","state":["exists","up"]},{"osd":13,"uuid":"4afcbb15-5c72-4b5f-bbd1-bddeba50b262","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6800","nonce":24897},{"type":"v1","addr":"172.21.15.96:6801","nonce":24897}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6802","nonce":24897},{"type":"v1","addr":"172.21.15.96:6803","nonce":24897}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6806","nonce":24897},{"type":"v1","addr":"172.21.15.96:6807","nonce":24897}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6804","nonce":24897},{"type":"v1","addr":"172.21.15.96:6805","nonce":24897}]},"public_addr":"172.21.15.96:6801/24897","cluster_addr":"172.21.15.96:6803/24897","heartbeat_back_addr":"172.21.15.96:6807/24897","heartbeat_front_addr":"172.21.15.96:6805/24897","state":["exists","up"]},{"osd":14,"uuid":"d713adf7-4bce-443c-873c-3226cd6e5a50","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6808","nonce":24905},{"type":"v1","addr":"172.21.15.119:6809","nonce":24905}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6810","nonce":24905},{"type":"v1","addr":"172.21.15.119:6811","nonce":24905}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6814","nonce":24905},{"type":"v1","addr":"172.21.15.119:6815","nonce":24905}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6812","nonce":24905},{"type":"v1","addr":"172.21.15.119:6813","nonce":24905}]},"public_addr":"172.21.15.119:6809/24905","cluster_addr":"172.21.15.119:6811/24905","heartbeat_back_addr":"172.21.15.119:6815/24905","heartbeat_front_addr":"172.21.15.119:6813/24905","state":["exists","up"]},{"osd":15,"uuid":"abfd15ca-bea7-4ed9-890d-c9d4add42879","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":23,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6808","nonce":25223},{"type":"v1","addr":"172.21.15.134:6812","nonce":25223}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6815","nonce":25223},{"type":"v1","addr":"172.21.15.134:6818","nonce":25223}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6827","nonce":25223},{"type":"v1","addr":"172.21.15.134:6829","nonce":25223}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6821","nonce":25223},{"type":"v1","addr":"172.21.15.134:6824","nonce":25223}]},"public_addr":"172.21.15.134:6812/25223","cluster_addr":"172.21.15.134:6818/25223","heartbeat_back_addr":"172.21.15.134:6829/25223","heartbeat_front_addr":"172.21.15.134:6824/25223","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T14:43:15.486100+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T14:43:15.506438+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T14:43:15.360852+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T14:43:15.307798+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T14:43:15.441535+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T14:43:15.492500+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T14:43:15.367390+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T14:43:15.465492+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T14:43:15.502850+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T14:43:15.384186+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T14:43:15.381570+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T14:43:15.281246+0000","dead_epoch":0},{"osd":12,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T14:43:15.374069+0000","dead_epoch":0},{"osd":13,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T14:43:15.255730+0000","dead_epoch":0},{"osd":14,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T14:43:15.200225+0000","dead_epoch":0},{"osd":15,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T14:43:15.363752+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-18T14:43:22.323 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-04-18T14:43:22.323 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-04-18T14:43:22.324 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-04-18T14:43:22.324 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-04-18T14:43:22.325 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2024-04-18T14:43:22.325 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2024-04-18T14:43:22.325 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2024-04-18T14:43:22.326 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2024-04-18T14:43:22.326 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.8 flush_pg_stats 2024-04-18T14:43:22.327 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.9 flush_pg_stats 2024-04-18T14:43:22.327 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.10 flush_pg_stats 2024-04-18T14:43:22.327 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.11 flush_pg_stats 2024-04-18T14:43:22.328 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.12 flush_pg_stats 2024-04-18T14:43:22.328 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.13 flush_pg_stats 2024-04-18T14:43:22.328 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.14 flush_pg_stats 2024-04-18T14:43:22.329 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.15 flush_pg_stats 2024-04-18T14:43:22.723 INFO:teuthology.orchestra.run.smithi086.stdout:103079215109 2024-04-18T14:43:22.724 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-04-18T14:43:22.804 INFO:teuthology.orchestra.run.smithi086.stdout:103079215108 2024-04-18T14:43:22.805 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.9 2024-04-18T14:43:22.819 INFO:teuthology.orchestra.run.smithi086.stdout:98784247811 2024-04-18T14:43:22.820 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-04-18T14:43:22.826 INFO:teuthology.orchestra.run.smithi086.stdout:98784247813 2024-04-18T14:43:22.827 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.8 2024-04-18T14:43:22.833 INFO:teuthology.orchestra.run.smithi086.stdout:94489280516 2024-04-18T14:43:22.833 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-04-18T14:43:22.844 INFO:teuthology.orchestra.run.smithi086.stdout:90194313221 2024-04-18T14:43:22.844 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.14 2024-04-18T14:43:22.858 INFO:teuthology.orchestra.run.smithi086.stdout:94489280515 2024-04-18T14:43:22.859 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-04-18T14:43:22.860 INFO:teuthology.orchestra.run.smithi086.stdout:103079215109 2024-04-18T14:43:22.860 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-04-18T14:43:22.873 INFO:teuthology.orchestra.run.smithi086.stdout:94489280516 2024-04-18T14:43:22.874 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.11 2024-04-18T14:43:22.887 INFO:teuthology.orchestra.run.smithi086.stdout:103079215107 2024-04-18T14:43:22.888 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.13 2024-04-18T14:43:22.889 INFO:teuthology.orchestra.run.smithi086.stdout:98784247813 2024-04-18T14:43:22.889 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-04-18T14:43:22.896 INFO:teuthology.orchestra.run.smithi086.stdout:94489280516 2024-04-18T14:43:22.896 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.10 2024-04-18T14:43:22.899 INFO:teuthology.orchestra.run.smithi086.stdout:94489280515 2024-04-18T14:43:22.899 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-04-18T14:43:22.922 INFO:teuthology.orchestra.run.smithi086.stdout:98784247812 2024-04-18T14:43:22.923 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-04-18T14:43:22.959 INFO:teuthology.orchestra.run.smithi086.stdout:94489280516 2024-04-18T14:43:22.959 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.12 2024-04-18T14:43:22.960 INFO:teuthology.orchestra.run.smithi086.stdout:98784247813 2024-04-18T14:43:22.961 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.15 2024-04-18T14:43:23.592 INFO:teuthology.orchestra.run.smithi086.stdout:103079215108 2024-04-18T14:43:23.630 INFO:teuthology.orchestra.run.smithi086.stdout:98784247813 2024-04-18T14:43:23.640 INFO:tasks.ceph.ceph_manager.ceph:need seq 103079215108 got 103079215108 for osd.9 2024-04-18T14:43:23.640 DEBUG:teuthology.parallel:result is None 2024-04-18T14:43:23.687 INFO:tasks.ceph.ceph_manager.ceph:need seq 98784247813 got 98784247813 for osd.8 2024-04-18T14:43:23.687 DEBUG:teuthology.parallel:result is None 2024-04-18T14:43:23.702 INFO:teuthology.orchestra.run.smithi086.stdout:103079215109 2024-04-18T14:43:23.703 INFO:teuthology.orchestra.run.smithi086.stdout:103079215109 2024-04-18T14:43:23.760 INFO:tasks.ceph.ceph_manager.ceph:need seq 103079215109 got 103079215109 for osd.5 2024-04-18T14:43:23.760 DEBUG:teuthology.parallel:result is None 2024-04-18T14:43:23.764 INFO:tasks.ceph.ceph_manager.ceph:need seq 103079215109 got 103079215109 for osd.1 2024-04-18T14:43:23.765 DEBUG:teuthology.parallel:result is None 2024-04-18T14:43:23.773 INFO:teuthology.orchestra.run.smithi086.stdout:98784247813 2024-04-18T14:43:23.820 INFO:teuthology.orchestra.run.smithi086.stdout:90194313221 2024-04-18T14:43:23.823 INFO:tasks.ceph.ceph_manager.ceph:need seq 98784247813 got 98784247813 for osd.7 2024-04-18T14:43:23.823 DEBUG:teuthology.parallel:result is None 2024-04-18T14:43:23.846 INFO:teuthology.orchestra.run.smithi086.stdout:94489280517 2024-04-18T14:43:23.861 INFO:teuthology.orchestra.run.smithi086.stdout:94489280517 2024-04-18T14:43:23.878 INFO:tasks.ceph.ceph_manager.ceph:need seq 90194313221 got 90194313221 for osd.14 2024-04-18T14:43:23.879 DEBUG:teuthology.parallel:result is None 2024-04-18T14:43:23.901 INFO:tasks.ceph.ceph_manager.ceph:need seq 94489280516 got 94489280517 for osd.2 2024-04-18T14:43:23.901 DEBUG:teuthology.parallel:result is None 2024-04-18T14:43:23.906 INFO:teuthology.orchestra.run.smithi086.stdout:103079215107 2024-04-18T14:43:23.913 INFO:tasks.ceph.ceph_manager.ceph:need seq 94489280516 got 94489280517 for osd.11 2024-04-18T14:43:23.913 DEBUG:teuthology.parallel:result is None 2024-04-18T14:43:23.922 INFO:teuthology.orchestra.run.smithi086.stdout:98784247811 2024-04-18T14:43:23.927 INFO:teuthology.orchestra.run.smithi086.stdout:98784247812 2024-04-18T14:43:23.928 INFO:teuthology.orchestra.run.smithi086.stdout:94489280517 2024-04-18T14:43:23.929 INFO:tasks.ceph.ceph_manager.ceph:need seq 103079215107 got 103079215107 for osd.13 2024-04-18T14:43:23.929 DEBUG:teuthology.parallel:result is None 2024-04-18T14:43:23.933 INFO:teuthology.orchestra.run.smithi086.stdout:94489280516 2024-04-18T14:43:23.951 INFO:tasks.ceph.ceph_manager.ceph:need seq 98784247812 got 98784247812 for osd.0 2024-04-18T14:43:23.952 DEBUG:teuthology.parallel:result is None 2024-04-18T14:43:23.958 INFO:tasks.ceph.ceph_manager.ceph:need seq 94489280516 got 94489280517 for osd.10 2024-04-18T14:43:23.958 DEBUG:teuthology.parallel:result is None 2024-04-18T14:43:23.963 INFO:tasks.ceph.ceph_manager.ceph:need seq 94489280515 got 94489280516 for osd.4 2024-04-18T14:43:23.964 DEBUG:teuthology.parallel:result is None 2024-04-18T14:43:23.967 INFO:tasks.ceph.ceph_manager.ceph:need seq 98784247811 got 98784247811 for osd.3 2024-04-18T14:43:23.967 DEBUG:teuthology.parallel:result is None 2024-04-18T14:43:23.973 INFO:teuthology.orchestra.run.smithi086.stdout:94489280517 2024-04-18T14:43:23.989 INFO:tasks.ceph.ceph_manager.ceph:need seq 94489280516 got 94489280517 for osd.12 2024-04-18T14:43:23.989 DEBUG:teuthology.parallel:result is None 2024-04-18T14:43:23.992 INFO:teuthology.orchestra.run.smithi086.stdout:94489280516 2024-04-18T14:43:24.008 INFO:tasks.ceph.ceph_manager.ceph:need seq 94489280515 got 94489280516 for osd.6 2024-04-18T14:43:24.009 DEBUG:teuthology.parallel:result is None 2024-04-18T14:43:24.016 INFO:teuthology.orchestra.run.smithi086.stdout:98784247813 2024-04-18T14:43:24.033 INFO:tasks.ceph.ceph_manager.ceph:need seq 98784247813 got 98784247813 for osd.15 2024-04-18T14:43:24.034 DEBUG:teuthology.parallel:result is None 2024-04-18T14:43:24.034 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-04-18T14:43:24.034 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-18T14:43:24.427 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-04-18T14:43:24.428 INFO:teuthology.orchestra.run.smithi086.stderr:dumped all 2024-04-18T14:43:24.447 INFO:teuthology.orchestra.run.smithi086.stdout:{"pg_ready":true,"pg_map":{"version":19,"stamp":"2024-04-18T14:43:23.336174+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":189,"num_write_kb":3198,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":145,"ondisk_log_size":145,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":11,"num_osds":16,"num_per_pool_osds":16,"num_per_pool_omap_osds":11,"kb":1509949440,"kb_used":437752,"kb_used_data":4884,"kb_used_omap":24,"kb_used_meta":432103,"kb_avail":1509511688,"statfs":{"total":1546188226560,"available":1545739968512,"internally_reserved":0,"allocated":5001216,"data_stored":2496480,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":25506,"internal_metadata":442473566},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":15,"apply_latency_ms":15,"commit_latency_ns":15000000,"apply_latency_ns":15000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":9,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-18T14:43:21.329769+0000","last_change":"2024-04-18T14:43:21.328715+0000","last_active":"2024-04-18T14:43:21.329769+0000","last_peered":"2024-04-18T14:43:21.329769+0000","last_clean":"2024-04-18T14:43:21.329769+0000","last_became_active":"2024-04-18T14:43:21.328185+0000","last_became_peered":"2024-04-18T14:43:21.328185+0000","last_unstale":"2024-04-18T14:43:21.329769+0000","last_undegraded":"2024-04-18T14:43:21.329769+0000","last_fullsized":"2024-04-18T14:43:21.329769+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T14:43:20.303322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T14:43:20.303322+0000","last_clean_scrub_stamp":"2024-04-18T14:43:20.303322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T14:44:20.541816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[15,13],"acting":[15,13],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":15,"acting_primary":15,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":9,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-18T14:43:21.415603+0000","last_change":"2024-04-18T14:43:21.414621+0000","last_active":"2024-04-18T14:43:21.415603+0000","last_peered":"2024-04-18T14:43:21.415603+0000","last_clean":"2024-04-18T14:43:21.415603+0000","last_became_active":"2024-04-18T14:43:21.413906+0000","last_became_peered":"2024-04-18T14:43:21.413906+0000","last_unstale":"2024-04-18T14:43:21.415603+0000","last_undegraded":"2024-04-18T14:43:21.415603+0000","last_fullsized":"2024-04-18T14:43:21.415603+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T14:43:20.303322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T14:43:20.303322+0000","last_clean_scrub_stamp":"2024-04-18T14:43:20.303322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T14:44:28.448910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[14,0],"acting":[14,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":14,"acting_primary":14,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":10,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T14:43:22.322909+0000","last_change":"2024-04-18T14:43:21.423043+0000","last_active":"2024-04-18T14:43:22.322909+0000","last_peered":"2024-04-18T14:43:22.322909+0000","last_clean":"2024-04-18T14:43:22.322909+0000","last_became_active":"2024-04-18T14:43:21.422468+0000","last_became_peered":"2024-04-18T14:43:21.422468+0000","last_unstale":"2024-04-18T14:43:22.322909+0000","last_undegraded":"2024-04-18T14:43:22.322909+0000","last_fullsized":"2024-04-18T14:43:22.322909+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T14:43:20.303322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T14:43:20.303322+0000","last_clean_scrub_stamp":"2024-04-18T14:43:20.303322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T14:44:36.598607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2],"acting":[8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":10,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T14:43:22.527523+0000","last_change":"2024-04-18T14:43:21.348882+0000","last_active":"2024-04-18T14:43:22.527523+0000","last_peered":"2024-04-18T14:43:22.527523+0000","last_clean":"2024-04-18T14:43:22.527523+0000","last_became_active":"2024-04-18T14:43:21.348012+0000","last_became_peered":"2024-04-18T14:43:21.348012+0000","last_unstale":"2024-04-18T14:43:22.527523+0000","last_undegraded":"2024-04-18T14:43:22.527523+0000","last_fullsized":"2024-04-18T14:43:22.527523+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T14:43:20.303322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T14:43:20.303322+0000","last_clean_scrub_stamp":"2024-04-18T14:43:20.303322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T14:44:27.891832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,12],"acting":[6,12],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":9,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-18T14:43:21.467111+0000","last_change":"2024-04-18T14:43:21.465969+0000","last_active":"2024-04-18T14:43:21.467111+0000","last_peered":"2024-04-18T14:43:21.467111+0000","last_clean":"2024-04-18T14:43:21.467111+0000","last_became_active":"2024-04-18T14:43:21.465481+0000","last_became_peered":"2024-04-18T14:43:21.465481+0000","last_unstale":"2024-04-18T14:43:21.467111+0000","last_undegraded":"2024-04-18T14:43:21.467111+0000","last_fullsized":"2024-04-18T14:43:21.467111+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T14:43:20.303322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T14:43:20.303322+0000","last_clean_scrub_stamp":"2024-04-18T14:43:20.303322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T14:44:45.650560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10],"acting":[3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":9,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-18T14:43:21.330618+0000","last_change":"2024-04-18T14:43:21.329508+0000","last_active":"2024-04-18T14:43:21.330618+0000","last_peered":"2024-04-18T14:43:21.330618+0000","last_clean":"2024-04-18T14:43:21.330618+0000","last_became_active":"2024-04-18T14:43:21.328534+0000","last_became_peered":"2024-04-18T14:43:21.328534+0000","last_unstale":"2024-04-18T14:43:21.330618+0000","last_undegraded":"2024-04-18T14:43:21.330618+0000","last_fullsized":"2024-04-18T14:43:21.330618+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T14:43:20.303322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T14:43:20.303322+0000","last_clean_scrub_stamp":"2024-04-18T14:43:20.303322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T14:44:22.866788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[13,5],"acting":[13,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":13,"acting_primary":13,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":9,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-18T14:43:21.415679+0000","last_change":"2024-04-18T14:43:21.414881+0000","last_active":"2024-04-18T14:43:21.415679+0000","last_peered":"2024-04-18T14:43:21.415679+0000","last_clean":"2024-04-18T14:43:21.415679+0000","last_became_active":"2024-04-18T14:43:21.414060+0000","last_became_peered":"2024-04-18T14:43:21.414060+0000","last_unstale":"2024-04-18T14:43:21.415679+0000","last_undegraded":"2024-04-18T14:43:21.415679+0000","last_fullsized":"2024-04-18T14:43:21.415679+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T14:43:20.303322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T14:43:20.303322+0000","last_clean_scrub_stamp":"2024-04-18T14:43:20.303322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T14:44:26.835605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":10,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T14:43:22.652571+0000","last_change":"2024-04-18T14:43:21.329224+0000","last_active":"2024-04-18T14:43:22.652571+0000","last_peered":"2024-04-18T14:43:22.652571+0000","last_clean":"2024-04-18T14:43:22.652571+0000","last_became_active":"2024-04-18T14:43:21.327764+0000","last_became_peered":"2024-04-18T14:43:21.327764+0000","last_unstale":"2024-04-18T14:43:22.652571+0000","last_undegraded":"2024-04-18T14:43:22.652571+0000","last_fullsized":"2024-04-18T14:43:22.652571+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T14:43:20.303322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T14:43:20.303322+0000","last_clean_scrub_stamp":"2024-04-18T14:43:20.303322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T14:44:20.633685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,15],"acting":[5,15],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"25'145","reported_seq":191,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-18T14:43:21.250954+0000","last_change":"2024-04-18T14:43:20.323829+0000","last_active":"2024-04-18T14:43:21.250954+0000","last_peered":"2024-04-18T14:43:21.250954+0000","last_clean":"2024-04-18T14:43:21.250954+0000","last_became_active":"2024-04-18T14:43:20.323133+0000","last_became_peered":"2024-04-18T14:43:20.323133+0000","last_unstale":"2024-04-18T14:43:21.250954+0000","last_undegraded":"2024-04-18T14:43:21.250954+0000","last_fullsized":"2024-04-18T14:43:21.250954+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T14:43:18.296821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T14:43:18.296821+0000","last_clean_scrub_stamp":"2024-04-18T14:43:18.296821+0000","objects_scrubbed":0,"log_size":145,"log_dups_size":0,"ondisk_log_size":145,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T14:44:25.445335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":189,"num_write_kb":3198,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[13,0],"acting":[13,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":13,"acting_primary":13,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":11},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":189,"num_write_kb":3198,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":942080,"data_stored":934976,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":145,"ondisk_log_size":145,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":13,"up_from":24,"seq":103079215107,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27984,"kb_used_data":708,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343856,"statfs":{"total":96636764160,"available":96608108544,"internally_reserved":0,"allocated":724992,"data_stored":564374,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,6,12,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70599999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0129999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.073}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.204}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.125}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.103}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2290000000000001}]},{"osd":12,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5089999999999999}]},{"osd":14,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4099999999999999}]},{"osd":15,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.292}]}]},{"osd":9,"up_from":24,"seq":103079215108,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27268,"kb_used_data":248,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344572,"statfs":{"total":96636764160,"available":96608841728,"internally_reserved":0,"allocated":253952,"data_stored":96886,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1599,"internal_metadata":27654593},"hb_peers":[0,1,3,8,10,11,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.04}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3200000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5980000000000001}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6899999999999999}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.425}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.849}]},{"osd":12,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.1560000000000001}]},{"osd":13,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.6030000000000002}]},{"osd":14,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.3180000000000001}]},{"osd":15,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.7789999999999999}]}]},{"osd":5,"up_from":24,"seq":103079215109,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27272,"kb_used_data":248,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344568,"statfs":{"total":96636764160,"available":96608837632,"internally_reserved":0,"allocated":253952,"data_stored":96886,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[3,4,6,8,9,10,11,12,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3680000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94399999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.7749999999999999}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2010000000000001}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2909999999999999}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.474}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.883}]},{"osd":12,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5249999999999999}]},{"osd":13,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.5070000000000001}]},{"osd":15,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.415}]}]},{"osd":14,"up_from":21,"seq":90194313221,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":248,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":253952,"data_stored":96886,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[3,4,5,6,7,8,10,12,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94499999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70199999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.99299999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82799999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3260000000000001}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1579999999999999}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3879999999999999}]},{"osd":12,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2}]},{"osd":13,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.522}]},{"osd":15,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6479999999999999}]}]},{"osd":1,"up_from":24,"seq":103079215109,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27264,"kb_used_data":244,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344576,"statfs":{"total":96636764160,"available":96608845824,"internally_reserved":0,"allocated":249856,"data_stored":96042,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76200000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90800000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1779999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0589999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.819}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.3639999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.96}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.8600000000000001}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.4780000000000002}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.625}]}]},{"osd":2,"up_from":22,"seq":94489280517,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27268,"kb_used_data":248,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344572,"statfs":{"total":96636764160,"available":96608841728,"internally_reserved":0,"allocated":253952,"data_stored":96886,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,3,5,6,7,8,10,11,12,14],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.175}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.222}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96699999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95299999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.367}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.03}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.006}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.748}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4510000000000001}]},{"osd":12,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0669999999999999}]},{"osd":14,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0800000000000001}]}]},{"osd":15,"up_from":23,"seq":98784247813,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27264,"kb_used_data":244,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344576,"statfs":{"total":96636764160,"available":96608845824,"internally_reserved":0,"allocated":249856,"data_stored":96042,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,3,4,5,6,7,8,10,11,14],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2769999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2050000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.139}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.0579999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.8680000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3839999999999999}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.004}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.403}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.2109999999999999}]},{"osd":14,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.351}]}]},{"osd":4,"up_from":22,"seq":94489280516,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27264,"kb_used_data":244,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344576,"statfs":{"total":96636764160,"available":96608845824,"internally_reserved":0,"allocated":249856,"data_stored":96042,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[2,6,10,11,12,14],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96899999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85399999999999998}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.093}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0549999999999999}]},{"osd":12,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69799999999999995}]},{"osd":14,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4730000000000001}]}]},{"osd":6,"up_from":22,"seq":94489280516,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27272,"kb_used_data":248,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344568,"statfs":{"total":96636764160,"available":96608837632,"internally_reserved":0,"allocated":253952,"data_stored":96886,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[1,2,4,5,7,8,10,11,12,14],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.878}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0429999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0860000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5049999999999999}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1180000000000001}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3799999999999999}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.3610000000000002}]},{"osd":12,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.329}]},{"osd":14,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.484}]}]},{"osd":10,"up_from":22,"seq":94489280517,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27284,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344556,"statfs":{"total":96636764160,"available":96608825344,"internally_reserved":0,"allocated":266240,"data_stored":105504,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1599,"internal_metadata":27654593},"hb_peers":[2,4,6,8,9,11,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71499999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.107}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90700000000000003}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.347}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0369999999999999}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.0299999999999998}]},{"osd":12,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95399999999999996}]},{"osd":13,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.052}]},{"osd":14,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2}]},{"osd":15,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.0840000000000001}]}]},{"osd":11,"up_from":22,"seq":94489280517,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27264,"kb_used_data":244,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344576,"statfs":{"total":96636764160,"available":96608845824,"internally_reserved":0,"allocated":249856,"data_stored":96042,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[2,4,6,10,12,14],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.367}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95699999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3260000000000001}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.111}]},{"osd":12,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6539999999999999}]},{"osd":14,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.282}]}]},{"osd":12,"up_from":22,"seq":94489280517,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27268,"kb_used_data":244,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344572,"statfs":{"total":96636764160,"available":96608841728,"internally_reserved":0,"allocated":249856,"data_stored":96042,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,3,4,6,7,10,11,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56999999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65600000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.438}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59699999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0920000000000001}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97699999999999998}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.016}]},{"osd":13,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84599999999999997}]},{"osd":14,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3400000000000001}]},{"osd":15,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90100000000000002}]}]},{"osd":0,"up_from":23,"seq":98784247812,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27980,"kb_used_data":704,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343860,"statfs":{"total":96636764160,"available":96608112640,"internally_reserved":0,"allocated":720896,"data_stored":563530,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,4,6,7,8,10,11,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81399999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60599999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65600000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71099999999999997}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69199999999999995}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93600000000000005}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75600000000000001}]},{"osd":13,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94699999999999995}]},{"osd":14,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91900000000000004}]},{"osd":15,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.046}]}]},{"osd":3,"up_from":23,"seq":98784247811,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27268,"kb_used_data":248,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344572,"statfs":{"total":96636764160,"available":96608841728,"internally_reserved":0,"allocated":253952,"data_stored":96886,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,2,4,6,7,8,10,11,12,14],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0760000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5469999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96599999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.472}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4199999999999999}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.51}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.71}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.881}]},{"osd":12,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.2050000000000001}]},{"osd":14,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.2879999999999998}]}]},{"osd":7,"up_from":23,"seq":98784247813,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27264,"kb_used_data":244,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344576,"statfs":{"total":96636764160,"available":96608845824,"internally_reserved":0,"allocated":249856,"data_stored":96042,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[2,4,5,6,8,10,11,12,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76100000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81799999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1140000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4690000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2789999999999999}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0700000000000001}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.831}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.694}]},{"osd":12,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.7549999999999999}]},{"osd":14,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.6059999999999999}]},{"osd":15,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.0390000000000001}]}]},{"osd":8,"up_from":23,"seq":98784247813,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27292,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344548,"statfs":{"total":96636764160,"available":96608817152,"internally_reserved":0,"allocated":266240,"data_stored":105504,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[2,4,5,7,9,10,11,12,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.413}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78300000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.181}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0009999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.425}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.468}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3049999999999999}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.8360000000000001}]},{"osd":12,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.7130000000000001}]},{"osd":14,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6339999999999999}]},{"osd":15,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.673}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":471040,"data_stored":467488,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":13,"total":0,"available":0,"internally_reserved":0,"allocated":471040,"data_stored":467488,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":12,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":13,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":14,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":15,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-18T14:43:24.449 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-18T14:43:24.732 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-04-18T14:43:24.733 INFO:teuthology.orchestra.run.smithi086.stderr:dumped all 2024-04-18T14:43:24.749 INFO:teuthology.orchestra.run.smithi086.stdout:{"pg_ready":true,"pg_map":{"version":19,"stamp":"2024-04-18T14:43:23.336174+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":189,"num_write_kb":3198,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":145,"ondisk_log_size":145,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":11,"num_osds":16,"num_per_pool_osds":16,"num_per_pool_omap_osds":11,"kb":1509949440,"kb_used":437752,"kb_used_data":4884,"kb_used_omap":24,"kb_used_meta":432103,"kb_avail":1509511688,"statfs":{"total":1546188226560,"available":1545739968512,"internally_reserved":0,"allocated":5001216,"data_stored":2496480,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":25506,"internal_metadata":442473566},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":15,"apply_latency_ms":15,"commit_latency_ns":15000000,"apply_latency_ns":15000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":9,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-18T14:43:21.329769+0000","last_change":"2024-04-18T14:43:21.328715+0000","last_active":"2024-04-18T14:43:21.329769+0000","last_peered":"2024-04-18T14:43:21.329769+0000","last_clean":"2024-04-18T14:43:21.329769+0000","last_became_active":"2024-04-18T14:43:21.328185+0000","last_became_peered":"2024-04-18T14:43:21.328185+0000","last_unstale":"2024-04-18T14:43:21.329769+0000","last_undegraded":"2024-04-18T14:43:21.329769+0000","last_fullsized":"2024-04-18T14:43:21.329769+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T14:43:20.303322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T14:43:20.303322+0000","last_clean_scrub_stamp":"2024-04-18T14:43:20.303322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T14:44:20.541816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[15,13],"acting":[15,13],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":15,"acting_primary":15,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":9,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-18T14:43:21.415603+0000","last_change":"2024-04-18T14:43:21.414621+0000","last_active":"2024-04-18T14:43:21.415603+0000","last_peered":"2024-04-18T14:43:21.415603+0000","last_clean":"2024-04-18T14:43:21.415603+0000","last_became_active":"2024-04-18T14:43:21.413906+0000","last_became_peered":"2024-04-18T14:43:21.413906+0000","last_unstale":"2024-04-18T14:43:21.415603+0000","last_undegraded":"2024-04-18T14:43:21.415603+0000","last_fullsized":"2024-04-18T14:43:21.415603+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T14:43:20.303322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T14:43:20.303322+0000","last_clean_scrub_stamp":"2024-04-18T14:43:20.303322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T14:44:28.448910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[14,0],"acting":[14,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":14,"acting_primary":14,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":10,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T14:43:22.322909+0000","last_change":"2024-04-18T14:43:21.423043+0000","last_active":"2024-04-18T14:43:22.322909+0000","last_peered":"2024-04-18T14:43:22.322909+0000","last_clean":"2024-04-18T14:43:22.322909+0000","last_became_active":"2024-04-18T14:43:21.422468+0000","last_became_peered":"2024-04-18T14:43:21.422468+0000","last_unstale":"2024-04-18T14:43:22.322909+0000","last_undegraded":"2024-04-18T14:43:22.322909+0000","last_fullsized":"2024-04-18T14:43:22.322909+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T14:43:20.303322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T14:43:20.303322+0000","last_clean_scrub_stamp":"2024-04-18T14:43:20.303322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T14:44:36.598607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2],"acting":[8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":10,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T14:43:22.527523+0000","last_change":"2024-04-18T14:43:21.348882+0000","last_active":"2024-04-18T14:43:22.527523+0000","last_peered":"2024-04-18T14:43:22.527523+0000","last_clean":"2024-04-18T14:43:22.527523+0000","last_became_active":"2024-04-18T14:43:21.348012+0000","last_became_peered":"2024-04-18T14:43:21.348012+0000","last_unstale":"2024-04-18T14:43:22.527523+0000","last_undegraded":"2024-04-18T14:43:22.527523+0000","last_fullsized":"2024-04-18T14:43:22.527523+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T14:43:20.303322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T14:43:20.303322+0000","last_clean_scrub_stamp":"2024-04-18T14:43:20.303322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T14:44:27.891832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,12],"acting":[6,12],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":9,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-18T14:43:21.467111+0000","last_change":"2024-04-18T14:43:21.465969+0000","last_active":"2024-04-18T14:43:21.467111+0000","last_peered":"2024-04-18T14:43:21.467111+0000","last_clean":"2024-04-18T14:43:21.467111+0000","last_became_active":"2024-04-18T14:43:21.465481+0000","last_became_peered":"2024-04-18T14:43:21.465481+0000","last_unstale":"2024-04-18T14:43:21.467111+0000","last_undegraded":"2024-04-18T14:43:21.467111+0000","last_fullsized":"2024-04-18T14:43:21.467111+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T14:43:20.303322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T14:43:20.303322+0000","last_clean_scrub_stamp":"2024-04-18T14:43:20.303322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T14:44:45.650560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10],"acting":[3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":9,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-18T14:43:21.330618+0000","last_change":"2024-04-18T14:43:21.329508+0000","last_active":"2024-04-18T14:43:21.330618+0000","last_peered":"2024-04-18T14:43:21.330618+0000","last_clean":"2024-04-18T14:43:21.330618+0000","last_became_active":"2024-04-18T14:43:21.328534+0000","last_became_peered":"2024-04-18T14:43:21.328534+0000","last_unstale":"2024-04-18T14:43:21.330618+0000","last_undegraded":"2024-04-18T14:43:21.330618+0000","last_fullsized":"2024-04-18T14:43:21.330618+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T14:43:20.303322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T14:43:20.303322+0000","last_clean_scrub_stamp":"2024-04-18T14:43:20.303322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T14:44:22.866788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[13,5],"acting":[13,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":13,"acting_primary":13,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":9,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-18T14:43:21.415679+0000","last_change":"2024-04-18T14:43:21.414881+0000","last_active":"2024-04-18T14:43:21.415679+0000","last_peered":"2024-04-18T14:43:21.415679+0000","last_clean":"2024-04-18T14:43:21.415679+0000","last_became_active":"2024-04-18T14:43:21.414060+0000","last_became_peered":"2024-04-18T14:43:21.414060+0000","last_unstale":"2024-04-18T14:43:21.415679+0000","last_undegraded":"2024-04-18T14:43:21.415679+0000","last_fullsized":"2024-04-18T14:43:21.415679+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T14:43:20.303322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T14:43:20.303322+0000","last_clean_scrub_stamp":"2024-04-18T14:43:20.303322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T14:44:26.835605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":10,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T14:43:22.652571+0000","last_change":"2024-04-18T14:43:21.329224+0000","last_active":"2024-04-18T14:43:22.652571+0000","last_peered":"2024-04-18T14:43:22.652571+0000","last_clean":"2024-04-18T14:43:22.652571+0000","last_became_active":"2024-04-18T14:43:21.327764+0000","last_became_peered":"2024-04-18T14:43:21.327764+0000","last_unstale":"2024-04-18T14:43:22.652571+0000","last_undegraded":"2024-04-18T14:43:22.652571+0000","last_fullsized":"2024-04-18T14:43:22.652571+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T14:43:20.303322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T14:43:20.303322+0000","last_clean_scrub_stamp":"2024-04-18T14:43:20.303322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T14:44:20.633685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,15],"acting":[5,15],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"25'145","reported_seq":191,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-18T14:43:21.250954+0000","last_change":"2024-04-18T14:43:20.323829+0000","last_active":"2024-04-18T14:43:21.250954+0000","last_peered":"2024-04-18T14:43:21.250954+0000","last_clean":"2024-04-18T14:43:21.250954+0000","last_became_active":"2024-04-18T14:43:20.323133+0000","last_became_peered":"2024-04-18T14:43:20.323133+0000","last_unstale":"2024-04-18T14:43:21.250954+0000","last_undegraded":"2024-04-18T14:43:21.250954+0000","last_fullsized":"2024-04-18T14:43:21.250954+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T14:43:18.296821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T14:43:18.296821+0000","last_clean_scrub_stamp":"2024-04-18T14:43:18.296821+0000","objects_scrubbed":0,"log_size":145,"log_dups_size":0,"ondisk_log_size":145,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T14:44:25.445335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":189,"num_write_kb":3198,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[13,0],"acting":[13,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":13,"acting_primary":13,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":11},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":189,"num_write_kb":3198,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":942080,"data_stored":934976,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":145,"ondisk_log_size":145,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":13,"up_from":24,"seq":103079215107,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27984,"kb_used_data":708,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343856,"statfs":{"total":96636764160,"available":96608108544,"internally_reserved":0,"allocated":724992,"data_stored":564374,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,6,12,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70599999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0129999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.073}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.204}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.125}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.103}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2290000000000001}]},{"osd":12,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5089999999999999}]},{"osd":14,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4099999999999999}]},{"osd":15,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.292}]}]},{"osd":9,"up_from":24,"seq":103079215108,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27268,"kb_used_data":248,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344572,"statfs":{"total":96636764160,"available":96608841728,"internally_reserved":0,"allocated":253952,"data_stored":96886,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1599,"internal_metadata":27654593},"hb_peers":[0,1,3,8,10,11,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.04}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3200000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5980000000000001}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6899999999999999}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.425}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.849}]},{"osd":12,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.1560000000000001}]},{"osd":13,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.6030000000000002}]},{"osd":14,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.3180000000000001}]},{"osd":15,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.7789999999999999}]}]},{"osd":5,"up_from":24,"seq":103079215109,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27272,"kb_used_data":248,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344568,"statfs":{"total":96636764160,"available":96608837632,"internally_reserved":0,"allocated":253952,"data_stored":96886,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[3,4,6,8,9,10,11,12,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3680000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94399999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.7749999999999999}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2010000000000001}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2909999999999999}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.474}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.883}]},{"osd":12,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5249999999999999}]},{"osd":13,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.5070000000000001}]},{"osd":15,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.415}]}]},{"osd":14,"up_from":21,"seq":90194313221,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":248,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":253952,"data_stored":96886,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[3,4,5,6,7,8,10,12,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94499999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70199999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.99299999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82799999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3260000000000001}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1579999999999999}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3879999999999999}]},{"osd":12,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2}]},{"osd":13,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.522}]},{"osd":15,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6479999999999999}]}]},{"osd":1,"up_from":24,"seq":103079215109,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27264,"kb_used_data":244,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344576,"statfs":{"total":96636764160,"available":96608845824,"internally_reserved":0,"allocated":249856,"data_stored":96042,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76200000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90800000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1779999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0589999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.819}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.3639999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.96}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.8600000000000001}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.4780000000000002}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.625}]}]},{"osd":2,"up_from":22,"seq":94489280517,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27268,"kb_used_data":248,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344572,"statfs":{"total":96636764160,"available":96608841728,"internally_reserved":0,"allocated":253952,"data_stored":96886,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,3,5,6,7,8,10,11,12,14],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.175}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.222}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96699999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95299999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.367}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.03}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.006}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.748}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4510000000000001}]},{"osd":12,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0669999999999999}]},{"osd":14,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0800000000000001}]}]},{"osd":15,"up_from":23,"seq":98784247813,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27264,"kb_used_data":244,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344576,"statfs":{"total":96636764160,"available":96608845824,"internally_reserved":0,"allocated":249856,"data_stored":96042,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,3,4,5,6,7,8,10,11,14],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2769999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2050000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.139}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.0579999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.8680000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3839999999999999}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.004}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.403}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.2109999999999999}]},{"osd":14,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.351}]}]},{"osd":4,"up_from":22,"seq":94489280516,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27264,"kb_used_data":244,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344576,"statfs":{"total":96636764160,"available":96608845824,"internally_reserved":0,"allocated":249856,"data_stored":96042,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[2,6,10,11,12,14],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96899999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85399999999999998}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.093}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0549999999999999}]},{"osd":12,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69799999999999995}]},{"osd":14,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4730000000000001}]}]},{"osd":6,"up_from":22,"seq":94489280516,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27272,"kb_used_data":248,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344568,"statfs":{"total":96636764160,"available":96608837632,"internally_reserved":0,"allocated":253952,"data_stored":96886,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[1,2,4,5,7,8,10,11,12,14],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.878}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0429999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0860000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5049999999999999}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1180000000000001}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3799999999999999}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.3610000000000002}]},{"osd":12,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.329}]},{"osd":14,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.484}]}]},{"osd":10,"up_from":22,"seq":94489280517,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27284,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344556,"statfs":{"total":96636764160,"available":96608825344,"internally_reserved":0,"allocated":266240,"data_stored":105504,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1599,"internal_metadata":27654593},"hb_peers":[2,4,6,8,9,11,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71499999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.107}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90700000000000003}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.347}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0369999999999999}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.0299999999999998}]},{"osd":12,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95399999999999996}]},{"osd":13,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.052}]},{"osd":14,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2}]},{"osd":15,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.0840000000000001}]}]},{"osd":11,"up_from":22,"seq":94489280517,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27264,"kb_used_data":244,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344576,"statfs":{"total":96636764160,"available":96608845824,"internally_reserved":0,"allocated":249856,"data_stored":96042,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[2,4,6,10,12,14],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.367}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95699999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3260000000000001}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.111}]},{"osd":12,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6539999999999999}]},{"osd":14,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.282}]}]},{"osd":12,"up_from":22,"seq":94489280517,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27268,"kb_used_data":244,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344572,"statfs":{"total":96636764160,"available":96608841728,"internally_reserved":0,"allocated":249856,"data_stored":96042,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,3,4,6,7,10,11,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56999999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65600000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.438}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59699999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0920000000000001}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97699999999999998}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.016}]},{"osd":13,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84599999999999997}]},{"osd":14,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3400000000000001}]},{"osd":15,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90100000000000002}]}]},{"osd":0,"up_from":23,"seq":98784247812,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27980,"kb_used_data":704,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343860,"statfs":{"total":96636764160,"available":96608112640,"internally_reserved":0,"allocated":720896,"data_stored":563530,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,4,6,7,8,10,11,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81399999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60599999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65600000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71099999999999997}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69199999999999995}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93600000000000005}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75600000000000001}]},{"osd":13,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94699999999999995}]},{"osd":14,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91900000000000004}]},{"osd":15,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.046}]}]},{"osd":3,"up_from":23,"seq":98784247811,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27268,"kb_used_data":248,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344572,"statfs":{"total":96636764160,"available":96608841728,"internally_reserved":0,"allocated":253952,"data_stored":96886,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,2,4,6,7,8,10,11,12,14],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0760000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5469999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96599999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.472}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4199999999999999}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.51}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.71}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.881}]},{"osd":12,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.2050000000000001}]},{"osd":14,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.2879999999999998}]}]},{"osd":7,"up_from":23,"seq":98784247813,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27264,"kb_used_data":244,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344576,"statfs":{"total":96636764160,"available":96608845824,"internally_reserved":0,"allocated":249856,"data_stored":96042,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[2,4,5,6,8,10,11,12,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76100000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81799999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1140000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4690000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2789999999999999}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0700000000000001}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.831}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.694}]},{"osd":12,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.7549999999999999}]},{"osd":14,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.6059999999999999}]},{"osd":15,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.0390000000000001}]}]},{"osd":8,"up_from":23,"seq":98784247813,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27292,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344548,"statfs":{"total":96636764160,"available":96608817152,"internally_reserved":0,"allocated":266240,"data_stored":105504,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[2,4,5,7,9,10,11,12,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.413}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78300000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.181}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0009999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.425}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.468}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3049999999999999}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.8360000000000001}]},{"osd":12,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.7130000000000001}]},{"osd":14,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6339999999999999}]},{"osd":15,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.673}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":471040,"data_stored":467488,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":13,"total":0,"available":0,"internally_reserved":0,"allocated":471040,"data_stored":467488,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":12,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":13,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":14,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":15,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-18T14:43:24.751 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-04-18T14:43:24.751 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-04-18T14:43:24.751 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-04-18T14:43:24.751 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-04-18T14:43:25.045 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-04-18T14:43:25.045 INFO:teuthology.orchestra.run.smithi086.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-04-18T14:43:25.063 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-04-18T14:43:25.063 INFO:teuthology.run_tasks:Running task thrashosds... 2024-04-18T14:43:25.073 INFO:tasks.thrashosds:config is {'aggressive_pg_num_changes': False, 'chance_pgnum_grow': 1, 'chance_pgnum_shrink': 1, 'chance_pgpnum_fix': 1, 'min_in': 8, 'timeout': 1200, 'sighup_delay': 0.1, 'optrack_toggle_delay': 2.0, 'dump_ops_enable': 'true', 'noscrub_toggle_delay': 2.0, 'random_eio': 0.0} 2024-04-18T14:43:25.074 INFO:tasks.thrashosds:overrides is {'admin_socket': {'branch': 'wip-yuri2-testing-2024-04-17-0823-reef'}, 'ceph': {'conf': {'global': {'mon client directed command retry': 5, 'mon election default strategy': 1, 'ms inject socket failures': 5000}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon scrub interval': 300}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'stupid', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'bluestore zero block detection': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd blocked scrub grace period': 3600, 'osd debug reject backfill probability': 0.3, 'osd debug verify cached snaps': True, 'osd debug verify missing on start': True, 'osd failsafe full ratio': 0.95, 'osd heartbeat use min delay socket': True, 'osd max backfills': 3, 'osd max markdown count': 1000, 'osd mclock override recovery settings': True, 'osd mclock profile': 'high_recovery_ops', 'osd objectstore': 'bluestore', 'osd op queue': 'debug_random', 'osd op queue cut off': 'debug_random', 'osd scrub max interval': 120, 'osd scrub min interval': 60, 'osd shutdown pgref assert': True}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(OSD_SLOW_PING_TIME', 'but it is still running', 'objects unfound and apparently lost', 'slow request', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', '\\(SLOW_OPS\\)', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from'], 'sha1': '6a7528e4aecd36b18c4b41cee6012e9f92aa7ab0'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': '6a7528e4aecd36b18c4b41cee6012e9f92aa7ab0'}}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-yuri2-testing-2024-04-17-0823-reef', 'sha1': '6a7528e4aecd36b18c4b41cee6012e9f92aa7ab0'}} 2024-04-18T14:43:25.074 INFO:tasks.thrashosds:config is {'aggressive_pg_num_changes': False, 'chance_pgnum_grow': 1, 'chance_pgnum_shrink': 1, 'chance_pgpnum_fix': 1, 'min_in': 8, 'timeout': 1200, 'sighup_delay': 0.1, 'optrack_toggle_delay': 2.0, 'dump_ops_enable': 'true', 'noscrub_toggle_delay': 2.0, 'random_eio': 0.0, 'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5} 2024-04-18T14:43:25.074 INFO:tasks.thrashosds:Beginning thrashosds... 2024-04-18T14:43:25.074 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-04-18T14:43:25.074 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-18T14:43:25.349 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-04-18T14:43:25.350 INFO:teuthology.orchestra.run.smithi086.stderr:dumped all 2024-04-18T14:43:25.364 INFO:teuthology.orchestra.run.smithi086.stdout:{"pg_ready":true,"pg_map":{"version":20,"stamp":"2024-04-18T14:43:25.336910+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":11,"num_osds":16,"num_per_pool_osds":16,"num_per_pool_omap_osds":11,"kb":1509949440,"kb_used":438248,"kb_used_data":5100,"kb_used_omap":24,"kb_used_meta":432103,"kb_avail":1509511192,"statfs":{"total":1546188226560,"available":1545739460608,"internally_reserved":0,"allocated":5222400,"data_stored":2676132,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":25506,"internal_metadata":442473566},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":15,"apply_latency_ms":15,"commit_latency_ns":15000000,"apply_latency_ns":15000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":9,"num_write":14,"num_write_kb":262,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"2.000735"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":10,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-18T14:43:22.847713+0000","last_change":"2024-04-18T14:43:21.328715+0000","last_active":"2024-04-18T14:43:22.847713+0000","last_peered":"2024-04-18T14:43:22.847713+0000","last_clean":"2024-04-18T14:43:22.847713+0000","last_became_active":"2024-04-18T14:43:21.328185+0000","last_became_peered":"2024-04-18T14:43:21.328185+0000","last_unstale":"2024-04-18T14:43:22.847713+0000","last_undegraded":"2024-04-18T14:43:22.847713+0000","last_fullsized":"2024-04-18T14:43:22.847713+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T14:43:20.303322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T14:43:20.303322+0000","last_clean_scrub_stamp":"2024-04-18T14:43:20.303322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T14:44:20.541816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[15,13],"acting":[15,13],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":15,"acting_primary":15,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":9,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-18T14:43:21.415603+0000","last_change":"2024-04-18T14:43:21.414621+0000","last_active":"2024-04-18T14:43:21.415603+0000","last_peered":"2024-04-18T14:43:21.415603+0000","last_clean":"2024-04-18T14:43:21.415603+0000","last_became_active":"2024-04-18T14:43:21.413906+0000","last_became_peered":"2024-04-18T14:43:21.413906+0000","last_unstale":"2024-04-18T14:43:21.415603+0000","last_undegraded":"2024-04-18T14:43:21.415603+0000","last_fullsized":"2024-04-18T14:43:21.415603+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T14:43:20.303322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T14:43:20.303322+0000","last_clean_scrub_stamp":"2024-04-18T14:43:20.303322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T14:44:28.448910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[14,0],"acting":[14,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":14,"acting_primary":14,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":10,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T14:43:22.322909+0000","last_change":"2024-04-18T14:43:21.423043+0000","last_active":"2024-04-18T14:43:22.322909+0000","last_peered":"2024-04-18T14:43:22.322909+0000","last_clean":"2024-04-18T14:43:22.322909+0000","last_became_active":"2024-04-18T14:43:21.422468+0000","last_became_peered":"2024-04-18T14:43:21.422468+0000","last_unstale":"2024-04-18T14:43:22.322909+0000","last_undegraded":"2024-04-18T14:43:22.322909+0000","last_fullsized":"2024-04-18T14:43:22.322909+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T14:43:20.303322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T14:43:20.303322+0000","last_clean_scrub_stamp":"2024-04-18T14:43:20.303322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T14:44:36.598607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2],"acting":[8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":10,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T14:43:22.527523+0000","last_change":"2024-04-18T14:43:21.348882+0000","last_active":"2024-04-18T14:43:22.527523+0000","last_peered":"2024-04-18T14:43:22.527523+0000","last_clean":"2024-04-18T14:43:22.527523+0000","last_became_active":"2024-04-18T14:43:21.348012+0000","last_became_peered":"2024-04-18T14:43:21.348012+0000","last_unstale":"2024-04-18T14:43:22.527523+0000","last_undegraded":"2024-04-18T14:43:22.527523+0000","last_fullsized":"2024-04-18T14:43:22.527523+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T14:43:20.303322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T14:43:20.303322+0000","last_clean_scrub_stamp":"2024-04-18T14:43:20.303322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T14:44:27.891832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,12],"acting":[6,12],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":10,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-18T14:43:22.764669+0000","last_change":"2024-04-18T14:43:21.465969+0000","last_active":"2024-04-18T14:43:22.764669+0000","last_peered":"2024-04-18T14:43:22.764669+0000","last_clean":"2024-04-18T14:43:22.764669+0000","last_became_active":"2024-04-18T14:43:21.465481+0000","last_became_peered":"2024-04-18T14:43:21.465481+0000","last_unstale":"2024-04-18T14:43:22.764669+0000","last_undegraded":"2024-04-18T14:43:22.764669+0000","last_fullsized":"2024-04-18T14:43:22.764669+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T14:43:20.303322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T14:43:20.303322+0000","last_clean_scrub_stamp":"2024-04-18T14:43:20.303322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T14:44:45.650560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10],"acting":[3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":10,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-18T14:43:22.792950+0000","last_change":"2024-04-18T14:43:21.329508+0000","last_active":"2024-04-18T14:43:22.792950+0000","last_peered":"2024-04-18T14:43:22.792950+0000","last_clean":"2024-04-18T14:43:22.792950+0000","last_became_active":"2024-04-18T14:43:21.328534+0000","last_became_peered":"2024-04-18T14:43:21.328534+0000","last_unstale":"2024-04-18T14:43:22.792950+0000","last_undegraded":"2024-04-18T14:43:22.792950+0000","last_fullsized":"2024-04-18T14:43:22.792950+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T14:43:20.303322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T14:43:20.303322+0000","last_clean_scrub_stamp":"2024-04-18T14:43:20.303322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T14:44:22.866788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[13,5],"acting":[13,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":13,"acting_primary":13,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":10,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-18T14:43:22.764608+0000","last_change":"2024-04-18T14:43:21.414881+0000","last_active":"2024-04-18T14:43:22.764608+0000","last_peered":"2024-04-18T14:43:22.764608+0000","last_clean":"2024-04-18T14:43:22.764608+0000","last_became_active":"2024-04-18T14:43:21.414060+0000","last_became_peered":"2024-04-18T14:43:21.414060+0000","last_unstale":"2024-04-18T14:43:22.764608+0000","last_undegraded":"2024-04-18T14:43:22.764608+0000","last_fullsized":"2024-04-18T14:43:22.764608+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T14:43:20.303322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T14:43:20.303322+0000","last_clean_scrub_stamp":"2024-04-18T14:43:20.303322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T14:44:26.835605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":10,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T14:43:22.652571+0000","last_change":"2024-04-18T14:43:21.329224+0000","last_active":"2024-04-18T14:43:22.652571+0000","last_peered":"2024-04-18T14:43:22.652571+0000","last_clean":"2024-04-18T14:43:22.652571+0000","last_became_active":"2024-04-18T14:43:21.327764+0000","last_became_peered":"2024-04-18T14:43:21.327764+0000","last_unstale":"2024-04-18T14:43:22.652571+0000","last_undegraded":"2024-04-18T14:43:22.652571+0000","last_fullsized":"2024-04-18T14:43:22.652571+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T14:43:20.303322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T14:43:20.303322+0000","last_clean_scrub_stamp":"2024-04-18T14:43:20.303322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T14:44:20.633685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,15],"acting":[5,15],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"26'157","reported_seq":207,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-18T14:43:23.048773+0000","last_change":"2024-04-18T14:43:20.323829+0000","last_active":"2024-04-18T14:43:23.048773+0000","last_peered":"2024-04-18T14:43:23.048773+0000","last_clean":"2024-04-18T14:43:23.048773+0000","last_became_active":"2024-04-18T14:43:20.323133+0000","last_became_peered":"2024-04-18T14:43:20.323133+0000","last_unstale":"2024-04-18T14:43:23.048773+0000","last_undegraded":"2024-04-18T14:43:23.048773+0000","last_fullsized":"2024-04-18T14:43:23.048773+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T14:43:18.296821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T14:43:18.296821+0000","last_clean_scrub_stamp":"2024-04-18T14:43:18.296821+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T14:44:25.445335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[13,0],"acting":[13,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":13,"acting_primary":13,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":11},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1064960,"data_stored":1057856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":13,"up_from":24,"seq":103079215108,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28192,"kb_used_data":784,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343648,"statfs":{"total":96636764160,"available":96607895552,"internally_reserved":0,"allocated":802816,"data_stored":635276,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,6,12,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0740000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84599999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2829999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75600000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.171}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97099999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.343}]},{"osd":12,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5}]},{"osd":14,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1339999999999999}]},{"osd":15,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.482}]}]},{"osd":9,"up_from":24,"seq":103079215109,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27288,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":270336,"data_stored":106348,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1599,"internal_metadata":27654593},"hb_peers":[0,1,3,8,10,11,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64700000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92800000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89300000000000002}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79400000000000004}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.21}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0680000000000001}]},{"osd":12,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0389999999999999}]},{"osd":13,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.095}]},{"osd":14,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.236}]},{"osd":15,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.486}]}]},{"osd":5,"up_from":24,"seq":103079215110,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27292,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344548,"statfs":{"total":96636764160,"available":96608817152,"internally_reserved":0,"allocated":270336,"data_stored":106348,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[3,4,6,8,9,10,11,12,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98799999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72699999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2889999999999999}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81200000000000006}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94799999999999995}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2609999999999999}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.357}]},{"osd":12,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1499999999999999}]},{"osd":13,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.337}]},{"osd":15,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.466}]}]},{"osd":14,"up_from":21,"seq":90194313221,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":248,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":253952,"data_stored":96886,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[3,4,5,6,7,8,10,12,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94499999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70199999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.99299999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82799999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3260000000000001}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1579999999999999}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3879999999999999}]},{"osd":12,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2}]},{"osd":13,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.522}]},{"osd":15,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6479999999999999}]}]},{"osd":1,"up_from":24,"seq":103079215110,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27284,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344556,"statfs":{"total":96636764160,"available":96608825344,"internally_reserved":0,"allocated":266240,"data_stored":105504,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76200000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90800000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1779999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0589999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.819}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.3639999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.96}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.8600000000000001}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.4780000000000002}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.625}]}]},{"osd":2,"up_from":22,"seq":94489280517,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27268,"kb_used_data":248,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344572,"statfs":{"total":96636764160,"available":96608841728,"internally_reserved":0,"allocated":253952,"data_stored":96886,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,3,5,6,7,8,10,11,12,14],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.175}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.222}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96699999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95299999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.367}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.03}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.006}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.748}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4510000000000001}]},{"osd":12,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0669999999999999}]},{"osd":14,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0800000000000001}]}]},{"osd":15,"up_from":23,"seq":98784247814,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27284,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344556,"statfs":{"total":96636764160,"available":96608825344,"internally_reserved":0,"allocated":266240,"data_stored":105504,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,3,4,5,6,7,8,10,11,14],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2769999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2050000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.139}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.0579999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.8680000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3839999999999999}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.004}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.403}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.2109999999999999}]},{"osd":14,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.351}]}]},{"osd":4,"up_from":22,"seq":94489280516,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27264,"kb_used_data":244,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344576,"statfs":{"total":96636764160,"available":96608845824,"internally_reserved":0,"allocated":249856,"data_stored":96042,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[2,6,10,11,12,14],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96899999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85399999999999998}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.093}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0549999999999999}]},{"osd":12,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69799999999999995}]},{"osd":14,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4730000000000001}]}]},{"osd":6,"up_from":22,"seq":94489280516,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27272,"kb_used_data":248,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344568,"statfs":{"total":96636764160,"available":96608837632,"internally_reserved":0,"allocated":253952,"data_stored":96886,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[1,2,4,5,7,8,10,11,12,14],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.878}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0429999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0860000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5049999999999999}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1180000000000001}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3799999999999999}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.3610000000000002}]},{"osd":12,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.329}]},{"osd":14,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.484}]}]},{"osd":10,"up_from":22,"seq":94489280517,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27284,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344556,"statfs":{"total":96636764160,"available":96608825344,"internally_reserved":0,"allocated":266240,"data_stored":105504,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1599,"internal_metadata":27654593},"hb_peers":[2,4,6,8,9,11,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71499999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.107}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90700000000000003}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.347}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0369999999999999}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.0299999999999998}]},{"osd":12,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95399999999999996}]},{"osd":13,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.052}]},{"osd":14,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2}]},{"osd":15,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.0840000000000001}]}]},{"osd":11,"up_from":22,"seq":94489280517,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27264,"kb_used_data":244,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344576,"statfs":{"total":96636764160,"available":96608845824,"internally_reserved":0,"allocated":249856,"data_stored":96042,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[2,4,6,10,12,14],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.367}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95699999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3260000000000001}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.111}]},{"osd":12,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6539999999999999}]},{"osd":14,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.282}]}]},{"osd":12,"up_from":22,"seq":94489280517,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27268,"kb_used_data":244,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344572,"statfs":{"total":96636764160,"available":96608841728,"internally_reserved":0,"allocated":249856,"data_stored":96042,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,3,4,6,7,10,11,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56999999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65600000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.438}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59699999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0920000000000001}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97699999999999998}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.016}]},{"osd":13,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84599999999999997}]},{"osd":14,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3400000000000001}]},{"osd":15,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90100000000000002}]}]},{"osd":0,"up_from":23,"seq":98784247813,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28168,"kb_used_data":764,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343672,"statfs":{"total":96636764160,"available":96607920128,"internally_reserved":0,"allocated":782336,"data_stored":624970,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,4,6,7,8,10,11,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81399999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60599999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65600000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71099999999999997}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69199999999999995}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93600000000000005}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75600000000000001}]},{"osd":13,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94699999999999995}]},{"osd":14,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91900000000000004}]},{"osd":15,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.046}]}]},{"osd":3,"up_from":23,"seq":98784247812,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":270336,"data_stored":106348,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,2,4,6,7,8,10,11,12,14],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0760000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5469999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96599999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.472}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4199999999999999}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.51}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.71}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.881}]},{"osd":12,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.2050000000000001}]},{"osd":14,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.2879999999999998}]}]},{"osd":7,"up_from":23,"seq":98784247814,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27264,"kb_used_data":244,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344576,"statfs":{"total":96636764160,"available":96608845824,"internally_reserved":0,"allocated":249856,"data_stored":96042,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[2,4,5,6,8,10,11,12,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76100000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81799999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1140000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4690000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2789999999999999}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0700000000000001}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.831}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.694}]},{"osd":12,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.7549999999999999}]},{"osd":14,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.6059999999999999}]},{"osd":15,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.0390000000000001}]}]},{"osd":8,"up_from":23,"seq":98784247814,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27292,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344548,"statfs":{"total":96636764160,"available":96608817152,"internally_reserved":0,"allocated":266240,"data_stored":105504,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[2,4,5,7,9,10,11,12,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.413}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78300000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.181}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0009999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.425}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.468}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3049999999999999}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.8360000000000001}]},{"osd":12,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.7130000000000001}]},{"osd":14,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6339999999999999}]},{"osd":15,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.673}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":13,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":12,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":13,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":14,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":15,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-18T14:43:25.366 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-18T14:43:25.647 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-04-18T14:43:25.647 INFO:teuthology.orchestra.run.smithi086.stderr:dumped all 2024-04-18T14:43:25.664 INFO:teuthology.orchestra.run.smithi086.stdout:{"pg_ready":true,"pg_map":{"version":20,"stamp":"2024-04-18T14:43:25.336910+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":11,"num_osds":16,"num_per_pool_osds":16,"num_per_pool_omap_osds":11,"kb":1509949440,"kb_used":438248,"kb_used_data":5100,"kb_used_omap":24,"kb_used_meta":432103,"kb_avail":1509511192,"statfs":{"total":1546188226560,"available":1545739460608,"internally_reserved":0,"allocated":5222400,"data_stored":2676132,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":25506,"internal_metadata":442473566},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":15,"apply_latency_ms":15,"commit_latency_ns":15000000,"apply_latency_ns":15000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":9,"num_write":14,"num_write_kb":262,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"2.000735"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":10,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-18T14:43:22.847713+0000","last_change":"2024-04-18T14:43:21.328715+0000","last_active":"2024-04-18T14:43:22.847713+0000","last_peered":"2024-04-18T14:43:22.847713+0000","last_clean":"2024-04-18T14:43:22.847713+0000","last_became_active":"2024-04-18T14:43:21.328185+0000","last_became_peered":"2024-04-18T14:43:21.328185+0000","last_unstale":"2024-04-18T14:43:22.847713+0000","last_undegraded":"2024-04-18T14:43:22.847713+0000","last_fullsized":"2024-04-18T14:43:22.847713+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T14:43:20.303322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T14:43:20.303322+0000","last_clean_scrub_stamp":"2024-04-18T14:43:20.303322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T14:44:20.541816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[15,13],"acting":[15,13],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":15,"acting_primary":15,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":9,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-18T14:43:21.415603+0000","last_change":"2024-04-18T14:43:21.414621+0000","last_active":"2024-04-18T14:43:21.415603+0000","last_peered":"2024-04-18T14:43:21.415603+0000","last_clean":"2024-04-18T14:43:21.415603+0000","last_became_active":"2024-04-18T14:43:21.413906+0000","last_became_peered":"2024-04-18T14:43:21.413906+0000","last_unstale":"2024-04-18T14:43:21.415603+0000","last_undegraded":"2024-04-18T14:43:21.415603+0000","last_fullsized":"2024-04-18T14:43:21.415603+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T14:43:20.303322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T14:43:20.303322+0000","last_clean_scrub_stamp":"2024-04-18T14:43:20.303322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T14:44:28.448910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[14,0],"acting":[14,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":14,"acting_primary":14,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":10,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T14:43:22.322909+0000","last_change":"2024-04-18T14:43:21.423043+0000","last_active":"2024-04-18T14:43:22.322909+0000","last_peered":"2024-04-18T14:43:22.322909+0000","last_clean":"2024-04-18T14:43:22.322909+0000","last_became_active":"2024-04-18T14:43:21.422468+0000","last_became_peered":"2024-04-18T14:43:21.422468+0000","last_unstale":"2024-04-18T14:43:22.322909+0000","last_undegraded":"2024-04-18T14:43:22.322909+0000","last_fullsized":"2024-04-18T14:43:22.322909+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T14:43:20.303322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T14:43:20.303322+0000","last_clean_scrub_stamp":"2024-04-18T14:43:20.303322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T14:44:36.598607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2],"acting":[8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":10,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T14:43:22.527523+0000","last_change":"2024-04-18T14:43:21.348882+0000","last_active":"2024-04-18T14:43:22.527523+0000","last_peered":"2024-04-18T14:43:22.527523+0000","last_clean":"2024-04-18T14:43:22.527523+0000","last_became_active":"2024-04-18T14:43:21.348012+0000","last_became_peered":"2024-04-18T14:43:21.348012+0000","last_unstale":"2024-04-18T14:43:22.527523+0000","last_undegraded":"2024-04-18T14:43:22.527523+0000","last_fullsized":"2024-04-18T14:43:22.527523+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T14:43:20.303322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T14:43:20.303322+0000","last_clean_scrub_stamp":"2024-04-18T14:43:20.303322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T14:44:27.891832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,12],"acting":[6,12],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":10,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-18T14:43:22.764669+0000","last_change":"2024-04-18T14:43:21.465969+0000","last_active":"2024-04-18T14:43:22.764669+0000","last_peered":"2024-04-18T14:43:22.764669+0000","last_clean":"2024-04-18T14:43:22.764669+0000","last_became_active":"2024-04-18T14:43:21.465481+0000","last_became_peered":"2024-04-18T14:43:21.465481+0000","last_unstale":"2024-04-18T14:43:22.764669+0000","last_undegraded":"2024-04-18T14:43:22.764669+0000","last_fullsized":"2024-04-18T14:43:22.764669+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T14:43:20.303322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T14:43:20.303322+0000","last_clean_scrub_stamp":"2024-04-18T14:43:20.303322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T14:44:45.650560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10],"acting":[3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":10,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-18T14:43:22.792950+0000","last_change":"2024-04-18T14:43:21.329508+0000","last_active":"2024-04-18T14:43:22.792950+0000","last_peered":"2024-04-18T14:43:22.792950+0000","last_clean":"2024-04-18T14:43:22.792950+0000","last_became_active":"2024-04-18T14:43:21.328534+0000","last_became_peered":"2024-04-18T14:43:21.328534+0000","last_unstale":"2024-04-18T14:43:22.792950+0000","last_undegraded":"2024-04-18T14:43:22.792950+0000","last_fullsized":"2024-04-18T14:43:22.792950+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T14:43:20.303322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T14:43:20.303322+0000","last_clean_scrub_stamp":"2024-04-18T14:43:20.303322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T14:44:22.866788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[13,5],"acting":[13,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":13,"acting_primary":13,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":10,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-18T14:43:22.764608+0000","last_change":"2024-04-18T14:43:21.414881+0000","last_active":"2024-04-18T14:43:22.764608+0000","last_peered":"2024-04-18T14:43:22.764608+0000","last_clean":"2024-04-18T14:43:22.764608+0000","last_became_active":"2024-04-18T14:43:21.414060+0000","last_became_peered":"2024-04-18T14:43:21.414060+0000","last_unstale":"2024-04-18T14:43:22.764608+0000","last_undegraded":"2024-04-18T14:43:22.764608+0000","last_fullsized":"2024-04-18T14:43:22.764608+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T14:43:20.303322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T14:43:20.303322+0000","last_clean_scrub_stamp":"2024-04-18T14:43:20.303322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T14:44:26.835605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":10,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T14:43:22.652571+0000","last_change":"2024-04-18T14:43:21.329224+0000","last_active":"2024-04-18T14:43:22.652571+0000","last_peered":"2024-04-18T14:43:22.652571+0000","last_clean":"2024-04-18T14:43:22.652571+0000","last_became_active":"2024-04-18T14:43:21.327764+0000","last_became_peered":"2024-04-18T14:43:21.327764+0000","last_unstale":"2024-04-18T14:43:22.652571+0000","last_undegraded":"2024-04-18T14:43:22.652571+0000","last_fullsized":"2024-04-18T14:43:22.652571+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T14:43:20.303322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T14:43:20.303322+0000","last_clean_scrub_stamp":"2024-04-18T14:43:20.303322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T14:44:20.633685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,15],"acting":[5,15],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"26'157","reported_seq":207,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-18T14:43:23.048773+0000","last_change":"2024-04-18T14:43:20.323829+0000","last_active":"2024-04-18T14:43:23.048773+0000","last_peered":"2024-04-18T14:43:23.048773+0000","last_clean":"2024-04-18T14:43:23.048773+0000","last_became_active":"2024-04-18T14:43:20.323133+0000","last_became_peered":"2024-04-18T14:43:20.323133+0000","last_unstale":"2024-04-18T14:43:23.048773+0000","last_undegraded":"2024-04-18T14:43:23.048773+0000","last_fullsized":"2024-04-18T14:43:23.048773+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T14:43:18.296821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T14:43:18.296821+0000","last_clean_scrub_stamp":"2024-04-18T14:43:18.296821+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T14:44:25.445335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[13,0],"acting":[13,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":13,"acting_primary":13,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":11},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1064960,"data_stored":1057856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":13,"up_from":24,"seq":103079215108,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28192,"kb_used_data":784,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343648,"statfs":{"total":96636764160,"available":96607895552,"internally_reserved":0,"allocated":802816,"data_stored":635276,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,6,12,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0740000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84599999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2829999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75600000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.171}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97099999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.343}]},{"osd":12,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5}]},{"osd":14,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1339999999999999}]},{"osd":15,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.482}]}]},{"osd":9,"up_from":24,"seq":103079215109,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27288,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":270336,"data_stored":106348,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1599,"internal_metadata":27654593},"hb_peers":[0,1,3,8,10,11,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64700000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92800000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89300000000000002}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79400000000000004}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.21}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0680000000000001}]},{"osd":12,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0389999999999999}]},{"osd":13,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.095}]},{"osd":14,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.236}]},{"osd":15,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.486}]}]},{"osd":5,"up_from":24,"seq":103079215110,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27292,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344548,"statfs":{"total":96636764160,"available":96608817152,"internally_reserved":0,"allocated":270336,"data_stored":106348,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[3,4,6,8,9,10,11,12,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98799999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72699999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2889999999999999}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81200000000000006}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94799999999999995}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2609999999999999}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.357}]},{"osd":12,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1499999999999999}]},{"osd":13,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.337}]},{"osd":15,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.466}]}]},{"osd":14,"up_from":21,"seq":90194313221,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":248,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":253952,"data_stored":96886,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[3,4,5,6,7,8,10,12,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94499999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70199999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.99299999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82799999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3260000000000001}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1579999999999999}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3879999999999999}]},{"osd":12,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2}]},{"osd":13,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.522}]},{"osd":15,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6479999999999999}]}]},{"osd":1,"up_from":24,"seq":103079215110,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27284,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344556,"statfs":{"total":96636764160,"available":96608825344,"internally_reserved":0,"allocated":266240,"data_stored":105504,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76200000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90800000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1779999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0589999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.819}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.3639999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.96}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.8600000000000001}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.4780000000000002}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.625}]}]},{"osd":2,"up_from":22,"seq":94489280517,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27268,"kb_used_data":248,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344572,"statfs":{"total":96636764160,"available":96608841728,"internally_reserved":0,"allocated":253952,"data_stored":96886,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,3,5,6,7,8,10,11,12,14],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.175}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.222}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96699999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95299999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.367}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.03}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.006}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.748}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4510000000000001}]},{"osd":12,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0669999999999999}]},{"osd":14,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0800000000000001}]}]},{"osd":15,"up_from":23,"seq":98784247814,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27284,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344556,"statfs":{"total":96636764160,"available":96608825344,"internally_reserved":0,"allocated":266240,"data_stored":105504,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,3,4,5,6,7,8,10,11,14],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2769999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2050000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.139}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.0579999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.8680000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3839999999999999}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.004}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.403}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.2109999999999999}]},{"osd":14,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.351}]}]},{"osd":4,"up_from":22,"seq":94489280516,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27264,"kb_used_data":244,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344576,"statfs":{"total":96636764160,"available":96608845824,"internally_reserved":0,"allocated":249856,"data_stored":96042,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[2,6,10,11,12,14],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96899999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85399999999999998}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.093}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0549999999999999}]},{"osd":12,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69799999999999995}]},{"osd":14,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4730000000000001}]}]},{"osd":6,"up_from":22,"seq":94489280516,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27272,"kb_used_data":248,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344568,"statfs":{"total":96636764160,"available":96608837632,"internally_reserved":0,"allocated":253952,"data_stored":96886,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[1,2,4,5,7,8,10,11,12,14],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.878}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0429999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0860000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5049999999999999}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1180000000000001}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3799999999999999}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.3610000000000002}]},{"osd":12,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.329}]},{"osd":14,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.484}]}]},{"osd":10,"up_from":22,"seq":94489280517,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27284,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344556,"statfs":{"total":96636764160,"available":96608825344,"internally_reserved":0,"allocated":266240,"data_stored":105504,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1599,"internal_metadata":27654593},"hb_peers":[2,4,6,8,9,11,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71499999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.107}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90700000000000003}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.347}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0369999999999999}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.0299999999999998}]},{"osd":12,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95399999999999996}]},{"osd":13,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.052}]},{"osd":14,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2}]},{"osd":15,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.0840000000000001}]}]},{"osd":11,"up_from":22,"seq":94489280517,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27264,"kb_used_data":244,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344576,"statfs":{"total":96636764160,"available":96608845824,"internally_reserved":0,"allocated":249856,"data_stored":96042,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[2,4,6,10,12,14],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.367}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95699999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3260000000000001}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.111}]},{"osd":12,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6539999999999999}]},{"osd":14,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.282}]}]},{"osd":12,"up_from":22,"seq":94489280517,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27268,"kb_used_data":244,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344572,"statfs":{"total":96636764160,"available":96608841728,"internally_reserved":0,"allocated":249856,"data_stored":96042,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,3,4,6,7,10,11,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56999999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65600000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.438}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59699999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0920000000000001}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97699999999999998}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.016}]},{"osd":13,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84599999999999997}]},{"osd":14,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3400000000000001}]},{"osd":15,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90100000000000002}]}]},{"osd":0,"up_from":23,"seq":98784247813,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28168,"kb_used_data":764,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343672,"statfs":{"total":96636764160,"available":96607920128,"internally_reserved":0,"allocated":782336,"data_stored":624970,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,4,6,7,8,10,11,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81399999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60599999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65600000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71099999999999997}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69199999999999995}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93600000000000005}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75600000000000001}]},{"osd":13,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94699999999999995}]},{"osd":14,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91900000000000004}]},{"osd":15,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.046}]}]},{"osd":3,"up_from":23,"seq":98784247812,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":270336,"data_stored":106348,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,2,4,6,7,8,10,11,12,14],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0760000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5469999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96599999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.472}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4199999999999999}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.51}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.71}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.881}]},{"osd":12,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.2050000000000001}]},{"osd":14,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.2879999999999998}]}]},{"osd":7,"up_from":23,"seq":98784247814,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27264,"kb_used_data":244,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344576,"statfs":{"total":96636764160,"available":96608845824,"internally_reserved":0,"allocated":249856,"data_stored":96042,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[2,4,5,6,8,10,11,12,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76100000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81799999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1140000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4690000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2789999999999999}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0700000000000001}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.831}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.694}]},{"osd":12,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.7549999999999999}]},{"osd":14,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.6059999999999999}]},{"osd":15,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.0390000000000001}]}]},{"osd":8,"up_from":23,"seq":98784247814,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27292,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344548,"statfs":{"total":96636764160,"available":96608817152,"internally_reserved":0,"allocated":266240,"data_stored":105504,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[2,4,5,7,9,10,11,12,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.413}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78300000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.181}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0009999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.425}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.468}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3049999999999999}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.8360000000000001}]},{"osd":12,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.7130000000000001}]},{"osd":14,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6339999999999999}]},{"osd":15,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.673}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":13,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":12,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":13,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":14,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":15,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-18T14:43:25.666 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-04-18T14:43:25.666 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump 2024-04-18T14:43:25.945 INFO:teuthology.orchestra.run.smithi086.stdout:epoch 27 2024-04-18T14:43:25.946 INFO:teuthology.orchestra.run.smithi086.stdout:fsid ac90c892-1809-401c-a743-76948b63c51a 2024-04-18T14:43:25.946 INFO:teuthology.orchestra.run.smithi086.stdout:created 2024-04-18T14:43:04.477846+0000 2024-04-18T14:43:25.946 INFO:teuthology.orchestra.run.smithi086.stdout:modified 2024-04-18T14:43:22.314147+0000 2024-04-18T14:43:25.946 INFO:teuthology.orchestra.run.smithi086.stdout:flags sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit 2024-04-18T14:43:25.946 INFO:teuthology.orchestra.run.smithi086.stdout:crush_version 5 2024-04-18T14:43:25.946 INFO:teuthology.orchestra.run.smithi086.stdout:full_ratio 0.95 2024-04-18T14:43:25.946 INFO:teuthology.orchestra.run.smithi086.stdout:backfillfull_ratio 0.9 2024-04-18T14:43:25.946 INFO:teuthology.orchestra.run.smithi086.stdout:nearfull_ratio 0.85 2024-04-18T14:43:25.946 INFO:teuthology.orchestra.run.smithi086.stdout:require_min_compat_client luminous 2024-04-18T14:43:25.946 INFO:teuthology.orchestra.run.smithi086.stdout:min_compat_client jewel 2024-04-18T14:43:25.946 INFO:teuthology.orchestra.run.smithi086.stdout:require_osd_release reef 2024-04-18T14:43:25.946 INFO:teuthology.orchestra.run.smithi086.stdout:stretch_mode_enabled false 2024-04-18T14:43:25.947 INFO:teuthology.orchestra.run.smithi086.stdout:pool 1 '.mgr' replicated size 2 min_size 1 crush_rule 0 object_hash rjenkins pg_num 1 pgp_num 1 autoscale_mode off last_change 26 flags hashpspool stripe_width 0 pg_num_max 32 pg_num_min 1 application mgr read_balance_score 15.38 2024-04-18T14:43:25.947 INFO:teuthology.orchestra.run.smithi086.stdout:pool 2 'rbd' replicated size 2 min_size 1 crush_rule 0 object_hash rjenkins pg_num 8 pgp_num 8 autoscale_mode off last_change 27 flags hashpspool stripe_width 0 application rbd read_balance_score 3.99 2024-04-18T14:43:25.947 INFO:teuthology.orchestra.run.smithi086.stdout:max_osd 16 2024-04-18T14:43:25.947 INFO:teuthology.orchestra.run.smithi086.stdout:osd.0 up in weight 1 up_from 23 up_thru 23 down_at 0 last_clean_interval [0,0) [v2:172.21.15.86:6804/24964,v1:172.21.15.86:6806/24964] [v2:172.21.15.86:6809/24964,v1:172.21.15.86:6812/24964] exists,up a2e10d33-3d09-4c39-aa08-15b3f6e81c8c 2024-04-18T14:43:25.947 INFO:teuthology.orchestra.run.smithi086.stdout:osd.1 up in weight 1 up_from 24 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:172.21.15.96:6824/24895,v1:172.21.15.96:6825/24895] [v2:172.21.15.96:6826/24895,v1:172.21.15.96:6827/24895] exists,up 9a6146f9-1780-409a-a0a5-e411bc40d674 2024-04-18T14:43:25.947 INFO:teuthology.orchestra.run.smithi086.stdout:osd.2 up in weight 1 up_from 22 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:172.21.15.119:6817/24902,v1:172.21.15.119:6819/24902] [v2:172.21.15.119:6821/24902,v1:172.21.15.119:6823/24902] exists,up 9c040397-fc12-4375-b34c-b7f3b5c299ae 2024-04-18T14:43:25.947 INFO:teuthology.orchestra.run.smithi086.stdout:osd.3 up in weight 1 up_from 23 up_thru 25 down_at 0 last_clean_interval [0,0) [v2:172.21.15.134:6806/25220,v1:172.21.15.134:6810/25220] [v2:172.21.15.134:6816/25220,v1:172.21.15.134:6820/25220] exists,up d6f346dc-57cc-4ad0-9db3-352ced49a170 2024-04-18T14:43:25.947 INFO:teuthology.orchestra.run.smithi086.stdout:osd.4 up in weight 1 up_from 22 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:172.21.15.86:6805/24962,v1:172.21.15.86:6808/24962] [v2:172.21.15.86:6811/24962,v1:172.21.15.86:6815/24962] exists,up b4a1348c-ca08-4588-8c5e-1b6338672f3f 2024-04-18T14:43:25.947 INFO:teuthology.orchestra.run.smithi086.stdout:osd.5 up in weight 1 up_from 24 up_thru 25 down_at 0 last_clean_interval [0,0) [v2:172.21.15.96:6813/24898,v1:172.21.15.96:6815/24898] [v2:172.21.15.96:6818/24898,v1:172.21.15.96:6819/24898] exists,up 2685cc4b-3fea-483c-a6ce-c74feae525a9 2024-04-18T14:43:25.947 INFO:teuthology.orchestra.run.smithi086.stdout:osd.6 up in weight 1 up_from 22 up_thru 25 down_at 0 last_clean_interval [0,0) [v2:172.21.15.119:6816/24903,v1:172.21.15.119:6818/24903] [v2:172.21.15.119:6820/24903,v1:172.21.15.119:6822/24903] exists,up a8dab92a-d416-4383-b35f-6ac033677638 2024-04-18T14:43:25.947 INFO:teuthology.orchestra.run.smithi086.stdout:osd.7 up in weight 1 up_from 23 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:172.21.15.134:6809/25221,v1:172.21.15.134:6814/25221] [v2:172.21.15.134:6819/25221,v1:172.21.15.134:6823/25221] exists,up 17e98ed9-593e-46df-82fa-80e4a36e6bf0 2024-04-18T14:43:25.947 INFO:teuthology.orchestra.run.smithi086.stdout:osd.8 up in weight 1 up_from 23 up_thru 25 down_at 0 last_clean_interval [0,0) [v2:172.21.15.86:6824/24967,v1:172.21.15.86:6825/24967] [v2:172.21.15.86:6826/24967,v1:172.21.15.86:6827/24967] exists,up be2c6ad5-ae83-463b-a8da-b8705b8c9ecd 2024-04-18T14:43:25.947 INFO:teuthology.orchestra.run.smithi086.stdout:osd.9 up in weight 1 up_from 24 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:172.21.15.96:6808/24896,v1:172.21.15.96:6809/24896] [v2:172.21.15.96:6810/24896,v1:172.21.15.96:6811/24896] exists,up 441c6b04-1540-46ea-b180-4b8fceda9c5e 2024-04-18T14:43:25.947 INFO:teuthology.orchestra.run.smithi086.stdout:osd.10 up in weight 1 up_from 22 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:172.21.15.119:6800/24904,v1:172.21.15.119:6801/24904] [v2:172.21.15.119:6802/24904,v1:172.21.15.119:6803/24904] exists,up 024a5dc2-0960-4540-89d5-7d40f5c4c2c8 2024-04-18T14:43:25.947 INFO:teuthology.orchestra.run.smithi086.stdout:osd.11 up in weight 1 up_from 22 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:172.21.15.134:6802/25222,v1:172.21.15.134:6803/25222] [v2:172.21.15.134:6804/25222,v1:172.21.15.134:6805/25222] exists,up b46de3d2-dc85-4a95-b7d9-9bcdc0cbf035 2024-04-18T14:43:25.948 INFO:teuthology.orchestra.run.smithi086.stdout:osd.12 up in weight 1 up_from 22 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:172.21.15.86:6800/24965,v1:172.21.15.86:6801/24965] [v2:172.21.15.86:6802/24965,v1:172.21.15.86:6803/24965] exists,up 29a50ae9-9c89-459b-b1de-a7f57905a6ca 2024-04-18T14:43:25.948 INFO:teuthology.orchestra.run.smithi086.stdout:osd.13 up in weight 1 up_from 24 up_thru 25 down_at 0 last_clean_interval [0,0) [v2:172.21.15.96:6800/24897,v1:172.21.15.96:6801/24897] [v2:172.21.15.96:6802/24897,v1:172.21.15.96:6803/24897] exists,up 4afcbb15-5c72-4b5f-bbd1-bddeba50b262 2024-04-18T14:43:25.948 INFO:teuthology.orchestra.run.smithi086.stdout:osd.14 up in weight 1 up_from 21 up_thru 25 down_at 0 last_clean_interval [0,0) [v2:172.21.15.119:6808/24905,v1:172.21.15.119:6809/24905] [v2:172.21.15.119:6810/24905,v1:172.21.15.119:6811/24905] exists,up d713adf7-4bce-443c-873c-3226cd6e5a50 2024-04-18T14:43:25.948 INFO:teuthology.orchestra.run.smithi086.stdout:osd.15 up in weight 1 up_from 23 up_thru 25 down_at 0 last_clean_interval [0,0) [v2:172.21.15.134:6808/25223,v1:172.21.15.134:6812/25223] [v2:172.21.15.134:6815/25223,v1:172.21.15.134:6818/25223] exists,up abfd15ca-bea7-4ed9-890d-c9d4add42879 2024-04-18T14:43:25.963 INFO:tasks.ceph.ceph_manager.ceph:['osd.0 up in weight 1 up_from 23 up_thru 23 down_at 0 last_clean_interval [0,0) [v2:172.21.15.86:6804/24964,v1:172.21.15.86:6806/24964] [v2:172.21.15.86:6809/24964,v1:172.21.15.86:6812/24964] exists,up a2e10d33-3d09-4c39-aa08-15b3f6e81c8c', 'osd.1 up in weight 1 up_from 24 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:172.21.15.96:6824/24895,v1:172.21.15.96:6825/24895] [v2:172.21.15.96:6826/24895,v1:172.21.15.96:6827/24895] exists,up 9a6146f9-1780-409a-a0a5-e411bc40d674', 'osd.2 up in weight 1 up_from 22 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:172.21.15.119:6817/24902,v1:172.21.15.119:6819/24902] [v2:172.21.15.119:6821/24902,v1:172.21.15.119:6823/24902] exists,up 9c040397-fc12-4375-b34c-b7f3b5c299ae', 'osd.3 up in weight 1 up_from 23 up_thru 25 down_at 0 last_clean_interval [0,0) [v2:172.21.15.134:6806/25220,v1:172.21.15.134:6810/25220] [v2:172.21.15.134:6816/25220,v1:172.21.15.134:6820/25220] exists,up d6f346dc-57cc-4ad0-9db3-352ced49a170', 'osd.4 up in weight 1 up_from 22 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:172.21.15.86:6805/24962,v1:172.21.15.86:6808/24962] [v2:172.21.15.86:6811/24962,v1:172.21.15.86:6815/24962] exists,up b4a1348c-ca08-4588-8c5e-1b6338672f3f', 'osd.5 up in weight 1 up_from 24 up_thru 25 down_at 0 last_clean_interval [0,0) [v2:172.21.15.96:6813/24898,v1:172.21.15.96:6815/24898] [v2:172.21.15.96:6818/24898,v1:172.21.15.96:6819/24898] exists,up 2685cc4b-3fea-483c-a6ce-c74feae525a9', 'osd.6 up in weight 1 up_from 22 up_thru 25 down_at 0 last_clean_interval [0,0) [v2:172.21.15.119:6816/24903,v1:172.21.15.119:6818/24903] [v2:172.21.15.119:6820/24903,v1:172.21.15.119:6822/24903] exists,up a8dab92a-d416-4383-b35f-6ac033677638', 'osd.7 up in weight 1 up_from 23 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:172.21.15.134:6809/25221,v1:172.21.15.134:6814/25221] [v2:172.21.15.134:6819/25221,v1:172.21.15.134:6823/25221] exists,up 17e98ed9-593e-46df-82fa-80e4a36e6bf0', 'osd.8 up in weight 1 up_from 23 up_thru 25 down_at 0 last_clean_interval [0,0) [v2:172.21.15.86:6824/24967,v1:172.21.15.86:6825/24967] [v2:172.21.15.86:6826/24967,v1:172.21.15.86:6827/24967] exists,up be2c6ad5-ae83-463b-a8da-b8705b8c9ecd', 'osd.9 up in weight 1 up_from 24 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:172.21.15.96:6808/24896,v1:172.21.15.96:6809/24896] [v2:172.21.15.96:6810/24896,v1:172.21.15.96:6811/24896] exists,up 441c6b04-1540-46ea-b180-4b8fceda9c5e', 'osd.10 up in weight 1 up_from 22 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:172.21.15.119:6800/24904,v1:172.21.15.119:6801/24904] [v2:172.21.15.119:6802/24904,v1:172.21.15.119:6803/24904] exists,up 024a5dc2-0960-4540-89d5-7d40f5c4c2c8', 'osd.11 up in weight 1 up_from 22 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:172.21.15.134:6802/25222,v1:172.21.15.134:6803/25222] [v2:172.21.15.134:6804/25222,v1:172.21.15.134:6805/25222] exists,up b46de3d2-dc85-4a95-b7d9-9bcdc0cbf035', 'osd.12 up in weight 1 up_from 22 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:172.21.15.86:6800/24965,v1:172.21.15.86:6801/24965] [v2:172.21.15.86:6802/24965,v1:172.21.15.86:6803/24965] exists,up 29a50ae9-9c89-459b-b1de-a7f57905a6ca', 'osd.13 up in weight 1 up_from 24 up_thru 25 down_at 0 last_clean_interval [0,0) [v2:172.21.15.96:6800/24897,v1:172.21.15.96:6801/24897] [v2:172.21.15.96:6802/24897,v1:172.21.15.96:6803/24897] exists,up 4afcbb15-5c72-4b5f-bbd1-bddeba50b262', 'osd.14 up in weight 1 up_from 21 up_thru 25 down_at 0 last_clean_interval [0,0) [v2:172.21.15.119:6808/24905,v1:172.21.15.119:6809/24905] [v2:172.21.15.119:6810/24905,v1:172.21.15.119:6811/24905] exists,up d713adf7-4bce-443c-873c-3226cd6e5a50', 'osd.15 up in weight 1 up_from 23 up_thru 25 down_at 0 last_clean_interval [0,0) [v2:172.21.15.134:6808/25223,v1:172.21.15.134:6812/25223] [v2:172.21.15.134:6815/25223,v1:172.21.15.134:6818/25223] exists,up abfd15ca-bea7-4ed9-890d-c9d4add42879'] 2024-04-18T14:43:25.963 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mon.a.asok config show 2024-04-18T14:43:26.069 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-04-18T14:43:26.069 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "mon.a", 2024-04-18T14:43:26.069 INFO:teuthology.orchestra.run.smithi086.stdout: "cluster": "ceph", 2024-04-18T14:43:26.069 INFO:teuthology.orchestra.run.smithi086.stdout: "admin_socket": "/var/run/ceph/ceph-mon.a.asok", 2024-04-18T14:43:26.069 INFO:teuthology.orchestra.run.smithi086.stdout: "admin_socket_mode": "", 2024-04-18T14:43:26.069 INFO:teuthology.orchestra.run.smithi086.stdout: "auth_allow_insecure_global_id_reclaim": "true", 2024-04-18T14:43:26.069 INFO:teuthology.orchestra.run.smithi086.stdout: "auth_client_required": "cephx, none", 2024-04-18T14:43:26.069 INFO:teuthology.orchestra.run.smithi086.stdout: "auth_cluster_required": "cephx", 2024-04-18T14:43:26.069 INFO:teuthology.orchestra.run.smithi086.stdout: "auth_debug": "true", 2024-04-18T14:43:26.069 INFO:teuthology.orchestra.run.smithi086.stdout: "auth_expose_insecure_global_id_reclaim": "true", 2024-04-18T14:43:26.069 INFO:teuthology.orchestra.run.smithi086.stdout: "auth_mon_ticket_ttl": "660.000000", 2024-04-18T14:43:26.070 INFO:teuthology.orchestra.run.smithi086.stdout: "auth_service_required": "cephx", 2024-04-18T14:43:26.070 INFO:teuthology.orchestra.run.smithi086.stdout: "auth_service_ticket_ttl": "240.000000", 2024-04-18T14:43:26.070 INFO:teuthology.orchestra.run.smithi086.stdout: "auth_supported": "cephx", 2024-04-18T14:43:26.070 INFO:teuthology.orchestra.run.smithi086.stdout: "bdev_aio": "true", 2024-04-18T14:43:26.070 INFO:teuthology.orchestra.run.smithi086.stdout: "bdev_aio_max_queue_depth": "1024", 2024-04-18T14:43:26.070 INFO:teuthology.orchestra.run.smithi086.stdout: "bdev_aio_poll_ms": "250", 2024-04-18T14:43:26.070 INFO:teuthology.orchestra.run.smithi086.stdout: "bdev_aio_reap_max": "16", 2024-04-18T14:43:26.070 INFO:teuthology.orchestra.run.smithi086.stdout: "bdev_async_discard": "false", 2024-04-18T14:43:26.070 INFO:teuthology.orchestra.run.smithi086.stdout: "bdev_block_size": "4096", 2024-04-18T14:43:26.070 INFO:teuthology.orchestra.run.smithi086.stdout: "bdev_debug_aio": "false", 2024-04-18T14:43:26.071 INFO:teuthology.orchestra.run.smithi086.stdout: "bdev_debug_aio_log_age": "5.000000", 2024-04-18T14:43:26.071 INFO:teuthology.orchestra.run.smithi086.stdout: "bdev_debug_aio_suicide_timeout": "60.000000", 2024-04-18T14:43:26.071 INFO:teuthology.orchestra.run.smithi086.stdout: "bdev_debug_inflight_ios": "false", 2024-04-18T14:43:26.071 INFO:teuthology.orchestra.run.smithi086.stdout: "bdev_enable_discard": "false", 2024-04-18T14:43:26.071 INFO:teuthology.orchestra.run.smithi086.stdout: "bdev_flock_retry": "3", 2024-04-18T14:43:26.071 INFO:teuthology.orchestra.run.smithi086.stdout: "bdev_flock_retry_interval": "0.100000", 2024-04-18T14:43:26.071 INFO:teuthology.orchestra.run.smithi086.stdout: "bdev_inject_crash": "0", 2024-04-18T14:43:26.071 INFO:teuthology.orchestra.run.smithi086.stdout: "bdev_inject_crash_flush_delay": "2", 2024-04-18T14:43:26.071 INFO:teuthology.orchestra.run.smithi086.stdout: "bdev_ioring": "false", 2024-04-18T14:43:26.071 INFO:teuthology.orchestra.run.smithi086.stdout: "bdev_ioring_hipri": "false", 2024-04-18T14:43:26.071 INFO:teuthology.orchestra.run.smithi086.stdout: "bdev_ioring_sqthread_poll": "false", 2024-04-18T14:43:26.071 INFO:teuthology.orchestra.run.smithi086.stdout: "bdev_nvme_unbind_from_kernel": "false", 2024-04-18T14:43:26.071 INFO:teuthology.orchestra.run.smithi086.stdout: "bdev_read_buffer_alignment": "4096", 2024-04-18T14:43:26.071 INFO:teuthology.orchestra.run.smithi086.stdout: "bdev_read_preallocated_huge_buffers": "", 2024-04-18T14:43:26.071 INFO:teuthology.orchestra.run.smithi086.stdout: "bdev_type": "", 2024-04-18T14:43:26.072 INFO:teuthology.orchestra.run.smithi086.stdout: "bluefs_alloc_size": "1048576", 2024-04-18T14:43:26.072 INFO:teuthology.orchestra.run.smithi086.stdout: "bluefs_allocator": "hybrid", 2024-04-18T14:43:26.072 INFO:teuthology.orchestra.run.smithi086.stdout: "bluefs_buffered_io": "true", 2024-04-18T14:43:26.072 INFO:teuthology.orchestra.run.smithi086.stdout: "bluefs_check_for_zeros": "false", 2024-04-18T14:43:26.072 INFO:teuthology.orchestra.run.smithi086.stdout: "bluefs_check_volume_selector_often": "false", 2024-04-18T14:43:26.072 INFO:teuthology.orchestra.run.smithi086.stdout: "bluefs_check_volume_selector_on_umount": "false", 2024-04-18T14:43:26.072 INFO:teuthology.orchestra.run.smithi086.stdout: "bluefs_compact_log_sync": "false", 2024-04-18T14:43:26.072 INFO:teuthology.orchestra.run.smithi086.stdout: "bluefs_failed_shared_alloc_cooldown": "600.000000", 2024-04-18T14:43:26.072 INFO:teuthology.orchestra.run.smithi086.stdout: "bluefs_log_compact_min_ratio": "5.000000", 2024-04-18T14:43:26.072 INFO:teuthology.orchestra.run.smithi086.stdout: "bluefs_log_compact_min_size": "16777216", 2024-04-18T14:43:26.072 INFO:teuthology.orchestra.run.smithi086.stdout: "bluefs_log_replay_check_allocations": "true", 2024-04-18T14:43:26.072 INFO:teuthology.orchestra.run.smithi086.stdout: "bluefs_max_log_runway": "4194304", 2024-04-18T14:43:26.072 INFO:teuthology.orchestra.run.smithi086.stdout: "bluefs_max_prefetch": "1048576", 2024-04-18T14:43:26.072 INFO:teuthology.orchestra.run.smithi086.stdout: "bluefs_min_flush_size": "524288", 2024-04-18T14:43:26.072 INFO:teuthology.orchestra.run.smithi086.stdout: "bluefs_min_log_runway": "1048576", 2024-04-18T14:43:26.073 INFO:teuthology.orchestra.run.smithi086.stdout: "bluefs_replay_recovery": "false", 2024-04-18T14:43:26.073 INFO:teuthology.orchestra.run.smithi086.stdout: "bluefs_replay_recovery_disable_compact": "false", 2024-04-18T14:43:26.073 INFO:teuthology.orchestra.run.smithi086.stdout: "bluefs_shared_alloc_size": "65536", 2024-04-18T14:43:26.073 INFO:teuthology.orchestra.run.smithi086.stdout: "bluefs_sync_write": "false", 2024-04-18T14:43:26.073 INFO:teuthology.orchestra.run.smithi086.stdout: "bluestore_2q_cache_kin_ratio": "0.500000", 2024-04-18T14:43:26.073 INFO:teuthology.orchestra.run.smithi086.stdout: "bluestore_2q_cache_kout_ratio": "0.500000", 2024-04-18T14:43:26.073 INFO:teuthology.orchestra.run.smithi086.stdout: "bluestore_alloc_stats_dump_interval": "86400.000000", 2024-04-18T14:43:26.073 INFO:teuthology.orchestra.run.smithi086.stdout: "bluestore_allocation_from_file": "true", 2024-04-18T14:43:26.073 INFO:teuthology.orchestra.run.smithi086.stdout: "bluestore_allocator": "hybrid", 2024-04-18T14:43:26.073 INFO:teuthology.orchestra.run.smithi086.stdout: "bluestore_avl_alloc_bf_free_pct": "4", 2024-04-18T14:43:26.074 INFO:teuthology.orchestra.run.smithi086.stdout: "bluestore_avl_alloc_bf_threshold": "131072", 2024-04-18T14:43:26.074 INFO:teuthology.orchestra.run.smithi086.stdout: "bluestore_avl_alloc_ff_max_search_bytes": "16777216", 2024-04-18T14:43:26.074 INFO:teuthology.orchestra.run.smithi086.stdout: "bluestore_avl_alloc_ff_max_search_count": "100", 2024-04-18T14:43:26.074 INFO:teuthology.orchestra.run.smithi086.stdout: "bluestore_bitmapallocator_blocks_per_zone": "1024", 2024-04-18T14:43:26.074 INFO:teuthology.orchestra.run.smithi086.stdout: "bluestore_bitmapallocator_span_size": "1024", 2024-04-18T14:43:26.074 INFO:teuthology.orchestra.run.smithi086.stdout: "bluestore_blobid_prealloc": "10240", 2024-04-18T14:43:26.074 INFO:teuthology.orchestra.run.smithi086.stdout: "bluestore_block_create": "true", 2024-04-18T14:43:26.074 INFO:teuthology.orchestra.run.smithi086.stdout: "bluestore_block_db_create": "false", 2024-04-18T14:43:26.074 INFO:teuthology.orchestra.run.smithi086.stdout: "bluestore_block_db_path": "", 2024-04-18T14:43:26.074 INFO:teuthology.orchestra.run.smithi086.stdout: "bluestore_block_db_size": "0", 2024-04-18T14:43:26.074 INFO:teuthology.orchestra.run.smithi086.stdout: "bluestore_block_path": "", 2024-04-18T14:43:26.074 INFO:teuthology.orchestra.run.smithi086.stdout: "bluestore_block_preallocate_file": "false", 2024-04-18T14:43:26.074 INFO:teuthology.orchestra.run.smithi086.stdout: "bluestore_block_size": "107374182400", 2024-04-18T14:43:26.075 INFO:teuthology.orchestra.run.smithi086.stdout: "bluestore_block_wal_create": "false", 2024-04-18T14:43:26.075 INFO:teuthology.orchestra.run.smithi086.stdout: "bluestore_block_wal_path": "", 2024-04-18T14:43:26.075 INFO:teuthology.orchestra.run.smithi086.stdout: "bluestore_block_wal_size": "100663296", 2024-04-18T14:43:26.075 INFO:teuthology.orchestra.run.smithi086.stdout: "bluestore_bluefs": "true", 2024-04-18T14:43:26.075 INFO:teuthology.orchestra.run.smithi086.stdout: "bluestore_bluefs_alloc_failure_dump_interval": "0.000000", 2024-04-18T14:43:26.075 INFO:teuthology.orchestra.run.smithi086.stdout: "bluestore_bluefs_env_mirror": "false", 2024-04-18T14:43:26.075 INFO:teuthology.orchestra.run.smithi086.stdout: "bluestore_bluefs_max_free": "10737418240", 2024-04-18T14:43:26.075 INFO:teuthology.orchestra.run.smithi086.stdout: "bluestore_cache_age_bin_interval": "1.000000", 2024-04-18T14:43:26.075 INFO:teuthology.orchestra.run.smithi086.stdout: "bluestore_cache_age_bins_data": "1 2 6 24 120 720 0 0 0 0", 2024-04-18T14:43:26.075 INFO:teuthology.orchestra.run.smithi086.stdout: "bluestore_cache_age_bins_kv": "1 2 6 24 120 720 0 0 0 0", 2024-04-18T14:43:26.075 INFO:teuthology.orchestra.run.smithi086.stdout: "bluestore_cache_age_bins_kv_onode": "0 0 0 0 0 0 0 0 0 720", 2024-04-18T14:43:26.075 INFO:teuthology.orchestra.run.smithi086.stdout: "bluestore_cache_age_bins_meta": "1 2 6 24 120 720 0 0 0 0", 2024-04-18T14:43:26.075 INFO:teuthology.orchestra.run.smithi086.stdout: "bluestore_cache_autotune": "true", 2024-04-18T14:43:26.075 INFO:teuthology.orchestra.run.smithi086.stdout: "bluestore_cache_autotune_interval": "5.000000", 2024-04-18T14:43:26.075 INFO:teuthology.orchestra.run.smithi086.stdout: "bluestore_cache_kv_onode_ratio": "0.040000", 2024-04-18T14:43:26.076 INFO:teuthology.orchestra.run.smithi086.stdout: "bluestore_cache_kv_ratio": "0.450000", 2024-04-18T14:43:26.076 INFO:teuthology.orchestra.run.smithi086.stdout: "bluestore_cache_meta_ratio": "0.450000", 2024-04-18T14:43:26.076 INFO:teuthology.orchestra.run.smithi086.stdout: "bluestore_cache_size": "0", 2024-04-18T14:43:26.076 INFO:teuthology.orchestra.run.smithi086.stdout: "bluestore_cache_size_hdd": "1073741824", 2024-04-18T14:43:26.076 INFO:teuthology.orchestra.run.smithi086.stdout: "bluestore_cache_size_ssd": "3221225472", 2024-04-18T14:43:26.076 INFO:teuthology.orchestra.run.smithi086.stdout: "bluestore_cache_trim_interval": "0.050000", 2024-04-18T14:43:26.076 INFO:teuthology.orchestra.run.smithi086.stdout: "bluestore_cache_trim_max_skip_pinned": "1000", 2024-04-18T14:43:26.076 INFO:teuthology.orchestra.run.smithi086.stdout: "bluestore_cache_type": "2q", 2024-04-18T14:43:26.076 INFO:teuthology.orchestra.run.smithi086.stdout: "bluestore_cleaner_sleep_interval": "5.000000", 2024-04-18T14:43:26.076 INFO:teuthology.orchestra.run.smithi086.stdout: "bluestore_clone_cow": "true", 2024-04-18T14:43:26.076 INFO:teuthology.orchestra.run.smithi086.stdout: "bluestore_compression_algorithm": "snappy", 2024-04-18T14:43:26.076 INFO:teuthology.orchestra.run.smithi086.stdout: "bluestore_compression_max_blob_size": "0", 2024-04-18T14:43:26.076 INFO:teuthology.orchestra.run.smithi086.stdout: "bluestore_compression_max_blob_size_hdd": "65536", 2024-04-18T14:43:26.076 INFO:teuthology.orchestra.run.smithi086.stdout: "bluestore_compression_max_blob_size_ssd": "65536", 2024-04-18T14:43:26.076 INFO:teuthology.orchestra.run.smithi086.stdout: "bluestore_compression_min_blob_size": "0", 2024-04-18T14:43:26.076 INFO:teuthology.orchestra.run.smithi086.stdout: "bluestore_compression_min_blob_size_hdd": "8192", 2024-04-18T14:43:26.077 INFO:teuthology.orchestra.run.smithi086.stdout: "bluestore_compression_min_blob_size_ssd": "65536", 2024-04-18T14:43:26.077 INFO:teuthology.orchestra.run.smithi086.stdout: "bluestore_compression_mode": "none", 2024-04-18T14:43:26.077 INFO:teuthology.orchestra.run.smithi086.stdout: "bluestore_compression_required_ratio": "0.875000", 2024-04-18T14:43:26.077 INFO:teuthology.orchestra.run.smithi086.stdout: "bluestore_csum_type": "crc32c", 2024-04-18T14:43:26.077 INFO:teuthology.orchestra.run.smithi086.stdout: "bluestore_debug_enforce_settings": "default", 2024-04-18T14:43:26.077 INFO:teuthology.orchestra.run.smithi086.stdout: "bluestore_debug_freelist": "false", 2024-04-18T14:43:26.077 INFO:teuthology.orchestra.run.smithi086.stdout: "bluestore_debug_fsck_abort": "false", 2024-04-18T14:43:26.077 INFO:teuthology.orchestra.run.smithi086.stdout: "bluestore_debug_inject_allocation_from_file_failure": "0.000000", 2024-04-18T14:43:26.077 INFO:teuthology.orchestra.run.smithi086.stdout: "bluestore_debug_inject_bug21040": "false", 2024-04-18T14:43:26.077 INFO:teuthology.orchestra.run.smithi086.stdout: "bluestore_debug_inject_csum_err_probability": "0.000000", 2024-04-18T14:43:26.077 INFO:teuthology.orchestra.run.smithi086.stdout: "bluestore_debug_inject_read_err": "false", 2024-04-18T14:43:26.077 INFO:teuthology.orchestra.run.smithi086.stdout: "bluestore_debug_legacy_omap": "false", 2024-04-18T14:43:26.077 INFO:teuthology.orchestra.run.smithi086.stdout: "bluestore_debug_no_reuse_blocks": "false", 2024-04-18T14:43:26.077 INFO:teuthology.orchestra.run.smithi086.stdout: "bluestore_debug_omit_block_device_write": "false", 2024-04-18T14:43:26.077 INFO:teuthology.orchestra.run.smithi086.stdout: "bluestore_debug_omit_kv_commit": "false", 2024-04-18T14:43:26.077 INFO:teuthology.orchestra.run.smithi086.stdout: "bluestore_debug_permit_any_bdev_label": "false", 2024-04-18T14:43:26.078 INFO:teuthology.orchestra.run.smithi086.stdout: "bluestore_debug_prefill": "0.000000", 2024-04-18T14:43:26.078 INFO:teuthology.orchestra.run.smithi086.stdout: "bluestore_debug_prefragment_max": "1048576", 2024-04-18T14:43:26.078 INFO:teuthology.orchestra.run.smithi086.stdout: "bluestore_debug_random_read_err": "0.000000", 2024-04-18T14:43:26.078 INFO:teuthology.orchestra.run.smithi086.stdout: "bluestore_debug_randomize_serial_transaction": "0", 2024-04-18T14:43:26.078 INFO:teuthology.orchestra.run.smithi086.stdout: "bluestore_debug_small_allocations": "0", 2024-04-18T14:43:26.078 INFO:teuthology.orchestra.run.smithi086.stdout: "bluestore_debug_too_many_blobs_threshold": "24576", 2024-04-18T14:43:26.078 INFO:teuthology.orchestra.run.smithi086.stdout: "bluestore_default_buffered_read": "true", 2024-04-18T14:43:26.078 INFO:teuthology.orchestra.run.smithi086.stdout: "bluestore_default_buffered_write": "false", 2024-04-18T14:43:26.078 INFO:teuthology.orchestra.run.smithi086.stdout: "bluestore_deferred_batch_ops": "0", 2024-04-18T14:43:26.079 INFO:teuthology.orchestra.run.smithi086.stdout: "bluestore_deferred_batch_ops_hdd": "64", 2024-04-18T14:43:26.079 INFO:teuthology.orchestra.run.smithi086.stdout: "bluestore_deferred_batch_ops_ssd": "16", 2024-04-18T14:43:26.079 INFO:teuthology.orchestra.run.smithi086.stdout: "bluestore_extent_map_inline_shard_prealloc_size": "256", 2024-04-18T14:43:26.079 INFO:teuthology.orchestra.run.smithi086.stdout: "bluestore_extent_map_shard_max_size": "1200", 2024-04-18T14:43:26.079 INFO:teuthology.orchestra.run.smithi086.stdout: "bluestore_extent_map_shard_min_size": "150", 2024-04-18T14:43:26.079 INFO:teuthology.orchestra.run.smithi086.stdout: "bluestore_extent_map_shard_target_size": "500", 2024-04-18T14:43:26.079 INFO:teuthology.orchestra.run.smithi086.stdout: "bluestore_extent_map_shard_target_size_slop": "0.200000", 2024-04-18T14:43:26.079 INFO:teuthology.orchestra.run.smithi086.stdout: "bluestore_fail_eio": "false", 2024-04-18T14:43:26.079 INFO:teuthology.orchestra.run.smithi086.stdout: "bluestore_freelist_blocks_per_key": "128", 2024-04-18T14:43:26.079 INFO:teuthology.orchestra.run.smithi086.stdout: "bluestore_fsck_error_on_no_per_pg_omap": "false", 2024-04-18T14:43:26.079 INFO:teuthology.orchestra.run.smithi086.stdout: "bluestore_fsck_error_on_no_per_pool_omap": "false", 2024-04-18T14:43:26.079 INFO:teuthology.orchestra.run.smithi086.stdout: "bluestore_fsck_error_on_no_per_pool_stats": "false", 2024-04-18T14:43:26.079 INFO:teuthology.orchestra.run.smithi086.stdout: "bluestore_fsck_on_mkfs": "true", 2024-04-18T14:43:26.079 INFO:teuthology.orchestra.run.smithi086.stdout: "bluestore_fsck_on_mkfs_deep": "false", 2024-04-18T14:43:26.079 INFO:teuthology.orchestra.run.smithi086.stdout: "bluestore_fsck_on_mount": "false", 2024-04-18T14:43:26.080 INFO:teuthology.orchestra.run.smithi086.stdout: "bluestore_fsck_on_mount_deep": "false", 2024-04-18T14:43:26.080 INFO:teuthology.orchestra.run.smithi086.stdout: "bluestore_fsck_on_umount": "false", 2024-04-18T14:43:26.080 INFO:teuthology.orchestra.run.smithi086.stdout: "bluestore_fsck_on_umount_deep": "false", 2024-04-18T14:43:26.080 INFO:teuthology.orchestra.run.smithi086.stdout: "bluestore_fsck_quick_fix_on_mount": "false", 2024-04-18T14:43:26.080 INFO:teuthology.orchestra.run.smithi086.stdout: "bluestore_fsck_quick_fix_threads": "2", 2024-04-18T14:43:26.080 INFO:teuthology.orchestra.run.smithi086.stdout: "bluestore_fsck_read_bytes_cap": "67108864", 2024-04-18T14:43:26.080 INFO:teuthology.orchestra.run.smithi086.stdout: "bluestore_fsck_shared_blob_tracker_size": "0.031250", 2024-04-18T14:43:26.080 INFO:teuthology.orchestra.run.smithi086.stdout: "bluestore_gc_enable_blob_threshold": "0", 2024-04-18T14:43:26.080 INFO:teuthology.orchestra.run.smithi086.stdout: "bluestore_gc_enable_total_threshold": "0", 2024-04-18T14:43:26.080 INFO:teuthology.orchestra.run.smithi086.stdout: "bluestore_hybrid_alloc_mem_cap": "67108864", 2024-04-18T14:43:26.080 INFO:teuthology.orchestra.run.smithi086.stdout: "bluestore_ignore_data_csum": "false", 2024-04-18T14:43:26.080 INFO:teuthology.orchestra.run.smithi086.stdout: "bluestore_kv_sync_util_logging_s": "10.000000", 2024-04-18T14:43:26.080 INFO:teuthology.orchestra.run.smithi086.stdout: "bluestore_kvbackend": "rocksdb", 2024-04-18T14:43:26.080 INFO:teuthology.orchestra.run.smithi086.stdout: "bluestore_log_collection_list_age": "60.000000", 2024-04-18T14:43:26.080 INFO:teuthology.orchestra.run.smithi086.stdout: "bluestore_log_omap_iterator_age": "5.000000", 2024-04-18T14:43:26.080 INFO:teuthology.orchestra.run.smithi086.stdout: "bluestore_log_op_age": "5.000000", 2024-04-18T14:43:26.081 INFO:teuthology.orchestra.run.smithi086.stdout: "bluestore_max_alloc_size": "0", 2024-04-18T14:43:26.081 INFO:teuthology.orchestra.run.smithi086.stdout: "bluestore_max_blob_size": "0", 2024-04-18T14:43:26.081 INFO:teuthology.orchestra.run.smithi086.stdout: "bluestore_max_blob_size_hdd": "65536", 2024-04-18T14:43:26.081 INFO:teuthology.orchestra.run.smithi086.stdout: "bluestore_max_blob_size_ssd": "65536", 2024-04-18T14:43:26.081 INFO:teuthology.orchestra.run.smithi086.stdout: "bluestore_max_defer_interval": "3.000000", 2024-04-18T14:43:26.081 INFO:teuthology.orchestra.run.smithi086.stdout: "bluestore_max_deferred_txc": "32", 2024-04-18T14:43:26.081 INFO:teuthology.orchestra.run.smithi086.stdout: "bluestore_min_alloc_size": "0", 2024-04-18T14:43:26.081 INFO:teuthology.orchestra.run.smithi086.stdout: "bluestore_min_alloc_size_hdd": "4096", 2024-04-18T14:43:26.081 INFO:teuthology.orchestra.run.smithi086.stdout: "bluestore_min_alloc_size_ssd": "4096", 2024-04-18T14:43:26.081 INFO:teuthology.orchestra.run.smithi086.stdout: "bluestore_nid_prealloc": "1024", 2024-04-18T14:43:26.081 INFO:teuthology.orchestra.run.smithi086.stdout: "bluestore_prefer_deferred_size": "0", 2024-04-18T14:43:26.081 INFO:teuthology.orchestra.run.smithi086.stdout: "bluestore_prefer_deferred_size_hdd": "65536", 2024-04-18T14:43:26.081 INFO:teuthology.orchestra.run.smithi086.stdout: "bluestore_prefer_deferred_size_ssd": "0", 2024-04-18T14:43:26.081 INFO:teuthology.orchestra.run.smithi086.stdout: "bluestore_qfsck_on_mount": "true", 2024-04-18T14:43:26.081 INFO:teuthology.orchestra.run.smithi086.stdout: "bluestore_retry_disk_reads": "3", 2024-04-18T14:43:26.082 INFO:teuthology.orchestra.run.smithi086.stdout: "bluestore_rocksdb_cf": "true", 2024-04-18T14:43:26.082 INFO:teuthology.orchestra.run.smithi086.stdout: "bluestore_rocksdb_cfs": "m(3) p(3,0-12) O(3,0-13)=block_cache={type=binned_lru} L=min_write_buffer_number_to_merge=32 P=min_write_buffer_number_to_merge=32", 2024-04-18T14:43:26.082 INFO:teuthology.orchestra.run.smithi086.stdout: "bluestore_rocksdb_options": "compression=kLZ4Compression,max_write_buffer_number=64,min_write_buffer_number_to_merge=6,compaction_style=kCompactionStyleLevel,write_buffer_size=16777216,max_background_jobs=4,level0_file_num_compaction_trigger=8,max_bytes_for_level_base=1073741824,max_bytes_for_level_multiplier=8,compaction_readahead_size=2MB,max_total_wal_size=1073741824,writable_file_max_buffer_size=0", 2024-04-18T14:43:26.082 INFO:teuthology.orchestra.run.smithi086.stdout: "bluestore_rocksdb_options_annex": "", 2024-04-18T14:43:26.082 INFO:teuthology.orchestra.run.smithi086.stdout: "bluestore_spdk_coremask": "0x1", 2024-04-18T14:43:26.082 INFO:teuthology.orchestra.run.smithi086.stdout: "bluestore_spdk_io_sleep": "5", 2024-04-18T14:43:26.082 INFO:teuthology.orchestra.run.smithi086.stdout: "bluestore_spdk_max_io_completion": "0", 2024-04-18T14:43:26.082 INFO:teuthology.orchestra.run.smithi086.stdout: "bluestore_spdk_mem": "512", 2024-04-18T14:43:26.082 INFO:teuthology.orchestra.run.smithi086.stdout: "bluestore_sync_submit_transaction": "false", 2024-04-18T14:43:26.082 INFO:teuthology.orchestra.run.smithi086.stdout: "bluestore_throttle_bytes": "67108864", 2024-04-18T14:43:26.082 INFO:teuthology.orchestra.run.smithi086.stdout: "bluestore_throttle_cost_per_io": "0", 2024-04-18T14:43:26.082 INFO:teuthology.orchestra.run.smithi086.stdout: "bluestore_throttle_cost_per_io_hdd": "670000", 2024-04-18T14:43:26.082 INFO:teuthology.orchestra.run.smithi086.stdout: "bluestore_throttle_cost_per_io_ssd": "4000", 2024-04-18T14:43:26.083 INFO:teuthology.orchestra.run.smithi086.stdout: "bluestore_throttle_deferred_bytes": "134217728", 2024-04-18T14:43:26.083 INFO:teuthology.orchestra.run.smithi086.stdout: "bluestore_throttle_trace_rate": "0.000000", 2024-04-18T14:43:26.083 INFO:teuthology.orchestra.run.smithi086.stdout: "bluestore_tracing": "false", 2024-04-18T14:43:26.083 INFO:teuthology.orchestra.run.smithi086.stdout: "bluestore_use_optimal_io_size_for_min_alloc_size": "false", 2024-04-18T14:43:26.083 INFO:teuthology.orchestra.run.smithi086.stdout: "bluestore_volume_selection_policy": "use_some_extra", 2024-04-18T14:43:26.083 INFO:teuthology.orchestra.run.smithi086.stdout: "bluestore_volume_selection_reserved": "0", 2024-04-18T14:43:26.083 INFO:teuthology.orchestra.run.smithi086.stdout: "bluestore_volume_selection_reserved_factor": "2.000000", 2024-04-18T14:43:26.083 INFO:teuthology.orchestra.run.smithi086.stdout: "bluestore_warn_on_bluefs_spillover": "true", 2024-04-18T14:43:26.083 INFO:teuthology.orchestra.run.smithi086.stdout: "bluestore_warn_on_legacy_statfs": "true", 2024-04-18T14:43:26.083 INFO:teuthology.orchestra.run.smithi086.stdout: "bluestore_warn_on_no_per_pg_omap": "false", 2024-04-18T14:43:26.083 INFO:teuthology.orchestra.run.smithi086.stdout: "bluestore_warn_on_no_per_pool_omap": "true", 2024-04-18T14:43:26.083 INFO:teuthology.orchestra.run.smithi086.stdout: "bluestore_warn_on_spurious_read_errors": "true", 2024-04-18T14:43:26.083 INFO:teuthology.orchestra.run.smithi086.stdout: "bluestore_zero_block_detection": "false", 2024-04-18T14:43:26.083 INFO:teuthology.orchestra.run.smithi086.stdout: "cephadm_path": "/usr/sbin/cephadm", 2024-04-18T14:43:26.083 INFO:teuthology.orchestra.run.smithi086.stdout: "cephfs_mirror_action_update_interval": "2", 2024-04-18T14:43:26.083 INFO:teuthology.orchestra.run.smithi086.stdout: "cephfs_mirror_directory_scan_interval": "10", 2024-04-18T14:43:26.084 INFO:teuthology.orchestra.run.smithi086.stdout: "cephfs_mirror_max_concurrent_directory_syncs": "3", 2024-04-18T14:43:26.084 INFO:teuthology.orchestra.run.smithi086.stdout: "cephfs_mirror_max_consecutive_failures_per_directory": "10", 2024-04-18T14:43:26.084 INFO:teuthology.orchestra.run.smithi086.stdout: "cephfs_mirror_max_snapshot_sync_per_cycle": "3", 2024-04-18T14:43:26.084 INFO:teuthology.orchestra.run.smithi086.stdout: "cephfs_mirror_mount_timeout": "10", 2024-04-18T14:43:26.084 INFO:teuthology.orchestra.run.smithi086.stdout: "cephfs_mirror_perf_stats_prio": "5", 2024-04-18T14:43:26.084 INFO:teuthology.orchestra.run.smithi086.stdout: "cephfs_mirror_restart_mirror_on_blocklist_interval": "30", 2024-04-18T14:43:26.084 INFO:teuthology.orchestra.run.smithi086.stdout: "cephfs_mirror_restart_mirror_on_failure_interval": "20", 2024-04-18T14:43:26.084 INFO:teuthology.orchestra.run.smithi086.stdout: "cephfs_mirror_retry_failed_directories_interval": "60", 2024-04-18T14:43:26.084 INFO:teuthology.orchestra.run.smithi086.stdout: "cephsqlite_blocklist_dead_locker": "true", 2024-04-18T14:43:26.085 INFO:teuthology.orchestra.run.smithi086.stdout: "cephsqlite_lock_renewal_interval": "2000", 2024-04-18T14:43:26.085 INFO:teuthology.orchestra.run.smithi086.stdout: "cephsqlite_lock_renewal_timeout": "30000", 2024-04-18T14:43:26.085 INFO:teuthology.orchestra.run.smithi086.stdout: "cephx_cluster_require_signatures": "false", 2024-04-18T14:43:26.085 INFO:teuthology.orchestra.run.smithi086.stdout: "cephx_cluster_require_version": "2", 2024-04-18T14:43:26.085 INFO:teuthology.orchestra.run.smithi086.stdout: "cephx_require_signatures": "false", 2024-04-18T14:43:26.085 INFO:teuthology.orchestra.run.smithi086.stdout: "cephx_require_version": "2", 2024-04-18T14:43:26.085 INFO:teuthology.orchestra.run.smithi086.stdout: "cephx_service_require_signatures": "false", 2024-04-18T14:43:26.085 INFO:teuthology.orchestra.run.smithi086.stdout: "cephx_service_require_version": "2", 2024-04-18T14:43:26.085 INFO:teuthology.orchestra.run.smithi086.stdout: "cephx_sign_messages": "true", 2024-04-18T14:43:26.085 INFO:teuthology.orchestra.run.smithi086.stdout: "chdir": "", 2024-04-18T14:43:26.085 INFO:teuthology.orchestra.run.smithi086.stdout: "client_acl_type": "", 2024-04-18T14:43:26.085 INFO:teuthology.orchestra.run.smithi086.stdout: "client_asio_thread_count": "2", 2024-04-18T14:43:26.085 INFO:teuthology.orchestra.run.smithi086.stdout: "client_cache_mid": "0.750000", 2024-04-18T14:43:26.085 INFO:teuthology.orchestra.run.smithi086.stdout: "client_cache_size": "16384", 2024-04-18T14:43:26.085 INFO:teuthology.orchestra.run.smithi086.stdout: "client_caps_release_delay": "5", 2024-04-18T14:43:26.086 INFO:teuthology.orchestra.run.smithi086.stdout: "client_check_pool_perm": "true", 2024-04-18T14:43:26.086 INFO:teuthology.orchestra.run.smithi086.stdout: "client_collect_and_send_global_metrics": "false", 2024-04-18T14:43:26.086 INFO:teuthology.orchestra.run.smithi086.stdout: "client_debug_force_sync_read": "false", 2024-04-18T14:43:26.086 INFO:teuthology.orchestra.run.smithi086.stdout: "client_debug_getattr_caps": "false", 2024-04-18T14:43:26.086 INFO:teuthology.orchestra.run.smithi086.stdout: "client_debug_inject_tick_delay": "0", 2024-04-18T14:43:26.086 INFO:teuthology.orchestra.run.smithi086.stdout: "client_die_on_failed_dentry_invalidate": "true", 2024-04-18T14:43:26.086 INFO:teuthology.orchestra.run.smithi086.stdout: "client_die_on_failed_remount": "false", 2024-04-18T14:43:26.086 INFO:teuthology.orchestra.run.smithi086.stdout: "client_dirsize_rbytes": "true", 2024-04-18T14:43:26.086 INFO:teuthology.orchestra.run.smithi086.stdout: "client_force_lazyio": "false", 2024-04-18T14:43:26.086 INFO:teuthology.orchestra.run.smithi086.stdout: "client_fs": "", 2024-04-18T14:43:26.086 INFO:teuthology.orchestra.run.smithi086.stdout: "client_inject_fixed_oldest_tid": "false", 2024-04-18T14:43:26.086 INFO:teuthology.orchestra.run.smithi086.stdout: "client_inject_release_failure": "false", 2024-04-18T14:43:26.086 INFO:teuthology.orchestra.run.smithi086.stdout: "client_max_inline_size": "4096", 2024-04-18T14:43:26.086 INFO:teuthology.orchestra.run.smithi086.stdout: "client_max_retries_on_remount_failure": "5", 2024-04-18T14:43:26.086 INFO:teuthology.orchestra.run.smithi086.stdout: "client_mds_namespace": "", 2024-04-18T14:43:26.087 INFO:teuthology.orchestra.run.smithi086.stdout: "client_metadata": "", 2024-04-18T14:43:26.087 INFO:teuthology.orchestra.run.smithi086.stdout: "client_mount_gid": "-1", 2024-04-18T14:43:26.087 INFO:teuthology.orchestra.run.smithi086.stdout: "client_mount_timeout": "300", 2024-04-18T14:43:26.087 INFO:teuthology.orchestra.run.smithi086.stdout: "client_mount_uid": "-1", 2024-04-18T14:43:26.087 INFO:teuthology.orchestra.run.smithi086.stdout: "client_mountpoint": "/", 2024-04-18T14:43:26.087 INFO:teuthology.orchestra.run.smithi086.stdout: "client_notify_timeout": "10", 2024-04-18T14:43:26.087 INFO:teuthology.orchestra.run.smithi086.stdout: "client_oc": "true", 2024-04-18T14:43:26.087 INFO:teuthology.orchestra.run.smithi086.stdout: "client_oc_max_dirty": "104857600", 2024-04-18T14:43:26.087 INFO:teuthology.orchestra.run.smithi086.stdout: "client_oc_max_dirty_age": "5.000000", 2024-04-18T14:43:26.087 INFO:teuthology.orchestra.run.smithi086.stdout: "client_oc_max_objects": "1000", 2024-04-18T14:43:26.087 INFO:teuthology.orchestra.run.smithi086.stdout: "client_oc_size": "209715200", 2024-04-18T14:43:26.087 INFO:teuthology.orchestra.run.smithi086.stdout: "client_oc_target_dirty": "8388608", 2024-04-18T14:43:26.087 INFO:teuthology.orchestra.run.smithi086.stdout: "client_permissions": "true", 2024-04-18T14:43:26.088 INFO:teuthology.orchestra.run.smithi086.stdout: "client_quota": "true", 2024-04-18T14:43:26.088 INFO:teuthology.orchestra.run.smithi086.stdout: "client_quota_df": "true", 2024-04-18T14:43:26.088 INFO:teuthology.orchestra.run.smithi086.stdout: "client_readahead_max_bytes": "0", 2024-04-18T14:43:26.088 INFO:teuthology.orchestra.run.smithi086.stdout: "client_readahead_max_periods": "4", 2024-04-18T14:43:26.088 INFO:teuthology.orchestra.run.smithi086.stdout: "client_readahead_min": "131072", 2024-04-18T14:43:26.088 INFO:teuthology.orchestra.run.smithi086.stdout: "client_reconnect_stale": "false", 2024-04-18T14:43:26.088 INFO:teuthology.orchestra.run.smithi086.stdout: "client_shutdown_timeout": "30", 2024-04-18T14:43:26.088 INFO:teuthology.orchestra.run.smithi086.stdout: "client_snapdir": ".snap", 2024-04-18T14:43:26.088 INFO:teuthology.orchestra.run.smithi086.stdout: "client_tick_interval": "1", 2024-04-18T14:43:26.088 INFO:teuthology.orchestra.run.smithi086.stdout: "client_trace": "", 2024-04-18T14:43:26.088 INFO:teuthology.orchestra.run.smithi086.stdout: "client_try_dentry_invalidate": "false", 2024-04-18T14:43:26.088 INFO:teuthology.orchestra.run.smithi086.stdout: "client_use_faked_inos": "false", 2024-04-18T14:43:26.088 INFO:teuthology.orchestra.run.smithi086.stdout: "client_use_random_mds": "false", 2024-04-18T14:43:26.089 INFO:teuthology.orchestra.run.smithi086.stdout: "clog_to_graylog": "false", 2024-04-18T14:43:26.089 INFO:teuthology.orchestra.run.smithi086.stdout: "clog_to_graylog_host": "127.0.0.1", 2024-04-18T14:43:26.089 INFO:teuthology.orchestra.run.smithi086.stdout: "clog_to_graylog_port": "12201", 2024-04-18T14:43:26.089 INFO:teuthology.orchestra.run.smithi086.stdout: "clog_to_monitors": "default=true", 2024-04-18T14:43:26.089 INFO:teuthology.orchestra.run.smithi086.stdout: "clog_to_syslog": "false", 2024-04-18T14:43:26.089 INFO:teuthology.orchestra.run.smithi086.stdout: "clog_to_syslog_facility": "default=daemon audit=local0", 2024-04-18T14:43:26.089 INFO:teuthology.orchestra.run.smithi086.stdout: "clog_to_syslog_level": "info", 2024-04-18T14:43:26.089 INFO:teuthology.orchestra.run.smithi086.stdout: "cluster_addr": "-", 2024-04-18T14:43:26.089 INFO:teuthology.orchestra.run.smithi086.stdout: "cluster_network": "", 2024-04-18T14:43:26.089 INFO:teuthology.orchestra.run.smithi086.stdout: "cluster_network_interface": "", 2024-04-18T14:43:26.089 INFO:teuthology.orchestra.run.smithi086.stdout: "compressor_zlib_isal": "false", 2024-04-18T14:43:26.089 INFO:teuthology.orchestra.run.smithi086.stdout: "compressor_zlib_level": "5", 2024-04-18T14:43:26.089 INFO:teuthology.orchestra.run.smithi086.stdout: "compressor_zlib_winsize": "-15", 2024-04-18T14:43:26.089 INFO:teuthology.orchestra.run.smithi086.stdout: "compressor_zstd_level": "1", 2024-04-18T14:43:26.089 INFO:teuthology.orchestra.run.smithi086.stdout: "container_image": "docker.io/ceph/daemon-base:latest-master-devel", 2024-04-18T14:43:26.089 INFO:teuthology.orchestra.run.smithi086.stdout: "crash_dir": "/var/lib/ceph/crash", 2024-04-18T14:43:26.090 INFO:teuthology.orchestra.run.smithi086.stdout: "crimson_alien_op_num_threads": "6", 2024-04-18T14:43:26.090 INFO:teuthology.orchestra.run.smithi086.stdout: "crimson_alien_thread_cpu_cores": "", 2024-04-18T14:43:26.090 INFO:teuthology.orchestra.run.smithi086.stdout: "crimson_osd_obc_lru_size": "10", 2024-04-18T14:43:26.090 INFO:teuthology.orchestra.run.smithi086.stdout: "crimson_osd_scheduler_concurrency": "0", 2024-04-18T14:43:26.090 INFO:teuthology.orchestra.run.smithi086.stdout: "crimson_seastar_smp": "1", 2024-04-18T14:43:26.090 INFO:teuthology.orchestra.run.smithi086.stdout: "crush_location": "", 2024-04-18T14:43:26.090 INFO:teuthology.orchestra.run.smithi086.stdout: "crush_location_hook": "", 2024-04-18T14:43:26.090 INFO:teuthology.orchestra.run.smithi086.stdout: "crush_location_hook_timeout": "10", 2024-04-18T14:43:26.090 INFO:teuthology.orchestra.run.smithi086.stdout: "daemonize": "false", 2024-04-18T14:43:26.090 INFO:teuthology.orchestra.run.smithi086.stdout: "daos_pool": "tank", 2024-04-18T14:43:26.090 INFO:teuthology.orchestra.run.smithi086.stdout: "dbstore_config_uri": "file:/var/lib/ceph/radosgw/dbstore-config.db", 2024-04-18T14:43:26.090 INFO:teuthology.orchestra.run.smithi086.stdout: "dbstore_db_dir": "/var/lib/ceph/radosgw", 2024-04-18T14:43:26.090 INFO:teuthology.orchestra.run.smithi086.stdout: "dbstore_db_name_prefix": "dbstore", 2024-04-18T14:43:26.090 INFO:teuthology.orchestra.run.smithi086.stdout: "debug_alienstore": "0/5", 2024-04-18T14:43:26.090 INFO:teuthology.orchestra.run.smithi086.stdout: "debug_allow_any_pool_priority": "false", 2024-04-18T14:43:26.091 INFO:teuthology.orchestra.run.smithi086.stdout: "debug_asok": "1/5", 2024-04-18T14:43:26.091 INFO:teuthology.orchestra.run.smithi086.stdout: "debug_asok_assert_abort": "false", 2024-04-18T14:43:26.091 INFO:teuthology.orchestra.run.smithi086.stdout: "debug_asserts_on_shutdown": "true", 2024-04-18T14:43:26.091 INFO:teuthology.orchestra.run.smithi086.stdout: "debug_auth": "20/20", 2024-04-18T14:43:26.091 INFO:teuthology.orchestra.run.smithi086.stdout: "debug_bdev": "1/3", 2024-04-18T14:43:26.091 INFO:teuthology.orchestra.run.smithi086.stdout: "debug_bluefs": "1/5", 2024-04-18T14:43:26.091 INFO:teuthology.orchestra.run.smithi086.stdout: "debug_bluestore": "1/5", 2024-04-18T14:43:26.091 INFO:teuthology.orchestra.run.smithi086.stdout: "debug_buffer": "0/1", 2024-04-18T14:43:26.091 INFO:teuthology.orchestra.run.smithi086.stdout: "debug_ceph_exporter": "1/5", 2024-04-18T14:43:26.091 INFO:teuthology.orchestra.run.smithi086.stdout: "debug_cephfs_mirror": "0/5", 2024-04-18T14:43:26.091 INFO:teuthology.orchestra.run.smithi086.stdout: "debug_cephsqlite": "0/5", 2024-04-18T14:43:26.091 INFO:teuthology.orchestra.run.smithi086.stdout: "debug_client": "0/5", 2024-04-18T14:43:26.091 INFO:teuthology.orchestra.run.smithi086.stdout: "debug_compressor": "1/5", 2024-04-18T14:43:26.091 INFO:teuthology.orchestra.run.smithi086.stdout: "debug_context": "0/1", 2024-04-18T14:43:26.091 INFO:teuthology.orchestra.run.smithi086.stdout: "debug_crush": "1/1", 2024-04-18T14:43:26.092 INFO:teuthology.orchestra.run.smithi086.stdout: "debug_crypto": "1/5", 2024-04-18T14:43:26.092 INFO:teuthology.orchestra.run.smithi086.stdout: "debug_cyanstore": "0/5", 2024-04-18T14:43:26.092 INFO:teuthology.orchestra.run.smithi086.stdout: "debug_deliberately_leak_memory": "false", 2024-04-18T14:43:26.092 INFO:teuthology.orchestra.run.smithi086.stdout: "debug_disable_randomized_ping": "false", 2024-04-18T14:43:26.092 INFO:teuthology.orchestra.run.smithi086.stdout: "debug_dpdk": "1/5", 2024-04-18T14:43:26.092 INFO:teuthology.orchestra.run.smithi086.stdout: "debug_eventtrace": "1/5", 2024-04-18T14:43:26.092 INFO:teuthology.orchestra.run.smithi086.stdout: "debug_filer": "0/1", 2024-04-18T14:43:26.092 INFO:teuthology.orchestra.run.smithi086.stdout: "debug_filestore": "1/3", 2024-04-18T14:43:26.092 INFO:teuthology.orchestra.run.smithi086.stdout: "debug_finisher": "1/1", 2024-04-18T14:43:26.092 INFO:teuthology.orchestra.run.smithi086.stdout: "debug_fuse": "1/5", 2024-04-18T14:43:26.092 INFO:teuthology.orchestra.run.smithi086.stdout: "debug_heartbeat_testing_span": "0", 2024-04-18T14:43:26.092 INFO:teuthology.orchestra.run.smithi086.stdout: "debug_heartbeatmap": "1/5", 2024-04-18T14:43:26.092 INFO:teuthology.orchestra.run.smithi086.stdout: "debug_immutable_obj_cache": "0/5", 2024-04-18T14:43:26.092 INFO:teuthology.orchestra.run.smithi086.stdout: "debug_javaclient": "1/5", 2024-04-18T14:43:26.092 INFO:teuthology.orchestra.run.smithi086.stdout: "debug_journal": "1/3", 2024-04-18T14:43:26.093 INFO:teuthology.orchestra.run.smithi086.stdout: "debug_journaler": "0/5", 2024-04-18T14:43:26.093 INFO:teuthology.orchestra.run.smithi086.stdout: "debug_kstore": "1/5", 2024-04-18T14:43:26.093 INFO:teuthology.orchestra.run.smithi086.stdout: "debug_leveldb": "4/5", 2024-04-18T14:43:26.093 INFO:teuthology.orchestra.run.smithi086.stdout: "debug_lockdep": "0/1", 2024-04-18T14:43:26.093 INFO:teuthology.orchestra.run.smithi086.stdout: "debug_mclock": "1/5", 2024-04-18T14:43:26.093 INFO:teuthology.orchestra.run.smithi086.stdout: "debug_mds": "1/5", 2024-04-18T14:43:26.093 INFO:teuthology.orchestra.run.smithi086.stdout: "debug_mds_balancer": "1/5", 2024-04-18T14:43:26.093 INFO:teuthology.orchestra.run.smithi086.stdout: "debug_mds_locker": "1/5", 2024-04-18T14:43:26.093 INFO:teuthology.orchestra.run.smithi086.stdout: "debug_mds_log": "1/5", 2024-04-18T14:43:26.093 INFO:teuthology.orchestra.run.smithi086.stdout: "debug_mds_log_expire": "1/5", 2024-04-18T14:43:26.093 INFO:teuthology.orchestra.run.smithi086.stdout: "debug_mds_migrator": "1/5", 2024-04-18T14:43:26.093 INFO:teuthology.orchestra.run.smithi086.stdout: "debug_memstore": "1/5", 2024-04-18T14:43:26.093 INFO:teuthology.orchestra.run.smithi086.stdout: "debug_mgr": "2/5", 2024-04-18T14:43:26.094 INFO:teuthology.orchestra.run.smithi086.stdout: "debug_mgrc": "1/5", 2024-04-18T14:43:26.094 INFO:teuthology.orchestra.run.smithi086.stdout: "debug_mon": "20/20", 2024-04-18T14:43:26.094 INFO:teuthology.orchestra.run.smithi086.stdout: "debug_monc": "0/10", 2024-04-18T14:43:26.094 INFO:teuthology.orchestra.run.smithi086.stdout: "debug_ms": "1/1", 2024-04-18T14:43:26.094 INFO:teuthology.orchestra.run.smithi086.stdout: "debug_none": "0/5", 2024-04-18T14:43:26.094 INFO:teuthology.orchestra.run.smithi086.stdout: "debug_objclass": "0/5", 2024-04-18T14:43:26.094 INFO:teuthology.orchestra.run.smithi086.stdout: "debug_objectcacher": "0/5", 2024-04-18T14:43:26.094 INFO:teuthology.orchestra.run.smithi086.stdout: "debug_objecter": "0/1", 2024-04-18T14:43:26.094 INFO:teuthology.orchestra.run.smithi086.stdout: "debug_optracker": "0/5", 2024-04-18T14:43:26.094 INFO:teuthology.orchestra.run.smithi086.stdout: "debug_osd": "1/5", 2024-04-18T14:43:26.094 INFO:teuthology.orchestra.run.smithi086.stdout: "debug_paxos": "20/20", 2024-04-18T14:43:26.094 INFO:teuthology.orchestra.run.smithi086.stdout: "debug_perfcounter": "1/5", 2024-04-18T14:43:26.094 INFO:teuthology.orchestra.run.smithi086.stdout: "debug_prioritycache": "1/5", 2024-04-18T14:43:26.094 INFO:teuthology.orchestra.run.smithi086.stdout: "debug_rados": "0/5", 2024-04-18T14:43:26.094 INFO:teuthology.orchestra.run.smithi086.stdout: "debug_rbd": "0/5", 2024-04-18T14:43:26.095 INFO:teuthology.orchestra.run.smithi086.stdout: "debug_rbd_mirror": "0/5", 2024-04-18T14:43:26.095 INFO:teuthology.orchestra.run.smithi086.stdout: "debug_rbd_pwl": "0/5", 2024-04-18T14:43:26.095 INFO:teuthology.orchestra.run.smithi086.stdout: "debug_rbd_replay": "0/5", 2024-04-18T14:43:26.095 INFO:teuthology.orchestra.run.smithi086.stdout: "debug_refs": "0/0", 2024-04-18T14:43:26.095 INFO:teuthology.orchestra.run.smithi086.stdout: "debug_reserver": "1/1", 2024-04-18T14:43:26.095 INFO:teuthology.orchestra.run.smithi086.stdout: "debug_rgw": "1/5", 2024-04-18T14:43:26.095 INFO:teuthology.orchestra.run.smithi086.stdout: "debug_rgw_access": "1/5", 2024-04-18T14:43:26.095 INFO:teuthology.orchestra.run.smithi086.stdout: "debug_rgw_datacache": "1/5", 2024-04-18T14:43:26.095 INFO:teuthology.orchestra.run.smithi086.stdout: "debug_rgw_dbstore": "1/5", 2024-04-18T14:43:26.095 INFO:teuthology.orchestra.run.smithi086.stdout: "debug_rgw_flight": "1/5", 2024-04-18T14:43:26.095 INFO:teuthology.orchestra.run.smithi086.stdout: "debug_rgw_sync": "1/5", 2024-04-18T14:43:26.095 INFO:teuthology.orchestra.run.smithi086.stdout: "debug_rocksdb": "4/5", 2024-04-18T14:43:26.095 INFO:teuthology.orchestra.run.smithi086.stdout: "debug_seastore": "0/5", 2024-04-18T14:43:26.095 INFO:teuthology.orchestra.run.smithi086.stdout: "debug_seastore_backref": "0/5", 2024-04-18T14:43:26.095 INFO:teuthology.orchestra.run.smithi086.stdout: "debug_seastore_cache": "0/5", 2024-04-18T14:43:26.096 INFO:teuthology.orchestra.run.smithi086.stdout: "debug_seastore_cleaner": "0/5", 2024-04-18T14:43:26.096 INFO:teuthology.orchestra.run.smithi086.stdout: "debug_seastore_device": "0/5", 2024-04-18T14:43:26.096 INFO:teuthology.orchestra.run.smithi086.stdout: "debug_seastore_epm": "0/5", 2024-04-18T14:43:26.096 INFO:teuthology.orchestra.run.smithi086.stdout: "debug_seastore_fixedkv_tree": "0/5", 2024-04-18T14:43:26.096 INFO:teuthology.orchestra.run.smithi086.stdout: "debug_seastore_journal": "0/5", 2024-04-18T14:43:26.096 INFO:teuthology.orchestra.run.smithi086.stdout: "debug_seastore_lba": "0/5", 2024-04-18T14:43:26.096 INFO:teuthology.orchestra.run.smithi086.stdout: "debug_seastore_odata": "0/5", 2024-04-18T14:43:26.096 INFO:teuthology.orchestra.run.smithi086.stdout: "debug_seastore_omap": "0/5", 2024-04-18T14:43:26.096 INFO:teuthology.orchestra.run.smithi086.stdout: "debug_seastore_onode": "0/5", 2024-04-18T14:43:26.096 INFO:teuthology.orchestra.run.smithi086.stdout: "debug_seastore_t": "0/5", 2024-04-18T14:43:26.096 INFO:teuthology.orchestra.run.smithi086.stdout: "debug_seastore_tm": "0/5", 2024-04-18T14:43:26.096 INFO:teuthology.orchestra.run.smithi086.stdout: "debug_striper": "0/1", 2024-04-18T14:43:26.096 INFO:teuthology.orchestra.run.smithi086.stdout: "debug_test": "0/5", 2024-04-18T14:43:26.096 INFO:teuthology.orchestra.run.smithi086.stdout: "debug_throttle": "1/1", 2024-04-18T14:43:26.096 INFO:teuthology.orchestra.run.smithi086.stdout: "debug_timer": "0/1", 2024-04-18T14:43:26.097 INFO:teuthology.orchestra.run.smithi086.stdout: "debug_tp": "0/5", 2024-04-18T14:43:26.097 INFO:teuthology.orchestra.run.smithi086.stdout: "defer_client_eviction_on_laggy_osds": "false", 2024-04-18T14:43:26.097 INFO:teuthology.orchestra.run.smithi086.stdout: "device_failure_prediction_mode": "none", 2024-04-18T14:43:26.097 INFO:teuthology.orchestra.run.smithi086.stdout: "enable_experimental_unrecoverable_data_corrupting_features": "", 2024-04-18T14:43:26.097 INFO:teuthology.orchestra.run.smithi086.stdout: "erasure_code_dir": "/usr/lib/ceph/erasure-code", 2024-04-18T14:43:26.097 INFO:teuthology.orchestra.run.smithi086.stdout: "err_to_graylog": "false", 2024-04-18T14:43:26.097 INFO:teuthology.orchestra.run.smithi086.stdout: "err_to_journald": "false", 2024-04-18T14:43:26.097 INFO:teuthology.orchestra.run.smithi086.stdout: "err_to_stderr": "true", 2024-04-18T14:43:26.097 INFO:teuthology.orchestra.run.smithi086.stdout: "err_to_syslog": "false", 2024-04-18T14:43:26.097 INFO:teuthology.orchestra.run.smithi086.stdout: "event_tracing": "false", 2024-04-18T14:43:26.097 INFO:teuthology.orchestra.run.smithi086.stdout: "exporter_addr": "0.0.0.0", 2024-04-18T14:43:26.097 INFO:teuthology.orchestra.run.smithi086.stdout: "exporter_http_port": "9926", 2024-04-18T14:43:26.097 INFO:teuthology.orchestra.run.smithi086.stdout: "exporter_prio_limit": "5", 2024-04-18T14:43:26.097 INFO:teuthology.orchestra.run.smithi086.stdout: "exporter_sock_dir": "/var/run/ceph/", 2024-04-18T14:43:26.097 INFO:teuthology.orchestra.run.smithi086.stdout: "exporter_sort_metrics": "true", 2024-04-18T14:43:26.098 INFO:teuthology.orchestra.run.smithi086.stdout: "exporter_stats_period": "5", 2024-04-18T14:43:26.098 INFO:teuthology.orchestra.run.smithi086.stdout: "fake_statfs_for_testing": "0", 2024-04-18T14:43:26.098 INFO:teuthology.orchestra.run.smithi086.stdout: "fatal_signal_handlers": "true", 2024-04-18T14:43:26.098 INFO:teuthology.orchestra.run.smithi086.stdout: "filer_max_purge_ops": "10", 2024-04-18T14:43:26.098 INFO:teuthology.orchestra.run.smithi086.stdout: "filer_max_truncate_ops": "128", 2024-04-18T14:43:26.098 INFO:teuthology.orchestra.run.smithi086.stdout: "filestore_apply_finisher_threads": "1", 2024-04-18T14:43:26.098 INFO:teuthology.orchestra.run.smithi086.stdout: "filestore_blackhole": "false", 2024-04-18T14:43:26.098 INFO:teuthology.orchestra.run.smithi086.stdout: "filestore_btrfs_clone_range": "true", 2024-04-18T14:43:26.098 INFO:teuthology.orchestra.run.smithi086.stdout: "filestore_btrfs_snap": "true", 2024-04-18T14:43:26.098 INFO:teuthology.orchestra.run.smithi086.stdout: "filestore_caller_concurrency": "10", 2024-04-18T14:43:26.098 INFO:teuthology.orchestra.run.smithi086.stdout: "filestore_collect_device_partition_information": "true", 2024-04-18T14:43:26.098 INFO:teuthology.orchestra.run.smithi086.stdout: "filestore_commit_timeout": "600.000000", 2024-04-18T14:43:26.098 INFO:teuthology.orchestra.run.smithi086.stdout: "filestore_debug_inject_read_err": "false", 2024-04-18T14:43:26.098 INFO:teuthology.orchestra.run.smithi086.stdout: "filestore_debug_omap_check": "false", 2024-04-18T14:43:26.099 INFO:teuthology.orchestra.run.smithi086.stdout: "filestore_debug_random_read_err": "0.000000", 2024-04-18T14:43:26.099 INFO:teuthology.orchestra.run.smithi086.stdout: "filestore_debug_verify_split": "false", 2024-04-18T14:43:26.099 INFO:teuthology.orchestra.run.smithi086.stdout: "filestore_dump_file": "", 2024-04-18T14:43:26.099 INFO:teuthology.orchestra.run.smithi086.stdout: "filestore_expected_throughput_bytes": "209715200.000000", 2024-04-18T14:43:26.099 INFO:teuthology.orchestra.run.smithi086.stdout: "filestore_expected_throughput_ops": "200.000000", 2024-04-18T14:43:26.099 INFO:teuthology.orchestra.run.smithi086.stdout: "filestore_fadvise": "true", 2024-04-18T14:43:26.099 INFO:teuthology.orchestra.run.smithi086.stdout: "filestore_fail_eio": "true", 2024-04-18T14:43:26.099 INFO:teuthology.orchestra.run.smithi086.stdout: "filestore_fd_cache_shards": "16", 2024-04-18T14:43:26.099 INFO:teuthology.orchestra.run.smithi086.stdout: "filestore_fd_cache_size": "128", 2024-04-18T14:43:26.099 INFO:teuthology.orchestra.run.smithi086.stdout: "filestore_fiemap": "false", 2024-04-18T14:43:26.099 INFO:teuthology.orchestra.run.smithi086.stdout: "filestore_fiemap_threshold": "4096", 2024-04-18T14:43:26.099 INFO:teuthology.orchestra.run.smithi086.stdout: "filestore_fsync_flushes_journal_data": "false", 2024-04-18T14:43:26.099 INFO:teuthology.orchestra.run.smithi086.stdout: "filestore_index_retry_probability": "0.000000", 2024-04-18T14:43:26.099 INFO:teuthology.orchestra.run.smithi086.stdout: "filestore_inject_stall": "0", 2024-04-18T14:43:26.099 INFO:teuthology.orchestra.run.smithi086.stdout: "filestore_journal_parallel": "false", 2024-04-18T14:43:26.099 INFO:teuthology.orchestra.run.smithi086.stdout: "filestore_journal_trailing": "false", 2024-04-18T14:43:26.100 INFO:teuthology.orchestra.run.smithi086.stdout: "filestore_journal_writeahead": "false", 2024-04-18T14:43:26.100 INFO:teuthology.orchestra.run.smithi086.stdout: "filestore_kill_at": "0", 2024-04-18T14:43:26.100 INFO:teuthology.orchestra.run.smithi086.stdout: "filestore_max_alloc_hint_size": "1048576", 2024-04-18T14:43:26.100 INFO:teuthology.orchestra.run.smithi086.stdout: "filestore_max_inline_xattr_size": "0", 2024-04-18T14:43:26.100 INFO:teuthology.orchestra.run.smithi086.stdout: "filestore_max_inline_xattr_size_btrfs": "2048", 2024-04-18T14:43:26.100 INFO:teuthology.orchestra.run.smithi086.stdout: "filestore_max_inline_xattr_size_other": "512", 2024-04-18T14:43:26.100 INFO:teuthology.orchestra.run.smithi086.stdout: "filestore_max_inline_xattr_size_xfs": "65536", 2024-04-18T14:43:26.100 INFO:teuthology.orchestra.run.smithi086.stdout: "filestore_max_inline_xattrs": "0", 2024-04-18T14:43:26.100 INFO:teuthology.orchestra.run.smithi086.stdout: "filestore_max_inline_xattrs_btrfs": "10", 2024-04-18T14:43:26.100 INFO:teuthology.orchestra.run.smithi086.stdout: "filestore_max_inline_xattrs_other": "2", 2024-04-18T14:43:26.100 INFO:teuthology.orchestra.run.smithi086.stdout: "filestore_max_inline_xattrs_xfs": "10", 2024-04-18T14:43:26.100 INFO:teuthology.orchestra.run.smithi086.stdout: "filestore_max_sync_interval": "5.000000", 2024-04-18T14:43:26.100 INFO:teuthology.orchestra.run.smithi086.stdout: "filestore_max_xattr_value_size": "0", 2024-04-18T14:43:26.100 INFO:teuthology.orchestra.run.smithi086.stdout: "filestore_max_xattr_value_size_btrfs": "65536", 2024-04-18T14:43:26.100 INFO:teuthology.orchestra.run.smithi086.stdout: "filestore_max_xattr_value_size_other": "1024", 2024-04-18T14:43:26.101 INFO:teuthology.orchestra.run.smithi086.stdout: "filestore_max_xattr_value_size_xfs": "65536", 2024-04-18T14:43:26.101 INFO:teuthology.orchestra.run.smithi086.stdout: "filestore_merge_threshold": "-10", 2024-04-18T14:43:26.101 INFO:teuthology.orchestra.run.smithi086.stdout: "filestore_min_sync_interval": "0.010000", 2024-04-18T14:43:26.101 INFO:teuthology.orchestra.run.smithi086.stdout: "filestore_odsync_write": "false", 2024-04-18T14:43:26.101 INFO:teuthology.orchestra.run.smithi086.stdout: "filestore_omap_backend": "rocksdb", 2024-04-18T14:43:26.101 INFO:teuthology.orchestra.run.smithi086.stdout: "filestore_omap_backend_path": "", 2024-04-18T14:43:26.101 INFO:teuthology.orchestra.run.smithi086.stdout: "filestore_omap_header_cache_size": "1024", 2024-04-18T14:43:26.101 INFO:teuthology.orchestra.run.smithi086.stdout: "filestore_ondisk_finisher_threads": "1", 2024-04-18T14:43:26.101 INFO:teuthology.orchestra.run.smithi086.stdout: "filestore_op_thread_suicide_timeout": "180", 2024-04-18T14:43:26.101 INFO:teuthology.orchestra.run.smithi086.stdout: "filestore_op_thread_timeout": "60", 2024-04-18T14:43:26.101 INFO:teuthology.orchestra.run.smithi086.stdout: "filestore_op_threads": "2", 2024-04-18T14:43:26.101 INFO:teuthology.orchestra.run.smithi086.stdout: "filestore_punch_hole": "false", 2024-04-18T14:43:26.101 INFO:teuthology.orchestra.run.smithi086.stdout: "filestore_queue_high_delay_multiple": "0.000000", 2024-04-18T14:43:26.101 INFO:teuthology.orchestra.run.smithi086.stdout: "filestore_queue_high_delay_multiple_bytes": "0.000000", 2024-04-18T14:43:26.101 INFO:teuthology.orchestra.run.smithi086.stdout: "filestore_queue_high_delay_multiple_ops": "0.000000", 2024-04-18T14:43:26.101 INFO:teuthology.orchestra.run.smithi086.stdout: "filestore_queue_high_threshhold": "0.900000", 2024-04-18T14:43:26.102 INFO:teuthology.orchestra.run.smithi086.stdout: "filestore_queue_low_threshhold": "0.300000", 2024-04-18T14:43:26.102 INFO:teuthology.orchestra.run.smithi086.stdout: "filestore_queue_max_bytes": "104857600", 2024-04-18T14:43:26.102 INFO:teuthology.orchestra.run.smithi086.stdout: "filestore_queue_max_delay_multiple": "0.000000", 2024-04-18T14:43:26.102 INFO:teuthology.orchestra.run.smithi086.stdout: "filestore_queue_max_delay_multiple_bytes": "0.000000", 2024-04-18T14:43:26.102 INFO:teuthology.orchestra.run.smithi086.stdout: "filestore_queue_max_delay_multiple_ops": "0.000000", 2024-04-18T14:43:26.102 INFO:teuthology.orchestra.run.smithi086.stdout: "filestore_queue_max_ops": "50", 2024-04-18T14:43:26.102 INFO:teuthology.orchestra.run.smithi086.stdout: "filestore_rocksdb_options": "max_background_jobs=10,compaction_readahead_size=2097152,compression=kNoCompression", 2024-04-18T14:43:26.102 INFO:teuthology.orchestra.run.smithi086.stdout: "filestore_seek_data_hole": "false", 2024-04-18T14:43:26.102 INFO:teuthology.orchestra.run.smithi086.stdout: "filestore_sloppy_crc": "false", 2024-04-18T14:43:26.102 INFO:teuthology.orchestra.run.smithi086.stdout: "filestore_sloppy_crc_block_size": "65536", 2024-04-18T14:43:26.102 INFO:teuthology.orchestra.run.smithi086.stdout: "filestore_splice": "false", 2024-04-18T14:43:26.102 INFO:teuthology.orchestra.run.smithi086.stdout: "filestore_split_multiple": "2", 2024-04-18T14:43:26.102 INFO:teuthology.orchestra.run.smithi086.stdout: "filestore_split_rand_factor": "20", 2024-04-18T14:43:26.102 INFO:teuthology.orchestra.run.smithi086.stdout: "filestore_update_to": "1000", 2024-04-18T14:43:26.102 INFO:teuthology.orchestra.run.smithi086.stdout: "filestore_wbthrottle_btrfs_bytes_hard_limit": "419430400", 2024-04-18T14:43:26.102 INFO:teuthology.orchestra.run.smithi086.stdout: "filestore_wbthrottle_btrfs_bytes_start_flusher": "41943040", 2024-04-18T14:43:26.103 INFO:teuthology.orchestra.run.smithi086.stdout: "filestore_wbthrottle_btrfs_inodes_hard_limit": "5000", 2024-04-18T14:43:26.103 INFO:teuthology.orchestra.run.smithi086.stdout: "filestore_wbthrottle_btrfs_inodes_start_flusher": "500", 2024-04-18T14:43:26.103 INFO:teuthology.orchestra.run.smithi086.stdout: "filestore_wbthrottle_btrfs_ios_hard_limit": "5000", 2024-04-18T14:43:26.103 INFO:teuthology.orchestra.run.smithi086.stdout: "filestore_wbthrottle_btrfs_ios_start_flusher": "500", 2024-04-18T14:43:26.103 INFO:teuthology.orchestra.run.smithi086.stdout: "filestore_wbthrottle_enable": "true", 2024-04-18T14:43:26.103 INFO:teuthology.orchestra.run.smithi086.stdout: "filestore_wbthrottle_xfs_bytes_hard_limit": "419430400", 2024-04-18T14:43:26.103 INFO:teuthology.orchestra.run.smithi086.stdout: "filestore_wbthrottle_xfs_bytes_start_flusher": "41943040", 2024-04-18T14:43:26.103 INFO:teuthology.orchestra.run.smithi086.stdout: "filestore_wbthrottle_xfs_inodes_hard_limit": "5000", 2024-04-18T14:43:26.103 INFO:teuthology.orchestra.run.smithi086.stdout: "filestore_wbthrottle_xfs_inodes_start_flusher": "500", 2024-04-18T14:43:26.103 INFO:teuthology.orchestra.run.smithi086.stdout: "filestore_wbthrottle_xfs_ios_hard_limit": "5000", 2024-04-18T14:43:26.103 INFO:teuthology.orchestra.run.smithi086.stdout: "filestore_wbthrottle_xfs_ios_start_flusher": "500", 2024-04-18T14:43:26.103 INFO:teuthology.orchestra.run.smithi086.stdout: "filestore_xfs_extsize": "false", 2024-04-18T14:43:26.103 INFO:teuthology.orchestra.run.smithi086.stdout: "filestore_zfs_snap": "false", 2024-04-18T14:43:26.103 INFO:teuthology.orchestra.run.smithi086.stdout: "fio_dir": "/tmp/fio", 2024-04-18T14:43:26.103 INFO:teuthology.orchestra.run.smithi086.stdout: "fsid": "ac90c892-1809-401c-a743-76948b63c51a", 2024-04-18T14:43:26.103 INFO:teuthology.orchestra.run.smithi086.stdout: "fuse_allow_other": "true", 2024-04-18T14:43:26.104 INFO:teuthology.orchestra.run.smithi086.stdout: "fuse_atomic_o_trunc": "true", 2024-04-18T14:43:26.104 INFO:teuthology.orchestra.run.smithi086.stdout: "fuse_big_writes": "true", 2024-04-18T14:43:26.104 INFO:teuthology.orchestra.run.smithi086.stdout: "fuse_debug": "false", 2024-04-18T14:43:26.104 INFO:teuthology.orchestra.run.smithi086.stdout: "fuse_default_permissions": "false", 2024-04-18T14:43:26.104 INFO:teuthology.orchestra.run.smithi086.stdout: "fuse_disable_pagecache": "false", 2024-04-18T14:43:26.104 INFO:teuthology.orchestra.run.smithi086.stdout: "fuse_max_write": "0", 2024-04-18T14:43:26.104 INFO:teuthology.orchestra.run.smithi086.stdout: "fuse_multithreaded": "true", 2024-04-18T14:43:26.104 INFO:teuthology.orchestra.run.smithi086.stdout: "fuse_require_active_mds": "true", 2024-04-18T14:43:26.104 INFO:teuthology.orchestra.run.smithi086.stdout: "fuse_set_user_groups": "true", 2024-04-18T14:43:26.104 INFO:teuthology.orchestra.run.smithi086.stdout: "fuse_splice_move": "true", 2024-04-18T14:43:26.104 INFO:teuthology.orchestra.run.smithi086.stdout: "fuse_splice_read": "true", 2024-04-18T14:43:26.104 INFO:teuthology.orchestra.run.smithi086.stdout: "fuse_splice_write": "true", 2024-04-18T14:43:26.104 INFO:teuthology.orchestra.run.smithi086.stdout: "fuse_syncfs_on_mksnap": "true", 2024-04-18T14:43:26.104 INFO:teuthology.orchestra.run.smithi086.stdout: "fuse_use_invalidate_cb": "true", 2024-04-18T14:43:26.104 INFO:teuthology.orchestra.run.smithi086.stdout: "gss_ktab_client_file": "/var/lib/ceph/mon.a/gss_client_mon.a.ktab", 2024-04-18T14:43:26.104 INFO:teuthology.orchestra.run.smithi086.stdout: "gss_target_name": "ceph", 2024-04-18T14:43:26.105 INFO:teuthology.orchestra.run.smithi086.stdout: "heartbeat_file": "", 2024-04-18T14:43:26.105 INFO:teuthology.orchestra.run.smithi086.stdout: "heartbeat_inject_failure": "0", 2024-04-18T14:43:26.105 INFO:teuthology.orchestra.run.smithi086.stdout: "heartbeat_interval": "5", 2024-04-18T14:43:26.105 INFO:teuthology.orchestra.run.smithi086.stdout: "host": "smithi086", 2024-04-18T14:43:26.105 INFO:teuthology.orchestra.run.smithi086.stdout: "immutable_object_cache_client_dedicated_thread_num": "2", 2024-04-18T14:43:26.105 INFO:teuthology.orchestra.run.smithi086.stdout: "immutable_object_cache_max_inflight_ops": "128", 2024-04-18T14:43:26.105 INFO:teuthology.orchestra.run.smithi086.stdout: "immutable_object_cache_max_size": "1073741824", 2024-04-18T14:43:26.105 INFO:teuthology.orchestra.run.smithi086.stdout: "immutable_object_cache_path": "/tmp/ceph_immutable_object_cache", 2024-04-18T14:43:26.105 INFO:teuthology.orchestra.run.smithi086.stdout: "immutable_object_cache_qos_bps_burst": "0", 2024-04-18T14:43:26.105 INFO:teuthology.orchestra.run.smithi086.stdout: "immutable_object_cache_qos_bps_burst_seconds": "1", 2024-04-18T14:43:26.105 INFO:teuthology.orchestra.run.smithi086.stdout: "immutable_object_cache_qos_bps_limit": "0", 2024-04-18T14:43:26.105 INFO:teuthology.orchestra.run.smithi086.stdout: "immutable_object_cache_qos_iops_burst": "0", 2024-04-18T14:43:26.105 INFO:teuthology.orchestra.run.smithi086.stdout: "immutable_object_cache_qos_iops_burst_seconds": "1", 2024-04-18T14:43:26.105 INFO:teuthology.orchestra.run.smithi086.stdout: "immutable_object_cache_qos_iops_limit": "0", 2024-04-18T14:43:26.105 INFO:teuthology.orchestra.run.smithi086.stdout: "immutable_object_cache_qos_schedule_tick_min": "50", 2024-04-18T14:43:26.105 INFO:teuthology.orchestra.run.smithi086.stdout: "immutable_object_cache_sock": "/var/run/ceph/immutable_object_cache_sock", 2024-04-18T14:43:26.106 INFO:teuthology.orchestra.run.smithi086.stdout: "immutable_object_cache_watermark": "0.900000", 2024-04-18T14:43:26.106 INFO:teuthology.orchestra.run.smithi086.stdout: "inject_early_sigterm": "false", 2024-04-18T14:43:26.106 INFO:teuthology.orchestra.run.smithi086.stdout: "jaeger_agent_port": "6799", 2024-04-18T14:43:26.106 INFO:teuthology.orchestra.run.smithi086.stdout: "jaeger_tracing_enable": "false", 2024-04-18T14:43:26.106 INFO:teuthology.orchestra.run.smithi086.stdout: "journal_aio": "true", 2024-04-18T14:43:26.106 INFO:teuthology.orchestra.run.smithi086.stdout: "journal_align_min_size": "65536", 2024-04-18T14:43:26.106 INFO:teuthology.orchestra.run.smithi086.stdout: "journal_block_align": "true", 2024-04-18T14:43:26.106 INFO:teuthology.orchestra.run.smithi086.stdout: "journal_block_size": "4096", 2024-04-18T14:43:26.106 INFO:teuthology.orchestra.run.smithi086.stdout: "journal_dio": "true", 2024-04-18T14:43:26.106 INFO:teuthology.orchestra.run.smithi086.stdout: "journal_discard": "false", 2024-04-18T14:43:26.106 INFO:teuthology.orchestra.run.smithi086.stdout: "journal_force_aio": "false", 2024-04-18T14:43:26.106 INFO:teuthology.orchestra.run.smithi086.stdout: "journal_ignore_corruption": "false", 2024-04-18T14:43:26.106 INFO:teuthology.orchestra.run.smithi086.stdout: "journal_max_write_bytes": "10485760", 2024-04-18T14:43:26.106 INFO:teuthology.orchestra.run.smithi086.stdout: "journal_max_write_entries": "100", 2024-04-18T14:43:26.106 INFO:teuthology.orchestra.run.smithi086.stdout: "journal_replay_from": "0", 2024-04-18T14:43:26.107 INFO:teuthology.orchestra.run.smithi086.stdout: "journal_throttle_high_multiple": "0.000000", 2024-04-18T14:43:26.107 INFO:teuthology.orchestra.run.smithi086.stdout: "journal_throttle_high_threshhold": "0.900000", 2024-04-18T14:43:26.107 INFO:teuthology.orchestra.run.smithi086.stdout: "journal_throttle_low_threshhold": "0.600000", 2024-04-18T14:43:26.107 INFO:teuthology.orchestra.run.smithi086.stdout: "journal_throttle_max_multiple": "0.000000", 2024-04-18T14:43:26.107 INFO:teuthology.orchestra.run.smithi086.stdout: "journal_write_header_frequency": "0", 2024-04-18T14:43:26.107 INFO:teuthology.orchestra.run.smithi086.stdout: "journal_zero_on_create": "false", 2024-04-18T14:43:26.107 INFO:teuthology.orchestra.run.smithi086.stdout: "journaler_prefetch_periods": "10", 2024-04-18T14:43:26.107 INFO:teuthology.orchestra.run.smithi086.stdout: "journaler_prezero_periods": "5", 2024-04-18T14:43:26.107 INFO:teuthology.orchestra.run.smithi086.stdout: "journaler_write_head_interval": "15", 2024-04-18T14:43:26.107 INFO:teuthology.orchestra.run.smithi086.stdout: "key": "", 2024-04-18T14:43:26.107 INFO:teuthology.orchestra.run.smithi086.stdout: "keyfile": "", 2024-04-18T14:43:26.107 INFO:teuthology.orchestra.run.smithi086.stdout: "keyring": "/var/lib/ceph/mon/ceph-a/keyring", 2024-04-18T14:43:26.107 INFO:teuthology.orchestra.run.smithi086.stdout: "kstore_backend": "rocksdb", 2024-04-18T14:43:26.107 INFO:teuthology.orchestra.run.smithi086.stdout: "kstore_default_stripe_size": "65536", 2024-04-18T14:43:26.107 INFO:teuthology.orchestra.run.smithi086.stdout: "kstore_fsck_on_mount": "false", 2024-04-18T14:43:26.107 INFO:teuthology.orchestra.run.smithi086.stdout: "kstore_fsck_on_mount_deep": "true", 2024-04-18T14:43:26.108 INFO:teuthology.orchestra.run.smithi086.stdout: "kstore_max_bytes": "67108864", 2024-04-18T14:43:26.108 INFO:teuthology.orchestra.run.smithi086.stdout: "kstore_max_ops": "512", 2024-04-18T14:43:26.108 INFO:teuthology.orchestra.run.smithi086.stdout: "kstore_nid_prealloc": "1024", 2024-04-18T14:43:26.108 INFO:teuthology.orchestra.run.smithi086.stdout: "kstore_onode_map_size": "1024", 2024-04-18T14:43:26.108 INFO:teuthology.orchestra.run.smithi086.stdout: "kstore_rocksdb_options": "compression=kNoCompression", 2024-04-18T14:43:26.108 INFO:teuthology.orchestra.run.smithi086.stdout: "kstore_sync_submit_transaction": "false", 2024-04-18T14:43:26.108 INFO:teuthology.orchestra.run.smithi086.stdout: "kstore_sync_transaction": "false", 2024-04-18T14:43:26.108 INFO:teuthology.orchestra.run.smithi086.stdout: "leveldb_block_size": "65536", 2024-04-18T14:43:26.108 INFO:teuthology.orchestra.run.smithi086.stdout: "leveldb_bloom_size": "0", 2024-04-18T14:43:26.108 INFO:teuthology.orchestra.run.smithi086.stdout: "leveldb_cache_size": "536870912", 2024-04-18T14:43:26.108 INFO:teuthology.orchestra.run.smithi086.stdout: "leveldb_compact_on_mount": "false", 2024-04-18T14:43:26.108 INFO:teuthology.orchestra.run.smithi086.stdout: "leveldb_compression": "false", 2024-04-18T14:43:26.108 INFO:teuthology.orchestra.run.smithi086.stdout: "leveldb_log": "", 2024-04-18T14:43:26.108 INFO:teuthology.orchestra.run.smithi086.stdout: "leveldb_log_to_ceph_log": "true", 2024-04-18T14:43:26.108 INFO:teuthology.orchestra.run.smithi086.stdout: "leveldb_max_open_files": "0", 2024-04-18T14:43:26.108 INFO:teuthology.orchestra.run.smithi086.stdout: "leveldb_paranoid": "false", 2024-04-18T14:43:26.109 INFO:teuthology.orchestra.run.smithi086.stdout: "leveldb_write_buffer_size": "33554432", 2024-04-18T14:43:26.109 INFO:teuthology.orchestra.run.smithi086.stdout: "librados_thread_count": "2", 2024-04-18T14:43:26.109 INFO:teuthology.orchestra.run.smithi086.stdout: "lockdep": "false", 2024-04-18T14:43:26.109 INFO:teuthology.orchestra.run.smithi086.stdout: "lockdep_force_backtrace": "false", 2024-04-18T14:43:26.109 INFO:teuthology.orchestra.run.smithi086.stdout: "log_coarse_timestamps": "true", 2024-04-18T14:43:26.109 INFO:teuthology.orchestra.run.smithi086.stdout: "log_file": "/var/log/ceph/ceph-mon.a.log", 2024-04-18T14:43:26.109 INFO:teuthology.orchestra.run.smithi086.stdout: "log_flush_on_exit": "false", 2024-04-18T14:43:26.109 INFO:teuthology.orchestra.run.smithi086.stdout: "log_graylog_host": "127.0.0.1", 2024-04-18T14:43:26.109 INFO:teuthology.orchestra.run.smithi086.stdout: "log_graylog_port": "12201", 2024-04-18T14:43:26.109 INFO:teuthology.orchestra.run.smithi086.stdout: "log_max_new": "1000", 2024-04-18T14:43:26.109 INFO:teuthology.orchestra.run.smithi086.stdout: "log_max_recent": "10000", 2024-04-18T14:43:26.109 INFO:teuthology.orchestra.run.smithi086.stdout: "log_stderr_prefix": "", 2024-04-18T14:43:26.109 INFO:teuthology.orchestra.run.smithi086.stdout: "log_stop_at_utilization": "0.970000", 2024-04-18T14:43:26.109 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_file": "true", 2024-04-18T14:43:26.109 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_graylog": "false", 2024-04-18T14:43:26.110 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_journald": "false", 2024-04-18T14:43:26.110 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_stderr": "false", 2024-04-18T14:43:26.110 INFO:teuthology.orchestra.run.smithi086.stdout: "log_to_syslog": "false", 2024-04-18T14:43:26.110 INFO:teuthology.orchestra.run.smithi086.stdout: "max_rotating_auth_attempts": "10", 2024-04-18T14:43:26.110 INFO:teuthology.orchestra.run.smithi086.stdout: "mds_abort_on_newly_corrupt_dentry": "true", 2024-04-18T14:43:26.110 INFO:teuthology.orchestra.run.smithi086.stdout: "mds_action_on_write_error": "1", 2024-04-18T14:43:26.110 INFO:teuthology.orchestra.run.smithi086.stdout: "mds_alternate_name_max": "8192", 2024-04-18T14:43:26.110 INFO:teuthology.orchestra.run.smithi086.stdout: "mds_asio_thread_count": "2", 2024-04-18T14:43:26.110 INFO:teuthology.orchestra.run.smithi086.stdout: "mds_bal_export_pin": "true", 2024-04-18T14:43:26.110 INFO:teuthology.orchestra.run.smithi086.stdout: "mds_bal_fragment_dirs": "true", 2024-04-18T14:43:26.110 INFO:teuthology.orchestra.run.smithi086.stdout: "mds_bal_fragment_fast_factor": "1.500000", 2024-04-18T14:43:26.110 INFO:teuthology.orchestra.run.smithi086.stdout: "mds_bal_fragment_interval": "5", 2024-04-18T14:43:26.110 INFO:teuthology.orchestra.run.smithi086.stdout: "mds_bal_fragment_size_max": "100000", 2024-04-18T14:43:26.110 INFO:teuthology.orchestra.run.smithi086.stdout: "mds_bal_idle_threshold": "0.000000", 2024-04-18T14:43:26.110 INFO:teuthology.orchestra.run.smithi086.stdout: "mds_bal_interval": "10", 2024-04-18T14:43:26.111 INFO:teuthology.orchestra.run.smithi086.stdout: "mds_bal_max": "-1", 2024-04-18T14:43:26.111 INFO:teuthology.orchestra.run.smithi086.stdout: "mds_bal_max_until": "-1", 2024-04-18T14:43:26.111 INFO:teuthology.orchestra.run.smithi086.stdout: "mds_bal_merge_size": "50", 2024-04-18T14:43:26.111 INFO:teuthology.orchestra.run.smithi086.stdout: "mds_bal_midchunk": "0.300000", 2024-04-18T14:43:26.111 INFO:teuthology.orchestra.run.smithi086.stdout: "mds_bal_min_rebalance": "0.100000", 2024-04-18T14:43:26.111 INFO:teuthology.orchestra.run.smithi086.stdout: "mds_bal_min_start": "0.200000", 2024-04-18T14:43:26.111 INFO:teuthology.orchestra.run.smithi086.stdout: "mds_bal_minchunk": "0.001000", 2024-04-18T14:43:26.111 INFO:teuthology.orchestra.run.smithi086.stdout: "mds_bal_mode": "0", 2024-04-18T14:43:26.111 INFO:teuthology.orchestra.run.smithi086.stdout: "mds_bal_need_max": "1.200000", 2024-04-18T14:43:26.111 INFO:teuthology.orchestra.run.smithi086.stdout: "mds_bal_need_min": "0.800000", 2024-04-18T14:43:26.111 INFO:teuthology.orchestra.run.smithi086.stdout: "mds_bal_replicate_threshold": "8000.000000", 2024-04-18T14:43:26.111 INFO:teuthology.orchestra.run.smithi086.stdout: "mds_bal_sample_interval": "3.000000", 2024-04-18T14:43:26.111 INFO:teuthology.orchestra.run.smithi086.stdout: "mds_bal_split_bits": "3", 2024-04-18T14:43:26.111 INFO:teuthology.orchestra.run.smithi086.stdout: "mds_bal_split_rd": "25000.000000", 2024-04-18T14:43:26.111 INFO:teuthology.orchestra.run.smithi086.stdout: "mds_bal_split_size": "10000", 2024-04-18T14:43:26.112 INFO:teuthology.orchestra.run.smithi086.stdout: "mds_bal_split_wr": "10000.000000", 2024-04-18T14:43:26.112 INFO:teuthology.orchestra.run.smithi086.stdout: "mds_bal_target_decay": "10.000000", 2024-04-18T14:43:26.112 INFO:teuthology.orchestra.run.smithi086.stdout: "mds_bal_unreplicate_threshold": "0.000000", 2024-04-18T14:43:26.112 INFO:teuthology.orchestra.run.smithi086.stdout: "mds_beacon_grace": "15.000000", 2024-04-18T14:43:26.112 INFO:teuthology.orchestra.run.smithi086.stdout: "mds_beacon_interval": "4.000000", 2024-04-18T14:43:26.112 INFO:teuthology.orchestra.run.smithi086.stdout: "mds_beacon_mon_down_grace": "60", 2024-04-18T14:43:26.112 INFO:teuthology.orchestra.run.smithi086.stdout: "mds_cache_memory_limit": "4294967296", 2024-04-18T14:43:26.112 INFO:teuthology.orchestra.run.smithi086.stdout: "mds_cache_mid": "0.700000", 2024-04-18T14:43:26.112 INFO:teuthology.orchestra.run.smithi086.stdout: "mds_cache_release_free_interval": "10", 2024-04-18T14:43:26.112 INFO:teuthology.orchestra.run.smithi086.stdout: "mds_cache_reservation": "0.050000", 2024-04-18T14:43:26.112 INFO:teuthology.orchestra.run.smithi086.stdout: "mds_cache_trim_decay_rate": "1.000000", 2024-04-18T14:43:26.112 INFO:teuthology.orchestra.run.smithi086.stdout: "mds_cache_trim_interval": "1", 2024-04-18T14:43:26.112 INFO:teuthology.orchestra.run.smithi086.stdout: "mds_cache_trim_threshold": "262144", 2024-04-18T14:43:26.112 INFO:teuthology.orchestra.run.smithi086.stdout: "mds_cap_acquisition_throttle_retry_request_timeout": "0.500000", 2024-04-18T14:43:26.112 INFO:teuthology.orchestra.run.smithi086.stdout: "mds_cap_revoke_eviction_timeout": "0.000000", 2024-04-18T14:43:26.112 INFO:teuthology.orchestra.run.smithi086.stdout: "mds_client_delegate_inos_pct": "50", 2024-04-18T14:43:26.113 INFO:teuthology.orchestra.run.smithi086.stdout: "mds_client_prealloc_inos": "1000", 2024-04-18T14:43:26.113 INFO:teuthology.orchestra.run.smithi086.stdout: "mds_client_writeable_range_max_inc_objs": "1024", 2024-04-18T14:43:26.113 INFO:teuthology.orchestra.run.smithi086.stdout: "mds_connect_bootstrapping": "false", 2024-04-18T14:43:26.113 INFO:teuthology.orchestra.run.smithi086.stdout: "mds_damage_table_max_entries": "10000", 2024-04-18T14:43:26.113 INFO:teuthology.orchestra.run.smithi086.stdout: "mds_data": "/var/lib/ceph/mds/ceph-a", 2024-04-18T14:43:26.113 INFO:teuthology.orchestra.run.smithi086.stdout: "mds_debug_auth_pins": "false", 2024-04-18T14:43:26.113 INFO:teuthology.orchestra.run.smithi086.stdout: "mds_debug_frag": "false", 2024-04-18T14:43:26.113 INFO:teuthology.orchestra.run.smithi086.stdout: "mds_debug_scatterstat": "false", 2024-04-18T14:43:26.113 INFO:teuthology.orchestra.run.smithi086.stdout: "mds_debug_subtrees": "false", 2024-04-18T14:43:26.113 INFO:teuthology.orchestra.run.smithi086.stdout: "mds_decay_halflife": "5.000000", 2024-04-18T14:43:26.113 INFO:teuthology.orchestra.run.smithi086.stdout: "mds_default_dir_hash": "2", 2024-04-18T14:43:26.113 INFO:teuthology.orchestra.run.smithi086.stdout: "mds_defer_session_stale": "true", 2024-04-18T14:43:26.113 INFO:teuthology.orchestra.run.smithi086.stdout: "mds_deny_all_reconnect": "false", 2024-04-18T14:43:26.113 INFO:teuthology.orchestra.run.smithi086.stdout: "mds_dir_keys_per_op": "16384", 2024-04-18T14:43:26.113 INFO:teuthology.orchestra.run.smithi086.stdout: "mds_dir_max_commit_size": "10", 2024-04-18T14:43:26.114 INFO:teuthology.orchestra.run.smithi086.stdout: "mds_dir_max_entries": "0", 2024-04-18T14:43:26.114 INFO:teuthology.orchestra.run.smithi086.stdout: "mds_dir_prefetch": "true", 2024-04-18T14:43:26.114 INFO:teuthology.orchestra.run.smithi086.stdout: "mds_dirstat_min_interval": "1.000000", 2024-04-18T14:43:26.114 INFO:teuthology.orchestra.run.smithi086.stdout: "mds_dump_cache_after_rejoin": "false", 2024-04-18T14:43:26.114 INFO:teuthology.orchestra.run.smithi086.stdout: "mds_dump_cache_on_map": "false", 2024-04-18T14:43:26.114 INFO:teuthology.orchestra.run.smithi086.stdout: "mds_dump_cache_threshold_file": "0", 2024-04-18T14:43:26.114 INFO:teuthology.orchestra.run.smithi086.stdout: "mds_dump_cache_threshold_formatter": "1073741824", 2024-04-18T14:43:26.114 INFO:teuthology.orchestra.run.smithi086.stdout: "mds_early_reply": "true", 2024-04-18T14:43:26.114 INFO:teuthology.orchestra.run.smithi086.stdout: "mds_enable_op_tracker": "true", 2024-04-18T14:43:26.114 INFO:teuthology.orchestra.run.smithi086.stdout: "mds_enforce_unique_name": "true", 2024-04-18T14:43:26.114 INFO:teuthology.orchestra.run.smithi086.stdout: "mds_export_ephemeral_distributed": "true", 2024-04-18T14:43:26.114 INFO:teuthology.orchestra.run.smithi086.stdout: "mds_export_ephemeral_distributed_factor": "2.000000", 2024-04-18T14:43:26.114 INFO:teuthology.orchestra.run.smithi086.stdout: "mds_export_ephemeral_random": "true", 2024-04-18T14:43:26.114 INFO:teuthology.orchestra.run.smithi086.stdout: "mds_export_ephemeral_random_max": "0.010000", 2024-04-18T14:43:26.114 INFO:teuthology.orchestra.run.smithi086.stdout: "mds_extraordinary_events_dump_interval": "0", 2024-04-18T14:43:26.115 INFO:teuthology.orchestra.run.smithi086.stdout: "mds_forward_all_requests_to_auth": "false", 2024-04-18T14:43:26.115 INFO:teuthology.orchestra.run.smithi086.stdout: "mds_freeze_tree_timeout": "30.000000", 2024-04-18T14:43:26.115 INFO:teuthology.orchestra.run.smithi086.stdout: "mds_fscrypt_last_block_max_size": "4096", 2024-04-18T14:43:26.115 INFO:teuthology.orchestra.run.smithi086.stdout: "mds_go_bad_corrupt_dentry": "true", 2024-04-18T14:43:26.115 INFO:teuthology.orchestra.run.smithi086.stdout: "mds_hack_allow_loading_invalid_metadata": "false", 2024-04-18T14:43:26.115 INFO:teuthology.orchestra.run.smithi086.stdout: "mds_health_cache_threshold": "1.500000", 2024-04-18T14:43:26.115 INFO:teuthology.orchestra.run.smithi086.stdout: "mds_health_summarize_threshold": "10", 2024-04-18T14:43:26.115 INFO:teuthology.orchestra.run.smithi086.stdout: "mds_heartbeat_grace": "15.000000", 2024-04-18T14:43:26.115 INFO:teuthology.orchestra.run.smithi086.stdout: "mds_heartbeat_reset_grace": "1000", 2024-04-18T14:43:26.115 INFO:teuthology.orchestra.run.smithi086.stdout: "mds_inject_health_dummy": "false", 2024-04-18T14:43:26.115 INFO:teuthology.orchestra.run.smithi086.stdout: "mds_inject_journal_corrupt_dentry_first": "0.000000", 2024-04-18T14:43:26.115 INFO:teuthology.orchestra.run.smithi086.stdout: "mds_inject_migrator_session_race": "false", 2024-04-18T14:43:26.115 INFO:teuthology.orchestra.run.smithi086.stdout: "mds_inject_rename_corrupt_dentry_first": "0.000000", 2024-04-18T14:43:26.115 INFO:teuthology.orchestra.run.smithi086.stdout: "mds_inject_skip_replaying_inotable": "false", 2024-04-18T14:43:26.115 INFO:teuthology.orchestra.run.smithi086.stdout: "mds_inject_traceless_reply_probability": "0.000000", 2024-04-18T14:43:26.116 INFO:teuthology.orchestra.run.smithi086.stdout: "mds_join_fs": "", 2024-04-18T14:43:26.116 INFO:teuthology.orchestra.run.smithi086.stdout: "mds_journal_format": "1", 2024-04-18T14:43:26.116 INFO:teuthology.orchestra.run.smithi086.stdout: "mds_kill_create_at": "0", 2024-04-18T14:43:26.116 INFO:teuthology.orchestra.run.smithi086.stdout: "mds_kill_export_at": "0", 2024-04-18T14:43:26.116 INFO:teuthology.orchestra.run.smithi086.stdout: "mds_kill_import_at": "0", 2024-04-18T14:43:26.116 INFO:teuthology.orchestra.run.smithi086.stdout: "mds_kill_journal_at": "0", 2024-04-18T14:43:26.116 INFO:teuthology.orchestra.run.smithi086.stdout: "mds_kill_journal_expire_at": "0", 2024-04-18T14:43:26.116 INFO:teuthology.orchestra.run.smithi086.stdout: "mds_kill_journal_replay_at": "0", 2024-04-18T14:43:26.116 INFO:teuthology.orchestra.run.smithi086.stdout: "mds_kill_link_at": "0", 2024-04-18T14:43:26.116 INFO:teuthology.orchestra.run.smithi086.stdout: "mds_kill_mdstable_at": "0", 2024-04-18T14:43:26.116 INFO:teuthology.orchestra.run.smithi086.stdout: "mds_kill_openc_at": "0", 2024-04-18T14:43:26.116 INFO:teuthology.orchestra.run.smithi086.stdout: "mds_kill_rename_at": "0", 2024-04-18T14:43:26.116 INFO:teuthology.orchestra.run.smithi086.stdout: "mds_kill_skip_replaying_inotable": "false", 2024-04-18T14:43:26.116 INFO:teuthology.orchestra.run.smithi086.stdout: "mds_log_events_per_segment": "1024", 2024-04-18T14:43:26.116 INFO:teuthology.orchestra.run.smithi086.stdout: "mds_log_max_events": "-1", 2024-04-18T14:43:26.116 INFO:teuthology.orchestra.run.smithi086.stdout: "mds_log_max_segments": "128", 2024-04-18T14:43:26.117 INFO:teuthology.orchestra.run.smithi086.stdout: "mds_log_pause": "false", 2024-04-18T14:43:26.117 INFO:teuthology.orchestra.run.smithi086.stdout: "mds_log_segment_size": "0", 2024-04-18T14:43:26.117 INFO:teuthology.orchestra.run.smithi086.stdout: "mds_log_skip_corrupt_events": "false", 2024-04-18T14:43:26.117 INFO:teuthology.orchestra.run.smithi086.stdout: "mds_log_warn_factor": "2.000000", 2024-04-18T14:43:26.117 INFO:teuthology.orchestra.run.smithi086.stdout: "mds_max_caps_per_client": "1048576", 2024-04-18T14:43:26.117 INFO:teuthology.orchestra.run.smithi086.stdout: "mds_max_completed_flushes": "100000", 2024-04-18T14:43:26.117 INFO:teuthology.orchestra.run.smithi086.stdout: "mds_max_completed_requests": "100000", 2024-04-18T14:43:26.117 INFO:teuthology.orchestra.run.smithi086.stdout: "mds_max_export_size": "20971520", 2024-04-18T14:43:26.117 INFO:teuthology.orchestra.run.smithi086.stdout: "mds_max_file_recover": "32", 2024-04-18T14:43:26.117 INFO:teuthology.orchestra.run.smithi086.stdout: "mds_max_purge_files": "64", 2024-04-18T14:43:26.117 INFO:teuthology.orchestra.run.smithi086.stdout: "mds_max_purge_ops": "8192", 2024-04-18T14:43:26.117 INFO:teuthology.orchestra.run.smithi086.stdout: "mds_max_purge_ops_per_pg": "0.500000", 2024-04-18T14:43:26.117 INFO:teuthology.orchestra.run.smithi086.stdout: "mds_max_scrub_ops_in_progress": "5", 2024-04-18T14:43:26.117 INFO:teuthology.orchestra.run.smithi086.stdout: "mds_max_snaps_per_dir": "100", 2024-04-18T14:43:26.117 INFO:teuthology.orchestra.run.smithi086.stdout: "mds_metrics_update_interval": "2", 2024-04-18T14:43:26.118 INFO:teuthology.orchestra.run.smithi086.stdout: "mds_min_caps_per_client": "100", 2024-04-18T14:43:26.118 INFO:teuthology.orchestra.run.smithi086.stdout: "mds_min_caps_working_set": "10000", 2024-04-18T14:43:26.118 INFO:teuthology.orchestra.run.smithi086.stdout: "mds_mon_shutdown_timeout": "5.000000", 2024-04-18T14:43:26.118 INFO:teuthology.orchestra.run.smithi086.stdout: "mds_numa_node": "-1", 2024-04-18T14:43:26.118 INFO:teuthology.orchestra.run.smithi086.stdout: "mds_oft_prefetch_dirfrags": "false", 2024-04-18T14:43:26.118 INFO:teuthology.orchestra.run.smithi086.stdout: "mds_op_complaint_time": "30.000000", 2024-04-18T14:43:26.118 INFO:teuthology.orchestra.run.smithi086.stdout: "mds_op_history_duration": "600", 2024-04-18T14:43:26.118 INFO:teuthology.orchestra.run.smithi086.stdout: "mds_op_history_size": "20", 2024-04-18T14:43:26.118 INFO:teuthology.orchestra.run.smithi086.stdout: "mds_op_history_slow_op_size": "20", 2024-04-18T14:43:26.118 INFO:teuthology.orchestra.run.smithi086.stdout: "mds_op_history_slow_op_threshold": "10", 2024-04-18T14:43:26.118 INFO:teuthology.orchestra.run.smithi086.stdout: "mds_op_log_threshold": "5", 2024-04-18T14:43:26.118 INFO:teuthology.orchestra.run.smithi086.stdout: "mds_ping_grace": "15", 2024-04-18T14:43:26.118 INFO:teuthology.orchestra.run.smithi086.stdout: "mds_ping_interval": "5", 2024-04-18T14:43:26.118 INFO:teuthology.orchestra.run.smithi086.stdout: "mds_purge_queue_busy_flush_period": "1.000000", 2024-04-18T14:43:26.118 INFO:teuthology.orchestra.run.smithi086.stdout: "mds_recall_global_max_decay_threshold": "131072", 2024-04-18T14:43:26.118 INFO:teuthology.orchestra.run.smithi086.stdout: "mds_recall_max_caps": "30000", 2024-04-18T14:43:26.119 INFO:teuthology.orchestra.run.smithi086.stdout: "mds_recall_max_decay_rate": "1.500000", 2024-04-18T14:43:26.119 INFO:teuthology.orchestra.run.smithi086.stdout: "mds_recall_max_decay_threshold": "131072", 2024-04-18T14:43:26.121 INFO:teuthology.orchestra.run.smithi086.stdout: "mds_recall_warning_decay_rate": "60.000000", 2024-04-18T14:43:26.121 INFO:teuthology.orchestra.run.smithi086.stdout: "mds_recall_warning_threshold": "262144", 2024-04-18T14:43:26.121 INFO:teuthology.orchestra.run.smithi086.stdout: "mds_reconnect_timeout": "45.000000", 2024-04-18T14:43:26.121 INFO:teuthology.orchestra.run.smithi086.stdout: "mds_replay_interval": "1.000000", 2024-04-18T14:43:26.121 INFO:teuthology.orchestra.run.smithi086.stdout: "mds_replay_unsafe_with_closed_session": "false", 2024-04-18T14:43:26.121 INFO:teuthology.orchestra.run.smithi086.stdout: "mds_request_load_average_decay_rate": "60.000000", 2024-04-18T14:43:26.121 INFO:teuthology.orchestra.run.smithi086.stdout: "mds_root_ino_gid": "0", 2024-04-18T14:43:26.122 INFO:teuthology.orchestra.run.smithi086.stdout: "mds_root_ino_uid": "0", 2024-04-18T14:43:26.122 INFO:teuthology.orchestra.run.smithi086.stdout: "mds_scatter_nudge_interval": "5.000000", 2024-04-18T14:43:26.122 INFO:teuthology.orchestra.run.smithi086.stdout: "mds_session_blocklist_on_evict": "true", 2024-04-18T14:43:26.122 INFO:teuthology.orchestra.run.smithi086.stdout: "mds_session_blocklist_on_timeout": "true", 2024-04-18T14:43:26.122 INFO:teuthology.orchestra.run.smithi086.stdout: "mds_session_cache_liveness_decay_rate": "300.000000", 2024-04-18T14:43:26.122 INFO:teuthology.orchestra.run.smithi086.stdout: "mds_session_cache_liveness_magnitude": "10", 2024-04-18T14:43:26.122 INFO:teuthology.orchestra.run.smithi086.stdout: "mds_session_cap_acquisition_decay_rate": "30.000000", 2024-04-18T14:43:26.122 INFO:teuthology.orchestra.run.smithi086.stdout: "mds_session_cap_acquisition_throttle": "100000", 2024-04-18T14:43:26.122 INFO:teuthology.orchestra.run.smithi086.stdout: "mds_session_max_caps_throttle_ratio": "1.100000", 2024-04-18T14:43:26.122 INFO:teuthology.orchestra.run.smithi086.stdout: "mds_session_metadata_threshold": "16777216", 2024-04-18T14:43:26.122 INFO:teuthology.orchestra.run.smithi086.stdout: "mds_sessionmap_keys_per_op": "1024", 2024-04-18T14:43:26.122 INFO:teuthology.orchestra.run.smithi086.stdout: "mds_shutdown_check": "0", 2024-04-18T14:43:26.122 INFO:teuthology.orchestra.run.smithi086.stdout: "mds_skip_ino": "0", 2024-04-18T14:43:26.122 INFO:teuthology.orchestra.run.smithi086.stdout: "mds_sleep_rank_change": "0.000000", 2024-04-18T14:43:26.122 INFO:teuthology.orchestra.run.smithi086.stdout: "mds_snap_max_uid": "4294967294", 2024-04-18T14:43:26.123 INFO:teuthology.orchestra.run.smithi086.stdout: "mds_snap_min_uid": "0", 2024-04-18T14:43:26.123 INFO:teuthology.orchestra.run.smithi086.stdout: "mds_snap_rstat": "false", 2024-04-18T14:43:26.123 INFO:teuthology.orchestra.run.smithi086.stdout: "mds_standby_replay_damaged": "false", 2024-04-18T14:43:26.123 INFO:teuthology.orchestra.run.smithi086.stdout: "mds_symlink_recovery": "true", 2024-04-18T14:43:26.123 INFO:teuthology.orchestra.run.smithi086.stdout: "mds_task_status_update_interval": "2.000000", 2024-04-18T14:43:26.123 INFO:teuthology.orchestra.run.smithi086.stdout: "mds_thrash_exports": "0", 2024-04-18T14:43:26.123 INFO:teuthology.orchestra.run.smithi086.stdout: "mds_thrash_fragments": "0", 2024-04-18T14:43:26.123 INFO:teuthology.orchestra.run.smithi086.stdout: "mds_tick_interval": "5.000000", 2024-04-18T14:43:26.123 INFO:teuthology.orchestra.run.smithi086.stdout: "mds_valgrind_exit": "false", 2024-04-18T14:43:26.123 INFO:teuthology.orchestra.run.smithi086.stdout: "mds_verify_backtrace": "1", 2024-04-18T14:43:26.123 INFO:teuthology.orchestra.run.smithi086.stdout: "mds_verify_scatter": "false", 2024-04-18T14:43:26.124 INFO:teuthology.orchestra.run.smithi086.stdout: "mds_wipe_ino_prealloc": "false", 2024-04-18T14:43:26.124 INFO:teuthology.orchestra.run.smithi086.stdout: "mds_wipe_sessions": "false", 2024-04-18T14:43:26.124 INFO:teuthology.orchestra.run.smithi086.stdout: "mempool_debug": "false", 2024-04-18T14:43:26.124 INFO:teuthology.orchestra.run.smithi086.stdout: "memstore_debug_omit_block_device_write": "false", 2024-04-18T14:43:26.124 INFO:teuthology.orchestra.run.smithi086.stdout: "memstore_device_bytes": "1073741824", 2024-04-18T14:43:26.124 INFO:teuthology.orchestra.run.smithi086.stdout: "memstore_page_set": "false", 2024-04-18T14:43:26.124 INFO:teuthology.orchestra.run.smithi086.stdout: "memstore_page_size": "65536", 2024-04-18T14:43:26.124 INFO:teuthology.orchestra.run.smithi086.stdout: "mgr_client_bytes": "134217728", 2024-04-18T14:43:26.124 INFO:teuthology.orchestra.run.smithi086.stdout: "mgr_client_messages": "512", 2024-04-18T14:43:26.124 INFO:teuthology.orchestra.run.smithi086.stdout: "mgr_client_service_daemon_unregister_timeout": "1.000000", 2024-04-18T14:43:26.124 INFO:teuthology.orchestra.run.smithi086.stdout: "mgr_connect_retry_interval": "1.000000", 2024-04-18T14:43:26.124 INFO:teuthology.orchestra.run.smithi086.stdout: "mgr_data": "/var/lib/ceph/mgr/ceph-a", 2024-04-18T14:43:26.124 INFO:teuthology.orchestra.run.smithi086.stdout: "mgr_debug_aggressive_pg_num_changes": "false", 2024-04-18T14:43:26.124 INFO:teuthology.orchestra.run.smithi086.stdout: "mgr_disabled_modules": "", 2024-04-18T14:43:26.124 INFO:teuthology.orchestra.run.smithi086.stdout: "mgr_initial_modules": "restful iostat nfs", 2024-04-18T14:43:26.125 INFO:teuthology.orchestra.run.smithi086.stdout: "mgr_max_pg_num_change": "128", 2024-04-18T14:43:26.125 INFO:teuthology.orchestra.run.smithi086.stdout: "mgr_mds_bytes": "134217728", 2024-04-18T14:43:26.125 INFO:teuthology.orchestra.run.smithi086.stdout: "mgr_mds_messages": "128", 2024-04-18T14:43:26.125 INFO:teuthology.orchestra.run.smithi086.stdout: "mgr_module_path": "/usr/share/ceph/mgr", 2024-04-18T14:43:26.125 INFO:teuthology.orchestra.run.smithi086.stdout: "mgr_mon_bytes": "134217728", 2024-04-18T14:43:26.125 INFO:teuthology.orchestra.run.smithi086.stdout: "mgr_mon_messages": "128", 2024-04-18T14:43:26.125 INFO:teuthology.orchestra.run.smithi086.stdout: "mgr_osd_bytes": "536870912", 2024-04-18T14:43:26.125 INFO:teuthology.orchestra.run.smithi086.stdout: "mgr_osd_messages": "8192", 2024-04-18T14:43:26.125 INFO:teuthology.orchestra.run.smithi086.stdout: "mgr_pool": "true", 2024-04-18T14:43:26.125 INFO:teuthology.orchestra.run.smithi086.stdout: "mgr_service_beacon_grace": "60.000000", 2024-04-18T14:43:26.125 INFO:teuthology.orchestra.run.smithi086.stdout: "mgr_standby_modules": "true", 2024-04-18T14:43:26.125 INFO:teuthology.orchestra.run.smithi086.stdout: "mgr_stats_period": "5", 2024-04-18T14:43:26.125 INFO:teuthology.orchestra.run.smithi086.stdout: "mgr_stats_threshold": "5", 2024-04-18T14:43:26.125 INFO:teuthology.orchestra.run.smithi086.stdout: "mgr_tick_period": "2", 2024-04-18T14:43:26.125 INFO:teuthology.orchestra.run.smithi086.stdout: "mgr_ttl_cache_expire_seconds": "0", 2024-04-18T14:43:26.126 INFO:teuthology.orchestra.run.smithi086.stdout: "mon_accept_timeout_factor": "2.000000", 2024-04-18T14:43:26.126 INFO:teuthology.orchestra.run.smithi086.stdout: "mon_allow_pool_delete": "true", 2024-04-18T14:43:26.126 INFO:teuthology.orchestra.run.smithi086.stdout: "mon_allow_pool_size_one": "true", 2024-04-18T14:43:26.126 INFO:teuthology.orchestra.run.smithi086.stdout: "mon_auth_validate_all_caps": "true", 2024-04-18T14:43:26.126 INFO:teuthology.orchestra.run.smithi086.stdout: "mon_cache_target_full_warn_ratio": "0.660000", 2024-04-18T14:43:26.126 INFO:teuthology.orchestra.run.smithi086.stdout: "mon_clean_pg_upmaps_per_chunk": "256", 2024-04-18T14:43:26.126 INFO:teuthology.orchestra.run.smithi086.stdout: "mon_client_bytes": "104857600", 2024-04-18T14:43:26.126 INFO:teuthology.orchestra.run.smithi086.stdout: "mon_client_directed_command_retry": "5", 2024-04-18T14:43:26.126 INFO:teuthology.orchestra.run.smithi086.stdout: "mon_client_hunt_interval": "3.000000", 2024-04-18T14:43:26.126 INFO:teuthology.orchestra.run.smithi086.stdout: "mon_client_hunt_interval_backoff": "1.500000", 2024-04-18T14:43:26.126 INFO:teuthology.orchestra.run.smithi086.stdout: "mon_client_hunt_interval_max_multiple": "10.000000", 2024-04-18T14:43:26.126 INFO:teuthology.orchestra.run.smithi086.stdout: "mon_client_hunt_interval_min_multiple": "1.000000", 2024-04-18T14:43:26.126 INFO:teuthology.orchestra.run.smithi086.stdout: "mon_client_hunt_parallel": "3", 2024-04-18T14:43:26.127 INFO:teuthology.orchestra.run.smithi086.stdout: "mon_client_log_interval": "1.000000", 2024-04-18T14:43:26.127 INFO:teuthology.orchestra.run.smithi086.stdout: "mon_client_max_log_entries_per_message": "1000", 2024-04-18T14:43:26.127 INFO:teuthology.orchestra.run.smithi086.stdout: "mon_client_ping_interval": "10.000000", 2024-04-18T14:43:26.127 INFO:teuthology.orchestra.run.smithi086.stdout: "mon_client_ping_timeout": "30.000000", 2024-04-18T14:43:26.127 INFO:teuthology.orchestra.run.smithi086.stdout: "mon_clock_drift_allowed": "1.000000", 2024-04-18T14:43:26.127 INFO:teuthology.orchestra.run.smithi086.stdout: "mon_clock_drift_warn_backoff": "5.000000", 2024-04-18T14:43:26.127 INFO:teuthology.orchestra.run.smithi086.stdout: "mon_cluster_log_file": "default=/var/log/ceph/ceph.$channel.log cluster=/var/log/ceph/ceph.log", 2024-04-18T14:43:26.127 INFO:teuthology.orchestra.run.smithi086.stdout: "mon_cluster_log_file_level": "debug", 2024-04-18T14:43:26.127 INFO:teuthology.orchestra.run.smithi086.stdout: "mon_cluster_log_to_file": "true", 2024-04-18T14:43:26.127 INFO:teuthology.orchestra.run.smithi086.stdout: "mon_cluster_log_to_graylog": "false", 2024-04-18T14:43:26.127 INFO:teuthology.orchestra.run.smithi086.stdout: "mon_cluster_log_to_graylog_host": "127.0.0.1", 2024-04-18T14:43:26.127 INFO:teuthology.orchestra.run.smithi086.stdout: "mon_cluster_log_to_graylog_port": "12201", 2024-04-18T14:43:26.128 INFO:teuthology.orchestra.run.smithi086.stdout: "mon_cluster_log_to_journald": "false", 2024-04-18T14:43:26.128 INFO:teuthology.orchestra.run.smithi086.stdout: "mon_cluster_log_to_stderr": "false", 2024-04-18T14:43:26.128 INFO:teuthology.orchestra.run.smithi086.stdout: "mon_cluster_log_to_syslog": "default=false", 2024-04-18T14:43:26.128 INFO:teuthology.orchestra.run.smithi086.stdout: "mon_cluster_log_to_syslog_facility": "daemon", 2024-04-18T14:43:26.128 INFO:teuthology.orchestra.run.smithi086.stdout: "mon_cluster_log_to_syslog_level": "info", 2024-04-18T14:43:26.128 INFO:teuthology.orchestra.run.smithi086.stdout: "mon_compact_on_bootstrap": "false", 2024-04-18T14:43:26.128 INFO:teuthology.orchestra.run.smithi086.stdout: "mon_compact_on_start": "false", 2024-04-18T14:43:26.128 INFO:teuthology.orchestra.run.smithi086.stdout: "mon_compact_on_trim": "true", 2024-04-18T14:43:26.128 INFO:teuthology.orchestra.run.smithi086.stdout: "mon_con_tracker_persist_interval": "10", 2024-04-18T14:43:26.128 INFO:teuthology.orchestra.run.smithi086.stdout: "mon_con_tracker_score_halflife": "43200", 2024-04-18T14:43:26.129 INFO:teuthology.orchestra.run.smithi086.stdout: "mon_config_key_max_entry_size": "65536", 2024-04-18T14:43:26.129 INFO:teuthology.orchestra.run.smithi086.stdout: "mon_cpu_threads": "4", 2024-04-18T14:43:26.129 INFO:teuthology.orchestra.run.smithi086.stdout: "mon_crush_min_required_version": "hammer", 2024-04-18T14:43:26.129 INFO:teuthology.orchestra.run.smithi086.stdout: "mon_daemon_bytes": "419430400", 2024-04-18T14:43:26.129 INFO:teuthology.orchestra.run.smithi086.stdout: "mon_data": "/var/lib/ceph/mon/ceph-a", 2024-04-18T14:43:26.129 INFO:teuthology.orchestra.run.smithi086.stdout: "mon_data_avail_crit": "5", 2024-04-18T14:43:26.129 INFO:teuthology.orchestra.run.smithi086.stdout: "mon_data_avail_warn": "5", 2024-04-18T14:43:26.129 INFO:teuthology.orchestra.run.smithi086.stdout: "mon_data_size_warn": "16106127360", 2024-04-18T14:43:26.129 INFO:teuthology.orchestra.run.smithi086.stdout: "mon_debug_block_osdmap_trim": "false", 2024-04-18T14:43:26.129 INFO:teuthology.orchestra.run.smithi086.stdout: "mon_debug_deprecated_as_obsolete": "false", 2024-04-18T14:43:26.129 INFO:teuthology.orchestra.run.smithi086.stdout: "mon_debug_dump_json": "false", 2024-04-18T14:43:26.129 INFO:teuthology.orchestra.run.smithi086.stdout: "mon_debug_dump_location": "/var/log/ceph/ceph-mon.a.tdump", 2024-04-18T14:43:26.129 INFO:teuthology.orchestra.run.smithi086.stdout: "mon_debug_dump_transactions": "false", 2024-04-18T14:43:26.129 INFO:teuthology.orchestra.run.smithi086.stdout: "mon_debug_extra_checks": "false", 2024-04-18T14:43:26.130 INFO:teuthology.orchestra.run.smithi086.stdout: "mon_debug_no_initial_persistent_features": "false", 2024-04-18T14:43:26.130 INFO:teuthology.orchestra.run.smithi086.stdout: "mon_debug_no_require_bluestore_for_ec_overwrites": "false", 2024-04-18T14:43:26.130 INFO:teuthology.orchestra.run.smithi086.stdout: "mon_debug_no_require_quincy": "false", 2024-04-18T14:43:26.130 INFO:teuthology.orchestra.run.smithi086.stdout: "mon_debug_no_require_reef": "false", 2024-04-18T14:43:26.130 INFO:teuthology.orchestra.run.smithi086.stdout: "mon_debug_unsafe_allow_tier_with_nonempty_snaps": "false", 2024-04-18T14:43:26.130 INFO:teuthology.orchestra.run.smithi086.stdout: "mon_delta_reset_interval": "10.000000", 2024-04-18T14:43:26.130 INFO:teuthology.orchestra.run.smithi086.stdout: "mon_dns_srv_name": "ceph-mon", 2024-04-18T14:43:26.130 INFO:teuthology.orchestra.run.smithi086.stdout: "mon_down_mkfs_grace": "120", 2024-04-18T14:43:26.130 INFO:teuthology.orchestra.run.smithi086.stdout: "mon_election_default_strategy": "1", 2024-04-18T14:43:26.130 INFO:teuthology.orchestra.run.smithi086.stdout: "mon_election_timeout": "5.000000", 2024-04-18T14:43:26.130 INFO:teuthology.orchestra.run.smithi086.stdout: "mon_elector_ignore_propose_margin": "0.000500", 2024-04-18T14:43:26.130 INFO:teuthology.orchestra.run.smithi086.stdout: "mon_elector_ping_divisor": "2", 2024-04-18T14:43:26.130 INFO:teuthology.orchestra.run.smithi086.stdout: "mon_elector_ping_timeout": "2.000000", 2024-04-18T14:43:26.131 INFO:teuthology.orchestra.run.smithi086.stdout: "mon_enable_op_tracker": "true", 2024-04-18T14:43:26.131 INFO:teuthology.orchestra.run.smithi086.stdout: "mon_fake_pool_delete": "false", 2024-04-18T14:43:26.131 INFO:teuthology.orchestra.run.smithi086.stdout: "mon_force_quorum_join": "false", 2024-04-18T14:43:26.131 INFO:teuthology.orchestra.run.smithi086.stdout: "mon_globalid_prealloc": "10000", 2024-04-18T14:43:26.131 INFO:teuthology.orchestra.run.smithi086.stdout: "mon_health_detail_to_clog": "false", 2024-04-18T14:43:26.131 INFO:teuthology.orchestra.run.smithi086.stdout: "mon_health_log_update_period": "5", 2024-04-18T14:43:26.131 INFO:teuthology.orchestra.run.smithi086.stdout: "mon_health_max_detail": "50", 2024-04-18T14:43:26.131 INFO:teuthology.orchestra.run.smithi086.stdout: "mon_health_to_clog": "true", 2024-04-18T14:43:26.131 INFO:teuthology.orchestra.run.smithi086.stdout: "mon_health_to_clog_interval": "600", 2024-04-18T14:43:26.131 INFO:teuthology.orchestra.run.smithi086.stdout: "mon_health_to_clog_tick_interval": "60.000000", 2024-04-18T14:43:26.131 INFO:teuthology.orchestra.run.smithi086.stdout: "mon_host": "172.21.15.86,172.21.15.96,172.21.15.119", 2024-04-18T14:43:26.131 INFO:teuthology.orchestra.run.smithi086.stdout: "mon_host_override": "", 2024-04-18T14:43:26.131 INFO:teuthology.orchestra.run.smithi086.stdout: "mon_initial_members": "", 2024-04-18T14:43:26.131 INFO:teuthology.orchestra.run.smithi086.stdout: "mon_inject_pg_merge_bounce_probability": "0.000000", 2024-04-18T14:43:26.131 INFO:teuthology.orchestra.run.smithi086.stdout: "mon_inject_sync_get_chunk_delay": "0.000000", 2024-04-18T14:43:26.132 INFO:teuthology.orchestra.run.smithi086.stdout: "mon_inject_transaction_delay_max": "10.000000", 2024-04-18T14:43:26.132 INFO:teuthology.orchestra.run.smithi086.stdout: "mon_inject_transaction_delay_probability": "0.000000", 2024-04-18T14:43:26.132 INFO:teuthology.orchestra.run.smithi086.stdout: "mon_keyvaluedb": "rocksdb", 2024-04-18T14:43:26.132 INFO:teuthology.orchestra.run.smithi086.stdout: "mon_lease": "5.000000", 2024-04-18T14:43:26.132 INFO:teuthology.orchestra.run.smithi086.stdout: "mon_lease_ack_timeout_factor": "2.000000", 2024-04-18T14:43:26.132 INFO:teuthology.orchestra.run.smithi086.stdout: "mon_lease_renew_interval_factor": "0.600000", 2024-04-18T14:43:26.132 INFO:teuthology.orchestra.run.smithi086.stdout: "mon_log_full_interval": "50", 2024-04-18T14:43:26.132 INFO:teuthology.orchestra.run.smithi086.stdout: "mon_log_max": "10000", 2024-04-18T14:43:26.132 INFO:teuthology.orchestra.run.smithi086.stdout: "mon_log_max_summary": "50", 2024-04-18T14:43:26.132 INFO:teuthology.orchestra.run.smithi086.stdout: "mon_max_log_entries_per_event": "4096", 2024-04-18T14:43:26.133 INFO:teuthology.orchestra.run.smithi086.stdout: "mon_max_log_epochs": "500", 2024-04-18T14:43:26.133 INFO:teuthology.orchestra.run.smithi086.stdout: "mon_max_mdsmap_epochs": "500", 2024-04-18T14:43:26.133 INFO:teuthology.orchestra.run.smithi086.stdout: "mon_max_mgrmap_epochs": "500", 2024-04-18T14:43:26.133 INFO:teuthology.orchestra.run.smithi086.stdout: "mon_max_osd": "10000", 2024-04-18T14:43:26.133 INFO:teuthology.orchestra.run.smithi086.stdout: "mon_max_pg_per_osd": "10000", 2024-04-18T14:43:26.133 INFO:teuthology.orchestra.run.smithi086.stdout: "mon_max_pool_pg_num": "65536", 2024-04-18T14:43:26.133 INFO:teuthology.orchestra.run.smithi086.stdout: "mon_max_snap_prune_per_epoch": "100", 2024-04-18T14:43:26.133 INFO:teuthology.orchestra.run.smithi086.stdout: "mon_mds_blocklist_interval": "86400.000000", 2024-04-18T14:43:26.133 INFO:teuthology.orchestra.run.smithi086.stdout: "mon_mds_force_trim_to": "0", 2024-04-18T14:43:26.133 INFO:teuthology.orchestra.run.smithi086.stdout: "mon_mds_skip_sanity": "false", 2024-04-18T14:43:26.133 INFO:teuthology.orchestra.run.smithi086.stdout: "mon_memory_autotune": "true", 2024-04-18T14:43:26.133 INFO:teuthology.orchestra.run.smithi086.stdout: "mon_memory_target": "2147483648", 2024-04-18T14:43:26.133 INFO:teuthology.orchestra.run.smithi086.stdout: "mon_mgr_beacon_grace": "30", 2024-04-18T14:43:26.133 INFO:teuthology.orchestra.run.smithi086.stdout: "mon_mgr_blocklist_interval": "86400.000000", 2024-04-18T14:43:26.133 INFO:teuthology.orchestra.run.smithi086.stdout: "mon_mgr_digest_period": "5", 2024-04-18T14:43:26.133 INFO:teuthology.orchestra.run.smithi086.stdout: "mon_mgr_inactive_grace": "60", 2024-04-18T14:43:26.134 INFO:teuthology.orchestra.run.smithi086.stdout: "mon_mgr_mkfs_grace": "240", 2024-04-18T14:43:26.134 INFO:teuthology.orchestra.run.smithi086.stdout: "mon_mgr_proxy_client_bytes_ratio": "0.300000", 2024-04-18T14:43:26.134 INFO:teuthology.orchestra.run.smithi086.stdout: "mon_min_osdmap_epochs": "500", 2024-04-18T14:43:26.134 INFO:teuthology.orchestra.run.smithi086.stdout: "mon_op_complaint_time": "30", 2024-04-18T14:43:26.134 INFO:teuthology.orchestra.run.smithi086.stdout: "mon_op_history_duration": "600", 2024-04-18T14:43:26.134 INFO:teuthology.orchestra.run.smithi086.stdout: "mon_op_history_size": "20", 2024-04-18T14:43:26.134 INFO:teuthology.orchestra.run.smithi086.stdout: "mon_op_history_slow_op_size": "20", 2024-04-18T14:43:26.134 INFO:teuthology.orchestra.run.smithi086.stdout: "mon_op_history_slow_op_threshold": "10", 2024-04-18T14:43:26.134 INFO:teuthology.orchestra.run.smithi086.stdout: "mon_op_log_threshold": "5", 2024-04-18T14:43:26.134 INFO:teuthology.orchestra.run.smithi086.stdout: "mon_osd_adjust_down_out_interval": "true", 2024-04-18T14:43:26.134 INFO:teuthology.orchestra.run.smithi086.stdout: "mon_osd_adjust_heartbeat_grace": "true", 2024-04-18T14:43:26.134 INFO:teuthology.orchestra.run.smithi086.stdout: "mon_osd_auto_mark_auto_out_in": "true", 2024-04-18T14:43:26.134 INFO:teuthology.orchestra.run.smithi086.stdout: "mon_osd_auto_mark_in": "false", 2024-04-18T14:43:26.135 INFO:teuthology.orchestra.run.smithi086.stdout: "mon_osd_auto_mark_new_in": "true", 2024-04-18T14:43:26.135 INFO:teuthology.orchestra.run.smithi086.stdout: "mon_osd_backfillfull_ratio": "0.900000", 2024-04-18T14:43:26.135 INFO:teuthology.orchestra.run.smithi086.stdout: "mon_osd_blocklist_default_expire": "3600.000000", 2024-04-18T14:43:26.135 INFO:teuthology.orchestra.run.smithi086.stdout: "mon_osd_cache_size": "500", 2024-04-18T14:43:26.135 INFO:teuthology.orchestra.run.smithi086.stdout: "mon_osd_cache_size_min": "134217728", 2024-04-18T14:43:26.135 INFO:teuthology.orchestra.run.smithi086.stdout: "mon_osd_crush_smoke_test": "true", 2024-04-18T14:43:26.135 INFO:teuthology.orchestra.run.smithi086.stdout: "mon_osd_destroyed_out_interval": "600", 2024-04-18T14:43:26.135 INFO:teuthology.orchestra.run.smithi086.stdout: "mon_osd_down_out_interval": "600", 2024-04-18T14:43:26.135 INFO:teuthology.orchestra.run.smithi086.stdout: "mon_osd_down_out_subtree_limit": "rack", 2024-04-18T14:43:26.135 INFO:teuthology.orchestra.run.smithi086.stdout: "mon_osd_err_op_age_ratio": "128.000000", 2024-04-18T14:43:26.135 INFO:teuthology.orchestra.run.smithi086.stdout: "mon_osd_force_trim_to": "0", 2024-04-18T14:43:26.135 INFO:teuthology.orchestra.run.smithi086.stdout: "mon_osd_full_ratio": "0.950000", 2024-04-18T14:43:26.135 INFO:teuthology.orchestra.run.smithi086.stdout: "mon_osd_initial_require_min_compat_client": "luminous", 2024-04-18T14:43:26.135 INFO:teuthology.orchestra.run.smithi086.stdout: "mon_osd_laggy_halflife": "3600", 2024-04-18T14:43:26.135 INFO:teuthology.orchestra.run.smithi086.stdout: "mon_osd_laggy_max_interval": "300", 2024-04-18T14:43:26.136 INFO:teuthology.orchestra.run.smithi086.stdout: "mon_osd_laggy_weight": "0.300000", 2024-04-18T14:43:26.136 INFO:teuthology.orchestra.run.smithi086.stdout: "mon_osd_mapping_pgs_per_chunk": "4096", 2024-04-18T14:43:26.136 INFO:teuthology.orchestra.run.smithi086.stdout: "mon_osd_max_creating_pgs": "1024", 2024-04-18T14:43:26.136 INFO:teuthology.orchestra.run.smithi086.stdout: "mon_osd_max_initial_pgs": "1024", 2024-04-18T14:43:26.136 INFO:teuthology.orchestra.run.smithi086.stdout: "mon_osd_min_down_reporters": "2", 2024-04-18T14:43:26.136 INFO:teuthology.orchestra.run.smithi086.stdout: "mon_osd_min_in_ratio": "0.750000", 2024-04-18T14:43:26.136 INFO:teuthology.orchestra.run.smithi086.stdout: "mon_osd_min_up_ratio": "0.300000", 2024-04-18T14:43:26.136 INFO:teuthology.orchestra.run.smithi086.stdout: "mon_osd_nearfull_ratio": "0.850000", 2024-04-18T14:43:26.136 INFO:teuthology.orchestra.run.smithi086.stdout: "mon_osd_prime_pg_temp": "true", 2024-04-18T14:43:26.136 INFO:teuthology.orchestra.run.smithi086.stdout: "mon_osd_prime_pg_temp_max_estimate": "0.250000", 2024-04-18T14:43:26.136 INFO:teuthology.orchestra.run.smithi086.stdout: "mon_osd_prime_pg_temp_max_time": "0.500000", 2024-04-18T14:43:26.136 INFO:teuthology.orchestra.run.smithi086.stdout: "mon_osd_report_timeout": "900", 2024-04-18T14:43:26.136 INFO:teuthology.orchestra.run.smithi086.stdout: "mon_osd_reporter_subtree_level": "osd", 2024-04-18T14:43:26.136 INFO:teuthology.orchestra.run.smithi086.stdout: "mon_osd_snap_trim_queue_warn_on": "32768", 2024-04-18T14:43:26.136 INFO:teuthology.orchestra.run.smithi086.stdout: "mon_osd_warn_num_repaired": "10", 2024-04-18T14:43:26.137 INFO:teuthology.orchestra.run.smithi086.stdout: "mon_osd_warn_op_age": "32.000000", 2024-04-18T14:43:26.137 INFO:teuthology.orchestra.run.smithi086.stdout: "mon_osdmap_full_prune_enabled": "true", 2024-04-18T14:43:26.137 INFO:teuthology.orchestra.run.smithi086.stdout: "mon_osdmap_full_prune_interval": "10", 2024-04-18T14:43:26.137 INFO:teuthology.orchestra.run.smithi086.stdout: "mon_osdmap_full_prune_min": "10000", 2024-04-18T14:43:26.137 INFO:teuthology.orchestra.run.smithi086.stdout: "mon_osdmap_full_prune_txsize": "100", 2024-04-18T14:43:26.137 INFO:teuthology.orchestra.run.smithi086.stdout: "mon_pg_check_down_all_threshold": "0.500000", 2024-04-18T14:43:26.137 INFO:teuthology.orchestra.run.smithi086.stdout: "mon_pg_stuck_threshold": "60", 2024-04-18T14:43:26.137 INFO:teuthology.orchestra.run.smithi086.stdout: "mon_pg_warn_max_object_skew": "0.000000", 2024-04-18T14:43:26.137 INFO:teuthology.orchestra.run.smithi086.stdout: "mon_pg_warn_min_objects": "10000", 2024-04-18T14:43:26.137 INFO:teuthology.orchestra.run.smithi086.stdout: "mon_pg_warn_min_per_osd": "0", 2024-04-18T14:43:26.137 INFO:teuthology.orchestra.run.smithi086.stdout: "mon_pg_warn_min_pool_objects": "1000", 2024-04-18T14:43:26.137 INFO:teuthology.orchestra.run.smithi086.stdout: "mon_pool_quota_crit_threshold": "0", 2024-04-18T14:43:26.137 INFO:teuthology.orchestra.run.smithi086.stdout: "mon_pool_quota_warn_threshold": "0", 2024-04-18T14:43:26.138 INFO:teuthology.orchestra.run.smithi086.stdout: "mon_probe_timeout": "2.000000", 2024-04-18T14:43:26.138 INFO:teuthology.orchestra.run.smithi086.stdout: "mon_reweight_max_change": "0.050000", 2024-04-18T14:43:26.138 INFO:teuthology.orchestra.run.smithi086.stdout: "mon_reweight_max_osds": "4", 2024-04-18T14:43:26.138 INFO:teuthology.orchestra.run.smithi086.stdout: "mon_reweight_min_bytes_per_osd": "10", 2024-04-18T14:43:26.138 INFO:teuthology.orchestra.run.smithi086.stdout: "mon_reweight_min_pgs_per_osd": "4", 2024-04-18T14:43:26.138 INFO:teuthology.orchestra.run.smithi086.stdout: "mon_rocksdb_options": "write_buffer_size=33554432,compression=kNoCompression,level_compaction_dynamic_level_bytes=true", 2024-04-18T14:43:26.138 INFO:teuthology.orchestra.run.smithi086.stdout: "mon_scrub_inject_crc_mismatch": "0.000000", 2024-04-18T14:43:26.138 INFO:teuthology.orchestra.run.smithi086.stdout: "mon_scrub_inject_missing_keys": "0.000000", 2024-04-18T14:43:26.138 INFO:teuthology.orchestra.run.smithi086.stdout: "mon_scrub_interval": "300", 2024-04-18T14:43:26.138 INFO:teuthology.orchestra.run.smithi086.stdout: "mon_scrub_max_keys": "100", 2024-04-18T14:43:26.138 INFO:teuthology.orchestra.run.smithi086.stdout: "mon_scrub_timeout": "300", 2024-04-18T14:43:26.138 INFO:teuthology.orchestra.run.smithi086.stdout: "mon_session_timeout": "300", 2024-04-18T14:43:26.138 INFO:teuthology.orchestra.run.smithi086.stdout: "mon_smart_report_timeout": "5", 2024-04-18T14:43:26.138 INFO:teuthology.orchestra.run.smithi086.stdout: "mon_stat_smooth_intervals": "6", 2024-04-18T14:43:26.139 INFO:teuthology.orchestra.run.smithi086.stdout: "mon_stretch_cluster_recovery_ratio": "0.600000", 2024-04-18T14:43:26.139 INFO:teuthology.orchestra.run.smithi086.stdout: "mon_stretch_pool_min_size": "2", 2024-04-18T14:43:26.139 INFO:teuthology.orchestra.run.smithi086.stdout: "mon_stretch_pool_size": "4", 2024-04-18T14:43:26.139 INFO:teuthology.orchestra.run.smithi086.stdout: "mon_stretch_recovery_min_wait": "15.000000", 2024-04-18T14:43:26.139 INFO:teuthology.orchestra.run.smithi086.stdout: "mon_subscribe_interval": "86400.000000", 2024-04-18T14:43:26.139 INFO:teuthology.orchestra.run.smithi086.stdout: "mon_sync_debug": "false", 2024-04-18T14:43:26.139 INFO:teuthology.orchestra.run.smithi086.stdout: "mon_sync_max_payload_keys": "2000", 2024-04-18T14:43:26.139 INFO:teuthology.orchestra.run.smithi086.stdout: "mon_sync_max_payload_size": "1048576", 2024-04-18T14:43:26.139 INFO:teuthology.orchestra.run.smithi086.stdout: "mon_sync_provider_kill_at": "0", 2024-04-18T14:43:26.139 INFO:teuthology.orchestra.run.smithi086.stdout: "mon_sync_requester_kill_at": "0", 2024-04-18T14:43:26.139 INFO:teuthology.orchestra.run.smithi086.stdout: "mon_sync_timeout": "60.000000", 2024-04-18T14:43:26.139 INFO:teuthology.orchestra.run.smithi086.stdout: "mon_target_pg_per_osd": "100", 2024-04-18T14:43:26.139 INFO:teuthology.orchestra.run.smithi086.stdout: "mon_tick_interval": "5", 2024-04-18T14:43:26.139 INFO:teuthology.orchestra.run.smithi086.stdout: "mon_timecheck_interval": "300.000000", 2024-04-18T14:43:26.140 INFO:teuthology.orchestra.run.smithi086.stdout: "mon_timecheck_skew_interval": "30.000000", 2024-04-18T14:43:26.140 INFO:teuthology.orchestra.run.smithi086.stdout: "mon_use_min_delay_socket": "false", 2024-04-18T14:43:26.140 INFO:teuthology.orchestra.run.smithi086.stdout: "mon_warn_older_version_delay": "604800", 2024-04-18T14:43:26.140 INFO:teuthology.orchestra.run.smithi086.stdout: "mon_warn_on_cache_pools_without_hit_sets": "true", 2024-04-18T14:43:26.140 INFO:teuthology.orchestra.run.smithi086.stdout: "mon_warn_on_crush_straw_calc_version_zero": "false", 2024-04-18T14:43:26.140 INFO:teuthology.orchestra.run.smithi086.stdout: "mon_warn_on_degraded_stretch_mode": "true", 2024-04-18T14:43:26.140 INFO:teuthology.orchestra.run.smithi086.stdout: "mon_warn_on_filestore_osds": "false", 2024-04-18T14:43:26.140 INFO:teuthology.orchestra.run.smithi086.stdout: "mon_warn_on_insecure_global_id_reclaim": "false", 2024-04-18T14:43:26.140 INFO:teuthology.orchestra.run.smithi086.stdout: "mon_warn_on_insecure_global_id_reclaim_allowed": "false", 2024-04-18T14:43:26.140 INFO:teuthology.orchestra.run.smithi086.stdout: "mon_warn_on_legacy_crush_tunables": "false", 2024-04-18T14:43:26.140 INFO:teuthology.orchestra.run.smithi086.stdout: "mon_warn_on_misplaced": "false", 2024-04-18T14:43:26.140 INFO:teuthology.orchestra.run.smithi086.stdout: "mon_warn_on_msgr2_not_enabled": "true", 2024-04-18T14:43:26.140 INFO:teuthology.orchestra.run.smithi086.stdout: "mon_warn_on_older_version": "true", 2024-04-18T14:43:26.140 INFO:teuthology.orchestra.run.smithi086.stdout: "mon_warn_on_osd_down_out_interval_zero": "false", 2024-04-18T14:43:26.140 INFO:teuthology.orchestra.run.smithi086.stdout: "mon_warn_on_pool_no_app": "true", 2024-04-18T14:43:26.141 INFO:teuthology.orchestra.run.smithi086.stdout: "mon_warn_on_pool_no_redundancy": "false", 2024-04-18T14:43:26.141 INFO:teuthology.orchestra.run.smithi086.stdout: "mon_warn_on_pool_pg_num_not_power_of_two": "false", 2024-04-18T14:43:26.141 INFO:teuthology.orchestra.run.smithi086.stdout: "mon_warn_on_slow_ping_ratio": "0.050000", 2024-04-18T14:43:26.141 INFO:teuthology.orchestra.run.smithi086.stdout: "mon_warn_on_slow_ping_time": "0.000000", 2024-04-18T14:43:26.141 INFO:teuthology.orchestra.run.smithi086.stdout: "mon_warn_on_too_few_osds": "false", 2024-04-18T14:43:26.141 INFO:teuthology.orchestra.run.smithi086.stdout: "mon_warn_pg_not_deep_scrubbed_ratio": "0.750000", 2024-04-18T14:43:26.141 INFO:teuthology.orchestra.run.smithi086.stdout: "mon_warn_pg_not_scrubbed_ratio": "0.500000", 2024-04-18T14:43:26.141 INFO:teuthology.orchestra.run.smithi086.stdout: "monmap": "", 2024-04-18T14:43:26.141 INFO:teuthology.orchestra.run.smithi086.stdout: "motr_admin_endpoint": "192.168.180.182@tcp:12345:4:1", 2024-04-18T14:43:26.141 INFO:teuthology.orchestra.run.smithi086.stdout: "motr_admin_fid": "0x7200000000000001:0x0", 2024-04-18T14:43:26.141 INFO:teuthology.orchestra.run.smithi086.stdout: "motr_ha_endpoint": "192.168.180.182@tcp:12345:1:1", 2024-04-18T14:43:26.141 INFO:teuthology.orchestra.run.smithi086.stdout: "motr_my_endpoint": "192.168.180.182@tcp:12345:4:1", 2024-04-18T14:43:26.141 INFO:teuthology.orchestra.run.smithi086.stdout: "motr_my_fid": "0x7200000000000001:0x0", 2024-04-18T14:43:26.141 INFO:teuthology.orchestra.run.smithi086.stdout: "motr_profile_fid": "0x7000000000000001:0x0", 2024-04-18T14:43:26.142 INFO:teuthology.orchestra.run.smithi086.stdout: "motr_tracing_enabled": "false", 2024-04-18T14:43:26.142 INFO:teuthology.orchestra.run.smithi086.stdout: "ms_async_op_threads": "3", 2024-04-18T14:43:26.142 INFO:teuthology.orchestra.run.smithi086.stdout: "ms_async_rdma_buffer_size": "131072", 2024-04-18T14:43:26.142 INFO:teuthology.orchestra.run.smithi086.stdout: "ms_async_rdma_cm": "false", 2024-04-18T14:43:26.142 INFO:teuthology.orchestra.run.smithi086.stdout: "ms_async_rdma_device_name": "", 2024-04-18T14:43:26.142 INFO:teuthology.orchestra.run.smithi086.stdout: "ms_async_rdma_dscp": "96", 2024-04-18T14:43:26.142 INFO:teuthology.orchestra.run.smithi086.stdout: "ms_async_rdma_enable_hugepage": "false", 2024-04-18T14:43:26.142 INFO:teuthology.orchestra.run.smithi086.stdout: "ms_async_rdma_gid_idx": "0", 2024-04-18T14:43:26.142 INFO:teuthology.orchestra.run.smithi086.stdout: "ms_async_rdma_local_gid": "", 2024-04-18T14:43:26.142 INFO:teuthology.orchestra.run.smithi086.stdout: "ms_async_rdma_polling_us": "1000", 2024-04-18T14:43:26.142 INFO:teuthology.orchestra.run.smithi086.stdout: "ms_async_rdma_port_num": "1", 2024-04-18T14:43:26.142 INFO:teuthology.orchestra.run.smithi086.stdout: "ms_async_rdma_receive_buffers": "32768", 2024-04-18T14:43:26.142 INFO:teuthology.orchestra.run.smithi086.stdout: "ms_async_rdma_receive_queue_len": "4096", 2024-04-18T14:43:26.142 INFO:teuthology.orchestra.run.smithi086.stdout: "ms_async_rdma_roce_ver": "1", 2024-04-18T14:43:26.143 INFO:teuthology.orchestra.run.smithi086.stdout: "ms_async_rdma_send_buffers": "1024", 2024-04-18T14:43:26.143 INFO:teuthology.orchestra.run.smithi086.stdout: "ms_async_rdma_sl": "3", 2024-04-18T14:43:26.143 INFO:teuthology.orchestra.run.smithi086.stdout: "ms_async_rdma_support_srq": "true", 2024-04-18T14:43:26.143 INFO:teuthology.orchestra.run.smithi086.stdout: "ms_async_rdma_type": "ib", 2024-04-18T14:43:26.143 INFO:teuthology.orchestra.run.smithi086.stdout: "ms_async_reap_threshold": "5", 2024-04-18T14:43:26.143 INFO:teuthology.orchestra.run.smithi086.stdout: "ms_bind_before_connect": "false", 2024-04-18T14:43:26.143 INFO:teuthology.orchestra.run.smithi086.stdout: "ms_bind_ipv4": "true", 2024-04-18T14:43:26.143 INFO:teuthology.orchestra.run.smithi086.stdout: "ms_bind_ipv6": "false", 2024-04-18T14:43:26.143 INFO:teuthology.orchestra.run.smithi086.stdout: "ms_bind_msgr1": "true", 2024-04-18T14:43:26.143 INFO:teuthology.orchestra.run.smithi086.stdout: "ms_bind_msgr2": "true", 2024-04-18T14:43:26.143 INFO:teuthology.orchestra.run.smithi086.stdout: "ms_bind_port_max": "7568", 2024-04-18T14:43:26.143 INFO:teuthology.orchestra.run.smithi086.stdout: "ms_bind_port_min": "6800", 2024-04-18T14:43:26.143 INFO:teuthology.orchestra.run.smithi086.stdout: "ms_bind_prefer_ipv4": "false", 2024-04-18T14:43:26.143 INFO:teuthology.orchestra.run.smithi086.stdout: "ms_bind_retry_count": "3", 2024-04-18T14:43:26.143 INFO:teuthology.orchestra.run.smithi086.stdout: "ms_bind_retry_delay": "5", 2024-04-18T14:43:26.144 INFO:teuthology.orchestra.run.smithi086.stdout: "ms_blackhole_client": "false", 2024-04-18T14:43:26.144 INFO:teuthology.orchestra.run.smithi086.stdout: "ms_blackhole_mds": "false", 2024-04-18T14:43:26.144 INFO:teuthology.orchestra.run.smithi086.stdout: "ms_blackhole_mgr": "false", 2024-04-18T14:43:26.144 INFO:teuthology.orchestra.run.smithi086.stdout: "ms_blackhole_mon": "false", 2024-04-18T14:43:26.144 INFO:teuthology.orchestra.run.smithi086.stdout: "ms_blackhole_osd": "false", 2024-04-18T14:43:26.144 INFO:teuthology.orchestra.run.smithi086.stdout: "ms_client_mode": "crc secure", 2024-04-18T14:43:26.144 INFO:teuthology.orchestra.run.smithi086.stdout: "ms_cluster_mode": "crc secure", 2024-04-18T14:43:26.144 INFO:teuthology.orchestra.run.smithi086.stdout: "ms_cluster_type": "", 2024-04-18T14:43:26.144 INFO:teuthology.orchestra.run.smithi086.stdout: "ms_compress_secure": "false", 2024-04-18T14:43:26.144 INFO:teuthology.orchestra.run.smithi086.stdout: "ms_connection_idle_timeout": "900", 2024-04-18T14:43:26.144 INFO:teuthology.orchestra.run.smithi086.stdout: "ms_connection_ready_timeout": "10", 2024-04-18T14:43:26.144 INFO:teuthology.orchestra.run.smithi086.stdout: "ms_crc_data": "true", 2024-04-18T14:43:26.145 INFO:teuthology.orchestra.run.smithi086.stdout: "ms_crc_header": "true", 2024-04-18T14:43:26.145 INFO:teuthology.orchestra.run.smithi086.stdout: "ms_die_on_bad_msg": "false", 2024-04-18T14:43:26.145 INFO:teuthology.orchestra.run.smithi086.stdout: "ms_die_on_bug": "true", 2024-04-18T14:43:26.145 INFO:teuthology.orchestra.run.smithi086.stdout: "ms_die_on_old_message": "true", 2024-04-18T14:43:26.145 INFO:teuthology.orchestra.run.smithi086.stdout: "ms_die_on_skipped_message": "false", 2024-04-18T14:43:26.145 INFO:teuthology.orchestra.run.smithi086.stdout: "ms_die_on_unhandled_msg": "false", 2024-04-18T14:43:26.145 INFO:teuthology.orchestra.run.smithi086.stdout: "ms_dispatch_throttle_bytes": "104857600", 2024-04-18T14:43:26.145 INFO:teuthology.orchestra.run.smithi086.stdout: "ms_dpdk_coremask": "0xF", 2024-04-18T14:43:26.145 INFO:teuthology.orchestra.run.smithi086.stdout: "ms_dpdk_debug_allow_loopback": "false", 2024-04-18T14:43:26.145 INFO:teuthology.orchestra.run.smithi086.stdout: "ms_dpdk_devs_allowlist": "", 2024-04-18T14:43:26.145 INFO:teuthology.orchestra.run.smithi086.stdout: "ms_dpdk_enable_tso": "true", 2024-04-18T14:43:26.145 INFO:teuthology.orchestra.run.smithi086.stdout: "ms_dpdk_gateway_ipv4_addr": "", 2024-04-18T14:43:26.145 INFO:teuthology.orchestra.run.smithi086.stdout: "ms_dpdk_host_ipv4_addr": "", 2024-04-18T14:43:26.145 INFO:teuthology.orchestra.run.smithi086.stdout: "ms_dpdk_hugepages": "", 2024-04-18T14:43:26.145 INFO:teuthology.orchestra.run.smithi086.stdout: "ms_dpdk_hw_flow_control": "true", 2024-04-18T14:43:26.146 INFO:teuthology.orchestra.run.smithi086.stdout: "ms_dpdk_hw_queue_weight": "1.000000", 2024-04-18T14:43:26.146 INFO:teuthology.orchestra.run.smithi086.stdout: "ms_dpdk_lro": "true", 2024-04-18T14:43:26.146 INFO:teuthology.orchestra.run.smithi086.stdout: "ms_dpdk_memory_channel": "4", 2024-04-18T14:43:26.146 INFO:teuthology.orchestra.run.smithi086.stdout: "ms_dpdk_netmask_ipv4_addr": "", 2024-04-18T14:43:26.146 INFO:teuthology.orchestra.run.smithi086.stdout: "ms_dpdk_pmd": "", 2024-04-18T14:43:26.146 INFO:teuthology.orchestra.run.smithi086.stdout: "ms_dpdk_port_id": "0", 2024-04-18T14:43:26.146 INFO:teuthology.orchestra.run.smithi086.stdout: "ms_dpdk_rx_buffer_count_per_core": "8192", 2024-04-18T14:43:26.146 INFO:teuthology.orchestra.run.smithi086.stdout: "ms_dump_corrupt_message_level": "1", 2024-04-18T14:43:26.146 INFO:teuthology.orchestra.run.smithi086.stdout: "ms_dump_on_send": "false", 2024-04-18T14:43:26.146 INFO:teuthology.orchestra.run.smithi086.stdout: "ms_initial_backoff": "0.200000", 2024-04-18T14:43:26.146 INFO:teuthology.orchestra.run.smithi086.stdout: "ms_inject_delay_max": "1.000000", 2024-04-18T14:43:26.146 INFO:teuthology.orchestra.run.smithi086.stdout: "ms_inject_delay_probability": "0.000000", 2024-04-18T14:43:26.146 INFO:teuthology.orchestra.run.smithi086.stdout: "ms_inject_delay_type": "", 2024-04-18T14:43:26.147 INFO:teuthology.orchestra.run.smithi086.stdout: "ms_inject_internal_delays": "0.000000", 2024-04-18T14:43:26.147 INFO:teuthology.orchestra.run.smithi086.stdout: "ms_inject_network_congestion": "0", 2024-04-18T14:43:26.147 INFO:teuthology.orchestra.run.smithi086.stdout: "ms_inject_socket_failures": "5000", 2024-04-18T14:43:26.147 INFO:teuthology.orchestra.run.smithi086.stdout: "ms_learn_addr_from_peer": "true", 2024-04-18T14:43:26.147 INFO:teuthology.orchestra.run.smithi086.stdout: "ms_max_accept_failures": "4", 2024-04-18T14:43:26.147 INFO:teuthology.orchestra.run.smithi086.stdout: "ms_max_backoff": "15.000000", 2024-04-18T14:43:26.147 INFO:teuthology.orchestra.run.smithi086.stdout: "ms_mon_client_mode": "secure crc", 2024-04-18T14:43:26.147 INFO:teuthology.orchestra.run.smithi086.stdout: "ms_mon_cluster_mode": "secure crc", 2024-04-18T14:43:26.147 INFO:teuthology.orchestra.run.smithi086.stdout: "ms_mon_service_mode": "secure crc", 2024-04-18T14:43:26.147 INFO:teuthology.orchestra.run.smithi086.stdout: "ms_osd_compress_min_size": "1024", 2024-04-18T14:43:26.147 INFO:teuthology.orchestra.run.smithi086.stdout: "ms_osd_compress_mode": "none", 2024-04-18T14:43:26.147 INFO:teuthology.orchestra.run.smithi086.stdout: "ms_osd_compression_algorithm": "snappy", 2024-04-18T14:43:26.148 INFO:teuthology.orchestra.run.smithi086.stdout: "ms_pq_max_tokens_per_priority": "16777216", 2024-04-18T14:43:26.148 INFO:teuthology.orchestra.run.smithi086.stdout: "ms_pq_min_cost": "65536", 2024-04-18T14:43:26.148 INFO:teuthology.orchestra.run.smithi086.stdout: "ms_public_type": "", 2024-04-18T14:43:26.148 INFO:teuthology.orchestra.run.smithi086.stdout: "ms_service_mode": "crc secure", 2024-04-18T14:43:26.148 INFO:teuthology.orchestra.run.smithi086.stdout: "ms_tcp_listen_backlog": "512", 2024-04-18T14:43:26.148 INFO:teuthology.orchestra.run.smithi086.stdout: "ms_tcp_nodelay": "true", 2024-04-18T14:43:26.148 INFO:teuthology.orchestra.run.smithi086.stdout: "ms_tcp_prefetch_max_size": "4096", 2024-04-18T14:43:26.148 INFO:teuthology.orchestra.run.smithi086.stdout: "ms_tcp_rcvbuf": "0", 2024-04-18T14:43:26.148 INFO:teuthology.orchestra.run.smithi086.stdout: "ms_type": "async+posix", 2024-04-18T14:43:26.148 INFO:teuthology.orchestra.run.smithi086.stdout: "no_config_file": "false", 2024-04-18T14:43:26.148 INFO:teuthology.orchestra.run.smithi086.stdout: "objecter_completion_locks_per_session": "32", 2024-04-18T14:43:26.148 INFO:teuthology.orchestra.run.smithi086.stdout: "objecter_debug_inject_relock_delay": "false", 2024-04-18T14:43:26.148 INFO:teuthology.orchestra.run.smithi086.stdout: "objecter_inflight_op_bytes": "104857600", 2024-04-18T14:43:26.148 INFO:teuthology.orchestra.run.smithi086.stdout: "objecter_inflight_ops": "1024", 2024-04-18T14:43:26.148 INFO:teuthology.orchestra.run.smithi086.stdout: "objecter_inject_no_watch_ping": "false", 2024-04-18T14:43:26.149 INFO:teuthology.orchestra.run.smithi086.stdout: "objecter_retry_writes_after_first_reply": "false", 2024-04-18T14:43:26.149 INFO:teuthology.orchestra.run.smithi086.stdout: "objecter_tick_interval": "5.000000", 2024-04-18T14:43:26.149 INFO:teuthology.orchestra.run.smithi086.stdout: "objecter_timeout": "10.000000", 2024-04-18T14:43:26.149 INFO:teuthology.orchestra.run.smithi086.stdout: "objectstore_blackhole": "false", 2024-04-18T14:43:26.149 INFO:teuthology.orchestra.run.smithi086.stdout: "openssl_engine_opts": "", 2024-04-18T14:43:26.149 INFO:teuthology.orchestra.run.smithi086.stdout: "osd_agent_delay_time": "5.000000", 2024-04-18T14:43:26.149 INFO:teuthology.orchestra.run.smithi086.stdout: "osd_agent_hist_halflife": "1000", 2024-04-18T14:43:26.149 INFO:teuthology.orchestra.run.smithi086.stdout: "osd_agent_max_low_ops": "2", 2024-04-18T14:43:26.149 INFO:teuthology.orchestra.run.smithi086.stdout: "osd_agent_max_ops": "4", 2024-04-18T14:43:26.149 INFO:teuthology.orchestra.run.smithi086.stdout: "osd_agent_min_evict_effort": "0.100000", 2024-04-18T14:43:26.149 INFO:teuthology.orchestra.run.smithi086.stdout: "osd_agent_quantize_effort": "0.100000", 2024-04-18T14:43:26.149 INFO:teuthology.orchestra.run.smithi086.stdout: "osd_agent_slop": "0.020000", 2024-04-18T14:43:26.149 INFO:teuthology.orchestra.run.smithi086.stdout: "osd_aggregated_slow_ops_logging": "true", 2024-04-18T14:43:26.149 INFO:teuthology.orchestra.run.smithi086.stdout: "osd_allow_recovery_below_min_size": "true", 2024-04-18T14:43:26.149 INFO:teuthology.orchestra.run.smithi086.stdout: "osd_asio_thread_count": "2", 2024-04-18T14:43:26.150 INFO:teuthology.orchestra.run.smithi086.stdout: "osd_async_recovery_min_cost": "100", 2024-04-18T14:43:26.150 INFO:teuthology.orchestra.run.smithi086.stdout: "osd_auto_mark_unfound_lost": "false", 2024-04-18T14:43:26.150 INFO:teuthology.orchestra.run.smithi086.stdout: "osd_backfill_retry_interval": "30.000000", 2024-04-18T14:43:26.150 INFO:teuthology.orchestra.run.smithi086.stdout: "osd_backfill_scan_max": "512", 2024-04-18T14:43:26.150 INFO:teuthology.orchestra.run.smithi086.stdout: "osd_backfill_scan_min": "64", 2024-04-18T14:43:26.150 INFO:teuthology.orchestra.run.smithi086.stdout: "osd_backoff_on_degraded": "false", 2024-04-18T14:43:26.150 INFO:teuthology.orchestra.run.smithi086.stdout: "osd_backoff_on_peering": "false", 2024-04-18T14:43:26.150 INFO:teuthology.orchestra.run.smithi086.stdout: "osd_backoff_on_unfound": "true", 2024-04-18T14:43:26.150 INFO:teuthology.orchestra.run.smithi086.stdout: "osd_beacon_report_interval": "300", 2024-04-18T14:43:26.150 INFO:teuthology.orchestra.run.smithi086.stdout: "osd_bench_duration": "30", 2024-04-18T14:43:26.150 INFO:teuthology.orchestra.run.smithi086.stdout: "osd_bench_large_size_max_throughput": "104857600", 2024-04-18T14:43:26.150 INFO:teuthology.orchestra.run.smithi086.stdout: "osd_bench_max_block_size": "67108864", 2024-04-18T14:43:26.150 INFO:teuthology.orchestra.run.smithi086.stdout: "osd_bench_small_size_max_iops": "100", 2024-04-18T14:43:26.150 INFO:teuthology.orchestra.run.smithi086.stdout: "osd_blkin_trace_all": "false", 2024-04-18T14:43:26.151 INFO:teuthology.orchestra.run.smithi086.stdout: "osd_blocked_scrub_grace_period": "120", 2024-04-18T14:43:26.151 INFO:teuthology.orchestra.run.smithi086.stdout: "osd_calc_pg_upmaps_aggressively": "true", 2024-04-18T14:43:26.151 INFO:teuthology.orchestra.run.smithi086.stdout: "osd_calc_pg_upmaps_aggressively_fast": "true", 2024-04-18T14:43:26.151 INFO:teuthology.orchestra.run.smithi086.stdout: "osd_calc_pg_upmaps_local_fallback_retries": "100", 2024-04-18T14:43:26.151 INFO:teuthology.orchestra.run.smithi086.stdout: "osd_check_for_log_corruption": "false", 2024-04-18T14:43:26.151 INFO:teuthology.orchestra.run.smithi086.stdout: "osd_check_max_object_name_len_on_startup": "true", 2024-04-18T14:43:26.151 INFO:teuthology.orchestra.run.smithi086.stdout: "osd_class_default_list": "cephfs hello journal lock log numops otp rbd refcount rgw rgw_gc timeindex user version cas cmpomap queue 2pc_queue fifo", 2024-04-18T14:43:26.151 INFO:teuthology.orchestra.run.smithi086.stdout: "osd_class_dir": "/usr/lib/rados-classes", 2024-04-18T14:43:26.151 INFO:teuthology.orchestra.run.smithi086.stdout: "osd_class_load_list": "cephfs hello journal lock log numops otp rbd refcount rgw rgw_gc timeindex user version cas cmpomap queue 2pc_queue fifo", 2024-04-18T14:43:26.151 INFO:teuthology.orchestra.run.smithi086.stdout: "osd_class_update_on_start": "true", 2024-04-18T14:43:26.151 INFO:teuthology.orchestra.run.smithi086.stdout: "osd_client_message_cap": "256", 2024-04-18T14:43:26.151 INFO:teuthology.orchestra.run.smithi086.stdout: "osd_client_message_size_cap": "524288000", 2024-04-18T14:43:26.151 INFO:teuthology.orchestra.run.smithi086.stdout: "osd_client_op_priority": "63", 2024-04-18T14:43:26.151 INFO:teuthology.orchestra.run.smithi086.stdout: "osd_client_watch_timeout": "30", 2024-04-18T14:43:26.151 INFO:teuthology.orchestra.run.smithi086.stdout: "osd_command_max_records": "256", 2024-04-18T14:43:26.152 INFO:teuthology.orchestra.run.smithi086.stdout: "osd_compact_on_start": "false", 2024-04-18T14:43:26.152 INFO:teuthology.orchestra.run.smithi086.stdout: "osd_copyfrom_max_chunk": "8388608", 2024-04-18T14:43:26.152 INFO:teuthology.orchestra.run.smithi086.stdout: "osd_crush_chooseleaf_type": "0", 2024-04-18T14:43:26.152 INFO:teuthology.orchestra.run.smithi086.stdout: "osd_crush_initial_weight": "-1.000000", 2024-04-18T14:43:26.152 INFO:teuthology.orchestra.run.smithi086.stdout: "osd_crush_update_on_start": "true", 2024-04-18T14:43:26.152 INFO:teuthology.orchestra.run.smithi086.stdout: "osd_crush_update_weight_set": "true", 2024-04-18T14:43:26.152 INFO:teuthology.orchestra.run.smithi086.stdout: "osd_data": "/var/lib/ceph/osd/ceph-a", 2024-04-18T14:43:26.152 INFO:teuthology.orchestra.run.smithi086.stdout: "osd_debug_crash_on_ignored_backoff": "false", 2024-04-18T14:43:26.152 INFO:teuthology.orchestra.run.smithi086.stdout: "osd_debug_deep_scrub_sleep": "0.000000", 2024-04-18T14:43:26.152 INFO:teuthology.orchestra.run.smithi086.stdout: "osd_debug_drop_ping_duration": "0", 2024-04-18T14:43:26.152 INFO:teuthology.orchestra.run.smithi086.stdout: "osd_debug_drop_ping_probability": "0.000000", 2024-04-18T14:43:26.152 INFO:teuthology.orchestra.run.smithi086.stdout: "osd_debug_feed_pullee": "-1", 2024-04-18T14:43:26.152 INFO:teuthology.orchestra.run.smithi086.stdout: "osd_debug_inject_copyfrom_error": "false", 2024-04-18T14:43:26.152 INFO:teuthology.orchestra.run.smithi086.stdout: "osd_debug_inject_dispatch_delay_duration": "0.100000", 2024-04-18T14:43:26.152 INFO:teuthology.orchestra.run.smithi086.stdout: "osd_debug_inject_dispatch_delay_probability": "0.000000", 2024-04-18T14:43:26.152 INFO:teuthology.orchestra.run.smithi086.stdout: "osd_debug_misdirected_ops": "false", 2024-04-18T14:43:26.153 INFO:teuthology.orchestra.run.smithi086.stdout: "osd_debug_no_acting_change": "false", 2024-04-18T14:43:26.153 INFO:teuthology.orchestra.run.smithi086.stdout: "osd_debug_no_purge_strays": "false", 2024-04-18T14:43:26.153 INFO:teuthology.orchestra.run.smithi086.stdout: "osd_debug_op_order": "false", 2024-04-18T14:43:26.153 INFO:teuthology.orchestra.run.smithi086.stdout: "osd_debug_pg_log_writeout": "false", 2024-04-18T14:43:26.153 INFO:teuthology.orchestra.run.smithi086.stdout: "osd_debug_pretend_recovery_active": "false", 2024-04-18T14:43:26.153 INFO:teuthology.orchestra.run.smithi086.stdout: "osd_debug_random_push_read_error": "0.000000", 2024-04-18T14:43:26.153 INFO:teuthology.orchestra.run.smithi086.stdout: "osd_debug_reject_backfill_probability": "0.000000", 2024-04-18T14:43:26.153 INFO:teuthology.orchestra.run.smithi086.stdout: "osd_debug_shutdown": "false", 2024-04-18T14:43:26.153 INFO:teuthology.orchestra.run.smithi086.stdout: "osd_debug_skip_full_check_in_backfill_reservation": "false", 2024-04-18T14:43:26.153 INFO:teuthology.orchestra.run.smithi086.stdout: "osd_debug_skip_full_check_in_recovery": "false", 2024-04-18T14:43:26.153 INFO:teuthology.orchestra.run.smithi086.stdout: "osd_debug_verify_cached_snaps": "false", 2024-04-18T14:43:26.153 INFO:teuthology.orchestra.run.smithi086.stdout: "osd_debug_verify_missing_on_start": "false", 2024-04-18T14:43:26.153 INFO:teuthology.orchestra.run.smithi086.stdout: "osd_debug_verify_snaps": "false", 2024-04-18T14:43:26.153 INFO:teuthology.orchestra.run.smithi086.stdout: "osd_debug_verify_stray_on_activate": "false", 2024-04-18T14:43:26.153 INFO:teuthology.orchestra.run.smithi086.stdout: "osd_deep_scrub_interval": "604800.000000", 2024-04-18T14:43:26.154 INFO:teuthology.orchestra.run.smithi086.stdout: "osd_deep_scrub_keys": "1024", 2024-04-18T14:43:26.154 INFO:teuthology.orchestra.run.smithi086.stdout: "osd_deep_scrub_large_omap_object_key_threshold": "200000", 2024-04-18T14:43:26.154 INFO:teuthology.orchestra.run.smithi086.stdout: "osd_deep_scrub_large_omap_object_value_sum_threshold": "1073741824", 2024-04-18T14:43:26.154 INFO:teuthology.orchestra.run.smithi086.stdout: "osd_deep_scrub_randomize_ratio": "0.150000", 2024-04-18T14:43:26.154 INFO:teuthology.orchestra.run.smithi086.stdout: "osd_deep_scrub_stride": "524288", 2024-04-18T14:43:26.154 INFO:teuthology.orchestra.run.smithi086.stdout: "osd_deep_scrub_update_digest_min_age": "7200", 2024-04-18T14:43:26.154 INFO:teuthology.orchestra.run.smithi086.stdout: "osd_default_data_pool_replay_window": "5", 2024-04-18T14:43:26.154 INFO:teuthology.orchestra.run.smithi086.stdout: "osd_default_notify_timeout": "30", 2024-04-18T14:43:26.154 INFO:teuthology.orchestra.run.smithi086.stdout: "osd_delete_sleep": "0.000000", 2024-04-18T14:43:26.154 INFO:teuthology.orchestra.run.smithi086.stdout: "osd_delete_sleep_hdd": "5.000000", 2024-04-18T14:43:26.154 INFO:teuthology.orchestra.run.smithi086.stdout: "osd_delete_sleep_hybrid": "1.000000", 2024-04-18T14:43:26.154 INFO:teuthology.orchestra.run.smithi086.stdout: "osd_delete_sleep_ssd": "1.000000", 2024-04-18T14:43:26.154 INFO:teuthology.orchestra.run.smithi086.stdout: "osd_discard_disconnected_ops": "true", 2024-04-18T14:43:26.154 INFO:teuthology.orchestra.run.smithi086.stdout: "osd_enable_op_tracker": "true", 2024-04-18T14:43:26.154 INFO:teuthology.orchestra.run.smithi086.stdout: "osd_erasure_code_plugins": "jerasure lrc", 2024-04-18T14:43:26.155 INFO:teuthology.orchestra.run.smithi086.stdout: "osd_extblkdev_plugins": "vdo", 2024-04-18T14:43:26.155 INFO:teuthology.orchestra.run.smithi086.stdout: "osd_failsafe_full_ratio": "0.970000", 2024-04-18T14:43:26.155 INFO:teuthology.orchestra.run.smithi086.stdout: "osd_fast_fail_on_connection_refused": "true", 2024-04-18T14:43:26.155 INFO:teuthology.orchestra.run.smithi086.stdout: "osd_fast_info": "true", 2024-04-18T14:43:26.155 INFO:teuthology.orchestra.run.smithi086.stdout: "osd_fast_shutdown": "true", 2024-04-18T14:43:26.155 INFO:teuthology.orchestra.run.smithi086.stdout: "osd_fast_shutdown_notify_mon": "true", 2024-04-18T14:43:26.155 INFO:teuthology.orchestra.run.smithi086.stdout: "osd_fast_shutdown_timeout": "15", 2024-04-18T14:43:26.155 INFO:teuthology.orchestra.run.smithi086.stdout: "osd_find_best_info_ignore_history_les": "false", 2024-04-18T14:43:26.155 INFO:teuthology.orchestra.run.smithi086.stdout: "osd_force_auth_primary_missing_objects": "100", 2024-04-18T14:43:26.155 INFO:teuthology.orchestra.run.smithi086.stdout: "osd_force_recovery_pg_log_entries_factor": "1.300000", 2024-04-18T14:43:26.155 INFO:teuthology.orchestra.run.smithi086.stdout: "osd_function_tracing": "false", 2024-04-18T14:43:26.155 INFO:teuthology.orchestra.run.smithi086.stdout: "osd_heartbeat_grace": "20", 2024-04-18T14:43:26.155 INFO:teuthology.orchestra.run.smithi086.stdout: "osd_heartbeat_interval": "6", 2024-04-18T14:43:26.155 INFO:teuthology.orchestra.run.smithi086.stdout: "osd_heartbeat_min_healthy_ratio": "0.330000", 2024-04-18T14:43:26.155 INFO:teuthology.orchestra.run.smithi086.stdout: "osd_heartbeat_min_peers": "10", 2024-04-18T14:43:26.156 INFO:teuthology.orchestra.run.smithi086.stdout: "osd_heartbeat_min_size": "2000", 2024-04-18T14:43:26.156 INFO:teuthology.orchestra.run.smithi086.stdout: "osd_heartbeat_stale": "600", 2024-04-18T14:43:26.156 INFO:teuthology.orchestra.run.smithi086.stdout: "osd_heartbeat_use_min_delay_socket": "false", 2024-04-18T14:43:26.156 INFO:teuthology.orchestra.run.smithi086.stdout: "osd_hit_set_max_size": "100000", 2024-04-18T14:43:26.156 INFO:teuthology.orchestra.run.smithi086.stdout: "osd_hit_set_min_size": "1000", 2024-04-18T14:43:26.156 INFO:teuthology.orchestra.run.smithi086.stdout: "osd_hit_set_namespace": ".ceph-internal", 2024-04-18T14:43:26.156 INFO:teuthology.orchestra.run.smithi086.stdout: "osd_ignore_stale_divergent_priors": "false", 2024-04-18T14:43:26.156 INFO:teuthology.orchestra.run.smithi086.stdout: "osd_inject_bad_map_crc_probability": "0.000000", 2024-04-18T14:43:26.156 INFO:teuthology.orchestra.run.smithi086.stdout: "osd_inject_failure_on_pg_removal": "false", 2024-04-18T14:43:26.156 INFO:teuthology.orchestra.run.smithi086.stdout: "osd_journal": "/var/lib/ceph/osd/ceph-a/journal", 2024-04-18T14:43:26.156 INFO:teuthology.orchestra.run.smithi086.stdout: "osd_journal_flush_on_shutdown": "true", 2024-04-18T14:43:26.156 INFO:teuthology.orchestra.run.smithi086.stdout: "osd_journal_size": "5120", 2024-04-18T14:43:26.156 INFO:teuthology.orchestra.run.smithi086.stdout: "osd_kill_backfill_at": "0", 2024-04-18T14:43:26.156 INFO:teuthology.orchestra.run.smithi086.stdout: "osd_loop_before_reset_tphandle": "64", 2024-04-18T14:43:26.157 INFO:teuthology.orchestra.run.smithi086.stdout: "osd_map_cache_size": "50", 2024-04-18T14:43:26.157 INFO:teuthology.orchestra.run.smithi086.stdout: "osd_map_dedup": "true", 2024-04-18T14:43:26.157 INFO:teuthology.orchestra.run.smithi086.stdout: "osd_map_message_max": "40", 2024-04-18T14:43:26.157 INFO:teuthology.orchestra.run.smithi086.stdout: "osd_map_message_max_bytes": "10485760", 2024-04-18T14:43:26.157 INFO:teuthology.orchestra.run.smithi086.stdout: "osd_map_share_max_epochs": "40", 2024-04-18T14:43:26.157 INFO:teuthology.orchestra.run.smithi086.stdout: "osd_max_attr_name_len": "100", 2024-04-18T14:43:26.157 INFO:teuthology.orchestra.run.smithi086.stdout: "osd_max_attr_size": "0", 2024-04-18T14:43:26.157 INFO:teuthology.orchestra.run.smithi086.stdout: "osd_max_backfills": "1", 2024-04-18T14:43:26.157 INFO:teuthology.orchestra.run.smithi086.stdout: "osd_max_markdown_count": "5", 2024-04-18T14:43:26.157 INFO:teuthology.orchestra.run.smithi086.stdout: "osd_max_markdown_period": "600", 2024-04-18T14:43:26.157 INFO:teuthology.orchestra.run.smithi086.stdout: "osd_max_object_name_len": "2048", 2024-04-18T14:43:26.157 INFO:teuthology.orchestra.run.smithi086.stdout: "osd_max_object_namespace_len": "256", 2024-04-18T14:43:26.157 INFO:teuthology.orchestra.run.smithi086.stdout: "osd_max_object_size": "134217728", 2024-04-18T14:43:26.157 INFO:teuthology.orchestra.run.smithi086.stdout: "osd_max_omap_bytes_per_request": "1073741824", 2024-04-18T14:43:26.157 INFO:teuthology.orchestra.run.smithi086.stdout: "osd_max_omap_entries_per_request": "1024", 2024-04-18T14:43:26.157 INFO:teuthology.orchestra.run.smithi086.stdout: "osd_max_pg_blocked_by": "16", 2024-04-18T14:43:26.158 INFO:teuthology.orchestra.run.smithi086.stdout: "osd_max_pg_log_entries": "10000", 2024-04-18T14:43:26.158 INFO:teuthology.orchestra.run.smithi086.stdout: "osd_max_pg_per_osd_hard_ratio": "3.000000", 2024-04-18T14:43:26.158 INFO:teuthology.orchestra.run.smithi086.stdout: "osd_max_pgls": "1024", 2024-04-18T14:43:26.158 INFO:teuthology.orchestra.run.smithi086.stdout: "osd_max_push_cost": "8388608", 2024-04-18T14:43:26.158 INFO:teuthology.orchestra.run.smithi086.stdout: "osd_max_push_objects": "10", 2024-04-18T14:43:26.158 INFO:teuthology.orchestra.run.smithi086.stdout: "osd_max_scrubs": "3", 2024-04-18T14:43:26.158 INFO:teuthology.orchestra.run.smithi086.stdout: "osd_max_snap_prune_intervals_per_epoch": "512", 2024-04-18T14:43:26.158 INFO:teuthology.orchestra.run.smithi086.stdout: "osd_max_trimming_pgs": "2", 2024-04-18T14:43:26.158 INFO:teuthology.orchestra.run.smithi086.stdout: "osd_max_write_op_reply_len": "64", 2024-04-18T14:43:26.158 INFO:teuthology.orchestra.run.smithi086.stdout: "osd_max_write_size": "90", 2024-04-18T14:43:26.158 INFO:teuthology.orchestra.run.smithi086.stdout: "osd_mclock_force_run_benchmark_on_init": "false", 2024-04-18T14:43:26.158 INFO:teuthology.orchestra.run.smithi086.stdout: "osd_mclock_iops_capacity_threshold_hdd": "500.000000", 2024-04-18T14:43:26.158 INFO:teuthology.orchestra.run.smithi086.stdout: "osd_mclock_iops_capacity_threshold_ssd": "80000.000000", 2024-04-18T14:43:26.158 INFO:teuthology.orchestra.run.smithi086.stdout: "osd_mclock_max_capacity_iops_hdd": "315.000000", 2024-04-18T14:43:26.159 INFO:teuthology.orchestra.run.smithi086.stdout: "osd_mclock_max_capacity_iops_ssd": "21500.000000", 2024-04-18T14:43:26.159 INFO:teuthology.orchestra.run.smithi086.stdout: "osd_mclock_max_sequential_bandwidth_hdd": "157286400", 2024-04-18T14:43:26.159 INFO:teuthology.orchestra.run.smithi086.stdout: "osd_mclock_max_sequential_bandwidth_ssd": "1258291200", 2024-04-18T14:43:26.159 INFO:teuthology.orchestra.run.smithi086.stdout: "osd_mclock_override_recovery_settings": "false", 2024-04-18T14:43:26.159 INFO:teuthology.orchestra.run.smithi086.stdout: "osd_mclock_profile": "balanced", 2024-04-18T14:43:26.159 INFO:teuthology.orchestra.run.smithi086.stdout: "osd_mclock_scheduler_anticipation_timeout": "0.000000", 2024-04-18T14:43:26.159 INFO:teuthology.orchestra.run.smithi086.stdout: "osd_mclock_scheduler_background_best_effort_lim": "0.000000", 2024-04-18T14:43:26.159 INFO:teuthology.orchestra.run.smithi086.stdout: "osd_mclock_scheduler_background_best_effort_res": "0.000000", 2024-04-18T14:43:26.159 INFO:teuthology.orchestra.run.smithi086.stdout: "osd_mclock_scheduler_background_best_effort_wgt": "1", 2024-04-18T14:43:26.159 INFO:teuthology.orchestra.run.smithi086.stdout: "osd_mclock_scheduler_background_recovery_lim": "0.000000", 2024-04-18T14:43:26.159 INFO:teuthology.orchestra.run.smithi086.stdout: "osd_mclock_scheduler_background_recovery_res": "0.000000", 2024-04-18T14:43:26.159 INFO:teuthology.orchestra.run.smithi086.stdout: "osd_mclock_scheduler_background_recovery_wgt": "1", 2024-04-18T14:43:26.159 INFO:teuthology.orchestra.run.smithi086.stdout: "osd_mclock_scheduler_client_lim": "0.000000", 2024-04-18T14:43:26.159 INFO:teuthology.orchestra.run.smithi086.stdout: "osd_mclock_scheduler_client_res": "0.000000", 2024-04-18T14:43:26.159 INFO:teuthology.orchestra.run.smithi086.stdout: "osd_mclock_scheduler_client_wgt": "1", 2024-04-18T14:43:26.159 INFO:teuthology.orchestra.run.smithi086.stdout: "osd_mclock_skip_benchmark": "false", 2024-04-18T14:43:26.160 INFO:teuthology.orchestra.run.smithi086.stdout: "osd_memory_base": "805306368", 2024-04-18T14:43:26.160 INFO:teuthology.orchestra.run.smithi086.stdout: "osd_memory_cache_min": "134217728", 2024-04-18T14:43:26.160 INFO:teuthology.orchestra.run.smithi086.stdout: "osd_memory_cache_resize_interval": "1.000000", 2024-04-18T14:43:26.160 INFO:teuthology.orchestra.run.smithi086.stdout: "osd_memory_expected_fragmentation": "0.150000", 2024-04-18T14:43:26.160 INFO:teuthology.orchestra.run.smithi086.stdout: "osd_memory_target": "4294967296", 2024-04-18T14:43:26.160 INFO:teuthology.orchestra.run.smithi086.stdout: "osd_memory_target_autotune": "false", 2024-04-18T14:43:26.160 INFO:teuthology.orchestra.run.smithi086.stdout: "osd_memory_target_cgroup_limit_ratio": "0.800000", 2024-04-18T14:43:26.160 INFO:teuthology.orchestra.run.smithi086.stdout: "osd_min_pg_log_entries": "250", 2024-04-18T14:43:26.160 INFO:teuthology.orchestra.run.smithi086.stdout: "osd_min_recovery_priority": "0", 2024-04-18T14:43:26.160 INFO:teuthology.orchestra.run.smithi086.stdout: "osd_mon_heartbeat_interval": "30", 2024-04-18T14:43:26.160 INFO:teuthology.orchestra.run.smithi086.stdout: "osd_mon_heartbeat_stat_stale": "3600", 2024-04-18T14:43:26.160 INFO:teuthology.orchestra.run.smithi086.stdout: "osd_mon_report_interval": "5", 2024-04-18T14:43:26.160 INFO:teuthology.orchestra.run.smithi086.stdout: "osd_mon_report_max_in_flight": "2", 2024-04-18T14:43:26.161 INFO:teuthology.orchestra.run.smithi086.stdout: "osd_mon_shutdown_timeout": "5.000000", 2024-04-18T14:43:26.161 INFO:teuthology.orchestra.run.smithi086.stdout: "osd_num_cache_shards": "32", 2024-04-18T14:43:26.161 INFO:teuthology.orchestra.run.smithi086.stdout: "osd_num_op_tracker_shard": "32", 2024-04-18T14:43:26.161 INFO:teuthology.orchestra.run.smithi086.stdout: "osd_numa_auto_affinity": "true", 2024-04-18T14:43:26.161 INFO:teuthology.orchestra.run.smithi086.stdout: "osd_numa_node": "-1", 2024-04-18T14:43:26.161 INFO:teuthology.orchestra.run.smithi086.stdout: "osd_numa_prefer_iface": "true", 2024-04-18T14:43:26.161 INFO:teuthology.orchestra.run.smithi086.stdout: "osd_object_clean_region_max_num_intervals": "10", 2024-04-18T14:43:26.161 INFO:teuthology.orchestra.run.smithi086.stdout: "osd_objecter_finishers": "1", 2024-04-18T14:43:26.161 INFO:teuthology.orchestra.run.smithi086.stdout: "osd_objectstore": "bluestore", 2024-04-18T14:43:26.161 INFO:teuthology.orchestra.run.smithi086.stdout: "osd_objectstore_fuse": "false", 2024-04-18T14:43:26.161 INFO:teuthology.orchestra.run.smithi086.stdout: "osd_objectstore_tracing": "false", 2024-04-18T14:43:26.161 INFO:teuthology.orchestra.run.smithi086.stdout: "osd_op_complaint_time": "30.000000", 2024-04-18T14:43:26.161 INFO:teuthology.orchestra.run.smithi086.stdout: "osd_op_history_duration": "600", 2024-04-18T14:43:26.161 INFO:teuthology.orchestra.run.smithi086.stdout: "osd_op_history_size": "20", 2024-04-18T14:43:26.162 INFO:teuthology.orchestra.run.smithi086.stdout: "osd_op_history_slow_op_size": "20", 2024-04-18T14:43:26.162 INFO:teuthology.orchestra.run.smithi086.stdout: "osd_op_history_slow_op_threshold": "10.000000", 2024-04-18T14:43:26.162 INFO:teuthology.orchestra.run.smithi086.stdout: "osd_op_log_threshold": "5", 2024-04-18T14:43:26.162 INFO:teuthology.orchestra.run.smithi086.stdout: "osd_op_num_shards": "0", 2024-04-18T14:43:26.162 INFO:teuthology.orchestra.run.smithi086.stdout: "osd_op_num_shards_hdd": "5", 2024-04-18T14:43:26.162 INFO:teuthology.orchestra.run.smithi086.stdout: "osd_op_num_shards_ssd": "8", 2024-04-18T14:43:26.162 INFO:teuthology.orchestra.run.smithi086.stdout: "osd_op_num_threads_per_shard": "0", 2024-04-18T14:43:26.162 INFO:teuthology.orchestra.run.smithi086.stdout: "osd_op_num_threads_per_shard_hdd": "1", 2024-04-18T14:43:26.162 INFO:teuthology.orchestra.run.smithi086.stdout: "osd_op_num_threads_per_shard_ssd": "2", 2024-04-18T14:43:26.162 INFO:teuthology.orchestra.run.smithi086.stdout: "osd_op_pq_max_tokens_per_priority": "4194304", 2024-04-18T14:43:26.162 INFO:teuthology.orchestra.run.smithi086.stdout: "osd_op_pq_min_cost": "65536", 2024-04-18T14:43:26.162 INFO:teuthology.orchestra.run.smithi086.stdout: "osd_op_queue": "mclock_scheduler", 2024-04-18T14:43:26.162 INFO:teuthology.orchestra.run.smithi086.stdout: "osd_op_queue_cut_off": "high", 2024-04-18T14:43:26.162 INFO:teuthology.orchestra.run.smithi086.stdout: "osd_op_thread_suicide_timeout": "150", 2024-04-18T14:43:26.163 INFO:teuthology.orchestra.run.smithi086.stdout: "osd_op_thread_timeout": "15", 2024-04-18T14:43:26.163 INFO:teuthology.orchestra.run.smithi086.stdout: "osd_open_classes_on_start": "true", 2024-04-18T14:43:26.163 INFO:teuthology.orchestra.run.smithi086.stdout: "osd_os_flags": "0", 2024-04-18T14:43:26.163 INFO:teuthology.orchestra.run.smithi086.stdout: "osd_peering_op_priority": "255", 2024-04-18T14:43:26.163 INFO:teuthology.orchestra.run.smithi086.stdout: "osd_pg_delete_cost": "1048576", 2024-04-18T14:43:26.163 INFO:teuthology.orchestra.run.smithi086.stdout: "osd_pg_delete_priority": "5", 2024-04-18T14:43:26.163 INFO:teuthology.orchestra.run.smithi086.stdout: "osd_pg_epoch_max_lag_factor": "2.000000", 2024-04-18T14:43:26.163 INFO:teuthology.orchestra.run.smithi086.stdout: "osd_pg_epoch_persisted_max_stale": "40", 2024-04-18T14:43:26.163 INFO:teuthology.orchestra.run.smithi086.stdout: "osd_pg_log_dups_tracked": "3000", 2024-04-18T14:43:26.163 INFO:teuthology.orchestra.run.smithi086.stdout: "osd_pg_log_trim_max": "10000", 2024-04-18T14:43:26.163 INFO:teuthology.orchestra.run.smithi086.stdout: "osd_pg_log_trim_min": "100", 2024-04-18T14:43:26.163 INFO:teuthology.orchestra.run.smithi086.stdout: "osd_pg_max_concurrent_snap_trims": "2", 2024-04-18T14:43:26.163 INFO:teuthology.orchestra.run.smithi086.stdout: "osd_pg_object_context_cache_count": "64", 2024-04-18T14:43:26.163 INFO:teuthology.orchestra.run.smithi086.stdout: "osd_pg_stat_report_interval_max": "500", 2024-04-18T14:43:26.163 INFO:teuthology.orchestra.run.smithi086.stdout: "osd_pool_default_cache_max_evict_check_size": "10", 2024-04-18T14:43:26.163 INFO:teuthology.orchestra.run.smithi086.stdout: "osd_pool_default_cache_min_evict_age": "0", 2024-04-18T14:43:26.164 INFO:teuthology.orchestra.run.smithi086.stdout: "osd_pool_default_cache_min_flush_age": "0", 2024-04-18T14:43:26.164 INFO:teuthology.orchestra.run.smithi086.stdout: "osd_pool_default_cache_target_dirty_high_ratio": "0.600000", 2024-04-18T14:43:26.164 INFO:teuthology.orchestra.run.smithi086.stdout: "osd_pool_default_cache_target_dirty_ratio": "0.400000", 2024-04-18T14:43:26.164 INFO:teuthology.orchestra.run.smithi086.stdout: "osd_pool_default_cache_target_full_ratio": "0.800000", 2024-04-18T14:43:26.164 INFO:teuthology.orchestra.run.smithi086.stdout: "osd_pool_default_crimson": "false", 2024-04-18T14:43:26.164 INFO:teuthology.orchestra.run.smithi086.stdout: "osd_pool_default_crush_rule": "-1", 2024-04-18T14:43:26.164 INFO:teuthology.orchestra.run.smithi086.stdout: "osd_pool_default_ec_fast_read": "false", 2024-04-18T14:43:26.164 INFO:teuthology.orchestra.run.smithi086.stdout: "osd_pool_default_erasure_code_profile": "plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd", 2024-04-18T14:43:26.164 INFO:teuthology.orchestra.run.smithi086.stdout: "osd_pool_default_flag_bulk": "false", 2024-04-18T14:43:26.164 INFO:teuthology.orchestra.run.smithi086.stdout: "osd_pool_default_flag_hashpspool": "true", 2024-04-18T14:43:26.164 INFO:teuthology.orchestra.run.smithi086.stdout: "osd_pool_default_flag_nodelete": "false", 2024-04-18T14:43:26.164 INFO:teuthology.orchestra.run.smithi086.stdout: "osd_pool_default_flag_nopgchange": "false", 2024-04-18T14:43:26.164 INFO:teuthology.orchestra.run.smithi086.stdout: "osd_pool_default_flag_nosizechange": "false", 2024-04-18T14:43:26.164 INFO:teuthology.orchestra.run.smithi086.stdout: "osd_pool_default_flags": "0", 2024-04-18T14:43:26.164 INFO:teuthology.orchestra.run.smithi086.stdout: "osd_pool_default_hit_set_bloom_fpp": "0.050000", 2024-04-18T14:43:26.165 INFO:teuthology.orchestra.run.smithi086.stdout: "osd_pool_default_min_size": "0", 2024-04-18T14:43:26.165 INFO:teuthology.orchestra.run.smithi086.stdout: "osd_pool_default_pg_autoscale_mode": "off", 2024-04-18T14:43:26.165 INFO:teuthology.orchestra.run.smithi086.stdout: "osd_pool_default_pg_num": "32", 2024-04-18T14:43:26.165 INFO:teuthology.orchestra.run.smithi086.stdout: "osd_pool_default_pgp_num": "0", 2024-04-18T14:43:26.165 INFO:teuthology.orchestra.run.smithi086.stdout: "osd_pool_default_read_lease_ratio": "0.800000", 2024-04-18T14:43:26.165 INFO:teuthology.orchestra.run.smithi086.stdout: "osd_pool_default_size": "2", 2024-04-18T14:43:26.165 INFO:teuthology.orchestra.run.smithi086.stdout: "osd_pool_default_type": "replicated", 2024-04-18T14:43:26.165 INFO:teuthology.orchestra.run.smithi086.stdout: "osd_pool_erasure_code_stripe_unit": "4096", 2024-04-18T14:43:26.165 INFO:teuthology.orchestra.run.smithi086.stdout: "osd_pool_use_gmt_hitset": "true", 2024-04-18T14:43:26.165 INFO:teuthology.orchestra.run.smithi086.stdout: "osd_push_per_object_cost": "1000", 2024-04-18T14:43:26.165 INFO:teuthology.orchestra.run.smithi086.stdout: "osd_read_ec_check_for_errors": "false", 2024-04-18T14:43:26.165 INFO:teuthology.orchestra.run.smithi086.stdout: "osd_recover_clone_overlap": "true", 2024-04-18T14:43:26.165 INFO:teuthology.orchestra.run.smithi086.stdout: "osd_recover_clone_overlap_limit": "10", 2024-04-18T14:43:26.165 INFO:teuthology.orchestra.run.smithi086.stdout: "osd_recovery_cost": "20971520", 2024-04-18T14:43:26.165 INFO:teuthology.orchestra.run.smithi086.stdout: "osd_recovery_delay_start": "0.000000", 2024-04-18T14:43:26.165 INFO:teuthology.orchestra.run.smithi086.stdout: "osd_recovery_max_active": "0", 2024-04-18T14:43:26.166 INFO:teuthology.orchestra.run.smithi086.stdout: "osd_recovery_max_active_hdd": "3", 2024-04-18T14:43:26.166 INFO:teuthology.orchestra.run.smithi086.stdout: "osd_recovery_max_active_ssd": "10", 2024-04-18T14:43:26.166 INFO:teuthology.orchestra.run.smithi086.stdout: "osd_recovery_max_chunk": "8388608", 2024-04-18T14:43:26.166 INFO:teuthology.orchestra.run.smithi086.stdout: "osd_recovery_max_omap_entries_per_chunk": "8096", 2024-04-18T14:43:26.166 INFO:teuthology.orchestra.run.smithi086.stdout: "osd_recovery_max_single_start": "1", 2024-04-18T14:43:26.166 INFO:teuthology.orchestra.run.smithi086.stdout: "osd_recovery_op_priority": "3", 2024-04-18T14:43:26.166 INFO:teuthology.orchestra.run.smithi086.stdout: "osd_recovery_op_warn_multiple": "16", 2024-04-18T14:43:26.166 INFO:teuthology.orchestra.run.smithi086.stdout: "osd_recovery_priority": "5", 2024-04-18T14:43:26.166 INFO:teuthology.orchestra.run.smithi086.stdout: "osd_recovery_retry_interval": "30.000000", 2024-04-18T14:43:26.166 INFO:teuthology.orchestra.run.smithi086.stdout: "osd_recovery_sleep": "0.000000", 2024-04-18T14:43:26.166 INFO:teuthology.orchestra.run.smithi086.stdout: "osd_recovery_sleep_hdd": "0.100000", 2024-04-18T14:43:26.166 INFO:teuthology.orchestra.run.smithi086.stdout: "osd_recovery_sleep_hybrid": "0.025000", 2024-04-18T14:43:26.166 INFO:teuthology.orchestra.run.smithi086.stdout: "osd_recovery_sleep_ssd": "0.000000", 2024-04-18T14:43:26.166 INFO:teuthology.orchestra.run.smithi086.stdout: "osd_repair_during_recovery": "false", 2024-04-18T14:43:26.166 INFO:teuthology.orchestra.run.smithi086.stdout: "osd_requested_scrub_priority": "120", 2024-04-18T14:43:26.167 INFO:teuthology.orchestra.run.smithi086.stdout: "osd_rocksdb_iterator_bounds_enabled": "true", 2024-04-18T14:43:26.167 INFO:teuthology.orchestra.run.smithi086.stdout: "osd_rollback_to_cluster_snap": "", 2024-04-18T14:43:26.167 INFO:teuthology.orchestra.run.smithi086.stdout: "osd_scrub_auto_repair": "false", 2024-04-18T14:43:26.167 INFO:teuthology.orchestra.run.smithi086.stdout: "osd_scrub_auto_repair_num_errors": "5", 2024-04-18T14:43:26.167 INFO:teuthology.orchestra.run.smithi086.stdout: "osd_scrub_backoff_ratio": "0.660000", 2024-04-18T14:43:26.167 INFO:teuthology.orchestra.run.smithi086.stdout: "osd_scrub_begin_hour": "0", 2024-04-18T14:43:26.167 INFO:teuthology.orchestra.run.smithi086.stdout: "osd_scrub_begin_week_day": "0", 2024-04-18T14:43:26.167 INFO:teuthology.orchestra.run.smithi086.stdout: "osd_scrub_chunk_max": "25", 2024-04-18T14:43:26.167 INFO:teuthology.orchestra.run.smithi086.stdout: "osd_scrub_chunk_min": "5", 2024-04-18T14:43:26.167 INFO:teuthology.orchestra.run.smithi086.stdout: "osd_scrub_cost": "52428800", 2024-04-18T14:43:26.167 INFO:teuthology.orchestra.run.smithi086.stdout: "osd_scrub_during_recovery": "false", 2024-04-18T14:43:26.167 INFO:teuthology.orchestra.run.smithi086.stdout: "osd_scrub_end_hour": "0", 2024-04-18T14:43:26.167 INFO:teuthology.orchestra.run.smithi086.stdout: "osd_scrub_end_week_day": "0", 2024-04-18T14:43:26.167 INFO:teuthology.orchestra.run.smithi086.stdout: "osd_scrub_event_cost": "4096", 2024-04-18T14:43:26.167 INFO:teuthology.orchestra.run.smithi086.stdout: "osd_scrub_extended_sleep": "0.000000", 2024-04-18T14:43:26.167 INFO:teuthology.orchestra.run.smithi086.stdout: "osd_scrub_interval_randomize_ratio": "0.500000", 2024-04-18T14:43:26.168 INFO:teuthology.orchestra.run.smithi086.stdout: "osd_scrub_invalid_stats": "true", 2024-04-18T14:43:26.168 INFO:teuthology.orchestra.run.smithi086.stdout: "osd_scrub_load_threshold": "0.500000", 2024-04-18T14:43:26.168 INFO:teuthology.orchestra.run.smithi086.stdout: "osd_scrub_max_interval": "604800.000000", 2024-04-18T14:43:26.168 INFO:teuthology.orchestra.run.smithi086.stdout: "osd_scrub_max_preemptions": "5", 2024-04-18T14:43:26.168 INFO:teuthology.orchestra.run.smithi086.stdout: "osd_scrub_min_interval": "86400.000000", 2024-04-18T14:43:26.168 INFO:teuthology.orchestra.run.smithi086.stdout: "osd_scrub_priority": "5", 2024-04-18T14:43:26.168 INFO:teuthology.orchestra.run.smithi086.stdout: "osd_scrub_reservation_timeout": "5000", 2024-04-18T14:43:26.168 INFO:teuthology.orchestra.run.smithi086.stdout: "osd_scrub_sleep": "0.000000", 2024-04-18T14:43:26.168 INFO:teuthology.orchestra.run.smithi086.stdout: "osd_scrub_slow_reservation_response": "2200", 2024-04-18T14:43:26.168 INFO:teuthology.orchestra.run.smithi086.stdout: "osd_shallow_scrub_chunk_max": "100", 2024-04-18T14:43:26.168 INFO:teuthology.orchestra.run.smithi086.stdout: "osd_shallow_scrub_chunk_min": "50", 2024-04-18T14:43:26.168 INFO:teuthology.orchestra.run.smithi086.stdout: "osd_shutdown_pgref_assert": "false", 2024-04-18T14:43:26.168 INFO:teuthology.orchestra.run.smithi086.stdout: "osd_skip_data_digest": "false", 2024-04-18T14:43:26.168 INFO:teuthology.orchestra.run.smithi086.stdout: "osd_smart_report_timeout": "5", 2024-04-18T14:43:26.168 INFO:teuthology.orchestra.run.smithi086.stdout: "osd_snap_trim_cost": "1048576", 2024-04-18T14:43:26.168 INFO:teuthology.orchestra.run.smithi086.stdout: "osd_snap_trim_priority": "5", 2024-04-18T14:43:26.169 INFO:teuthology.orchestra.run.smithi086.stdout: "osd_snap_trim_sleep": "0.000000", 2024-04-18T14:43:26.169 INFO:teuthology.orchestra.run.smithi086.stdout: "osd_snap_trim_sleep_hdd": "5.000000", 2024-04-18T14:43:26.169 INFO:teuthology.orchestra.run.smithi086.stdout: "osd_snap_trim_sleep_hybrid": "2.000000", 2024-04-18T14:43:26.169 INFO:teuthology.orchestra.run.smithi086.stdout: "osd_snap_trim_sleep_ssd": "0.000000", 2024-04-18T14:43:26.169 INFO:teuthology.orchestra.run.smithi086.stdout: "osd_stats_update_period_not_scrubbing": "120", 2024-04-18T14:43:26.169 INFO:teuthology.orchestra.run.smithi086.stdout: "osd_stats_update_period_scrubbing": "15", 2024-04-18T14:43:26.169 INFO:teuthology.orchestra.run.smithi086.stdout: "osd_target_pg_log_entries_per_osd": "300000", 2024-04-18T14:43:26.169 INFO:teuthology.orchestra.run.smithi086.stdout: "osd_target_transaction_size": "30", 2024-04-18T14:43:26.169 INFO:teuthology.orchestra.run.smithi086.stdout: "osd_tier_default_cache_hit_set_count": "4", 2024-04-18T14:43:26.169 INFO:teuthology.orchestra.run.smithi086.stdout: "osd_tier_default_cache_hit_set_grade_decay_rate": "20", 2024-04-18T14:43:26.169 INFO:teuthology.orchestra.run.smithi086.stdout: "osd_tier_default_cache_hit_set_period": "1200", 2024-04-18T14:43:26.169 INFO:teuthology.orchestra.run.smithi086.stdout: "osd_tier_default_cache_hit_set_search_last_n": "1", 2024-04-18T14:43:26.169 INFO:teuthology.orchestra.run.smithi086.stdout: "osd_tier_default_cache_hit_set_type": "bloom", 2024-04-18T14:43:26.169 INFO:teuthology.orchestra.run.smithi086.stdout: "osd_tier_default_cache_min_read_recency_for_promote": "1", 2024-04-18T14:43:26.169 INFO:teuthology.orchestra.run.smithi086.stdout: "osd_tier_default_cache_min_write_recency_for_promote": "1", 2024-04-18T14:43:26.170 INFO:teuthology.orchestra.run.smithi086.stdout: "osd_tier_default_cache_mode": "writeback", 2024-04-18T14:43:26.170 INFO:teuthology.orchestra.run.smithi086.stdout: "osd_tier_promote_max_bytes_sec": "5242880", 2024-04-18T14:43:26.170 INFO:teuthology.orchestra.run.smithi086.stdout: "osd_tier_promote_max_objects_sec": "25", 2024-04-18T14:43:26.170 INFO:teuthology.orchestra.run.smithi086.stdout: "osd_tracing": "false", 2024-04-18T14:43:26.170 INFO:teuthology.orchestra.run.smithi086.stdout: "osd_use_stale_snap": "false", 2024-04-18T14:43:26.170 INFO:teuthology.orchestra.run.smithi086.stdout: "osd_uuid": "00000000-0000-0000-0000-000000000000", 2024-04-18T14:43:26.170 INFO:teuthology.orchestra.run.smithi086.stdout: "osdc_blkin_trace_all": "false", 2024-04-18T14:43:26.170 INFO:teuthology.orchestra.run.smithi086.stdout: "paxos_kill_at": "0", 2024-04-18T14:43:26.170 INFO:teuthology.orchestra.run.smithi086.stdout: "paxos_max_join_drift": "10", 2024-04-18T14:43:26.170 INFO:teuthology.orchestra.run.smithi086.stdout: "paxos_min": "500", 2024-04-18T14:43:26.170 INFO:teuthology.orchestra.run.smithi086.stdout: "paxos_min_wait": "0.050000", 2024-04-18T14:43:26.170 INFO:teuthology.orchestra.run.smithi086.stdout: "paxos_propose_interval": "1.000000", 2024-04-18T14:43:26.170 INFO:teuthology.orchestra.run.smithi086.stdout: "paxos_service_trim_max": "500", 2024-04-18T14:43:26.170 INFO:teuthology.orchestra.run.smithi086.stdout: "paxos_service_trim_max_multiplier": "20", 2024-04-18T14:43:26.170 INFO:teuthology.orchestra.run.smithi086.stdout: "paxos_service_trim_min": "250", 2024-04-18T14:43:26.171 INFO:teuthology.orchestra.run.smithi086.stdout: "paxos_stash_full_interval": "25", 2024-04-18T14:43:26.171 INFO:teuthology.orchestra.run.smithi086.stdout: "paxos_trim_max": "500", 2024-04-18T14:43:26.171 INFO:teuthology.orchestra.run.smithi086.stdout: "paxos_trim_min": "250", 2024-04-18T14:43:26.171 INFO:teuthology.orchestra.run.smithi086.stdout: "perf": "true", 2024-04-18T14:43:26.171 INFO:teuthology.orchestra.run.smithi086.stdout: "pid_file": "/var/run/ceph/ceph-mon.a.pid", 2024-04-18T14:43:26.171 INFO:teuthology.orchestra.run.smithi086.stdout: "plugin_crypto_accelerator": "crypto_isal", 2024-04-18T14:43:26.171 INFO:teuthology.orchestra.run.smithi086.stdout: "plugin_dir": "/usr/lib/ceph", 2024-04-18T14:43:26.171 INFO:teuthology.orchestra.run.smithi086.stdout: "public_addr": "-", 2024-04-18T14:43:26.171 INFO:teuthology.orchestra.run.smithi086.stdout: "public_addrv": "", 2024-04-18T14:43:26.171 INFO:teuthology.orchestra.run.smithi086.stdout: "public_bind_addr": "-", 2024-04-18T14:43:26.171 INFO:teuthology.orchestra.run.smithi086.stdout: "public_network": "", 2024-04-18T14:43:26.171 INFO:teuthology.orchestra.run.smithi086.stdout: "public_network_interface": "", 2024-04-18T14:43:26.171 INFO:teuthology.orchestra.run.smithi086.stdout: "qat_compressor_enabled": "false", 2024-04-18T14:43:26.171 INFO:teuthology.orchestra.run.smithi086.stdout: "qat_compressor_session_max_number": "256", 2024-04-18T14:43:26.171 INFO:teuthology.orchestra.run.smithi086.stdout: "rados_mon_op_timeout": "0", 2024-04-18T14:43:26.171 INFO:teuthology.orchestra.run.smithi086.stdout: "rados_osd_op_timeout": "0", 2024-04-18T14:43:26.172 INFO:teuthology.orchestra.run.smithi086.stdout: "rados_tracing": "false", 2024-04-18T14:43:26.172 INFO:teuthology.orchestra.run.smithi086.stdout: "rbd_atime_update_interval": "60", 2024-04-18T14:43:26.172 INFO:teuthology.orchestra.run.smithi086.stdout: "rbd_auto_exclusive_lock_until_manual_request": "true", 2024-04-18T14:43:26.172 INFO:teuthology.orchestra.run.smithi086.stdout: "rbd_balance_parent_reads": "false", 2024-04-18T14:43:26.172 INFO:teuthology.orchestra.run.smithi086.stdout: "rbd_balance_snap_reads": "false", 2024-04-18T14:43:26.172 INFO:teuthology.orchestra.run.smithi086.stdout: "rbd_blkin_trace_all": "false", 2024-04-18T14:43:26.172 INFO:teuthology.orchestra.run.smithi086.stdout: "rbd_blocklist_expire_seconds": "0", 2024-04-18T14:43:26.172 INFO:teuthology.orchestra.run.smithi086.stdout: "rbd_blocklist_on_break_lock": "true", 2024-04-18T14:43:26.172 INFO:teuthology.orchestra.run.smithi086.stdout: "rbd_cache": "true", 2024-04-18T14:43:26.172 INFO:teuthology.orchestra.run.smithi086.stdout: "rbd_cache_block_writes_upfront": "false", 2024-04-18T14:43:26.172 INFO:teuthology.orchestra.run.smithi086.stdout: "rbd_cache_max_dirty": "25165824", 2024-04-18T14:43:26.172 INFO:teuthology.orchestra.run.smithi086.stdout: "rbd_cache_max_dirty_age": "1.000000", 2024-04-18T14:43:26.172 INFO:teuthology.orchestra.run.smithi086.stdout: "rbd_cache_max_dirty_object": "0", 2024-04-18T14:43:26.172 INFO:teuthology.orchestra.run.smithi086.stdout: "rbd_cache_policy": "writearound", 2024-04-18T14:43:26.172 INFO:teuthology.orchestra.run.smithi086.stdout: "rbd_cache_size": "33554432", 2024-04-18T14:43:26.173 INFO:teuthology.orchestra.run.smithi086.stdout: "rbd_cache_target_dirty": "16777216", 2024-04-18T14:43:26.173 INFO:teuthology.orchestra.run.smithi086.stdout: "rbd_cache_writethrough_until_flush": "true", 2024-04-18T14:43:26.173 INFO:teuthology.orchestra.run.smithi086.stdout: "rbd_clone_copy_on_read": "false", 2024-04-18T14:43:26.173 INFO:teuthology.orchestra.run.smithi086.stdout: "rbd_compression_hint": "none", 2024-04-18T14:43:26.173 INFO:teuthology.orchestra.run.smithi086.stdout: "rbd_concurrent_management_ops": "10", 2024-04-18T14:43:26.173 INFO:teuthology.orchestra.run.smithi086.stdout: "rbd_config_pool_override_update_timestamp": "0", 2024-04-18T14:43:26.173 INFO:teuthology.orchestra.run.smithi086.stdout: "rbd_default_clone_format": "auto", 2024-04-18T14:43:26.173 INFO:teuthology.orchestra.run.smithi086.stdout: "rbd_default_data_pool": "", 2024-04-18T14:43:26.173 INFO:teuthology.orchestra.run.smithi086.stdout: "rbd_default_features": "61", 2024-04-18T14:43:26.173 INFO:teuthology.orchestra.run.smithi086.stdout: "rbd_default_format": "2", 2024-04-18T14:43:26.173 INFO:teuthology.orchestra.run.smithi086.stdout: "rbd_default_map_options": "", 2024-04-18T14:43:26.173 INFO:teuthology.orchestra.run.smithi086.stdout: "rbd_default_order": "22", 2024-04-18T14:43:26.173 INFO:teuthology.orchestra.run.smithi086.stdout: "rbd_default_pool": "rbd", 2024-04-18T14:43:26.173 INFO:teuthology.orchestra.run.smithi086.stdout: "rbd_default_snapshot_quiesce_mode": "required", 2024-04-18T14:43:26.173 INFO:teuthology.orchestra.run.smithi086.stdout: "rbd_default_stripe_count": "0", 2024-04-18T14:43:26.173 INFO:teuthology.orchestra.run.smithi086.stdout: "rbd_default_stripe_unit": "0", 2024-04-18T14:43:26.174 INFO:teuthology.orchestra.run.smithi086.stdout: "rbd_disable_zero_copy_writes": "true", 2024-04-18T14:43:26.174 INFO:teuthology.orchestra.run.smithi086.stdout: "rbd_discard_granularity_bytes": "65536", 2024-04-18T14:43:26.174 INFO:teuthology.orchestra.run.smithi086.stdout: "rbd_discard_on_zeroed_write_same": "true", 2024-04-18T14:43:26.174 INFO:teuthology.orchestra.run.smithi086.stdout: "rbd_enable_alloc_hint": "true", 2024-04-18T14:43:26.174 INFO:teuthology.orchestra.run.smithi086.stdout: "rbd_invalidate_object_map_on_timeout": "true", 2024-04-18T14:43:26.174 INFO:teuthology.orchestra.run.smithi086.stdout: "rbd_io_scheduler": "simple", 2024-04-18T14:43:26.174 INFO:teuthology.orchestra.run.smithi086.stdout: "rbd_io_scheduler_simple_max_delay": "0", 2024-04-18T14:43:26.174 INFO:teuthology.orchestra.run.smithi086.stdout: "rbd_journal_commit_age": "5.000000", 2024-04-18T14:43:26.174 INFO:teuthology.orchestra.run.smithi086.stdout: "rbd_journal_max_concurrent_object_sets": "0", 2024-04-18T14:43:26.174 INFO:teuthology.orchestra.run.smithi086.stdout: "rbd_journal_max_payload_bytes": "16384", 2024-04-18T14:43:26.174 INFO:teuthology.orchestra.run.smithi086.stdout: "rbd_journal_object_flush_age": "0.000000", 2024-04-18T14:43:26.174 INFO:teuthology.orchestra.run.smithi086.stdout: "rbd_journal_object_flush_bytes": "1048576", 2024-04-18T14:43:26.174 INFO:teuthology.orchestra.run.smithi086.stdout: "rbd_journal_object_flush_interval": "0", 2024-04-18T14:43:26.174 INFO:teuthology.orchestra.run.smithi086.stdout: "rbd_journal_object_max_in_flight_appends": "0", 2024-04-18T14:43:26.174 INFO:teuthology.orchestra.run.smithi086.stdout: "rbd_journal_object_writethrough_until_flush": "true", 2024-04-18T14:43:26.175 INFO:teuthology.orchestra.run.smithi086.stdout: "rbd_journal_order": "24", 2024-04-18T14:43:26.175 INFO:teuthology.orchestra.run.smithi086.stdout: "rbd_journal_pool": "", 2024-04-18T14:43:26.175 INFO:teuthology.orchestra.run.smithi086.stdout: "rbd_journal_splay_width": "4", 2024-04-18T14:43:26.175 INFO:teuthology.orchestra.run.smithi086.stdout: "rbd_localize_parent_reads": "false", 2024-04-18T14:43:26.175 INFO:teuthology.orchestra.run.smithi086.stdout: "rbd_localize_snap_reads": "false", 2024-04-18T14:43:26.175 INFO:teuthology.orchestra.run.smithi086.stdout: "rbd_mirror_concurrent_image_deletions": "1", 2024-04-18T14:43:26.175 INFO:teuthology.orchestra.run.smithi086.stdout: "rbd_mirror_concurrent_image_syncs": "5", 2024-04-18T14:43:26.175 INFO:teuthology.orchestra.run.smithi086.stdout: "rbd_mirror_delete_retry_interval": "30.000000", 2024-04-18T14:43:26.175 INFO:teuthology.orchestra.run.smithi086.stdout: "rbd_mirror_image_perf_stats_prio": "5", 2024-04-18T14:43:26.175 INFO:teuthology.orchestra.run.smithi086.stdout: "rbd_mirror_image_policy_migration_throttle": "300", 2024-04-18T14:43:26.175 INFO:teuthology.orchestra.run.smithi086.stdout: "rbd_mirror_image_policy_rebalance_timeout": "0.000000", 2024-04-18T14:43:26.175 INFO:teuthology.orchestra.run.smithi086.stdout: "rbd_mirror_image_policy_type": "simple", 2024-04-18T14:43:26.175 INFO:teuthology.orchestra.run.smithi086.stdout: "rbd_mirror_image_policy_update_throttle_interval": "1.000000", 2024-04-18T14:43:26.175 INFO:teuthology.orchestra.run.smithi086.stdout: "rbd_mirror_image_state_check_interval": "30", 2024-04-18T14:43:26.175 INFO:teuthology.orchestra.run.smithi086.stdout: "rbd_mirror_journal_commit_age": "5.000000", 2024-04-18T14:43:26.175 INFO:teuthology.orchestra.run.smithi086.stdout: "rbd_mirror_journal_poll_age": "5.000000", 2024-04-18T14:43:26.176 INFO:teuthology.orchestra.run.smithi086.stdout: "rbd_mirror_leader_heartbeat_interval": "5", 2024-04-18T14:43:26.176 INFO:teuthology.orchestra.run.smithi086.stdout: "rbd_mirror_leader_max_acquire_attempts_before_break": "3", 2024-04-18T14:43:26.176 INFO:teuthology.orchestra.run.smithi086.stdout: "rbd_mirror_leader_max_missed_heartbeats": "2", 2024-04-18T14:43:26.176 INFO:teuthology.orchestra.run.smithi086.stdout: "rbd_mirror_memory_autotune": "true", 2024-04-18T14:43:26.176 INFO:teuthology.orchestra.run.smithi086.stdout: "rbd_mirror_memory_base": "805306368", 2024-04-18T14:43:26.176 INFO:teuthology.orchestra.run.smithi086.stdout: "rbd_mirror_memory_cache_autotune_interval": "30.000000", 2024-04-18T14:43:26.176 INFO:teuthology.orchestra.run.smithi086.stdout: "rbd_mirror_memory_cache_min": "134217728", 2024-04-18T14:43:26.176 INFO:teuthology.orchestra.run.smithi086.stdout: "rbd_mirror_memory_cache_resize_interval": "5.000000", 2024-04-18T14:43:26.176 INFO:teuthology.orchestra.run.smithi086.stdout: "rbd_mirror_memory_expected_fragmentation": "0.150000", 2024-04-18T14:43:26.176 INFO:teuthology.orchestra.run.smithi086.stdout: "rbd_mirror_memory_target": "4294967296", 2024-04-18T14:43:26.176 INFO:teuthology.orchestra.run.smithi086.stdout: "rbd_mirror_perf_stats_prio": "5", 2024-04-18T14:43:26.176 INFO:teuthology.orchestra.run.smithi086.stdout: "rbd_mirror_pool_replayers_refresh_interval": "30", 2024-04-18T14:43:26.176 INFO:teuthology.orchestra.run.smithi086.stdout: "rbd_mirror_sync_point_update_age": "30.000000", 2024-04-18T14:43:26.176 INFO:teuthology.orchestra.run.smithi086.stdout: "rbd_mirroring_delete_delay": "0", 2024-04-18T14:43:26.176 INFO:teuthology.orchestra.run.smithi086.stdout: "rbd_mirroring_max_mirroring_snapshots": "5", 2024-04-18T14:43:26.176 INFO:teuthology.orchestra.run.smithi086.stdout: "rbd_mirroring_replay_delay": "0", 2024-04-18T14:43:26.177 INFO:teuthology.orchestra.run.smithi086.stdout: "rbd_mirroring_resync_after_disconnect": "false", 2024-04-18T14:43:26.177 INFO:teuthology.orchestra.run.smithi086.stdout: "rbd_move_parent_to_trash_on_remove": "false", 2024-04-18T14:43:26.177 INFO:teuthology.orchestra.run.smithi086.stdout: "rbd_move_to_trash_on_remove": "false", 2024-04-18T14:43:26.177 INFO:teuthology.orchestra.run.smithi086.stdout: "rbd_move_to_trash_on_remove_expire_seconds": "0", 2024-04-18T14:43:26.177 INFO:teuthology.orchestra.run.smithi086.stdout: "rbd_mtime_update_interval": "60", 2024-04-18T14:43:26.177 INFO:teuthology.orchestra.run.smithi086.stdout: "rbd_non_blocking_aio": "true", 2024-04-18T14:43:26.177 INFO:teuthology.orchestra.run.smithi086.stdout: "rbd_op_thread_timeout": "60", 2024-04-18T14:43:26.177 INFO:teuthology.orchestra.run.smithi086.stdout: "rbd_op_threads": "1", 2024-04-18T14:43:26.177 INFO:teuthology.orchestra.run.smithi086.stdout: "rbd_parent_cache_enabled": "false", 2024-04-18T14:43:26.177 INFO:teuthology.orchestra.run.smithi086.stdout: "rbd_persistent_cache_mode": "disabled", 2024-04-18T14:43:26.177 INFO:teuthology.orchestra.run.smithi086.stdout: "rbd_persistent_cache_path": "/tmp", 2024-04-18T14:43:26.177 INFO:teuthology.orchestra.run.smithi086.stdout: "rbd_persistent_cache_size": "1073741824", 2024-04-18T14:43:26.177 INFO:teuthology.orchestra.run.smithi086.stdout: "rbd_plugins": "", 2024-04-18T14:43:26.177 INFO:teuthology.orchestra.run.smithi086.stdout: "rbd_qos_bps_burst": "0", 2024-04-18T14:43:26.177 INFO:teuthology.orchestra.run.smithi086.stdout: "rbd_qos_bps_burst_seconds": "1", 2024-04-18T14:43:26.177 INFO:teuthology.orchestra.run.smithi086.stdout: "rbd_qos_bps_limit": "0", 2024-04-18T14:43:26.178 INFO:teuthology.orchestra.run.smithi086.stdout: "rbd_qos_exclude_ops": "0", 2024-04-18T14:43:26.178 INFO:teuthology.orchestra.run.smithi086.stdout: "rbd_qos_iops_burst": "0", 2024-04-18T14:43:26.178 INFO:teuthology.orchestra.run.smithi086.stdout: "rbd_qos_iops_burst_seconds": "1", 2024-04-18T14:43:26.178 INFO:teuthology.orchestra.run.smithi086.stdout: "rbd_qos_iops_limit": "0", 2024-04-18T14:43:26.178 INFO:teuthology.orchestra.run.smithi086.stdout: "rbd_qos_read_bps_burst": "0", 2024-04-18T14:43:26.178 INFO:teuthology.orchestra.run.smithi086.stdout: "rbd_qos_read_bps_burst_seconds": "1", 2024-04-18T14:43:26.178 INFO:teuthology.orchestra.run.smithi086.stdout: "rbd_qos_read_bps_limit": "0", 2024-04-18T14:43:26.178 INFO:teuthology.orchestra.run.smithi086.stdout: "rbd_qos_read_iops_burst": "0", 2024-04-18T14:43:26.178 INFO:teuthology.orchestra.run.smithi086.stdout: "rbd_qos_read_iops_burst_seconds": "1", 2024-04-18T14:43:26.178 INFO:teuthology.orchestra.run.smithi086.stdout: "rbd_qos_read_iops_limit": "0", 2024-04-18T14:43:26.178 INFO:teuthology.orchestra.run.smithi086.stdout: "rbd_qos_schedule_tick_min": "50", 2024-04-18T14:43:26.178 INFO:teuthology.orchestra.run.smithi086.stdout: "rbd_qos_write_bps_burst": "0", 2024-04-18T14:43:26.178 INFO:teuthology.orchestra.run.smithi086.stdout: "rbd_qos_write_bps_burst_seconds": "1", 2024-04-18T14:43:26.178 INFO:teuthology.orchestra.run.smithi086.stdout: "rbd_qos_write_bps_limit": "0", 2024-04-18T14:43:26.178 INFO:teuthology.orchestra.run.smithi086.stdout: "rbd_qos_write_iops_burst": "0", 2024-04-18T14:43:26.179 INFO:teuthology.orchestra.run.smithi086.stdout: "rbd_qos_write_iops_burst_seconds": "1", 2024-04-18T14:43:26.179 INFO:teuthology.orchestra.run.smithi086.stdout: "rbd_qos_write_iops_limit": "0", 2024-04-18T14:43:26.179 INFO:teuthology.orchestra.run.smithi086.stdout: "rbd_quiesce_notification_attempts": "10", 2024-04-18T14:43:26.179 INFO:teuthology.orchestra.run.smithi086.stdout: "rbd_read_from_replica_policy": "default", 2024-04-18T14:43:26.179 INFO:teuthology.orchestra.run.smithi086.stdout: "rbd_readahead_disable_after_bytes": "52428800", 2024-04-18T14:43:26.179 INFO:teuthology.orchestra.run.smithi086.stdout: "rbd_readahead_max_bytes": "524288", 2024-04-18T14:43:26.179 INFO:teuthology.orchestra.run.smithi086.stdout: "rbd_readahead_trigger_requests": "10", 2024-04-18T14:43:26.179 INFO:teuthology.orchestra.run.smithi086.stdout: "rbd_request_timed_out_seconds": "30", 2024-04-18T14:43:26.179 INFO:teuthology.orchestra.run.smithi086.stdout: "rbd_skip_partial_discard": "true", 2024-04-18T14:43:26.179 INFO:teuthology.orchestra.run.smithi086.stdout: "rbd_sparse_read_threshold_bytes": "65536", 2024-04-18T14:43:26.179 INFO:teuthology.orchestra.run.smithi086.stdout: "rbd_tracing": "false", 2024-04-18T14:43:26.179 INFO:teuthology.orchestra.run.smithi086.stdout: "rbd_validate_names": "true", 2024-04-18T14:43:26.179 INFO:teuthology.orchestra.run.smithi086.stdout: "rbd_validate_pool": "true", 2024-04-18T14:43:26.179 INFO:teuthology.orchestra.run.smithi086.stdout: "restapi_base_url": "", 2024-04-18T14:43:26.179 INFO:teuthology.orchestra.run.smithi086.stdout: "restapi_log_level": "", 2024-04-18T14:43:26.179 INFO:teuthology.orchestra.run.smithi086.stdout: "rgw_acl_grants_max_num": "100", 2024-04-18T14:43:26.180 INFO:teuthology.orchestra.run.smithi086.stdout: "rgw_admin_entry": "admin", 2024-04-18T14:43:26.180 INFO:teuthology.orchestra.run.smithi086.stdout: "rgw_allow_notification_secrets_in_cleartext": "false", 2024-04-18T14:43:26.180 INFO:teuthology.orchestra.run.smithi086.stdout: "rgw_backend_store": "rados", 2024-04-18T14:43:26.180 INFO:teuthology.orchestra.run.smithi086.stdout: "rgw_barbican_url": "", 2024-04-18T14:43:26.180 INFO:teuthology.orchestra.run.smithi086.stdout: "rgw_beast_enable_async": "true", 2024-04-18T14:43:26.180 INFO:teuthology.orchestra.run.smithi086.stdout: "rgw_bucket_default_quota_max_objects": "-1", 2024-04-18T14:43:26.180 INFO:teuthology.orchestra.run.smithi086.stdout: "rgw_bucket_default_quota_max_size": "-1", 2024-04-18T14:43:26.180 INFO:teuthology.orchestra.run.smithi086.stdout: "rgw_bucket_index_max_aio": "128", 2024-04-18T14:43:26.180 INFO:teuthology.orchestra.run.smithi086.stdout: "rgw_bucket_index_transaction_instrumentation": "false", 2024-04-18T14:43:26.180 INFO:teuthology.orchestra.run.smithi086.stdout: "rgw_bucket_quota_cache_size": "10000", 2024-04-18T14:43:26.180 INFO:teuthology.orchestra.run.smithi086.stdout: "rgw_bucket_quota_ttl": "600", 2024-04-18T14:43:26.180 INFO:teuthology.orchestra.run.smithi086.stdout: "rgw_bucket_sync_spawn_window": "20", 2024-04-18T14:43:26.180 INFO:teuthology.orchestra.run.smithi086.stdout: "rgw_cache_enabled": "true", 2024-04-18T14:43:26.180 INFO:teuthology.orchestra.run.smithi086.stdout: "rgw_cache_expiry_interval": "900", 2024-04-18T14:43:26.180 INFO:teuthology.orchestra.run.smithi086.stdout: "rgw_cache_lru_size": "10000", 2024-04-18T14:43:26.181 INFO:teuthology.orchestra.run.smithi086.stdout: "rgw_config_store": "rados", 2024-04-18T14:43:26.181 INFO:teuthology.orchestra.run.smithi086.stdout: "rgw_content_length_compat": "false", 2024-04-18T14:43:26.181 INFO:teuthology.orchestra.run.smithi086.stdout: "rgw_copy_obj_progress": "true", 2024-04-18T14:43:26.181 INFO:teuthology.orchestra.run.smithi086.stdout: "rgw_copy_obj_progress_every_bytes": "1048576", 2024-04-18T14:43:26.181 INFO:teuthology.orchestra.run.smithi086.stdout: "rgw_cors_rules_max_num": "100", 2024-04-18T14:43:26.181 INFO:teuthology.orchestra.run.smithi086.stdout: "rgw_cross_domain_policy": "", 2024-04-18T14:43:26.181 INFO:teuthology.orchestra.run.smithi086.stdout: "rgw_crypt_default_encryption_key": "", 2024-04-18T14:43:26.181 INFO:teuthology.orchestra.run.smithi086.stdout: "rgw_crypt_kmip_addr": "", 2024-04-18T14:43:26.181 INFO:teuthology.orchestra.run.smithi086.stdout: "rgw_crypt_kmip_ca_path": "", 2024-04-18T14:43:26.181 INFO:teuthology.orchestra.run.smithi086.stdout: "rgw_crypt_kmip_client_cert": "", 2024-04-18T14:43:26.181 INFO:teuthology.orchestra.run.smithi086.stdout: "rgw_crypt_kmip_client_key": "", 2024-04-18T14:43:26.181 INFO:teuthology.orchestra.run.smithi086.stdout: "rgw_crypt_kmip_kms_key_template": "", 2024-04-18T14:43:26.181 INFO:teuthology.orchestra.run.smithi086.stdout: "rgw_crypt_kmip_password": "", 2024-04-18T14:43:26.181 INFO:teuthology.orchestra.run.smithi086.stdout: "rgw_crypt_kmip_s3_key_template": "$keyid", 2024-04-18T14:43:26.181 INFO:teuthology.orchestra.run.smithi086.stdout: "rgw_crypt_kmip_username": "", 2024-04-18T14:43:26.181 INFO:teuthology.orchestra.run.smithi086.stdout: "rgw_crypt_require_ssl": "true", 2024-04-18T14:43:26.182 INFO:teuthology.orchestra.run.smithi086.stdout: "rgw_crypt_s3_kms_backend": "barbican", 2024-04-18T14:43:26.182 INFO:teuthology.orchestra.run.smithi086.stdout: "rgw_crypt_s3_kms_encryption_keys": "", 2024-04-18T14:43:26.182 INFO:teuthology.orchestra.run.smithi086.stdout: "rgw_crypt_sse_s3_backend": "vault", 2024-04-18T14:43:26.182 INFO:teuthology.orchestra.run.smithi086.stdout: "rgw_crypt_sse_s3_key_template": "%bucket_id", 2024-04-18T14:43:26.182 INFO:teuthology.orchestra.run.smithi086.stdout: "rgw_crypt_sse_s3_vault_addr": "", 2024-04-18T14:43:26.182 INFO:teuthology.orchestra.run.smithi086.stdout: "rgw_crypt_sse_s3_vault_auth": "token", 2024-04-18T14:43:26.182 INFO:teuthology.orchestra.run.smithi086.stdout: "rgw_crypt_sse_s3_vault_namespace": "", 2024-04-18T14:43:26.182 INFO:teuthology.orchestra.run.smithi086.stdout: "rgw_crypt_sse_s3_vault_prefix": "", 2024-04-18T14:43:26.182 INFO:teuthology.orchestra.run.smithi086.stdout: "rgw_crypt_sse_s3_vault_secret_engine": "transit", 2024-04-18T14:43:26.182 INFO:teuthology.orchestra.run.smithi086.stdout: "rgw_crypt_sse_s3_vault_ssl_cacert": "", 2024-04-18T14:43:26.182 INFO:teuthology.orchestra.run.smithi086.stdout: "rgw_crypt_sse_s3_vault_ssl_clientcert": "", 2024-04-18T14:43:26.182 INFO:teuthology.orchestra.run.smithi086.stdout: "rgw_crypt_sse_s3_vault_ssl_clientkey": "", 2024-04-18T14:43:26.182 INFO:teuthology.orchestra.run.smithi086.stdout: "rgw_crypt_sse_s3_vault_token_file": "", 2024-04-18T14:43:26.182 INFO:teuthology.orchestra.run.smithi086.stdout: "rgw_crypt_sse_s3_vault_verify_ssl": "true", 2024-04-18T14:43:26.182 INFO:teuthology.orchestra.run.smithi086.stdout: "rgw_crypt_suppress_logs": "true", 2024-04-18T14:43:26.183 INFO:teuthology.orchestra.run.smithi086.stdout: "rgw_crypt_vault_addr": "", 2024-04-18T14:43:26.183 INFO:teuthology.orchestra.run.smithi086.stdout: "rgw_crypt_vault_auth": "token", 2024-04-18T14:43:26.183 INFO:teuthology.orchestra.run.smithi086.stdout: "rgw_crypt_vault_namespace": "", 2024-04-18T14:43:26.183 INFO:teuthology.orchestra.run.smithi086.stdout: "rgw_crypt_vault_prefix": "", 2024-04-18T14:43:26.183 INFO:teuthology.orchestra.run.smithi086.stdout: "rgw_crypt_vault_secret_engine": "transit", 2024-04-18T14:43:26.183 INFO:teuthology.orchestra.run.smithi086.stdout: "rgw_crypt_vault_ssl_cacert": "", 2024-04-18T14:43:26.183 INFO:teuthology.orchestra.run.smithi086.stdout: "rgw_crypt_vault_ssl_clientcert": "", 2024-04-18T14:43:26.183 INFO:teuthology.orchestra.run.smithi086.stdout: "rgw_crypt_vault_ssl_clientkey": "", 2024-04-18T14:43:26.183 INFO:teuthology.orchestra.run.smithi086.stdout: "rgw_crypt_vault_token_file": "", 2024-04-18T14:43:26.183 INFO:teuthology.orchestra.run.smithi086.stdout: "rgw_crypt_vault_verify_ssl": "true", 2024-04-18T14:43:26.183 INFO:teuthology.orchestra.run.smithi086.stdout: "rgw_curl_buffersize": "524288", 2024-04-18T14:43:26.183 INFO:teuthology.orchestra.run.smithi086.stdout: "rgw_curl_low_speed_limit": "1024", 2024-04-18T14:43:26.183 INFO:teuthology.orchestra.run.smithi086.stdout: "rgw_curl_low_speed_time": "300", 2024-04-18T14:43:26.183 INFO:teuthology.orchestra.run.smithi086.stdout: "rgw_curl_tcp_keepalive": "0", 2024-04-18T14:43:26.183 INFO:teuthology.orchestra.run.smithi086.stdout: "rgw_curl_wait_timeout_ms": "1000", 2024-04-18T14:43:26.184 INFO:teuthology.orchestra.run.smithi086.stdout: "rgw_d3n_l1_datacache_persistent_path": "/tmp/rgw_datacache/", 2024-04-18T14:43:26.184 INFO:teuthology.orchestra.run.smithi086.stdout: "rgw_d3n_l1_datacache_size": "1073741824", 2024-04-18T14:43:26.184 INFO:teuthology.orchestra.run.smithi086.stdout: "rgw_d3n_l1_evict_cache_on_start": "true", 2024-04-18T14:43:26.184 INFO:teuthology.orchestra.run.smithi086.stdout: "rgw_d3n_l1_eviction_policy": "lru", 2024-04-18T14:43:26.184 INFO:teuthology.orchestra.run.smithi086.stdout: "rgw_d3n_l1_fadvise": "4", 2024-04-18T14:43:26.184 INFO:teuthology.orchestra.run.smithi086.stdout: "rgw_d3n_l1_local_datacache_enabled": "false", 2024-04-18T14:43:26.184 INFO:teuthology.orchestra.run.smithi086.stdout: "rgw_d3n_libaio_aio_num": "64", 2024-04-18T14:43:26.184 INFO:teuthology.orchestra.run.smithi086.stdout: "rgw_d3n_libaio_aio_threads": "20", 2024-04-18T14:43:26.184 INFO:teuthology.orchestra.run.smithi086.stdout: "rgw_data": "/var/lib/ceph/radosgw/ceph-a", 2024-04-18T14:43:26.184 INFO:teuthology.orchestra.run.smithi086.stdout: "rgw_data_log_changes_size": "1000", 2024-04-18T14:43:26.184 INFO:teuthology.orchestra.run.smithi086.stdout: "rgw_data_log_num_shards": "128", 2024-04-18T14:43:26.184 INFO:teuthology.orchestra.run.smithi086.stdout: "rgw_data_log_obj_prefix": "data_log", 2024-04-18T14:43:26.184 INFO:teuthology.orchestra.run.smithi086.stdout: "rgw_data_log_window": "30", 2024-04-18T14:43:26.184 INFO:teuthology.orchestra.run.smithi086.stdout: "rgw_data_notify_interval_msec": "0", 2024-04-18T14:43:26.184 INFO:teuthology.orchestra.run.smithi086.stdout: "rgw_data_sync_poll_interval": "20", 2024-04-18T14:43:26.184 INFO:teuthology.orchestra.run.smithi086.stdout: "rgw_data_sync_spawn_window": "20", 2024-04-18T14:43:26.185 INFO:teuthology.orchestra.run.smithi086.stdout: "rgw_debug_inject_olh_cancel_modification_err": "false", 2024-04-18T14:43:26.185 INFO:teuthology.orchestra.run.smithi086.stdout: "rgw_debug_inject_set_olh_err": "0", 2024-04-18T14:43:26.185 INFO:teuthology.orchestra.run.smithi086.stdout: "rgw_default_data_log_backing": "fifo", 2024-04-18T14:43:26.185 INFO:teuthology.orchestra.run.smithi086.stdout: "rgw_default_realm_info_oid": "default.realm", 2024-04-18T14:43:26.185 INFO:teuthology.orchestra.run.smithi086.stdout: "rgw_default_region_info_oid": "default.region", 2024-04-18T14:43:26.185 INFO:teuthology.orchestra.run.smithi086.stdout: "rgw_default_zone_info_oid": "default.zone", 2024-04-18T14:43:26.185 INFO:teuthology.orchestra.run.smithi086.stdout: "rgw_default_zonegroup_info_oid": "default.zonegroup", 2024-04-18T14:43:26.185 INFO:teuthology.orchestra.run.smithi086.stdout: "rgw_defer_to_bucket_acls": "", 2024-04-18T14:43:26.185 INFO:teuthology.orchestra.run.smithi086.stdout: "rgw_delete_multi_obj_max_num": "1000", 2024-04-18T14:43:26.185 INFO:teuthology.orchestra.run.smithi086.stdout: "rgw_dmclock_admin_lim": "0.000000", 2024-04-18T14:43:26.185 INFO:teuthology.orchestra.run.smithi086.stdout: "rgw_dmclock_admin_res": "100.000000", 2024-04-18T14:43:26.185 INFO:teuthology.orchestra.run.smithi086.stdout: "rgw_dmclock_admin_wgt": "100.000000", 2024-04-18T14:43:26.185 INFO:teuthology.orchestra.run.smithi086.stdout: "rgw_dmclock_auth_lim": "0.000000", 2024-04-18T14:43:26.185 INFO:teuthology.orchestra.run.smithi086.stdout: "rgw_dmclock_auth_res": "200.000000", 2024-04-18T14:43:26.185 INFO:teuthology.orchestra.run.smithi086.stdout: "rgw_dmclock_auth_wgt": "100.000000", 2024-04-18T14:43:26.185 INFO:teuthology.orchestra.run.smithi086.stdout: "rgw_dmclock_data_lim": "0.000000", 2024-04-18T14:43:26.186 INFO:teuthology.orchestra.run.smithi086.stdout: "rgw_dmclock_data_res": "500.000000", 2024-04-18T14:43:26.186 INFO:teuthology.orchestra.run.smithi086.stdout: "rgw_dmclock_data_wgt": "500.000000", 2024-04-18T14:43:26.186 INFO:teuthology.orchestra.run.smithi086.stdout: "rgw_dmclock_metadata_lim": "0.000000", 2024-04-18T14:43:26.186 INFO:teuthology.orchestra.run.smithi086.stdout: "rgw_dmclock_metadata_res": "500.000000", 2024-04-18T14:43:26.186 INFO:teuthology.orchestra.run.smithi086.stdout: "rgw_dmclock_metadata_wgt": "500.000000", 2024-04-18T14:43:26.186 INFO:teuthology.orchestra.run.smithi086.stdout: "rgw_dns_name": "", 2024-04-18T14:43:26.186 INFO:teuthology.orchestra.run.smithi086.stdout: "rgw_dns_s3website_name": "", 2024-04-18T14:43:26.186 INFO:teuthology.orchestra.run.smithi086.stdout: "rgw_dynamic_resharding": "true", 2024-04-18T14:43:26.186 INFO:teuthology.orchestra.run.smithi086.stdout: "rgw_enable_apis": "s3, s3website, swift, swift_auth, admin, sts, iam, notifications", 2024-04-18T14:43:26.186 INFO:teuthology.orchestra.run.smithi086.stdout: "rgw_enable_gc_threads": "true", 2024-04-18T14:43:26.186 INFO:teuthology.orchestra.run.smithi086.stdout: "rgw_enable_lc_threads": "true", 2024-04-18T14:43:26.186 INFO:teuthology.orchestra.run.smithi086.stdout: "rgw_enable_ops_log": "false", 2024-04-18T14:43:26.186 INFO:teuthology.orchestra.run.smithi086.stdout: "rgw_enable_quota_threads": "true", 2024-04-18T14:43:26.186 INFO:teuthology.orchestra.run.smithi086.stdout: "rgw_enable_static_website": "false", 2024-04-18T14:43:26.186 INFO:teuthology.orchestra.run.smithi086.stdout: "rgw_enable_usage_log": "false", 2024-04-18T14:43:26.187 INFO:teuthology.orchestra.run.smithi086.stdout: "rgw_enforce_swift_acls": "true", 2024-04-18T14:43:26.187 INFO:teuthology.orchestra.run.smithi086.stdout: "rgw_exit_timeout_secs": "120", 2024-04-18T14:43:26.187 INFO:teuthology.orchestra.run.smithi086.stdout: "rgw_expose_bucket": "false", 2024-04-18T14:43:26.187 INFO:teuthology.orchestra.run.smithi086.stdout: "rgw_extended_http_attrs": "", 2024-04-18T14:43:26.187 INFO:teuthology.orchestra.run.smithi086.stdout: "rgw_filter": "none", 2024-04-18T14:43:26.187 INFO:teuthology.orchestra.run.smithi086.stdout: "rgw_frontend_defaults": "beast ssl_certificate=config://rgw/cert/$realm/$zone.crt ssl_private_key=config://rgw/cert/$realm/$zone.key", 2024-04-18T14:43:26.187 INFO:teuthology.orchestra.run.smithi086.stdout: "rgw_frontends": "beast port=7480", 2024-04-18T14:43:26.187 INFO:teuthology.orchestra.run.smithi086.stdout: "rgw_gc_max_concurrent_io": "10", 2024-04-18T14:43:26.187 INFO:teuthology.orchestra.run.smithi086.stdout: "rgw_gc_max_deferred": "50", 2024-04-18T14:43:26.187 INFO:teuthology.orchestra.run.smithi086.stdout: "rgw_gc_max_deferred_entries_size": "3072", 2024-04-18T14:43:26.187 INFO:teuthology.orchestra.run.smithi086.stdout: "rgw_gc_max_objs": "32", 2024-04-18T14:43:26.187 INFO:teuthology.orchestra.run.smithi086.stdout: "rgw_gc_max_queue_size": "134213632", 2024-04-18T14:43:26.187 INFO:teuthology.orchestra.run.smithi086.stdout: "rgw_gc_max_trim_chunk": "16", 2024-04-18T14:43:26.187 INFO:teuthology.orchestra.run.smithi086.stdout: "rgw_gc_obj_min_wait": "7200", 2024-04-18T14:43:26.187 INFO:teuthology.orchestra.run.smithi086.stdout: "rgw_gc_processor_max_time": "3600", 2024-04-18T14:43:26.187 INFO:teuthology.orchestra.run.smithi086.stdout: "rgw_gc_processor_period": "3600", 2024-04-18T14:43:26.188 INFO:teuthology.orchestra.run.smithi086.stdout: "rgw_get_obj_max_req_size": "4194304", 2024-04-18T14:43:26.188 INFO:teuthology.orchestra.run.smithi086.stdout: "rgw_get_obj_window_size": "16777216", 2024-04-18T14:43:26.188 INFO:teuthology.orchestra.run.smithi086.stdout: "rgw_healthcheck_disabling_path": "", 2024-04-18T14:43:26.188 INFO:teuthology.orchestra.run.smithi086.stdout: "rgw_ignore_get_invalid_range": "false", 2024-04-18T14:43:26.188 INFO:teuthology.orchestra.run.smithi086.stdout: "rgw_init_timeout": "300", 2024-04-18T14:43:26.188 INFO:teuthology.orchestra.run.smithi086.stdout: "rgw_inject_notify_timeout_probability": "0.000000", 2024-04-18T14:43:26.188 INFO:teuthology.orchestra.run.smithi086.stdout: "rgw_json_config": "/var/lib/ceph/radosgw/config.json", 2024-04-18T14:43:26.188 INFO:teuthology.orchestra.run.smithi086.stdout: "rgw_keystone_accepted_admin_roles": "", 2024-04-18T14:43:26.188 INFO:teuthology.orchestra.run.smithi086.stdout: "rgw_keystone_accepted_roles": "Member, admin", 2024-04-18T14:43:26.188 INFO:teuthology.orchestra.run.smithi086.stdout: "rgw_keystone_admin_domain": "", 2024-04-18T14:43:26.188 INFO:teuthology.orchestra.run.smithi086.stdout: "rgw_keystone_admin_password": "", 2024-04-18T14:43:26.188 INFO:teuthology.orchestra.run.smithi086.stdout: "rgw_keystone_admin_password_path": "", 2024-04-18T14:43:26.188 INFO:teuthology.orchestra.run.smithi086.stdout: "rgw_keystone_admin_project": "", 2024-04-18T14:43:26.188 INFO:teuthology.orchestra.run.smithi086.stdout: "rgw_keystone_admin_tenant": "", 2024-04-18T14:43:26.188 INFO:teuthology.orchestra.run.smithi086.stdout: "rgw_keystone_admin_token": "", 2024-04-18T14:43:26.188 INFO:teuthology.orchestra.run.smithi086.stdout: "rgw_keystone_admin_token_path": "", 2024-04-18T14:43:26.189 INFO:teuthology.orchestra.run.smithi086.stdout: "rgw_keystone_admin_user": "", 2024-04-18T14:43:26.189 INFO:teuthology.orchestra.run.smithi086.stdout: "rgw_keystone_api_version": "2", 2024-04-18T14:43:26.189 INFO:teuthology.orchestra.run.smithi086.stdout: "rgw_keystone_barbican_domain": "", 2024-04-18T14:43:26.189 INFO:teuthology.orchestra.run.smithi086.stdout: "rgw_keystone_barbican_password": "", 2024-04-18T14:43:26.189 INFO:teuthology.orchestra.run.smithi086.stdout: "rgw_keystone_barbican_project": "", 2024-04-18T14:43:26.189 INFO:teuthology.orchestra.run.smithi086.stdout: "rgw_keystone_barbican_tenant": "", 2024-04-18T14:43:26.189 INFO:teuthology.orchestra.run.smithi086.stdout: "rgw_keystone_barbican_user": "", 2024-04-18T14:43:26.189 INFO:teuthology.orchestra.run.smithi086.stdout: "rgw_keystone_expired_token_cache_expiration": "3600", 2024-04-18T14:43:26.189 INFO:teuthology.orchestra.run.smithi086.stdout: "rgw_keystone_implicit_tenants": "false", 2024-04-18T14:43:26.189 INFO:teuthology.orchestra.run.smithi086.stdout: "rgw_keystone_service_token_accepted_roles": "admin", 2024-04-18T14:43:26.189 INFO:teuthology.orchestra.run.smithi086.stdout: "rgw_keystone_service_token_enabled": "false", 2024-04-18T14:43:26.189 INFO:teuthology.orchestra.run.smithi086.stdout: "rgw_keystone_token_cache_size": "10000", 2024-04-18T14:43:26.189 INFO:teuthology.orchestra.run.smithi086.stdout: "rgw_keystone_url": "", 2024-04-18T14:43:26.189 INFO:teuthology.orchestra.run.smithi086.stdout: "rgw_keystone_verify_ssl": "true", 2024-04-18T14:43:26.189 INFO:teuthology.orchestra.run.smithi086.stdout: "rgw_lc_debug_interval": "-1", 2024-04-18T14:43:26.189 INFO:teuthology.orchestra.run.smithi086.stdout: "rgw_lc_lock_max_time": "90", 2024-04-18T14:43:26.190 INFO:teuthology.orchestra.run.smithi086.stdout: "rgw_lc_max_objs": "32", 2024-04-18T14:43:26.190 INFO:teuthology.orchestra.run.smithi086.stdout: "rgw_lc_max_rules": "1000", 2024-04-18T14:43:26.190 INFO:teuthology.orchestra.run.smithi086.stdout: "rgw_lc_max_worker": "3", 2024-04-18T14:43:26.190 INFO:teuthology.orchestra.run.smithi086.stdout: "rgw_lc_max_wp_worker": "3", 2024-04-18T14:43:26.190 INFO:teuthology.orchestra.run.smithi086.stdout: "rgw_lc_thread_delay": "0", 2024-04-18T14:43:26.190 INFO:teuthology.orchestra.run.smithi086.stdout: "rgw_ldap_binddn": "uid=admin,cn=users,dc=example,dc=com", 2024-04-18T14:43:26.190 INFO:teuthology.orchestra.run.smithi086.stdout: "rgw_ldap_dnattr": "uid", 2024-04-18T14:43:26.190 INFO:teuthology.orchestra.run.smithi086.stdout: "rgw_ldap_searchdn": "cn=users,cn=accounts,dc=example,dc=com", 2024-04-18T14:43:26.190 INFO:teuthology.orchestra.run.smithi086.stdout: "rgw_ldap_searchfilter": "", 2024-04-18T14:43:26.190 INFO:teuthology.orchestra.run.smithi086.stdout: "rgw_ldap_secret": "/etc/openldap/secret", 2024-04-18T14:43:26.190 INFO:teuthology.orchestra.run.smithi086.stdout: "rgw_ldap_uri": "ldaps://", 2024-04-18T14:43:26.190 INFO:teuthology.orchestra.run.smithi086.stdout: "rgw_lifecycle_work_time": "00:00-06:00", 2024-04-18T14:43:26.190 INFO:teuthology.orchestra.run.smithi086.stdout: "rgw_list_bucket_min_readahead": "1000", 2024-04-18T14:43:26.190 INFO:teuthology.orchestra.run.smithi086.stdout: "rgw_list_buckets_max_chunk": "1000", 2024-04-18T14:43:26.191 INFO:teuthology.orchestra.run.smithi086.stdout: "rgw_log_http_headers": "", 2024-04-18T14:43:26.191 INFO:teuthology.orchestra.run.smithi086.stdout: "rgw_log_nonexistent_bucket": "false", 2024-04-18T14:43:26.191 INFO:teuthology.orchestra.run.smithi086.stdout: "rgw_log_object_name": "%Y-%m-%d-%H-%i-%n", 2024-04-18T14:43:26.191 INFO:teuthology.orchestra.run.smithi086.stdout: "rgw_log_object_name_utc": "false", 2024-04-18T14:43:26.191 INFO:teuthology.orchestra.run.smithi086.stdout: "rgw_luarocks_location": "/tmp/luarocks", 2024-04-18T14:43:26.191 INFO:teuthology.orchestra.run.smithi086.stdout: "rgw_max_attr_name_len": "0", 2024-04-18T14:43:26.191 INFO:teuthology.orchestra.run.smithi086.stdout: "rgw_max_attr_size": "0", 2024-04-18T14:43:26.191 INFO:teuthology.orchestra.run.smithi086.stdout: "rgw_max_attrs_num_in_req": "0", 2024-04-18T14:43:26.191 INFO:teuthology.orchestra.run.smithi086.stdout: "rgw_max_chunk_size": "4194304", 2024-04-18T14:43:26.191 INFO:teuthology.orchestra.run.smithi086.stdout: "rgw_max_concurrent_requests": "1024", 2024-04-18T14:43:26.191 INFO:teuthology.orchestra.run.smithi086.stdout: "rgw_max_copy_obj_concurrent_io": "10", 2024-04-18T14:43:26.191 INFO:teuthology.orchestra.run.smithi086.stdout: "rgw_max_dynamic_shards": "1999", 2024-04-18T14:43:26.191 INFO:teuthology.orchestra.run.smithi086.stdout: "rgw_max_listing_results": "1000", 2024-04-18T14:43:26.191 INFO:teuthology.orchestra.run.smithi086.stdout: "rgw_max_notify_retries": "10", 2024-04-18T14:43:26.191 INFO:teuthology.orchestra.run.smithi086.stdout: "rgw_max_objs_per_shard": "100000", 2024-04-18T14:43:26.191 INFO:teuthology.orchestra.run.smithi086.stdout: "rgw_max_put_param_size": "1048576", 2024-04-18T14:43:26.192 INFO:teuthology.orchestra.run.smithi086.stdout: "rgw_max_put_size": "5368709120", 2024-04-18T14:43:26.192 INFO:teuthology.orchestra.run.smithi086.stdout: "rgw_max_slo_entries": "1000", 2024-04-18T14:43:26.192 INFO:teuthology.orchestra.run.smithi086.stdout: "rgw_md_log_max_shards": "64", 2024-04-18T14:43:26.192 INFO:teuthology.orchestra.run.smithi086.stdout: "rgw_md_notify_interval_msec": "200", 2024-04-18T14:43:26.192 INFO:teuthology.orchestra.run.smithi086.stdout: "rgw_meta_sync_poll_interval": "20", 2024-04-18T14:43:26.192 INFO:teuthology.orchestra.run.smithi086.stdout: "rgw_meta_sync_spawn_window": "20", 2024-04-18T14:43:26.192 INFO:teuthology.orchestra.run.smithi086.stdout: "rgw_mime_types_file": "/etc/mime.types", 2024-04-18T14:43:26.192 INFO:teuthology.orchestra.run.smithi086.stdout: "rgw_mp_lock_max_time": "600", 2024-04-18T14:43:26.192 INFO:teuthology.orchestra.run.smithi086.stdout: "rgw_multi_obj_del_max_aio": "16", 2024-04-18T14:43:26.192 INFO:teuthology.orchestra.run.smithi086.stdout: "rgw_multipart_min_part_size": "5242880", 2024-04-18T14:43:26.192 INFO:teuthology.orchestra.run.smithi086.stdout: "rgw_multipart_part_upload_limit": "10000", 2024-04-18T14:43:26.192 INFO:teuthology.orchestra.run.smithi086.stdout: "rgw_nfs_fhcache_partitions": "3", 2024-04-18T14:43:26.192 INFO:teuthology.orchestra.run.smithi086.stdout: "rgw_nfs_fhcache_size": "2017", 2024-04-18T14:43:26.192 INFO:teuthology.orchestra.run.smithi086.stdout: "rgw_nfs_frontends": "rgw-nfs", 2024-04-18T14:43:26.192 INFO:teuthology.orchestra.run.smithi086.stdout: "rgw_nfs_lru_lane_hiwat": "911", 2024-04-18T14:43:26.193 INFO:teuthology.orchestra.run.smithi086.stdout: "rgw_nfs_lru_lanes": "5", 2024-04-18T14:43:26.193 INFO:teuthology.orchestra.run.smithi086.stdout: "rgw_nfs_max_gc": "300", 2024-04-18T14:43:26.193 INFO:teuthology.orchestra.run.smithi086.stdout: "rgw_nfs_namespace_expire_secs": "300", 2024-04-18T14:43:26.193 INFO:teuthology.orchestra.run.smithi086.stdout: "rgw_nfs_run_gc_threads": "false", 2024-04-18T14:43:26.193 INFO:teuthology.orchestra.run.smithi086.stdout: "rgw_nfs_run_lc_threads": "false", 2024-04-18T14:43:26.193 INFO:teuthology.orchestra.run.smithi086.stdout: "rgw_nfs_run_quota_threads": "false", 2024-04-18T14:43:26.193 INFO:teuthology.orchestra.run.smithi086.stdout: "rgw_nfs_run_sync_thread": "false", 2024-04-18T14:43:26.193 INFO:teuthology.orchestra.run.smithi086.stdout: "rgw_nfs_s3_fast_attrs": "false", 2024-04-18T14:43:26.193 INFO:teuthology.orchestra.run.smithi086.stdout: "rgw_nfs_write_completion_interval_s": "10", 2024-04-18T14:43:26.193 INFO:teuthology.orchestra.run.smithi086.stdout: "rgw_num_async_rados_threads": "32", 2024-04-18T14:43:26.193 INFO:teuthology.orchestra.run.smithi086.stdout: "rgw_num_control_oids": "8", 2024-04-18T14:43:26.193 INFO:teuthology.orchestra.run.smithi086.stdout: "rgw_numa_node": "-1", 2024-04-18T14:43:26.194 INFO:teuthology.orchestra.run.smithi086.stdout: "rgw_obj_stripe_size": "4194304", 2024-04-18T14:43:26.194 INFO:teuthology.orchestra.run.smithi086.stdout: "rgw_obj_tombstone_cache_size": "1000", 2024-04-18T14:43:26.194 INFO:teuthology.orchestra.run.smithi086.stdout: "rgw_objexp_chunk_size": "100", 2024-04-18T14:43:26.194 INFO:teuthology.orchestra.run.smithi086.stdout: "rgw_objexp_gc_interval": "600", 2024-04-18T14:43:26.194 INFO:teuthology.orchestra.run.smithi086.stdout: "rgw_objexp_hints_num_shards": "127", 2024-04-18T14:43:26.194 INFO:teuthology.orchestra.run.smithi086.stdout: "rgw_olh_pending_timeout_sec": "3600", 2024-04-18T14:43:26.194 INFO:teuthology.orchestra.run.smithi086.stdout: "rgw_op_thread_suicide_timeout": "0", 2024-04-18T14:43:26.194 INFO:teuthology.orchestra.run.smithi086.stdout: "rgw_op_thread_timeout": "600", 2024-04-18T14:43:26.194 INFO:teuthology.orchestra.run.smithi086.stdout: "rgw_op_tracing": "false", 2024-04-18T14:43:26.194 INFO:teuthology.orchestra.run.smithi086.stdout: "rgw_opa_token": "", 2024-04-18T14:43:26.194 INFO:teuthology.orchestra.run.smithi086.stdout: "rgw_opa_url": "", 2024-04-18T14:43:26.194 INFO:teuthology.orchestra.run.smithi086.stdout: "rgw_opa_verify_ssl": "true", 2024-04-18T14:43:26.194 INFO:teuthology.orchestra.run.smithi086.stdout: "rgw_ops_log_data_backlog": "5242880", 2024-04-18T14:43:26.194 INFO:teuthology.orchestra.run.smithi086.stdout: "rgw_ops_log_file_path": "/var/log/ceph/ops-log-ceph-mon.a.log", 2024-04-18T14:43:26.194 INFO:teuthology.orchestra.run.smithi086.stdout: "rgw_ops_log_rados": "false", 2024-04-18T14:43:26.194 INFO:teuthology.orchestra.run.smithi086.stdout: "rgw_ops_log_socket_path": "", 2024-04-18T14:43:26.195 INFO:teuthology.orchestra.run.smithi086.stdout: "rgw_override_bucket_index_max_shards": "0", 2024-04-18T14:43:26.195 INFO:teuthology.orchestra.run.smithi086.stdout: "rgw_pending_bucket_index_op_expiration": "120", 2024-04-18T14:43:26.195 INFO:teuthology.orchestra.run.smithi086.stdout: "rgw_period_latest_epoch_info_oid": ".latest_epoch", 2024-04-18T14:43:26.195 INFO:teuthology.orchestra.run.smithi086.stdout: "rgw_period_push_interval": "2.000000", 2024-04-18T14:43:26.195 INFO:teuthology.orchestra.run.smithi086.stdout: "rgw_period_push_interval_max": "30.000000", 2024-04-18T14:43:26.195 INFO:teuthology.orchestra.run.smithi086.stdout: "rgw_period_root_pool": ".rgw.root", 2024-04-18T14:43:26.195 INFO:teuthology.orchestra.run.smithi086.stdout: "rgw_policy_reject_invalid_principals": "true", 2024-04-18T14:43:26.195 INFO:teuthology.orchestra.run.smithi086.stdout: "rgw_print_continue": "true", 2024-04-18T14:43:26.195 INFO:teuthology.orchestra.run.smithi086.stdout: "rgw_print_prohibited_content_length": "false", 2024-04-18T14:43:26.195 INFO:teuthology.orchestra.run.smithi086.stdout: "rgw_put_obj_max_window_size": "67108864", 2024-04-18T14:43:26.195 INFO:teuthology.orchestra.run.smithi086.stdout: "rgw_put_obj_min_window_size": "16777216", 2024-04-18T14:43:26.195 INFO:teuthology.orchestra.run.smithi086.stdout: "rgw_rados_pool_autoscale_bias": "4.000000", 2024-04-18T14:43:26.195 INFO:teuthology.orchestra.run.smithi086.stdout: "rgw_rados_pool_recovery_priority": "5", 2024-04-18T14:43:26.195 INFO:teuthology.orchestra.run.smithi086.stdout: "rgw_rados_tracing": "false", 2024-04-18T14:43:26.195 INFO:teuthology.orchestra.run.smithi086.stdout: "rgw_realm": "", 2024-04-18T14:43:26.196 INFO:teuthology.orchestra.run.smithi086.stdout: "rgw_realm_id": "", 2024-04-18T14:43:26.196 INFO:teuthology.orchestra.run.smithi086.stdout: "rgw_realm_root_pool": ".rgw.root", 2024-04-18T14:43:26.196 INFO:teuthology.orchestra.run.smithi086.stdout: "rgw_region": "", 2024-04-18T14:43:26.196 INFO:teuthology.orchestra.run.smithi086.stdout: "rgw_region_root_pool": ".rgw.root", 2024-04-18T14:43:26.196 INFO:teuthology.orchestra.run.smithi086.stdout: "rgw_relaxed_region_enforcement": "false", 2024-04-18T14:43:26.196 INFO:teuthology.orchestra.run.smithi086.stdout: "rgw_relaxed_s3_bucket_names": "false", 2024-04-18T14:43:26.196 INFO:teuthology.orchestra.run.smithi086.stdout: "rgw_remote_addr_param": "REMOTE_ADDR", 2024-04-18T14:43:26.196 INFO:teuthology.orchestra.run.smithi086.stdout: "rgw_request_uri": "", 2024-04-18T14:43:26.196 INFO:teuthology.orchestra.run.smithi086.stdout: "rgw_reshard_batch_size": "64", 2024-04-18T14:43:26.196 INFO:teuthology.orchestra.run.smithi086.stdout: "rgw_reshard_bucket_lock_duration": "360", 2024-04-18T14:43:26.196 INFO:teuthology.orchestra.run.smithi086.stdout: "rgw_reshard_max_aio": "128", 2024-04-18T14:43:26.196 INFO:teuthology.orchestra.run.smithi086.stdout: "rgw_reshard_num_logs": "16", 2024-04-18T14:43:26.196 INFO:teuthology.orchestra.run.smithi086.stdout: "rgw_reshard_thread_interval": "600", 2024-04-18T14:43:26.196 INFO:teuthology.orchestra.run.smithi086.stdout: "rgw_resolve_cname": "false", 2024-04-18T14:43:26.196 INFO:teuthology.orchestra.run.smithi086.stdout: "rgw_rest_getusage_op_compat": "false", 2024-04-18T14:43:26.197 INFO:teuthology.orchestra.run.smithi086.stdout: "rgw_run_sync_thread": "true", 2024-04-18T14:43:26.197 INFO:teuthology.orchestra.run.smithi086.stdout: "rgw_s3_auth_order": "sts, external, local", 2024-04-18T14:43:26.197 INFO:teuthology.orchestra.run.smithi086.stdout: "rgw_s3_auth_use_keystone": "false", 2024-04-18T14:43:26.197 INFO:teuthology.orchestra.run.smithi086.stdout: "rgw_s3_auth_use_ldap": "false", 2024-04-18T14:43:26.197 INFO:teuthology.orchestra.run.smithi086.stdout: "rgw_s3_auth_use_rados": "true", 2024-04-18T14:43:26.197 INFO:teuthology.orchestra.run.smithi086.stdout: "rgw_s3_auth_use_sts": "false", 2024-04-18T14:43:26.197 INFO:teuthology.orchestra.run.smithi086.stdout: "rgw_s3_client_max_sig_ver": "-1", 2024-04-18T14:43:26.197 INFO:teuthology.orchestra.run.smithi086.stdout: "rgw_s3_success_create_obj_status": "0", 2024-04-18T14:43:26.197 INFO:teuthology.orchestra.run.smithi086.stdout: "rgw_safe_max_objects_per_shard": "102400", 2024-04-18T14:43:26.197 INFO:teuthology.orchestra.run.smithi086.stdout: "rgw_scheduler_type": "throttler", 2024-04-18T14:43:26.197 INFO:teuthology.orchestra.run.smithi086.stdout: "rgw_script_uri": "", 2024-04-18T14:43:26.197 INFO:teuthology.orchestra.run.smithi086.stdout: "rgw_service_provider_name": "", 2024-04-18T14:43:26.197 INFO:teuthology.orchestra.run.smithi086.stdout: "rgw_shard_warning_threshold": "90.000000", 2024-04-18T14:43:26.197 INFO:teuthology.orchestra.run.smithi086.stdout: "rgw_sts_client_id": "", 2024-04-18T14:43:26.197 INFO:teuthology.orchestra.run.smithi086.stdout: "rgw_sts_client_secret": "", 2024-04-18T14:43:26.197 INFO:teuthology.orchestra.run.smithi086.stdout: "rgw_sts_entry": "sts", 2024-04-18T14:43:26.198 INFO:teuthology.orchestra.run.smithi086.stdout: "rgw_sts_key": "sts", 2024-04-18T14:43:26.198 INFO:teuthology.orchestra.run.smithi086.stdout: "rgw_sts_max_session_duration": "43200", 2024-04-18T14:43:26.198 INFO:teuthology.orchestra.run.smithi086.stdout: "rgw_sts_min_session_duration": "900", 2024-04-18T14:43:26.198 INFO:teuthology.orchestra.run.smithi086.stdout: "rgw_sts_token_introspection_url": "", 2024-04-18T14:43:26.198 INFO:teuthology.orchestra.run.smithi086.stdout: "rgw_swift_account_in_url": "false", 2024-04-18T14:43:26.198 INFO:teuthology.orchestra.run.smithi086.stdout: "rgw_swift_auth_entry": "auth", 2024-04-18T14:43:26.198 INFO:teuthology.orchestra.run.smithi086.stdout: "rgw_swift_auth_url": "", 2024-04-18T14:43:26.198 INFO:teuthology.orchestra.run.smithi086.stdout: "rgw_swift_custom_header": "", 2024-04-18T14:43:26.198 INFO:teuthology.orchestra.run.smithi086.stdout: "rgw_swift_enforce_content_length": "false", 2024-04-18T14:43:26.198 INFO:teuthology.orchestra.run.smithi086.stdout: "rgw_swift_need_stats": "true", 2024-04-18T14:43:26.198 INFO:teuthology.orchestra.run.smithi086.stdout: "rgw_swift_tenant_name": "", 2024-04-18T14:43:26.198 INFO:teuthology.orchestra.run.smithi086.stdout: "rgw_swift_token_expiration": "86400", 2024-04-18T14:43:26.198 INFO:teuthology.orchestra.run.smithi086.stdout: "rgw_swift_url": "", 2024-04-18T14:43:26.198 INFO:teuthology.orchestra.run.smithi086.stdout: "rgw_swift_url_prefix": "swift", 2024-04-18T14:43:26.198 INFO:teuthology.orchestra.run.smithi086.stdout: "rgw_swift_versioning_enabled": "false", 2024-04-18T14:43:26.199 INFO:teuthology.orchestra.run.smithi086.stdout: "rgw_sync_data_full_inject_err_probability": "0.000000", 2024-04-18T14:43:26.199 INFO:teuthology.orchestra.run.smithi086.stdout: "rgw_sync_data_inject_err_probability": "0.000000", 2024-04-18T14:43:26.199 INFO:teuthology.orchestra.run.smithi086.stdout: "rgw_sync_lease_period": "120", 2024-04-18T14:43:26.199 INFO:teuthology.orchestra.run.smithi086.stdout: "rgw_sync_log_trim_concurrent_buckets": "4", 2024-04-18T14:43:26.199 INFO:teuthology.orchestra.run.smithi086.stdout: "rgw_sync_log_trim_interval": "1200", 2024-04-18T14:43:26.199 INFO:teuthology.orchestra.run.smithi086.stdout: "rgw_sync_log_trim_max_buckets": "16", 2024-04-18T14:43:26.199 INFO:teuthology.orchestra.run.smithi086.stdout: "rgw_sync_log_trim_min_cold_buckets": "4", 2024-04-18T14:43:26.199 INFO:teuthology.orchestra.run.smithi086.stdout: "rgw_sync_meta_inject_err_probability": "0.000000", 2024-04-18T14:43:26.199 INFO:teuthology.orchestra.run.smithi086.stdout: "rgw_sync_obj_etag_verify": "false", 2024-04-18T14:43:26.199 INFO:teuthology.orchestra.run.smithi086.stdout: "rgw_sync_trace_history_size": "4096", 2024-04-18T14:43:26.199 INFO:teuthology.orchestra.run.smithi086.stdout: "rgw_sync_trace_per_node_log_size": "32", 2024-04-18T14:43:26.199 INFO:teuthology.orchestra.run.smithi086.stdout: "rgw_sync_trace_servicemap_update_interval": "10", 2024-04-18T14:43:26.199 INFO:teuthology.orchestra.run.smithi086.stdout: "rgw_thread_pool_size": "512", 2024-04-18T14:43:26.199 INFO:teuthology.orchestra.run.smithi086.stdout: "rgw_torrent_comment": "", 2024-04-18T14:43:26.199 INFO:teuthology.orchestra.run.smithi086.stdout: "rgw_torrent_createby": "", 2024-04-18T14:43:26.199 INFO:teuthology.orchestra.run.smithi086.stdout: "rgw_torrent_encoding": "", 2024-04-18T14:43:26.200 INFO:teuthology.orchestra.run.smithi086.stdout: "rgw_torrent_flag": "false", 2024-04-18T14:43:26.200 INFO:teuthology.orchestra.run.smithi086.stdout: "rgw_torrent_origin": "", 2024-04-18T14:43:26.200 INFO:teuthology.orchestra.run.smithi086.stdout: "rgw_torrent_sha_unit": "524288", 2024-04-18T14:43:26.200 INFO:teuthology.orchestra.run.smithi086.stdout: "rgw_torrent_tracker": "", 2024-04-18T14:43:26.200 INFO:teuthology.orchestra.run.smithi086.stdout: "rgw_trust_forwarded_https": "false", 2024-04-18T14:43:26.200 INFO:teuthology.orchestra.run.smithi086.stdout: "rgw_usage_log_flush_threshold": "1024", 2024-04-18T14:43:26.200 INFO:teuthology.orchestra.run.smithi086.stdout: "rgw_usage_log_tick_interval": "30", 2024-04-18T14:43:26.200 INFO:teuthology.orchestra.run.smithi086.stdout: "rgw_usage_max_shards": "32", 2024-04-18T14:43:26.200 INFO:teuthology.orchestra.run.smithi086.stdout: "rgw_usage_max_user_shards": "1", 2024-04-18T14:43:26.200 INFO:teuthology.orchestra.run.smithi086.stdout: "rgw_use_opa_authz": "false", 2024-04-18T14:43:26.200 INFO:teuthology.orchestra.run.smithi086.stdout: "rgw_user_default_quota_max_objects": "-1", 2024-04-18T14:43:26.200 INFO:teuthology.orchestra.run.smithi086.stdout: "rgw_user_default_quota_max_size": "-1", 2024-04-18T14:43:26.200 INFO:teuthology.orchestra.run.smithi086.stdout: "rgw_user_max_buckets": "1000", 2024-04-18T14:43:26.200 INFO:teuthology.orchestra.run.smithi086.stdout: "rgw_user_policies_max_num": "100", 2024-04-18T14:43:26.200 INFO:teuthology.orchestra.run.smithi086.stdout: "rgw_user_quota_bucket_sync_interval": "180", 2024-04-18T14:43:26.200 INFO:teuthology.orchestra.run.smithi086.stdout: "rgw_user_quota_sync_idle_users": "false", 2024-04-18T14:43:26.201 INFO:teuthology.orchestra.run.smithi086.stdout: "rgw_user_quota_sync_interval": "86400", 2024-04-18T14:43:26.201 INFO:teuthology.orchestra.run.smithi086.stdout: "rgw_user_quota_sync_wait_time": "86400", 2024-04-18T14:43:26.201 INFO:teuthology.orchestra.run.smithi086.stdout: "rgw_user_unique_email": "true", 2024-04-18T14:43:26.201 INFO:teuthology.orchestra.run.smithi086.stdout: "rgw_verify_ssl": "true", 2024-04-18T14:43:26.201 INFO:teuthology.orchestra.run.smithi086.stdout: "rgw_website_routing_rules_max_num": "50", 2024-04-18T14:43:26.201 INFO:teuthology.orchestra.run.smithi086.stdout: "rgw_zone": "", 2024-04-18T14:43:26.201 INFO:teuthology.orchestra.run.smithi086.stdout: "rgw_zone_id": "", 2024-04-18T14:43:26.201 INFO:teuthology.orchestra.run.smithi086.stdout: "rgw_zone_root_pool": ".rgw.root", 2024-04-18T14:43:26.201 INFO:teuthology.orchestra.run.smithi086.stdout: "rgw_zonegroup": "", 2024-04-18T14:43:26.201 INFO:teuthology.orchestra.run.smithi086.stdout: "rgw_zonegroup_id": "", 2024-04-18T14:43:26.201 INFO:teuthology.orchestra.run.smithi086.stdout: "rgw_zonegroup_root_pool": ".rgw.root", 2024-04-18T14:43:26.201 INFO:teuthology.orchestra.run.smithi086.stdout: "rgwlc_auto_session_clear": "true", 2024-04-18T14:43:26.201 INFO:teuthology.orchestra.run.smithi086.stdout: "rgwlc_skip_bucket_step": "false", 2024-04-18T14:43:26.201 INFO:teuthology.orchestra.run.smithi086.stdout: "rocksdb_block_size": "4096", 2024-04-18T14:43:26.201 INFO:teuthology.orchestra.run.smithi086.stdout: "rocksdb_bloom_bits_per_key": "20", 2024-04-18T14:43:26.201 INFO:teuthology.orchestra.run.smithi086.stdout: "rocksdb_cache_index_and_filter_blocks": "true", 2024-04-18T14:43:26.202 INFO:teuthology.orchestra.run.smithi086.stdout: "rocksdb_cache_index_and_filter_blocks_with_high_priority": "false", 2024-04-18T14:43:26.202 INFO:teuthology.orchestra.run.smithi086.stdout: "rocksdb_cache_row_ratio": "0.000000", 2024-04-18T14:43:26.202 INFO:teuthology.orchestra.run.smithi086.stdout: "rocksdb_cache_shard_bits": "4", 2024-04-18T14:43:26.202 INFO:teuthology.orchestra.run.smithi086.stdout: "rocksdb_cache_size": "536870912", 2024-04-18T14:43:26.202 INFO:teuthology.orchestra.run.smithi086.stdout: "rocksdb_cache_type": "binned_lru", 2024-04-18T14:43:26.202 INFO:teuthology.orchestra.run.smithi086.stdout: "rocksdb_cf_compact_on_deletion": "true", 2024-04-18T14:43:26.202 INFO:teuthology.orchestra.run.smithi086.stdout: "rocksdb_cf_compact_on_deletion_sliding_window": "32768", 2024-04-18T14:43:26.202 INFO:teuthology.orchestra.run.smithi086.stdout: "rocksdb_cf_compact_on_deletion_trigger": "16384", 2024-04-18T14:43:26.202 INFO:teuthology.orchestra.run.smithi086.stdout: "rocksdb_collect_compaction_stats": "false", 2024-04-18T14:43:26.202 INFO:teuthology.orchestra.run.smithi086.stdout: "rocksdb_collect_extended_stats": "false", 2024-04-18T14:43:26.202 INFO:teuthology.orchestra.run.smithi086.stdout: "rocksdb_collect_memory_stats": "false", 2024-04-18T14:43:26.202 INFO:teuthology.orchestra.run.smithi086.stdout: "rocksdb_delete_range_threshold": "1048576", 2024-04-18T14:43:26.202 INFO:teuthology.orchestra.run.smithi086.stdout: "rocksdb_index_type": "binary_search", 2024-04-18T14:43:26.202 INFO:teuthology.orchestra.run.smithi086.stdout: "rocksdb_log_to_ceph_log": "true", 2024-04-18T14:43:26.202 INFO:teuthology.orchestra.run.smithi086.stdout: "rocksdb_metadata_block_size": "4096", 2024-04-18T14:43:26.203 INFO:teuthology.orchestra.run.smithi086.stdout: "rocksdb_partition_filters": "false", 2024-04-18T14:43:26.203 INFO:teuthology.orchestra.run.smithi086.stdout: "rocksdb_perf": "false", 2024-04-18T14:43:26.203 INFO:teuthology.orchestra.run.smithi086.stdout: "rocksdb_pin_l0_filter_and_index_blocks_in_cache": "false", 2024-04-18T14:43:26.203 INFO:teuthology.orchestra.run.smithi086.stdout: "rotating_keys_bootstrap_timeout": "30", 2024-04-18T14:43:26.203 INFO:teuthology.orchestra.run.smithi086.stdout: "rotating_keys_renewal_timeout": "10", 2024-04-18T14:43:26.203 INFO:teuthology.orchestra.run.smithi086.stdout: "run_dir": "/var/run/ceph", 2024-04-18T14:43:26.203 INFO:teuthology.orchestra.run.smithi086.stdout: "seastore_block_create": "true", 2024-04-18T14:43:26.203 INFO:teuthology.orchestra.run.smithi086.stdout: "seastore_cache_lru_size": "67108864", 2024-04-18T14:43:26.203 INFO:teuthology.orchestra.run.smithi086.stdout: "seastore_cbjournal_size": "5368709120", 2024-04-18T14:43:26.203 INFO:teuthology.orchestra.run.smithi086.stdout: "seastore_default_max_object_size": "16777216", 2024-04-18T14:43:26.203 INFO:teuthology.orchestra.run.smithi086.stdout: "seastore_default_object_metadata_reservation": "16777216", 2024-04-18T14:43:26.203 INFO:teuthology.orchestra.run.smithi086.stdout: "seastore_device_size": "53687091200", 2024-04-18T14:43:26.203 INFO:teuthology.orchestra.run.smithi086.stdout: "seastore_journal_batch_capacity": "16", 2024-04-18T14:43:26.203 INFO:teuthology.orchestra.run.smithi086.stdout: "seastore_journal_batch_flush_size": "16777216", 2024-04-18T14:43:26.203 INFO:teuthology.orchestra.run.smithi086.stdout: "seastore_journal_batch_preferred_fullness": "0.950000", 2024-04-18T14:43:26.204 INFO:teuthology.orchestra.run.smithi086.stdout: "seastore_journal_iodepth_limit": "5", 2024-04-18T14:43:26.204 INFO:teuthology.orchestra.run.smithi086.stdout: "seastore_main_device_type": "SSD", 2024-04-18T14:43:26.204 INFO:teuthology.orchestra.run.smithi086.stdout: "seastore_max_concurrent_transactions": "8", 2024-04-18T14:43:26.204 INFO:teuthology.orchestra.run.smithi086.stdout: "seastore_multiple_tiers_default_evict_ratio": "0.600000", 2024-04-18T14:43:26.204 INFO:teuthology.orchestra.run.smithi086.stdout: "seastore_multiple_tiers_fast_evict_ratio": "0.700000", 2024-04-18T14:43:26.204 INFO:teuthology.orchestra.run.smithi086.stdout: "seastore_multiple_tiers_stop_evict_ratio": "0.500000", 2024-04-18T14:43:26.204 INFO:teuthology.orchestra.run.smithi086.stdout: "seastore_obj_data_write_amplification": "1.250000", 2024-04-18T14:43:26.204 INFO:teuthology.orchestra.run.smithi086.stdout: "seastore_segment_size": "67108864", 2024-04-18T14:43:26.204 INFO:teuthology.orchestra.run.smithi086.stdout: "set_keepcaps": "false", 2024-04-18T14:43:26.204 INFO:teuthology.orchestra.run.smithi086.stdout: "setgroup": "", 2024-04-18T14:43:26.204 INFO:teuthology.orchestra.run.smithi086.stdout: "setuser": "", 2024-04-18T14:43:26.204 INFO:teuthology.orchestra.run.smithi086.stdout: "setuser_match_path": "", 2024-04-18T14:43:26.204 INFO:teuthology.orchestra.run.smithi086.stdout: "target_max_misplaced_ratio": "0.050000", 2024-04-18T14:43:26.204 INFO:teuthology.orchestra.run.smithi086.stdout: "thp": "false", 2024-04-18T14:43:26.204 INFO:teuthology.orchestra.run.smithi086.stdout: "threadpool_default_timeout": "60", 2024-04-18T14:43:26.204 INFO:teuthology.orchestra.run.smithi086.stdout: "threadpool_empty_queue_max_wait": "2", 2024-04-18T14:43:26.205 INFO:teuthology.orchestra.run.smithi086.stdout: "throttler_perf_counter": "true" 2024-04-18T14:43:26.205 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-04-18T14:43:26.207 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'mon.*' injectargs --mon_osd_down_out_interval=0 2024-04-18T14:43:26.346 INFO:teuthology.orchestra.run.smithi086.stdout:mon.a: {} 2024-04-18T14:43:26.347 INFO:teuthology.orchestra.run.smithi086.stderr:mon.a: mon_osd_down_out_interval = '' (not observed, change may require restart) 2024-04-18T14:43:26.358 INFO:teuthology.orchestra.run.smithi086.stdout:mon.b: {} 2024-04-18T14:43:26.359 INFO:teuthology.orchestra.run.smithi086.stderr:mon.b: mon_osd_down_out_interval = '' (not observed, change may require restart) 2024-04-18T14:43:26.371 INFO:teuthology.orchestra.run.smithi086.stdout:mon.c: {} 2024-04-18T14:43:26.371 INFO:teuthology.orchestra.run.smithi086.stderr:mon.c: mon_osd_down_out_interval = '' (not observed, change may require restart) 2024-04-18T14:43:26.388 DEBUG:teuthology.orchestra.run.smithi134:> type ceph-objectstore-tool 2024-04-18T14:43:26.393 INFO:teuthology.orchestra.run.smithi134.stdout:ceph-objectstore-tool is /usr/bin/ceph-objectstore-tool 2024-04-18T14:43:26.394 DEBUG:teuthology.orchestra.run.smithi119:> type ceph-objectstore-tool 2024-04-18T14:43:26.399 INFO:teuthology.orchestra.run.smithi119.stdout:ceph-objectstore-tool is /usr/bin/ceph-objectstore-tool 2024-04-18T14:43:26.399 DEBUG:teuthology.orchestra.run.smithi096:> type ceph-objectstore-tool 2024-04-18T14:43:26.405 INFO:teuthology.orchestra.run.smithi096.stdout:ceph-objectstore-tool is /usr/bin/ceph-objectstore-tool 2024-04-18T14:43:26.405 DEBUG:teuthology.orchestra.run.smithi086:> type ceph-objectstore-tool 2024-04-18T14:43:26.409 INFO:teuthology.orchestra.run.smithi086.stdout:ceph-objectstore-tool is /usr/bin/ceph-objectstore-tool 2024-04-18T14:43:26.409 INFO:teuthology.run_tasks:Running task rados... 2024-04-18T14:43:26.420 INFO:tasks.rados:Beginning rados... 2024-04-18T14:43:26.420 DEBUG:teuthology.run_tasks:Unwinding manager rados 2024-04-18T14:43:26.427 INFO:tasks.rados:joining rados 2024-04-18T14:43:26.427 INFO:tasks.thrashosds.thrasher:starting do_thrash 2024-04-18T14:43:26.428 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15] out_osds: [] dead_osds: [] live_osds: [0, 4, 8, 12, 1, 5, 9, 13, 2, 6, 10, 14, 3, 7, 11, 15] 2024-04-18T14:43:26.428 INFO:tasks.thrashosds.thrasher:choose_action: min_in 8 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-04-18T14:43:26.428 INFO:tasks.thrashosds.thrasher:Removing osd 1, in_osds are: [0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15] 2024-04-18T14:43:26.428 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd out 1 2024-04-18T14:43:26.428 INFO:tasks.thrashosds.thrasher:starting do_sighup with a delay of 0.1 2024-04-18T14:43:26.429 INFO:tasks.thrashosds.thrasher:starting do_optrack_toggle with a delay of 2.0 2024-04-18T14:43:26.429 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-18T14:43:26.429 INFO:tasks.thrashosds.thrasher:starting do_dump_ops 2024-04-18T14:43:26.429 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-18T14:43:26.429 INFO:tasks.thrashosds.thrasher:starting do_noscrub_toggle with a delay of 2.0 2024-04-18T14:43:26.430 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-04-18T14:43:26.430 INFO:tasks.rados:clients are ['client.0'] 2024-04-18T14:43:26.430 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd erasure-code-profile set shecprofile c=2 crush-failure-domain=osd k=4 m=3 name=shecprofile plugin=shec 2024-04-18T14:43:26.446 INFO:tasks.ceph.osd.9.smithi096.stderr:2024-04-18T14:43:26.448+0000 7fa2c1cbf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 9 (PID: 24891) UID: 0 2024-04-18T14:43:26.531 INFO:tasks.ceph.osd.7.smithi134.stderr:2024-04-18T14:43:26.531+0000 7fd7de549640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25213) UID: 0 2024-04-18T14:43:26.594 INFO:teuthology.orchestra.run.smithi086.stdout:osd.0: {} 2024-04-18T14:43:26.594 INFO:teuthology.orchestra.run.smithi086.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-18T14:43:26.615 INFO:teuthology.orchestra.run.smithi086.stdout:osd.1: {} 2024-04-18T14:43:26.615 INFO:teuthology.orchestra.run.smithi086.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-18T14:43:26.632 INFO:tasks.ceph.osd.14.smithi119.stderr:2024-04-18T14:43:26.630+0000 7f180f599640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 14 (PID: 24900) UID: 0 2024-04-18T14:43:26.637 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-04-18T14:43:26.637 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T14:43:26.648 INFO:teuthology.orchestra.run.smithi086.stdout:osd.2: {} 2024-04-18T14:43:26.648 INFO:teuthology.orchestra.run.smithi086.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-18T14:43:26.654 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-18T14:43:26.668 INFO:teuthology.orchestra.run.smithi086.stdout:osd.3: {} 2024-04-18T14:43:26.668 INFO:teuthology.orchestra.run.smithi086.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-18T14:43:26.699 INFO:teuthology.orchestra.run.smithi086.stdout:osd.4: {} 2024-04-18T14:43:26.699 INFO:teuthology.orchestra.run.smithi086.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-18T14:43:26.734 INFO:teuthology.orchestra.run.smithi086.stdout:osd.5: {} 2024-04-18T14:43:26.734 INFO:teuthology.orchestra.run.smithi086.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-18T14:43:26.735 INFO:tasks.ceph.osd.5.smithi096.stderr:2024-04-18T14:43:26.736+0000 7fc33f25b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 24889) UID: 0 2024-04-18T14:43:26.765 INFO:teuthology.orchestra.run.smithi086.stdout:osd.6: {} 2024-04-18T14:43:26.765 INFO:teuthology.orchestra.run.smithi086.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-18T14:43:26.784 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-04-18T14:43:26.784 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T14:43:26.797 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-18T14:43:26.798 INFO:teuthology.orchestra.run.smithi086.stdout:osd.7: {} 2024-04-18T14:43:26.798 INFO:teuthology.orchestra.run.smithi086.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-18T14:43:26.814 INFO:teuthology.orchestra.run.smithi086.stdout:osd.8: {} 2024-04-18T14:43:26.814 INFO:teuthology.orchestra.run.smithi086.stderr:osd.8: osd_enable_op_tracker = '' 2024-04-18T14:43:26.835 INFO:tasks.ceph.osd.6.smithi119.stderr:2024-04-18T14:43:26.838+0000 7fb7cb8bd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 24896) UID: 0 2024-04-18T14:43:26.845 INFO:teuthology.orchestra.run.smithi086.stdout:osd.9: {} 2024-04-18T14:43:26.845 INFO:teuthology.orchestra.run.smithi086.stderr:osd.9: osd_enable_op_tracker = '' 2024-04-18T14:43:26.877 INFO:teuthology.orchestra.run.smithi086.stdout:osd.10: {} 2024-04-18T14:43:26.877 INFO:teuthology.orchestra.run.smithi086.stderr:osd.10: osd_enable_op_tracker = '' 2024-04-18T14:43:26.903 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-04-18T14:43:26.903 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T14:43:26.907 INFO:tasks.ceph.mon.a.smithi086.stderr:2024-04-18T14:43:26.908+0000 7f0d98e5e640 -1 mon.a@0(leader).osd e27 definitely_dead 0 2024-04-18T14:43:26.909 INFO:teuthology.orchestra.run.smithi086.stdout:osd.11: {} 2024-04-18T14:43:26.909 INFO:teuthology.orchestra.run.smithi086.stderr:osd.11: osd_enable_op_tracker = '' 2024-04-18T14:43:26.916 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-04-18T14:43:26.924 INFO:teuthology.orchestra.run.smithi086.stdout:osd.12: {} 2024-04-18T14:43:26.925 INFO:teuthology.orchestra.run.smithi086.stderr:osd.12: osd_enable_op_tracker = '' 2024-04-18T14:43:26.937 INFO:tasks.ceph.osd.15.smithi134.stderr:2024-04-18T14:43:26.935+0000 7f08e6a51640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 15 (PID: 25218) UID: 0 2024-04-18T14:43:26.943 INFO:teuthology.orchestra.run.smithi086.stdout:osd.13: {} 2024-04-18T14:43:26.944 INFO:teuthology.orchestra.run.smithi086.stderr:osd.13: osd_enable_op_tracker = '' 2024-04-18T14:43:26.962 INFO:teuthology.orchestra.run.smithi086.stdout:osd.14: {} 2024-04-18T14:43:26.963 INFO:teuthology.orchestra.run.smithi086.stderr:osd.14: osd_enable_op_tracker = '' 2024-04-18T14:43:26.963 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-18T14:43:26.964+0000 7f7eb685b640 0 -- 172.21.15.86:0/3603197877 >> [v2:172.21.15.134:6808/25223,v1:172.21.15.134:6812/25223] conn(0x7f7eb02219a0 msgr2=0x7f7eb0223d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-04-18T14:43:27.036 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-04-18T14:43:27.037 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T14:43:27.037 INFO:tasks.ceph.osd.7.smithi134.stderr:2024-04-18T14:43:27.039+0000 7fd7de549640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25213) UID: 0 2024-04-18T14:43:27.050 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-04-18T14:43:27.138 INFO:tasks.ceph.osd.15.smithi134.stderr:2024-04-18T14:43:27.139+0000 7f08e6a51640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 15 (PID: 25218) UID: 0 2024-04-18T14:43:27.186 INFO:teuthology.orchestra.run.smithi086.stdout:osd.15: {} 2024-04-18T14:43:27.186 INFO:teuthology.orchestra.run.smithi086.stderr:osd.15: osd_enable_op_tracker = '' 2024-04-18T14:43:27.212 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-04-18T14:43:27.212 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T14:43:27.225 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-04-18T14:43:27.239 INFO:tasks.ceph.osd.10.smithi119.stderr:2024-04-18T14:43:27.238+0000 7f6f24c12640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 10 (PID: 24898) UID: 0 2024-04-18T14:43:27.340 INFO:tasks.ceph.osd.11.smithi134.stderr:2024-04-18T14:43:27.339+0000 7f2d36f12640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 11 (PID: 25216) UID: 0 2024-04-18T14:43:27.387 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-04-18T14:43:27.387 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T14:43:27.400 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.8.asok dump_ops_in_flight 2024-04-18T14:43:27.440 INFO:tasks.ceph.osd.9.smithi096.stderr:2024-04-18T14:43:27.443+0000 7fa2c1cbf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 9 (PID: 24891) UID: 0 2024-04-18T14:43:27.516 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-04-18T14:43:27.516 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T14:43:27.529 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.8.asok dump_blocked_ops 2024-04-18T14:43:27.541 INFO:tasks.ceph.osd.2.smithi119.stderr:2024-04-18T14:43:27.542+0000 7fcbd30c0640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 24894) UID: 0 2024-04-18T14:43:27.618 INFO:teuthology.orchestra.run.smithi086.stderr:noscrub is set 2024-04-18T14:43:27.619 INFO:teuthology.orchestra.run.smithi086.stderr:load: shec 2024-04-18T14:43:27.619 INFO:teuthology.orchestra.run.smithi086.stderr:marked out osd.1. 2024-04-18T14:43:27.643 INFO:tasks.ceph.osd.1.smithi096.stderr:2024-04-18T14:43:27.643+0000 7f56a7a98640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 24887) UID: 0 2024-04-18T14:43:27.650 INFO:tasks.rados:starting run 0 out of 1 2024-04-18T14:43:27.650 INFO:tasks.ceph.ceph_manager.ceph:creating pool_name unique_pool_0 2024-04-18T14:43:27.650 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create unique_pool_0 16 16 erasure shecprofile 2024-04-18T14:43:27.659 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-04-18T14:43:27.659 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T14:43:27.672 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.8.asok dump_historic_ops 2024-04-18T14:43:27.742 INFO:tasks.ceph.osd.6.smithi119.stderr:2024-04-18T14:43:27.742+0000 7fb7cb8bd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 24896) UID: 0 2024-04-18T14:43:27.833 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-04-18T14:43:27.833 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T14:43:27.844 INFO:tasks.ceph.osd.9.smithi096.stderr:2024-04-18T14:43:27.843+0000 7fa2c1cbf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 9 (PID: 24891) UID: 0 2024-04-18T14:43:27.846 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.12.asok dump_ops_in_flight 2024-04-18T14:43:27.945 INFO:tasks.ceph.osd.13.smithi096.stderr:2024-04-18T14:43:27.947+0000 7f7e72fad640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 13 (PID: 24893) UID: 0 2024-04-18T14:43:27.957 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-04-18T14:43:27.957 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T14:43:27.972 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.12.asok dump_blocked_ops 2024-04-18T14:43:28.046 INFO:tasks.ceph.osd.6.smithi119.stderr:2024-04-18T14:43:28.046+0000 7fb7cb8bd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 24896) UID: 0 2024-04-18T14:43:28.080 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-04-18T14:43:28.080 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T14:43:28.093 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.12.asok dump_historic_ops 2024-04-18T14:43:28.146 INFO:tasks.ceph.osd.1.smithi096.stderr:2024-04-18T14:43:28.147+0000 7f56a7a98640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 24887) UID: 0 2024-04-18T14:43:28.200 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-04-18T14:43:28.200 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T14:43:28.213 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-18T14:43:28.247 INFO:tasks.ceph.osd.10.smithi119.stderr:2024-04-18T14:43:28.246+0000 7f6f24c12640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 10 (PID: 24898) UID: 0 2024-04-18T14:43:28.345 INFO:teuthology.orchestra.run.smithi096.stdout:ERROR: (22) Invalid argument 2024-04-18T14:43:28.345 INFO:teuthology.orchestra.run.smithi096.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T14:43:28.349 INFO:tasks.ceph.osd.15.smithi134.stderr:2024-04-18T14:43:28.351+0000 7f08e6a51640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 15 (PID: 25218) UID: 0 2024-04-18T14:43:28.359 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-18T14:43:28.449 INFO:tasks.ceph.osd.3.smithi134.stderr:2024-04-18T14:43:28.451+0000 7fe7a4443640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25211) UID: 0 2024-04-18T14:43:28.474 INFO:teuthology.orchestra.run.smithi096.stdout:ERROR: (22) Invalid argument 2024-04-18T14:43:28.475 INFO:teuthology.orchestra.run.smithi096.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T14:43:28.488 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-18T14:43:28.550 INFO:tasks.ceph.osd.3.smithi134.stderr:2024-04-18T14:43:28.551+0000 7fe7a4443640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25211) UID: 0 2024-04-18T14:43:28.611 INFO:teuthology.orchestra.run.smithi096.stdout:ERROR: (22) Invalid argument 2024-04-18T14:43:28.611 INFO:teuthology.orchestra.run.smithi096.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T14:43:28.627 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-04-18T14:43:28.651 INFO:tasks.ceph.osd.15.smithi134.stderr:2024-04-18T14:43:28.651+0000 7f08e6a51640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 15 (PID: 25218) UID: 0 2024-04-18T14:43:28.743 INFO:teuthology.orchestra.run.smithi096.stdout:ERROR: (22) Invalid argument 2024-04-18T14:43:28.744 INFO:teuthology.orchestra.run.smithi096.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T14:43:28.752 INFO:tasks.ceph.osd.5.smithi096.stderr:2024-04-18T14:43:28.751+0000 7fc33f25b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 24889) UID: 0 2024-04-18T14:43:28.757 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-04-18T14:43:28.853 INFO:tasks.ceph.osd.7.smithi134.stderr:2024-04-18T14:43:28.855+0000 7fd7de549640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25213) UID: 0 2024-04-18T14:43:28.918 INFO:teuthology.orchestra.run.smithi096.stdout:ERROR: (22) Invalid argument 2024-04-18T14:43:28.918 INFO:teuthology.orchestra.run.smithi096.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T14:43:28.932 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-04-18T14:43:28.978 INFO:tasks.ceph.osd.13.smithi096.stderr:2024-04-18T14:43:28.979+0000 7f7e72fad640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 13 (PID: 24893) UID: 0 2024-04-18T14:43:29.047 INFO:teuthology.orchestra.run.smithi096.stdout:ERROR: (22) Invalid argument 2024-04-18T14:43:29.047 INFO:teuthology.orchestra.run.smithi096.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T14:43:29.056 INFO:tasks.ceph.osd.13.smithi096.stderr:2024-04-18T14:43:29.055+0000 7f7e72fad640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 13 (PID: 24893) UID: 0 2024-04-18T14:43:29.061 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.9.asok dump_ops_in_flight 2024-04-18T14:43:29.157 INFO:tasks.ceph.osd.12.smithi086.stderr:2024-04-18T14:43:29.156+0000 7f6904968640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 12 (PID: 24960) UID: 0 2024-04-18T14:43:29.207 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-18T14:43:29.230 INFO:teuthology.orchestra.run.smithi096.stdout:ERROR: (22) Invalid argument 2024-04-18T14:43:29.230 INFO:teuthology.orchestra.run.smithi096.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T14:43:29.244 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.9.asok dump_blocked_ops 2024-04-18T14:43:29.257 INFO:tasks.ceph.osd.0.smithi086.stderr:2024-04-18T14:43:29.256+0000 7f7cdfd78640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 24953) UID: 0 2024-04-18T14:43:29.358 INFO:tasks.ceph.osd.7.smithi134.stderr:2024-04-18T14:43:29.359+0000 7fd7de549640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25213) UID: 0 2024-04-18T14:43:29.362 INFO:teuthology.orchestra.run.smithi086.stdout:osd.0: {} 2024-04-18T14:43:29.362 INFO:teuthology.orchestra.run.smithi086.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-18T14:43:29.366 INFO:teuthology.orchestra.run.smithi096.stdout:ERROR: (22) Invalid argument 2024-04-18T14:43:29.366 INFO:teuthology.orchestra.run.smithi096.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T14:43:29.381 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.9.asok dump_historic_ops 2024-04-18T14:43:29.381 INFO:teuthology.orchestra.run.smithi086.stdout:osd.1: {} 2024-04-18T14:43:29.382 INFO:teuthology.orchestra.run.smithi086.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-18T14:43:29.401 INFO:teuthology.orchestra.run.smithi086.stdout:osd.2: {} 2024-04-18T14:43:29.402 INFO:teuthology.orchestra.run.smithi086.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-18T14:43:29.424 INFO:teuthology.orchestra.run.smithi086.stdout:osd.3: {} 2024-04-18T14:43:29.424 INFO:teuthology.orchestra.run.smithi086.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-18T14:43:29.443 INFO:teuthology.orchestra.run.smithi086.stdout:osd.4: {} 2024-04-18T14:43:29.443 INFO:teuthology.orchestra.run.smithi086.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-18T14:43:29.459 INFO:tasks.ceph.osd.1.smithi096.stderr:2024-04-18T14:43:29.459+0000 7f56a7a98640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 24887) UID: 0 2024-04-18T14:43:29.462 INFO:teuthology.orchestra.run.smithi086.stdout:osd.5: {} 2024-04-18T14:43:29.462 INFO:teuthology.orchestra.run.smithi086.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-18T14:43:29.485 INFO:teuthology.orchestra.run.smithi086.stdout:osd.6: {} 2024-04-18T14:43:29.485 INFO:teuthology.orchestra.run.smithi086.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-18T14:43:29.503 INFO:teuthology.orchestra.run.smithi096.stdout:ERROR: (22) Invalid argument 2024-04-18T14:43:29.503 INFO:teuthology.orchestra.run.smithi096.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T14:43:29.506 INFO:teuthology.orchestra.run.smithi086.stdout:osd.7: {} 2024-04-18T14:43:29.506 INFO:teuthology.orchestra.run.smithi086.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-18T14:43:29.517 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.13.asok dump_ops_in_flight 2024-04-18T14:43:29.524 INFO:teuthology.orchestra.run.smithi086.stdout:osd.8: {} 2024-04-18T14:43:29.525 INFO:teuthology.orchestra.run.smithi086.stderr:osd.8: osd_enable_op_tracker = '' 2024-04-18T14:43:29.543 INFO:teuthology.orchestra.run.smithi086.stdout:osd.9: {} 2024-04-18T14:43:29.544 INFO:teuthology.orchestra.run.smithi086.stderr:osd.9: osd_enable_op_tracker = '' 2024-04-18T14:43:29.560 INFO:tasks.ceph.osd.14.smithi119.stderr:2024-04-18T14:43:29.558+0000 7f180f599640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 14 (PID: 24900) UID: 0 2024-04-18T14:43:29.564 INFO:teuthology.orchestra.run.smithi086.stdout:osd.10: {} 2024-04-18T14:43:29.564 INFO:teuthology.orchestra.run.smithi086.stderr:osd.10: osd_enable_op_tracker = '' 2024-04-18T14:43:29.586 INFO:teuthology.orchestra.run.smithi086.stdout:osd.11: {} 2024-04-18T14:43:29.586 INFO:teuthology.orchestra.run.smithi086.stderr:osd.11: osd_enable_op_tracker = '' 2024-04-18T14:43:29.605 INFO:teuthology.orchestra.run.smithi086.stdout:osd.12: {} 2024-04-18T14:43:29.605 INFO:teuthology.orchestra.run.smithi086.stderr:osd.12: osd_enable_op_tracker = '' 2024-04-18T14:43:29.617 INFO:teuthology.orchestra.run.smithi086.stderr:pool 'unique_pool_0' created 2024-04-18T14:43:29.627 INFO:teuthology.orchestra.run.smithi086.stdout:osd.13: {} 2024-04-18T14:43:29.628 INFO:teuthology.orchestra.run.smithi086.stderr:osd.13: osd_enable_op_tracker = '' 2024-04-18T14:43:29.641 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool application enable unique_pool_0 rados --yes-i-really-mean-it || true 2024-04-18T14:43:29.643 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-04-18T14:43:29.663 INFO:teuthology.orchestra.run.smithi086.stdout:osd.14: {} 2024-04-18T14:43:29.664 INFO:teuthology.orchestra.run.smithi086.stderr:osd.14: osd_enable_op_tracker = '' 2024-04-18T14:43:29.664 INFO:tasks.ceph.osd.4.smithi086.stderr:2024-04-18T14:43:29.664+0000 7f0c4c462640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 24956) UID: 0 2024-04-18T14:43:29.684 INFO:teuthology.orchestra.run.smithi086.stdout:osd.15: {} 2024-04-18T14:43:29.684 INFO:teuthology.orchestra.run.smithi086.stderr:osd.15: osd_enable_op_tracker = '' 2024-04-18T14:43:29.686 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2024-04-18T14:43:29.686 INFO:teuthology.orchestra.run.smithi096.stdout: "ops": [], 2024-04-18T14:43:29.686 INFO:teuthology.orchestra.run.smithi096.stdout: "num_ops": 0 2024-04-18T14:43:29.686 INFO:teuthology.orchestra.run.smithi096.stdout:} 2024-04-18T14:43:29.700 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.13.asok dump_blocked_ops 2024-04-18T14:43:29.763 INFO:tasks.ceph.osd.10.smithi119.stderr:2024-04-18T14:43:29.766+0000 7f6f24c12640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 10 (PID: 24898) UID: 0 2024-04-18T14:43:29.819 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2024-04-18T14:43:29.820 INFO:teuthology.orchestra.run.smithi096.stdout: "ops": [], 2024-04-18T14:43:29.820 INFO:teuthology.orchestra.run.smithi096.stdout: "complaint_time": 30, 2024-04-18T14:43:29.820 INFO:teuthology.orchestra.run.smithi096.stdout: "num_blocked_ops": 0 2024-04-18T14:43:29.820 INFO:teuthology.orchestra.run.smithi096.stdout:} 2024-04-18T14:43:29.834 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.13.asok dump_historic_ops 2024-04-18T14:43:29.864 INFO:tasks.ceph.osd.2.smithi119.stderr:2024-04-18T14:43:29.866+0000 7fcbd30c0640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 24894) UID: 0 2024-04-18T14:43:29.960 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2024-04-18T14:43:29.960 INFO:teuthology.orchestra.run.smithi096.stdout: "size": 20, 2024-04-18T14:43:29.960 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 600, 2024-04-18T14:43:29.960 INFO:teuthology.orchestra.run.smithi096.stdout: "ops": [ 2024-04-18T14:43:29.961 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:29.961 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4212.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-18T14:43:29.961 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-04-18T14:43:19.321281+0000", 2024-04-18T14:43:29.961 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 10.637456168, 2024-04-18T14:43:29.961 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.0074994820000001, 2024-04-18T14:43:29.961 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-04-18T14:43:29.961 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T14:43:29.961 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-04-18T14:43:29.961 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4212", 2024-04-18T14:43:29.961 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "172.21.15.134:0/3325451476", 2024-04-18T14:43:29.961 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 1 2024-04-18T14:43:29.961 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:29.961 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-04-18T14:43:29.961 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:29.961 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-04-18T14:43:29.961 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:19.321281+0000", 2024-04-18T14:43:29.962 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:43:29.962 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:29.962 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:29.962 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-04-18T14:43:29.962 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:19.321281+0000", 2024-04-18T14:43:29.962 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:43:29.962 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:29.962 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:29.962 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-04-18T14:43:29.962 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:19.321279+0000", 2024-04-18T14:43:29.962 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 4294967295.9999971 2024-04-18T14:43:29.962 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:29.962 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:29.962 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-04-18T14:43:29.962 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:19.321299+0000", 2024-04-18T14:43:29.963 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.0098e-05 2024-04-18T14:43:29.963 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:29.963 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:29.963 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-04-18T14:43:29.963 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:19.321342+0000", 2024-04-18T14:43:29.963 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 4.3146000000000003e-05 2024-04-18T14:43:29.963 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:29.963 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:29.963 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-04-18T14:43:29.963 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:19.321367+0000", 2024-04-18T14:43:29.963 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.5318000000000001e-05 2024-04-18T14:43:29.963 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:29.963 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:29.963 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-04-18T14:43:29.963 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:19.321511+0000", 2024-04-18T14:43:29.964 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000143981 2024-04-18T14:43:29.964 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:29.964 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:29.964 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for peered", 2024-04-18T14:43:29.964 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:19.321560+0000", 2024-04-18T14:43:29.964 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 4.8279999999999999e-05 2024-04-18T14:43:29.964 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:29.964 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:29.964 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-04-18T14:43:29.964 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.324154+0000", 2024-04-18T14:43:29.964 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.0025947829999999 2024-04-18T14:43:29.965 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:29.965 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:29.965 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-04-18T14:43:29.965 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.324558+0000", 2024-04-18T14:43:29.965 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00040310999999999998 2024-04-18T14:43:29.965 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:29.965 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:29.965 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for subops from 0", 2024-04-18T14:43:29.965 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.325049+0000", 2024-04-18T14:43:29.965 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00049149000000000003 2024-04-18T14:43:29.965 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:29.965 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:29.965 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_commit_rec", 2024-04-18T14:43:29.965 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.326473+0000", 2024-04-18T14:43:29.965 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.001423517 2024-04-18T14:43:29.966 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:29.966 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:29.966 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-04-18T14:43:29.966 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.328533+0000", 2024-04-18T14:43:29.966 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0020606779999999998 2024-04-18T14:43:29.966 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:29.966 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:29.966 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-04-18T14:43:29.966 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.328679+0000", 2024-04-18T14:43:29.966 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00014585800000000001 2024-04-18T14:43:29.966 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:29.966 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:29.966 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-04-18T14:43:29.966 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.328781+0000", 2024-04-18T14:43:29.966 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000101872 2024-04-18T14:43:29.967 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:43:29.967 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T14:43:29.967 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:43:29.967 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:29.967 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:29.967 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4212.0:110 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-04-18T14:43:29.967 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-04-18T14:43:20.700822+0000", 2024-04-18T14:43:29.967 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 9.2579153739999995, 2024-04-18T14:43:29.967 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.021022381999999999, 2024-04-18T14:43:29.967 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-04-18T14:43:29.967 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T14:43:29.967 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-04-18T14:43:29.968 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4212", 2024-04-18T14:43:29.968 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "172.21.15.134:0/3325451476", 2024-04-18T14:43:29.968 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 110 2024-04-18T14:43:29.968 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:29.968 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-04-18T14:43:29.968 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:29.968 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-04-18T14:43:29.968 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.700822+0000", 2024-04-18T14:43:29.968 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:43:29.968 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:29.968 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:29.968 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-04-18T14:43:29.968 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.700822+0000", 2024-04-18T14:43:29.968 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:43:29.968 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:29.968 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:29.969 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-04-18T14:43:29.969 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.700821+0000", 2024-04-18T14:43:29.969 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 4294967295.999999 2024-04-18T14:43:29.969 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:29.969 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:29.969 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-04-18T14:43:29.969 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.700828+0000", 2024-04-18T14:43:29.969 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 6.9269999999999999e-06 2024-04-18T14:43:29.969 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:29.969 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:29.969 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-04-18T14:43:29.969 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.700839+0000", 2024-04-18T14:43:29.969 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.0702e-05 2024-04-18T14:43:29.969 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:29.969 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:29.970 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-04-18T14:43:29.970 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.700847+0000", 2024-04-18T14:43:29.970 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 7.6020000000000002e-06 2024-04-18T14:43:29.970 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:29.970 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:29.970 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-04-18T14:43:29.970 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.709488+0000", 2024-04-18T14:43:29.970 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0086410080000000004 2024-04-18T14:43:29.970 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:29.970 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:29.970 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-04-18T14:43:29.970 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.709751+0000", 2024-04-18T14:43:29.970 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000263272 2024-04-18T14:43:29.970 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:29.970 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:29.971 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for subops from 0", 2024-04-18T14:43:29.971 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.710106+0000", 2024-04-18T14:43:29.971 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000355037 2024-04-18T14:43:29.971 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:29.971 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:29.971 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-04-18T14:43:29.971 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.714026+0000", 2024-04-18T14:43:29.971 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0039202860000000003 2024-04-18T14:43:29.971 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:29.971 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:29.971 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_commit_rec", 2024-04-18T14:43:29.971 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.721600+0000", 2024-04-18T14:43:29.972 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0075740879999999997 2024-04-18T14:43:29.972 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:29.972 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:29.972 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-04-18T14:43:29.972 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.721740+0000", 2024-04-18T14:43:29.972 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00013932500000000001 2024-04-18T14:43:29.972 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:29.972 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:29.972 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-04-18T14:43:29.972 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.721845+0000", 2024-04-18T14:43:29.972 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000104992 2024-04-18T14:43:29.972 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:43:29.972 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T14:43:29.972 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:43:29.973 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:29.973 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:29.973 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4212.0:111 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-04-18T14:43:29.973 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-04-18T14:43:20.700855+0000", 2024-04-18T14:43:29.973 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 9.2578824900000001, 2024-04-18T14:43:29.973 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.021347998, 2024-04-18T14:43:29.973 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-04-18T14:43:29.973 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T14:43:29.973 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-04-18T14:43:29.973 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4212", 2024-04-18T14:43:29.973 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "172.21.15.134:0/3325451476", 2024-04-18T14:43:29.973 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 111 2024-04-18T14:43:29.973 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:29.973 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-04-18T14:43:29.973 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:29.974 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-04-18T14:43:29.974 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.700855+0000", 2024-04-18T14:43:29.974 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:43:29.974 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:29.974 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:29.974 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-04-18T14:43:29.974 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.700855+0000", 2024-04-18T14:43:29.974 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:43:29.974 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:29.974 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:29.974 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-04-18T14:43:29.974 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.700854+0000", 2024-04-18T14:43:29.974 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 4294967295.999999 2024-04-18T14:43:29.974 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:29.974 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:29.975 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-04-18T14:43:29.975 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.700860+0000", 2024-04-18T14:43:29.975 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 5.7189999999999998e-06 2024-04-18T14:43:29.975 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:29.975 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:29.975 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-04-18T14:43:29.975 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.700869+0000", 2024-04-18T14:43:29.975 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 8.9889999999999998e-06 2024-04-18T14:43:29.975 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:29.975 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:29.975 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-04-18T14:43:29.975 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.700876+0000", 2024-04-18T14:43:29.975 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 7.0430000000000002e-06 2024-04-18T14:43:29.975 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:29.975 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:29.975 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-04-18T14:43:29.976 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.711224+0000", 2024-04-18T14:43:29.976 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.010347897 2024-04-18T14:43:29.976 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:29.976 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:29.976 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-04-18T14:43:29.976 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.711463+0000", 2024-04-18T14:43:29.976 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00023920699999999999 2024-04-18T14:43:29.976 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:29.976 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:29.976 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for subops from 0", 2024-04-18T14:43:29.976 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.711805+0000", 2024-04-18T14:43:29.976 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00034209600000000001 2024-04-18T14:43:29.976 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:29.976 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:29.976 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-04-18T14:43:29.977 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.715645+0000", 2024-04-18T14:43:29.977 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.003839309 2024-04-18T14:43:29.977 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:29.977 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:29.977 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_commit_rec", 2024-04-18T14:43:29.977 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.721971+0000", 2024-04-18T14:43:29.977 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0063267729999999999 2024-04-18T14:43:29.977 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:29.977 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:29.977 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-04-18T14:43:29.977 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.722107+0000", 2024-04-18T14:43:29.977 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00013514500000000001 2024-04-18T14:43:29.977 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:29.977 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:29.977 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-04-18T14:43:29.977 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.722203+0000", 2024-04-18T14:43:29.978 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 9.6545999999999993e-05 2024-04-18T14:43:29.978 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:43:29.978 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T14:43:29.978 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:43:29.978 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:29.978 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:29.978 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4212.0:112 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-04-18T14:43:29.978 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-04-18T14:43:20.700902+0000", 2024-04-18T14:43:29.978 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 9.2578353470000003, 2024-04-18T14:43:29.978 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.021658816000000001, 2024-04-18T14:43:29.978 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-04-18T14:43:29.978 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T14:43:29.978 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-04-18T14:43:29.978 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4212", 2024-04-18T14:43:29.978 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "172.21.15.134:0/3325451476", 2024-04-18T14:43:29.979 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 112 2024-04-18T14:43:29.979 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:29.979 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-04-18T14:43:29.979 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:29.979 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-04-18T14:43:29.979 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.700902+0000", 2024-04-18T14:43:29.979 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:43:29.979 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:29.979 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:29.979 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-04-18T14:43:29.979 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.700902+0000", 2024-04-18T14:43:29.979 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:43:29.979 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:29.979 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:29.979 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-04-18T14:43:29.979 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.700901+0000", 2024-04-18T14:43:29.980 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 4294967295.999999 2024-04-18T14:43:29.980 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:29.980 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:29.980 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-04-18T14:43:29.980 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.701003+0000", 2024-04-18T14:43:29.980 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000102205 2024-04-18T14:43:29.980 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:29.980 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:29.980 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-04-18T14:43:29.980 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.701016+0000", 2024-04-18T14:43:29.980 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.2908000000000001e-05 2024-04-18T14:43:29.980 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:29.980 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:29.980 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-04-18T14:43:29.980 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.701025+0000", 2024-04-18T14:43:29.981 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 8.7229999999999993e-06 2024-04-18T14:43:29.981 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:29.981 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:29.981 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-04-18T14:43:29.981 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.712558+0000", 2024-04-18T14:43:29.981 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.011533181 2024-04-18T14:43:29.981 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:29.981 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:29.981 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-04-18T14:43:29.981 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.712690+0000", 2024-04-18T14:43:29.981 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00013159200000000001 2024-04-18T14:43:29.981 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:29.981 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:29.981 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for subops from 0", 2024-04-18T14:43:29.981 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.712895+0000", 2024-04-18T14:43:29.982 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000205126 2024-04-18T14:43:29.982 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:29.982 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:29.982 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-04-18T14:43:29.982 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.721499+0000", 2024-04-18T14:43:29.982 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0086041469999999995 2024-04-18T14:43:29.982 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:29.982 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:29.982 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_commit_rec", 2024-04-18T14:43:29.982 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.722336+0000", 2024-04-18T14:43:29.982 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00083725200000000003 2024-04-18T14:43:29.982 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:29.982 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:29.982 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-04-18T14:43:29.982 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.722461+0000", 2024-04-18T14:43:29.982 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00012457899999999999 2024-04-18T14:43:29.983 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:29.983 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:29.983 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-04-18T14:43:29.983 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.722561+0000", 2024-04-18T14:43:29.983 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000100066 2024-04-18T14:43:29.983 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:43:29.983 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T14:43:29.983 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:43:29.983 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:29.983 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:29.983 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4212.0:113 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-04-18T14:43:29.983 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-04-18T14:43:20.701035+0000", 2024-04-18T14:43:29.983 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 9.2577021609999992, 2024-04-18T14:43:29.983 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.021756507000000001, 2024-04-18T14:43:29.983 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-04-18T14:43:29.984 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T14:43:29.984 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-04-18T14:43:29.984 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4212", 2024-04-18T14:43:29.984 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "172.21.15.134:0/3325451476", 2024-04-18T14:43:29.984 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 113 2024-04-18T14:43:29.984 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:29.984 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-04-18T14:43:29.984 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:29.984 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-04-18T14:43:29.984 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.701035+0000", 2024-04-18T14:43:29.984 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:43:29.984 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:29.984 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:29.984 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-04-18T14:43:29.984 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.701035+0000", 2024-04-18T14:43:29.985 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:43:29.985 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:29.985 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:29.985 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-04-18T14:43:29.985 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.701035+0000", 2024-04-18T14:43:29.985 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 4294967295.999999 2024-04-18T14:43:29.985 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:29.985 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:29.985 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-04-18T14:43:29.985 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.701041+0000", 2024-04-18T14:43:29.985 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 6.0290000000000002e-06 2024-04-18T14:43:29.985 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:29.985 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:29.985 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-04-18T14:43:29.985 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.701050+0000", 2024-04-18T14:43:29.985 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 9.0299999999999999e-06 2024-04-18T14:43:29.986 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:29.986 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:29.986 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-04-18T14:43:29.986 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.701057+0000", 2024-04-18T14:43:29.986 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 6.9550000000000003e-06 2024-04-18T14:43:29.986 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:29.986 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:29.986 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-04-18T14:43:29.986 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.714308+0000", 2024-04-18T14:43:29.986 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.013251281 2024-04-18T14:43:29.987 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:29.987 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:29.987 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-04-18T14:43:29.987 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.714542+0000", 2024-04-18T14:43:29.987 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00023440000000000001 2024-04-18T14:43:29.987 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:29.987 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:29.987 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for subops from 0", 2024-04-18T14:43:29.987 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.714898+0000", 2024-04-18T14:43:29.987 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00035589500000000001 2024-04-18T14:43:29.987 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:29.987 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:29.987 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-04-18T14:43:29.987 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.721874+0000", 2024-04-18T14:43:29.987 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0069761620000000002 2024-04-18T14:43:29.988 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:29.988 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:29.988 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_commit_rec", 2024-04-18T14:43:29.988 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.722665+0000", 2024-04-18T14:43:29.988 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00079023299999999999 2024-04-18T14:43:29.988 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:29.988 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:29.988 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-04-18T14:43:29.988 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.722737+0000", 2024-04-18T14:43:29.988 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 7.2156999999999994e-05 2024-04-18T14:43:29.988 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:29.988 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:29.988 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-04-18T14:43:29.988 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.722792+0000", 2024-04-18T14:43:29.988 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 5.5095e-05 2024-04-18T14:43:29.988 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:43:29.989 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T14:43:29.989 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:43:29.989 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:29.989 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:29.989 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4212.0:114 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-04-18T14:43:29.989 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-04-18T14:43:20.701065+0000", 2024-04-18T14:43:29.989 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 9.2576725, 2024-04-18T14:43:29.989 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.022072597999999999, 2024-04-18T14:43:29.989 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-04-18T14:43:29.989 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T14:43:29.989 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-04-18T14:43:29.989 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4212", 2024-04-18T14:43:29.989 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "172.21.15.134:0/3325451476", 2024-04-18T14:43:29.989 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 114 2024-04-18T14:43:29.989 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:29.990 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-04-18T14:43:29.990 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:29.990 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-04-18T14:43:29.990 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.701065+0000", 2024-04-18T14:43:29.990 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:43:29.990 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:29.990 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:29.990 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-04-18T14:43:29.990 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.701065+0000", 2024-04-18T14:43:29.990 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:43:29.990 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:29.990 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:29.990 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-04-18T14:43:29.991 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.701064+0000", 2024-04-18T14:43:29.991 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 4294967295.9999995 2024-04-18T14:43:29.991 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:29.991 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:29.991 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-04-18T14:43:29.991 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.701070+0000", 2024-04-18T14:43:29.991 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 5.6400000000000002e-06 2024-04-18T14:43:29.991 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:29.991 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:29.991 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-04-18T14:43:29.991 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.701079+0000", 2024-04-18T14:43:29.991 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 8.9590000000000001e-06 2024-04-18T14:43:29.991 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:29.991 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:29.992 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-04-18T14:43:29.992 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.701086+0000", 2024-04-18T14:43:29.992 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 6.8499999999999996e-06 2024-04-18T14:43:29.992 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:29.992 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:29.992 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-04-18T14:43:29.992 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.715764+0000", 2024-04-18T14:43:29.992 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.01467833 2024-04-18T14:43:29.992 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:29.992 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:29.992 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-04-18T14:43:29.992 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.715902+0000", 2024-04-18T14:43:29.992 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00013763499999999999 2024-04-18T14:43:29.992 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:29.992 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:29.992 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for subops from 0", 2024-04-18T14:43:29.993 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.716201+0000", 2024-04-18T14:43:29.993 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00029946200000000001 2024-04-18T14:43:29.993 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:29.993 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:29.993 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-04-18T14:43:29.993 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.721892+0000", 2024-04-18T14:43:29.993 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0056902680000000001 2024-04-18T14:43:29.993 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:29.993 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:29.993 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_commit_rec", 2024-04-18T14:43:29.993 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.722918+0000", 2024-04-18T14:43:29.993 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0010263130000000001 2024-04-18T14:43:29.993 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:29.993 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:29.993 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-04-18T14:43:29.993 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.723034+0000", 2024-04-18T14:43:29.994 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000116481 2024-04-18T14:43:29.994 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:29.994 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:29.994 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-04-18T14:43:29.994 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.723138+0000", 2024-04-18T14:43:29.994 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000103274 2024-04-18T14:43:29.994 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:43:29.994 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T14:43:29.994 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:43:29.994 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:29.994 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:29.994 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4212.0:115 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-04-18T14:43:29.994 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-04-18T14:43:20.701238+0000", 2024-04-18T14:43:29.994 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 9.2574991050000008, 2024-04-18T14:43:29.994 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.02214089, 2024-04-18T14:43:29.995 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-04-18T14:43:29.995 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T14:43:29.995 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-04-18T14:43:29.995 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4212", 2024-04-18T14:43:29.995 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "172.21.15.134:0/3325451476", 2024-04-18T14:43:29.995 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 115 2024-04-18T14:43:29.995 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:29.995 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-04-18T14:43:29.995 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:29.995 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-04-18T14:43:29.995 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.701238+0000", 2024-04-18T14:43:29.995 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:43:29.995 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:29.995 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:29.995 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-04-18T14:43:29.995 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.701238+0000", 2024-04-18T14:43:29.996 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:43:29.996 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:29.996 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:29.996 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-04-18T14:43:29.996 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.701237+0000", 2024-04-18T14:43:29.996 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 4294967295.9999986 2024-04-18T14:43:29.996 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:29.996 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:29.996 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-04-18T14:43:29.996 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.701377+0000", 2024-04-18T14:43:29.996 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000139849 2024-04-18T14:43:29.996 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:29.996 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:29.996 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-04-18T14:43:29.996 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.701392+0000", 2024-04-18T14:43:29.997 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.5322e-05 2024-04-18T14:43:29.997 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:29.997 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:29.997 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-04-18T14:43:29.997 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.701401+0000", 2024-04-18T14:43:29.997 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 8.9430000000000006e-06 2024-04-18T14:43:29.997 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:29.997 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:29.997 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-04-18T14:43:29.997 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.719830+0000", 2024-04-18T14:43:29.997 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.018429009999999999 2024-04-18T14:43:29.997 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:29.997 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:29.997 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-04-18T14:43:29.997 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.720057+0000", 2024-04-18T14:43:29.997 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00022700500000000001 2024-04-18T14:43:29.998 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:29.998 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:29.998 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for subops from 0", 2024-04-18T14:43:29.998 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.720408+0000", 2024-04-18T14:43:29.998 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00035086399999999999 2024-04-18T14:43:29.998 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:29.998 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:29.998 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-04-18T14:43:29.998 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.723171+0000", 2024-04-18T14:43:29.998 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.002762708 2024-04-18T14:43:29.998 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:29.998 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:29.998 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_commit_rec", 2024-04-18T14:43:29.998 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.723264+0000", 2024-04-18T14:43:29.998 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 9.2888999999999998e-05 2024-04-18T14:43:29.999 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:29.999 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:29.999 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-04-18T14:43:29.999 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.723329+0000", 2024-04-18T14:43:29.999 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 6.5394000000000004e-05 2024-04-18T14:43:29.999 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:29.999 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:29.999 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-04-18T14:43:29.999 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.723379+0000", 2024-04-18T14:43:29.999 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 5.0126000000000001e-05 2024-04-18T14:43:29.999 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:43:29.999 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T14:43:29.999 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:43:29.999 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:29.999 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:30.000 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4212.0:116 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-04-18T14:43:30.000 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-04-18T14:43:20.701416+0000", 2024-04-18T14:43:30.000 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 9.2573218290000003, 2024-04-18T14:43:30.000 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.024681692000000002, 2024-04-18T14:43:30.000 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-04-18T14:43:30.000 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T14:43:30.000 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-04-18T14:43:30.000 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4212", 2024-04-18T14:43:30.000 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "172.21.15.134:0/3325451476", 2024-04-18T14:43:30.000 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 116 2024-04-18T14:43:30.000 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:30.000 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-04-18T14:43:30.000 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:30.000 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-04-18T14:43:30.000 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.701416+0000", 2024-04-18T14:43:30.001 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:43:30.001 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:30.001 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:30.001 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-04-18T14:43:30.001 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.701416+0000", 2024-04-18T14:43:30.001 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:43:30.001 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:30.001 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:30.001 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-04-18T14:43:30.001 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.701415+0000", 2024-04-18T14:43:30.001 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 4294967295.999999 2024-04-18T14:43:30.001 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:30.001 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:30.001 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-04-18T14:43:30.001 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.701434+0000", 2024-04-18T14:43:30.001 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.9258000000000001e-05 2024-04-18T14:43:30.002 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:30.002 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:30.002 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-04-18T14:43:30.002 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.701445+0000", 2024-04-18T14:43:30.002 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.0485999999999999e-05 2024-04-18T14:43:30.002 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:30.002 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:30.002 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-04-18T14:43:30.002 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.701452+0000", 2024-04-18T14:43:30.002 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 7.9060000000000002e-06 2024-04-18T14:43:30.002 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:30.002 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:30.002 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-04-18T14:43:30.002 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.723471+0000", 2024-04-18T14:43:30.002 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.022019047 2024-04-18T14:43:30.003 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:30.003 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:30.003 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-04-18T14:43:30.003 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.723697+0000", 2024-04-18T14:43:30.003 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000225634 2024-04-18T14:43:30.003 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:30.003 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:30.003 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for subops from 0", 2024-04-18T14:43:30.003 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.724053+0000", 2024-04-18T14:43:30.003 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000355798 2024-04-18T14:43:30.003 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:30.003 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:30.003 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_commit_rec", 2024-04-18T14:43:30.003 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.725675+0000", 2024-04-18T14:43:30.003 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.001622264 2024-04-18T14:43:30.003 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:30.004 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:30.004 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-04-18T14:43:30.004 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.725879+0000", 2024-04-18T14:43:30.004 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00020390299999999999 2024-04-18T14:43:30.004 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:30.004 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:30.004 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-04-18T14:43:30.004 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.725994+0000", 2024-04-18T14:43:30.004 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000115158 2024-04-18T14:43:30.004 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:30.004 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:30.004 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-04-18T14:43:30.004 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.726097+0000", 2024-04-18T14:43:30.004 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000103231 2024-04-18T14:43:30.004 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:43:30.004 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T14:43:30.005 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:43:30.005 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:30.005 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:30.005 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4212.0:117 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-04-18T14:43:30.005 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-04-18T14:43:20.701462+0000", 2024-04-18T14:43:30.005 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 9.2572759960000006, 2024-04-18T14:43:30.005 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.025118439999999999, 2024-04-18T14:43:30.005 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-04-18T14:43:30.005 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T14:43:30.005 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-04-18T14:43:30.005 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4212", 2024-04-18T14:43:30.005 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "172.21.15.134:0/3325451476", 2024-04-18T14:43:30.005 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 117 2024-04-18T14:43:30.005 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:30.005 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-04-18T14:43:30.006 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:30.006 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-04-18T14:43:30.006 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.701462+0000", 2024-04-18T14:43:30.006 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:43:30.006 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:30.006 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:30.006 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-04-18T14:43:30.006 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.701462+0000", 2024-04-18T14:43:30.006 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:43:30.006 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:30.006 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:30.006 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-04-18T14:43:30.006 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.701461+0000", 2024-04-18T14:43:30.006 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 4294967295.9999995 2024-04-18T14:43:30.006 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:30.007 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:30.007 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-04-18T14:43:30.007 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.701468+0000", 2024-04-18T14:43:30.007 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 6.6630000000000004e-06 2024-04-18T14:43:30.007 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:30.007 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:30.007 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-04-18T14:43:30.007 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.701478+0000", 2024-04-18T14:43:30.007 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.0796e-05 2024-04-18T14:43:30.007 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:30.007 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:30.007 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-04-18T14:43:30.007 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.701486+0000", 2024-04-18T14:43:30.007 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 7.3490000000000003e-06 2024-04-18T14:43:30.007 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:30.007 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:30.008 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-04-18T14:43:30.008 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.724772+0000", 2024-04-18T14:43:30.008 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.023286554000000001 2024-04-18T14:43:30.008 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:30.008 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:30.008 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-04-18T14:43:30.010 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.724901+0000", 2024-04-18T14:43:30.010 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00012827499999999999 2024-04-18T14:43:30.010 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:30.010 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:30.010 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for subops from 0", 2024-04-18T14:43:30.010 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.725102+0000", 2024-04-18T14:43:30.010 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000201471 2024-04-18T14:43:30.010 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:30.010 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:30.010 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_commit_rec", 2024-04-18T14:43:30.010 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.726349+0000", 2024-04-18T14:43:30.010 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.001247061 2024-04-18T14:43:30.010 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:30.011 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:30.011 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-04-18T14:43:30.011 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.726373+0000", 2024-04-18T14:43:30.011 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.4207999999999999e-05 2024-04-18T14:43:30.011 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:30.011 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:30.011 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-04-18T14:43:30.011 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.726488+0000", 2024-04-18T14:43:30.011 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000115118 2024-04-18T14:43:30.011 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:30.011 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:30.011 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-04-18T14:43:30.011 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.726580+0000", 2024-04-18T14:43:30.011 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 9.1612000000000003e-05 2024-04-18T14:43:30.011 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:43:30.011 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T14:43:30.012 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:43:30.012 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:30.012 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:30.012 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4212.0:141 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-04-18T14:43:30.012 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-04-18T14:43:20.875689+0000", 2024-04-18T14:43:30.012 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 9.0830485410000001, 2024-04-18T14:43:30.012 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.018885018999999999, 2024-04-18T14:43:30.012 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-04-18T14:43:30.012 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T14:43:30.012 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-04-18T14:43:30.012 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4212", 2024-04-18T14:43:30.012 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "172.21.15.134:0/3325451476", 2024-04-18T14:43:30.012 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 141 2024-04-18T14:43:30.012 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:30.012 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-04-18T14:43:30.012 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:30.013 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-04-18T14:43:30.013 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.875689+0000", 2024-04-18T14:43:30.013 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:43:30.013 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:30.013 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:30.013 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-04-18T14:43:30.013 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.875689+0000", 2024-04-18T14:43:30.013 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:43:30.013 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:30.013 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:30.013 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-04-18T14:43:30.013 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.875689+0000", 2024-04-18T14:43:30.013 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 4294967295.9999995 2024-04-18T14:43:30.013 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:30.014 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:30.014 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-04-18T14:43:30.014 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.875692+0000", 2024-04-18T14:43:30.014 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.095e-06 2024-04-18T14:43:30.014 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:30.014 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:30.014 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-04-18T14:43:30.014 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.875695+0000", 2024-04-18T14:43:30.014 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.552e-06 2024-04-18T14:43:30.014 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:30.014 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:30.014 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-04-18T14:43:30.014 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.875698+0000", 2024-04-18T14:43:30.014 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.9900000000000002e-06 2024-04-18T14:43:30.014 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:30.015 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:30.015 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-04-18T14:43:30.015 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.884737+0000", 2024-04-18T14:43:30.015 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0090389530000000006 2024-04-18T14:43:30.015 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:30.015 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:30.015 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-04-18T14:43:30.015 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.884963+0000", 2024-04-18T14:43:30.015 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00022563800000000001 2024-04-18T14:43:30.015 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:30.015 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:30.015 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for subops from 0", 2024-04-18T14:43:30.015 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.885324+0000", 2024-04-18T14:43:30.015 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000360804 2024-04-18T14:43:30.015 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:30.015 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:30.016 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-04-18T14:43:30.016 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.891966+0000", 2024-04-18T14:43:30.016 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0066426539999999996 2024-04-18T14:43:30.016 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:30.016 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:30.016 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_commit_rec", 2024-04-18T14:43:30.016 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.894346+0000", 2024-04-18T14:43:30.016 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.002379899 2024-04-18T14:43:30.016 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:30.016 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:30.016 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-04-18T14:43:30.016 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.894472+0000", 2024-04-18T14:43:30.016 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00012594900000000001 2024-04-18T14:43:30.016 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:30.016 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:30.016 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-04-18T14:43:30.017 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.894574+0000", 2024-04-18T14:43:30.017 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000101852 2024-04-18T14:43:30.017 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:43:30.017 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T14:43:30.017 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:43:30.017 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:30.017 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:30.017 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4212.0:163 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-04-18T14:43:30.017 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-04-18T14:43:21.039657+0000", 2024-04-18T14:43:30.017 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 8.9190801959999995, 2024-04-18T14:43:30.017 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.019955601999999999, 2024-04-18T14:43:30.017 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-04-18T14:43:30.017 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T14:43:30.017 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-04-18T14:43:30.017 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4212", 2024-04-18T14:43:30.017 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "172.21.15.134:0/3325451476", 2024-04-18T14:43:30.018 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 163 2024-04-18T14:43:30.018 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:30.018 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-04-18T14:43:30.018 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:30.018 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-04-18T14:43:30.018 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:21.039657+0000", 2024-04-18T14:43:30.018 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:43:30.018 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:30.018 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:30.018 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-04-18T14:43:30.018 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:21.039657+0000", 2024-04-18T14:43:30.018 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:43:30.018 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:30.018 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:30.018 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-04-18T14:43:30.019 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:21.039657+0000", 2024-04-18T14:43:30.019 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 4294967295.999999 2024-04-18T14:43:30.019 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:30.019 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:30.019 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-04-18T14:43:30.019 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:21.039663+0000", 2024-04-18T14:43:30.019 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 6.4300000000000003e-06 2024-04-18T14:43:30.019 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:30.019 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:30.019 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-04-18T14:43:30.019 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:21.039673+0000", 2024-04-18T14:43:30.019 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.0105999999999999e-05 2024-04-18T14:43:30.019 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:30.019 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:30.019 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-04-18T14:43:30.019 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:21.039681+0000", 2024-04-18T14:43:30.020 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 7.5560000000000002e-06 2024-04-18T14:43:30.020 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:30.020 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:30.020 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-04-18T14:43:30.020 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:21.054744+0000", 2024-04-18T14:43:30.020 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.015062766 2024-04-18T14:43:30.020 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:30.020 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:30.020 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-04-18T14:43:30.020 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:21.054971+0000", 2024-04-18T14:43:30.020 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00022734200000000001 2024-04-18T14:43:30.020 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:30.020 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:30.020 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for subops from 0", 2024-04-18T14:43:30.020 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:21.055343+0000", 2024-04-18T14:43:30.020 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000372004 2024-04-18T14:43:30.021 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:30.021 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:30.021 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-04-18T14:43:30.021 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:21.059373+0000", 2024-04-18T14:43:30.021 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0040298080000000002 2024-04-18T14:43:30.021 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:30.021 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:30.021 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_commit_rec", 2024-04-18T14:43:30.021 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:21.059468+0000", 2024-04-18T14:43:30.021 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 9.5753000000000003e-05 2024-04-18T14:43:30.021 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:30.021 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:30.021 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-04-18T14:43:30.021 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:21.059553+0000", 2024-04-18T14:43:30.021 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 8.4538999999999998e-05 2024-04-18T14:43:30.021 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:30.022 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:30.022 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-04-18T14:43:30.022 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:21.059613+0000", 2024-04-18T14:43:30.022 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 6.0055e-05 2024-04-18T14:43:30.022 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:43:30.022 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T14:43:30.022 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:43:30.022 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:30.022 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:30.022 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4212.0:164 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-04-18T14:43:30.022 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-04-18T14:43:21.039689+0000", 2024-04-18T14:43:30.022 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 8.9190483250000003, 2024-04-18T14:43:30.022 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.020243589999999999, 2024-04-18T14:43:30.022 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-04-18T14:43:30.022 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T14:43:30.023 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-04-18T14:43:30.023 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4212", 2024-04-18T14:43:30.023 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "172.21.15.134:0/3325451476", 2024-04-18T14:43:30.023 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 164 2024-04-18T14:43:30.023 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:30.023 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-04-18T14:43:30.023 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:30.023 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-04-18T14:43:30.023 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:21.039689+0000", 2024-04-18T14:43:30.023 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:43:30.023 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:30.023 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:30.023 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-04-18T14:43:30.023 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:21.039689+0000", 2024-04-18T14:43:30.023 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:43:30.023 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:30.024 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:30.024 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-04-18T14:43:30.024 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:21.039689+0000", 2024-04-18T14:43:30.024 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 4294967295.9999995 2024-04-18T14:43:30.024 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:30.024 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:30.024 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-04-18T14:43:30.024 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:21.039773+0000", 2024-04-18T14:43:30.024 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 8.4040000000000002e-05 2024-04-18T14:43:30.024 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:30.024 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:30.024 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-04-18T14:43:30.024 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:21.039783+0000", 2024-04-18T14:43:30.024 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.0786e-05 2024-04-18T14:43:30.024 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:30.024 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:30.025 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-04-18T14:43:30.025 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:21.039791+0000", 2024-04-18T14:43:30.025 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 7.8320000000000006e-06 2024-04-18T14:43:30.025 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:30.025 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:30.025 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-04-18T14:43:30.025 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:21.056266+0000", 2024-04-18T14:43:30.025 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.016474586999999999 2024-04-18T14:43:30.025 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:30.025 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:30.025 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-04-18T14:43:30.025 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:21.056394+0000", 2024-04-18T14:43:30.025 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00012773299999999999 2024-04-18T14:43:30.025 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:30.025 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:30.026 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for subops from 0", 2024-04-18T14:43:30.026 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:21.056584+0000", 2024-04-18T14:43:30.026 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00019052500000000001 2024-04-18T14:43:30.026 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:30.026 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:30.026 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_commit_rec", 2024-04-18T14:43:30.026 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:21.059718+0000", 2024-04-18T14:43:30.026 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0031340999999999999 2024-04-18T14:43:30.026 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:30.026 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:30.026 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-04-18T14:43:30.026 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:21.059746+0000", 2024-04-18T14:43:30.026 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.7447999999999999e-05 2024-04-18T14:43:30.026 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:30.026 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:30.027 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-04-18T14:43:30.027 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:21.059876+0000", 2024-04-18T14:43:30.027 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00013080599999999999 2024-04-18T14:43:30.027 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:30.027 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:30.027 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-04-18T14:43:30.027 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:21.059933+0000", 2024-04-18T14:43:30.027 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 5.6372999999999997e-05 2024-04-18T14:43:30.027 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:43:30.027 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T14:43:30.027 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:43:30.027 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:30.027 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:30.027 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4212.0:165 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-04-18T14:43:30.027 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-04-18T14:43:21.039800+0000", 2024-04-18T14:43:30.028 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 8.9189371239999993, 2024-04-18T14:43:30.028 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.022777954, 2024-04-18T14:43:30.028 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-04-18T14:43:30.028 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T14:43:30.028 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-04-18T14:43:30.028 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4212", 2024-04-18T14:43:30.028 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "172.21.15.134:0/3325451476", 2024-04-18T14:43:30.028 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 165 2024-04-18T14:43:30.028 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:30.028 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-04-18T14:43:30.028 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:30.028 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-04-18T14:43:30.028 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:21.039800+0000", 2024-04-18T14:43:30.028 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:43:30.028 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:30.028 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:30.029 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-04-18T14:43:30.029 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:21.039800+0000", 2024-04-18T14:43:30.029 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:43:30.029 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:30.029 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:30.029 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-04-18T14:43:30.029 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:21.039800+0000", 2024-04-18T14:43:30.029 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 4294967295.999999 2024-04-18T14:43:30.029 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:30.029 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:30.029 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-04-18T14:43:30.029 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:21.039806+0000", 2024-04-18T14:43:30.029 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 6.263e-06 2024-04-18T14:43:30.029 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:30.029 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:30.029 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-04-18T14:43:30.030 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:21.039815+0000", 2024-04-18T14:43:30.030 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 9.0790000000000007e-06 2024-04-18T14:43:30.030 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:30.030 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:30.030 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-04-18T14:43:30.030 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:21.039822+0000", 2024-04-18T14:43:30.030 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 6.9929999999999998e-06 2024-04-18T14:43:30.030 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:30.030 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:30.030 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-04-18T14:43:30.030 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:21.058092+0000", 2024-04-18T14:43:30.031 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.018269884 2024-04-18T14:43:30.031 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:30.031 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:30.031 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-04-18T14:43:30.031 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:21.058307+0000", 2024-04-18T14:43:30.031 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00021547600000000001 2024-04-18T14:43:30.031 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:30.031 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:30.031 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for subops from 0", 2024-04-18T14:43:30.031 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:21.058667+0000", 2024-04-18T14:43:30.031 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00035945500000000001 2024-04-18T14:43:30.031 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:30.031 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:30.031 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_commit_rec", 2024-04-18T14:43:30.031 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:21.060393+0000", 2024-04-18T14:43:30.031 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0017262619999999999 2024-04-18T14:43:30.032 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:30.032 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:30.032 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-04-18T14:43:30.032 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:21.062336+0000", 2024-04-18T14:43:30.032 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.001943078 2024-04-18T14:43:30.032 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:30.032 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:30.032 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-04-18T14:43:30.032 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:21.062471+0000", 2024-04-18T14:43:30.032 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00013455300000000001 2024-04-18T14:43:30.032 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:30.032 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:30.032 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-04-18T14:43:30.032 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:21.062578+0000", 2024-04-18T14:43:30.032 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00010770800000000001 2024-04-18T14:43:30.033 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:43:30.033 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T14:43:30.033 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:43:30.033 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:30.033 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:30.033 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4212.0:183 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-04-18T14:43:30.033 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-04-18T14:43:21.210978+0000", 2024-04-18T14:43:30.033 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 8.7477598440000008, 2024-04-18T14:43:30.033 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.018803698000000001, 2024-04-18T14:43:30.033 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-04-18T14:43:30.033 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T14:43:30.033 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-04-18T14:43:30.033 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4212", 2024-04-18T14:43:30.033 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "172.21.15.134:0/3325451476", 2024-04-18T14:43:30.033 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 183 2024-04-18T14:43:30.033 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:30.034 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-04-18T14:43:30.034 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:30.034 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-04-18T14:43:30.034 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:21.210978+0000", 2024-04-18T14:43:30.034 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:43:30.034 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:30.034 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:30.034 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-04-18T14:43:30.034 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:21.210978+0000", 2024-04-18T14:43:30.034 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:43:30.034 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:30.034 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:30.034 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-04-18T14:43:30.034 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:21.210977+0000", 2024-04-18T14:43:30.034 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 4294967295.999999 2024-04-18T14:43:30.035 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:30.035 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:30.035 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-04-18T14:43:30.035 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:21.210984+0000", 2024-04-18T14:43:30.035 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 7.199e-06 2024-04-18T14:43:30.035 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:30.035 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:30.035 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-04-18T14:43:30.035 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:21.210994+0000", 2024-04-18T14:43:30.035 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.0353000000000001e-05 2024-04-18T14:43:30.035 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:30.035 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:30.035 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-04-18T14:43:30.035 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:21.211001+0000", 2024-04-18T14:43:30.035 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 6.9630000000000001e-06 2024-04-18T14:43:30.035 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:30.036 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:30.036 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-04-18T14:43:30.036 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:21.220821+0000", 2024-04-18T14:43:30.036 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0098195509999999993 2024-04-18T14:43:30.036 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:30.036 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:30.036 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-04-18T14:43:30.036 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:21.220960+0000", 2024-04-18T14:43:30.036 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000138942 2024-04-18T14:43:30.036 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:30.036 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:30.036 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for subops from 0", 2024-04-18T14:43:30.036 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:21.221161+0000", 2024-04-18T14:43:30.036 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00020154999999999999 2024-04-18T14:43:30.036 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:30.036 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:30.037 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_commit_rec", 2024-04-18T14:43:30.037 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:21.226409+0000", 2024-04-18T14:43:30.037 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0052475489999999998 2024-04-18T14:43:30.037 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:30.037 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:30.037 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-04-18T14:43:30.037 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:21.229544+0000", 2024-04-18T14:43:30.037 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0031353129999999998 2024-04-18T14:43:30.037 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:30.037 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:30.037 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-04-18T14:43:30.037 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:21.229680+0000", 2024-04-18T14:43:30.037 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00013617300000000001 2024-04-18T14:43:30.037 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:30.037 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:30.038 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-04-18T14:43:30.038 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:21.229781+0000", 2024-04-18T14:43:30.038 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000101062 2024-04-18T14:43:30.038 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:43:30.038 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T14:43:30.038 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:43:30.038 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:30.038 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:30.038 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4212.0:184 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-04-18T14:43:30.038 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-04-18T14:43:21.211009+0000", 2024-04-18T14:43:30.038 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 8.7477284239999999, 2024-04-18T14:43:30.038 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.018995425999999999, 2024-04-18T14:43:30.038 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-04-18T14:43:30.038 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T14:43:30.038 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-04-18T14:43:30.039 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4212", 2024-04-18T14:43:30.039 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "172.21.15.134:0/3325451476", 2024-04-18T14:43:30.039 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 184 2024-04-18T14:43:30.039 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:30.039 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-04-18T14:43:30.039 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:30.039 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-04-18T14:43:30.039 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:21.211009+0000", 2024-04-18T14:43:30.040 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:43:30.040 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:30.040 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:30.040 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-04-18T14:43:30.040 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:21.211009+0000", 2024-04-18T14:43:30.040 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:43:30.040 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:30.040 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:30.040 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-04-18T14:43:30.040 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:21.211009+0000", 2024-04-18T14:43:30.040 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 4294967295.9999995 2024-04-18T14:43:30.040 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:30.040 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:30.040 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-04-18T14:43:30.040 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:21.211014+0000", 2024-04-18T14:43:30.041 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 5.5339999999999999e-06 2024-04-18T14:43:30.041 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:30.041 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:30.041 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-04-18T14:43:30.041 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:21.211023+0000", 2024-04-18T14:43:30.041 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 9.0319999999999992e-06 2024-04-18T14:43:30.041 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:30.041 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:30.041 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-04-18T14:43:30.041 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:21.211035+0000", 2024-04-18T14:43:30.041 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.1875999999999999e-05 2024-04-18T14:43:30.041 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:30.041 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:30.041 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-04-18T14:43:30.041 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:21.222820+0000", 2024-04-18T14:43:30.041 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.011784901 2024-04-18T14:43:30.042 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:30.042 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:30.042 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-04-18T14:43:30.042 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:21.222958+0000", 2024-04-18T14:43:30.042 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00013764199999999999 2024-04-18T14:43:30.042 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:30.042 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:30.042 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for subops from 0", 2024-04-18T14:43:30.042 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:21.223154+0000", 2024-04-18T14:43:30.042 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000196701 2024-04-18T14:43:30.042 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:30.042 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:30.042 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_commit_rec", 2024-04-18T14:43:30.042 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:21.229521+0000", 2024-04-18T14:43:30.042 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0063666130000000001 2024-04-18T14:43:30.043 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:30.043 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:30.043 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-04-18T14:43:30.043 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:21.229803+0000", 2024-04-18T14:43:30.043 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00028222700000000002 2024-04-18T14:43:30.043 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:30.043 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:30.043 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-04-18T14:43:30.043 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:21.229913+0000", 2024-04-18T14:43:30.043 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000109441 2024-04-18T14:43:30.043 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:30.043 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:30.043 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-04-18T14:43:30.043 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:21.230005+0000", 2024-04-18T14:43:30.043 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 9.2078999999999997e-05 2024-04-18T14:43:30.043 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:43:30.044 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T14:43:30.044 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:43:30.044 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:30.044 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:30.044 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4212.0:185 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-04-18T14:43:30.044 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-04-18T14:43:21.211070+0000", 2024-04-18T14:43:30.044 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 8.7476676120000008, 2024-04-18T14:43:30.044 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.019187958000000001, 2024-04-18T14:43:30.044 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-04-18T14:43:30.044 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T14:43:30.044 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-04-18T14:43:30.044 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4212", 2024-04-18T14:43:30.044 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "172.21.15.134:0/3325451476", 2024-04-18T14:43:30.044 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 185 2024-04-18T14:43:30.044 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:30.045 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-04-18T14:43:30.045 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:30.045 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-04-18T14:43:30.045 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:21.211070+0000", 2024-04-18T14:43:30.045 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:43:30.045 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:30.045 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:30.045 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-04-18T14:43:30.045 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:21.211070+0000", 2024-04-18T14:43:30.045 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:43:30.045 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:30.045 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:30.045 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-04-18T14:43:30.045 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:21.211069+0000", 2024-04-18T14:43:30.045 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 4294967295.9999986 2024-04-18T14:43:30.045 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:30.046 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:30.046 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-04-18T14:43:30.046 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:21.211194+0000", 2024-04-18T14:43:30.046 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00012547599999999999 2024-04-18T14:43:30.046 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:30.046 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:30.046 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-04-18T14:43:30.046 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:21.211233+0000", 2024-04-18T14:43:30.046 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.8556999999999997e-05 2024-04-18T14:43:30.046 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:30.046 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:30.046 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-04-18T14:43:30.046 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:21.211242+0000", 2024-04-18T14:43:30.046 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 9.5929999999999995e-06 2024-04-18T14:43:30.046 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:30.046 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:30.047 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-04-18T14:43:30.047 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:21.223832+0000", 2024-04-18T14:43:30.047 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.01258977 2024-04-18T14:43:30.047 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:30.047 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:30.047 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-04-18T14:43:30.047 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:21.224067+0000", 2024-04-18T14:43:30.047 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00023518399999999999 2024-04-18T14:43:30.047 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:30.047 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:30.047 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for subops from 0", 2024-04-18T14:43:30.047 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:21.224435+0000", 2024-04-18T14:43:30.047 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00036764399999999998 2024-04-18T14:43:30.047 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:30.047 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:30.047 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-04-18T14:43:30.048 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:21.230024+0000", 2024-04-18T14:43:30.048 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0055886479999999999 2024-04-18T14:43:30.048 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:30.048 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:30.048 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_commit_rec", 2024-04-18T14:43:30.048 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:21.230124+0000", 2024-04-18T14:43:30.048 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00010045899999999999 2024-04-18T14:43:30.048 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:30.048 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:30.048 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-04-18T14:43:30.048 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:21.230201+0000", 2024-04-18T14:43:30.048 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 7.6509999999999998e-05 2024-04-18T14:43:30.048 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:30.048 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:30.048 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-04-18T14:43:30.048 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:21.230258+0000", 2024-04-18T14:43:30.049 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 5.7395999999999997e-05 2024-04-18T14:43:30.049 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:43:30.049 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T14:43:30.049 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:43:30.049 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:30.049 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:30.049 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4212.0:186 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-04-18T14:43:30.049 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-04-18T14:43:21.211255+0000", 2024-04-18T14:43:30.049 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 8.7474830029999993, 2024-04-18T14:43:30.049 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.019388148000000001, 2024-04-18T14:43:30.049 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-04-18T14:43:30.049 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T14:43:30.049 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-04-18T14:43:30.049 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4212", 2024-04-18T14:43:30.049 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "172.21.15.134:0/3325451476", 2024-04-18T14:43:30.049 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 186 2024-04-18T14:43:30.050 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:30.050 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-04-18T14:43:30.050 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:30.050 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-04-18T14:43:30.050 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:21.211255+0000", 2024-04-18T14:43:30.050 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:43:30.050 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:30.050 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:30.050 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-04-18T14:43:30.050 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:21.211255+0000", 2024-04-18T14:43:30.050 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:43:30.050 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:30.050 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:30.050 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-04-18T14:43:30.051 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:21.211254+0000", 2024-04-18T14:43:30.051 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 4294967295.999999 2024-04-18T14:43:30.051 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:30.051 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:30.051 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-04-18T14:43:30.051 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:21.211261+0000", 2024-04-18T14:43:30.051 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 7.0190000000000001e-06 2024-04-18T14:43:30.051 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:30.051 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:30.051 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-04-18T14:43:30.051 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:21.211270+0000", 2024-04-18T14:43:30.051 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 9.5189999999999998e-06 2024-04-18T14:43:30.051 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:30.051 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:30.051 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-04-18T14:43:30.052 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:21.211277+0000", 2024-04-18T14:43:30.052 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 7.1400000000000002e-06 2024-04-18T14:43:30.052 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:30.052 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:30.052 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-04-18T14:43:30.052 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:21.226501+0000", 2024-04-18T14:43:30.052 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.015224115999999999 2024-04-18T14:43:30.052 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:30.052 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:30.052 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-04-18T14:43:30.052 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:21.226767+0000", 2024-04-18T14:43:30.052 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00026582199999999998 2024-04-18T14:43:30.052 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:30.052 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:30.052 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for subops from 0", 2024-04-18T14:43:30.052 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:21.227160+0000", 2024-04-18T14:43:30.053 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000392803 2024-04-18T14:43:30.053 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:30.053 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:30.053 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_commit_rec", 2024-04-18T14:43:30.053 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:21.230391+0000", 2024-04-18T14:43:30.053 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.003231182 2024-04-18T14:43:30.053 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:30.053 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:30.053 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-04-18T14:43:30.053 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:21.230414+0000", 2024-04-18T14:43:30.053 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.3045e-05 2024-04-18T14:43:30.053 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:30.053 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:30.053 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-04-18T14:43:30.053 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:21.230543+0000", 2024-04-18T14:43:30.053 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00012871900000000001 2024-04-18T14:43:30.054 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:30.054 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:30.054 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-04-18T14:43:30.054 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:21.230643+0000", 2024-04-18T14:43:30.054 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 9.9766000000000007e-05 2024-04-18T14:43:30.054 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:43:30.054 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T14:43:30.054 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:43:30.054 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:30.054 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:30.054 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4212.0:187 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-04-18T14:43:30.054 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-04-18T14:43:21.211285+0000", 2024-04-18T14:43:30.054 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 8.7474521920000008, 2024-04-18T14:43:30.054 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.022261811999999999, 2024-04-18T14:43:30.055 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-04-18T14:43:30.055 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T14:43:30.055 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-04-18T14:43:30.055 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4212", 2024-04-18T14:43:30.055 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "172.21.15.134:0/3325451476", 2024-04-18T14:43:30.055 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 187 2024-04-18T14:43:30.055 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:30.055 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-04-18T14:43:30.055 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:30.055 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-04-18T14:43:30.055 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:21.211285+0000", 2024-04-18T14:43:30.055 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:43:30.055 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:30.055 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:30.055 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-04-18T14:43:30.056 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:21.211285+0000", 2024-04-18T14:43:30.056 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:43:30.056 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:30.056 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:30.056 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-04-18T14:43:30.056 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:21.211285+0000", 2024-04-18T14:43:30.056 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 4294967295.9999995 2024-04-18T14:43:30.056 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:30.056 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:30.056 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-04-18T14:43:30.056 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:21.211290+0000", 2024-04-18T14:43:30.056 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 5.6999999999999996e-06 2024-04-18T14:43:30.056 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:30.056 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:30.056 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-04-18T14:43:30.057 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:21.211300+0000", 2024-04-18T14:43:30.057 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 9.0890000000000006e-06 2024-04-18T14:43:30.057 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:30.057 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:30.057 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-04-18T14:43:30.057 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:21.211306+0000", 2024-04-18T14:43:30.057 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 6.8029999999999999e-06 2024-04-18T14:43:30.057 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:30.057 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:30.057 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-04-18T14:43:30.057 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:21.228301+0000", 2024-04-18T14:43:30.057 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.016994598999999999 2024-04-18T14:43:30.057 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:30.057 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:30.057 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-04-18T14:43:30.058 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:21.228558+0000", 2024-04-18T14:43:30.058 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00025666600000000001 2024-04-18T14:43:30.058 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:30.058 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:30.058 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for subops from 0", 2024-04-18T14:43:30.058 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:21.228844+0000", 2024-04-18T14:43:30.058 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00028685700000000001 2024-04-18T14:43:30.058 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:30.058 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:30.058 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-04-18T14:43:30.058 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:21.233311+0000", 2024-04-18T14:43:30.058 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0044661400000000004 2024-04-18T14:43:30.058 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:30.058 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:30.058 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_commit_rec", 2024-04-18T14:43:30.059 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:21.233386+0000", 2024-04-18T14:43:30.059 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 7.5184000000000004e-05 2024-04-18T14:43:30.059 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:30.059 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:30.059 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-04-18T14:43:30.059 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:21.233457+0000", 2024-04-18T14:43:30.059 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 7.0914999999999994e-05 2024-04-18T14:43:30.059 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:30.059 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:30.059 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-04-18T14:43:30.059 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:21.233547+0000", 2024-04-18T14:43:30.059 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 9.0486000000000001e-05 2024-04-18T14:43:30.059 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:43:30.059 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T14:43:30.059 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:43:30.060 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:30.060 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:30.060 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4212.0:188 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-04-18T14:43:30.060 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-04-18T14:43:21.211314+0000", 2024-04-18T14:43:30.060 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 8.7474234440000007, 2024-04-18T14:43:30.060 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.022928674999999999, 2024-04-18T14:43:30.060 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-04-18T14:43:30.060 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T14:43:30.060 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-04-18T14:43:30.060 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4212", 2024-04-18T14:43:30.060 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "172.21.15.134:0/3325451476", 2024-04-18T14:43:30.060 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 188 2024-04-18T14:43:30.060 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:30.060 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-04-18T14:43:30.060 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:30.060 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-04-18T14:43:30.061 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:21.211314+0000", 2024-04-18T14:43:30.061 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:43:30.061 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:30.061 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:30.061 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-04-18T14:43:30.061 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:21.211314+0000", 2024-04-18T14:43:30.061 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:43:30.061 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:30.061 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:30.061 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-04-18T14:43:30.061 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:21.211314+0000", 2024-04-18T14:43:30.061 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 4294967295.9999995 2024-04-18T14:43:30.061 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:30.061 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:30.061 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-04-18T14:43:30.061 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:21.211413+0000", 2024-04-18T14:43:30.062 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 9.9754999999999996e-05 2024-04-18T14:43:30.062 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:30.062 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:30.062 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-04-18T14:43:30.062 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:21.211425+0000", 2024-04-18T14:43:30.062 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.1259e-05 2024-04-18T14:43:30.062 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:30.062 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:30.062 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-04-18T14:43:30.062 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:21.211435+0000", 2024-04-18T14:43:30.062 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 9.9990000000000003e-06 2024-04-18T14:43:30.062 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:30.062 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:30.062 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-04-18T14:43:30.062 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:21.230726+0000", 2024-04-18T14:43:30.063 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.019291490000000001 2024-04-18T14:43:30.063 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:30.063 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:30.063 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-04-18T14:43:30.063 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:21.230855+0000", 2024-04-18T14:43:30.063 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000129102 2024-04-18T14:43:30.063 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:30.063 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:30.063 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for subops from 0", 2024-04-18T14:43:30.063 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:21.231049+0000", 2024-04-18T14:43:30.063 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00019388900000000001 2024-04-18T14:43:30.063 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:30.063 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:30.063 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-04-18T14:43:30.064 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:21.233333+0000", 2024-04-18T14:43:30.064 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0022836309999999999 2024-04-18T14:43:30.064 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:30.064 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:30.064 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_commit_rec", 2024-04-18T14:43:30.064 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:21.234118+0000", 2024-04-18T14:43:30.064 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00078523999999999998 2024-04-18T14:43:30.064 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:30.064 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:30.064 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-04-18T14:43:30.064 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:21.234191+0000", 2024-04-18T14:43:30.064 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 7.3028000000000006e-05 2024-04-18T14:43:30.064 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:30.064 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:30.064 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-04-18T14:43:30.065 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:21.234243+0000", 2024-04-18T14:43:30.065 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 5.1898999999999999e-05 2024-04-18T14:43:30.065 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:43:30.065 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T14:43:30.065 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:43:30.065 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:30.065 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:30.065 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4212.0:189 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-04-18T14:43:30.065 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-04-18T14:43:21.211444+0000", 2024-04-18T14:43:30.065 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 8.7472935009999997, 2024-04-18T14:43:30.065 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.023955757000000001, 2024-04-18T14:43:30.065 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-04-18T14:43:30.065 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T14:43:30.065 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-04-18T14:43:30.065 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4212", 2024-04-18T14:43:30.066 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "172.21.15.134:0/3325451476", 2024-04-18T14:43:30.066 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 189 2024-04-18T14:43:30.066 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:30.066 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-04-18T14:43:30.066 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:30.066 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-04-18T14:43:30.066 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:21.211444+0000", 2024-04-18T14:43:30.066 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:43:30.066 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:30.066 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:30.066 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-04-18T14:43:30.066 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:21.211444+0000", 2024-04-18T14:43:30.066 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:43:30.066 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:30.066 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:30.067 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-04-18T14:43:30.067 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:21.211443+0000", 2024-04-18T14:43:30.067 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 4294967295.999999 2024-04-18T14:43:30.067 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:30.067 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:30.067 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-04-18T14:43:30.067 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:21.211450+0000", 2024-04-18T14:43:30.067 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 6.28e-06 2024-04-18T14:43:30.067 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:30.067 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:30.067 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-04-18T14:43:30.067 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:21.211459+0000", 2024-04-18T14:43:30.067 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 9.132e-06 2024-04-18T14:43:30.067 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:30.067 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:30.068 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-04-18T14:43:30.068 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:21.211466+0000", 2024-04-18T14:43:30.068 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 6.8530000000000003e-06 2024-04-18T14:43:30.068 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:30.068 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:30.068 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-04-18T14:43:30.068 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:21.231986+0000", 2024-04-18T14:43:30.068 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.020520218 2024-04-18T14:43:30.068 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:30.068 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:30.068 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-04-18T14:43:30.068 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:21.232208+0000", 2024-04-18T14:43:30.068 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000222208 2024-04-18T14:43:30.068 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:30.068 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:30.069 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for subops from 0", 2024-04-18T14:43:30.069 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:21.232551+0000", 2024-04-18T14:43:30.069 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00034289999999999999 2024-04-18T14:43:30.069 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:30.069 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:30.069 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-04-18T14:43:30.069 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:21.233981+0000", 2024-04-18T14:43:30.069 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0014303390000000001 2024-04-18T14:43:30.069 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:30.069 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:30.069 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_commit_rec", 2024-04-18T14:43:30.069 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:21.235295+0000", 2024-04-18T14:43:30.069 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0013134189999999999 2024-04-18T14:43:30.069 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:30.069 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:30.070 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-04-18T14:43:30.070 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:21.235354+0000", 2024-04-18T14:43:30.070 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 5.8928000000000002e-05 2024-04-18T14:43:30.070 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:30.070 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:30.070 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-04-18T14:43:30.070 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:21.235400+0000", 2024-04-18T14:43:30.070 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 4.6273999999999998e-05 2024-04-18T14:43:30.070 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:43:30.070 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T14:43:30.070 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:43:30.070 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:43:30.070 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T14:43:30.070 INFO:teuthology.orchestra.run.smithi096.stdout:} 2024-04-18T14:43:30.072 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-18T14:43:30.073 INFO:tasks.ceph.osd.14.smithi119.stderr:2024-04-18T14:43:30.070+0000 7f180f599640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 14 (PID: 24900) UID: 0 2024-04-18T14:43:30.173 INFO:tasks.ceph.osd.10.smithi119.stderr:2024-04-18T14:43:30.174+0000 7f6f24c12640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 10 (PID: 24898) UID: 0 2024-04-18T14:43:30.201 INFO:teuthology.orchestra.run.smithi119.stdout:{ 2024-04-18T14:43:30.202 INFO:teuthology.orchestra.run.smithi119.stdout: "ops": [], 2024-04-18T14:43:30.202 INFO:teuthology.orchestra.run.smithi119.stdout: "num_ops": 0 2024-04-18T14:43:30.202 INFO:teuthology.orchestra.run.smithi119.stdout:} 2024-04-18T14:43:30.215 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-18T14:43:30.301 INFO:tasks.ceph.osd.6.smithi119.stderr:2024-04-18T14:43:30.302+0000 7fb7cb8bd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 24896) UID: 0 2024-04-18T14:43:30.375 INFO:tasks.ceph.osd.4.smithi086.stderr:2024-04-18T14:43:30.376+0000 7f0c4c462640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 24956) UID: 0 2024-04-18T14:43:30.378 INFO:teuthology.orchestra.run.smithi119.stdout:{ 2024-04-18T14:43:30.379 INFO:teuthology.orchestra.run.smithi119.stdout: "ops": [], 2024-04-18T14:43:30.379 INFO:teuthology.orchestra.run.smithi119.stdout: "complaint_time": 30, 2024-04-18T14:43:30.379 INFO:teuthology.orchestra.run.smithi119.stdout: "num_blocked_ops": 0 2024-04-18T14:43:30.379 INFO:teuthology.orchestra.run.smithi119.stdout:} 2024-04-18T14:43:30.393 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-18T14:43:30.476 INFO:tasks.ceph.osd.9.smithi096.stderr:2024-04-18T14:43:30.475+0000 7fa2c1cbf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 9 (PID: 24891) UID: 0 2024-04-18T14:43:30.559 INFO:teuthology.orchestra.run.smithi119.stdout:{ 2024-04-18T14:43:30.559 INFO:teuthology.orchestra.run.smithi119.stdout: "size": 20, 2024-04-18T14:43:30.560 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 600, 2024-04-18T14:43:30.560 INFO:teuthology.orchestra.run.smithi119.stdout: "ops": [] 2024-04-18T14:43:30.560 INFO:teuthology.orchestra.run.smithi119.stdout:} 2024-04-18T14:43:30.574 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-04-18T14:43:30.577 INFO:tasks.ceph.osd.0.smithi086.stderr:2024-04-18T14:43:30.576+0000 7f7cdfd78640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 24953) UID: 0 2024-04-18T14:43:30.625 INFO:teuthology.orchestra.run.smithi086.stderr:enabled application 'rados' on pool 'unique_pool_0' 2024-04-18T14:43:30.626 INFO:teuthology.orchestra.run.smithi086.stderr:nodeep-scrub is set 2024-04-18T14:43:30.698 INFO:tasks.ceph.osd.8.smithi086.stderr:2024-04-18T14:43:30.700+0000 7f29f7b9d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 8 (PID: 24958) UID: 0 2024-04-18T14:43:30.705 INFO:teuthology.orchestra.run.smithi119.stdout:{ 2024-04-18T14:43:30.705 INFO:teuthology.orchestra.run.smithi119.stdout: "ops": [], 2024-04-18T14:43:30.705 INFO:teuthology.orchestra.run.smithi119.stdout: "num_ops": 0 2024-04-18T14:43:30.705 INFO:teuthology.orchestra.run.smithi119.stdout:} 2024-04-18T14:43:30.719 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-04-18T14:43:30.778 INFO:tasks.ceph.osd.0.smithi086.stderr:2024-04-18T14:43:30.780+0000 7f7cdfd78640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 24953) UID: 0 2024-04-18T14:43:30.845 INFO:teuthology.orchestra.run.smithi119.stdout:{ 2024-04-18T14:43:30.845 INFO:teuthology.orchestra.run.smithi119.stdout: "ops": [], 2024-04-18T14:43:30.845 INFO:teuthology.orchestra.run.smithi119.stdout: "complaint_time": 30, 2024-04-18T14:43:30.845 INFO:teuthology.orchestra.run.smithi119.stdout: "num_blocked_ops": 0 2024-04-18T14:43:30.845 INFO:teuthology.orchestra.run.smithi119.stdout:} 2024-04-18T14:43:30.859 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-04-18T14:43:30.880 INFO:tasks.ceph.osd.13.smithi096.stderr:2024-04-18T14:43:30.879+0000 7f7e72fad640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 13 (PID: 24893) UID: 0 2024-04-18T14:43:30.979 INFO:teuthology.orchestra.run.smithi119.stdout:{ 2024-04-18T14:43:30.979 INFO:teuthology.orchestra.run.smithi119.stdout: "size": 20, 2024-04-18T14:43:30.979 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 600, 2024-04-18T14:43:30.979 INFO:teuthology.orchestra.run.smithi119.stdout: "ops": [] 2024-04-18T14:43:30.979 INFO:teuthology.orchestra.run.smithi119.stdout:} 2024-04-18T14:43:30.980 INFO:tasks.ceph.osd.3.smithi134.stderr:2024-04-18T14:43:30.983+0000 7fe7a4443640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25211) UID: 0 2024-04-18T14:43:30.993 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.10.asok dump_ops_in_flight 2024-04-18T14:43:31.082 INFO:tasks.ceph.osd.4.smithi086.stderr:2024-04-18T14:43:31.083+0000 7f0c4c462640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 24956) UID: 0 2024-04-18T14:43:31.108 INFO:teuthology.orchestra.run.smithi119.stdout:{ 2024-04-18T14:43:31.109 INFO:teuthology.orchestra.run.smithi119.stdout: "ops": [], 2024-04-18T14:43:31.109 INFO:teuthology.orchestra.run.smithi119.stdout: "num_ops": 0 2024-04-18T14:43:31.109 INFO:teuthology.orchestra.run.smithi119.stdout:} 2024-04-18T14:43:31.123 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.10.asok dump_blocked_ops 2024-04-18T14:43:31.183 INFO:tasks.ceph.osd.4.smithi086.stderr:2024-04-18T14:43:31.183+0000 7f0c4c462640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 24956) UID: 0 2024-04-18T14:43:31.245 INFO:teuthology.orchestra.run.smithi119.stdout:{ 2024-04-18T14:43:31.245 INFO:teuthology.orchestra.run.smithi119.stdout: "ops": [], 2024-04-18T14:43:31.245 INFO:teuthology.orchestra.run.smithi119.stdout: "complaint_time": 30, 2024-04-18T14:43:31.245 INFO:teuthology.orchestra.run.smithi119.stdout: "num_blocked_ops": 0 2024-04-18T14:43:31.245 INFO:teuthology.orchestra.run.smithi119.stdout:} 2024-04-18T14:43:31.259 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.10.asok dump_historic_ops 2024-04-18T14:43:31.283 INFO:tasks.ceph.osd.3.smithi134.stderr:2024-04-18T14:43:31.283+0000 7fe7a4443640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25211) UID: 0 2024-04-18T14:43:31.382 INFO:teuthology.orchestra.run.smithi119.stdout:{ 2024-04-18T14:43:31.382 INFO:teuthology.orchestra.run.smithi119.stdout: "size": 20, 2024-04-18T14:43:31.383 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 600, 2024-04-18T14:43:31.383 INFO:teuthology.orchestra.run.smithi119.stdout: "ops": [] 2024-04-18T14:43:31.383 INFO:teuthology.orchestra.run.smithi119.stdout:} 2024-04-18T14:43:31.384 INFO:tasks.ceph.osd.12.smithi086.stderr:2024-04-18T14:43:31.383+0000 7f6904968640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 12 (PID: 24960) UID: 0 2024-04-18T14:43:31.396 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.14.asok dump_ops_in_flight 2024-04-18T14:43:31.485 INFO:tasks.ceph.osd.1.smithi096.stderr:2024-04-18T14:43:31.483+0000 7f56a7a98640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 24887) UID: 0 2024-04-18T14:43:31.518 INFO:teuthology.orchestra.run.smithi119.stdout:{ 2024-04-18T14:43:31.518 INFO:teuthology.orchestra.run.smithi119.stdout: "ops": [], 2024-04-18T14:43:31.519 INFO:teuthology.orchestra.run.smithi119.stdout: "num_ops": 0 2024-04-18T14:43:31.519 INFO:teuthology.orchestra.run.smithi119.stdout:} 2024-04-18T14:43:31.532 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.14.asok dump_blocked_ops 2024-04-18T14:43:31.586 INFO:tasks.ceph.osd.12.smithi086.stderr:2024-04-18T14:43:31.587+0000 7f6904968640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 12 (PID: 24960) UID: 0 2024-04-18T14:43:31.653 DEBUG:teuthology.orchestra.run.smithi134:> CEPH_CLIENT_ID=0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph_test_rados --no-omap --ec-pool --max-ops 400 --objects 50 --max-in-flight 16 --size 4000000 --min-stride-size 400000 --max-stride-size 800000 --max-seconds 0 --op read 100 --op write 0 --op delete 50 --op snap_create 50 --op snap_remove 50 --op rollback 50 --op setattr 25 --op rmattr 25 --op copy_from 50 --op append 100 --pool unique_pool_0 2024-04-18T14:43:31.657 INFO:teuthology.orchestra.run.smithi119.stdout:{ 2024-04-18T14:43:31.657 INFO:teuthology.orchestra.run.smithi119.stdout: "ops": [], 2024-04-18T14:43:31.657 INFO:teuthology.orchestra.run.smithi119.stdout: "complaint_time": 30, 2024-04-18T14:43:31.657 INFO:teuthology.orchestra.run.smithi119.stdout: "num_blocked_ops": 0 2024-04-18T14:43:31.657 INFO:teuthology.orchestra.run.smithi119.stdout:} 2024-04-18T14:43:31.672 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.14.asok dump_historic_ops 2024-04-18T14:43:31.674 INFO:tasks.rados.rados.0.smithi134.stdout:adding op weight read -> 100 2024-04-18T14:43:31.675 INFO:tasks.rados.rados.0.smithi134.stdout:adding op weight delete -> 50 2024-04-18T14:43:31.675 INFO:tasks.rados.rados.0.smithi134.stdout:adding op weight snap_create -> 50 2024-04-18T14:43:31.675 INFO:tasks.rados.rados.0.smithi134.stdout:adding op weight snap_remove -> 50 2024-04-18T14:43:31.675 INFO:tasks.rados.rados.0.smithi134.stdout:adding op weight rollback -> 50 2024-04-18T14:43:31.675 INFO:tasks.rados.rados.0.smithi134.stdout:adding op weight setattr -> 25 2024-04-18T14:43:31.675 INFO:tasks.rados.rados.0.smithi134.stdout:adding op weight rmattr -> 25 2024-04-18T14:43:31.675 INFO:tasks.rados.rados.0.smithi134.stdout:adding op weight copy_from -> 50 2024-04-18T14:43:31.675 INFO:tasks.rados.rados.0.smithi134.stdout:adding op weight append -> 100 2024-04-18T14:43:31.675 INFO:tasks.rados.rados.0.smithi134.stdout:ceph version 18.2.2-1240-g6a7528e4 (6a7528e4aecd36b18c4b41cee6012e9f92aa7ab0) reef (stable) 2024-04-18T14:43:31.675 INFO:tasks.rados.rados.0.smithi134.stdout:Configuration: 2024-04-18T14:43:31.675 INFO:tasks.rados.rados.0.smithi134.stdout: Number of operations: 400 2024-04-18T14:43:31.675 INFO:tasks.rados.rados.0.smithi134.stdout: Number of objects: 50 2024-04-18T14:43:31.675 INFO:tasks.rados.rados.0.smithi134.stdout: Max in flight operations: 16 2024-04-18T14:43:31.675 INFO:tasks.rados.rados.0.smithi134.stdout: Object size (in bytes): 4000000 2024-04-18T14:43:31.675 INFO:tasks.rados.rados.0.smithi134.stdout: Write stride min: 400000 2024-04-18T14:43:31.676 INFO:tasks.rados.rados.0.smithi134.stdout: Write stride max: 800000 2024-04-18T14:43:31.687 INFO:tasks.ceph.osd.4.smithi086.stderr:2024-04-18T14:43:31.687+0000 7f0c4c462640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 24956) UID: 0 2024-04-18T14:43:31.703 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-18T14:43:31.788 INFO:tasks.ceph.osd.6.smithi119.stderr:2024-04-18T14:43:31.786+0000 7fb7cb8bd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 24896) UID: 0 2024-04-18T14:43:31.795 INFO:teuthology.orchestra.run.smithi119.stdout:{ 2024-04-18T14:43:31.795 INFO:teuthology.orchestra.run.smithi119.stdout: "size": 20, 2024-04-18T14:43:31.795 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 600, 2024-04-18T14:43:31.795 INFO:teuthology.orchestra.run.smithi119.stdout: "ops": [] 2024-04-18T14:43:31.795 INFO:teuthology.orchestra.run.smithi119.stdout:} 2024-04-18T14:43:31.809 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-04-18T14:43:31.858 INFO:teuthology.orchestra.run.smithi086.stdout:osd.0: {} 2024-04-18T14:43:31.859 INFO:teuthology.orchestra.run.smithi086.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-18T14:43:31.879 INFO:teuthology.orchestra.run.smithi086.stdout:osd.1: {} 2024-04-18T14:43:31.880 INFO:teuthology.orchestra.run.smithi086.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-18T14:43:31.889 INFO:tasks.ceph.osd.4.smithi086.stderr:2024-04-18T14:43:31.887+0000 7f0c4c462640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 24956) UID: 0 2024-04-18T14:43:31.897 INFO:teuthology.orchestra.run.smithi086.stdout:osd.2: {} 2024-04-18T14:43:31.898 INFO:teuthology.orchestra.run.smithi086.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-18T14:43:31.916 INFO:teuthology.orchestra.run.smithi086.stdout:osd.3: {} 2024-04-18T14:43:31.917 INFO:teuthology.orchestra.run.smithi086.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-18T14:43:31.932 INFO:teuthology.orchestra.run.smithi086.stdout:osd.4: {} 2024-04-18T14:43:31.932 INFO:teuthology.orchestra.run.smithi086.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-18T14:43:31.941 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-04-18T14:43:31.941 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T14:43:31.953 INFO:teuthology.orchestra.run.smithi086.stdout:osd.5: {} 2024-04-18T14:43:31.953 INFO:teuthology.orchestra.run.smithi086.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-18T14:43:31.956 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-04-18T14:43:31.973 INFO:teuthology.orchestra.run.smithi086.stdout:osd.6: {} 2024-04-18T14:43:31.974 INFO:teuthology.orchestra.run.smithi086.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-18T14:43:31.990 INFO:tasks.ceph.osd.0.smithi086.stderr:2024-04-18T14:43:31.991+0000 7f7cdfd78640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 24953) UID: 0 2024-04-18T14:43:31.992 INFO:teuthology.orchestra.run.smithi086.stdout:osd.7: {} 2024-04-18T14:43:31.992 INFO:teuthology.orchestra.run.smithi086.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-18T14:43:32.009 INFO:teuthology.orchestra.run.smithi086.stdout:osd.8: {} 2024-04-18T14:43:32.009 INFO:teuthology.orchestra.run.smithi086.stderr:osd.8: osd_enable_op_tracker = '' 2024-04-18T14:43:32.029 INFO:teuthology.orchestra.run.smithi086.stdout:osd.9: {} 2024-04-18T14:43:32.030 INFO:teuthology.orchestra.run.smithi086.stderr:osd.9: osd_enable_op_tracker = '' 2024-04-18T14:43:32.051 INFO:teuthology.orchestra.run.smithi086.stdout:osd.10: {} 2024-04-18T14:43:32.051 INFO:teuthology.orchestra.run.smithi086.stderr:osd.10: osd_enable_op_tracker = '' 2024-04-18T14:43:32.074 INFO:teuthology.orchestra.run.smithi086.stdout:osd.11: {} 2024-04-18T14:43:32.074 INFO:teuthology.orchestra.run.smithi086.stderr:osd.11: osd_enable_op_tracker = '' 2024-04-18T14:43:32.077 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-04-18T14:43:32.078 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T14:43:32.091 INFO:teuthology.orchestra.run.smithi086.stdout:osd.12: {} 2024-04-18T14:43:32.091 INFO:teuthology.orchestra.run.smithi086.stderr:osd.12: osd_enable_op_tracker = '' 2024-04-18T14:43:32.092 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-04-18T14:43:32.093 INFO:tasks.ceph.osd.6.smithi119.stderr:2024-04-18T14:43:32.090+0000 7fb7cb8bd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 24896) UID: 0 2024-04-18T14:43:32.094 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-18T14:43:32.095+0000 7ff1ae59c640 0 -- 172.21.15.86:0/2826662675 >> [v2:172.21.15.96:6800/24897,v1:172.21.15.96:6801/24897] conn(0x7ff1b02175a0 msgr2=0x7ff1b02179e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-04-18T14:43:32.114 INFO:teuthology.orchestra.run.smithi086.stdout:osd.13: {} 2024-04-18T14:43:32.114 INFO:teuthology.orchestra.run.smithi086.stderr:osd.13: osd_enable_op_tracker = '' 2024-04-18T14:43:32.136 INFO:teuthology.orchestra.run.smithi086.stdout:osd.14: {} 2024-04-18T14:43:32.136 INFO:teuthology.orchestra.run.smithi086.stderr:osd.14: osd_enable_op_tracker = '' 2024-04-18T14:43:32.155 INFO:teuthology.orchestra.run.smithi086.stdout:osd.15: {} 2024-04-18T14:43:32.156 INFO:teuthology.orchestra.run.smithi086.stderr:osd.15: osd_enable_op_tracker = '' 2024-04-18T14:43:32.191 INFO:tasks.ceph.osd.7.smithi134.stderr:2024-04-18T14:43:32.191+0000 7fd7de549640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25213) UID: 0 2024-04-18T14:43:32.216 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-04-18T14:43:32.216 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T14:43:32.231 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-04-18T14:43:32.293 INFO:tasks.ceph.osd.1.smithi096.stderr:2024-04-18T14:43:32.291+0000 7f56a7a98640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 24887) UID: 0 2024-04-18T14:43:32.394 INFO:tasks.ceph.osd.10.smithi119.stderr:2024-04-18T14:43:32.394+0000 7f6f24c12640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 10 (PID: 24898) UID: 0 2024-04-18T14:43:32.400 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-04-18T14:43:32.400 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T14:43:32.415 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-04-18T14:43:32.494 INFO:tasks.ceph.osd.8.smithi086.stderr:2024-04-18T14:43:32.495+0000 7f29f7b9d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 8 (PID: 24958) UID: 0 2024-04-18T14:43:32.537 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-04-18T14:43:32.537 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T14:43:32.551 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-04-18T14:43:32.596 INFO:tasks.ceph.osd.0.smithi086.stderr:2024-04-18T14:43:32.595+0000 7f7cdfd78640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 24953) UID: 0 2024-04-18T14:43:32.644 INFO:tasks.thrashosds.thrasher:in_osds: [0, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15] out_osds: [1] dead_osds: [] live_osds: [0, 4, 8, 12, 1, 5, 9, 13, 2, 6, 10, 14, 3, 7, 11, 15] 2024-04-18T14:43:32.644 INFO:tasks.thrashosds.thrasher:choose_action: min_in 8 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-04-18T14:43:32.644 INFO:tasks.thrashosds.thrasher:reset_purged_snaps_last 2024-04-18T14:43:32.644 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 reset_purged_snaps_last 2024-04-18T14:43:32.653 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-04-18T14:43:32.666 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-04-18T14:43:32.666 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T14:43:32.680 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.11.asok dump_ops_in_flight 2024-04-18T14:43:32.694 INFO:tasks.rados.rados.0.smithi134.stdout:1: write initial oid 1 2024-04-18T14:43:32.694 INFO:tasks.rados.rados.0.smithi134.stdout:1: seq_num 0 ranges {0=32768} 2024-04-18T14:43:32.694 INFO:tasks.rados.rados.0.smithi134.stdout:1: writing smithi13430248-1 from 0 to 32768 tid 1 2024-04-18T14:43:32.694 INFO:tasks.rados.rados.0.smithi134.stdout:2: write initial oid 2 2024-04-18T14:43:32.694 INFO:tasks.rados.rados.0.smithi134.stdout:2: seq_num 1 ranges {0=32768} 2024-04-18T14:43:32.695 INFO:tasks.rados.rados.0.smithi134.stdout:2: writing smithi13430248-2 from 0 to 32768 tid 1 2024-04-18T14:43:32.695 INFO:tasks.rados.rados.0.smithi134.stdout:3: write initial oid 3 2024-04-18T14:43:32.695 INFO:tasks.rados.rados.0.smithi134.stdout:3: seq_num 2 ranges {0=49152} 2024-04-18T14:43:32.695 INFO:tasks.rados.rados.0.smithi134.stdout:3: writing smithi13430248-3 from 0 to 49152 tid 1 2024-04-18T14:43:32.695 INFO:tasks.rados.rados.0.smithi134.stdout:4: write initial oid 4 2024-04-18T14:43:32.695 INFO:tasks.rados.rados.0.smithi134.stdout:4: seq_num 3 ranges {0=65536} 2024-04-18T14:43:32.695 INFO:tasks.rados.rados.0.smithi134.stdout:4: writing smithi13430248-4 from 0 to 65536 tid 1 2024-04-18T14:43:32.696 INFO:tasks.rados.rados.0.smithi134.stdout:5: write initial oid 5 2024-04-18T14:43:32.696 INFO:tasks.rados.rados.0.smithi134.stdout:5: seq_num 4 ranges {0=81920} 2024-04-18T14:43:32.696 INFO:tasks.rados.rados.0.smithi134.stdout:5: writing smithi13430248-5 from 0 to 81920 tid 1 2024-04-18T14:43:32.697 INFO:tasks.rados.rados.0.smithi134.stdout:6: write initial oid 6 2024-04-18T14:43:32.697 INFO:tasks.rados.rados.0.smithi134.stdout:6: seq_num 5 ranges {0=98304} 2024-04-18T14:43:32.697 INFO:tasks.rados.rados.0.smithi134.stdout:6: writing smithi13430248-6 from 0 to 98304 tid 1 2024-04-18T14:43:32.697 INFO:tasks.rados.rados.0.smithi134.stdout:7: write initial oid 7 2024-04-18T14:43:32.697 INFO:tasks.rados.rados.0.smithi134.stdout:7: seq_num 6 ranges {0=114688} 2024-04-18T14:43:32.697 INFO:tasks.rados.rados.0.smithi134.stdout:7: writing smithi13430248-7 from 0 to 114688 tid 1 2024-04-18T14:43:32.697 INFO:tasks.rados.rados.0.smithi134.stdout:8: write initial oid 8 2024-04-18T14:43:32.697 INFO:tasks.rados.rados.0.smithi134.stdout:8: seq_num 7 ranges {0=131072} 2024-04-18T14:43:32.699 INFO:tasks.rados.rados.0.smithi134.stdout:8: writing smithi13430248-8 from 0 to 131072 tid 1 2024-04-18T14:43:32.699 INFO:tasks.rados.rados.0.smithi134.stdout:9: write initial oid 9 2024-04-18T14:43:32.700 INFO:tasks.rados.rados.0.smithi134.stdout:9: seq_num 8 ranges {0=147456} 2024-04-18T14:43:32.700 INFO:tasks.rados.rados.0.smithi134.stdout:9: writing smithi13430248-9 from 0 to 147456 tid 1 2024-04-18T14:43:32.700 INFO:tasks.rados.rados.0.smithi134.stdout:10: write initial oid 10 2024-04-18T14:43:32.700 INFO:tasks.rados.rados.0.smithi134.stdout:10: seq_num 9 ranges {0=163840} 2024-04-18T14:43:32.701 INFO:tasks.rados.rados.0.smithi134.stdout:10: writing smithi13430248-10 from 0 to 163840 tid 1 2024-04-18T14:43:32.701 INFO:tasks.rados.rados.0.smithi134.stdout:11: write initial oid 11 2024-04-18T14:43:32.701 INFO:tasks.rados.rados.0.smithi134.stdout:11: seq_num 10 ranges {0=180224} 2024-04-18T14:43:32.702 INFO:tasks.rados.rados.0.smithi134.stdout:11: writing smithi13430248-11 from 0 to 180224 tid 1 2024-04-18T14:43:32.703 INFO:tasks.rados.rados.0.smithi134.stdout:12: write initial oid 12 2024-04-18T14:43:32.703 INFO:tasks.rados.rados.0.smithi134.stdout:12: seq_num 11 ranges {0=196608} 2024-04-18T14:43:32.707 INFO:tasks.rados.rados.0.smithi134.stdout:12: writing smithi13430248-12 from 0 to 196608 tid 1 2024-04-18T14:43:32.707 INFO:tasks.rados.rados.0.smithi134.stdout:13: write initial oid 13 2024-04-18T14:43:32.707 INFO:tasks.rados.rados.0.smithi134.stdout:13: seq_num 12 ranges {0=212992} 2024-04-18T14:43:32.707 INFO:tasks.rados.rados.0.smithi134.stdout:13: writing smithi13430248-13 from 0 to 212992 tid 1 2024-04-18T14:43:32.707 INFO:tasks.rados.rados.0.smithi134.stdout:14: write initial oid 14 2024-04-18T14:43:32.707 INFO:tasks.rados.rados.0.smithi134.stdout:14: seq_num 13 ranges {0=229376} 2024-04-18T14:43:32.708 INFO:tasks.rados.rados.0.smithi134.stdout:14: writing smithi13430248-14 from 0 to 229376 tid 1 2024-04-18T14:43:32.708 INFO:tasks.rados.rados.0.smithi134.stdout:15: write initial oid 15 2024-04-18T14:43:32.708 INFO:tasks.rados.rados.0.smithi134.stdout:15: seq_num 14 ranges {0=245760} 2024-04-18T14:43:32.710 INFO:tasks.rados.rados.0.smithi134.stdout:15: writing smithi13430248-15 from 0 to 245760 tid 1 2024-04-18T14:43:32.711 INFO:tasks.rados.rados.0.smithi134.stdout:16: write initial oid 16 2024-04-18T14:43:32.711 INFO:tasks.rados.rados.0.smithi134.stdout:16: seq_num 15 ranges {0=262144} 2024-04-18T14:43:32.713 INFO:tasks.rados.rados.0.smithi134.stdout:16: writing smithi13430248-16 from 0 to 262144 tid 1 2024-04-18T14:43:32.714 INFO:tasks.rados.rados.0.smithi134.stdout:4: finishing write tid 1 to smithi13430248-4 2024-04-18T14:43:32.714 INFO:tasks.rados.rados.0.smithi134.stdout:2: finishing write tid 1 to smithi13430248-2 2024-04-18T14:43:32.714 INFO:tasks.rados.rados.0.smithi134.stdout:2: finishing write tid 2 to smithi13430248-2 2024-04-18T14:43:32.714 INFO:tasks.rados.rados.0.smithi134.stdout:4: finishing write tid 2 to smithi13430248-4 2024-04-18T14:43:32.714 INFO:tasks.rados.rados.0.smithi134.stdout:1: finishing write tid 1 to smithi13430248-1 2024-04-18T14:43:32.714 INFO:tasks.rados.rados.0.smithi134.stdout: waiting on 16 2024-04-18T14:43:32.714 INFO:tasks.rados.rados.0.smithi134.stdout:1: finishing write tid 2 to smithi13430248-1 2024-04-18T14:43:32.717 INFO:tasks.rados.rados.0.smithi134.stdout:2: finishing write tid 3 to smithi13430248-2 2024-04-18T14:43:32.718 INFO:tasks.rados.rados.0.smithi134.stdout:2: oid 2 updating version 0 to 1 2024-04-18T14:43:32.718 INFO:tasks.rados.rados.0.smithi134.stdout:2: oid 2 updating version 1 to 2 2024-04-18T14:43:32.718 INFO:tasks.rados.rados.0.smithi134.stdout:update_object_version oid 2 v 2 (ObjNum 1 snap 0 seq_num 1) dirty exists 2024-04-18T14:43:32.718 INFO:tasks.rados.rados.0.smithi134.stdout:2: left oid 2 (ObjNum 1 snap 0 seq_num 1) 2024-04-18T14:43:32.718 INFO:tasks.rados.rados.0.smithi134.stdout:2: done (15 left) 2024-04-18T14:43:32.718 INFO:tasks.rados.rados.0.smithi134.stdout:17: write initial oid 17 2024-04-18T14:43:32.718 INFO:tasks.rados.rados.0.smithi134.stdout:17: seq_num 16 ranges {0=278528} 2024-04-18T14:43:32.719 INFO:tasks.rados.rados.0.smithi134.stdout:17: writing smithi13430248-17 from 0 to 278528 tid 1 2024-04-18T14:43:32.720 INFO:tasks.rados.rados.0.smithi134.stdout:3: finishing write tid 1 to smithi13430248-3 2024-04-18T14:43:32.720 INFO:tasks.rados.rados.0.smithi134.stdout:3: finishing write tid 2 to smithi13430248-3 2024-04-18T14:43:32.720 INFO:tasks.rados.rados.0.smithi134.stdout:11: finishing write tid 1 to smithi13430248-11 2024-04-18T14:43:32.720 INFO:tasks.rados.rados.0.smithi134.stdout:6: finishing write tid 1 to smithi13430248-6 2024-04-18T14:43:32.720 INFO:tasks.rados.rados.0.smithi134.stdout:3: finishing write tid 3 to smithi13430248-3 2024-04-18T14:43:32.720 INFO:tasks.rados.rados.0.smithi134.stdout:3: oid 3 updating version 0 to 2 2024-04-18T14:43:32.721 INFO:tasks.rados.rados.0.smithi134.stdout:3: oid 3 version 2 is already newer than 1 2024-04-18T14:43:32.721 INFO:tasks.rados.rados.0.smithi134.stdout:update_object_version oid 3 v 2 (ObjNum 2 snap 0 seq_num 2) dirty exists 2024-04-18T14:43:32.721 INFO:tasks.rados.rados.0.smithi134.stdout:3: left oid 3 (ObjNum 2 snap 0 seq_num 2) 2024-04-18T14:43:32.721 INFO:tasks.rados.rados.0.smithi134.stdout:11: finishing write tid 2 to smithi13430248-11 2024-04-18T14:43:32.721 INFO:tasks.rados.rados.0.smithi134.stdout:3: done (15 left) 2024-04-18T14:43:32.721 INFO:tasks.rados.rados.0.smithi134.stdout:18: write initial oid 18 2024-04-18T14:43:32.721 INFO:tasks.rados.rados.0.smithi134.stdout:18: seq_num 17 ranges {0=294912} 2024-04-18T14:43:32.724 INFO:tasks.rados.rados.0.smithi134.stdout:18: writing smithi13430248-18 from 0 to 294912 tid 1 2024-04-18T14:43:32.724 INFO:tasks.rados.rados.0.smithi134.stdout: waiting on 16 2024-04-18T14:43:32.724 INFO:tasks.rados.rados.0.smithi134.stdout:6: finishing write tid 2 to smithi13430248-6 2024-04-18T14:43:32.725 INFO:tasks.rados.rados.0.smithi134.stdout:9: finishing write tid 1 to smithi13430248-9 2024-04-18T14:43:32.725 INFO:tasks.rados.rados.0.smithi134.stdout:6: finishing write tid 3 to smithi13430248-6 2024-04-18T14:43:32.725 INFO:tasks.rados.rados.0.smithi134.stdout:6: oid 6 updating version 0 to 3 2024-04-18T14:43:32.725 INFO:tasks.rados.rados.0.smithi134.stdout:6: oid 6 updating version 3 to 4 2024-04-18T14:43:32.725 INFO:tasks.rados.rados.0.smithi134.stdout:update_object_version oid 6 v 4 (ObjNum 5 snap 0 seq_num 5) dirty exists 2024-04-18T14:43:32.725 INFO:tasks.rados.rados.0.smithi134.stdout:6: left oid 6 (ObjNum 5 snap 0 seq_num 5) 2024-04-18T14:43:32.725 INFO:tasks.rados.rados.0.smithi134.stdout:6: done (15 left) 2024-04-18T14:43:32.725 INFO:tasks.rados.rados.0.smithi134.stdout:19: write initial oid 19 2024-04-18T14:43:32.725 INFO:tasks.rados.rados.0.smithi134.stdout:19: seq_num 18 ranges {0=311296} 2024-04-18T14:43:32.726 INFO:tasks.rados.rados.0.smithi134.stdout:19: writing smithi13430248-19 from 0 to 311296 tid 1 2024-04-18T14:43:32.726 INFO:tasks.rados.rados.0.smithi134.stdout: waiting on 16 2024-04-18T14:43:32.726 INFO:tasks.rados.rados.0.smithi134.stdout:11: finishing write tid 3 to smithi13430248-11 2024-04-18T14:43:32.727 INFO:tasks.rados.rados.0.smithi134.stdout:11: oid 11 updating version 0 to 1 2024-04-18T14:43:32.727 INFO:tasks.rados.rados.0.smithi134.stdout:11: oid 11 updating version 1 to 2 2024-04-18T14:43:32.727 INFO:tasks.rados.rados.0.smithi134.stdout:update_object_version oid 11 v 2 (ObjNum 10 snap 0 seq_num 10) dirty exists 2024-04-18T14:43:32.727 INFO:tasks.rados.rados.0.smithi134.stdout:11: left oid 11 (ObjNum 10 snap 0 seq_num 10) 2024-04-18T14:43:32.727 INFO:tasks.rados.rados.0.smithi134.stdout:9: finishing write tid 2 to smithi13430248-9 2024-04-18T14:43:32.727 INFO:tasks.rados.rados.0.smithi134.stdout:11: done (15 left) 2024-04-18T14:43:32.727 INFO:tasks.rados.rados.0.smithi134.stdout:20: write initial oid 20 2024-04-18T14:43:32.727 INFO:tasks.rados.rados.0.smithi134.stdout:20: seq_num 19 ranges {0=327680} 2024-04-18T14:43:32.728 INFO:tasks.rados.rados.0.smithi134.stdout:20: writing smithi13430248-20 from 0 to 327680 tid 1 2024-04-18T14:43:32.728 INFO:tasks.rados.rados.0.smithi134.stdout: waiting on 16 2024-04-18T14:43:32.728 INFO:tasks.rados.rados.0.smithi134.stdout:12: finishing write tid 1 to smithi13430248-12 2024-04-18T14:43:32.731 INFO:tasks.rados.rados.0.smithi134.stdout:7: finishing write tid 1 to smithi13430248-7 2024-04-18T14:43:32.732 INFO:tasks.rados.rados.0.smithi134.stdout:7: finishing write tid 2 to smithi13430248-7 2024-04-18T14:43:32.732 INFO:tasks.rados.rados.0.smithi134.stdout:10: finishing write tid 1 to smithi13430248-10 2024-04-18T14:43:32.732 INFO:tasks.rados.rados.0.smithi134.stdout:12: finishing write tid 2 to smithi13430248-12 2024-04-18T14:43:32.732 INFO:tasks.rados.rados.0.smithi134.stdout:16: finishing write tid 1 to smithi13430248-16 2024-04-18T14:43:32.732 INFO:tasks.rados.rados.0.smithi134.stdout:16: finishing write tid 2 to smithi13430248-16 2024-04-18T14:43:32.732 INFO:tasks.rados.rados.0.smithi134.stdout:10: finishing write tid 2 to smithi13430248-10 2024-04-18T14:43:32.732 INFO:tasks.rados.rados.0.smithi134.stdout:14: finishing write tid 1 to smithi13430248-14 2024-04-18T14:43:32.733 INFO:tasks.rados.rados.0.smithi134.stdout:20: finishing write tid 1 to smithi13430248-20 2024-04-18T14:43:32.734 INFO:tasks.ceph.osd.0.smithi086.stderr:2024-04-18T14:43:32.735+0000 7f7cdfd78640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 24953) UID: 0 2024-04-18T14:43:32.734 INFO:tasks.rados.rados.0.smithi134.stdout:20: finishing write tid 2 to smithi13430248-20 2024-04-18T14:43:32.735 INFO:tasks.rados.rados.0.smithi134.stdout:5: finishing write tid 1 to smithi13430248-5 2024-04-18T14:43:32.735 INFO:tasks.rados.rados.0.smithi134.stdout:12: finishing write tid 3 to smithi13430248-12 2024-04-18T14:43:32.735 INFO:tasks.rados.rados.0.smithi134.stdout:12: oid 12 updating version 0 to 1 2024-04-18T14:43:32.735 INFO:tasks.rados.rados.0.smithi134.stdout:12: oid 12 updating version 1 to 2 2024-04-18T14:43:32.735 INFO:tasks.rados.rados.0.smithi134.stdout:update_object_version oid 12 v 2 (ObjNum 11 snap 0 seq_num 11) dirty exists 2024-04-18T14:43:32.735 INFO:tasks.rados.rados.0.smithi134.stdout:12: left oid 12 (ObjNum 11 snap 0 seq_num 11) 2024-04-18T14:43:32.735 INFO:tasks.rados.rados.0.smithi134.stdout:12: done (15 left) 2024-04-18T14:43:32.735 INFO:tasks.rados.rados.0.smithi134.stdout:21: write initial oid 21 2024-04-18T14:43:32.735 INFO:tasks.rados.rados.0.smithi134.stdout:21: seq_num 20 ranges {0=344064} 2024-04-18T14:43:32.738 INFO:tasks.rados.rados.0.smithi134.stdout:21: writing smithi13430248-21 from 0 to 344064 tid 1 2024-04-18T14:43:32.738 INFO:tasks.rados.rados.0.smithi134.stdout: waiting on 16 2024-04-18T14:43:32.738 INFO:tasks.rados.rados.0.smithi134.stdout:16: finishing write tid 3 to smithi13430248-16 2024-04-18T14:43:32.738 INFO:tasks.rados.rados.0.smithi134.stdout:16: oid 16 updating version 0 to 4 2024-04-18T14:43:32.738 INFO:tasks.rados.rados.0.smithi134.stdout:16: oid 16 version 4 is already newer than 3 2024-04-18T14:43:32.738 INFO:tasks.rados.rados.0.smithi134.stdout:update_object_version oid 16 v 4 (ObjNum 15 snap 0 seq_num 15) dirty exists 2024-04-18T14:43:32.739 INFO:tasks.rados.rados.0.smithi134.stdout:16: left oid 16 (ObjNum 15 snap 0 seq_num 15) 2024-04-18T14:43:32.739 INFO:tasks.rados.rados.0.smithi134.stdout:14: finishing write tid 2 to smithi13430248-14 2024-04-18T14:43:32.739 INFO:tasks.rados.rados.0.smithi134.stdout:20: finishing write tid 3 to smithi13430248-20 2024-04-18T14:43:32.739 INFO:tasks.rados.rados.0.smithi134.stdout:20: oid 20 updating version 0 to 3 2024-04-18T14:43:32.739 INFO:tasks.rados.rados.0.smithi134.stdout:20: oid 20 updating version 3 to 4 2024-04-18T14:43:32.739 INFO:tasks.rados.rados.0.smithi134.stdout:update_object_version oid 20 v 4 (ObjNum 19 snap 0 seq_num 19) dirty exists 2024-04-18T14:43:32.739 INFO:tasks.rados.rados.0.smithi134.stdout:20: left oid 20 (ObjNum 19 snap 0 seq_num 19) 2024-04-18T14:43:32.739 INFO:tasks.rados.rados.0.smithi134.stdout:16: done (15 left) 2024-04-18T14:43:32.739 INFO:tasks.rados.rados.0.smithi134.stdout:20: done (14 left) 2024-04-18T14:43:32.739 INFO:tasks.rados.rados.0.smithi134.stdout:22: write initial oid 22 2024-04-18T14:43:32.739 INFO:tasks.rados.rados.0.smithi134.stdout:22: seq_num 21 ranges {0=360448} 2024-04-18T14:43:32.740 INFO:tasks.rados.rados.0.smithi134.stdout:22: writing smithi13430248-22 from 0 to 360448 tid 1 2024-04-18T14:43:32.740 INFO:tasks.rados.rados.0.smithi134.stdout:23: write initial oid 23 2024-04-18T14:43:32.741 INFO:tasks.rados.rados.0.smithi134.stdout:23: seq_num 22 ranges {0=376832} 2024-04-18T14:43:32.744 INFO:tasks.rados.rados.0.smithi134.stdout:23: writing smithi13430248-23 from 0 to 376832 tid 1 2024-04-18T14:43:32.744 INFO:tasks.rados.rados.0.smithi134.stdout:10: finishing write tid 3 to smithi13430248-10 2024-04-18T14:43:32.744 INFO:tasks.rados.rados.0.smithi134.stdout:10: oid 10 updating version 0 to 3 2024-04-18T14:43:32.744 INFO:tasks.rados.rados.0.smithi134.stdout:10: oid 10 updating version 3 to 4 2024-04-18T14:43:32.744 INFO:tasks.rados.rados.0.smithi134.stdout:update_object_version oid 10 v 4 (ObjNum 9 snap 0 seq_num 9) dirty exists 2024-04-18T14:43:32.744 INFO:tasks.rados.rados.0.smithi134.stdout:10: left oid 10 (ObjNum 9 snap 0 seq_num 9) 2024-04-18T14:43:32.744 INFO:tasks.rados.rados.0.smithi134.stdout:1: finishing write tid 3 to smithi13430248-1 2024-04-18T14:43:32.744 INFO:tasks.rados.rados.0.smithi134.stdout:1: oid 1 updating version 0 to 2 2024-04-18T14:43:32.744 INFO:tasks.rados.rados.0.smithi134.stdout:1: oid 1 version 2 is already newer than 1 2024-04-18T14:43:32.745 INFO:tasks.rados.rados.0.smithi134.stdout:update_object_version oid 1 v 2 (ObjNum 0 snap 0 seq_num 0) dirty exists 2024-04-18T14:43:32.745 INFO:tasks.rados.rados.0.smithi134.stdout:1: left oid 1 (ObjNum 0 snap 0 seq_num 0) 2024-04-18T14:43:32.745 INFO:tasks.rados.rados.0.smithi134.stdout:5: finishing write tid 2 to smithi13430248-5 2024-04-18T14:43:32.745 INFO:tasks.rados.rados.0.smithi134.stdout:4: finishing write tid 3 to smithi13430248-4 2024-04-18T14:43:32.745 INFO:tasks.rados.rados.0.smithi134.stdout:4: oid 4 updating version 0 to 1 2024-04-18T14:43:32.745 INFO:tasks.rados.rados.0.smithi134.stdout:4: oid 4 updating version 1 to 2 2024-04-18T14:43:32.745 INFO:tasks.rados.rados.0.smithi134.stdout:update_object_version oid 4 v 2 (ObjNum 3 snap 0 seq_num 3) dirty exists 2024-04-18T14:43:32.745 INFO:tasks.rados.rados.0.smithi134.stdout:4: left oid 4 (ObjNum 3 snap 0 seq_num 3) 2024-04-18T14:43:32.745 INFO:tasks.rados.rados.0.smithi134.stdout:7: finishing write tid 3 to smithi13430248-7 2024-04-18T14:43:32.745 INFO:tasks.rados.rados.0.smithi134.stdout:7: oid 7 updating version 0 to 1 2024-04-18T14:43:32.745 INFO:tasks.rados.rados.0.smithi134.stdout:7: oid 7 updating version 1 to 2 2024-04-18T14:43:32.745 INFO:tasks.rados.rados.0.smithi134.stdout:update_object_version oid 7 v 2 (ObjNum 6 snap 0 seq_num 6) dirty exists 2024-04-18T14:43:32.745 INFO:tasks.rados.rados.0.smithi134.stdout:7: left oid 7 (ObjNum 6 snap 0 seq_num 6) 2024-04-18T14:43:32.746 INFO:tasks.rados.rados.0.smithi134.stdout:13: finishing write tid 1 to smithi13430248-13 2024-04-18T14:43:32.746 INFO:tasks.rados.rados.0.smithi134.stdout:15: finishing write tid 1 to smithi13430248-15 2024-04-18T14:43:32.746 INFO:tasks.rados.rados.0.smithi134.stdout:15: finishing write tid 2 to smithi13430248-15 2024-04-18T14:43:32.746 INFO:tasks.rados.rados.0.smithi134.stdout:1: done (15 left) 2024-04-18T14:43:32.746 INFO:tasks.rados.rados.0.smithi134.stdout:4: done (14 left) 2024-04-18T14:43:32.746 INFO:tasks.rados.rados.0.smithi134.stdout:7: done (13 left) 2024-04-18T14:43:32.746 INFO:tasks.rados.rados.0.smithi134.stdout:10: done (12 left) 2024-04-18T14:43:32.746 INFO:tasks.rados.rados.0.smithi134.stdout:24: write initial oid 24 2024-04-18T14:43:32.746 INFO:tasks.rados.rados.0.smithi134.stdout:24: seq_num 23 ranges {0=393216} 2024-04-18T14:43:32.747 INFO:tasks.rados.rados.0.smithi134.stdout:24: writing smithi13430248-24 from 0 to 393216 tid 1 2024-04-18T14:43:32.747 INFO:tasks.rados.rados.0.smithi134.stdout:25: write initial oid 25 2024-04-18T14:43:32.747 INFO:tasks.rados.rados.0.smithi134.stdout:25: seq_num 24 ranges {0=409600} 2024-04-18T14:43:32.748 INFO:tasks.rados.rados.0.smithi134.stdout:25: writing smithi13430248-25 from 0 to 409600 tid 1 2024-04-18T14:43:32.748 INFO:tasks.rados.rados.0.smithi134.stdout:26: write initial oid 26 2024-04-18T14:43:32.748 INFO:tasks.rados.rados.0.smithi134.stdout:26: seq_num 25 ranges {0=425984} 2024-04-18T14:43:32.751 INFO:tasks.rados.rados.0.smithi134.stdout:26: writing smithi13430248-26 from 0 to 425984 tid 1 2024-04-18T14:43:32.751 INFO:tasks.rados.rados.0.smithi134.stdout:27: write initial oid 27 2024-04-18T14:43:32.751 INFO:tasks.rados.rados.0.smithi134.stdout:27: seq_num 26 ranges {0=442368} 2024-04-18T14:43:32.756 INFO:tasks.rados.rados.0.smithi134.stdout:27: writing smithi13430248-27 from 0 to 442368 tid 1 2024-04-18T14:43:32.756 INFO:tasks.rados.rados.0.smithi134.stdout: waiting on 16 2024-04-18T14:43:32.756 INFO:tasks.rados.rados.0.smithi134.stdout:14: finishing write tid 3 to smithi13430248-14 2024-04-18T14:43:32.756 INFO:tasks.rados.rados.0.smithi134.stdout:14: oid 14 updating version 0 to 5 2024-04-18T14:43:32.756 INFO:tasks.rados.rados.0.smithi134.stdout:14: oid 14 updating version 5 to 6 2024-04-18T14:43:32.756 INFO:tasks.rados.rados.0.smithi134.stdout:update_object_version oid 14 v 6 (ObjNum 13 snap 0 seq_num 13) dirty exists 2024-04-18T14:43:32.756 INFO:tasks.rados.rados.0.smithi134.stdout:14: left oid 14 (ObjNum 13 snap 0 seq_num 13) 2024-04-18T14:43:32.756 INFO:tasks.rados.rados.0.smithi134.stdout:18: finishing write tid 1 to smithi13430248-18 2024-04-18T14:43:32.756 INFO:tasks.rados.rados.0.smithi134.stdout:18: finishing write tid 2 to smithi13430248-18 2024-04-18T14:43:32.756 INFO:tasks.rados.rados.0.smithi134.stdout:17: finishing write tid 1 to smithi13430248-17 2024-04-18T14:43:32.757 INFO:tasks.rados.rados.0.smithi134.stdout:15: finishing write tid 3 to smithi13430248-15 2024-04-18T14:43:32.757 INFO:tasks.rados.rados.0.smithi134.stdout:15: oid 15 updating version 0 to 2 2024-04-18T14:43:32.757 INFO:tasks.rados.rados.0.smithi134.stdout:15: oid 15 version 2 is already newer than 1 2024-04-18T14:43:32.757 INFO:tasks.rados.rados.0.smithi134.stdout:update_object_version oid 15 v 2 (ObjNum 14 snap 0 seq_num 14) dirty exists 2024-04-18T14:43:32.757 INFO:tasks.rados.rados.0.smithi134.stdout:15: left oid 15 (ObjNum 14 snap 0 seq_num 14) 2024-04-18T14:43:32.757 INFO:tasks.rados.rados.0.smithi134.stdout:13: finishing write tid 2 to smithi13430248-13 2024-04-18T14:43:32.757 INFO:tasks.rados.rados.0.smithi134.stdout:5: finishing write tid 3 to smithi13430248-5 2024-04-18T14:43:32.757 INFO:tasks.rados.rados.0.smithi134.stdout:5: oid 5 updating version 0 to 4 2024-04-18T14:43:32.757 INFO:tasks.rados.rados.0.smithi134.stdout:5: oid 5 version 4 is already newer than 3 2024-04-18T14:43:32.757 INFO:tasks.rados.rados.0.smithi134.stdout:update_object_version oid 5 v 4 (ObjNum 4 snap 0 seq_num 4) dirty exists 2024-04-18T14:43:32.757 INFO:tasks.rados.rados.0.smithi134.stdout:5: left oid 5 (ObjNum 4 snap 0 seq_num 4) 2024-04-18T14:43:32.757 INFO:tasks.rados.rados.0.smithi134.stdout:18: finishing write tid 3 to smithi13430248-18 2024-04-18T14:43:32.757 INFO:tasks.rados.rados.0.smithi134.stdout:18: oid 18 updating version 0 to 1 2024-04-18T14:43:32.757 INFO:tasks.rados.rados.0.smithi134.stdout:18: oid 18 updating version 1 to 2 2024-04-18T14:43:32.758 INFO:tasks.rados.rados.0.smithi134.stdout:update_object_version oid 18 v 2 (ObjNum 17 snap 0 seq_num 17) dirty exists 2024-04-18T14:43:32.758 INFO:tasks.rados.rados.0.smithi134.stdout:18: left oid 18 (ObjNum 17 snap 0 seq_num 17) 2024-04-18T14:43:32.758 INFO:tasks.rados.rados.0.smithi134.stdout:21: finishing write tid 1 to smithi13430248-21 2024-04-18T14:43:32.758 INFO:tasks.rados.rados.0.smithi134.stdout:22: finishing write tid 1 to smithi13430248-22 2024-04-18T14:43:32.758 INFO:tasks.rados.rados.0.smithi134.stdout:13: finishing write tid 3 to smithi13430248-13 2024-04-18T14:43:32.758 INFO:tasks.rados.rados.0.smithi134.stdout:13: oid 13 updating version 0 to 3 2024-04-18T14:43:32.758 INFO:tasks.rados.rados.0.smithi134.stdout:13: oid 13 updating version 3 to 4 2024-04-18T14:43:32.758 INFO:tasks.rados.rados.0.smithi134.stdout:update_object_version oid 13 v 4 (ObjNum 12 snap 0 seq_num 12) dirty exists 2024-04-18T14:43:32.758 INFO:tasks.rados.rados.0.smithi134.stdout:13: left oid 13 (ObjNum 12 snap 0 seq_num 12) 2024-04-18T14:43:32.758 INFO:tasks.rados.rados.0.smithi134.stdout:21: finishing write tid 2 to smithi13430248-21 2024-04-18T14:43:32.758 INFO:tasks.rados.rados.0.smithi134.stdout:22: finishing write tid 2 to smithi13430248-22 2024-04-18T14:43:32.758 INFO:tasks.rados.rados.0.smithi134.stdout:19: finishing write tid 1 to smithi13430248-19 2024-04-18T14:43:32.758 INFO:tasks.rados.rados.0.smithi134.stdout:9: finishing write tid 3 to smithi13430248-9 2024-04-18T14:43:32.759 INFO:tasks.rados.rados.0.smithi134.stdout:9: oid 9 updating version 0 to 1 2024-04-18T14:43:32.759 INFO:tasks.rados.rados.0.smithi134.stdout:9: oid 9 updating version 1 to 2 2024-04-18T14:43:32.759 INFO:tasks.rados.rados.0.smithi134.stdout:update_object_version oid 9 v 2 (ObjNum 8 snap 0 seq_num 8) dirty exists 2024-04-18T14:43:32.759 INFO:tasks.rados.rados.0.smithi134.stdout:9: left oid 9 (ObjNum 8 snap 0 seq_num 8) 2024-04-18T14:43:32.759 INFO:tasks.rados.rados.0.smithi134.stdout:22: finishing write tid 3 to smithi13430248-22 2024-04-18T14:43:32.759 INFO:tasks.rados.rados.0.smithi134.stdout:22: oid 22 updating version 0 to 4 2024-04-18T14:43:32.759 INFO:tasks.rados.rados.0.smithi134.stdout:22: oid 22 version 4 is already newer than 3 2024-04-18T14:43:32.759 INFO:tasks.rados.rados.0.smithi134.stdout:update_object_version oid 22 v 4 (ObjNum 21 snap 0 seq_num 21) dirty exists 2024-04-18T14:43:32.759 INFO:tasks.rados.rados.0.smithi134.stdout:22: left oid 22 (ObjNum 21 snap 0 seq_num 21) 2024-04-18T14:43:32.759 INFO:tasks.rados.rados.0.smithi134.stdout:21: finishing write tid 3 to smithi13430248-21 2024-04-18T14:43:32.759 INFO:tasks.rados.rados.0.smithi134.stdout:21: oid 21 updating version 0 to 7 2024-04-18T14:43:32.759 INFO:tasks.rados.rados.0.smithi134.stdout:21: oid 21 updating version 7 to 8 2024-04-18T14:43:32.759 INFO:tasks.rados.rados.0.smithi134.stdout:update_object_version oid 21 v 8 (ObjNum 20 snap 0 seq_num 20) dirty exists 2024-04-18T14:43:32.759 INFO:tasks.rados.rados.0.smithi134.stdout:21: left oid 21 (ObjNum 20 snap 0 seq_num 20) 2024-04-18T14:43:32.760 INFO:tasks.rados.rados.0.smithi134.stdout:17: finishing write tid 2 to smithi13430248-17 2024-04-18T14:43:32.760 INFO:tasks.rados.rados.0.smithi134.stdout:5: done (15 left) 2024-04-18T14:43:32.760 INFO:tasks.rados.rados.0.smithi134.stdout:9: done (14 left) 2024-04-18T14:43:32.760 INFO:tasks.rados.rados.0.smithi134.stdout:13: done (13 left) 2024-04-18T14:43:32.760 INFO:tasks.rados.rados.0.smithi134.stdout:14: done (12 left) 2024-04-18T14:43:32.760 INFO:tasks.rados.rados.0.smithi134.stdout:15: done (11 left) 2024-04-18T14:43:32.760 INFO:tasks.rados.rados.0.smithi134.stdout:18: done (10 left) 2024-04-18T14:43:32.760 INFO:tasks.rados.rados.0.smithi134.stdout:21: done (9 left) 2024-04-18T14:43:32.760 INFO:tasks.rados.rados.0.smithi134.stdout:22: done (8 left) 2024-04-18T14:43:32.760 INFO:tasks.rados.rados.0.smithi134.stdout:28: write initial oid 28 2024-04-18T14:43:32.760 INFO:tasks.rados.rados.0.smithi134.stdout:28: seq_num 27 ranges {0=458752} 2024-04-18T14:43:32.761 INFO:tasks.rados.rados.0.smithi134.stdout:28: writing smithi13430248-28 from 0 to 458752 tid 1 2024-04-18T14:43:32.761 INFO:tasks.rados.rados.0.smithi134.stdout:29: write initial oid 29 2024-04-18T14:43:32.761 INFO:tasks.rados.rados.0.smithi134.stdout:29: seq_num 28 ranges {0=475136} 2024-04-18T14:43:32.761 INFO:tasks.rados.rados.0.smithi134.stdout:29: writing smithi13430248-29 from 0 to 475136 tid 1 2024-04-18T14:43:32.761 INFO:tasks.rados.rados.0.smithi134.stdout:30: write initial oid 30 2024-04-18T14:43:32.762 INFO:tasks.rados.rados.0.smithi134.stdout:30: seq_num 29 ranges {0=491520} 2024-04-18T14:43:32.765 INFO:tasks.rados.rados.0.smithi134.stdout:30: writing smithi13430248-30 from 0 to 491520 tid 1 2024-04-18T14:43:32.765 INFO:tasks.rados.rados.0.smithi134.stdout:31: write initial oid 31 2024-04-18T14:43:32.765 INFO:tasks.rados.rados.0.smithi134.stdout:31: seq_num 30 ranges {0=507904} 2024-04-18T14:43:32.768 INFO:tasks.rados.rados.0.smithi134.stdout:31: writing smithi13430248-31 from 0 to 507904 tid 1 2024-04-18T14:43:32.768 INFO:tasks.rados.rados.0.smithi134.stdout:32: write initial oid 32 2024-04-18T14:43:32.768 INFO:tasks.rados.rados.0.smithi134.stdout:32: seq_num 31 ranges {0=524288} 2024-04-18T14:43:32.771 INFO:tasks.rados.rados.0.smithi134.stdout:32: writing smithi13430248-32 from 0 to 524288 tid 1 2024-04-18T14:43:32.771 INFO:tasks.rados.rados.0.smithi134.stdout:33: write initial oid 33 2024-04-18T14:43:32.771 INFO:tasks.rados.rados.0.smithi134.stdout:33: seq_num 32 ranges {0=540672} 2024-04-18T14:43:32.774 INFO:tasks.rados.rados.0.smithi134.stdout:33: writing smithi13430248-33 from 0 to 540672 tid 1 2024-04-18T14:43:32.774 INFO:tasks.rados.rados.0.smithi134.stdout:34: write initial oid 34 2024-04-18T14:43:32.775 INFO:tasks.rados.rados.0.smithi134.stdout:34: seq_num 33 ranges {0=557056} 2024-04-18T14:43:32.778 INFO:tasks.rados.rados.0.smithi134.stdout:34: writing smithi13430248-34 from 0 to 557056 tid 1 2024-04-18T14:43:32.778 INFO:tasks.rados.rados.0.smithi134.stdout:35: write initial oid 35 2024-04-18T14:43:32.778 INFO:tasks.rados.rados.0.smithi134.stdout:35: seq_num 34 ranges {0=573440} 2024-04-18T14:43:32.782 INFO:tasks.rados.rados.0.smithi134.stdout:35: writing smithi13430248-35 from 0 to 573440 tid 1 2024-04-18T14:43:32.782 INFO:tasks.rados.rados.0.smithi134.stdout: waiting on 16 2024-04-18T14:43:32.782 INFO:tasks.rados.rados.0.smithi134.stdout:17: finishing write tid 3 to smithi13430248-17 2024-04-18T14:43:32.782 INFO:tasks.rados.rados.0.smithi134.stdout:17: oid 17 updating version 0 to 6 2024-04-18T14:43:32.782 INFO:tasks.rados.rados.0.smithi134.stdout:17: oid 17 version 6 is already newer than 5 2024-04-18T14:43:32.782 INFO:tasks.rados.rados.0.smithi134.stdout:update_object_version oid 17 v 6 (ObjNum 16 snap 0 seq_num 16) dirty exists 2024-04-18T14:43:32.782 INFO:tasks.rados.rados.0.smithi134.stdout:17: left oid 17 (ObjNum 16 snap 0 seq_num 16) 2024-04-18T14:43:32.782 INFO:tasks.rados.rados.0.smithi134.stdout:19: finishing write tid 2 to smithi13430248-19 2024-04-18T14:43:32.782 INFO:tasks.rados.rados.0.smithi134.stdout:19: finishing write tid 3 to smithi13430248-19 2024-04-18T14:43:32.783 INFO:tasks.rados.rados.0.smithi134.stdout:19: oid 19 updating version 0 to 3 2024-04-18T14:43:32.783 INFO:tasks.rados.rados.0.smithi134.stdout:19: oid 19 updating version 3 to 4 2024-04-18T14:43:32.783 INFO:tasks.rados.rados.0.smithi134.stdout:update_object_version oid 19 v 4 (ObjNum 18 snap 0 seq_num 18) dirty exists 2024-04-18T14:43:32.783 INFO:tasks.rados.rados.0.smithi134.stdout:19: left oid 19 (ObjNum 18 snap 0 seq_num 18) 2024-04-18T14:43:32.783 INFO:tasks.rados.rados.0.smithi134.stdout:25: finishing write tid 1 to smithi13430248-25 2024-04-18T14:43:32.783 INFO:tasks.rados.rados.0.smithi134.stdout:25: finishing write tid 2 to smithi13430248-25 2024-04-18T14:43:32.783 INFO:tasks.rados.rados.0.smithi134.stdout:27: finishing write tid 1 to smithi13430248-27 2024-04-18T14:43:32.783 INFO:tasks.rados.rados.0.smithi134.stdout:17: done (15 left) 2024-04-18T14:43:32.783 INFO:tasks.rados.rados.0.smithi134.stdout:19: done (14 left) 2024-04-18T14:43:32.783 INFO:tasks.rados.rados.0.smithi134.stdout:36: write initial oid 36 2024-04-18T14:43:32.783 INFO:tasks.rados.rados.0.smithi134.stdout:36: seq_num 35 ranges {0=589824} 2024-04-18T14:43:32.785 INFO:tasks.rados.rados.0.smithi134.stdout:36: writing smithi13430248-36 from 0 to 589824 tid 1 2024-04-18T14:43:32.785 INFO:tasks.rados.rados.0.smithi134.stdout:37: write initial oid 37 2024-04-18T14:43:32.785 INFO:tasks.rados.rados.0.smithi134.stdout:37: seq_num 36 ranges {0=606208} 2024-04-18T14:43:32.789 INFO:tasks.rados.rados.0.smithi134.stdout:37: writing smithi13430248-37 from 0 to 606208 tid 1 2024-04-18T14:43:32.789 INFO:tasks.rados.rados.0.smithi134.stdout: waiting on 16 2024-04-18T14:43:32.789 INFO:tasks.rados.rados.0.smithi134.stdout:27: finishing write tid 2 to smithi13430248-27 2024-04-18T14:43:32.789 INFO:tasks.rados.rados.0.smithi134.stdout:24: finishing write tid 1 to smithi13430248-24 2024-04-18T14:43:32.789 INFO:tasks.rados.rados.0.smithi134.stdout:28: finishing write tid 1 to smithi13430248-28 2024-04-18T14:43:32.789 INFO:tasks.rados.rados.0.smithi134.stdout:24: finishing write tid 2 to smithi13430248-24 2024-04-18T14:43:32.789 INFO:tasks.rados.rados.0.smithi134.stdout:26: finishing write tid 1 to smithi13430248-26 2024-04-18T14:43:32.790 INFO:tasks.rados.rados.0.smithi134.stdout:26: finishing write tid 2 to smithi13430248-26 2024-04-18T14:43:32.790 INFO:tasks.rados.rados.0.smithi134.stdout:25: finishing write tid 3 to smithi13430248-25 2024-04-18T14:43:32.790 INFO:tasks.rados.rados.0.smithi134.stdout:25: oid 25 updating version 0 to 8 2024-04-18T14:43:32.790 INFO:tasks.rados.rados.0.smithi134.stdout:25: oid 25 version 8 is already newer than 7 2024-04-18T14:43:32.790 INFO:tasks.rados.rados.0.smithi134.stdout:update_object_version oid 25 v 8 (ObjNum 24 snap 0 seq_num 24) dirty exists 2024-04-18T14:43:32.790 INFO:tasks.rados.rados.0.smithi134.stdout:25: left oid 25 (ObjNum 24 snap 0 seq_num 24) 2024-04-18T14:43:32.790 INFO:tasks.rados.rados.0.smithi134.stdout:28: finishing write tid 2 to smithi13430248-28 2024-04-18T14:43:32.790 INFO:tasks.rados.rados.0.smithi134.stdout:28: finishing write tid 3 to smithi13430248-28 2024-04-18T14:43:32.790 INFO:tasks.rados.rados.0.smithi134.stdout:28: oid 28 updating version 0 to 6 2024-04-18T14:43:32.790 INFO:tasks.rados.rados.0.smithi134.stdout:28: oid 28 version 6 is already newer than 5 2024-04-18T14:43:32.790 INFO:tasks.rados.rados.0.smithi134.stdout:update_object_version oid 28 v 6 (ObjNum 27 snap 0 seq_num 27) dirty exists 2024-04-18T14:43:32.790 INFO:tasks.rados.rados.0.smithi134.stdout:28: left oid 28 (ObjNum 27 snap 0 seq_num 27) 2024-04-18T14:43:32.790 INFO:tasks.rados.rados.0.smithi134.stdout:27: finishing write tid 3 to smithi13430248-27 2024-04-18T14:43:32.790 INFO:tasks.rados.rados.0.smithi134.stdout:27: oid 27 updating version 0 to 10 2024-04-18T14:43:32.791 INFO:tasks.rados.rados.0.smithi134.stdout:27: oid 27 version 10 is already newer than 9 2024-04-18T14:43:32.791 INFO:tasks.rados.rados.0.smithi134.stdout:update_object_version oid 27 v 10 (ObjNum 26 snap 0 seq_num 26) dirty exists 2024-04-18T14:43:32.791 INFO:tasks.rados.rados.0.smithi134.stdout:27: left oid 27 (ObjNum 26 snap 0 seq_num 26) 2024-04-18T14:43:32.791 INFO:tasks.rados.rados.0.smithi134.stdout:26: finishing write tid 3 to smithi13430248-26 2024-04-18T14:43:32.791 INFO:tasks.rados.rados.0.smithi134.stdout:26: oid 26 updating version 0 to 2 2024-04-18T14:43:32.791 INFO:tasks.rados.rados.0.smithi134.stdout:26: oid 26 version 2 is already newer than 1 2024-04-18T14:43:32.791 INFO:tasks.rados.rados.0.smithi134.stdout:update_object_version oid 26 v 2 (ObjNum 25 snap 0 seq_num 25) dirty exists 2024-04-18T14:43:32.791 INFO:tasks.rados.rados.0.smithi134.stdout:26: left oid 26 (ObjNum 25 snap 0 seq_num 25) 2024-04-18T14:43:32.791 INFO:tasks.rados.rados.0.smithi134.stdout:24: finishing write tid 3 to smithi13430248-24 2024-04-18T14:43:32.791 INFO:tasks.rados.rados.0.smithi134.stdout:24: oid 24 updating version 0 to 6 2024-04-18T14:43:32.791 INFO:tasks.rados.rados.0.smithi134.stdout:24: oid 24 version 6 is already newer than 5 2024-04-18T14:43:32.791 INFO:tasks.rados.rados.0.smithi134.stdout:update_object_version oid 24 v 6 (ObjNum 23 snap 0 seq_num 23) dirty exists 2024-04-18T14:43:32.791 INFO:tasks.rados.rados.0.smithi134.stdout:24: left oid 24 (ObjNum 23 snap 0 seq_num 23) 2024-04-18T14:43:32.791 INFO:tasks.rados.rados.0.smithi134.stdout:29: finishing write tid 1 to smithi13430248-29 2024-04-18T14:43:32.792 INFO:tasks.rados.rados.0.smithi134.stdout:24: done (15 left) 2024-04-18T14:43:32.792 INFO:tasks.rados.rados.0.smithi134.stdout:25: done (14 left) 2024-04-18T14:43:32.792 INFO:tasks.rados.rados.0.smithi134.stdout:26: done (13 left) 2024-04-18T14:43:32.792 INFO:tasks.rados.rados.0.smithi134.stdout:27: done (12 left) 2024-04-18T14:43:32.792 INFO:tasks.rados.rados.0.smithi134.stdout:28: done (11 left) 2024-04-18T14:43:32.792 INFO:tasks.rados.rados.0.smithi134.stdout:38: write initial oid 38 2024-04-18T14:43:32.792 INFO:tasks.rados.rados.0.smithi134.stdout:38: seq_num 37 ranges {0=622592} 2024-04-18T14:43:32.793 INFO:tasks.rados.rados.0.smithi134.stdout:38: writing smithi13430248-38 from 0 to 622592 tid 1 2024-04-18T14:43:32.793 INFO:tasks.rados.rados.0.smithi134.stdout:39: write initial oid 39 2024-04-18T14:43:32.793 INFO:tasks.rados.rados.0.smithi134.stdout:39: seq_num 38 ranges {0=638976} 2024-04-18T14:43:32.797 INFO:tasks.rados.rados.0.smithi134.stdout:39: writing smithi13430248-39 from 0 to 638976 tid 1 2024-04-18T14:43:32.798 INFO:tasks.rados.rados.0.smithi134.stdout:40: write initial oid 40 2024-04-18T14:43:32.798 INFO:tasks.rados.rados.0.smithi134.stdout:40: seq_num 39 ranges {0=671744} 2024-04-18T14:43:32.798 INFO:tasks.ceph.osd.5.smithi096.stderr:2024-04-18T14:43:32.795+0000 7fc33f25b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 24889) UID: 0 2024-04-18T14:43:32.802 INFO:tasks.rados.rados.0.smithi134.stdout:40: writing smithi13430248-40 from 0 to 671744 tid 1 2024-04-18T14:43:32.802 INFO:tasks.rados.rados.0.smithi134.stdout:41: write initial oid 41 2024-04-18T14:43:32.802 INFO:tasks.rados.rados.0.smithi134.stdout:41: seq_num 40 ranges {0=688128} 2024-04-18T14:43:32.807 INFO:tasks.rados.rados.0.smithi134.stdout:41: writing smithi13430248-41 from 0 to 688128 tid 1 2024-04-18T14:43:32.807 INFO:tasks.rados.rados.0.smithi134.stdout:42: write initial oid 42 2024-04-18T14:43:32.807 INFO:tasks.rados.rados.0.smithi134.stdout:42: seq_num 41 ranges {0=704512} 2024-04-18T14:43:32.812 INFO:tasks.rados.rados.0.smithi134.stdout:42: writing smithi13430248-42 from 0 to 704512 tid 1 2024-04-18T14:43:32.812 INFO:tasks.rados.rados.0.smithi134.stdout: waiting on 16 2024-04-18T14:43:32.812 INFO:tasks.rados.rados.0.smithi134.stdout:30: finishing write tid 1 to smithi13430248-30 2024-04-18T14:43:32.813 INFO:tasks.rados.rados.0.smithi134.stdout:30: finishing write tid 2 to smithi13430248-30 2024-04-18T14:43:32.813 INFO:tasks.rados.rados.0.smithi134.stdout:29: finishing write tid 2 to smithi13430248-29 2024-04-18T14:43:32.813 INFO:tasks.rados.rados.0.smithi134.stdout:31: finishing write tid 1 to smithi13430248-31 2024-04-18T14:43:32.813 INFO:tasks.rados.rados.0.smithi134.stdout:31: finishing write tid 2 to smithi13430248-31 2024-04-18T14:43:32.813 INFO:tasks.rados.rados.0.smithi134.stdout:29: finishing write tid 3 to smithi13430248-29 2024-04-18T14:43:32.813 INFO:tasks.rados.rados.0.smithi134.stdout:29: oid 29 updating version 0 to 4 2024-04-18T14:43:32.813 INFO:tasks.rados.rados.0.smithi134.stdout:29: oid 29 version 4 is already newer than 3 2024-04-18T14:43:32.813 INFO:tasks.rados.rados.0.smithi134.stdout:update_object_version oid 29 v 4 (ObjNum 28 snap 0 seq_num 28) dirty exists 2024-04-18T14:43:32.813 INFO:tasks.rados.rados.0.smithi134.stdout:29: left oid 29 (ObjNum 28 snap 0 seq_num 28) 2024-04-18T14:43:32.813 INFO:tasks.rados.rados.0.smithi134.stdout:30: finishing write tid 3 to smithi13430248-30 2024-04-18T14:43:32.813 INFO:tasks.rados.rados.0.smithi134.stdout:30: oid 30 updating version 0 to 6 2024-04-18T14:43:32.813 INFO:tasks.rados.rados.0.smithi134.stdout:30: oid 30 version 6 is already newer than 5 2024-04-18T14:43:32.813 INFO:tasks.rados.rados.0.smithi134.stdout:update_object_version oid 30 v 6 (ObjNum 29 snap 0 seq_num 29) dirty exists 2024-04-18T14:43:32.813 INFO:tasks.rados.rados.0.smithi134.stdout:30: left oid 30 (ObjNum 29 snap 0 seq_num 29) 2024-04-18T14:43:32.814 INFO:tasks.rados.rados.0.smithi134.stdout:31: finishing write tid 3 to smithi13430248-31 2024-04-18T14:43:32.814 INFO:tasks.rados.rados.0.smithi134.stdout:31: oid 31 updating version 0 to 1 2024-04-18T14:43:32.814 INFO:tasks.rados.rados.0.smithi134.stdout:31: oid 31 updating version 1 to 2 2024-04-18T14:43:32.814 INFO:tasks.rados.rados.0.smithi134.stdout:update_object_version oid 31 v 2 (ObjNum 30 snap 0 seq_num 30) dirty exists 2024-04-18T14:43:32.814 INFO:tasks.rados.rados.0.smithi134.stdout:31: left oid 31 (ObjNum 30 snap 0 seq_num 30) 2024-04-18T14:43:32.814 INFO:tasks.rados.rados.0.smithi134.stdout:33: finishing write tid 1 to smithi13430248-33 2024-04-18T14:43:32.814 INFO:tasks.rados.rados.0.smithi134.stdout:33: finishing write tid 2 to smithi13430248-33 2024-04-18T14:43:32.814 INFO:tasks.rados.rados.0.smithi134.stdout:33: finishing write tid 3 to smithi13430248-33 2024-04-18T14:43:32.814 INFO:tasks.rados.rados.0.smithi134.stdout:33: oid 33 updating version 0 to 10 2024-04-18T14:43:32.814 INFO:tasks.rados.rados.0.smithi134.stdout:33: oid 33 version 10 is already newer than 9 2024-04-18T14:43:32.814 INFO:tasks.rados.rados.0.smithi134.stdout:update_object_version oid 33 v 10 (ObjNum 32 snap 0 seq_num 32) dirty exists 2024-04-18T14:43:32.814 INFO:tasks.rados.rados.0.smithi134.stdout:33: left oid 33 (ObjNum 32 snap 0 seq_num 32) 2024-04-18T14:43:32.814 INFO:tasks.rados.rados.0.smithi134.stdout:37: finishing write tid 1 to smithi13430248-37 2024-04-18T14:43:32.814 INFO:tasks.rados.rados.0.smithi134.stdout:37: finishing write tid 2 to smithi13430248-37 2024-04-18T14:43:32.814 INFO:tasks.rados.rados.0.smithi134.stdout:37: finishing write tid 3 to smithi13430248-37 2024-04-18T14:43:32.814 INFO:tasks.rados.rados.0.smithi134.stdout:37: oid 37 updating version 0 to 5 2024-04-18T14:43:32.815 INFO:tasks.rados.rados.0.smithi134.stdout:37: oid 37 updating version 5 to 6 2024-04-18T14:43:32.815 INFO:tasks.rados.rados.0.smithi134.stdout:update_object_version oid 37 v 6 (ObjNum 36 snap 0 seq_num 36) dirty exists 2024-04-18T14:43:32.815 INFO:tasks.rados.rados.0.smithi134.stdout:37: left oid 37 (ObjNum 36 snap 0 seq_num 36) 2024-04-18T14:43:32.815 INFO:tasks.rados.rados.0.smithi134.stdout:38: finishing write tid 1 to smithi13430248-38 2024-04-18T14:43:32.815 INFO:tasks.rados.rados.0.smithi134.stdout:29: done (15 left) 2024-04-18T14:43:32.815 INFO:tasks.rados.rados.0.smithi134.stdout:30: done (14 left) 2024-04-18T14:43:32.815 INFO:tasks.rados.rados.0.smithi134.stdout:31: done (13 left) 2024-04-18T14:43:32.815 INFO:tasks.rados.rados.0.smithi134.stdout:33: done (12 left) 2024-04-18T14:43:32.815 INFO:tasks.rados.rados.0.smithi134.stdout:37: done (11 left) 2024-04-18T14:43:32.815 INFO:tasks.rados.rados.0.smithi134.stdout:43: write initial oid 43 2024-04-18T14:43:32.815 INFO:tasks.rados.rados.0.smithi134.stdout:43: seq_num 42 ranges {0=720896} 2024-04-18T14:43:32.816 INFO:tasks.rados.rados.0.smithi134.stdout:43: writing smithi13430248-43 from 0 to 720896 tid 1 2024-04-18T14:43:32.816 INFO:tasks.rados.rados.0.smithi134.stdout:44: write initial oid 44 2024-04-18T14:43:32.816 INFO:tasks.rados.rados.0.smithi134.stdout:44: seq_num 43 ranges {0=737280} 2024-04-18T14:43:32.822 INFO:tasks.rados.rados.0.smithi134.stdout:44: writing smithi13430248-44 from 0 to 737280 tid 1 2024-04-18T14:43:32.822 INFO:tasks.rados.rados.0.smithi134.stdout:45: write initial oid 45 2024-04-18T14:43:32.822 INFO:tasks.rados.rados.0.smithi134.stdout:45: seq_num 44 ranges {0=753664} 2024-04-18T14:43:32.826 INFO:tasks.rados.rados.0.smithi134.stdout:45: writing smithi13430248-45 from 0 to 753664 tid 1 2024-04-18T14:43:32.826 INFO:tasks.rados.rados.0.smithi134.stdout:46: write initial oid 46 2024-04-18T14:43:32.826 INFO:tasks.rados.rados.0.smithi134.stdout:46: seq_num 45 ranges {0=770048} 2024-04-18T14:43:32.831 INFO:tasks.rados.rados.0.smithi134.stdout:46: writing smithi13430248-46 from 0 to 770048 tid 1 2024-04-18T14:43:32.831 INFO:tasks.rados.rados.0.smithi134.stdout:47: write initial oid 47 2024-04-18T14:43:32.831 INFO:tasks.rados.rados.0.smithi134.stdout:47: seq_num 46 ranges {0=786432} 2024-04-18T14:43:32.835 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-04-18T14:43:32.835 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T14:43:32.836 INFO:tasks.rados.rados.0.smithi134.stdout:47: writing smithi13430248-47 from 0 to 786432 tid 1 2024-04-18T14:43:32.836 INFO:tasks.rados.rados.0.smithi134.stdout: waiting on 16 2024-04-18T14:43:32.837 INFO:tasks.rados.rados.0.smithi134.stdout:38: finishing write tid 2 to smithi13430248-38 2024-04-18T14:43:32.837 INFO:tasks.rados.rados.0.smithi134.stdout:38: finishing write tid 3 to smithi13430248-38 2024-04-18T14:43:32.837 INFO:tasks.rados.rados.0.smithi134.stdout:38: oid 38 updating version 0 to 12 2024-04-18T14:43:32.837 INFO:tasks.rados.rados.0.smithi134.stdout:38: oid 38 version 12 is already newer than 11 2024-04-18T14:43:32.837 INFO:tasks.rados.rados.0.smithi134.stdout:update_object_version oid 38 v 12 (ObjNum 37 snap 0 seq_num 37) dirty exists 2024-04-18T14:43:32.837 INFO:tasks.rados.rados.0.smithi134.stdout:38: left oid 38 (ObjNum 37 snap 0 seq_num 37) 2024-04-18T14:43:32.837 INFO:tasks.rados.rados.0.smithi134.stdout:39: finishing write tid 1 to smithi13430248-39 2024-04-18T14:43:32.837 INFO:tasks.rados.rados.0.smithi134.stdout:39: finishing write tid 2 to smithi13430248-39 2024-04-18T14:43:32.837 INFO:tasks.rados.rados.0.smithi134.stdout:38: done (15 left) 2024-04-18T14:43:32.837 INFO:tasks.rados.rados.0.smithi134.stdout:48: write initial oid 48 2024-04-18T14:43:32.837 INFO:tasks.rados.rados.0.smithi134.stdout:48: seq_num 47 ranges {0=425984,425984=376832} 2024-04-18T14:43:32.838 INFO:tasks.rados.rados.0.smithi134.stdout:48: writing smithi13430248-48 from 0 to 425984 tid 1 2024-04-18T14:43:32.841 INFO:tasks.rados.rados.0.smithi134.stdout:48: writing smithi13430248-48 from 425984 to 802816 tid 2 2024-04-18T14:43:32.841 INFO:tasks.rados.rados.0.smithi134.stdout: waiting on 16 2024-04-18T14:43:32.841 INFO:tasks.rados.rados.0.smithi134.stdout:39: finishing write tid 3 to smithi13430248-39 2024-04-18T14:43:32.841 INFO:tasks.rados.rados.0.smithi134.stdout:39: oid 39 updating version 0 to 1 2024-04-18T14:43:32.841 INFO:tasks.rados.rados.0.smithi134.stdout:39: oid 39 updating version 1 to 2 2024-04-18T14:43:32.841 INFO:tasks.rados.rados.0.smithi134.stdout:update_object_version oid 39 v 2 (ObjNum 38 snap 0 seq_num 38) dirty exists 2024-04-18T14:43:32.841 INFO:tasks.rados.rados.0.smithi134.stdout:39: left oid 39 (ObjNum 38 snap 0 seq_num 38) 2024-04-18T14:43:32.841 INFO:tasks.rados.rados.0.smithi134.stdout:40: finishing write tid 1 to smithi13430248-40 2024-04-18T14:43:32.842 INFO:tasks.rados.rados.0.smithi134.stdout:39: done (15 left) 2024-04-18T14:43:32.842 INFO:tasks.rados.rados.0.smithi134.stdout:49: write initial oid 49 2024-04-18T14:43:32.842 INFO:tasks.rados.rados.0.smithi134.stdout:49: seq_num 48 ranges {0=442368,442368=376832} 2024-04-18T14:43:32.844 INFO:tasks.rados.rados.0.smithi134.stdout:49: writing smithi13430248-49 from 0 to 442368 tid 1 2024-04-18T14:43:32.847 INFO:tasks.rados.rados.0.smithi134.stdout:49: writing smithi13430248-49 from 442368 to 819200 tid 2 2024-04-18T14:43:32.847 INFO:tasks.rados.rados.0.smithi134.stdout: waiting on 16 2024-04-18T14:43:32.847 INFO:tasks.rados.rados.0.smithi134.stdout:40: finishing write tid 2 to smithi13430248-40 2024-04-18T14:43:32.847 INFO:tasks.rados.rados.0.smithi134.stdout:41: finishing write tid 1 to smithi13430248-41 2024-04-18T14:43:32.847 INFO:tasks.rados.rados.0.smithi134.stdout:40: finishing write tid 3 to smithi13430248-40 2024-04-18T14:43:32.847 INFO:tasks.rados.rados.0.smithi134.stdout:40: oid 40 updating version 0 to 5 2024-04-18T14:43:32.847 INFO:tasks.rados.rados.0.smithi134.stdout:40: oid 40 updating version 5 to 6 2024-04-18T14:43:32.847 INFO:tasks.rados.rados.0.smithi134.stdout:update_object_version oid 40 v 6 (ObjNum 39 snap 0 seq_num 39) dirty exists 2024-04-18T14:43:32.847 INFO:tasks.rados.rados.0.smithi134.stdout:40: left oid 40 (ObjNum 39 snap 0 seq_num 39) 2024-04-18T14:43:32.847 INFO:tasks.rados.rados.0.smithi134.stdout:41: finishing write tid 2 to smithi13430248-41 2024-04-18T14:43:32.847 INFO:tasks.rados.rados.0.smithi134.stdout:42: finishing write tid 1 to smithi13430248-42 2024-04-18T14:43:32.847 INFO:tasks.rados.rados.0.smithi134.stdout:41: finishing write tid 3 to smithi13430248-41 2024-04-18T14:43:32.848 INFO:tasks.rados.rados.0.smithi134.stdout:41: oid 41 updating version 0 to 7 2024-04-18T14:43:32.848 INFO:tasks.rados.rados.0.smithi134.stdout:41: oid 41 updating version 7 to 8 2024-04-18T14:43:32.848 INFO:tasks.rados.rados.0.smithi134.stdout:update_object_version oid 41 v 8 (ObjNum 40 snap 0 seq_num 40) dirty exists 2024-04-18T14:43:32.848 INFO:tasks.rados.rados.0.smithi134.stdout:41: left oid 41 (ObjNum 40 snap 0 seq_num 40) 2024-04-18T14:43:32.848 INFO:tasks.rados.rados.0.smithi134.stdout:42: finishing write tid 2 to smithi13430248-42 2024-04-18T14:43:32.848 INFO:tasks.rados.rados.0.smithi134.stdout:43: finishing write tid 1 to smithi13430248-43 2024-04-18T14:43:32.848 INFO:tasks.rados.rados.0.smithi134.stdout:43: finishing write tid 2 to smithi13430248-43 2024-04-18T14:43:32.848 INFO:tasks.rados.rados.0.smithi134.stdout:40: done (15 left) 2024-04-18T14:43:32.848 INFO:tasks.rados.rados.0.smithi134.stdout:41: done (14 left) 2024-04-18T14:43:32.848 INFO:tasks.rados.rados.0.smithi134.stdout:50: write initial oid 50 2024-04-18T14:43:32.848 INFO:tasks.rados.rados.0.smithi134.stdout:50: seq_num 49 ranges {0=458752,458752=376832} 2024-04-18T14:43:32.849 INFO:tasks.rados.rados.0.smithi134.stdout:50: writing smithi13430248-50 from 0 to 458752 tid 1 2024-04-18T14:43:32.852 INFO:tasks.rados.rados.0.smithi134.stdout:50: writing smithi13430248-50 from 458752 to 835584 tid 2 2024-04-18T14:43:32.853 INFO:tasks.rados.rados.0.smithi134.stdout:51: copy_from oid 26 from oid 40 current snap is 0 2024-04-18T14:43:32.853 INFO:tasks.rados.rados.0.smithi134.stdout:42: finishing write tid 3 to smithi13430248-42 2024-04-18T14:43:32.853 INFO:tasks.rados.rados.0.smithi134.stdout:42: oid 42 updating version 0 to 5 2024-04-18T14:43:32.853 INFO:tasks.rados.rados.0.smithi134.stdout:42: oid 42 updating version 5 to 6 2024-04-18T14:43:32.853 INFO:tasks.rados.rados.0.smithi134.stdout:update_object_version oid 42 v 6 (ObjNum 41 snap 0 seq_num 41) dirty exists 2024-04-18T14:43:32.853 INFO:tasks.rados.rados.0.smithi134.stdout:42: left oid 42 (ObjNum 41 snap 0 seq_num 41) 2024-04-18T14:43:32.853 INFO:tasks.rados.rados.0.smithi134.stdout:43: finishing write tid 3 to smithi13430248-43 2024-04-18T14:43:32.853 INFO:tasks.rados.rados.0.smithi134.stdout:43: oid 43 updating version 0 to 12 2024-04-18T14:43:32.853 INFO:tasks.rados.rados.0.smithi134.stdout:43: oid 43 version 12 is already newer than 11 2024-04-18T14:43:32.853 INFO:tasks.rados.rados.0.smithi134.stdout:update_object_version oid 43 v 12 (ObjNum 42 snap 0 seq_num 42) dirty exists 2024-04-18T14:43:32.853 INFO:tasks.rados.rados.0.smithi134.stdout:43: left oid 43 (ObjNum 42 snap 0 seq_num 42) 2024-04-18T14:43:32.853 INFO:tasks.rados.rados.0.smithi134.stdout:44: finishing write tid 1 to smithi13430248-44 2024-04-18T14:43:32.853 INFO:tasks.rados.rados.0.smithi134.stdout:44: finishing write tid 2 to smithi13430248-44 2024-04-18T14:43:32.853 INFO:tasks.rados.rados.0.smithi134.stdout:45: finishing write tid 1 to smithi13430248-45 2024-04-18T14:43:32.853 INFO:tasks.rados.rados.0.smithi134.stdout:44: finishing write tid 3 to smithi13430248-44 2024-04-18T14:43:32.854 INFO:tasks.rados.rados.0.smithi134.stdout:44: oid 44 updating version 0 to 3 2024-04-18T14:43:32.854 INFO:tasks.rados.rados.0.smithi134.stdout:44: oid 44 updating version 3 to 4 2024-04-18T14:43:32.854 INFO:tasks.rados.rados.0.smithi134.stdout:update_object_version oid 44 v 4 (ObjNum 43 snap 0 seq_num 43) dirty exists 2024-04-18T14:43:32.854 INFO:tasks.rados.rados.0.smithi134.stdout:44: left oid 44 (ObjNum 43 snap 0 seq_num 43) 2024-04-18T14:43:32.854 INFO:tasks.rados.rados.0.smithi134.stdout:45: finishing write tid 2 to smithi13430248-45 2024-04-18T14:43:32.854 INFO:tasks.rados.rados.0.smithi134.stdout:46: finishing write tid 1 to smithi13430248-46 2024-04-18T14:43:32.854 INFO:tasks.rados.rados.0.smithi134.stdout:46: finishing write tid 2 to smithi13430248-46 2024-04-18T14:43:32.854 INFO:tasks.rados.rados.0.smithi134.stdout:45: finishing write tid 3 to smithi13430248-45 2024-04-18T14:43:32.854 INFO:tasks.rados.rados.0.smithi134.stdout:45: oid 45 updating version 0 to 7 2024-04-18T14:43:32.854 INFO:tasks.rados.rados.0.smithi134.stdout:45: oid 45 updating version 7 to 8 2024-04-18T14:43:32.854 INFO:tasks.rados.rados.0.smithi134.stdout:update_object_version oid 45 v 8 (ObjNum 44 snap 0 seq_num 44) dirty exists 2024-04-18T14:43:32.854 INFO:tasks.rados.rados.0.smithi134.stdout:45: left oid 45 (ObjNum 44 snap 0 seq_num 44) 2024-04-18T14:43:32.854 INFO:tasks.rados.rados.0.smithi134.stdout:46: finishing write tid 3 to smithi13430248-46 2024-04-18T14:43:32.854 INFO:tasks.rados.rados.0.smithi134.stdout:46: oid 46 updating version 0 to 7 2024-04-18T14:43:32.854 INFO:tasks.rados.rados.0.smithi134.stdout:46: oid 46 updating version 7 to 8 2024-04-18T14:43:32.855 INFO:tasks.rados.rados.0.smithi134.stdout:update_object_version oid 46 v 8 (ObjNum 45 snap 0 seq_num 45) dirty exists 2024-04-18T14:43:32.855 INFO:tasks.rados.rados.0.smithi134.stdout:46: left oid 46 (ObjNum 45 snap 0 seq_num 45) 2024-04-18T14:43:32.855 INFO:tasks.rados.rados.0.smithi134.stdout:42: done (15 left) 2024-04-18T14:43:32.855 INFO:tasks.rados.rados.0.smithi134.stdout:43: done (14 left) 2024-04-18T14:43:32.855 INFO:tasks.rados.rados.0.smithi134.stdout:44: done (13 left) 2024-04-18T14:43:32.855 INFO:tasks.rados.rados.0.smithi134.stdout:45: done (12 left) 2024-04-18T14:43:32.855 INFO:tasks.rados.rados.0.smithi134.stdout:46: done (11 left) 2024-04-18T14:43:32.855 INFO:tasks.rados.rados.0.smithi134.stdout:52: rollback oid 13 current snap is 0 2024-04-18T14:43:32.855 INFO:tasks.rados.rados.0.smithi134.stdout:52: done (11 left) 2024-04-18T14:43:32.855 INFO:tasks.rados.rados.0.smithi134.stdout:53: setattr oid 6 current snap is 0 2024-04-18T14:43:32.855 INFO:tasks.rados.rados.0.smithi134.stdout:48: finishing write tid 1 to smithi13430248-48 2024-04-18T14:43:32.856 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.11.asok dump_blocked_ops 2024-04-18T14:43:32.858 INFO:tasks.rados.rados.0.smithi134.stdout:48: finishing write tid 2 to smithi13430248-48 2024-04-18T14:43:32.858 INFO:tasks.rados.rados.0.smithi134.stdout:49: finishing write tid 1 to smithi13430248-49 2024-04-18T14:43:32.858 INFO:tasks.rados.rados.0.smithi134.stdout:48: finishing write tid 3 to smithi13430248-48 2024-04-18T14:43:32.858 INFO:tasks.rados.rados.0.smithi134.stdout:54: read oid 25 snap -1 2024-04-18T14:43:32.859 INFO:tasks.rados.rados.0.smithi134.stdout:54: expect (ObjNum 24 snap 0 seq_num 24) 2024-04-18T14:43:32.859 INFO:tasks.rados.rados.0.smithi134.stdout:55: setattr oid 1 current snap is 0 2024-04-18T14:43:32.859 INFO:tasks.rados.rados.0.smithi134.stdout:56: read oid 28 snap -1 2024-04-18T14:43:32.859 INFO:tasks.rados.rados.0.smithi134.stdout:56: expect (ObjNum 27 snap 0 seq_num 27) 2024-04-18T14:43:32.859 INFO:tasks.rados.rados.0.smithi134.stdout:57: copy_from oid 17 from oid 38 current snap is 0 2024-04-18T14:43:32.859 INFO:tasks.rados.rados.0.smithi134.stdout: waiting on 16 2024-04-18T14:43:32.859 INFO:tasks.rados.rados.0.smithi134.stdout:49: finishing write tid 2 to smithi13430248-49 2024-04-18T14:43:32.859 INFO:tasks.rados.rados.0.smithi134.stdout:49: finishing write tid 3 to smithi13430248-49 2024-04-18T14:43:32.859 INFO:tasks.rados.rados.0.smithi134.stdout:48: finishing write tid 4 to smithi13430248-48 2024-04-18T14:43:32.859 INFO:tasks.rados.rados.0.smithi134.stdout:48: oid 48 updating version 0 to 5 2024-04-18T14:43:32.859 INFO:tasks.rados.rados.0.smithi134.stdout:48: oid 48 version 5 is already newer than 3 2024-04-18T14:43:32.859 INFO:tasks.rados.rados.0.smithi134.stdout:48: oid 48 version 5 is already newer than 4 2024-04-18T14:43:32.859 INFO:tasks.rados.rados.0.smithi134.stdout:update_object_version oid 48 v 5 (ObjNum 47 snap 0 seq_num 47) dirty exists 2024-04-18T14:43:32.859 INFO:tasks.rados.rados.0.smithi134.stdout:48: left oid 48 (ObjNum 47 snap 0 seq_num 47) 2024-04-18T14:43:32.859 INFO:tasks.rados.rados.0.smithi134.stdout:48: done (15 left) 2024-04-18T14:43:32.859 INFO:tasks.rados.rados.0.smithi134.stdout:58: copy_from oid 9 from oid 30 current snap is 0 2024-04-18T14:43:32.860 INFO:tasks.rados.rados.0.smithi134.stdout: waiting on 16 2024-04-18T14:43:32.861 INFO:tasks.rados.rados.0.smithi134.stdout:49: finishing write tid 4 to smithi13430248-49 2024-04-18T14:43:32.861 INFO:tasks.rados.rados.0.smithi134.stdout:49: oid 49 updating version 0 to 9 2024-04-18T14:43:32.861 INFO:tasks.rados.rados.0.smithi134.stdout:49: oid 49 version 9 is already newer than 7 2024-04-18T14:43:32.861 INFO:tasks.rados.rados.0.smithi134.stdout:49: oid 49 version 9 is already newer than 8 2024-04-18T14:43:32.861 INFO:tasks.rados.rados.0.smithi134.stdout:update_object_version oid 49 v 9 (ObjNum 48 snap 0 seq_num 48) dirty exists 2024-04-18T14:43:32.861 INFO:tasks.rados.rados.0.smithi134.stdout:49: left oid 49 (ObjNum 48 snap 0 seq_num 48) 2024-04-18T14:43:32.861 INFO:tasks.rados.rados.0.smithi134.stdout:49: done (15 left) 2024-04-18T14:43:32.861 INFO:tasks.rados.rados.0.smithi134.stdout:59: snap_create 2024-04-18T14:43:32.861 INFO:tasks.rados.rados.0.smithi134.stdout:54: expect (ObjNum 24 snap 0 seq_num 24) 2024-04-18T14:43:32.870 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 reset_purged_snaps_last 2024-04-18T14:43:32.875 INFO:tasks.rados.rados.0.smithi134.stdout:update_object_version oid 6 v 7 (ObjNum 5 snap 0 seq_num 5) dirty exists 2024-04-18T14:43:32.875 INFO:tasks.rados.rados.0.smithi134.stdout:update_object_version oid 1 v 9 (ObjNum 0 snap 0 seq_num 0) dirty exists 2024-04-18T14:43:32.875 INFO:tasks.rados.rados.0.smithi134.stdout:57: finishing copy_from racing read to smithi13430248-17 2024-04-18T14:43:32.875 INFO:tasks.rados.rados.0.smithi134.stdout:51: finishing copy_from racing read to smithi13430248-26 2024-04-18T14:43:32.876 INFO:tasks.rados.rados.0.smithi134.stdout:56: expect (ObjNum 27 snap 0 seq_num 27) 2024-04-18T14:43:32.888 INFO:tasks.rados.rados.0.smithi134.stdout:58: finishing copy_from racing read to smithi13430248-9 2024-04-18T14:43:32.888 INFO:tasks.rados.rados.0.smithi134.stdout:57: finishing copy_from to smithi13430248-17 2024-04-18T14:43:32.889 INFO:tasks.rados.rados.0.smithi134.stdout:update_object_version oid 17 v 12 (ObjNum 37 snap 0 seq_num 37) dirty exists 2024-04-18T14:43:32.889 INFO:tasks.rados.rados.0.smithi134.stdout:51: finishing copy_from to smithi13430248-26 2024-04-18T14:43:32.889 INFO:tasks.rados.rados.0.smithi134.stdout:update_object_version oid 26 v 6 (ObjNum 39 snap 0 seq_num 39) dirty exists 2024-04-18T14:43:32.889 INFO:tasks.rados.rados.0.smithi134.stdout:58: finishing copy_from to smithi13430248-9 2024-04-18T14:43:32.889 INFO:tasks.rados.rados.0.smithi134.stdout:update_object_version oid 9 v 6 (ObjNum 29 snap 0 seq_num 29) dirty exists 2024-04-18T14:43:32.908 INFO:tasks.rados.rados.0.smithi134.stdout:8: finishing write tid 1 to smithi13430248-8 2024-04-18T14:43:32.908 INFO:tasks.rados.rados.0.smithi134.stdout:8: finishing write tid 2 to smithi13430248-8 2024-04-18T14:43:32.910 INFO:tasks.rados.rados.0.smithi134.stdout:23: finishing write tid 1 to smithi13430248-23 2024-04-18T14:43:32.911 INFO:tasks.rados.rados.0.smithi134.stdout:23: finishing write tid 2 to smithi13430248-23 2024-04-18T14:43:32.912 INFO:tasks.rados.rados.0.smithi134.stdout:8: finishing write tid 3 to smithi13430248-8 2024-04-18T14:43:32.912 INFO:tasks.rados.rados.0.smithi134.stdout:8: oid 8 updating version 0 to 1 2024-04-18T14:43:32.912 INFO:tasks.rados.rados.0.smithi134.stdout:8: oid 8 updating version 1 to 2 2024-04-18T14:43:32.912 INFO:tasks.rados.rados.0.smithi134.stdout:update_object_version oid 8 v 2 (ObjNum 7 snap 0 seq_num 7) dirty exists 2024-04-18T14:43:32.912 INFO:tasks.rados.rados.0.smithi134.stdout:8: left oid 8 (ObjNum 7 snap 0 seq_num 7) 2024-04-18T14:43:32.914 INFO:tasks.ceph.osd.4.smithi086.stderr:2024-04-18T14:43:32.915+0000 7f0c4c462640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 24956) UID: 0 2024-04-18T14:43:32.914 INFO:tasks.rados.rados.0.smithi134.stdout:23: finishing write tid 3 to smithi13430248-23 2024-04-18T14:43:32.914 INFO:tasks.rados.rados.0.smithi134.stdout:23: oid 23 updating version 0 to 3 2024-04-18T14:43:32.914 INFO:tasks.rados.rados.0.smithi134.stdout:23: oid 23 updating version 3 to 4 2024-04-18T14:43:32.915 INFO:tasks.rados.rados.0.smithi134.stdout:update_object_version oid 23 v 4 (ObjNum 22 snap 0 seq_num 22) dirty exists 2024-04-18T14:43:32.915 INFO:tasks.rados.rados.0.smithi134.stdout:23: left oid 23 (ObjNum 22 snap 0 seq_num 22) 2024-04-18T14:43:32.924 INFO:tasks.rados.rados.0.smithi134.stdout:32: finishing write tid 1 to smithi13430248-32 2024-04-18T14:43:32.924 INFO:tasks.rados.rados.0.smithi134.stdout:32: finishing write tid 2 to smithi13430248-32 2024-04-18T14:43:32.927 INFO:tasks.rados.rados.0.smithi134.stdout:35: finishing write tid 1 to smithi13430248-35 2024-04-18T14:43:32.927 INFO:tasks.rados.rados.0.smithi134.stdout:35: finishing write tid 2 to smithi13430248-35 2024-04-18T14:43:32.929 INFO:tasks.rados.rados.0.smithi134.stdout:32: finishing write tid 3 to smithi13430248-32 2024-04-18T14:43:32.929 INFO:tasks.rados.rados.0.smithi134.stdout:32: oid 32 updating version 0 to 5 2024-04-18T14:43:32.929 INFO:tasks.rados.rados.0.smithi134.stdout:32: oid 32 updating version 5 to 6 2024-04-18T14:43:32.929 INFO:tasks.rados.rados.0.smithi134.stdout:update_object_version oid 32 v 6 (ObjNum 31 snap 0 seq_num 31) dirty exists 2024-04-18T14:43:32.929 INFO:tasks.rados.rados.0.smithi134.stdout:32: left oid 32 (ObjNum 31 snap 0 seq_num 31) 2024-04-18T14:43:32.931 INFO:tasks.rados.rados.0.smithi134.stdout:35: finishing write tid 3 to smithi13430248-35 2024-04-18T14:43:32.931 INFO:tasks.rados.rados.0.smithi134.stdout:35: oid 35 updating version 0 to 8 2024-04-18T14:43:32.931 INFO:tasks.rados.rados.0.smithi134.stdout:35: oid 35 version 8 is already newer than 7 2024-04-18T14:43:32.931 INFO:tasks.rados.rados.0.smithi134.stdout:update_object_version oid 35 v 8 (ObjNum 34 snap 0 seq_num 34) dirty exists 2024-04-18T14:43:32.931 INFO:tasks.rados.rados.0.smithi134.stdout:35: left oid 35 (ObjNum 34 snap 0 seq_num 34) 2024-04-18T14:43:32.975 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-04-18T14:43:32.975 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T14:43:32.989 INFO:tasks.rados.rados.0.smithi134.stdout:34: finishing write tid 1 to smithi13430248-34 2024-04-18T14:43:32.991 INFO:tasks.rados.rados.0.smithi134.stdout:34: finishing write tid 2 to smithi13430248-34 2024-04-18T14:43:32.992 INFO:tasks.rados.rados.0.smithi134.stdout:50: finishing write tid 1 to smithi13430248-50 2024-04-18T14:43:32.993 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.11.asok dump_historic_ops 2024-04-18T14:43:32.994 INFO:tasks.rados.rados.0.smithi134.stdout:50: finishing write tid 2 to smithi13430248-50 2024-04-18T14:43:32.994 INFO:tasks.rados.rados.0.smithi134.stdout:50: finishing write tid 3 to smithi13430248-50 2024-04-18T14:43:32.995 INFO:tasks.rados.rados.0.smithi134.stdout:34: finishing write tid 3 to smithi13430248-34 2024-04-18T14:43:32.995 INFO:tasks.rados.rados.0.smithi134.stdout:34: oid 34 updating version 0 to 2 2024-04-18T14:43:32.995 INFO:tasks.rados.rados.0.smithi134.stdout:34: oid 34 version 2 is already newer than 1 2024-04-18T14:43:32.995 INFO:tasks.rados.rados.0.smithi134.stdout:update_object_version oid 34 v 2 (ObjNum 33 snap 0 seq_num 33) dirty exists 2024-04-18T14:43:32.995 INFO:tasks.rados.rados.0.smithi134.stdout:34: left oid 34 (ObjNum 33 snap 0 seq_num 33) 2024-04-18T14:43:32.995 INFO:tasks.rados.rados.0.smithi134.stdout:50: finishing write tid 4 to smithi13430248-50 2024-04-18T14:43:32.996 INFO:tasks.rados.rados.0.smithi134.stdout:50: oid 50 updating version 0 to 5 2024-04-18T14:43:32.996 INFO:tasks.rados.rados.0.smithi134.stdout:50: oid 50 version 5 is already newer than 3 2024-04-18T14:43:32.996 INFO:tasks.rados.rados.0.smithi134.stdout:50: oid 50 version 5 is already newer than 4 2024-04-18T14:43:32.996 INFO:tasks.rados.rados.0.smithi134.stdout:update_object_version oid 50 v 5 (ObjNum 49 snap 0 seq_num 49) dirty exists 2024-04-18T14:43:32.996 INFO:tasks.rados.rados.0.smithi134.stdout:50: left oid 50 (ObjNum 49 snap 0 seq_num 49) 2024-04-18T14:43:32.998 INFO:tasks.ceph.osd.0.smithi086.stderr:2024-04-18T14:43:32.999+0000 7f7cdfd78640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 24953) UID: 0 2024-04-18T14:43:33.075 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 reset_purged_snaps_last 2024-04-18T14:43:33.100 INFO:tasks.ceph.osd.14.smithi119.stderr:2024-04-18T14:43:33.098+0000 7f180f599640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 14 (PID: 24900) UID: 0 2024-04-18T14:43:33.116 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-04-18T14:43:33.117 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T14:43:33.131 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.15.asok dump_ops_in_flight 2024-04-18T14:43:33.144 INFO:tasks.rados.rados.0.smithi134.stdout:36: finishing write tid 1 to smithi13430248-36 2024-04-18T14:43:33.144 INFO:tasks.rados.rados.0.smithi134.stdout:36: finishing write tid 2 to smithi13430248-36 2024-04-18T14:43:33.145 INFO:tasks.rados.rados.0.smithi134.stdout:47: finishing write tid 1 to smithi13430248-47 2024-04-18T14:43:33.147 INFO:tasks.rados.rados.0.smithi134.stdout:36: finishing write tid 3 to smithi13430248-36 2024-04-18T14:43:33.147 INFO:tasks.rados.rados.0.smithi134.stdout:36: oid 36 updating version 0 to 9 2024-04-18T14:43:33.147 INFO:tasks.rados.rados.0.smithi134.stdout:36: oid 36 updating version 9 to 10 2024-04-18T14:43:33.147 INFO:tasks.rados.rados.0.smithi134.stdout:update_object_version oid 36 v 10 (ObjNum 35 snap 0 seq_num 35) dirty exists 2024-04-18T14:43:33.147 INFO:tasks.rados.rados.0.smithi134.stdout:36: left oid 36 (ObjNum 35 snap 0 seq_num 35) 2024-04-18T14:43:33.147 INFO:tasks.rados.rados.0.smithi134.stdout:47: finishing write tid 2 to smithi13430248-47 2024-04-18T14:43:33.150 INFO:tasks.rados.rados.0.smithi134.stdout:47: finishing write tid 3 to smithi13430248-47 2024-04-18T14:43:33.150 INFO:tasks.rados.rados.0.smithi134.stdout:47: oid 47 updating version 0 to 11 2024-04-18T14:43:33.151 INFO:tasks.rados.rados.0.smithi134.stdout:47: oid 47 updating version 11 to 12 2024-04-18T14:43:33.151 INFO:tasks.rados.rados.0.smithi134.stdout:update_object_version oid 47 v 12 (ObjNum 46 snap 0 seq_num 46) dirty exists 2024-04-18T14:43:33.151 INFO:tasks.rados.rados.0.smithi134.stdout:47: left oid 47 (ObjNum 46 snap 0 seq_num 46) 2024-04-18T14:43:33.201 INFO:tasks.ceph.osd.1.smithi096.stderr:2024-04-18T14:43:33.199+0000 7f56a7a98640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 24887) UID: 0 2024-04-18T14:43:33.251 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-04-18T14:43:33.251 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T14:43:33.266 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.15.asok dump_blocked_ops 2024-04-18T14:43:33.280 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 reset_purged_snaps_last 2024-04-18T14:43:33.302 INFO:tasks.ceph.osd.2.smithi119.stderr:2024-04-18T14:43:33.302+0000 7fcbd30c0640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 24894) UID: 0 2024-04-18T14:43:33.403 INFO:tasks.ceph.osd.6.smithi119.stderr:2024-04-18T14:43:33.402+0000 7fb7cb8bd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 24896) UID: 0 2024-04-18T14:43:33.431 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-04-18T14:43:33.432 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T14:43:33.445 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 reset_purged_snaps_last 2024-04-18T14:43:33.447 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.15.asok dump_historic_ops 2024-04-18T14:43:33.504 INFO:tasks.ceph.osd.3.smithi134.stderr:2024-04-18T14:43:33.503+0000 7fe7a4443640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25211) UID: 0 2024-04-18T14:43:33.570 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-04-18T14:43:33.570 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T14:43:33.584 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-18T14:43:33.607 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 reset_purged_snaps_last 2024-04-18T14:43:33.628 INFO:tasks.ceph.osd.7.smithi134.stderr:2024-04-18T14:43:33.631+0000 7fd7de549640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25213) UID: 0 2024-04-18T14:43:33.695 INFO:teuthology.orchestra.run.smithi086.stderr:noscrub is unset 2024-04-18T14:43:33.697 INFO:tasks.rados.rados.0.smithi134.stdout:8: done (15 left) 2024-04-18T14:43:33.698 INFO:tasks.rados.rados.0.smithi134.stdout:23: done (14 left) 2024-04-18T14:43:33.698 INFO:tasks.rados.rados.0.smithi134.stdout:32: done (13 left) 2024-04-18T14:43:33.698 INFO:tasks.rados.rados.0.smithi134.stdout:34: done (12 left) 2024-04-18T14:43:33.698 INFO:tasks.rados.rados.0.smithi134.stdout:35: done (11 left) 2024-04-18T14:43:33.698 INFO:tasks.rados.rados.0.smithi134.stdout:36: done (10 left) 2024-04-18T14:43:33.698 INFO:tasks.rados.rados.0.smithi134.stdout:47: done (9 left) 2024-04-18T14:43:33.698 INFO:tasks.rados.rados.0.smithi134.stdout:50: done (8 left) 2024-04-18T14:43:33.698 INFO:tasks.rados.rados.0.smithi134.stdout:51: done (7 left) 2024-04-18T14:43:33.698 INFO:tasks.rados.rados.0.smithi134.stdout:53: done (6 left) 2024-04-18T14:43:33.698 INFO:tasks.rados.rados.0.smithi134.stdout:54: done (5 left) 2024-04-18T14:43:33.699 INFO:tasks.rados.rados.0.smithi134.stdout:55: done (4 left) 2024-04-18T14:43:33.699 INFO:tasks.rados.rados.0.smithi134.stdout:56: done (3 left) 2024-04-18T14:43:33.699 INFO:tasks.rados.rados.0.smithi134.stdout:57: done (2 left) 2024-04-18T14:43:33.699 INFO:tasks.rados.rados.0.smithi134.stdout:58: done (1 left) 2024-04-18T14:43:33.699 INFO:tasks.rados.rados.0.smithi134.stdout:59: done (0 left) 2024-04-18T14:43:33.699 INFO:tasks.rados.rados.0.smithi134.stdout:60: copy_from oid 26 from oid 6 current snap is 1 2024-04-18T14:43:33.699 INFO:tasks.rados.rados.0.smithi134.stdout:61: read oid 35 snap 0 2024-04-18T14:43:33.699 INFO:tasks.rados.rados.0.smithi134.stdout:61: expect (ObjNum 34 snap 0 seq_num 34) 2024-04-18T14:43:33.699 INFO:tasks.rados.rados.0.smithi134.stdout:62: snap_create 2024-04-18T14:43:33.702 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-04-18T14:43:33.702 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T14:43:33.705 INFO:tasks.ceph.osd.4.smithi086.stderr:2024-04-18T14:43:33.703+0000 7f0c4c462640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 24956) UID: 0 2024-04-18T14:43:33.713 INFO:tasks.rados.rados.0.smithi134.stdout:61: expect (ObjNum 34 snap 0 seq_num 34) 2024-04-18T14:43:33.723 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-18T14:43:33.758 INFO:tasks.rados.rados.0.smithi134.stdout:60: finishing copy_from racing read to smithi13430248-26 2024-04-18T14:43:33.758 INFO:tasks.rados.rados.0.smithi134.stdout:60: finishing copy_from to smithi13430248-26 2024-04-18T14:43:33.758 INFO:tasks.rados.rados.0.smithi134.stdout:update_object_version oid 26 v 7 (ObjNum 5 snap 0 seq_num 5) dirty exists 2024-04-18T14:43:33.806 INFO:tasks.ceph.osd.5.smithi096.stderr:2024-04-18T14:43:33.807+0000 7fc33f25b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 24889) UID: 0 2024-04-18T14:43:33.823 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 reset_purged_snaps_last 2024-04-18T14:43:33.882 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-04-18T14:43:33.883 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T14:43:33.898 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-18T14:43:33.908 INFO:tasks.ceph.osd.10.smithi119.stderr:2024-04-18T14:43:33.906+0000 7f6f24c12640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 10 (PID: 24898) UID: 0 2024-04-18T14:43:33.982 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.8 reset_purged_snaps_last 2024-04-18T14:43:34.009 INFO:tasks.ceph.osd.1.smithi096.stderr:2024-04-18T14:43:34.007+0000 7f56a7a98640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 24887) UID: 0 2024-04-18T14:43:34.014 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-04-18T14:43:34.014 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T14:43:34.029 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-04-18T14:43:34.114 INFO:tasks.ceph.osd.12.smithi086.stderr:2024-04-18T14:43:34.115+0000 7f6904968640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 12 (PID: 24960) UID: 0 2024-04-18T14:43:34.139 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.9 reset_purged_snaps_last 2024-04-18T14:43:34.176 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-18T14:43:34.191 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-04-18T14:43:34.191 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T14:43:34.207 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-04-18T14:43:34.210 INFO:tasks.ceph.osd.2.smithi119.stderr:2024-04-18T14:43:34.210+0000 7fcbd30c0640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 24894) UID: 0 2024-04-18T14:43:34.312 INFO:tasks.ceph.osd.11.smithi134.stderr:2024-04-18T14:43:34.315+0000 7f2d36f12640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 11 (PID: 25216) UID: 0 2024-04-18T14:43:34.326 INFO:teuthology.orchestra.run.smithi086.stdout:osd.0: {} 2024-04-18T14:43:34.327 INFO:teuthology.orchestra.run.smithi086.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-18T14:43:34.348 INFO:teuthology.orchestra.run.smithi086.stdout:osd.1: {} 2024-04-18T14:43:34.349 INFO:teuthology.orchestra.run.smithi086.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-18T14:43:34.350 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.10 reset_purged_snaps_last 2024-04-18T14:43:34.369 INFO:teuthology.orchestra.run.smithi086.stdout:osd.2: {} 2024-04-18T14:43:34.369 INFO:teuthology.orchestra.run.smithi086.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-18T14:43:34.384 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-04-18T14:43:34.385 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T14:43:34.390 INFO:teuthology.orchestra.run.smithi086.stdout:osd.3: {} 2024-04-18T14:43:34.390 INFO:teuthology.orchestra.run.smithi086.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-18T14:43:34.400 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-04-18T14:43:34.406 INFO:teuthology.orchestra.run.smithi086.stdout:osd.4: {} 2024-04-18T14:43:34.406 INFO:teuthology.orchestra.run.smithi086.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-18T14:43:34.413 INFO:tasks.ceph.osd.10.smithi119.stderr:2024-04-18T14:43:34.414+0000 7f6f24c12640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 10 (PID: 24898) UID: 0 2024-04-18T14:43:34.426 INFO:teuthology.orchestra.run.smithi086.stdout:osd.5: {} 2024-04-18T14:43:34.426 INFO:teuthology.orchestra.run.smithi086.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-18T14:43:34.446 INFO:teuthology.orchestra.run.smithi086.stdout:osd.6: {} 2024-04-18T14:43:34.446 INFO:teuthology.orchestra.run.smithi086.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-18T14:43:34.466 INFO:teuthology.orchestra.run.smithi086.stdout:osd.7: {} 2024-04-18T14:43:34.466 INFO:teuthology.orchestra.run.smithi086.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-18T14:43:34.482 INFO:teuthology.orchestra.run.smithi086.stdout:osd.8: {} 2024-04-18T14:43:34.482 INFO:teuthology.orchestra.run.smithi086.stderr:osd.8: osd_enable_op_tracker = '' 2024-04-18T14:43:34.501 INFO:teuthology.orchestra.run.smithi086.stdout:osd.9: {} 2024-04-18T14:43:34.501 INFO:teuthology.orchestra.run.smithi086.stderr:osd.9: osd_enable_op_tracker = '' 2024-04-18T14:43:34.509 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.11 reset_purged_snaps_last 2024-04-18T14:43:34.514 INFO:tasks.ceph.osd.9.smithi096.stderr:2024-04-18T14:43:34.515+0000 7fa2c1cbf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 9 (PID: 24891) UID: 0 2024-04-18T14:43:34.520 INFO:teuthology.orchestra.run.smithi086.stdout:osd.10: {} 2024-04-18T14:43:34.520 INFO:teuthology.orchestra.run.smithi086.stderr:osd.10: osd_enable_op_tracker = '' 2024-04-18T14:43:34.521 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-04-18T14:43:34.521 INFO:teuthology.orchestra.run.smithi086.stdout: "size": 20, 2024-04-18T14:43:34.521 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 600, 2024-04-18T14:43:34.521 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [] 2024-04-18T14:43:34.521 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-04-18T14:43:34.535 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.8.asok dump_ops_in_flight 2024-04-18T14:43:34.539 INFO:teuthology.orchestra.run.smithi086.stdout:osd.11: {} 2024-04-18T14:43:34.540 INFO:teuthology.orchestra.run.smithi086.stderr:osd.11: osd_enable_op_tracker = '' 2024-04-18T14:43:34.555 INFO:teuthology.orchestra.run.smithi086.stdout:osd.12: {} 2024-04-18T14:43:34.555 INFO:teuthology.orchestra.run.smithi086.stderr:osd.12: osd_enable_op_tracker = '' 2024-04-18T14:43:34.574 INFO:teuthology.orchestra.run.smithi086.stdout:osd.13: {} 2024-04-18T14:43:34.574 INFO:teuthology.orchestra.run.smithi086.stderr:osd.13: osd_enable_op_tracker = '' 2024-04-18T14:43:34.593 INFO:teuthology.orchestra.run.smithi086.stdout:osd.14: {} 2024-04-18T14:43:34.594 INFO:teuthology.orchestra.run.smithi086.stderr:osd.14: osd_enable_op_tracker = '' 2024-04-18T14:43:34.596 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-18T14:43:34.595+0000 7f5baa511640 0 -- 172.21.15.86:0/487623146 >> [v2:172.21.15.134:6808/25223,v1:172.21.15.134:6812/25223] conn(0x7f5ba4221930 msgr2=0x7f5ba4223d20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-04-18T14:43:34.615 INFO:teuthology.orchestra.run.smithi086.stdout:osd.15: {} 2024-04-18T14:43:34.615 INFO:teuthology.orchestra.run.smithi086.stderr:osd.15: osd_enable_op_tracker = '' 2024-04-18T14:43:34.615 INFO:tasks.ceph.osd.14.smithi119.stderr:2024-04-18T14:43:34.614+0000 7f180f599640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 14 (PID: 24900) UID: 0 2024-04-18T14:43:34.651 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-04-18T14:43:34.651 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [], 2024-04-18T14:43:34.651 INFO:teuthology.orchestra.run.smithi086.stdout: "num_ops": 0 2024-04-18T14:43:34.651 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-04-18T14:43:34.664 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.8.asok dump_blocked_ops 2024-04-18T14:43:34.675 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.12 reset_purged_snaps_last 2024-04-18T14:43:34.704 INFO:tasks.rados.rados.0.smithi134.stdout:60: done (2 left) 2024-04-18T14:43:34.705 INFO:tasks.rados.rados.0.smithi134.stdout:61: done (1 left) 2024-04-18T14:43:34.705 INFO:tasks.rados.rados.0.smithi134.stdout:62: done (0 left) 2024-04-18T14:43:34.705 INFO:tasks.rados.rados.0.smithi134.stdout:63: delete oid 25 current snap is 2 2024-04-18T14:43:34.711 INFO:tasks.rados.rados.0.smithi134.stdout:63: done (0 left) 2024-04-18T14:43:34.711 INFO:tasks.rados.rados.0.smithi134.stdout:64: delete oid 20 current snap is 2 2024-04-18T14:43:34.719 INFO:tasks.ceph.osd.4.smithi086.stderr:2024-04-18T14:43:34.719+0000 7f0c4c462640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 24956) UID: 0 2024-04-18T14:43:34.723 INFO:tasks.rados.rados.0.smithi134.stdout:64: done (0 left) 2024-04-18T14:43:34.723 INFO:tasks.rados.rados.0.smithi134.stdout:65: snap_create 2024-04-18T14:43:34.818 INFO:tasks.ceph.osd.8.smithi086.stderr:2024-04-18T14:43:34.819+0000 7f29f7b9d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 8 (PID: 24958) UID: 0 2024-04-18T14:43:34.821 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-04-18T14:43:34.821 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [], 2024-04-18T14:43:34.821 INFO:teuthology.orchestra.run.smithi086.stdout: "complaint_time": 30, 2024-04-18T14:43:34.821 INFO:teuthology.orchestra.run.smithi086.stdout: "num_blocked_ops": 0 2024-04-18T14:43:34.821 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-04-18T14:43:34.835 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.8.asok dump_historic_ops 2024-04-18T14:43:34.863 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.13 reset_purged_snaps_last 2024-04-18T14:43:34.921 INFO:tasks.ceph.osd.2.smithi119.stderr:2024-04-18T14:43:34.918+0000 7fcbd30c0640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 24894) UID: 0 2024-04-18T14:43:35.016 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-04-18T14:43:35.016 INFO:teuthology.orchestra.run.smithi086.stdout: "size": 20, 2024-04-18T14:43:35.017 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 600, 2024-04-18T14:43:35.017 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [ 2024-04-18T14:43:35.017 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:35.017 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "MOSDECSubOpWrite(3.as4 35/30 ECSubWrite(tid=16, reqid=client.4559.0:176, at_version=35'10, trim_to=0'0, roll_forward_to=33'8))", 2024-04-18T14:43:35.017 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-04-18T14:43:34.719151+0000", 2024-04-18T14:43:35.017 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 0.30030177699999999, 2024-04-18T14:43:35.017 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00091739800000000004, 2024-04-18T14:43:35.017 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-04-18T14:43:35.017 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "reached pg", 2024-04-18T14:43:35.017 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-04-18T14:43:35.017 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:35.017 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-04-18T14:43:35.017 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:34.719151+0000", 2024-04-18T14:43:35.018 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:43:35.018 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:35.018 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:35.018 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-04-18T14:43:35.018 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:34.719151+0000", 2024-04-18T14:43:35.018 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:43:35.018 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:35.018 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:35.018 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-04-18T14:43:35.018 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:34.719151+0000", 2024-04-18T14:43:35.018 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967296 2024-04-18T14:43:35.018 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:35.018 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:35.018 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-04-18T14:43:35.019 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:34.719168+0000", 2024-04-18T14:43:35.019 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.6677999999999999e-05 2024-04-18T14:43:35.019 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:35.019 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:35.019 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-04-18T14:43:35.019 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:34.719176+0000", 2024-04-18T14:43:35.019 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.4330000000000004e-06 2024-04-18T14:43:35.019 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:35.019 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:35.019 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-04-18T14:43:35.019 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:34.719182+0000", 2024-04-18T14:43:35.019 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.8860000000000001e-06 2024-04-18T14:43:35.019 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:35.019 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:35.019 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-04-18T14:43:35.020 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:34.719223+0000", 2024-04-18T14:43:35.020 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.1084999999999997e-05 2024-04-18T14:43:35.020 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:35.020 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:35.020 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_started", 2024-04-18T14:43:35.020 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:34.719229+0000", 2024-04-18T14:43:35.020 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.9070000000000004e-06 2024-04-18T14:43:35.020 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:35.020 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:35.020 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_committed", 2024-04-18T14:43:35.020 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:34.720048+0000", 2024-04-18T14:43:35.020 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00081876699999999998 2024-04-18T14:43:35.020 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:35.020 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:35.020 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-04-18T14:43:35.021 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:34.720069+0000", 2024-04-18T14:43:35.021 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.0780000000000001e-05 2024-04-18T14:43:35.021 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:43:35.021 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-04-18T14:43:35.021 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:43:35.021 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:35.021 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:35.021 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "MOSDECSubOpWrite(3.as4 35/30 ECSubWrite(tid=17, reqid=client.4559.0:176, at_version=0'0, trim_to=0'0, roll_forward_to=35'10))", 2024-04-18T14:43:35.021 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-04-18T14:43:34.726885+0000", 2024-04-18T14:43:35.021 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 0.29256830499999997, 2024-04-18T14:43:35.021 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00090227899999999997, 2024-04-18T14:43:35.021 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-04-18T14:43:35.021 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "reached pg", 2024-04-18T14:43:35.021 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-04-18T14:43:35.021 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:35.022 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-04-18T14:43:35.022 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:34.726885+0000", 2024-04-18T14:43:35.022 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:43:35.022 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:35.022 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:35.022 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-04-18T14:43:35.022 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:34.726885+0000", 2024-04-18T14:43:35.022 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:43:35.022 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:35.022 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:35.022 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-04-18T14:43:35.022 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:34.726884+0000", 2024-04-18T14:43:35.022 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-04-18T14:43:35.022 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:35.022 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:35.023 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-04-18T14:43:35.023 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:34.726902+0000", 2024-04-18T14:43:35.023 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.8698e-05 2024-04-18T14:43:35.023 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:35.023 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:35.023 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-04-18T14:43:35.023 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:34.726919+0000", 2024-04-18T14:43:35.023 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.6509000000000001e-05 2024-04-18T14:43:35.023 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:35.023 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:35.023 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-04-18T14:43:35.023 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:34.726929+0000", 2024-04-18T14:43:35.023 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.0158e-05 2024-04-18T14:43:35.023 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:35.023 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:35.024 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-04-18T14:43:35.024 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:34.726986+0000", 2024-04-18T14:43:35.024 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.6613999999999997e-05 2024-04-18T14:43:35.024 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:35.024 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:35.024 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_started", 2024-04-18T14:43:35.024 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:34.726997+0000", 2024-04-18T14:43:35.024 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.1263e-05 2024-04-18T14:43:35.024 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:35.024 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:35.024 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_committed", 2024-04-18T14:43:35.024 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:34.727758+0000", 2024-04-18T14:43:35.024 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00076127699999999998 2024-04-18T14:43:35.024 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:35.025 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:35.025 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-04-18T14:43:35.025 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:34.727787+0000", 2024-04-18T14:43:35.025 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.8875999999999999e-05 2024-04-18T14:43:35.025 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:43:35.025 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-04-18T14:43:35.025 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:43:35.025 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:43:35.025 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-04-18T14:43:35.025 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-04-18T14:43:35.026 INFO:tasks.ceph.osd.10.smithi119.stderr:2024-04-18T14:43:35.026+0000 7f6f24c12640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 10 (PID: 24898) UID: 0 2024-04-18T14:43:35.031 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.12.asok dump_ops_in_flight 2024-04-18T14:43:35.063 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.14 reset_purged_snaps_last 2024-04-18T14:43:35.135 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-04-18T14:43:35.135 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [], 2024-04-18T14:43:35.135 INFO:teuthology.orchestra.run.smithi086.stdout: "num_ops": 0 2024-04-18T14:43:35.135 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-04-18T14:43:35.136 INFO:tasks.ceph.osd.12.smithi086.stderr:2024-04-18T14:43:35.135+0000 7f6904968640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 12 (PID: 24960) UID: 0 2024-04-18T14:43:35.149 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.12.asok dump_blocked_ops 2024-04-18T14:43:35.242 INFO:tasks.ceph.osd.4.smithi086.stderr:2024-04-18T14:43:35.243+0000 7f0c4c462640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 24956) UID: 0 2024-04-18T14:43:35.257 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.15 reset_purged_snaps_last 2024-04-18T14:43:35.313 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-04-18T14:43:35.314 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [], 2024-04-18T14:43:35.314 INFO:teuthology.orchestra.run.smithi086.stdout: "complaint_time": 30, 2024-04-18T14:43:35.314 INFO:teuthology.orchestra.run.smithi086.stdout: "num_blocked_ops": 0 2024-04-18T14:43:35.314 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-04-18T14:43:35.330 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.12.asok dump_historic_ops 2024-04-18T14:43:35.331 INFO:tasks.ceph.osd.9.smithi096.stderr:2024-04-18T14:43:35.331+0000 7fa2c1cbf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 9 (PID: 24891) UID: 0 2024-04-18T14:43:35.432 INFO:tasks.ceph.osd.2.smithi119.stderr:2024-04-18T14:43:35.430+0000 7fcbd30c0640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 24894) UID: 0 2024-04-18T14:43:35.484 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-04-18T14:43:35.484 INFO:teuthology.orchestra.run.smithi086.stdout: "size": 20, 2024-04-18T14:43:35.484 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 600, 2024-04-18T14:43:35.484 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [ 2024-04-18T14:43:35.484 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:35.484 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4559.0:175 3.9s0 3:967bb897:::smithi13430248-25:head [stat,delete] snapc 3=[3,2] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-04-18T14:43:35.484 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-04-18T14:43:34.708488+0000", 2024-04-18T14:43:35.484 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 0.77759891299999995, 2024-04-18T14:43:35.484 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0059938609999999996, 2024-04-18T14:43:35.484 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-04-18T14:43:35.484 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T14:43:35.484 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-04-18T14:43:35.484 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4559", 2024-04-18T14:43:35.485 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.134:0/3113589487", 2024-04-18T14:43:35.485 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 175 2024-04-18T14:43:35.485 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:35.485 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-04-18T14:43:35.485 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:35.485 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-04-18T14:43:35.485 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:34.708488+0000", 2024-04-18T14:43:35.485 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:43:35.485 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:35.485 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:35.485 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-04-18T14:43:35.485 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:34.708488+0000", 2024-04-18T14:43:35.485 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:43:35.485 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:35.486 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:35.486 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-04-18T14:43:35.486 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:34.708486+0000", 2024-04-18T14:43:35.486 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999981 2024-04-18T14:43:35.486 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:35.486 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:35.486 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-04-18T14:43:35.486 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:34.708497+0000", 2024-04-18T14:43:35.486 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.1328999999999999e-05 2024-04-18T14:43:35.486 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:35.486 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:35.486 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-04-18T14:43:35.486 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:34.708513+0000", 2024-04-18T14:43:35.486 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.5991999999999999e-05 2024-04-18T14:43:35.487 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:35.487 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:35.487 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-04-18T14:43:35.487 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:34.708521+0000", 2024-04-18T14:43:35.487 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.8560000000000007e-06 2024-04-18T14:43:35.487 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:35.487 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:35.487 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-04-18T14:43:35.487 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:34.708582+0000", 2024-04-18T14:43:35.487 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.0693999999999999e-05 2024-04-18T14:43:35.487 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:35.488 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:35.488 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op must wait for map", 2024-04-18T14:43:35.488 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:34.708591+0000", 2024-04-18T14:43:35.488 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.9510000000000001e-06 2024-04-18T14:43:35.488 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:35.488 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:35.488 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-04-18T14:43:35.488 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:34.710385+0000", 2024-04-18T14:43:35.488 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0017931329999999999 2024-04-18T14:43:35.488 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:35.488 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:35.488 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-04-18T14:43:35.488 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:34.710489+0000", 2024-04-18T14:43:35.488 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000104275 2024-04-18T14:43:35.489 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:35.489 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:35.489 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_started", 2024-04-18T14:43:35.489 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:34.711275+0000", 2024-04-18T14:43:35.489 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00078623799999999998 2024-04-18T14:43:35.489 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:35.489 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:35.489 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_committed", 2024-04-18T14:43:35.489 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:34.712040+0000", 2024-04-18T14:43:35.489 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00076439800000000001 2024-04-18T14:43:35.489 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:35.490 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:35.490 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-04-18T14:43:35.490 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:34.714446+0000", 2024-04-18T14:43:35.490 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.002406821 2024-04-18T14:43:35.490 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:35.490 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:35.490 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-04-18T14:43:35.490 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:34.714482+0000", 2024-04-18T14:43:35.490 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.5303999999999999e-05 2024-04-18T14:43:35.490 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:43:35.490 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-04-18T14:43:35.490 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:43:35.490 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:35.490 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:35.491 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "MOSDECSubOpWriteReply(3.9s0 34/30 ECSubWriteReply(tid=27, last_complete=35'15, committed=1, applied=1))", 2024-04-18T14:43:35.491 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-04-18T14:43:34.712293+0000", 2024-04-18T14:43:35.491 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 0.77379381400000002, 2024-04-18T14:43:35.491 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.0399000000000003e-05, 2024-04-18T14:43:35.491 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-04-18T14:43:35.491 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "reached pg", 2024-04-18T14:43:35.491 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-04-18T14:43:35.491 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:35.491 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-04-18T14:43:35.491 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:34.712293+0000", 2024-04-18T14:43:35.491 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:43:35.491 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:35.491 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:35.491 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-04-18T14:43:35.491 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:34.712293+0000", 2024-04-18T14:43:35.492 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:43:35.492 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:35.492 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:35.492 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-04-18T14:43:35.492 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:34.712292+0000", 2024-04-18T14:43:35.492 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-04-18T14:43:35.492 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:35.492 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:35.493 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-04-18T14:43:35.493 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:34.712297+0000", 2024-04-18T14:43:35.493 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.4830000000000001e-06 2024-04-18T14:43:35.493 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:35.493 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:35.493 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-04-18T14:43:35.493 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:34.712305+0000", 2024-04-18T14:43:35.493 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.8300000000000002e-06 2024-04-18T14:43:35.493 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:35.493 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:35.493 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-04-18T14:43:35.493 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:34.712310+0000", 2024-04-18T14:43:35.493 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.9130000000000002e-06 2024-04-18T14:43:35.493 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:35.494 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:35.494 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-04-18T14:43:35.494 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:34.712336+0000", 2024-04-18T14:43:35.494 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.5732e-05 2024-04-18T14:43:35.494 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:35.494 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:35.494 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-04-18T14:43:35.494 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:34.712343+0000", 2024-04-18T14:43:35.494 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.2729999999999997e-06 2024-04-18T14:43:35.494 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:43:35.494 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-04-18T14:43:35.494 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:43:35.494 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:35.494 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:35.494 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "MOSDECSubOpWriteReply(3.9s0 35/30 ECSubWriteReply(tid=27, last_complete=35'15, committed=1, applied=1))", 2024-04-18T14:43:35.495 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-04-18T14:43:34.713190+0000", 2024-04-18T14:43:35.495 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 0.77289717899999999, 2024-04-18T14:43:35.495 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.2807999999999999e-05, 2024-04-18T14:43:35.495 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-04-18T14:43:35.495 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "reached pg", 2024-04-18T14:43:35.495 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-04-18T14:43:35.495 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:35.495 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-04-18T14:43:35.495 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:34.713190+0000", 2024-04-18T14:43:35.495 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:43:35.495 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:35.495 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:35.496 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-04-18T14:43:35.496 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:34.713190+0000", 2024-04-18T14:43:35.496 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:43:35.496 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:35.496 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:35.496 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-04-18T14:43:35.496 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:34.713189+0000", 2024-04-18T14:43:35.496 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-04-18T14:43:35.496 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:35.496 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:35.496 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-04-18T14:43:35.496 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:34.713199+0000", 2024-04-18T14:43:35.496 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.009e-05 2024-04-18T14:43:35.496 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:35.497 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:35.497 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-04-18T14:43:35.497 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:34.713211+0000", 2024-04-18T14:43:35.497 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.2520999999999999e-05 2024-04-18T14:43:35.497 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:35.497 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:35.497 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-04-18T14:43:35.497 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:34.713218+0000", 2024-04-18T14:43:35.497 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.3589999999999996e-06 2024-04-18T14:43:35.497 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:35.497 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:35.497 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-04-18T14:43:35.498 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:34.713247+0000", 2024-04-18T14:43:35.498 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.9000999999999999e-05 2024-04-18T14:43:35.498 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:35.498 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:35.498 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-04-18T14:43:35.498 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:34.713252+0000", 2024-04-18T14:43:35.498 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.5600000000000001e-06 2024-04-18T14:43:35.498 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:43:35.498 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-04-18T14:43:35.498 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:43:35.498 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:35.499 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:35.499 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "MOSDECSubOpWriteReply(3.9s0 34/30 ECSubWriteReply(tid=27, last_complete=35'15, committed=1, applied=1))", 2024-04-18T14:43:35.499 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-04-18T14:43:34.713598+0000", 2024-04-18T14:43:35.499 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 0.77248827799999997, 2024-04-18T14:43:35.499 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.5305999999999997e-05, 2024-04-18T14:43:35.499 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-04-18T14:43:35.499 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "reached pg", 2024-04-18T14:43:35.499 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-04-18T14:43:35.499 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:35.499 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-04-18T14:43:35.499 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:34.713598+0000", 2024-04-18T14:43:35.499 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:43:35.499 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:35.499 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:35.499 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-04-18T14:43:35.500 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:34.713598+0000", 2024-04-18T14:43:35.500 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:43:35.500 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:35.500 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:35.500 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-04-18T14:43:35.500 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:34.713598+0000", 2024-04-18T14:43:35.500 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-04-18T14:43:35.500 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:35.500 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:35.500 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-04-18T14:43:35.500 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:34.713601+0000", 2024-04-18T14:43:35.500 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.5790000000000002e-06 2024-04-18T14:43:35.500 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:35.500 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:35.500 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-04-18T14:43:35.501 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:34.713607+0000", 2024-04-18T14:43:35.501 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.1940000000000003e-06 2024-04-18T14:43:35.501 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:35.501 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:35.501 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-04-18T14:43:35.501 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:34.713610+0000", 2024-04-18T14:43:35.501 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.4809999999999998e-06 2024-04-18T14:43:35.501 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:35.501 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:35.501 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-04-18T14:43:35.501 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:34.713628+0000", 2024-04-18T14:43:35.501 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.7198999999999999e-05 2024-04-18T14:43:35.501 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:35.501 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:35.501 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-04-18T14:43:35.502 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:34.713634+0000", 2024-04-18T14:43:35.502 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.224e-06 2024-04-18T14:43:35.502 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:43:35.502 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-04-18T14:43:35.502 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:43:35.502 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:35.502 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:35.502 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "MOSDECSubOpWriteReply(3.9s0 35/30 ECSubWriteReply(tid=27, last_complete=35'15, committed=1, applied=1))", 2024-04-18T14:43:35.503 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-04-18T14:43:34.713746+0000", 2024-04-18T14:43:35.503 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 0.77234119599999995, 2024-04-18T14:43:35.503 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.5460000000000003e-05, 2024-04-18T14:43:35.503 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-04-18T14:43:35.503 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "reached pg", 2024-04-18T14:43:35.503 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-04-18T14:43:35.503 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:35.503 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-04-18T14:43:35.503 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:34.713746+0000", 2024-04-18T14:43:35.503 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:43:35.503 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:35.503 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:35.503 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-04-18T14:43:35.503 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:34.713746+0000", 2024-04-18T14:43:35.503 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:43:35.503 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:35.504 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:35.504 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-04-18T14:43:35.504 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:34.713745+0000", 2024-04-18T14:43:35.504 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-04-18T14:43:35.504 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:35.504 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:35.504 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-04-18T14:43:35.504 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:34.713748+0000", 2024-04-18T14:43:35.504 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.9170000000000002e-06 2024-04-18T14:43:35.504 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:35.504 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:35.505 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-04-18T14:43:35.505 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:34.713755+0000", 2024-04-18T14:43:35.505 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.0720000000000002e-06 2024-04-18T14:43:35.505 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:35.505 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:35.505 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-04-18T14:43:35.505 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:34.713759+0000", 2024-04-18T14:43:35.505 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.7570000000000002e-06 2024-04-18T14:43:35.505 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:35.505 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:35.505 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-04-18T14:43:35.505 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:34.713777+0000", 2024-04-18T14:43:35.505 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.7903000000000001e-05 2024-04-18T14:43:35.505 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:35.505 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:35.506 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-04-18T14:43:35.506 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:34.713781+0000", 2024-04-18T14:43:35.506 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.2490000000000003e-06 2024-04-18T14:43:35.506 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:43:35.506 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-04-18T14:43:35.506 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:43:35.506 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:35.506 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:35.506 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "MOSDECSubOpWriteReply(3.9s0 34/30 ECSubWriteReply(tid=27, last_complete=35'15, committed=1, applied=1))", 2024-04-18T14:43:35.506 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-04-18T14:43:34.714186+0000", 2024-04-18T14:43:35.506 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 0.77190036699999998, 2024-04-18T14:43:35.506 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.3521000000000004e-05, 2024-04-18T14:43:35.506 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-04-18T14:43:35.506 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "reached pg", 2024-04-18T14:43:35.507 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-04-18T14:43:35.507 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:35.507 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-04-18T14:43:35.507 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:34.714186+0000", 2024-04-18T14:43:35.507 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:43:35.507 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:35.507 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:35.507 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-04-18T14:43:35.507 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:34.714186+0000", 2024-04-18T14:43:35.507 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:43:35.507 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:35.507 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:35.507 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-04-18T14:43:35.507 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:34.714186+0000", 2024-04-18T14:43:35.507 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-04-18T14:43:35.507 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:35.508 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:35.508 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-04-18T14:43:35.508 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:34.714189+0000", 2024-04-18T14:43:35.508 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.1599999999999998e-06 2024-04-18T14:43:35.508 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:35.508 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:35.508 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-04-18T14:43:35.508 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:34.714195+0000", 2024-04-18T14:43:35.508 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.9109999999999998e-06 2024-04-18T14:43:35.508 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:35.508 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:35.509 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-04-18T14:43:35.509 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:34.714198+0000", 2024-04-18T14:43:35.509 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.2459999999999999e-06 2024-04-18T14:43:35.509 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:35.509 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:35.509 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-04-18T14:43:35.510 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:34.714235+0000", 2024-04-18T14:43:35.510 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.7202000000000001e-05 2024-04-18T14:43:35.510 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:35.510 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:35.510 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-04-18T14:43:35.510 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:34.714250+0000", 2024-04-18T14:43:35.510 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.4372000000000001e-05 2024-04-18T14:43:35.510 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:43:35.510 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-04-18T14:43:35.510 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:43:35.510 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:35.510 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:35.510 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "MOSDECSubOpWriteReply(3.9s0 34/30 ECSubWriteReply(tid=27, last_complete=35'15, committed=1, applied=1))", 2024-04-18T14:43:35.511 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-04-18T14:43:34.714372+0000", 2024-04-18T14:43:35.511 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 0.77171441100000004, 2024-04-18T14:43:35.511 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00033771099999999998, 2024-04-18T14:43:35.511 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-04-18T14:43:35.511 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "reached pg", 2024-04-18T14:43:35.511 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-04-18T14:43:35.511 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:35.511 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-04-18T14:43:35.511 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:34.714372+0000", 2024-04-18T14:43:35.511 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:43:35.511 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:35.511 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:35.511 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-04-18T14:43:35.511 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:34.714372+0000", 2024-04-18T14:43:35.512 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:43:35.512 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:35.512 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:35.512 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-04-18T14:43:35.512 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:34.714372+0000", 2024-04-18T14:43:35.512 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-04-18T14:43:35.512 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:35.512 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:35.512 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-04-18T14:43:35.513 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:34.714374+0000", 2024-04-18T14:43:35.513 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.5490000000000001e-06 2024-04-18T14:43:35.513 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:35.513 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:35.513 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-04-18T14:43:35.513 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:34.714381+0000", 2024-04-18T14:43:35.513 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.6449999999999999e-06 2024-04-18T14:43:35.513 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:35.513 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:35.513 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-04-18T14:43:35.513 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:34.714384+0000", 2024-04-18T14:43:35.514 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.247e-06 2024-04-18T14:43:35.514 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:35.514 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:35.514 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-04-18T14:43:35.514 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:34.714404+0000", 2024-04-18T14:43:35.514 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.9830000000000002e-05 2024-04-18T14:43:35.514 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:35.514 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:35.514 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-04-18T14:43:35.514 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:34.714710+0000", 2024-04-18T14:43:35.514 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00030587600000000001 2024-04-18T14:43:35.514 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:43:35.514 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-04-18T14:43:35.514 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:43:35.514 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:35.515 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:35.515 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "MOSDECSubOpWriteReply(3.9s0 35/30 ECSubWriteReply(tid=28, last_complete=35'15, committed=1, applied=1))", 2024-04-18T14:43:35.515 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-04-18T14:43:34.715855+0000", 2024-04-18T14:43:35.515 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 0.77023210399999997, 2024-04-18T14:43:35.515 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.1033999999999999e-05, 2024-04-18T14:43:35.515 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-04-18T14:43:35.515 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "reached pg", 2024-04-18T14:43:35.515 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-04-18T14:43:35.515 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:35.515 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-04-18T14:43:35.515 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:34.715855+0000", 2024-04-18T14:43:35.515 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:43:35.515 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:35.515 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:35.516 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-04-18T14:43:35.516 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:34.715855+0000", 2024-04-18T14:43:35.516 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:43:35.516 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:35.516 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:35.516 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-04-18T14:43:35.516 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:34.715854+0000", 2024-04-18T14:43:35.516 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-04-18T14:43:35.516 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:35.516 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:35.516 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-04-18T14:43:35.517 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:34.715858+0000", 2024-04-18T14:43:35.517 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.9960000000000004e-06 2024-04-18T14:43:35.517 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:35.517 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:35.517 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-04-18T14:43:35.517 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:34.715868+0000", 2024-04-18T14:43:35.517 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.6909999999999992e-06 2024-04-18T14:43:35.517 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:35.517 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:35.517 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-04-18T14:43:35.517 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:34.715873+0000", 2024-04-18T14:43:35.517 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.8470000000000003e-06 2024-04-18T14:43:35.517 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:35.517 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:35.517 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-04-18T14:43:35.518 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:34.715905+0000", 2024-04-18T14:43:35.518 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.2836000000000002e-05 2024-04-18T14:43:35.518 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:35.518 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:35.518 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-04-18T14:43:35.518 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:34.715916+0000", 2024-04-18T14:43:35.518 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.0249e-05 2024-04-18T14:43:35.518 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:43:35.518 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-04-18T14:43:35.518 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:43:35.518 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:35.519 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:35.519 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "MOSDECSubOpWriteReply(3.9s0 35/30 ECSubWriteReply(tid=28, last_complete=35'15, committed=1, applied=1))", 2024-04-18T14:43:35.519 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-04-18T14:43:34.715915+0000", 2024-04-18T14:43:35.519 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 0.77017161599999995, 2024-04-18T14:43:35.519 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.4466000000000002e-05, 2024-04-18T14:43:35.519 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-04-18T14:43:35.519 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "reached pg", 2024-04-18T14:43:35.519 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-04-18T14:43:35.519 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:35.519 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-04-18T14:43:35.519 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:34.715915+0000", 2024-04-18T14:43:35.519 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:43:35.519 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:35.520 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:35.520 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-04-18T14:43:35.520 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:34.715915+0000", 2024-04-18T14:43:35.520 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:43:35.520 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:35.520 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:35.520 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-04-18T14:43:35.520 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:34.715915+0000", 2024-04-18T14:43:35.520 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-04-18T14:43:35.520 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:35.520 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:35.520 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-04-18T14:43:35.520 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:34.715918+0000", 2024-04-18T14:43:35.520 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.4999999999999999e-06 2024-04-18T14:43:35.521 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:35.521 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:35.521 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-04-18T14:43:35.521 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:34.715926+0000", 2024-04-18T14:43:35.521 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.9389999999999997e-06 2024-04-18T14:43:35.521 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:35.521 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:35.521 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-04-18T14:43:35.521 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:34.715929+0000", 2024-04-18T14:43:35.521 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.3380000000000001e-06 2024-04-18T14:43:35.521 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:35.521 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:35.521 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-04-18T14:43:35.521 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:34.715966+0000", 2024-04-18T14:43:35.522 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.6949999999999997e-05 2024-04-18T14:43:35.522 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:35.522 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:35.522 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-04-18T14:43:35.522 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:34.715980+0000", 2024-04-18T14:43:35.522 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.3219e-05 2024-04-18T14:43:35.522 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:43:35.522 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-04-18T14:43:35.522 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:43:35.522 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:35.522 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:35.522 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "MOSDECSubOpWriteReply(3.9s0 35/30 ECSubWriteReply(tid=28, last_complete=35'15, committed=1, applied=1))", 2024-04-18T14:43:35.523 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-04-18T14:43:34.716367+0000", 2024-04-18T14:43:35.523 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 0.76971989200000002, 2024-04-18T14:43:35.523 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.3523000000000003e-05, 2024-04-18T14:43:35.523 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-04-18T14:43:35.523 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "reached pg", 2024-04-18T14:43:35.523 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-04-18T14:43:35.523 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:35.523 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-04-18T14:43:35.523 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:34.716367+0000", 2024-04-18T14:43:35.523 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:43:35.523 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:35.523 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:35.523 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-04-18T14:43:35.523 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:34.716367+0000", 2024-04-18T14:43:35.524 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:43:35.524 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:35.524 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:35.524 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-04-18T14:43:35.524 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:34.716366+0000", 2024-04-18T14:43:35.524 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-04-18T14:43:35.524 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:35.524 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:35.524 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-04-18T14:43:35.524 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:34.716370+0000", 2024-04-18T14:43:35.524 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.5240000000000001e-06 2024-04-18T14:43:35.524 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:35.524 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:35.524 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-04-18T14:43:35.525 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:34.716381+0000", 2024-04-18T14:43:35.525 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.1181e-05 2024-04-18T14:43:35.525 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:35.525 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:35.525 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-04-18T14:43:35.525 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:34.716386+0000", 2024-04-18T14:43:35.525 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.7129999999999996e-06 2024-04-18T14:43:35.525 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:35.525 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:35.525 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-04-18T14:43:35.525 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:34.716405+0000", 2024-04-18T14:43:35.525 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.9174e-05 2024-04-18T14:43:35.525 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:35.525 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:35.525 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-04-18T14:43:35.526 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:34.716410+0000", 2024-04-18T14:43:35.526 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.5559999999999998e-06 2024-04-18T14:43:35.526 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:43:35.526 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-04-18T14:43:35.526 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:43:35.526 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:35.526 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:35.526 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "MOSDECSubOpWriteReply(3.9s0 35/30 ECSubWriteReply(tid=28, last_complete=35'15, committed=1, applied=1))", 2024-04-18T14:43:35.527 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-04-18T14:43:34.717520+0000", 2024-04-18T14:43:35.527 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 0.76856669600000005, 2024-04-18T14:43:35.527 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.4666000000000001e-05, 2024-04-18T14:43:35.527 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-04-18T14:43:35.527 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "reached pg", 2024-04-18T14:43:35.527 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-04-18T14:43:35.528 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:35.528 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-04-18T14:43:35.528 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:34.717520+0000", 2024-04-18T14:43:35.528 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:43:35.528 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:35.529 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:35.529 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-04-18T14:43:35.529 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:34.717520+0000", 2024-04-18T14:43:35.529 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:43:35.529 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:35.529 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:35.529 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-04-18T14:43:35.529 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:34.717520+0000", 2024-04-18T14:43:35.529 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-04-18T14:43:35.529 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:35.529 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:35.529 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-04-18T14:43:35.530 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:34.717522+0000", 2024-04-18T14:43:35.530 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.7870000000000002e-06 2024-04-18T14:43:35.530 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:35.530 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:35.530 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-04-18T14:43:35.530 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:34.717529+0000", 2024-04-18T14:43:35.530 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.6830000000000002e-06 2024-04-18T14:43:35.530 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:35.530 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:35.530 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-04-18T14:43:35.531 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:34.717533+0000", 2024-04-18T14:43:35.531 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.5559999999999999e-06 2024-04-18T14:43:35.531 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:35.531 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:35.531 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-04-18T14:43:35.531 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:34.717564+0000", 2024-04-18T14:43:35.531 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.0895999999999997e-05 2024-04-18T14:43:35.531 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:35.531 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:35.531 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-04-18T14:43:35.531 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:34.717575+0000", 2024-04-18T14:43:35.532 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.11e-05 2024-04-18T14:43:35.532 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:43:35.532 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-04-18T14:43:35.532 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:43:35.532 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:35.532 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:35.532 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "MOSDECSubOpWriteReply(3.9s0 35/30 ECSubWriteReply(tid=28, last_complete=35'15, committed=1, applied=1))", 2024-04-18T14:43:35.532 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-04-18T14:43:34.717678+0000", 2024-04-18T14:43:35.532 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 0.76840867400000001, 2024-04-18T14:43:35.532 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.5982e-05, 2024-04-18T14:43:35.532 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-04-18T14:43:35.533 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "reached pg", 2024-04-18T14:43:35.533 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-04-18T14:43:35.533 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:35.533 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-04-18T14:43:35.533 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:34.717678+0000", 2024-04-18T14:43:35.533 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:43:35.533 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:35.533 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:35.533 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-04-18T14:43:35.533 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:34.717678+0000", 2024-04-18T14:43:35.533 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:43:35.533 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:35.533 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:35.533 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-04-18T14:43:35.533 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:34.717678+0000", 2024-04-18T14:43:35.534 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-04-18T14:43:35.534 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:35.534 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:35.534 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-04-18T14:43:35.534 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:34.717681+0000", 2024-04-18T14:43:35.534 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.1939999999999998e-06 2024-04-18T14:43:35.534 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:35.534 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:35.534 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-04-18T14:43:35.534 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:34.717688+0000", 2024-04-18T14:43:35.534 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.3830000000000003e-06 2024-04-18T14:43:35.534 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:35.534 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:35.535 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-04-18T14:43:35.535 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:34.717692+0000", 2024-04-18T14:43:35.535 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.6229999999999999e-06 2024-04-18T14:43:35.535 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:35.535 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:35.535 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-04-18T14:43:35.535 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:34.717725+0000", 2024-04-18T14:43:35.535 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.2944999999999997e-05 2024-04-18T14:43:35.535 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:35.535 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:35.535 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-04-18T14:43:35.535 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:34.717734+0000", 2024-04-18T14:43:35.536 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.2820000000000002e-06 2024-04-18T14:43:35.536 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:43:35.536 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-04-18T14:43:35.536 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:43:35.536 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:35.536 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:35.536 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "MOSDECSubOpWrite(3.as2 35/30 ECSubWrite(tid=16, reqid=client.4559.0:176, at_version=35'10, trim_to=0'0, roll_forward_to=33'8))", 2024-04-18T14:43:35.536 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-04-18T14:43:34.719408+0000", 2024-04-18T14:43:35.536 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 0.76667892199999998, 2024-04-18T14:43:35.536 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00071306500000000003, 2024-04-18T14:43:35.536 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-04-18T14:43:35.536 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "reached pg", 2024-04-18T14:43:35.536 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-04-18T14:43:35.537 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:35.537 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-04-18T14:43:35.537 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:34.719408+0000", 2024-04-18T14:43:35.537 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:43:35.537 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:35.537 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:35.537 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-04-18T14:43:35.537 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:34.719408+0000", 2024-04-18T14:43:35.537 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:43:35.537 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:35.537 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:35.537 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-04-18T14:43:35.537 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:34.719408+0000", 2024-04-18T14:43:35.537 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967296 2024-04-18T14:43:35.538 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:35.538 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:35.538 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-04-18T14:43:35.538 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:34.719427+0000", 2024-04-18T14:43:35.538 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.9902e-05 2024-04-18T14:43:35.538 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:35.538 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:35.538 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-04-18T14:43:35.538 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:34.719438+0000", 2024-04-18T14:43:35.538 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.0528e-05 2024-04-18T14:43:35.538 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:35.538 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:35.538 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-04-18T14:43:35.539 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:34.719447+0000", 2024-04-18T14:43:35.539 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.8820000000000007e-06 2024-04-18T14:43:35.539 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:35.539 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:35.539 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-04-18T14:43:35.539 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:34.719493+0000", 2024-04-18T14:43:35.539 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.5704000000000002e-05 2024-04-18T14:43:35.539 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:35.539 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:35.539 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_started", 2024-04-18T14:43:35.539 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:34.719502+0000", 2024-04-18T14:43:35.539 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.6579999999999997e-06 2024-04-18T14:43:35.539 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:35.539 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:35.539 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_committed", 2024-04-18T14:43:35.539 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:34.720104+0000", 2024-04-18T14:43:35.540 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00060163000000000003 2024-04-18T14:43:35.540 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:35.540 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:35.540 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-04-18T14:43:35.540 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:34.720121+0000", 2024-04-18T14:43:35.540 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.6983e-05 2024-04-18T14:43:35.540 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:43:35.540 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-04-18T14:43:35.540 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:43:35.540 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:35.540 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:35.540 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "MOSDECSubOpWriteReply(3.9s0 35/30 ECSubWriteReply(tid=28, last_complete=35'15, committed=1, applied=1))", 2024-04-18T14:43:35.540 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-04-18T14:43:34.719495+0000", 2024-04-18T14:43:35.540 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 0.76659211500000002, 2024-04-18T14:43:35.540 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.4576e-05, 2024-04-18T14:43:35.541 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-04-18T14:43:35.541 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "reached pg", 2024-04-18T14:43:35.541 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-04-18T14:43:35.541 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:35.541 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-04-18T14:43:35.541 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:34.719495+0000", 2024-04-18T14:43:35.541 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:43:35.541 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:35.541 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:35.541 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-04-18T14:43:35.541 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:34.719495+0000", 2024-04-18T14:43:35.541 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:43:35.541 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:35.541 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:35.542 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-04-18T14:43:35.542 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:34.719494+0000", 2024-04-18T14:43:35.542 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-04-18T14:43:35.542 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:35.542 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:35.542 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-04-18T14:43:35.542 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:34.719499+0000", 2024-04-18T14:43:35.542 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.7079999999999996e-06 2024-04-18T14:43:35.542 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:35.542 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:35.543 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-04-18T14:43:35.543 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:34.719507+0000", 2024-04-18T14:43:35.543 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.3329999999999997e-06 2024-04-18T14:43:35.543 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:35.543 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:35.543 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-04-18T14:43:35.543 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:34.719511+0000", 2024-04-18T14:43:35.543 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.5179999999999998e-06 2024-04-18T14:43:35.543 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:35.543 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:35.543 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-04-18T14:43:35.543 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:34.719540+0000", 2024-04-18T14:43:35.543 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.8941e-05 2024-04-18T14:43:35.543 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:35.544 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:35.544 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-04-18T14:43:35.544 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:34.719559+0000", 2024-04-18T14:43:35.544 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.8751000000000001e-05 2024-04-18T14:43:35.544 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:43:35.544 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-04-18T14:43:35.544 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:43:35.544 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:35.544 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:35.544 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "MOSDECSubOpWrite(3.as2 35/30 ECSubWrite(tid=17, reqid=client.4559.0:176, at_version=0'0, trim_to=0'0, roll_forward_to=35'10))", 2024-04-18T14:43:35.544 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-04-18T14:43:34.727014+0000", 2024-04-18T14:43:35.544 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 0.75907306200000002, 2024-04-18T14:43:35.544 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00072111400000000002, 2024-04-18T14:43:35.545 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-04-18T14:43:35.545 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "reached pg", 2024-04-18T14:43:35.545 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-04-18T14:43:35.545 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:35.545 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-04-18T14:43:35.545 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:34.727014+0000", 2024-04-18T14:43:35.545 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:43:35.545 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:35.545 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:35.545 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-04-18T14:43:35.545 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:34.727014+0000", 2024-04-18T14:43:35.545 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:43:35.545 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:35.546 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:35.546 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-04-18T14:43:35.546 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:34.727013+0000", 2024-04-18T14:43:35.546 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-04-18T14:43:35.546 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:35.546 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:35.546 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-04-18T14:43:35.546 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:34.727028+0000", 2024-04-18T14:43:35.546 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.5078e-05 2024-04-18T14:43:35.546 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:35.546 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:35.546 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-04-18T14:43:35.546 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:34.727047+0000", 2024-04-18T14:43:35.547 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.9751000000000001e-05 2024-04-18T14:43:35.547 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:35.547 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:35.547 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-04-18T14:43:35.547 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:34.727061+0000", 2024-04-18T14:43:35.547 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.3169e-05 2024-04-18T14:43:35.547 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:35.547 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:35.547 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-04-18T14:43:35.547 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:34.727116+0000", 2024-04-18T14:43:35.547 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.5343999999999997e-05 2024-04-18T14:43:35.547 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:35.547 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:35.547 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_started", 2024-04-18T14:43:35.548 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:34.727126+0000", 2024-04-18T14:43:35.548 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.0421999999999999e-05 2024-04-18T14:43:35.548 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:35.548 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:35.548 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_committed", 2024-04-18T14:43:35.548 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:34.727704+0000", 2024-04-18T14:43:35.548 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00057789799999999998 2024-04-18T14:43:35.548 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:35.548 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:35.548 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-04-18T14:43:35.548 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:34.727735+0000", 2024-04-18T14:43:35.548 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.0543999999999998e-05 2024-04-18T14:43:35.548 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:43:35.548 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-04-18T14:43:35.549 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:43:35.549 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:43:35.549 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-04-18T14:43:35.549 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-04-18T14:43:35.550 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-18T14:43:35.551 INFO:tasks.ceph.osd.10.smithi119.stderr:2024-04-18T14:43:35.550+0000 7f6f24c12640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 10 (PID: 24898) UID: 0 2024-04-18T14:43:35.651 INFO:tasks.ceph.osd.5.smithi096.stderr:2024-04-18T14:43:35.651+0000 7fc33f25b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 24889) UID: 0 2024-04-18T14:43:35.682 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2024-04-18T14:43:35.682 INFO:teuthology.orchestra.run.smithi096.stdout: "ops": [], 2024-04-18T14:43:35.682 INFO:teuthology.orchestra.run.smithi096.stdout: "num_ops": 0 2024-04-18T14:43:35.682 INFO:teuthology.orchestra.run.smithi096.stdout:} 2024-04-18T14:43:35.696 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-18T14:43:35.713 INFO:tasks.rados.rados.0.smithi134.stdout:65: done (0 left) 2024-04-18T14:43:35.713 INFO:tasks.rados.rados.0.smithi134.stdout:append oid 37 current snap is 3 2024-04-18T14:43:35.713 INFO:tasks.rados.rados.0.smithi134.stdout:66: seq_num 52 ranges {606208=507904,1114112=376832} 2024-04-18T14:43:35.721 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-04-18T14:43:35.726 INFO:tasks.rados.rados.0.smithi134.stdout:66: writing smithi13430248-37 from 606208 to 1114112 tid 1 2024-04-18T14:43:35.731 INFO:tasks.rados.rados.0.smithi134.stdout:66: writing smithi13430248-37 from 1114112 to 1490944 tid 2 2024-04-18T14:43:35.731 INFO:tasks.rados.rados.0.smithi134.stdout:67: snap_remove snap 1 2024-04-18T14:43:35.786 INFO:tasks.ceph.osd.9.smithi096.stderr:2024-04-18T14:43:35.787+0000 7fa2c1cbf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 9 (PID: 24891) UID: 0 2024-04-18T14:43:35.852 INFO:tasks.ceph.osd.12.smithi086.stderr:2024-04-18T14:43:35.851+0000 7f6904968640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 12 (PID: 24960) UID: 0 2024-04-18T14:43:35.860 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2024-04-18T14:43:35.861 INFO:teuthology.orchestra.run.smithi096.stdout: "ops": [], 2024-04-18T14:43:35.861 INFO:teuthology.orchestra.run.smithi096.stdout: "complaint_time": 30, 2024-04-18T14:43:35.861 INFO:teuthology.orchestra.run.smithi096.stdout: "num_blocked_ops": 0 2024-04-18T14:43:35.861 INFO:teuthology.orchestra.run.smithi096.stdout:} 2024-04-18T14:43:35.874 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-18T14:43:35.954 INFO:tasks.ceph.osd.11.smithi134.stderr:2024-04-18T14:43:35.955+0000 7f2d36f12640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 11 (PID: 25216) UID: 0 2024-04-18T14:43:36.041 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2024-04-18T14:43:36.041 INFO:teuthology.orchestra.run.smithi096.stdout: "size": 20, 2024-04-18T14:43:36.041 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 600, 2024-04-18T14:43:36.041 INFO:teuthology.orchestra.run.smithi096.stdout: "ops": [] 2024-04-18T14:43:36.041 INFO:teuthology.orchestra.run.smithi096.stdout:} 2024-04-18T14:43:36.055 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-04-18T14:43:36.056 INFO:tasks.ceph.osd.13.smithi096.stderr:2024-04-18T14:43:36.055+0000 7f7e72fad640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 13 (PID: 24893) UID: 0 2024-04-18T14:43:36.156 INFO:tasks.ceph.osd.2.smithi119.stderr:2024-04-18T14:43:36.154+0000 7fcbd30c0640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 24894) UID: 0 2024-04-18T14:43:36.219 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2024-04-18T14:43:36.220 INFO:teuthology.orchestra.run.smithi096.stdout: "ops": [], 2024-04-18T14:43:36.220 INFO:teuthology.orchestra.run.smithi096.stdout: "num_ops": 0 2024-04-18T14:43:36.220 INFO:teuthology.orchestra.run.smithi096.stdout:} 2024-04-18T14:43:36.233 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-04-18T14:43:36.257 INFO:tasks.ceph.osd.7.smithi134.stderr:2024-04-18T14:43:36.259+0000 7fd7de549640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25213) UID: 0 2024-04-18T14:43:36.355 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2024-04-18T14:43:36.355 INFO:teuthology.orchestra.run.smithi096.stdout: "ops": [], 2024-04-18T14:43:36.355 INFO:teuthology.orchestra.run.smithi096.stdout: "complaint_time": 30, 2024-04-18T14:43:36.355 INFO:teuthology.orchestra.run.smithi096.stdout: "num_blocked_ops": 0 2024-04-18T14:43:36.356 INFO:teuthology.orchestra.run.smithi096.stdout:} 2024-04-18T14:43:36.357 INFO:tasks.ceph.osd.5.smithi096.stderr:2024-04-18T14:43:36.355+0000 7fc33f25b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 24889) UID: 0 2024-04-18T14:43:36.369 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-04-18T14:43:36.457 INFO:tasks.ceph.osd.2.smithi119.stderr:2024-04-18T14:43:36.458+0000 7fcbd30c0640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 24894) UID: 0 2024-04-18T14:43:36.531 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2024-04-18T14:43:36.531 INFO:teuthology.orchestra.run.smithi096.stdout: "size": 20, 2024-04-18T14:43:36.531 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 600, 2024-04-18T14:43:36.531 INFO:teuthology.orchestra.run.smithi096.stdout: "ops": [ 2024-04-18T14:43:36.531 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:36.531 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "MOSDECSubOpWrite(3.9s1 35/30 ECSubWrite(tid=27, reqid=client.4559.0:175, at_version=35'15, trim_to=0'0, roll_forward_to=33'13))", 2024-04-18T14:43:36.531 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-04-18T14:43:34.711458+0000", 2024-04-18T14:43:36.531 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 1.821854007, 2024-04-18T14:43:36.531 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0021507219999999999, 2024-04-18T14:43:36.531 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-04-18T14:43:36.531 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "reached pg", 2024-04-18T14:43:36.532 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-04-18T14:43:36.532 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:36.532 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-04-18T14:43:36.532 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:34.711458+0000", 2024-04-18T14:43:36.532 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:43:36.532 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:36.532 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:36.532 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-04-18T14:43:36.532 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:34.711458+0000", 2024-04-18T14:43:36.532 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:43:36.532 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:36.532 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:36.533 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-04-18T14:43:36.533 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:34.711457+0000", 2024-04-18T14:43:36.533 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 4294967295.9999995 2024-04-18T14:43:36.533 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:36.533 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:36.533 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-04-18T14:43:36.533 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:34.711510+0000", 2024-04-18T14:43:36.533 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 5.2323e-05 2024-04-18T14:43:36.533 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:36.533 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:36.533 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-04-18T14:43:36.533 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:34.711539+0000", 2024-04-18T14:43:36.533 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.8962000000000002e-05 2024-04-18T14:43:36.533 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:36.534 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:36.534 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-04-18T14:43:36.534 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:34.711556+0000", 2024-04-18T14:43:36.534 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.7655e-05 2024-04-18T14:43:36.534 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:36.534 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:36.534 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-04-18T14:43:36.534 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:34.711669+0000", 2024-04-18T14:43:36.534 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000113008 2024-04-18T14:43:36.534 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:36.534 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:36.534 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_started", 2024-04-18T14:43:36.534 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:34.711685+0000", 2024-04-18T14:43:36.535 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.6198999999999999e-05 2024-04-18T14:43:36.535 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:36.535 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:36.535 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_committed", 2024-04-18T14:43:36.535 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:34.713561+0000", 2024-04-18T14:43:36.535 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0018756739999999999 2024-04-18T14:43:36.535 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:36.535 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:36.535 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-04-18T14:43:36.535 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:34.713608+0000", 2024-04-18T14:43:36.535 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 4.7280999999999997e-05 2024-04-18T14:43:36.535 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:43:36.535 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T14:43:36.535 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:43:36.536 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:36.536 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:36.536 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "MOSDECSubOpWrite(3.9s1 35/30 ECSubWrite(tid=28, reqid=client.4559.0:175, at_version=0'0, trim_to=0'0, roll_forward_to=35'15))", 2024-04-18T14:43:36.536 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-04-18T14:43:34.714755+0000", 2024-04-18T14:43:36.536 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 1.8185565079999999, 2024-04-18T14:43:36.536 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.001194645, 2024-04-18T14:43:36.536 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-04-18T14:43:36.536 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "reached pg", 2024-04-18T14:43:36.536 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-04-18T14:43:36.536 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:36.536 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-04-18T14:43:36.536 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:34.714755+0000", 2024-04-18T14:43:36.536 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:43:36.536 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:36.536 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:36.536 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-04-18T14:43:36.537 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:34.714755+0000", 2024-04-18T14:43:36.537 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:43:36.537 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:36.537 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:36.537 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-04-18T14:43:36.537 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:34.714753+0000", 2024-04-18T14:43:36.537 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 4294967295.9999981 2024-04-18T14:43:36.537 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:36.537 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:36.537 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-04-18T14:43:36.537 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:34.714781+0000", 2024-04-18T14:43:36.537 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.7691999999999998e-05 2024-04-18T14:43:36.537 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:36.537 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:36.538 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-04-18T14:43:36.538 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:34.714801+0000", 2024-04-18T14:43:36.538 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.9609000000000001e-05 2024-04-18T14:43:36.538 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:36.538 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:36.538 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-04-18T14:43:36.538 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:34.714814+0000", 2024-04-18T14:43:36.538 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.3519e-05 2024-04-18T14:43:36.538 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:36.538 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:36.538 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-04-18T14:43:36.538 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:34.714881+0000", 2024-04-18T14:43:36.538 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 6.6883000000000003e-05 2024-04-18T14:43:36.538 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:36.539 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:36.539 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_started", 2024-04-18T14:43:36.539 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:34.714894+0000", 2024-04-18T14:43:36.539 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.327e-05 2024-04-18T14:43:36.539 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:36.539 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:36.539 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_committed", 2024-04-18T14:43:36.539 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:34.715905+0000", 2024-04-18T14:43:36.539 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.001010658 2024-04-18T14:43:36.539 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:36.539 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:36.539 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-04-18T14:43:36.539 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:34.715950+0000", 2024-04-18T14:43:36.539 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 4.4801e-05 2024-04-18T14:43:36.540 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:43:36.540 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T14:43:36.540 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:43:36.540 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:43:36.540 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T14:43:36.540 INFO:teuthology.orchestra.run.smithi096.stdout:} 2024-04-18T14:43:36.545 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.9.asok dump_ops_in_flight 2024-04-18T14:43:36.558 INFO:tasks.ceph.osd.0.smithi086.stderr:2024-04-18T14:43:36.559+0000 7f7cdfd78640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 24953) UID: 0 2024-04-18T14:43:36.635 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-18T14:43:36.660 INFO:tasks.ceph.osd.14.smithi119.stderr:2024-04-18T14:43:36.658+0000 7f180f599640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 14 (PID: 24900) UID: 0 2024-04-18T14:43:36.666 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2024-04-18T14:43:36.666 INFO:teuthology.orchestra.run.smithi096.stdout: "ops": [], 2024-04-18T14:43:36.667 INFO:teuthology.orchestra.run.smithi096.stdout: "num_ops": 0 2024-04-18T14:43:36.667 INFO:teuthology.orchestra.run.smithi096.stdout:} 2024-04-18T14:43:36.680 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.9.asok dump_blocked_ops 2024-04-18T14:43:36.719 INFO:teuthology.orchestra.run.smithi086.stderr:nodeep-scrub is unset 2024-04-18T14:43:36.720 INFO:tasks.rados.rados.0.smithi134.stdout:67: done (1 left) 2024-04-18T14:43:36.721 INFO:tasks.rados.rados.0.smithi134.stdout:68: copy_from oid 30 from oid 17 current snap is 3 2024-04-18T14:43:36.721 INFO:tasks.rados.rados.0.smithi134.stdout:66: finishing write tid 1 to smithi13430248-37 2024-04-18T14:43:36.721 INFO:tasks.rados.rados.0.smithi134.stdout:66: finishing write tid 2 to smithi13430248-37 2024-04-18T14:43:36.721 INFO:tasks.rados.rados.0.smithi134.stdout:66: finishing write tid 3 to smithi13430248-37 2024-04-18T14:43:36.721 INFO:tasks.rados.rados.0.smithi134.stdout:66: finishing write tid 4 to smithi13430248-37 2024-04-18T14:43:36.721 INFO:tasks.rados.rados.0.smithi134.stdout:66: oid 37 updating version 0 to 13 2024-04-18T14:43:36.721 INFO:tasks.rados.rados.0.smithi134.stdout:66: oid 37 version 13 is already newer than 12 2024-04-18T14:43:36.721 INFO:tasks.rados.rados.0.smithi134.stdout:66: oid 37 updating version 13 to 14 2024-04-18T14:43:36.721 INFO:tasks.rados.rados.0.smithi134.stdout:update_object_version oid 37 v 14 (ObjNum 52 snap 3 seq_num 52) dirty exists 2024-04-18T14:43:36.721 INFO:tasks.rados.rados.0.smithi134.stdout:66: left oid 37 (ObjNum 52 snap 3 seq_num 52) 2024-04-18T14:43:36.721 INFO:tasks.rados.rados.0.smithi134.stdout:66: done (1 left) 2024-04-18T14:43:36.721 INFO:tasks.rados.rados.0.smithi134.stdout:69: delete oid 42 current snap is 3 2024-04-18T14:43:36.731 INFO:tasks.rados.rados.0.smithi134.stdout:69: done (1 left) 2024-04-18T14:43:36.731 INFO:tasks.rados.rados.0.smithi134.stdout:append oid 9 current snap is 3 2024-04-18T14:43:36.731 INFO:tasks.rados.rados.0.smithi134.stdout:70: seq_num 54 ranges {491520=540672,1032192=376832} 2024-04-18T14:43:36.750 INFO:tasks.rados.rados.0.smithi134.stdout:70: writing smithi13430248-9 from 491520 to 1032192 tid 1 2024-04-18T14:43:36.756 INFO:tasks.rados.rados.0.smithi134.stdout:70: writing smithi13430248-9 from 1032192 to 1409024 tid 2 2024-04-18T14:43:36.756 INFO:tasks.rados.rados.0.smithi134.stdout:71: delete oid 11 current snap is 3 2024-04-18T14:43:36.756 INFO:tasks.rados.rados.0.smithi134.stdout:68: finishing copy_from racing read to smithi13430248-30 2024-04-18T14:43:36.756 INFO:tasks.rados.rados.0.smithi134.stdout:68: finishing copy_from to smithi13430248-30 2024-04-18T14:43:36.757 INFO:tasks.rados.rados.0.smithi134.stdout:update_object_version oid 30 v 12 (ObjNum 37 snap 0 seq_num 37) dirty exists 2024-04-18T14:43:36.761 INFO:tasks.ceph.osd.10.smithi119.stderr:2024-04-18T14:43:36.762+0000 7f6f24c12640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 10 (PID: 24898) UID: 0 2024-04-18T14:43:36.762 INFO:tasks.rados.rados.0.smithi134.stdout:70: finishing write tid 1 to smithi13430248-9 2024-04-18T14:43:36.770 INFO:tasks.rados.rados.0.smithi134.stdout:70: finishing write tid 2 to smithi13430248-9 2024-04-18T14:43:36.770 INFO:tasks.rados.rados.0.smithi134.stdout:70: finishing write tid 3 to smithi13430248-9 2024-04-18T14:43:36.771 INFO:tasks.rados.rados.0.smithi134.stdout:68: done (2 left) 2024-04-18T14:43:36.771 INFO:tasks.rados.rados.0.smithi134.stdout:71: done (1 left) 2024-04-18T14:43:36.771 INFO:tasks.rados.rados.0.smithi134.stdout:72: read oid 14 snap 2 2024-04-18T14:43:36.771 INFO:tasks.rados.rados.0.smithi134.stdout:72: expect (ObjNum 13 snap 0 seq_num 13) 2024-04-18T14:43:36.771 INFO:tasks.rados.rados.0.smithi134.stdout:73: read oid 23 snap -1 2024-04-18T14:43:36.772 INFO:tasks.rados.rados.0.smithi134.stdout:73: expect (ObjNum 22 snap 0 seq_num 22) 2024-04-18T14:43:36.772 INFO:tasks.rados.rados.0.smithi134.stdout:74: rollback oid 25 current snap is 3 2024-04-18T14:43:36.772 INFO:tasks.rados.rados.0.smithi134.stdout:rollback oid 25 to 2 2024-04-18T14:43:36.772 INFO:tasks.rados.rados.0.smithi134.stdout:75: read oid 31 snap 0 2024-04-18T14:43:36.772 INFO:tasks.rados.rados.0.smithi134.stdout:75: expect (ObjNum 30 snap 0 seq_num 30) 2024-04-18T14:43:36.772 INFO:tasks.rados.rados.0.smithi134.stdout:76: delete oid 4 current snap is 3 2024-04-18T14:43:36.776 INFO:tasks.rados.rados.0.smithi134.stdout:70: finishing write tid 4 to smithi13430248-9 2024-04-18T14:43:36.776 INFO:tasks.rados.rados.0.smithi134.stdout:70: oid 9 updating version 0 to 14 2024-04-18T14:43:36.776 INFO:tasks.rados.rados.0.smithi134.stdout:70: oid 9 version 14 is already newer than 13 2024-04-18T14:43:36.776 INFO:tasks.rados.rados.0.smithi134.stdout:70: oid 9 version 14 is already newer than 12 2024-04-18T14:43:36.776 INFO:tasks.rados.rados.0.smithi134.stdout:update_object_version oid 9 v 14 (ObjNum 54 snap 3 seq_num 54) dirty exists 2024-04-18T14:43:36.776 INFO:tasks.rados.rados.0.smithi134.stdout:70: left oid 9 (ObjNum 54 snap 3 seq_num 54) 2024-04-18T14:43:36.779 INFO:tasks.rados.rados.0.smithi134.stdout:73: expect (ObjNum 22 snap 0 seq_num 22) 2024-04-18T14:43:36.797 INFO:teuthology.orchestra.run.smithi086.stdout:osd.0: {} 2024-04-18T14:43:36.797 INFO:teuthology.orchestra.run.smithi086.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-18T14:43:36.807 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2024-04-18T14:43:36.807 INFO:teuthology.orchestra.run.smithi096.stdout: "ops": [], 2024-04-18T14:43:36.807 INFO:teuthology.orchestra.run.smithi096.stdout: "complaint_time": 30, 2024-04-18T14:43:36.807 INFO:teuthology.orchestra.run.smithi096.stdout: "num_blocked_ops": 0 2024-04-18T14:43:36.807 INFO:teuthology.orchestra.run.smithi096.stdout:} 2024-04-18T14:43:36.808 INFO:tasks.rados.rados.0.smithi134.stdout:74: finishing rollback tid 1 to smithi13430248-25 2024-04-18T14:43:36.808 INFO:tasks.rados.rados.0.smithi134.stdout:update_object_version oid 25 v 15 (ObjNum -1507619616 snap 32520 seq_num 304) dirty dne 2024-04-18T14:43:36.808 INFO:tasks.rados.rados.0.smithi134.stdout:72: expect (ObjNum 13 snap 0 seq_num 13) 2024-04-18T14:43:36.817 INFO:teuthology.orchestra.run.smithi086.stdout:osd.1: {} 2024-04-18T14:43:36.817 INFO:teuthology.orchestra.run.smithi086.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-18T14:43:36.822 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.9.asok dump_historic_ops 2024-04-18T14:43:36.825 INFO:tasks.rados.rados.0.smithi134.stdout:75: expect (ObjNum 30 snap 0 seq_num 30) 2024-04-18T14:43:36.836 INFO:teuthology.orchestra.run.smithi086.stdout:osd.2: {} 2024-04-18T14:43:36.837 INFO:teuthology.orchestra.run.smithi086.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-18T14:43:36.849 INFO:tasks.rados.rados.0.smithi134.stdout:70: done (5 left) 2024-04-18T14:43:36.850 INFO:tasks.rados.rados.0.smithi134.stdout:72: done (4 left) 2024-04-18T14:43:36.850 INFO:tasks.rados.rados.0.smithi134.stdout:73: done (3 left) 2024-04-18T14:43:36.850 INFO:tasks.rados.rados.0.smithi134.stdout:74: done (2 left) 2024-04-18T14:43:36.850 INFO:tasks.rados.rados.0.smithi134.stdout:75: done (1 left) 2024-04-18T14:43:36.850 INFO:tasks.rados.rados.0.smithi134.stdout:76: done (0 left) 2024-04-18T14:43:36.850 INFO:tasks.rados.rados.0.smithi134.stdout:77: read oid 47 snap -1 2024-04-18T14:43:36.850 INFO:tasks.rados.rados.0.smithi134.stdout:77: expect (ObjNum 46 snap 0 seq_num 46) 2024-04-18T14:43:36.850 INFO:tasks.rados.rados.0.smithi134.stdout:78: delete oid 33 current snap is 3 2024-04-18T14:43:36.854 INFO:tasks.rados.rados.0.smithi134.stdout:78: done (1 left) 2024-04-18T14:43:36.854 INFO:tasks.rados.rados.0.smithi134.stdout:79: copy_from oid 13 from oid 45 current snap is 3 2024-04-18T14:43:36.854 INFO:tasks.rados.rados.0.smithi134.stdout:80: copy_from oid 46 from oid 30 current snap is 3 2024-04-18T14:43:36.854 INFO:tasks.rados.rados.0.smithi134.stdout:81: snap_create 2024-04-18T14:43:36.858 INFO:tasks.rados.rados.0.smithi134.stdout:77: expect (ObjNum 46 snap 0 seq_num 46) 2024-04-18T14:43:36.859 INFO:teuthology.orchestra.run.smithi086.stdout:osd.3: {} 2024-04-18T14:43:36.859 INFO:teuthology.orchestra.run.smithi086.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-18T14:43:36.861 INFO:tasks.ceph.osd.11.smithi134.stderr:2024-04-18T14:43:36.863+0000 7f2d36f12640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 11 (PID: 25216) UID: 0 2024-04-18T14:43:36.874 INFO:teuthology.orchestra.run.smithi086.stdout:osd.4: {} 2024-04-18T14:43:36.875 INFO:teuthology.orchestra.run.smithi086.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-18T14:43:36.892 INFO:teuthology.orchestra.run.smithi086.stdout:osd.5: {} 2024-04-18T14:43:36.892 INFO:teuthology.orchestra.run.smithi086.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-18T14:43:36.904 INFO:tasks.rados.rados.0.smithi134.stdout:79: finishing copy_from racing read to smithi13430248-13 2024-04-18T14:43:36.905 INFO:tasks.rados.rados.0.smithi134.stdout:79: finishing copy_from to smithi13430248-13 2024-04-18T14:43:36.905 INFO:tasks.rados.rados.0.smithi134.stdout:update_object_version oid 13 v 8 (ObjNum 44 snap 0 seq_num 44) dirty exists 2024-04-18T14:43:36.905 INFO:tasks.rados.rados.0.smithi134.stdout:80: finishing copy_from racing read to smithi13430248-46 2024-04-18T14:43:36.905 INFO:tasks.rados.rados.0.smithi134.stdout:80: finishing copy_from to smithi13430248-46 2024-04-18T14:43:36.905 INFO:tasks.rados.rados.0.smithi134.stdout:update_object_version oid 46 v 12 (ObjNum 37 snap 0 seq_num 37) dirty exists 2024-04-18T14:43:36.911 INFO:teuthology.orchestra.run.smithi086.stdout:osd.6: {} 2024-04-18T14:43:36.911 INFO:teuthology.orchestra.run.smithi086.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-18T14:43:36.932 INFO:teuthology.orchestra.run.smithi086.stdout:osd.7: {} 2024-04-18T14:43:36.932 INFO:teuthology.orchestra.run.smithi086.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-18T14:43:36.945 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2024-04-18T14:43:36.945 INFO:teuthology.orchestra.run.smithi096.stdout: "size": 20, 2024-04-18T14:43:36.946 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 600, 2024-04-18T14:43:36.946 INFO:teuthology.orchestra.run.smithi096.stdout: "ops": [ 2024-04-18T14:43:36.946 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:36.946 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "MOSDECSubOpWrite(3.as3 35/30 ECSubWrite(tid=16, reqid=client.4559.0:176, at_version=35'10, trim_to=0'0, roll_forward_to=33'8))", 2024-04-18T14:43:36.946 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-04-18T14:43:34.719444+0000", 2024-04-18T14:43:36.946 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 2.2275853799999998, 2024-04-18T14:43:36.946 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.001980931, 2024-04-18T14:43:36.946 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-04-18T14:43:36.946 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "reached pg", 2024-04-18T14:43:36.946 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-04-18T14:43:36.946 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:36.946 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-04-18T14:43:36.946 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:34.719444+0000", 2024-04-18T14:43:36.947 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:43:36.947 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:36.947 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:36.947 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-04-18T14:43:36.947 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:34.719444+0000", 2024-04-18T14:43:36.947 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:43:36.947 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:36.947 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:36.947 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-04-18T14:43:36.947 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:34.719443+0000", 2024-04-18T14:43:36.947 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 4294967295.999999 2024-04-18T14:43:36.947 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:36.947 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:36.948 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-04-18T14:43:36.948 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:34.719504+0000", 2024-04-18T14:43:36.948 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 6.0559000000000001e-05 2024-04-18T14:43:36.948 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:36.948 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:36.948 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-04-18T14:43:36.948 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:34.719537+0000", 2024-04-18T14:43:36.948 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.3429000000000001e-05 2024-04-18T14:43:36.948 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:36.948 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:36.948 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-04-18T14:43:36.948 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:34.719566+0000", 2024-04-18T14:43:36.948 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.8904999999999999e-05 2024-04-18T14:43:36.948 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:36.949 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:36.949 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-04-18T14:43:36.949 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:34.719669+0000", 2024-04-18T14:43:36.949 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000102837 2024-04-18T14:43:36.949 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:36.949 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:36.949 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_started", 2024-04-18T14:43:36.949 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:34.719687+0000", 2024-04-18T14:43:36.949 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.8133000000000001e-05 2024-04-18T14:43:36.949 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:36.949 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:36.949 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_committed", 2024-04-18T14:43:36.949 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:34.721366+0000", 2024-04-18T14:43:36.949 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.001678208 2024-04-18T14:43:36.950 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:36.950 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:36.950 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-04-18T14:43:36.950 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:34.721425+0000", 2024-04-18T14:43:36.950 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 5.9636000000000003e-05 2024-04-18T14:43:36.950 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:43:36.950 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T14:43:36.950 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:43:36.950 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:36.950 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:36.950 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "MOSDECSubOpWrite(3.as3 35/30 ECSubWrite(tid=17, reqid=client.4559.0:176, at_version=0'0, trim_to=0'0, roll_forward_to=35'10))", 2024-04-18T14:43:36.950 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-04-18T14:43:34.727119+0000", 2024-04-18T14:43:36.950 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 2.2199109359999998, 2024-04-18T14:43:36.950 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.001465056, 2024-04-18T14:43:36.950 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-04-18T14:43:36.951 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "reached pg", 2024-04-18T14:43:36.951 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-04-18T14:43:36.951 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:36.951 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-04-18T14:43:36.951 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:34.727119+0000", 2024-04-18T14:43:36.951 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:43:36.951 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:36.951 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:36.951 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-04-18T14:43:36.951 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:34.727119+0000", 2024-04-18T14:43:36.951 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:43:36.951 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:36.951 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:36.952 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-04-18T14:43:36.952 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:34.727117+0000", 2024-04-18T14:43:36.952 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 4294967295.9999981 2024-04-18T14:43:36.952 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:36.952 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:36.952 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-04-18T14:43:36.952 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:34.727140+0000", 2024-04-18T14:43:36.952 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.3164999999999999e-05 2024-04-18T14:43:36.952 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:36.952 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:36.952 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-04-18T14:43:36.952 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:34.727170+0000", 2024-04-18T14:43:36.952 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.0032e-05 2024-04-18T14:43:36.952 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:36.952 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:36.953 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-04-18T14:43:36.953 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:34.727203+0000", 2024-04-18T14:43:36.953 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.2400999999999997e-05 2024-04-18T14:43:36.953 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:36.953 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:36.953 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-04-18T14:43:36.953 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:34.727324+0000", 2024-04-18T14:43:36.953 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000120994 2024-04-18T14:43:36.953 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:36.953 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:36.953 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_started", 2024-04-18T14:43:36.953 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:34.727351+0000", 2024-04-18T14:43:36.953 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.7847999999999998e-05 2024-04-18T14:43:36.953 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:36.954 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:36.954 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_committed", 2024-04-18T14:43:36.954 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:34.728544+0000", 2024-04-18T14:43:36.954 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.001192432 2024-04-18T14:43:36.954 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:36.954 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:36.954 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-04-18T14:43:36.954 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:34.728584+0000", 2024-04-18T14:43:36.954 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.9934000000000001e-05 2024-04-18T14:43:36.954 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:43:36.954 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T14:43:36.954 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:43:36.954 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:36.954 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:36.955 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "MOSDECSubOpWrite(3.as3 36/30 ECSubWrite(tid=18, reqid=client.4559.0:178, at_version=36'12, trim_to=0'0, roll_forward_to=35'10))", 2024-04-18T14:43:36.955 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-04-18T14:43:35.737991+0000", 2024-04-18T14:43:36.955 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 1.2090389909999999, 2024-04-18T14:43:36.955 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0022125930000000001, 2024-04-18T14:43:36.955 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-04-18T14:43:36.955 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "reached pg", 2024-04-18T14:43:36.955 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-04-18T14:43:36.955 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:36.955 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-04-18T14:43:36.955 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:35.737991+0000", 2024-04-18T14:43:36.955 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:43:36.955 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:36.955 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:36.955 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-04-18T14:43:36.956 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:35.737991+0000", 2024-04-18T14:43:36.956 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:43:36.956 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:36.956 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:36.956 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-04-18T14:43:36.956 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:35.737990+0000", 2024-04-18T14:43:36.956 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 4294967295.9999995 2024-04-18T14:43:36.956 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:36.956 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:36.956 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-04-18T14:43:36.956 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:35.738352+0000", 2024-04-18T14:43:36.956 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00036129400000000001 2024-04-18T14:43:36.956 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:36.956 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:36.956 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-04-18T14:43:36.956 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:35.738380+0000", 2024-04-18T14:43:36.957 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.7971e-05 2024-04-18T14:43:36.957 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:36.957 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:36.957 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-04-18T14:43:36.957 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:35.738396+0000", 2024-04-18T14:43:36.957 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.5988999999999999e-05 2024-04-18T14:43:36.957 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:36.957 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:36.957 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-04-18T14:43:36.957 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:35.738470+0000", 2024-04-18T14:43:36.957 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 7.4394000000000006e-05 2024-04-18T14:43:36.957 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:36.957 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:36.957 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_started", 2024-04-18T14:43:36.957 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:35.738483+0000", 2024-04-18T14:43:36.958 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.3447e-05 2024-04-18T14:43:36.958 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:36.958 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:36.958 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_committed", 2024-04-18T14:43:36.958 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:35.740181+0000", 2024-04-18T14:43:36.958 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0016976890000000001 2024-04-18T14:43:36.958 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:36.958 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:36.958 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-04-18T14:43:36.958 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:35.740203+0000", 2024-04-18T14:43:36.958 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.2161999999999999e-05 2024-04-18T14:43:36.958 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:43:36.958 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T14:43:36.958 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:43:36.959 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:36.959 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:36.959 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "MOSDECSubOpWrite(3.as3 36/30 ECSubWrite(tid=19, reqid=client.4559.0:179, at_version=36'13, trim_to=0'0, roll_forward_to=35'10))", 2024-04-18T14:43:36.959 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-04-18T14:43:35.744177+0000", 2024-04-18T14:43:36.959 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 1.2028525000000001, 2024-04-18T14:43:36.959 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00092180799999999998, 2024-04-18T14:43:36.959 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-04-18T14:43:36.959 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "reached pg", 2024-04-18T14:43:36.959 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-04-18T14:43:36.959 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:36.959 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-04-18T14:43:36.959 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:35.744177+0000", 2024-04-18T14:43:36.959 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:43:36.959 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:36.960 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:36.960 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-04-18T14:43:36.960 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:35.744177+0000", 2024-04-18T14:43:36.960 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:43:36.960 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:36.960 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:36.960 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-04-18T14:43:36.960 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:35.744176+0000", 2024-04-18T14:43:36.960 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 4294967295.9999986 2024-04-18T14:43:36.960 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:36.960 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:36.960 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-04-18T14:43:36.960 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:35.744308+0000", 2024-04-18T14:43:36.960 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000132626 2024-04-18T14:43:36.961 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:36.961 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:36.961 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-04-18T14:43:36.961 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:35.744338+0000", 2024-04-18T14:43:36.961 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.9675999999999998e-05 2024-04-18T14:43:36.961 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:36.961 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:36.961 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-04-18T14:43:36.961 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:35.744361+0000", 2024-04-18T14:43:36.961 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.2962000000000001e-05 2024-04-18T14:43:36.961 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:36.961 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:36.961 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-04-18T14:43:36.961 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:35.744407+0000", 2024-04-18T14:43:36.962 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 4.5883000000000001e-05 2024-04-18T14:43:36.962 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:36.962 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:36.962 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_started", 2024-04-18T14:43:36.962 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:35.744413+0000", 2024-04-18T14:43:36.962 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 6.7850000000000003e-06 2024-04-18T14:43:36.962 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:36.962 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:36.962 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_committed", 2024-04-18T14:43:36.962 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:35.745076+0000", 2024-04-18T14:43:36.962 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00066273000000000005 2024-04-18T14:43:36.962 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:36.962 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:36.963 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-04-18T14:43:36.963 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:35.745099+0000", 2024-04-18T14:43:36.963 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.2733000000000001e-05 2024-04-18T14:43:36.963 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:43:36.963 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T14:43:36.963 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:43:36.963 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:36.963 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:36.963 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "MOSDECSubOpWrite(3.as3 36/30 ECSubWrite(tid=21, reqid=client.4559.0:180, at_version=0'0, trim_to=0'0, roll_forward_to=36'14))", 2024-04-18T14:43:36.963 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-04-18T14:43:35.748986+0000", 2024-04-18T14:43:36.963 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 1.198043325, 2024-04-18T14:43:36.963 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.001167579, 2024-04-18T14:43:36.963 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-04-18T14:43:36.963 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "reached pg", 2024-04-18T14:43:36.963 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-04-18T14:43:36.964 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:36.964 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-04-18T14:43:36.964 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:35.748986+0000", 2024-04-18T14:43:36.964 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:43:36.964 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:36.964 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:36.964 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-04-18T14:43:36.964 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:35.748986+0000", 2024-04-18T14:43:36.964 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:43:36.964 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:36.964 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:36.964 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-04-18T14:43:36.964 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:35.748985+0000", 2024-04-18T14:43:36.964 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 4294967295.999999 2024-04-18T14:43:36.964 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:36.965 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:36.965 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-04-18T14:43:36.965 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:35.749001+0000", 2024-04-18T14:43:36.965 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.5681000000000001e-05 2024-04-18T14:43:36.965 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:36.965 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:36.965 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-04-18T14:43:36.965 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:35.749025+0000", 2024-04-18T14:43:36.965 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.4261999999999999e-05 2024-04-18T14:43:36.965 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:36.965 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:36.965 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-04-18T14:43:36.965 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:35.749038+0000", 2024-04-18T14:43:36.965 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.258e-05 2024-04-18T14:43:36.965 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:36.966 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:36.966 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-04-18T14:43:36.966 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:35.749152+0000", 2024-04-18T14:43:36.966 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000113891 2024-04-18T14:43:36.966 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:36.966 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:36.966 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_started", 2024-04-18T14:43:36.966 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:35.749176+0000", 2024-04-18T14:43:36.966 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.4465999999999999e-05 2024-04-18T14:43:36.966 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:36.966 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:36.966 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_committed", 2024-04-18T14:43:36.966 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:35.750126+0000", 2024-04-18T14:43:36.966 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00095033900000000002 2024-04-18T14:43:36.966 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:36.967 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:36.967 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-04-18T14:43:36.967 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:35.750154+0000", 2024-04-18T14:43:36.967 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.7379999999999999e-05 2024-04-18T14:43:36.967 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:43:36.967 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T14:43:36.967 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:43:36.967 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:36.967 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:36.967 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "MOSDECSubOpWrite(3.bs3 37/30 ECSubWrite(tid=16, reqid=client.4559.0:185, at_version=37'8, trim_to=0'0, roll_forward_to=33'6))", 2024-04-18T14:43:36.967 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-04-18T14:43:36.726068+0000", 2024-04-18T14:43:36.967 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 0.22096146999999999, 2024-04-18T14:43:36.967 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0015823670000000001, 2024-04-18T14:43:36.967 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-04-18T14:43:36.967 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "reached pg", 2024-04-18T14:43:36.967 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-04-18T14:43:36.968 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:36.968 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-04-18T14:43:36.968 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:36.726068+0000", 2024-04-18T14:43:36.968 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:43:36.968 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:36.968 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:36.968 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-04-18T14:43:36.968 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:36.726068+0000", 2024-04-18T14:43:36.968 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:43:36.968 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:36.968 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:36.968 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-04-18T14:43:36.968 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:36.726068+0000", 2024-04-18T14:43:36.968 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 4294967295.9999995 2024-04-18T14:43:36.968 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:36.969 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:36.969 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-04-18T14:43:36.969 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:36.726113+0000", 2024-04-18T14:43:36.969 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 4.5602999999999997e-05 2024-04-18T14:43:36.969 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:36.969 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:36.969 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-04-18T14:43:36.969 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:36.726127+0000", 2024-04-18T14:43:36.969 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.4114000000000001e-05 2024-04-18T14:43:36.969 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:36.969 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:36.969 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-04-18T14:43:36.969 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:36.726142+0000", 2024-04-18T14:43:36.969 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.5098e-05 2024-04-18T14:43:36.969 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:36.970 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:36.970 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-04-18T14:43:36.970 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:36.726199+0000", 2024-04-18T14:43:36.970 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 5.6592000000000003e-05 2024-04-18T14:43:36.970 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:36.970 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:36.970 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_started", 2024-04-18T14:43:36.970 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:36.726209+0000", 2024-04-18T14:43:36.970 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 9.4970000000000007e-06 2024-04-18T14:43:36.970 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:36.970 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:36.970 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_committed", 2024-04-18T14:43:36.970 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:36.727620+0000", 2024-04-18T14:43:36.970 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.001411352 2024-04-18T14:43:36.971 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:36.971 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:36.971 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-04-18T14:43:36.971 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:36.727651+0000", 2024-04-18T14:43:36.971 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.0626999999999997e-05 2024-04-18T14:43:36.971 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:43:36.971 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T14:43:36.971 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:43:36.971 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:36.971 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:36.971 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "MOSDECSubOpWrite(3.7s2 37/30 ECSubWrite(tid=35, reqid=client.4559.0:183, at_version=37'11, trim_to=0'0, roll_forward_to=33'9))", 2024-04-18T14:43:36.971 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-04-18T14:43:36.748095+0000", 2024-04-18T14:43:36.971 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 0.19893486499999999, 2024-04-18T14:43:36.971 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.001760033, 2024-04-18T14:43:36.971 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-04-18T14:43:36.972 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "reached pg", 2024-04-18T14:43:36.972 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-04-18T14:43:36.972 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:36.972 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-04-18T14:43:36.972 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:36.748095+0000", 2024-04-18T14:43:36.972 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:43:36.972 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:36.972 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:36.972 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-04-18T14:43:36.972 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:36.748095+0000", 2024-04-18T14:43:36.972 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:43:36.972 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:36.972 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:36.972 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-04-18T14:43:36.972 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:36.748094+0000", 2024-04-18T14:43:36.973 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 4294967295.9999995 2024-04-18T14:43:36.973 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:36.973 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:36.973 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-04-18T14:43:36.973 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:36.748576+0000", 2024-04-18T14:43:36.973 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00048122900000000001 2024-04-18T14:43:36.973 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:36.973 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:36.973 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-04-18T14:43:36.973 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:36.748591+0000", 2024-04-18T14:43:36.973 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.5398000000000001e-05 2024-04-18T14:43:36.973 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:36.973 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:36.973 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-04-18T14:43:36.974 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:36.748603+0000", 2024-04-18T14:43:36.974 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.2078e-05 2024-04-18T14:43:36.974 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:36.974 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:36.974 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-04-18T14:43:36.974 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:36.748669+0000", 2024-04-18T14:43:36.974 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 6.5759000000000005e-05 2024-04-18T14:43:36.974 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:36.974 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:36.974 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_started", 2024-04-18T14:43:36.974 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:36.748679+0000", 2024-04-18T14:43:36.974 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.0241000000000001e-05 2024-04-18T14:43:36.974 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:36.974 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:36.975 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_committed", 2024-04-18T14:43:36.975 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:36.749822+0000", 2024-04-18T14:43:36.975 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0011429140000000001 2024-04-18T14:43:36.975 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:36.975 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:36.975 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-04-18T14:43:36.975 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:36.749855+0000", 2024-04-18T14:43:36.975 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.2780999999999997e-05 2024-04-18T14:43:36.975 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:43:36.975 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T14:43:36.975 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:43:36.975 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:36.975 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:36.975 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "MOSDECSubOpWrite(3.7s2 37/30 ECSubWrite(tid=36, reqid=client.4559.0:183, at_version=0'0, trim_to=0'0, roll_forward_to=37'11))", 2024-04-18T14:43:36.976 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-04-18T14:43:36.757068+0000", 2024-04-18T14:43:36.976 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 0.189961135, 2024-04-18T14:43:36.976 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00071151000000000005, 2024-04-18T14:43:36.976 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-04-18T14:43:36.976 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "reached pg", 2024-04-18T14:43:36.976 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-04-18T14:43:36.976 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:36.976 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-04-18T14:43:36.976 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:36.757068+0000", 2024-04-18T14:43:36.977 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:43:36.977 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:36.977 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:36.977 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-04-18T14:43:36.977 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:36.757068+0000", 2024-04-18T14:43:36.977 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:43:36.977 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:36.977 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:36.977 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-04-18T14:43:36.977 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:36.757066+0000", 2024-04-18T14:43:36.977 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 4294967295.9999971 2024-04-18T14:43:36.977 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:36.977 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:36.978 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-04-18T14:43:36.978 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:36.757089+0000", 2024-04-18T14:43:36.978 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.2756e-05 2024-04-18T14:43:36.978 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:36.978 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:36.978 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-04-18T14:43:36.978 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:36.757118+0000", 2024-04-18T14:43:36.978 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.9244999999999999e-05 2024-04-18T14:43:36.978 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:36.978 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:36.978 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-04-18T14:43:36.978 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:36.757132+0000", 2024-04-18T14:43:36.978 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.4175999999999999e-05 2024-04-18T14:43:36.978 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:36.979 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:36.979 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-04-18T14:43:36.979 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:36.757201+0000", 2024-04-18T14:43:36.979 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 6.9159000000000006e-05 2024-04-18T14:43:36.979 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:36.979 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:36.979 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_started", 2024-04-18T14:43:36.979 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:36.757209+0000", 2024-04-18T14:43:36.979 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 8.3429999999999996e-06 2024-04-18T14:43:36.979 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:36.979 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:36.979 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_committed", 2024-04-18T14:43:36.979 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:36.757746+0000", 2024-04-18T14:43:36.979 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00053608400000000004 2024-04-18T14:43:36.979 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:36.980 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:36.980 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-04-18T14:43:36.980 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:36.757780+0000", 2024-04-18T14:43:36.980 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.4446999999999997e-05 2024-04-18T14:43:36.980 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:43:36.980 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T14:43:36.980 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:43:36.980 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:36.980 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:36.980 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "MOSDECSubOpWrite(3.1s2 37/30 ECSubWrite(tid=18, reqid=client.4559.0:186, at_version=37'12, trim_to=0'0, roll_forward_to=33'10))", 2024-04-18T14:43:36.980 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-04-18T14:43:36.760051+0000", 2024-04-18T14:43:36.980 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 0.186978855, 2024-04-18T14:43:36.980 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0021448830000000002, 2024-04-18T14:43:36.981 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-04-18T14:43:36.981 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "reached pg", 2024-04-18T14:43:36.981 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-04-18T14:43:36.981 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:36.981 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-04-18T14:43:36.981 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:36.760051+0000", 2024-04-18T14:43:36.981 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:43:36.981 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:36.981 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:36.981 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-04-18T14:43:36.981 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:36.760051+0000", 2024-04-18T14:43:36.981 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:43:36.981 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:36.981 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:36.982 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-04-18T14:43:36.982 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:36.760050+0000", 2024-04-18T14:43:36.982 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 4294967295.9999995 2024-04-18T14:43:36.982 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:36.982 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:36.982 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-04-18T14:43:36.982 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:36.760726+0000", 2024-04-18T14:43:36.982 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00067511800000000005 2024-04-18T14:43:36.982 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:36.982 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:36.982 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-04-18T14:43:36.983 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:36.760741+0000", 2024-04-18T14:43:36.983 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.5764999999999999e-05 2024-04-18T14:43:36.983 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:36.983 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:36.983 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-04-18T14:43:36.983 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:36.760750+0000", 2024-04-18T14:43:36.983 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 8.2670000000000006e-06 2024-04-18T14:43:36.983 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:36.983 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:36.983 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-04-18T14:43:36.983 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:36.760815+0000", 2024-04-18T14:43:36.983 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 6.5833000000000005e-05 2024-04-18T14:43:36.983 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:36.983 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:36.984 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_started", 2024-04-18T14:43:36.984 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:36.760827+0000", 2024-04-18T14:43:36.984 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.1849e-05 2024-04-18T14:43:36.984 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:36.984 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:36.984 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_committed", 2024-04-18T14:43:36.984 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:36.762161+0000", 2024-04-18T14:43:36.984 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0013340730000000001 2024-04-18T14:43:36.984 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:36.984 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:36.984 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-04-18T14:43:36.984 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:36.762196+0000", 2024-04-18T14:43:36.984 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.4255999999999999e-05 2024-04-18T14:43:36.984 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:43:36.984 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T14:43:36.985 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:43:36.985 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:36.985 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:36.985 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "MOSDECSubOpWrite(3.1s2 37/30 ECSubWrite(tid=19, reqid=client.4559.0:187, at_version=37'13, trim_to=0'0, roll_forward_to=33'10))", 2024-04-18T14:43:36.985 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-04-18T14:43:36.762821+0000", 2024-04-18T14:43:36.985 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 0.18420835699999999, 2024-04-18T14:43:36.985 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.001711862, 2024-04-18T14:43:36.985 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-04-18T14:43:36.985 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "reached pg", 2024-04-18T14:43:36.985 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-04-18T14:43:36.985 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:36.985 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-04-18T14:43:36.985 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:36.762821+0000", 2024-04-18T14:43:36.985 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:43:36.985 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:36.985 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:36.986 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-04-18T14:43:36.986 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:36.762821+0000", 2024-04-18T14:43:36.986 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:43:36.986 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:36.986 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:36.986 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-04-18T14:43:36.986 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:36.762820+0000", 2024-04-18T14:43:36.986 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 4294967295.999999 2024-04-18T14:43:36.986 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:36.986 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:36.986 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-04-18T14:43:36.986 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:36.762933+0000", 2024-04-18T14:43:36.986 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00011226 2024-04-18T14:43:36.987 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:36.987 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:36.987 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-04-18T14:43:36.987 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:36.762952+0000", 2024-04-18T14:43:36.987 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.9752e-05 2024-04-18T14:43:36.987 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:36.987 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:36.987 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-04-18T14:43:36.987 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:36.762963+0000", 2024-04-18T14:43:36.987 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.0822000000000001e-05 2024-04-18T14:43:36.987 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:36.987 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:36.987 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-04-18T14:43:36.988 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:36.763024+0000", 2024-04-18T14:43:36.988 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 6.0615000000000002e-05 2024-04-18T14:43:36.988 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:36.988 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:36.988 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_started", 2024-04-18T14:43:36.988 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:36.763032+0000", 2024-04-18T14:43:36.988 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 7.7999999999999999e-06 2024-04-18T14:43:36.988 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:36.988 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:36.988 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_committed", 2024-04-18T14:43:36.988 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:36.764508+0000", 2024-04-18T14:43:36.988 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0014759389999999999 2024-04-18T14:43:36.988 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:36.989 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:36.989 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-04-18T14:43:36.989 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:36.764533+0000", 2024-04-18T14:43:36.989 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.5598000000000001e-05 2024-04-18T14:43:36.989 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:43:36.989 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T14:43:36.989 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:43:36.989 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:36.989 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:36.989 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "MOSDECSubOpWrite(3.1s2 37/30 ECSubWrite(tid=20, reqid=client.4559.0:188, at_version=37'14, trim_to=0'0, roll_forward_to=33'10))", 2024-04-18T14:43:36.989 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-04-18T14:43:36.764813+0000", 2024-04-18T14:43:36.989 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 0.18221681000000001, 2024-04-18T14:43:36.989 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00071584700000000003, 2024-04-18T14:43:36.990 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-04-18T14:43:36.990 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "reached pg", 2024-04-18T14:43:36.990 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-04-18T14:43:36.990 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:36.990 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-04-18T14:43:36.990 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:36.764813+0000", 2024-04-18T14:43:36.990 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:43:36.990 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:36.990 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:36.990 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-04-18T14:43:36.990 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:36.764813+0000", 2024-04-18T14:43:36.990 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:43:36.990 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:36.990 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:36.990 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-04-18T14:43:36.991 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:36.764812+0000", 2024-04-18T14:43:36.991 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 4294967295.999999 2024-04-18T14:43:36.991 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:36.991 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:36.991 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-04-18T14:43:36.991 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:36.764879+0000", 2024-04-18T14:43:36.991 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 6.7416999999999995e-05 2024-04-18T14:43:36.991 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:36.991 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:36.991 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-04-18T14:43:36.991 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:36.764899+0000", 2024-04-18T14:43:36.991 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.9307999999999999e-05 2024-04-18T14:43:36.991 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:36.991 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:36.991 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-04-18T14:43:36.992 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:36.764911+0000", 2024-04-18T14:43:36.992 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.2325e-05 2024-04-18T14:43:36.992 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:36.992 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:36.992 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-04-18T14:43:36.992 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:36.764968+0000", 2024-04-18T14:43:36.992 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 5.7037000000000003e-05 2024-04-18T14:43:36.992 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:36.992 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:36.992 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_started", 2024-04-18T14:43:36.992 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:36.764978+0000", 2024-04-18T14:43:36.992 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 9.3749999999999992e-06 2024-04-18T14:43:36.992 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:36.992 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:36.993 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_committed", 2024-04-18T14:43:36.993 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:36.765495+0000", 2024-04-18T14:43:36.993 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00051775699999999998 2024-04-18T14:43:36.993 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:36.993 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:36.993 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-04-18T14:43:36.993 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:36.765529+0000", 2024-04-18T14:43:36.993 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.3358999999999997e-05 2024-04-18T14:43:36.993 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:43:36.993 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T14:43:36.993 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:43:36.993 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:36.993 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:36.993 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "MOSDECSubOpWrite(3.as3 37/30 ECSubWrite(tid=23, reqid=client.4559.0:190, at_version=37'16, trim_to=0'0, roll_forward_to=36'14))", 2024-04-18T14:43:36.994 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-04-18T14:43:36.766473+0000", 2024-04-18T14:43:36.994 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 0.18055647599999999, 2024-04-18T14:43:36.994 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00093055899999999997, 2024-04-18T14:43:36.994 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-04-18T14:43:36.994 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "reached pg", 2024-04-18T14:43:36.994 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-04-18T14:43:36.994 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:36.994 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-04-18T14:43:36.994 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:36.766473+0000", 2024-04-18T14:43:36.994 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:43:36.994 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:36.994 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:36.994 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-04-18T14:43:36.994 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:36.766473+0000", 2024-04-18T14:43:36.995 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:43:36.995 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:36.995 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:36.995 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-04-18T14:43:36.995 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:36.766473+0000", 2024-04-18T14:43:36.995 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 4294967295.9999995 2024-04-18T14:43:36.995 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:36.995 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:36.995 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-04-18T14:43:36.995 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:36.766494+0000", 2024-04-18T14:43:36.995 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.0713e-05 2024-04-18T14:43:36.995 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:36.995 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:36.995 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-04-18T14:43:36.996 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:36.766505+0000", 2024-04-18T14:43:36.996 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.1364e-05 2024-04-18T14:43:36.996 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:36.996 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:36.996 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-04-18T14:43:36.996 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:36.766513+0000", 2024-04-18T14:43:36.996 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 8.2749999999999995e-06 2024-04-18T14:43:36.996 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:36.996 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:36.996 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-04-18T14:43:36.996 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:36.766572+0000", 2024-04-18T14:43:36.996 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 5.9178000000000002e-05 2024-04-18T14:43:36.996 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:36.996 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:36.996 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_started", 2024-04-18T14:43:36.997 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:36.766579+0000", 2024-04-18T14:43:36.997 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 6.99e-06 2024-04-18T14:43:36.997 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:36.997 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:36.997 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_committed", 2024-04-18T14:43:36.997 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:36.767359+0000", 2024-04-18T14:43:36.997 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00077919899999999995 2024-04-18T14:43:36.997 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:36.997 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:36.997 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-04-18T14:43:36.997 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:36.767404+0000", 2024-04-18T14:43:36.997 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 4.5157000000000002e-05 2024-04-18T14:43:36.997 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:43:36.997 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T14:43:36.997 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:43:36.998 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:36.998 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:36.998 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "MOSDECSubOpWrite(3.as3 37/30 ECSubWrite(tid=24, reqid=osd.3.0:24, at_version=37'18, trim_to=0'0, roll_forward_to=36'14))", 2024-04-18T14:43:36.998 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-04-18T14:43:36.770196+0000", 2024-04-18T14:43:36.998 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 0.17683400599999999, 2024-04-18T14:43:36.998 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000807896, 2024-04-18T14:43:36.998 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-04-18T14:43:36.998 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "reached pg", 2024-04-18T14:43:36.998 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-04-18T14:43:36.998 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:36.998 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-04-18T14:43:36.998 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:36.770196+0000", 2024-04-18T14:43:36.998 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:43:36.998 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:36.998 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:36.999 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-04-18T14:43:36.999 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:36.770196+0000", 2024-04-18T14:43:36.999 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:43:36.999 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:36.999 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:36.999 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-04-18T14:43:36.999 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:36.770195+0000", 2024-04-18T14:43:36.999 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 4294967295.999999 2024-04-18T14:43:36.999 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:36.999 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:36.999 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-04-18T14:43:36.999 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:36.770214+0000", 2024-04-18T14:43:36.999 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.9249000000000002e-05 2024-04-18T14:43:36.999 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:36.999 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:36.999 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-04-18T14:43:37.000 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:36.770228+0000", 2024-04-18T14:43:37.000 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.4153e-05 2024-04-18T14:43:37.000 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:37.000 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:37.000 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-04-18T14:43:37.000 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:36.770235+0000", 2024-04-18T14:43:37.000 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 6.9469999999999997e-06 2024-04-18T14:43:37.000 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:37.000 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:37.000 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-04-18T14:43:37.000 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:36.770290+0000", 2024-04-18T14:43:37.000 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 5.4679000000000003e-05 2024-04-18T14:43:37.000 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:37.000 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:37.000 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_started", 2024-04-18T14:43:37.001 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:36.770296+0000", 2024-04-18T14:43:37.001 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 6.5039999999999999e-06 2024-04-18T14:43:37.001 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:37.001 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:37.001 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_committed", 2024-04-18T14:43:37.001 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:36.770940+0000", 2024-04-18T14:43:37.001 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00064381200000000001 2024-04-18T14:43:37.001 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:37.001 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:37.001 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-04-18T14:43:37.001 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:36.771004+0000", 2024-04-18T14:43:37.001 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 6.3347000000000002e-05 2024-04-18T14:43:37.001 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:43:37.001 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T14:43:37.001 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:43:37.002 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:37.002 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:37.002 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "MOSDECSubOpWrite(3.as3 37/30 ECSubWrite(tid=25, reqid=osd.3.0:25, at_version=37'20, trim_to=0'0, roll_forward_to=36'14))", 2024-04-18T14:43:37.002 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-04-18T14:43:36.772525+0000", 2024-04-18T14:43:37.002 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 0.17450489699999999, 2024-04-18T14:43:37.002 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00078032299999999998, 2024-04-18T14:43:37.002 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-04-18T14:43:37.002 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "reached pg", 2024-04-18T14:43:37.002 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-04-18T14:43:37.002 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:37.002 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-04-18T14:43:37.002 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:36.772525+0000", 2024-04-18T14:43:37.002 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:43:37.002 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:37.003 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:37.003 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-04-18T14:43:37.003 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:36.772525+0000", 2024-04-18T14:43:37.003 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:43:37.003 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:37.003 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:37.003 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-04-18T14:43:37.003 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:36.772524+0000", 2024-04-18T14:43:37.003 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 4294967295.999999 2024-04-18T14:43:37.003 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:37.003 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:37.003 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-04-18T14:43:37.003 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:36.772545+0000", 2024-04-18T14:43:37.003 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.1282999999999999e-05 2024-04-18T14:43:37.003 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:37.004 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:37.004 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-04-18T14:43:37.004 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:36.772559+0000", 2024-04-18T14:43:37.004 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.4183e-05 2024-04-18T14:43:37.004 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:37.004 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:37.004 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-04-18T14:43:37.004 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:36.772569+0000", 2024-04-18T14:43:37.004 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 9.6239999999999997e-06 2024-04-18T14:43:37.004 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:37.004 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:37.004 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-04-18T14:43:37.004 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:36.772624+0000", 2024-04-18T14:43:37.004 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 5.5229000000000003e-05 2024-04-18T14:43:37.005 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:37.005 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:37.005 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_started", 2024-04-18T14:43:37.005 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:36.772631+0000", 2024-04-18T14:43:37.005 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 6.4409999999999998e-06 2024-04-18T14:43:37.005 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:37.005 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:37.005 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_committed", 2024-04-18T14:43:37.005 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:36.773265+0000", 2024-04-18T14:43:37.005 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00063394299999999998 2024-04-18T14:43:37.005 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:37.005 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:37.005 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-04-18T14:43:37.005 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:36.773305+0000", 2024-04-18T14:43:37.006 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 4.0414999999999998e-05 2024-04-18T14:43:37.006 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:43:37.006 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T14:43:37.006 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:43:37.006 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:37.006 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:37.006 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "MOSDECSubOpWrite(3.as3 37/30 ECSubWrite(tid=26, reqid=osd.3.0:25, at_version=0'0, trim_to=0'0, roll_forward_to=37'20))", 2024-04-18T14:43:37.006 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-04-18T14:43:36.777324+0000", 2024-04-18T14:43:37.006 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 0.169705732, 2024-04-18T14:43:37.006 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00083973800000000003, 2024-04-18T14:43:37.006 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-04-18T14:43:37.006 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "reached pg", 2024-04-18T14:43:37.006 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-04-18T14:43:37.006 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:37.006 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-04-18T14:43:37.007 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:36.777324+0000", 2024-04-18T14:43:37.007 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:43:37.007 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:37.007 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:37.007 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-04-18T14:43:37.007 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:36.777324+0000", 2024-04-18T14:43:37.007 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:43:37.007 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:37.007 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:37.007 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-04-18T14:43:37.007 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:36.777323+0000", 2024-04-18T14:43:37.007 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 4294967295.999999 2024-04-18T14:43:37.008 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:37.008 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:37.008 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-04-18T14:43:37.008 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:36.777339+0000", 2024-04-18T14:43:37.008 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.5628999999999999e-05 2024-04-18T14:43:37.008 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:37.008 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:37.008 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-04-18T14:43:37.008 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:36.777358+0000", 2024-04-18T14:43:37.008 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.9488999999999999e-05 2024-04-18T14:43:37.008 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:37.008 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:37.008 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-04-18T14:43:37.008 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:36.777369+0000", 2024-04-18T14:43:37.008 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.0558e-05 2024-04-18T14:43:37.009 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:37.009 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:37.009 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-04-18T14:43:37.009 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:36.777428+0000", 2024-04-18T14:43:37.009 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 5.9617999999999997e-05 2024-04-18T14:43:37.009 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:37.009 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:37.009 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_started", 2024-04-18T14:43:37.009 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:36.777437+0000", 2024-04-18T14:43:37.009 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 9.0790000000000007e-06 2024-04-18T14:43:37.009 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:37.009 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:37.009 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_committed", 2024-04-18T14:43:37.009 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:36.778131+0000", 2024-04-18T14:43:37.009 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00069411099999999997 2024-04-18T14:43:37.010 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:37.010 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:37.010 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-04-18T14:43:37.010 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:36.778164+0000", 2024-04-18T14:43:37.010 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.2191999999999999e-05 2024-04-18T14:43:37.010 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:43:37.010 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T14:43:37.010 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:43:37.010 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:37.010 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:37.010 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "MOSDECSubOpWrite(3.6s6 37/30 ECSubWrite(tid=37, reqid=client.4559.0:201, at_version=37'10, trim_to=0'0, roll_forward_to=33'8))", 2024-04-18T14:43:37.010 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-04-18T14:43:36.779695+0000", 2024-04-18T14:43:37.010 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 0.16733441399999999, 2024-04-18T14:43:37.010 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.001320426, 2024-04-18T14:43:37.010 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-04-18T14:43:37.011 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "reached pg", 2024-04-18T14:43:37.011 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-04-18T14:43:37.011 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:37.011 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-04-18T14:43:37.011 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:36.779695+0000", 2024-04-18T14:43:37.011 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:43:37.011 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:37.011 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:37.011 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-04-18T14:43:37.011 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:36.779695+0000", 2024-04-18T14:43:37.011 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:43:37.012 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:37.012 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:37.012 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-04-18T14:43:37.012 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:36.779694+0000", 2024-04-18T14:43:37.012 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 4294967295.999999 2024-04-18T14:43:37.012 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:37.012 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:37.012 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-04-18T14:43:37.012 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:36.779733+0000", 2024-04-18T14:43:37.012 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.8581000000000002e-05 2024-04-18T14:43:37.012 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:37.012 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:37.012 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-04-18T14:43:37.012 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:36.779747+0000", 2024-04-18T14:43:37.013 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.3893000000000001e-05 2024-04-18T14:43:37.013 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:37.013 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:37.013 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-04-18T14:43:37.013 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:36.779758+0000", 2024-04-18T14:43:37.013 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.0847e-05 2024-04-18T14:43:37.013 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:37.013 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:37.013 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-04-18T14:43:37.013 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:36.779820+0000", 2024-04-18T14:43:37.013 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 6.2624000000000002e-05 2024-04-18T14:43:37.013 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:37.013 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:37.013 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_started", 2024-04-18T14:43:37.013 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:36.779833+0000", 2024-04-18T14:43:37.013 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.2395000000000001e-05 2024-04-18T14:43:37.014 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:37.014 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:37.014 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_committed", 2024-04-18T14:43:37.014 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:36.780965+0000", 2024-04-18T14:43:37.014 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0011319170000000001 2024-04-18T14:43:37.014 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:37.014 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:37.014 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-04-18T14:43:37.014 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:36.781016+0000", 2024-04-18T14:43:37.014 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 5.0943999999999999e-05 2024-04-18T14:43:37.014 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:43:37.014 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T14:43:37.014 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:43:37.015 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:37.015 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:37.015 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "MOSDECSubOpWrite(3.6s6 37/30 ECSubWrite(tid=38, reqid=client.4559.0:201, at_version=0'0, trim_to=0'0, roll_forward_to=37'10))", 2024-04-18T14:43:37.015 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-04-18T14:43:36.785006+0000", 2024-04-18T14:43:37.015 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 0.16202349299999999, 2024-04-18T14:43:37.015 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.001024767, 2024-04-18T14:43:37.015 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-04-18T14:43:37.015 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "reached pg", 2024-04-18T14:43:37.015 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-04-18T14:43:37.015 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:37.015 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-04-18T14:43:37.015 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:36.785006+0000", 2024-04-18T14:43:37.015 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:43:37.015 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:37.016 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:37.016 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-04-18T14:43:37.016 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:36.785006+0000", 2024-04-18T14:43:37.016 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:43:37.016 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:37.016 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:37.016 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-04-18T14:43:37.016 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:36.785005+0000", 2024-04-18T14:43:37.016 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 4294967295.999999 2024-04-18T14:43:37.016 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:37.016 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:37.016 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-04-18T14:43:37.016 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:36.785019+0000", 2024-04-18T14:43:37.016 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.3178e-05 2024-04-18T14:43:37.016 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:37.017 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:37.017 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-04-18T14:43:37.017 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:36.785034+0000", 2024-04-18T14:43:37.017 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.5707000000000001e-05 2024-04-18T14:43:37.017 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:37.017 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:37.017 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-04-18T14:43:37.017 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:36.785043+0000", 2024-04-18T14:43:37.017 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 8.8759999999999994e-06 2024-04-18T14:43:37.017 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:37.017 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:37.017 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-04-18T14:43:37.017 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:36.785098+0000", 2024-04-18T14:43:37.017 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 5.5305e-05 2024-04-18T14:43:37.017 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:37.018 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:37.018 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_started", 2024-04-18T14:43:37.018 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:36.785109+0000", 2024-04-18T14:43:37.018 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.0441999999999999e-05 2024-04-18T14:43:37.018 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:37.018 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:37.018 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_committed", 2024-04-18T14:43:37.018 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:36.785993+0000", 2024-04-18T14:43:37.018 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000884481 2024-04-18T14:43:37.018 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:37.018 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:37.018 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-04-18T14:43:37.018 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:36.786031+0000", 2024-04-18T14:43:37.018 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.7512000000000003e-05 2024-04-18T14:43:37.019 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:43:37.019 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T14:43:37.019 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:43:37.019 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:37.019 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:37.019 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "MOSDECSubOpRead(3.7s2 37/30 ECSubRead(tid=40, to_read={3:e3a0e00d:::smithi13430248-30:head=0,155648,0}, subchunks={3:e3a0e00d:::smithi13430248-30:head=[0,1]}, attrs_to_read=))", 2024-04-18T14:43:37.019 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-04-18T14:43:36.861143+0000", 2024-04-18T14:43:37.019 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 0.085886309999999993, 2024-04-18T14:43:37.019 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00075210200000000004, 2024-04-18T14:43:37.019 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-04-18T14:43:37.019 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "reached pg", 2024-04-18T14:43:37.019 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-04-18T14:43:37.019 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:37.019 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-04-18T14:43:37.019 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:36.861143+0000", 2024-04-18T14:43:37.019 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:43:37.020 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:37.020 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:37.020 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-04-18T14:43:37.020 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:36.861143+0000", 2024-04-18T14:43:37.020 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:43:37.020 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:37.020 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:37.020 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-04-18T14:43:37.020 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:36.861142+0000", 2024-04-18T14:43:37.020 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 4294967295.9999986 2024-04-18T14:43:37.020 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:37.020 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:37.020 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-04-18T14:43:37.020 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:36.861155+0000", 2024-04-18T14:43:37.020 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.3821e-05 2024-04-18T14:43:37.021 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:37.021 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:37.021 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-04-18T14:43:37.021 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:36.861180+0000", 2024-04-18T14:43:37.021 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.4464000000000002e-05 2024-04-18T14:43:37.021 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:37.021 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:37.021 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-04-18T14:43:37.021 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:36.861191+0000", 2024-04-18T14:43:37.021 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.0963e-05 2024-04-18T14:43:37.021 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:37.021 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:37.021 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-04-18T14:43:37.021 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:36.861262+0000", 2024-04-18T14:43:37.021 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 7.1568000000000003e-05 2024-04-18T14:43:37.022 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:37.022 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:37.022 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-04-18T14:43:37.022 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:36.861895+0000", 2024-04-18T14:43:37.022 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00063292899999999996 2024-04-18T14:43:37.022 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:43:37.022 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T14:43:37.022 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:43:37.022 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:37.022 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:37.022 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "MOSDECSubOpWrite(3.6s6 37/30 ECSubWrite(tid=41, reqid=client.4559.0:206, at_version=37'12, trim_to=0'0, roll_forward_to=37'10))", 2024-04-18T14:43:37.022 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-04-18T14:43:36.869175+0000", 2024-04-18T14:43:37.022 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 0.077854264000000006, 2024-04-18T14:43:37.022 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0019598200000000001, 2024-04-18T14:43:37.023 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-04-18T14:43:37.023 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "reached pg", 2024-04-18T14:43:37.023 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-04-18T14:43:37.023 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:37.023 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-04-18T14:43:37.023 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:36.869175+0000", 2024-04-18T14:43:37.023 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:43:37.023 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:37.023 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:37.023 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-04-18T14:43:37.023 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:36.869175+0000", 2024-04-18T14:43:37.023 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:43:37.023 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:37.023 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:37.023 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-04-18T14:43:37.024 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:36.869174+0000", 2024-04-18T14:43:37.024 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 4294967295.999999 2024-04-18T14:43:37.024 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:37.024 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:37.024 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-04-18T14:43:37.024 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:36.869385+0000", 2024-04-18T14:43:37.024 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000210776 2024-04-18T14:43:37.024 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:37.024 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:37.024 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-04-18T14:43:37.024 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:36.869401+0000", 2024-04-18T14:43:37.024 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.6081000000000001e-05 2024-04-18T14:43:37.024 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:37.024 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:37.024 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-04-18T14:43:37.025 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:36.869412+0000", 2024-04-18T14:43:37.025 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.0278999999999999e-05 2024-04-18T14:43:37.025 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:37.025 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:37.025 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-04-18T14:43:37.025 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:36.869480+0000", 2024-04-18T14:43:37.025 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 6.8885000000000002e-05 2024-04-18T14:43:37.025 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:37.025 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:37.025 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_started", 2024-04-18T14:43:37.025 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:36.869496+0000", 2024-04-18T14:43:37.025 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.5690999999999999e-05 2024-04-18T14:43:37.025 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:37.025 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:37.025 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_committed", 2024-04-18T14:43:37.025 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:36.871098+0000", 2024-04-18T14:43:37.026 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00160195 2024-04-18T14:43:37.026 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:37.026 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:37.026 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-04-18T14:43:37.026 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:36.871135+0000", 2024-04-18T14:43:37.026 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.7078e-05 2024-04-18T14:43:37.026 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:43:37.026 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T14:43:37.026 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:43:37.026 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:37.026 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:37.026 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "MOSDECSubOpWrite(3.7s2 37/30 ECSubWrite(tid=42, reqid=client.4559.0:208, at_version=37'13, trim_to=0'0, roll_forward_to=37'11))", 2024-04-18T14:43:37.026 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-04-18T14:43:36.875002+0000", 2024-04-18T14:43:37.027 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 0.072027643000000002, 2024-04-18T14:43:37.027 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.001753487, 2024-04-18T14:43:37.027 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-04-18T14:43:37.027 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "reached pg", 2024-04-18T14:43:37.027 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-04-18T14:43:37.027 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:37.027 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-04-18T14:43:37.027 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:36.875002+0000", 2024-04-18T14:43:37.027 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:43:37.027 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:37.027 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:37.027 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-04-18T14:43:37.027 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:36.875002+0000", 2024-04-18T14:43:37.028 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:43:37.028 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:37.028 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:37.028 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-04-18T14:43:37.028 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:36.875001+0000", 2024-04-18T14:43:37.028 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 4294967295.999999 2024-04-18T14:43:37.028 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:37.028 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:37.028 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-04-18T14:43:37.028 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:36.875225+0000", 2024-04-18T14:43:37.028 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00022414399999999999 2024-04-18T14:43:37.028 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:37.028 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:37.028 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-04-18T14:43:37.028 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:36.875238+0000", 2024-04-18T14:43:37.028 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.2814e-05 2024-04-18T14:43:37.029 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:37.029 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:37.029 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-04-18T14:43:37.029 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:36.875245+0000", 2024-04-18T14:43:37.029 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 6.8510000000000001e-06 2024-04-18T14:43:37.029 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:37.029 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:37.029 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-04-18T14:43:37.029 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:36.875311+0000", 2024-04-18T14:43:37.029 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 6.5741999999999995e-05 2024-04-18T14:43:37.029 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:37.029 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:37.029 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_started", 2024-04-18T14:43:37.029 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:36.875326+0000", 2024-04-18T14:43:37.029 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.5082000000000001e-05 2024-04-18T14:43:37.030 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:37.030 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:37.030 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_committed", 2024-04-18T14:43:37.030 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:36.876734+0000", 2024-04-18T14:43:37.030 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.001407841 2024-04-18T14:43:37.030 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:37.030 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:37.030 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-04-18T14:43:37.030 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:36.876755+0000", 2024-04-18T14:43:37.030 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.1767999999999999e-05 2024-04-18T14:43:37.030 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:43:37.030 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T14:43:37.030 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:43:37.030 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:43:37.031 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T14:43:37.031 INFO:teuthology.orchestra.run.smithi096.stdout:} 2024-04-18T14:43:37.032 INFO:teuthology.orchestra.run.smithi086.stdout:osd.8: {} 2024-04-18T14:43:37.032 INFO:teuthology.orchestra.run.smithi086.stderr:osd.8: osd_enable_op_tracker = '' 2024-04-18T14:43:37.033 INFO:teuthology.orchestra.run.smithi086.stdout:osd.9: {} 2024-04-18T14:43:37.033 INFO:teuthology.orchestra.run.smithi086.stderr:osd.9: osd_enable_op_tracker = '' 2024-04-18T14:43:37.033 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.13.asok dump_ops_in_flight 2024-04-18T14:43:37.034 INFO:teuthology.orchestra.run.smithi086.stdout:osd.10: {} 2024-04-18T14:43:37.034 INFO:teuthology.orchestra.run.smithi086.stderr:osd.10: osd_enable_op_tracker = '' 2024-04-18T14:43:37.035 INFO:teuthology.orchestra.run.smithi086.stdout:osd.11: {} 2024-04-18T14:43:37.035 INFO:teuthology.orchestra.run.smithi086.stderr:osd.11: osd_enable_op_tracker = '' 2024-04-18T14:43:37.035 INFO:teuthology.orchestra.run.smithi086.stdout:osd.12: {} 2024-04-18T14:43:37.035 INFO:teuthology.orchestra.run.smithi086.stderr:osd.12: osd_enable_op_tracker = '' 2024-04-18T14:43:37.036 INFO:tasks.ceph.osd.7.smithi134.stderr:2024-04-18T14:43:37.035+0000 7fd7de549640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25213) UID: 0 2024-04-18T14:43:37.047 INFO:teuthology.orchestra.run.smithi086.stdout:osd.13: {} 2024-04-18T14:43:37.047 INFO:teuthology.orchestra.run.smithi086.stderr:osd.13: osd_enable_op_tracker = '' 2024-04-18T14:43:37.068 INFO:teuthology.orchestra.run.smithi086.stdout:osd.14: {} 2024-04-18T14:43:37.068 INFO:teuthology.orchestra.run.smithi086.stderr:osd.14: osd_enable_op_tracker = '' 2024-04-18T14:43:37.071 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-18T14:43:37.071+0000 7fc4929fa640 0 -- 172.21.15.86:0/78869319 >> [v2:172.21.15.134:6808/25223,v1:172.21.15.134:6812/25223] conn(0x7fc48c223f70 msgr2=0x7fc48c226360 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-04-18T14:43:37.088 INFO:teuthology.orchestra.run.smithi086.stdout:osd.15: {} 2024-04-18T14:43:37.089 INFO:teuthology.orchestra.run.smithi086.stderr:osd.15: osd_enable_op_tracker = '' 2024-04-18T14:43:37.133 INFO:tasks.ceph.osd.1.smithi096.stderr:2024-04-18T14:43:37.131+0000 7f56a7a98640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 24887) UID: 0 2024-04-18T14:43:37.155 INFO:teuthology.orchestra.run.smithi096.stdout:ERROR: (22) Invalid argument 2024-04-18T14:43:37.155 INFO:teuthology.orchestra.run.smithi096.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T14:43:37.169 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.13.asok dump_blocked_ops 2024-04-18T14:43:37.233 INFO:tasks.ceph.osd.14.smithi119.stderr:2024-04-18T14:43:37.234+0000 7f180f599640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 14 (PID: 24900) UID: 0 2024-04-18T14:43:37.331 INFO:teuthology.orchestra.run.smithi096.stdout:ERROR: (22) Invalid argument 2024-04-18T14:43:37.332 INFO:teuthology.orchestra.run.smithi096.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T14:43:37.334 INFO:tasks.ceph.osd.14.smithi119.stderr:2024-04-18T14:43:37.334+0000 7f180f599640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 14 (PID: 24900) UID: 0 2024-04-18T14:43:37.345 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.13.asok dump_historic_ops 2024-04-18T14:43:37.435 INFO:tasks.ceph.osd.0.smithi086.stderr:2024-04-18T14:43:37.435+0000 7f7cdfd78640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 24953) UID: 0 2024-04-18T14:43:37.466 INFO:teuthology.orchestra.run.smithi096.stdout:ERROR: (22) Invalid argument 2024-04-18T14:43:37.466 INFO:teuthology.orchestra.run.smithi096.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T14:43:37.480 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-18T14:43:37.536 INFO:tasks.ceph.osd.2.smithi119.stderr:2024-04-18T14:43:37.534+0000 7fcbd30c0640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 24894) UID: 0 2024-04-18T14:43:37.609 INFO:teuthology.orchestra.run.smithi119.stdout:ERROR: (22) Invalid argument 2024-04-18T14:43:37.610 INFO:teuthology.orchestra.run.smithi119.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T14:43:37.623 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-18T14:43:37.665 INFO:tasks.ceph.osd.2.smithi119.stderr:2024-04-18T14:43:37.666+0000 7fcbd30c0640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 24894) UID: 0 2024-04-18T14:43:37.724 INFO:tasks.rados.rados.0.smithi134.stdout:77: done (3 left) 2024-04-18T14:43:37.935 INFO:tasks.rados.rados.0.smithi134.stdout:79: done (2 left) 2024-04-18T14:43:37.935 INFO:tasks.rados.rados.0.smithi134.stdout:80: done (1 left) 2024-04-18T14:43:37.935 INFO:tasks.rados.rados.0.smithi134.stdout:81: done (0 left) 2024-04-18T14:43:37.935 INFO:tasks.rados.rados.0.smithi134.stdout:append oid 10 current snap is 4 2024-04-18T14:43:37.935 INFO:tasks.rados.rados.0.smithi134.stdout:82: seq_num 58 ranges {163840=606208,770048=376832} 2024-04-18T14:43:37.938 INFO:teuthology.orchestra.run.smithi119.stdout:ERROR: (22) Invalid argument 2024-04-18T14:43:37.938 INFO:teuthology.orchestra.run.smithi119.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T14:43:37.938 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-18T14:43:37.941 INFO:tasks.rados.rados.0.smithi134.stdout:82: writing smithi13430248-10 from 163840 to 770048 tid 1 2024-04-18T14:43:37.941 INFO:tasks.rados.rados.0.smithi134.stdout:82: writing smithi13430248-10 from 770048 to 1146880 tid 2 2024-04-18T14:43:37.941 INFO:tasks.rados.rados.0.smithi134.stdout:83: setattr oid 30 current snap is 4 2024-04-18T14:43:37.941 INFO:tasks.rados.rados.0.smithi134.stdout:append oid 8 current snap is 4 2024-04-18T14:43:37.941 INFO:tasks.rados.rados.0.smithi134.stdout:84: seq_num 59 ranges {131072=622592,753664=376832} 2024-04-18T14:43:37.941 INFO:tasks.rados.rados.0.smithi134.stdout:84: writing smithi13430248-8 from 131072 to 753664 tid 1 2024-04-18T14:43:37.941 INFO:tasks.rados.rados.0.smithi134.stdout:84: writing smithi13430248-8 from 753664 to 1130496 tid 2 2024-04-18T14:43:37.941 INFO:tasks.rados.rados.0.smithi134.stdout:85: read oid 14 snap -1 2024-04-18T14:43:37.941 INFO:tasks.rados.rados.0.smithi134.stdout:85: expect (ObjNum 13 snap 0 seq_num 13) 2024-04-18T14:43:37.941 INFO:tasks.rados.rados.0.smithi134.stdout:append oid 38 current snap is 4 2024-04-18T14:43:37.941 INFO:tasks.rados.rados.0.smithi134.stdout:86: seq_num 60 ranges {622592=638976,1261568=376832} 2024-04-18T14:43:37.941 INFO:tasks.rados.rados.0.smithi134.stdout:86: writing smithi13430248-38 from 622592 to 1261568 tid 1 2024-04-18T14:43:37.942 INFO:tasks.rados.rados.0.smithi134.stdout:86: writing smithi13430248-38 from 1261568 to 1638400 tid 2 2024-04-18T14:43:37.942 INFO:tasks.rados.rados.0.smithi134.stdout:87: read oid 11 snap -1 2024-04-18T14:43:37.942 INFO:tasks.rados.rados.0.smithi134.stdout:87: expect deleted 2024-04-18T14:43:37.942 INFO:tasks.rados.rados.0.smithi134.stdout:88: snap_create 2024-04-18T14:43:37.942 INFO:tasks.rados.rados.0.smithi134.stdout:82: finishing write tid 1 to smithi13430248-10 2024-04-18T14:43:37.942 INFO:tasks.rados.rados.0.smithi134.stdout:update_object_version oid 30 v 15 (ObjNum 37 snap 0 seq_num 37) dirty exists 2024-04-18T14:43:37.942 INFO:tasks.rados.rados.0.smithi134.stdout:82: finishing write tid 2 to smithi13430248-10 2024-04-18T14:43:37.942 INFO:tasks.rados.rados.0.smithi134.stdout:82: finishing write tid 3 to smithi13430248-10 2024-04-18T14:43:37.942 INFO:tasks.rados.rados.0.smithi134.stdout:82: finishing write tid 4 to smithi13430248-10 2024-04-18T14:43:37.942 INFO:tasks.rados.rados.0.smithi134.stdout:82: oid 10 updating version 0 to 16 2024-04-18T14:43:37.942 INFO:tasks.rados.rados.0.smithi134.stdout:82: oid 10 version 16 is already newer than 14 2024-04-18T14:43:37.942 INFO:tasks.rados.rados.0.smithi134.stdout:82: oid 10 version 16 is already newer than 15 2024-04-18T14:43:37.942 INFO:tasks.rados.rados.0.smithi134.stdout:update_object_version oid 10 v 16 (ObjNum 58 snap 4 seq_num 58) dirty exists 2024-04-18T14:43:37.942 INFO:tasks.rados.rados.0.smithi134.stdout:82: left oid 10 (ObjNum 58 snap 4 seq_num 58) 2024-04-18T14:43:37.943 INFO:tasks.rados.rados.0.smithi134.stdout:84: finishing write tid 1 to smithi13430248-8 2024-04-18T14:43:37.943 INFO:tasks.rados.rados.0.smithi134.stdout:85: expect (ObjNum 13 snap 0 seq_num 13) 2024-04-18T14:43:37.943 INFO:tasks.rados.rados.0.smithi134.stdout:84: finishing write tid 2 to smithi13430248-8 2024-04-18T14:43:37.943 INFO:tasks.rados.rados.0.smithi134.stdout:84: finishing write tid 3 to smithi13430248-8 2024-04-18T14:43:37.943 INFO:tasks.rados.rados.0.smithi134.stdout:84: finishing write tid 4 to smithi13430248-8 2024-04-18T14:43:37.943 INFO:tasks.rados.rados.0.smithi134.stdout:84: oid 8 updating version 0 to 15 2024-04-18T14:43:37.943 INFO:tasks.rados.rados.0.smithi134.stdout:84: oid 8 version 15 is already newer than 14 2024-04-18T14:43:37.943 INFO:tasks.rados.rados.0.smithi134.stdout:84: oid 8 updating version 15 to 16 2024-04-18T14:43:37.943 INFO:tasks.rados.rados.0.smithi134.stdout:update_object_version oid 8 v 16 (ObjNum 59 snap 4 seq_num 59) dirty exists 2024-04-18T14:43:37.943 INFO:tasks.rados.rados.0.smithi134.stdout:84: left oid 8 (ObjNum 59 snap 4 seq_num 59) 2024-04-18T14:43:37.943 INFO:tasks.rados.rados.0.smithi134.stdout:86: finishing write tid 1 to smithi13430248-38 2024-04-18T14:43:37.943 INFO:tasks.rados.rados.0.smithi134.stdout:86: finishing write tid 2 to smithi13430248-38 2024-04-18T14:43:37.943 INFO:tasks.rados.rados.0.smithi134.stdout:86: finishing write tid 3 to smithi13430248-38 2024-04-18T14:43:37.943 INFO:tasks.rados.rados.0.smithi134.stdout:86: finishing write tid 4 to smithi13430248-38 2024-04-18T14:43:37.943 INFO:tasks.rados.rados.0.smithi134.stdout:86: oid 38 updating version 0 to 24 2024-04-18T14:43:37.944 INFO:tasks.rados.rados.0.smithi134.stdout:86: oid 38 version 24 is already newer than 23 2024-04-18T14:43:37.944 INFO:tasks.rados.rados.0.smithi134.stdout:86: oid 38 version 24 is already newer than 22 2024-04-18T14:43:37.944 INFO:tasks.rados.rados.0.smithi134.stdout:update_object_version oid 38 v 24 (ObjNum 60 snap 4 seq_num 60) dirty exists 2024-04-18T14:43:37.944 INFO:tasks.rados.rados.0.smithi134.stdout:86: left oid 38 (ObjNum 60 snap 4 seq_num 60) 2024-04-18T14:43:37.944 INFO:tasks.ceph.osd.0.smithi086.stderr:2024-04-18T14:43:37.935+0000 7f7cdfd78640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 24953) UID: 0 2024-04-18T14:43:38.038 INFO:tasks.ceph.osd.9.smithi096.stderr:2024-04-18T14:43:38.039+0000 7fa2c1cbf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 9 (PID: 24891) UID: 0 2024-04-18T14:43:38.069 INFO:teuthology.orchestra.run.smithi119.stdout:ERROR: (22) Invalid argument 2024-04-18T14:43:38.069 INFO:teuthology.orchestra.run.smithi119.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T14:43:38.084 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-04-18T14:43:38.139 INFO:tasks.ceph.osd.14.smithi119.stderr:2024-04-18T14:43:38.138+0000 7f180f599640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 14 (PID: 24900) UID: 0 2024-04-18T14:43:38.203 INFO:teuthology.orchestra.run.smithi119.stdout:ERROR: (22) Invalid argument 2024-04-18T14:43:38.204 INFO:teuthology.orchestra.run.smithi119.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T14:43:38.219 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-04-18T14:43:38.240 INFO:tasks.ceph.osd.13.smithi096.stderr:2024-04-18T14:43:38.239+0000 7f7e72fad640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 13 (PID: 24893) UID: 0 2024-04-18T14:43:38.342 INFO:tasks.ceph.osd.13.smithi096.stderr:2024-04-18T14:43:38.339+0000 7f7e72fad640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 13 (PID: 24893) UID: 0 2024-04-18T14:43:38.382 INFO:teuthology.orchestra.run.smithi119.stdout:ERROR: (22) Invalid argument 2024-04-18T14:43:38.382 INFO:teuthology.orchestra.run.smithi119.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T14:43:38.396 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-04-18T14:43:38.445 INFO:tasks.ceph.osd.6.smithi119.stderr:2024-04-18T14:43:38.446+0000 7fb7cb8bd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 24896) UID: 0 2024-04-18T14:43:38.512 INFO:teuthology.orchestra.run.smithi119.stdout:ERROR: (22) Invalid argument 2024-04-18T14:43:38.512 INFO:teuthology.orchestra.run.smithi119.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T14:43:38.527 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.10.asok dump_ops_in_flight 2024-04-18T14:43:38.544 INFO:tasks.ceph.osd.13.smithi096.stderr:2024-04-18T14:43:38.543+0000 7f7e72fad640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 13 (PID: 24893) UID: 0 2024-04-18T14:43:38.646 INFO:tasks.ceph.osd.1.smithi096.stderr:2024-04-18T14:43:38.647+0000 7f56a7a98640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 24887) UID: 0 2024-04-18T14:43:38.686 INFO:teuthology.orchestra.run.smithi119.stdout:ERROR: (22) Invalid argument 2024-04-18T14:43:38.686 INFO:teuthology.orchestra.run.smithi119.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T14:43:38.699 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.10.asok dump_blocked_ops 2024-04-18T14:43:38.731 INFO:tasks.rados.rados.0.smithi134.stdout:82: done (6 left) 2024-04-18T14:43:38.731 INFO:tasks.rados.rados.0.smithi134.stdout:83: done (5 left) 2024-04-18T14:43:38.731 INFO:tasks.rados.rados.0.smithi134.stdout:84: done (4 left) 2024-04-18T14:43:38.731 INFO:tasks.rados.rados.0.smithi134.stdout:85: done (3 left) 2024-04-18T14:43:38.731 INFO:tasks.rados.rados.0.smithi134.stdout:86: done (2 left) 2024-04-18T14:43:38.731 INFO:tasks.rados.rados.0.smithi134.stdout:87: done (1 left) 2024-04-18T14:43:38.732 INFO:tasks.rados.rados.0.smithi134.stdout:88: done (0 left) 2024-04-18T14:43:38.732 INFO:tasks.rados.rados.0.smithi134.stdout:append oid 43 current snap is 5 2024-04-18T14:43:38.732 INFO:tasks.rados.rados.0.smithi134.stdout:89: seq_num 61 ranges {720896=655360,1376256=376832} 2024-04-18T14:43:38.744 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-04-18T14:43:38.746 INFO:tasks.ceph.osd.7.smithi134.stderr:2024-04-18T14:43:38.747+0000 7fd7de549640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25213) UID: 0 2024-04-18T14:43:38.746 INFO:tasks.rados.rados.0.smithi134.stdout:89: writing smithi13430248-43 from 720896 to 1376256 tid 1 2024-04-18T14:43:38.751 INFO:tasks.rados.rados.0.smithi134.stdout:89: writing smithi13430248-43 from 1376256 to 1753088 tid 2 2024-04-18T14:43:38.751 INFO:tasks.rados.rados.0.smithi134.stdout:90: copy_from oid 4 from oid 31 current snap is 5 2024-04-18T14:43:38.751 INFO:tasks.rados.rados.0.smithi134.stdout:91: read oid 11 snap -1 2024-04-18T14:43:38.751 INFO:tasks.rados.rados.0.smithi134.stdout:91: expect deleted 2024-04-18T14:43:38.751 INFO:tasks.rados.rados.0.smithi134.stdout:92: snap_create 2024-04-18T14:43:38.762 INFO:tasks.rados.rados.0.smithi134.stdout:90: finishing copy_from racing read to smithi13430248-4 2024-04-18T14:43:38.764 INFO:tasks.rados.rados.0.smithi134.stdout:89: finishing write tid 1 to smithi13430248-43 2024-04-18T14:43:38.765 INFO:tasks.rados.rados.0.smithi134.stdout:89: finishing write tid 2 to smithi13430248-43 2024-04-18T14:43:38.767 INFO:tasks.rados.rados.0.smithi134.stdout:90: finishing copy_from to smithi13430248-4 2024-04-18T14:43:38.767 INFO:tasks.rados.rados.0.smithi134.stdout:update_object_version oid 4 v 2 (ObjNum 30 snap 0 seq_num 30) dirty exists 2024-04-18T14:43:38.768 INFO:tasks.rados.rados.0.smithi134.stdout:89: finishing write tid 3 to smithi13430248-43 2024-04-18T14:43:38.771 INFO:tasks.rados.rados.0.smithi134.stdout:89: finishing write tid 4 to smithi13430248-43 2024-04-18T14:43:38.772 INFO:tasks.rados.rados.0.smithi134.stdout:89: oid 43 updating version 0 to 18 2024-04-18T14:43:38.772 INFO:tasks.rados.rados.0.smithi134.stdout:89: oid 43 updating version 18 to 19 2024-04-18T14:43:38.772 INFO:tasks.rados.rados.0.smithi134.stdout:89: oid 43 updating version 19 to 20 2024-04-18T14:43:38.772 INFO:tasks.rados.rados.0.smithi134.stdout:update_object_version oid 43 v 20 (ObjNum 61 snap 5 seq_num 61) dirty exists 2024-04-18T14:43:38.772 INFO:tasks.rados.rados.0.smithi134.stdout:89: left oid 43 (ObjNum 61 snap 5 seq_num 61) 2024-04-18T14:43:38.824 INFO:teuthology.orchestra.run.smithi119.stdout:ERROR: (22) Invalid argument 2024-04-18T14:43:38.824 INFO:teuthology.orchestra.run.smithi119.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T14:43:38.838 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.10.asok dump_historic_ops 2024-04-18T14:43:38.885 INFO:tasks.ceph.osd.6.smithi119.stderr:2024-04-18T14:43:38.886+0000 7fb7cb8bd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 24896) UID: 0 2024-04-18T14:43:38.947 INFO:tasks.ceph.osd.8.smithi086.stderr:2024-04-18T14:43:38.947+0000 7f29f7b9d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 8 (PID: 24958) UID: 0 2024-04-18T14:43:38.953 INFO:teuthology.orchestra.run.smithi119.stdout:ERROR: (22) Invalid argument 2024-04-18T14:43:38.953 INFO:teuthology.orchestra.run.smithi119.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T14:43:38.965 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.14.asok dump_ops_in_flight 2024-04-18T14:43:39.048 INFO:tasks.ceph.osd.15.smithi134.stderr:2024-04-18T14:43:39.051+0000 7f08e6a51640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 15 (PID: 25218) UID: 0 2024-04-18T14:43:39.107 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-18T14:43:39.131 INFO:teuthology.orchestra.run.smithi119.stdout:ERROR: (22) Invalid argument 2024-04-18T14:43:39.131 INFO:teuthology.orchestra.run.smithi119.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T14:43:39.145 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.14.asok dump_blocked_ops 2024-04-18T14:43:39.149 INFO:tasks.ceph.osd.10.smithi119.stderr:2024-04-18T14:43:39.150+0000 7f6f24c12640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 10 (PID: 24898) UID: 0 2024-04-18T14:43:39.249 INFO:tasks.ceph.osd.7.smithi134.stderr:2024-04-18T14:43:39.251+0000 7fd7de549640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25213) UID: 0 2024-04-18T14:43:39.252 INFO:teuthology.orchestra.run.smithi086.stdout:osd.0: {} 2024-04-18T14:43:39.252 INFO:teuthology.orchestra.run.smithi086.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-18T14:43:39.264 INFO:teuthology.orchestra.run.smithi119.stdout:ERROR: (22) Invalid argument 2024-04-18T14:43:39.265 INFO:teuthology.orchestra.run.smithi119.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T14:43:39.272 INFO:teuthology.orchestra.run.smithi086.stdout:osd.1: {} 2024-04-18T14:43:39.272 INFO:teuthology.orchestra.run.smithi086.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-18T14:43:39.279 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.14.asok dump_historic_ops 2024-04-18T14:43:39.290 INFO:teuthology.orchestra.run.smithi086.stdout:osd.2: {} 2024-04-18T14:43:39.291 INFO:teuthology.orchestra.run.smithi086.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-18T14:43:39.311 INFO:teuthology.orchestra.run.smithi086.stdout:osd.3: {} 2024-04-18T14:43:39.311 INFO:teuthology.orchestra.run.smithi086.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-18T14:43:39.328 INFO:teuthology.orchestra.run.smithi086.stdout:osd.4: {} 2024-04-18T14:43:39.329 INFO:teuthology.orchestra.run.smithi086.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-18T14:43:39.350 INFO:teuthology.orchestra.run.smithi086.stdout:osd.5: {} 2024-04-18T14:43:39.350 INFO:teuthology.orchestra.run.smithi086.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-18T14:43:39.350 INFO:tasks.ceph.osd.10.smithi119.stderr:2024-04-18T14:43:39.350+0000 7f6f24c12640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 10 (PID: 24898) UID: 0 2024-04-18T14:43:39.368 INFO:teuthology.orchestra.run.smithi086.stdout:osd.6: {} 2024-04-18T14:43:39.368 INFO:teuthology.orchestra.run.smithi086.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-18T14:43:39.389 INFO:teuthology.orchestra.run.smithi086.stdout:osd.7: {} 2024-04-18T14:43:39.389 INFO:teuthology.orchestra.run.smithi086.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-18T14:43:39.396 INFO:teuthology.orchestra.run.smithi119.stdout:ERROR: (22) Invalid argument 2024-04-18T14:43:39.397 INFO:teuthology.orchestra.run.smithi119.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T14:43:39.410 INFO:teuthology.orchestra.run.smithi086.stdout:osd.8: {} 2024-04-18T14:43:39.410 INFO:teuthology.orchestra.run.smithi086.stderr:osd.8: osd_enable_op_tracker = '' 2024-04-18T14:43:39.412 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-04-18T14:43:39.432 INFO:teuthology.orchestra.run.smithi086.stdout:osd.9: {} 2024-04-18T14:43:39.432 INFO:teuthology.orchestra.run.smithi086.stderr:osd.9: osd_enable_op_tracker = '' 2024-04-18T14:43:39.451 INFO:teuthology.orchestra.run.smithi086.stdout:osd.10: {} 2024-04-18T14:43:39.451 INFO:teuthology.orchestra.run.smithi086.stderr:osd.10: osd_enable_op_tracker = '' 2024-04-18T14:43:39.456 INFO:tasks.ceph.osd.10.smithi119.stderr:2024-04-18T14:43:39.458+0000 7f6f24c12640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 10 (PID: 24898) UID: 0 2024-04-18T14:43:39.470 INFO:teuthology.orchestra.run.smithi086.stdout:osd.11: {} 2024-04-18T14:43:39.470 INFO:teuthology.orchestra.run.smithi086.stderr:osd.11: osd_enable_op_tracker = '' 2024-04-18T14:43:39.486 INFO:teuthology.orchestra.run.smithi086.stdout:osd.12: {} 2024-04-18T14:43:39.486 INFO:teuthology.orchestra.run.smithi086.stderr:osd.12: osd_enable_op_tracker = '' 2024-04-18T14:43:39.506 INFO:teuthology.orchestra.run.smithi086.stdout:osd.13: {} 2024-04-18T14:43:39.506 INFO:teuthology.orchestra.run.smithi086.stderr:osd.13: osd_enable_op_tracker = '' 2024-04-18T14:43:39.526 INFO:teuthology.orchestra.run.smithi086.stdout:osd.14: {} 2024-04-18T14:43:39.526 INFO:teuthology.orchestra.run.smithi086.stderr:osd.14: osd_enable_op_tracker = '' 2024-04-18T14:43:39.541 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-04-18T14:43:39.541 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [], 2024-04-18T14:43:39.541 INFO:teuthology.orchestra.run.smithi134.stdout: "num_ops": 0 2024-04-18T14:43:39.542 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-04-18T14:43:39.546 INFO:teuthology.orchestra.run.smithi086.stdout:osd.15: {} 2024-04-18T14:43:39.546 INFO:teuthology.orchestra.run.smithi086.stderr:osd.15: osd_enable_op_tracker = '' 2024-04-18T14:43:39.551 INFO:tasks.ceph.osd.11.smithi134.stderr:2024-04-18T14:43:39.552+0000 7f2d36f12640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 11 (PID: 25216) UID: 0 2024-04-18T14:43:39.556 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-04-18T14:43:39.652 INFO:tasks.ceph.osd.10.smithi119.stderr:2024-04-18T14:43:39.654+0000 7f6f24c12640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 10 (PID: 24898) UID: 0 2024-04-18T14:43:39.723 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-04-18T14:43:39.724 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [], 2024-04-18T14:43:39.724 INFO:teuthology.orchestra.run.smithi134.stdout: "complaint_time": 30, 2024-04-18T14:43:39.724 INFO:teuthology.orchestra.run.smithi134.stdout: "num_blocked_ops": 0 2024-04-18T14:43:39.724 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-04-18T14:43:39.738 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-04-18T14:43:39.745 INFO:teuthology.orchestra.run.smithi086.stderr:noscrub is set 2024-04-18T14:43:39.746 INFO:tasks.rados.rados.0.smithi134.stdout:89: done (3 left) 2024-04-18T14:43:39.746 INFO:tasks.rados.rados.0.smithi134.stdout:90: done (2 left) 2024-04-18T14:43:39.746 INFO:tasks.rados.rados.0.smithi134.stdout:91: done (1 left) 2024-04-18T14:43:39.746 INFO:tasks.rados.rados.0.smithi134.stdout:92: done (0 left) 2024-04-18T14:43:39.747 INFO:tasks.rados.rados.0.smithi134.stdout:93: snap_remove snap 3 2024-04-18T14:43:39.753 INFO:tasks.ceph.osd.2.smithi119.stderr:2024-04-18T14:43:39.754+0000 7fcbd30c0640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 24894) UID: 0 2024-04-18T14:43:39.855 INFO:tasks.ceph.osd.5.smithi096.stderr:2024-04-18T14:43:39.855+0000 7fc33f25b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 24889) UID: 0 2024-04-18T14:43:39.857 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-04-18T14:43:39.858 INFO:teuthology.orchestra.run.smithi134.stdout: "size": 20, 2024-04-18T14:43:39.858 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 600, 2024-04-18T14:43:39.858 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [ 2024-04-18T14:43:39.858 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:39.858 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4559.0:176 3.as0 3:5dff433d:::smithi13430248-20:head [delete] snapc 3=[3,2] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e35)", 2024-04-18T14:43:39.858 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T14:43:34.715612+0000", 2024-04-18T14:43:39.858 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 5.1437133719999997, 2024-04-18T14:43:39.859 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.011905134, 2024-04-18T14:43:39.859 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T14:43:39.859 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T14:43:39.859 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-18T14:43:39.859 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4559", 2024-04-18T14:43:39.859 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/3113589487", 2024-04-18T14:43:39.859 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 176 2024-04-18T14:43:39.859 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:39.860 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T14:43:39.860 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:39.860 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T14:43:39.860 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:34.715612+0000", 2024-04-18T14:43:39.860 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:43:39.860 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:39.860 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:39.860 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T14:43:39.861 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:34.715612+0000", 2024-04-18T14:43:39.861 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:43:39.861 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:39.861 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:39.861 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T14:43:39.862 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:34.715609+0000", 2024-04-18T14:43:39.862 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999971 2024-04-18T14:43:39.862 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:39.862 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:39.862 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T14:43:39.862 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:34.715623+0000", 2024-04-18T14:43:39.862 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.4578e-05 2024-04-18T14:43:39.863 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:39.863 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:39.863 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T14:43:39.863 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:34.715659+0000", 2024-04-18T14:43:39.863 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.5824000000000001e-05 2024-04-18T14:43:39.863 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:39.863 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:39.863 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T14:43:39.864 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:34.715676+0000", 2024-04-18T14:43:39.864 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6594000000000001e-05 2024-04-18T14:43:39.864 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:39.864 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:39.864 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T14:43:39.864 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:34.715794+0000", 2024-04-18T14:43:39.864 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000118744 2024-04-18T14:43:39.864 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:39.864 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:39.865 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op must wait for map", 2024-04-18T14:43:39.865 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:34.715807+0000", 2024-04-18T14:43:39.865 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2486e-05 2024-04-18T14:43:39.865 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:39.865 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:39.865 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T14:43:39.865 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:34.718556+0000", 2024-04-18T14:43:39.865 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.002749175 2024-04-18T14:43:39.866 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:39.866 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:39.866 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T14:43:39.866 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:34.718699+0000", 2024-04-18T14:43:39.866 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00014262000000000001 2024-04-18T14:43:39.866 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:39.866 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:39.867 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_started", 2024-04-18T14:43:39.867 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:34.720045+0000", 2024-04-18T14:43:39.867 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0013458400000000001 2024-04-18T14:43:39.867 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:39.867 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:39.867 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_committed", 2024-04-18T14:43:39.867 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:34.721856+0000", 2024-04-18T14:43:39.867 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.001811226 2024-04-18T14:43:39.868 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:39.868 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:39.868 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T14:43:39.868 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:34.727477+0000", 2024-04-18T14:43:39.868 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0056212290000000002 2024-04-18T14:43:39.868 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:39.868 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:39.868 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T14:43:39.869 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:34.727517+0000", 2024-04-18T14:43:39.869 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.9712000000000002e-05 2024-04-18T14:43:39.869 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:43:39.869 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T14:43:39.869 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:43:39.869 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:39.869 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:39.869 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4559.0:178 3.as0 3:504bbe78:::smithi13430248-37:head [append 0~507904] snapc 4=[4,3,2] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-04-18T14:43:39.870 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T14:43:35.731082+0000", 2024-04-18T14:43:39.870 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 4.1282430689999998, 2024-04-18T14:43:39.870 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.015989092, 2024-04-18T14:43:39.870 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T14:43:39.870 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T14:43:39.870 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-18T14:43:39.870 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4559", 2024-04-18T14:43:39.870 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/3113589487", 2024-04-18T14:43:39.871 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 178 2024-04-18T14:43:39.871 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:39.871 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T14:43:39.872 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:39.872 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T14:43:39.872 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:35.731082+0000", 2024-04-18T14:43:39.872 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:43:39.872 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:39.872 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:39.872 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T14:43:39.872 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:35.731082+0000", 2024-04-18T14:43:39.873 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:43:39.873 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:39.873 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:39.873 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T14:43:39.873 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:35.731079+0000", 2024-04-18T14:43:39.873 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999971 2024-04-18T14:43:39.873 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:39.873 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:39.874 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T14:43:39.874 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:35.731663+0000", 2024-04-18T14:43:39.874 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00058377699999999995 2024-04-18T14:43:39.874 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:39.874 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:39.874 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T14:43:39.874 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:35.731697+0000", 2024-04-18T14:43:39.874 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.4578e-05 2024-04-18T14:43:39.875 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:39.875 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:39.875 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T14:43:39.875 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:35.731716+0000", 2024-04-18T14:43:39.875 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8413000000000001e-05 2024-04-18T14:43:39.875 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:39.875 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:39.875 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T14:43:39.875 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:35.731829+0000", 2024-04-18T14:43:39.876 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000113323 2024-04-18T14:43:39.876 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:39.876 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:39.876 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op must wait for map", 2024-04-18T14:43:39.876 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:35.731843+0000", 2024-04-18T14:43:39.876 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.4072e-05 2024-04-18T14:43:39.876 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:39.876 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:39.877 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T14:43:39.877 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:35.735773+0000", 2024-04-18T14:43:39.877 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0039293569999999996 2024-04-18T14:43:39.877 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:39.877 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:39.877 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T14:43:39.877 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:35.736021+0000", 2024-04-18T14:43:39.877 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00024879299999999997 2024-04-18T14:43:39.877 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:39.878 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:39.878 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_started", 2024-04-18T14:43:39.878 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:35.738679+0000", 2024-04-18T14:43:39.878 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0026578460000000002 2024-04-18T14:43:39.878 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:39.878 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:39.878 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_committed", 2024-04-18T14:43:39.879 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:35.745018+0000", 2024-04-18T14:43:39.879 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0063392070000000003 2024-04-18T14:43:39.879 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:39.879 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:39.879 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T14:43:39.879 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:35.746981+0000", 2024-04-18T14:43:39.879 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00196254 2024-04-18T14:43:39.879 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:39.879 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:39.880 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T14:43:39.880 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:35.747071+0000", 2024-04-18T14:43:39.880 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.0016e-05 2024-04-18T14:43:39.880 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:43:39.880 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T14:43:39.880 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:43:39.880 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:39.880 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:39.881 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4559.0:179 3.as0 3:504bbe78:::smithi13430248-37:head [append 0~376832] snapc 4=[4,3,2] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-04-18T14:43:39.881 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T14:43:35.735197+0000", 2024-04-18T14:43:39.881 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 4.1241282520000002, 2024-04-18T14:43:39.881 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.013886849999999999, 2024-04-18T14:43:39.881 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T14:43:39.881 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T14:43:39.881 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-18T14:43:39.881 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4559", 2024-04-18T14:43:39.882 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/3113589487", 2024-04-18T14:43:39.882 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 179 2024-04-18T14:43:39.882 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:39.882 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T14:43:39.882 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:39.882 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T14:43:39.882 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:35.735197+0000", 2024-04-18T14:43:39.882 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:43:39.883 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:39.883 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:39.883 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T14:43:39.883 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:35.735197+0000", 2024-04-18T14:43:39.883 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:43:39.883 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:39.883 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:39.883 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T14:43:39.884 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:35.735193+0000", 2024-04-18T14:43:39.884 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999967 2024-04-18T14:43:39.884 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:39.884 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:39.884 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T14:43:39.884 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:35.735791+0000", 2024-04-18T14:43:39.884 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00059791 2024-04-18T14:43:39.884 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:39.885 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:39.885 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T14:43:39.885 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:35.735818+0000", 2024-04-18T14:43:39.885 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.6214e-05 2024-04-18T14:43:39.885 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:39.885 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:39.885 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T14:43:39.885 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:35.735834+0000", 2024-04-18T14:43:39.886 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6603999999999999e-05 2024-04-18T14:43:39.886 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:39.886 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:39.886 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T14:43:39.886 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:35.741060+0000", 2024-04-18T14:43:39.886 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0052256580000000002 2024-04-18T14:43:39.886 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:39.886 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:39.887 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T14:43:39.887 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:35.741402+0000", 2024-04-18T14:43:39.887 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00034264000000000001 2024-04-18T14:43:39.887 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:39.887 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:39.887 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_started", 2024-04-18T14:43:39.887 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:35.743027+0000", 2024-04-18T14:43:39.887 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0016244250000000001 2024-04-18T14:43:39.888 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:39.888 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:39.888 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_committed", 2024-04-18T14:43:39.888 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:35.746673+0000", 2024-04-18T14:43:39.888 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0036466189999999998 2024-04-18T14:43:39.888 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:39.888 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:39.888 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T14:43:39.888 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:35.749020+0000", 2024-04-18T14:43:39.889 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0023462439999999999 2024-04-18T14:43:39.889 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:39.889 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:39.889 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T14:43:39.889 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:35.749084+0000", 2024-04-18T14:43:39.889 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.3875999999999996e-05 2024-04-18T14:43:39.889 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:43:39.889 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T14:43:39.890 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:43:39.890 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:39.890 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:39.890 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4559.0:180 3.as0 3:504bbe78:::smithi13430248-37:head [setxattr _header (56) in=7b] snapc 4=[4,3,2] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-04-18T14:43:39.890 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T14:43:35.735855+0000", 2024-04-18T14:43:39.890 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 4.1234701500000002, 2024-04-18T14:43:39.890 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.013531458999999999, 2024-04-18T14:43:39.890 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T14:43:39.891 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T14:43:39.891 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-18T14:43:39.891 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4559", 2024-04-18T14:43:39.891 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/3113589487", 2024-04-18T14:43:39.891 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 180 2024-04-18T14:43:39.891 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:39.891 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T14:43:39.891 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:39.892 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T14:43:39.892 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:35.735855+0000", 2024-04-18T14:43:39.892 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:43:39.892 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:39.892 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:39.892 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T14:43:39.892 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:35.735855+0000", 2024-04-18T14:43:39.892 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:43:39.893 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:39.893 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:39.893 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T14:43:39.893 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:35.735853+0000", 2024-04-18T14:43:39.893 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999986 2024-04-18T14:43:39.893 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:39.893 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:39.893 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T14:43:39.894 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:35.735860+0000", 2024-04-18T14:43:39.894 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.024e-06 2024-04-18T14:43:39.894 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:39.894 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:39.894 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T14:43:39.894 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:35.735871+0000", 2024-04-18T14:43:39.894 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.076e-05 2024-04-18T14:43:39.894 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:39.895 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:39.895 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T14:43:39.895 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:35.735895+0000", 2024-04-18T14:43:39.895 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.3623999999999999e-05 2024-04-18T14:43:39.895 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:39.895 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:39.895 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T14:43:39.896 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:35.745199+0000", 2024-04-18T14:43:39.896 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0093043380000000005 2024-04-18T14:43:39.896 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:39.896 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:39.896 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T14:43:39.896 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:35.745372+0000", 2024-04-18T14:43:39.896 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00017296100000000001 2024-04-18T14:43:39.897 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:39.897 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:39.897 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_started", 2024-04-18T14:43:39.897 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:35.746162+0000", 2024-04-18T14:43:39.897 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00078974600000000002 2024-04-18T14:43:39.897 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:39.897 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:39.897 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_committed", 2024-04-18T14:43:39.897 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:35.748150+0000", 2024-04-18T14:43:39.898 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0019877649999999998 2024-04-18T14:43:39.898 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:39.898 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:39.898 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T14:43:39.898 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:35.749316+0000", 2024-04-18T14:43:39.898 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0011658949999999999 2024-04-18T14:43:39.898 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:39.899 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:39.899 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T14:43:39.899 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:35.749386+0000", 2024-04-18T14:43:39.899 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.0729999999999995e-05 2024-04-18T14:43:39.899 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:43:39.899 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T14:43:39.899 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:43:39.900 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:39.900 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:39.900 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4559.0:181 3.as0 3:504bbe78:::smithi13430248-37:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e36)", 2024-04-18T14:43:39.900 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T14:43:35.735904+0000", 2024-04-18T14:43:39.900 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 4.1234212650000002, 2024-04-18T14:43:39.900 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.015807422000000002, 2024-04-18T14:43:39.900 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T14:43:39.900 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-04-18T14:43:39.901 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-18T14:43:39.901 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4559", 2024-04-18T14:43:39.901 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/3113589487", 2024-04-18T14:43:39.901 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 181 2024-04-18T14:43:39.901 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:39.901 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T14:43:39.901 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:39.901 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T14:43:39.901 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:35.735904+0000", 2024-04-18T14:43:39.902 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:43:39.902 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:39.902 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:39.902 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T14:43:39.902 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:35.735904+0000", 2024-04-18T14:43:39.902 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:43:39.902 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:39.902 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:39.902 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T14:43:39.903 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:35.735903+0000", 2024-04-18T14:43:39.903 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-18T14:43:39.903 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:39.903 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:39.903 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T14:43:39.903 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:35.735907+0000", 2024-04-18T14:43:39.903 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.1899999999999997e-06 2024-04-18T14:43:39.903 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:39.903 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:39.903 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T14:43:39.904 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:35.735920+0000", 2024-04-18T14:43:39.904 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2857000000000001e-05 2024-04-18T14:43:39.904 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:39.904 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:39.904 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T14:43:39.904 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:35.735927+0000", 2024-04-18T14:43:39.904 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.447e-06 2024-04-18T14:43:39.904 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:39.905 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:39.905 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T14:43:39.905 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:35.746529+0000", 2024-04-18T14:43:39.905 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.010601348 2024-04-18T14:43:39.905 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:39.905 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:39.905 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for rw locks", 2024-04-18T14:43:39.905 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:35.746655+0000", 2024-04-18T14:43:39.905 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000125823 2024-04-18T14:43:39.905 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:39.905 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:39.905 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T14:43:39.905 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:35.749858+0000", 2024-04-18T14:43:39.905 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0032038209999999999 2024-04-18T14:43:39.905 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:39.906 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:39.906 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T14:43:39.906 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:35.750001+0000", 2024-04-18T14:43:39.906 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000142602 2024-04-18T14:43:39.906 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:39.906 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:39.906 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T14:43:39.906 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:35.751711+0000", 2024-04-18T14:43:39.906 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0017101709999999999 2024-04-18T14:43:39.906 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:43:39.906 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T14:43:39.906 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:43:39.906 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:39.907 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:39.907 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "MOSDECSubOpWriteReply(3.as0 36/30 ECSubWriteReply(tid=18, last_complete=36'12, committed=1, applied=1))", 2024-04-18T14:43:39.907 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T14:43:35.740773+0000", 2024-04-18T14:43:39.907 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 4.1185524170000001, 2024-04-18T14:43:39.907 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.004249142, 2024-04-18T14:43:39.907 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T14:43:39.907 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-04-18T14:43:39.907 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T14:43:39.907 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:39.907 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T14:43:39.907 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:35.740773+0000", 2024-04-18T14:43:39.907 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:43:39.907 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:39.907 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:39.907 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T14:43:39.908 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:35.740773+0000", 2024-04-18T14:43:39.908 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:43:39.908 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:39.908 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:39.908 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T14:43:39.908 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:35.740771+0000", 2024-04-18T14:43:39.908 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999981 2024-04-18T14:43:39.908 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:39.908 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:39.908 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T14:43:39.908 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:35.740784+0000", 2024-04-18T14:43:39.908 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3173000000000001e-05 2024-04-18T14:43:39.908 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:39.908 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:39.908 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T14:43:39.909 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:35.740830+0000", 2024-04-18T14:43:39.909 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.6610999999999998e-05 2024-04-18T14:43:39.909 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:39.909 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:39.909 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T14:43:39.909 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:35.740851+0000", 2024-04-18T14:43:39.909 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0401e-05 2024-04-18T14:43:39.909 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:39.909 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:39.909 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T14:43:39.909 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:35.744984+0000", 2024-04-18T14:43:39.909 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0041332160000000003 2024-04-18T14:43:39.909 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:39.909 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:39.909 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T14:43:39.910 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:35.745022+0000", 2024-04-18T14:43:39.910 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.7651000000000003e-05 2024-04-18T14:43:39.910 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:43:39.910 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T14:43:39.910 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:43:39.910 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:39.910 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:39.910 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "MOSDECSubOpWriteReply(3.as0 36/30 ECSubWriteReply(tid=18, last_complete=36'12, committed=1, applied=1))", 2024-04-18T14:43:39.910 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T14:43:35.742501+0000", 2024-04-18T14:43:39.910 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 4.1168236800000004, 2024-04-18T14:43:39.910 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.002587841, 2024-04-18T14:43:39.910 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T14:43:39.910 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-04-18T14:43:39.910 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T14:43:39.910 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:39.911 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T14:43:39.911 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:35.742501+0000", 2024-04-18T14:43:39.911 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:43:39.911 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:39.911 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:39.911 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T14:43:39.911 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:35.742501+0000", 2024-04-18T14:43:39.911 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:43:39.911 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:39.911 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:39.911 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T14:43:39.911 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:35.742499+0000", 2024-04-18T14:43:39.911 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999976 2024-04-18T14:43:39.911 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:39.911 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:39.912 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T14:43:39.912 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:35.742530+0000", 2024-04-18T14:43:39.912 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.1130999999999997e-05 2024-04-18T14:43:39.912 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:39.912 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:39.912 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T14:43:39.912 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:35.742583+0000", 2024-04-18T14:43:39.912 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.2595e-05 2024-04-18T14:43:39.912 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:39.912 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:39.912 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T14:43:39.912 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:35.742597+0000", 2024-04-18T14:43:39.912 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.4620999999999999e-05 2024-04-18T14:43:39.912 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:39.912 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:39.913 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T14:43:39.913 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:35.745070+0000", 2024-04-18T14:43:39.913 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0024728900000000002 2024-04-18T14:43:39.913 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:39.913 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:39.913 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T14:43:39.913 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:35.745089+0000", 2024-04-18T14:43:39.913 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8876e-05 2024-04-18T14:43:39.913 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:43:39.913 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T14:43:39.913 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:43:39.913 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:39.913 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:39.913 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "MOSDECSubOpWriteReply(3.as0 35/30 ECSubWriteReply(tid=18, last_complete=36'12, committed=1, applied=1))", 2024-04-18T14:43:39.913 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T14:43:35.742632+0000", 2024-04-18T14:43:39.913 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 4.1166925900000004, 2024-04-18T14:43:39.914 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0025205510000000002, 2024-04-18T14:43:39.914 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T14:43:39.914 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-04-18T14:43:39.914 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T14:43:39.914 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:39.914 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T14:43:39.914 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:35.742632+0000", 2024-04-18T14:43:39.914 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:43:39.914 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:39.914 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:39.914 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T14:43:39.914 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:35.742632+0000", 2024-04-18T14:43:39.914 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:43:39.914 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:39.915 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:39.915 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T14:43:39.915 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:35.742631+0000", 2024-04-18T14:43:39.915 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-18T14:43:39.915 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:39.915 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:39.915 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T14:43:39.915 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:35.742639+0000", 2024-04-18T14:43:39.915 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.1489999999999997e-06 2024-04-18T14:43:39.915 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:39.915 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:39.915 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T14:43:39.915 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:35.742654+0000", 2024-04-18T14:43:39.915 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5481999999999998e-05 2024-04-18T14:43:39.915 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:39.916 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:39.916 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T14:43:39.916 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:35.742665+0000", 2024-04-18T14:43:39.916 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0406e-05 2024-04-18T14:43:39.916 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:39.916 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:39.916 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T14:43:39.916 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:35.745136+0000", 2024-04-18T14:43:39.916 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0024717340000000002 2024-04-18T14:43:39.916 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:39.916 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:39.916 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T14:43:39.916 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:35.745153+0000", 2024-04-18T14:43:39.916 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6701000000000002e-05 2024-04-18T14:43:39.916 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:43:39.917 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T14:43:39.917 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:43:39.917 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:39.917 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:39.917 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "MOSDECSubOpWriteReply(3.as0 36/30 ECSubWriteReply(tid=18, last_complete=36'12, committed=1, applied=1))", 2024-04-18T14:43:39.917 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T14:43:35.745153+0000", 2024-04-18T14:43:39.917 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 4.1141716930000003, 2024-04-18T14:43:39.917 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.001585281, 2024-04-18T14:43:39.917 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T14:43:39.917 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-04-18T14:43:39.917 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T14:43:39.917 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:39.917 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T14:43:39.917 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:35.745153+0000", 2024-04-18T14:43:39.917 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:43:39.918 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:39.918 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:39.918 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T14:43:39.918 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:35.745153+0000", 2024-04-18T14:43:39.918 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:43:39.918 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:39.918 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:39.918 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T14:43:39.918 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:35.745152+0000", 2024-04-18T14:43:39.918 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999986 2024-04-18T14:43:39.918 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:39.918 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:39.918 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T14:43:39.918 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:35.745164+0000", 2024-04-18T14:43:39.918 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.167e-05 2024-04-18T14:43:39.919 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:39.919 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:39.919 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T14:43:39.919 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:35.745183+0000", 2024-04-18T14:43:39.919 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.9525e-05 2024-04-18T14:43:39.919 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:39.919 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:39.919 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T14:43:39.919 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:35.745195+0000", 2024-04-18T14:43:39.919 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2216e-05 2024-04-18T14:43:39.919 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:39.919 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:39.919 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T14:43:39.919 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:35.746718+0000", 2024-04-18T14:43:39.920 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0015232170000000001 2024-04-18T14:43:39.920 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:39.920 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:39.920 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T14:43:39.920 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:35.746739+0000", 2024-04-18T14:43:39.920 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0106999999999999e-05 2024-04-18T14:43:39.920 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:43:39.920 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T14:43:39.920 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:43:39.920 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:39.920 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:39.920 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "MOSDECSubOpWriteReply(3.as0 36/30 ECSubWriteReply(tid=18, last_complete=36'12, committed=1, applied=1))", 2024-04-18T14:43:39.920 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T14:43:35.745628+0000", 2024-04-18T14:43:39.920 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 4.1136967479999997, 2024-04-18T14:43:39.920 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.001153406, 2024-04-18T14:43:39.921 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T14:43:39.921 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-04-18T14:43:39.921 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T14:43:39.921 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:39.921 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T14:43:39.921 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:35.745628+0000", 2024-04-18T14:43:39.921 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:43:39.921 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:39.921 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:39.921 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T14:43:39.921 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:35.745628+0000", 2024-04-18T14:43:39.921 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:43:39.921 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:39.921 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:39.921 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T14:43:39.921 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:35.745627+0000", 2024-04-18T14:43:39.922 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-18T14:43:39.922 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:39.922 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:39.922 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T14:43:39.922 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:35.745634+0000", 2024-04-18T14:43:39.922 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.8419999999999999e-06 2024-04-18T14:43:39.922 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:39.922 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:39.922 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T14:43:39.922 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:35.745647+0000", 2024-04-18T14:43:39.922 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3352e-05 2024-04-18T14:43:39.922 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:39.922 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:39.922 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T14:43:39.923 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:35.745655+0000", 2024-04-18T14:43:39.923 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.6529999999999994e-06 2024-04-18T14:43:39.923 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:39.923 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:39.923 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T14:43:39.923 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:35.746768+0000", 2024-04-18T14:43:39.923 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0011132990000000001 2024-04-18T14:43:39.923 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:39.923 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:39.923 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T14:43:39.923 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:35.746782+0000", 2024-04-18T14:43:39.923 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3309000000000001e-05 2024-04-18T14:43:39.923 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:43:39.923 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T14:43:39.924 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:43:39.924 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:39.924 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:39.924 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4559.0:190 3.as0 3:5474a36d:::smithi13430248-11:head [delete] snapc 4=[4,2] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e37)", 2024-04-18T14:43:39.924 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T14:43:36.761006+0000", 2024-04-18T14:43:39.924 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 3.0983194530000002, 2024-04-18T14:43:39.924 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.014529398000000001, 2024-04-18T14:43:39.924 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T14:43:39.924 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T14:43:39.924 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-18T14:43:39.924 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4559", 2024-04-18T14:43:39.924 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/3113589487", 2024-04-18T14:43:39.924 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 190 2024-04-18T14:43:39.924 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:39.924 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T14:43:39.925 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:39.925 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T14:43:39.925 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.761006+0000", 2024-04-18T14:43:39.925 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:43:39.925 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:39.925 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:39.925 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T14:43:39.925 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.761006+0000", 2024-04-18T14:43:39.925 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:43:39.925 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:39.925 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:39.925 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T14:43:39.925 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.761002+0000", 2024-04-18T14:43:39.925 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999967 2024-04-18T14:43:39.925 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:39.926 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:39.926 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T14:43:39.926 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.761018+0000", 2024-04-18T14:43:39.926 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5339999999999999e-05 2024-04-18T14:43:39.926 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:39.926 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:39.926 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T14:43:39.926 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.761058+0000", 2024-04-18T14:43:39.926 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.0197999999999997e-05 2024-04-18T14:43:39.926 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:39.926 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:39.926 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T14:43:39.926 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.761074+0000", 2024-04-18T14:43:39.926 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6646999999999998e-05 2024-04-18T14:43:39.926 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:39.927 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:39.927 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T14:43:39.927 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.761215+0000", 2024-04-18T14:43:39.927 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00014079399999999999 2024-04-18T14:43:39.927 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:39.927 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:39.927 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op must wait for map", 2024-04-18T14:43:39.927 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.761236+0000", 2024-04-18T14:43:39.927 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.105e-05 2024-04-18T14:43:39.927 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:39.927 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:39.927 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T14:43:39.927 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.765644+0000", 2024-04-18T14:43:39.927 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.004408159 2024-04-18T14:43:39.927 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:39.928 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:39.928 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T14:43:39.928 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.765818+0000", 2024-04-18T14:43:39.928 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00017385799999999999 2024-04-18T14:43:39.928 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:39.928 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:39.928 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_started", 2024-04-18T14:43:39.928 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.767388+0000", 2024-04-18T14:43:39.928 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0015693980000000001 2024-04-18T14:43:39.928 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:39.928 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:39.928 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_committed", 2024-04-18T14:43:39.928 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.774151+0000", 2024-04-18T14:43:39.928 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0067634050000000001 2024-04-18T14:43:39.928 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:39.929 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:39.929 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T14:43:39.929 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.775409+0000", 2024-04-18T14:43:39.929 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00125745 2024-04-18T14:43:39.929 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:39.929 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:39.929 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T14:43:39.929 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.775535+0000", 2024-04-18T14:43:39.929 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000126379 2024-04-18T14:43:39.929 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:43:39.929 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T14:43:39.929 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:43:39.929 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:39.929 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:39.929 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "MOSDECSubOpWriteReply(3.as0 37/30 ECSubWriteReply(tid=23, last_complete=37'16, committed=1, applied=1))", 2024-04-18T14:43:39.930 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T14:43:36.768128+0000", 2024-04-18T14:43:39.930 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 3.0911966899999999, 2024-04-18T14:43:39.930 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0069581299999999999, 2024-04-18T14:43:39.930 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T14:43:39.930 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-04-18T14:43:39.930 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T14:43:39.930 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:39.930 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T14:43:39.930 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.768128+0000", 2024-04-18T14:43:39.930 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:43:39.930 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:39.930 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:39.930 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T14:43:39.930 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.768128+0000", 2024-04-18T14:43:39.930 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:43:39.931 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:39.931 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:39.931 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T14:43:39.931 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.768126+0000", 2024-04-18T14:43:39.931 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999981 2024-04-18T14:43:39.931 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:39.931 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:39.931 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T14:43:39.931 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.768139+0000", 2024-04-18T14:43:39.931 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2493e-05 2024-04-18T14:43:39.931 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:39.931 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:39.931 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T14:43:39.931 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.768169+0000", 2024-04-18T14:43:39.931 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.0463999999999998e-05 2024-04-18T14:43:39.932 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:39.932 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:39.932 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T14:43:39.932 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.768190+0000", 2024-04-18T14:43:39.932 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.1070999999999999e-05 2024-04-18T14:43:39.932 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:39.932 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:39.932 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T14:43:39.932 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.774008+0000", 2024-04-18T14:43:39.932 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0058170929999999997 2024-04-18T14:43:39.932 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:39.932 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:39.932 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T14:43:39.932 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.775086+0000", 2024-04-18T14:43:39.933 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.001078905 2024-04-18T14:43:39.933 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:43:39.933 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T14:43:39.933 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:43:39.933 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:39.933 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:39.933 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "MOSDECSubOpWriteReply(3.as0 37/30 ECSubWriteReply(tid=23, last_complete=37'16, committed=1, applied=1))", 2024-04-18T14:43:39.933 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T14:43:36.769154+0000", 2024-04-18T14:43:39.933 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 3.0901711590000001, 2024-04-18T14:43:39.933 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0050060019999999998, 2024-04-18T14:43:39.933 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T14:43:39.933 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-04-18T14:43:39.933 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T14:43:39.933 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:39.933 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T14:43:39.934 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.769154+0000", 2024-04-18T14:43:39.934 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:43:39.934 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:39.934 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:39.934 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T14:43:39.934 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.769154+0000", 2024-04-18T14:43:39.934 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:43:39.934 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:39.934 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:39.934 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T14:43:39.934 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.769152+0000", 2024-04-18T14:43:39.934 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999981 2024-04-18T14:43:39.934 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:39.934 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:39.935 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T14:43:39.935 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.769166+0000", 2024-04-18T14:43:39.935 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3986e-05 2024-04-18T14:43:39.935 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:39.935 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:39.935 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T14:43:39.935 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.769198+0000", 2024-04-18T14:43:39.935 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.2070999999999998e-05 2024-04-18T14:43:39.935 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:39.935 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:39.935 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T14:43:39.935 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.769218+0000", 2024-04-18T14:43:39.935 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0338000000000001e-05 2024-04-18T14:43:39.935 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:39.935 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:39.936 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T14:43:39.936 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.774100+0000", 2024-04-18T14:43:39.936 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0048815550000000001 2024-04-18T14:43:39.936 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:39.936 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:39.936 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T14:43:39.936 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.774160+0000", 2024-04-18T14:43:39.936 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.0092e-05 2024-04-18T14:43:39.936 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:43:39.936 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T14:43:39.936 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:43:39.936 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:39.936 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:39.936 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "MOSDECSubOpWriteReply(3.as0 37/30 ECSubWriteReply(tid=23, last_complete=37'16, committed=1, applied=1))", 2024-04-18T14:43:39.936 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T14:43:36.769269+0000", 2024-04-18T14:43:39.937 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 3.0900557160000002, 2024-04-18T14:43:39.937 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0049830869999999998, 2024-04-18T14:43:39.937 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T14:43:39.937 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-04-18T14:43:39.937 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T14:43:39.937 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:39.937 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T14:43:39.937 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.769269+0000", 2024-04-18T14:43:39.937 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:43:39.937 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:39.937 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:39.937 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T14:43:39.937 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.769269+0000", 2024-04-18T14:43:39.937 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:43:39.937 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:39.938 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:39.938 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T14:43:39.938 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.769263+0000", 2024-04-18T14:43:39.938 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999938 2024-04-18T14:43:39.938 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:39.938 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:39.938 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T14:43:39.938 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.769275+0000", 2024-04-18T14:43:39.938 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1463e-05 2024-04-18T14:43:39.938 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:39.938 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:39.938 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T14:43:39.938 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.769299+0000", 2024-04-18T14:43:39.938 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.4757999999999999e-05 2024-04-18T14:43:39.938 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:39.939 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:39.939 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T14:43:39.939 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.769314+0000", 2024-04-18T14:43:39.939 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.4443e-05 2024-04-18T14:43:39.939 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:39.939 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:39.939 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T14:43:39.939 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.774225+0000", 2024-04-18T14:43:39.939 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0049107530000000003 2024-04-18T14:43:39.939 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:39.939 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:39.939 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T14:43:39.939 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.774252+0000", 2024-04-18T14:43:39.939 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.779e-05 2024-04-18T14:43:39.939 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:43:39.940 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T14:43:39.940 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:43:39.940 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:39.940 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:39.940 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "MOSDECSubOpWriteReply(3.as0 37/30 ECSubWriteReply(tid=23, last_complete=37'16, committed=1, applied=1))", 2024-04-18T14:43:39.940 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T14:43:36.770427+0000", 2024-04-18T14:43:39.940 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 3.0888981659999999, 2024-04-18T14:43:39.940 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0039472439999999999, 2024-04-18T14:43:39.940 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T14:43:39.940 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-04-18T14:43:39.940 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T14:43:39.940 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:39.940 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T14:43:39.940 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.770427+0000", 2024-04-18T14:43:39.940 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:43:39.941 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:39.941 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:39.941 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T14:43:39.941 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.770427+0000", 2024-04-18T14:43:39.941 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:43:39.941 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:39.941 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:39.941 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T14:43:39.941 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.770425+0000", 2024-04-18T14:43:39.941 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999981 2024-04-18T14:43:39.941 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:39.941 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:39.941 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T14:43:39.941 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.770440+0000", 2024-04-18T14:43:39.941 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.4734e-05 2024-04-18T14:43:39.941 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:39.942 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:39.942 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T14:43:39.942 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.770469+0000", 2024-04-18T14:43:39.942 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.9181000000000001e-05 2024-04-18T14:43:39.942 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:39.942 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:39.942 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T14:43:39.942 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.770487+0000", 2024-04-18T14:43:39.942 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8349999999999999e-05 2024-04-18T14:43:39.942 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:39.942 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:39.942 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T14:43:39.942 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.774345+0000", 2024-04-18T14:43:39.942 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0038580849999999998 2024-04-18T14:43:39.942 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:39.943 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:39.943 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T14:43:39.943 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.774374+0000", 2024-04-18T14:43:39.943 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.8724000000000001e-05 2024-04-18T14:43:39.943 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:43:39.943 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T14:43:39.943 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:43:39.943 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:39.943 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:39.943 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "MOSDECSubOpWriteReply(3.as0 37/30 ECSubWriteReply(tid=24, last_complete=37'18, committed=1, applied=1))", 2024-04-18T14:43:39.943 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T14:43:36.772141+0000", 2024-04-18T14:43:39.943 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 3.0871835769999998, 2024-04-18T14:43:39.943 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0023555249999999998, 2024-04-18T14:43:39.943 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T14:43:39.943 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-04-18T14:43:39.944 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T14:43:39.944 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:39.944 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T14:43:39.944 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.772141+0000", 2024-04-18T14:43:39.944 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:43:39.944 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:39.944 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:39.944 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T14:43:39.944 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.772141+0000", 2024-04-18T14:43:39.944 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:43:39.944 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:39.944 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:39.944 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T14:43:39.944 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.772132+0000", 2024-04-18T14:43:39.944 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999905 2024-04-18T14:43:39.944 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:39.945 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:39.945 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T14:43:39.945 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.772151+0000", 2024-04-18T14:43:39.945 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8807000000000001e-05 2024-04-18T14:43:39.945 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:39.945 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:39.945 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T14:43:39.945 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.772184+0000", 2024-04-18T14:43:39.945 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.3587000000000002e-05 2024-04-18T14:43:39.945 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:39.945 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:39.945 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T14:43:39.945 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.772204+0000", 2024-04-18T14:43:39.945 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.9840999999999999e-05 2024-04-18T14:43:39.945 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:39.946 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:39.946 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T14:43:39.946 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.774428+0000", 2024-04-18T14:43:39.946 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0022235879999999999 2024-04-18T14:43:39.946 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:39.946 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:39.946 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T14:43:39.946 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.774497+0000", 2024-04-18T14:43:39.946 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.9041999999999994e-05 2024-04-18T14:43:39.946 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:43:39.946 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T14:43:39.946 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:43:39.946 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:39.946 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:39.947 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "MOSDECSubOpWriteReply(3.as0 37/30 ECSubWriteReply(tid=24, last_complete=37'18, committed=1, applied=1))", 2024-04-18T14:43:39.947 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T14:43:36.772393+0000", 2024-04-18T14:43:39.947 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 3.0869318300000002, 2024-04-18T14:43:39.947 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0021826340000000001, 2024-04-18T14:43:39.947 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T14:43:39.947 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-04-18T14:43:39.947 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T14:43:39.947 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:39.947 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T14:43:39.947 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.772393+0000", 2024-04-18T14:43:39.947 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:43:39.947 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:39.947 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:39.947 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T14:43:39.947 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.772393+0000", 2024-04-18T14:43:39.948 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:43:39.948 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:39.948 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:39.948 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T14:43:39.948 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.772386+0000", 2024-04-18T14:43:39.948 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999924 2024-04-18T14:43:39.948 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:39.948 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:39.948 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T14:43:39.948 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.772406+0000", 2024-04-18T14:43:39.948 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0650999999999999e-05 2024-04-18T14:43:39.948 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:39.948 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:39.948 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T14:43:39.948 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.772432+0000", 2024-04-18T14:43:39.949 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.5803999999999999e-05 2024-04-18T14:43:39.949 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:39.949 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:39.949 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T14:43:39.949 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.772449+0000", 2024-04-18T14:43:39.949 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6543999999999999e-05 2024-04-18T14:43:39.949 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:39.949 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:39.949 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T14:43:39.949 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.774550+0000", 2024-04-18T14:43:39.949 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0021018550000000001 2024-04-18T14:43:39.949 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:39.949 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:39.949 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T14:43:39.949 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.774576+0000", 2024-04-18T14:43:39.949 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.5401e-05 2024-04-18T14:43:39.950 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:43:39.950 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T14:43:39.950 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:43:39.950 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:39.950 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:39.950 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "MOSDECSubOpWriteReply(3.as0 37/30 ECSubWriteReply(tid=23, last_complete=37'16, committed=1, applied=1))", 2024-04-18T14:43:39.950 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T14:43:36.772724+0000", 2024-04-18T14:43:39.950 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 3.0866005420000002, 2024-04-18T14:43:39.950 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.001986519, 2024-04-18T14:43:39.950 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T14:43:39.950 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-04-18T14:43:39.950 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T14:43:39.950 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:39.950 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T14:43:39.951 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.772724+0000", 2024-04-18T14:43:39.951 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:43:39.951 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:39.951 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:39.951 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T14:43:39.951 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.772724+0000", 2024-04-18T14:43:39.951 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:43:39.951 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:39.951 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:39.951 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T14:43:39.951 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.772722+0000", 2024-04-18T14:43:39.951 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999976 2024-04-18T14:43:39.951 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:39.951 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:39.951 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T14:43:39.951 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.772738+0000", 2024-04-18T14:43:39.952 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5328e-05 2024-04-18T14:43:39.952 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:39.952 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:39.952 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T14:43:39.952 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.772775+0000", 2024-04-18T14:43:39.952 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.6897000000000003e-05 2024-04-18T14:43:39.952 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:39.952 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:39.952 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T14:43:39.952 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.772800+0000", 2024-04-18T14:43:39.952 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.5316999999999998e-05 2024-04-18T14:43:39.952 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:39.952 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:39.952 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T14:43:39.952 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.774684+0000", 2024-04-18T14:43:39.953 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0018842799999999999 2024-04-18T14:43:39.953 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:39.953 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:39.953 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T14:43:39.953 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.774711+0000", 2024-04-18T14:43:39.953 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.6883999999999999e-05 2024-04-18T14:43:39.953 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:43:39.953 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T14:43:39.953 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:43:39.953 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:39.953 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:39.953 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "MOSDECSubOpWriteReply(3.as0 37/30 ECSubWriteReply(tid=24, last_complete=37'18, committed=1, applied=1))", 2024-04-18T14:43:39.953 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T14:43:36.773105+0000", 2024-04-18T14:43:39.953 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 3.0862199349999999, 2024-04-18T14:43:39.953 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0016816940000000001, 2024-04-18T14:43:39.954 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T14:43:39.954 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-04-18T14:43:39.954 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T14:43:39.954 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:39.954 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T14:43:39.954 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.773105+0000", 2024-04-18T14:43:39.954 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:43:39.954 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:39.954 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:39.954 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T14:43:39.954 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.773105+0000", 2024-04-18T14:43:39.954 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:43:39.954 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:39.954 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:39.954 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T14:43:39.955 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.773096+0000", 2024-04-18T14:43:39.955 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999909 2024-04-18T14:43:39.955 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:39.955 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:39.955 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T14:43:39.955 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.773115+0000", 2024-04-18T14:43:39.955 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8930999999999999e-05 2024-04-18T14:43:39.955 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:39.955 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:39.955 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T14:43:39.955 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.773147+0000", 2024-04-18T14:43:39.955 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.1789999999999999e-05 2024-04-18T14:43:39.955 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:39.955 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:39.955 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T14:43:39.956 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.773166+0000", 2024-04-18T14:43:39.956 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8848e-05 2024-04-18T14:43:39.956 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:39.956 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:39.956 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T14:43:39.956 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.774768+0000", 2024-04-18T14:43:39.956 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.001602525 2024-04-18T14:43:39.956 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:39.956 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:39.956 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T14:43:39.956 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.774787+0000", 2024-04-18T14:43:39.956 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8604e-05 2024-04-18T14:43:39.956 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:43:39.956 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T14:43:39.956 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:43:39.957 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:39.957 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:39.957 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "MOSDECSubOpWriteReply(3.as0 37/30 ECSubWriteReply(tid=25, last_complete=37'20, committed=1, applied=1))", 2024-04-18T14:43:39.957 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T14:43:36.777522+0000", 2024-04-18T14:43:39.957 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 3.081803249, 2024-04-18T14:43:39.957 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.001245536, 2024-04-18T14:43:39.957 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T14:43:39.957 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-04-18T14:43:39.957 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T14:43:39.957 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:39.957 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T14:43:39.957 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.777522+0000", 2024-04-18T14:43:39.957 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:43:39.957 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:39.957 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:39.957 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T14:43:39.958 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.777522+0000", 2024-04-18T14:43:39.958 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:43:39.958 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:39.958 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:39.958 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T14:43:39.958 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.777520+0000", 2024-04-18T14:43:39.958 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999981 2024-04-18T14:43:39.958 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:39.958 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:39.958 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T14:43:39.958 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.777533+0000", 2024-04-18T14:43:39.958 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2714000000000001e-05 2024-04-18T14:43:39.958 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:39.958 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:39.959 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T14:43:39.959 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.777565+0000", 2024-04-18T14:43:39.959 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.2214e-05 2024-04-18T14:43:39.959 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:39.959 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:39.959 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T14:43:39.959 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.777590+0000", 2024-04-18T14:43:39.959 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.4913999999999999e-05 2024-04-18T14:43:39.959 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:39.959 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:39.959 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T14:43:39.959 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.777715+0000", 2024-04-18T14:43:39.959 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00012520000000000001 2024-04-18T14:43:39.959 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:39.959 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:39.960 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T14:43:39.960 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.778767+0000", 2024-04-18T14:43:39.960 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0010523080000000001 2024-04-18T14:43:39.960 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:43:39.960 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T14:43:39.960 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:43:39.960 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:43:39.960 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T14:43:39.960 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-04-18T14:43:39.962 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-04-18T14:43:39.962 INFO:tasks.ceph.osd.10.smithi119.stderr:2024-04-18T14:43:39.962+0000 7f6f24c12640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 10 (PID: 24898) UID: 0 2024-04-18T14:43:40.062 INFO:tasks.ceph.osd.0.smithi086.stderr:2024-04-18T14:43:40.063+0000 7f7cdfd78640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 24953) UID: 0 2024-04-18T14:43:40.129 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-04-18T14:43:40.129 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [], 2024-04-18T14:43:40.129 INFO:teuthology.orchestra.run.smithi134.stdout: "num_ops": 0 2024-04-18T14:43:40.129 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-04-18T14:43:40.144 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-04-18T14:43:40.188 INFO:tasks.ceph.osd.15.smithi134.stderr:2024-04-18T14:43:40.192+0000 7f08e6a51640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 15 (PID: 25218) UID: 0 2024-04-18T14:43:40.264 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-04-18T14:43:40.264 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [], 2024-04-18T14:43:40.264 INFO:teuthology.orchestra.run.smithi134.stdout: "complaint_time": 30, 2024-04-18T14:43:40.264 INFO:teuthology.orchestra.run.smithi134.stdout: "num_blocked_ops": 0 2024-04-18T14:43:40.264 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-04-18T14:43:40.264 INFO:tasks.ceph.osd.6.smithi119.stderr:2024-04-18T14:43:40.266+0000 7fb7cb8bd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 24896) UID: 0 2024-04-18T14:43:40.278 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-04-18T14:43:40.365 INFO:tasks.ceph.osd.6.smithi119.stderr:2024-04-18T14:43:40.366+0000 7fb7cb8bd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 24896) UID: 0 2024-04-18T14:43:40.446 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-04-18T14:43:40.446 INFO:teuthology.orchestra.run.smithi134.stdout: "size": 20, 2024-04-18T14:43:40.447 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 600, 2024-04-18T14:43:40.447 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [ 2024-04-18T14:43:40.447 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:40.447 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "MOSDECSubOpWrite(3.as1 35/30 ECSubWrite(tid=16, reqid=client.4559.0:176, at_version=35'10, trim_to=0'0, roll_forward_to=33'8))", 2024-04-18T14:43:40.447 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T14:43:34.719973+0000", 2024-04-18T14:43:40.447 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 5.7270344870000001, 2024-04-18T14:43:40.447 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0071817529999999999, 2024-04-18T14:43:40.447 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T14:43:40.447 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-04-18T14:43:40.447 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T14:43:40.447 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:40.447 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T14:43:40.447 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:34.719973+0000", 2024-04-18T14:43:40.447 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:43:40.448 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:40.448 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:40.448 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T14:43:40.448 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:34.719973+0000", 2024-04-18T14:43:40.448 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:43:40.448 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:40.448 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:40.448 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T14:43:40.448 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:34.719973+0000", 2024-04-18T14:43:40.448 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-04-18T14:43:40.448 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:40.448 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:40.448 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T14:43:40.448 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:34.720054+0000", 2024-04-18T14:43:40.448 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.0933000000000006e-05 2024-04-18T14:43:40.449 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:40.449 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:40.449 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T14:43:40.449 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:34.720091+0000", 2024-04-18T14:43:40.449 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.7611000000000003e-05 2024-04-18T14:43:40.449 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:40.449 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:40.449 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T14:43:40.449 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:34.725072+0000", 2024-04-18T14:43:40.449 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0049810920000000003 2024-04-18T14:43:40.450 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:40.450 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:40.450 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T14:43:40.450 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:34.725204+0000", 2024-04-18T14:43:40.450 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00013195700000000001 2024-04-18T14:43:40.450 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:40.450 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:40.450 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_started", 2024-04-18T14:43:40.450 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:34.725235+0000", 2024-04-18T14:43:40.450 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.0314000000000001e-05 2024-04-18T14:43:40.450 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:40.451 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:40.451 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_committed", 2024-04-18T14:43:40.451 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:34.727109+0000", 2024-04-18T14:43:40.451 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.001874625 2024-04-18T14:43:40.451 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:40.451 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:40.451 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T14:43:40.451 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:34.727155+0000", 2024-04-18T14:43:40.451 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.5748000000000003e-05 2024-04-18T14:43:40.451 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:43:40.451 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T14:43:40.451 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:43:40.451 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:40.452 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:40.452 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "MOSDECSubOpWrite(3.as1 35/30 ECSubWrite(tid=17, reqid=client.4559.0:176, at_version=0'0, trim_to=0'0, roll_forward_to=35'10))", 2024-04-18T14:43:40.452 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T14:43:34.729407+0000", 2024-04-18T14:43:40.452 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 5.7176006079999997, 2024-04-18T14:43:40.452 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0012620089999999999, 2024-04-18T14:43:40.452 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T14:43:40.452 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-04-18T14:43:40.452 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T14:43:40.452 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:40.452 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T14:43:40.452 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:34.729407+0000", 2024-04-18T14:43:40.453 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:43:40.453 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:40.453 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:40.453 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T14:43:40.453 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:34.729407+0000", 2024-04-18T14:43:40.453 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:43:40.453 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:40.453 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:40.453 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T14:43:40.453 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:34.729406+0000", 2024-04-18T14:43:40.453 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-18T14:43:40.454 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:40.454 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:40.454 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T14:43:40.454 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:34.729424+0000", 2024-04-18T14:43:40.454 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.7433999999999999e-05 2024-04-18T14:43:40.454 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:40.454 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:40.454 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T14:43:40.454 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:34.729438+0000", 2024-04-18T14:43:40.454 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.4511e-05 2024-04-18T14:43:40.454 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:40.454 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:40.455 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T14:43:40.455 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:34.729449+0000", 2024-04-18T14:43:40.455 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0718e-05 2024-04-18T14:43:40.455 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:40.455 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:40.455 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T14:43:40.455 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:34.729580+0000", 2024-04-18T14:43:40.455 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000131495 2024-04-18T14:43:40.455 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:40.455 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:40.455 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_started", 2024-04-18T14:43:40.455 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:34.729611+0000", 2024-04-18T14:43:40.455 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.0437e-05 2024-04-18T14:43:40.455 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:40.455 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:40.456 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_committed", 2024-04-18T14:43:40.456 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:34.730639+0000", 2024-04-18T14:43:40.456 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0010288230000000001 2024-04-18T14:43:40.456 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:40.456 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:40.456 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T14:43:40.456 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:34.730669+0000", 2024-04-18T14:43:40.456 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.9683e-05 2024-04-18T14:43:40.456 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:43:40.456 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T14:43:40.456 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:43:40.456 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:40.456 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:40.456 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "MOSDECSubOpWrite(3.as1 36/30 ECSubWrite(tid=18, reqid=client.4559.0:178, at_version=36'12, trim_to=0'0, roll_forward_to=35'10))", 2024-04-18T14:43:40.457 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T14:43:35.741752+0000", 2024-04-18T14:43:40.457 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 4.7052555609999995, 2024-04-18T14:43:40.457 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0037328299999999999, 2024-04-18T14:43:40.457 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T14:43:40.457 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-04-18T14:43:40.457 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T14:43:40.457 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:40.457 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T14:43:40.457 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:35.741752+0000", 2024-04-18T14:43:40.457 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:43:40.457 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:40.457 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:40.457 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T14:43:40.457 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:35.741752+0000", 2024-04-18T14:43:40.457 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:43:40.457 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:40.458 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:40.458 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T14:43:40.458 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:35.741752+0000", 2024-04-18T14:43:40.458 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-04-18T14:43:40.458 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:40.458 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:40.458 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T14:43:40.458 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:35.741956+0000", 2024-04-18T14:43:40.458 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00020423300000000001 2024-04-18T14:43:40.459 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:40.459 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:40.459 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T14:43:40.459 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:35.741973+0000", 2024-04-18T14:43:40.459 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6659000000000001e-05 2024-04-18T14:43:40.459 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:40.459 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:40.459 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T14:43:40.460 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:35.741985+0000", 2024-04-18T14:43:40.460 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2502e-05 2024-04-18T14:43:40.460 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:40.460 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:40.460 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T14:43:40.460 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:35.742148+0000", 2024-04-18T14:43:40.460 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00016324699999999999 2024-04-18T14:43:40.460 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:40.460 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:40.460 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_started", 2024-04-18T14:43:40.461 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:35.742172+0000", 2024-04-18T14:43:40.461 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.3859999999999999e-05 2024-04-18T14:43:40.461 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:40.461 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:40.461 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_committed", 2024-04-18T14:43:40.461 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:35.745447+0000", 2024-04-18T14:43:40.461 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.003275268 2024-04-18T14:43:40.462 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:40.462 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:40.462 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T14:43:40.462 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:35.745485+0000", 2024-04-18T14:43:40.462 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.7561999999999997e-05 2024-04-18T14:43:40.462 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:43:40.462 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T14:43:40.462 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:43:40.462 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:40.462 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:40.462 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "MOSDECSubOpWrite(3.as1 36/30 ECSubWrite(tid=19, reqid=client.4559.0:179, at_version=36'13, trim_to=0'0, roll_forward_to=35'10))", 2024-04-18T14:43:40.462 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T14:43:35.743818+0000", 2024-04-18T14:43:40.462 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 4.7031894279999999, 2024-04-18T14:43:40.463 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.002443279, 2024-04-18T14:43:40.463 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T14:43:40.463 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-04-18T14:43:40.463 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T14:43:40.463 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:40.463 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T14:43:40.463 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:35.743818+0000", 2024-04-18T14:43:40.463 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:43:40.464 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:40.464 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:40.464 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T14:43:40.464 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:35.743818+0000", 2024-04-18T14:43:40.464 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:43:40.464 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:40.464 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:40.465 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T14:43:40.465 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:35.743817+0000", 2024-04-18T14:43:40.465 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-18T14:43:40.465 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:40.465 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:40.465 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T14:43:40.466 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:35.743954+0000", 2024-04-18T14:43:40.466 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00013716999999999999 2024-04-18T14:43:40.466 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:40.466 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:40.466 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T14:43:40.466 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:35.743973+0000", 2024-04-18T14:43:40.466 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8396000000000001e-05 2024-04-18T14:43:40.467 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:40.467 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:40.467 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T14:43:40.467 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:35.743989+0000", 2024-04-18T14:43:40.467 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5926e-05 2024-04-18T14:43:40.467 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:40.467 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:40.467 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T14:43:40.467 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:35.744418+0000", 2024-04-18T14:43:40.467 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00042939900000000001 2024-04-18T14:43:40.467 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:40.468 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:40.468 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_started", 2024-04-18T14:43:40.468 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:35.744431+0000", 2024-04-18T14:43:40.468 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3089e-05 2024-04-18T14:43:40.468 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:40.468 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:40.468 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_committed", 2024-04-18T14:43:40.468 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:35.746188+0000", 2024-04-18T14:43:40.468 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.001756606 2024-04-18T14:43:40.468 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:40.468 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:40.468 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T14:43:40.469 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:35.746262+0000", 2024-04-18T14:43:40.469 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.3875999999999995e-05 2024-04-18T14:43:40.469 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:43:40.469 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T14:43:40.469 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:43:40.469 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:40.469 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:40.469 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "MOSDECSubOpWrite(3.as1 36/30 ECSubWrite(tid=20, reqid=client.4559.0:180, at_version=36'14, trim_to=0'0, roll_forward_to=35'10))", 2024-04-18T14:43:40.469 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T14:43:35.746138+0000", 2024-04-18T14:43:40.469 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 4.7008700690000005, 2024-04-18T14:43:40.469 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.002201087, 2024-04-18T14:43:40.469 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T14:43:40.469 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-04-18T14:43:40.469 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T14:43:40.469 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:40.470 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T14:43:40.470 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:35.746138+0000", 2024-04-18T14:43:40.470 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:43:40.470 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:40.470 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:40.470 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T14:43:40.470 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:35.746138+0000", 2024-04-18T14:43:40.470 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:43:40.470 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:40.470 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:40.470 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T14:43:40.470 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:35.746136+0000", 2024-04-18T14:43:40.470 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999986 2024-04-18T14:43:40.470 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:40.471 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:40.471 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T14:43:40.471 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:35.746161+0000", 2024-04-18T14:43:40.471 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.4879e-05 2024-04-18T14:43:40.471 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:40.471 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:40.471 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T14:43:40.471 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:35.746176+0000", 2024-04-18T14:43:40.471 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5336e-05 2024-04-18T14:43:40.471 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:40.471 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:40.471 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T14:43:40.471 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:35.746190+0000", 2024-04-18T14:43:40.471 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3684e-05 2024-04-18T14:43:40.471 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:40.472 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:40.472 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T14:43:40.472 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:35.746348+0000", 2024-04-18T14:43:40.472 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00015826699999999999 2024-04-18T14:43:40.472 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:40.472 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:40.472 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_started", 2024-04-18T14:43:40.472 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:35.746372+0000", 2024-04-18T14:43:40.473 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.3099999999999999e-05 2024-04-18T14:43:40.473 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:40.473 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:40.473 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_committed", 2024-04-18T14:43:40.473 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:35.748242+0000", 2024-04-18T14:43:40.473 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0018703719999999999 2024-04-18T14:43:40.473 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:40.473 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:40.473 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T14:43:40.473 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:35.748339+0000", 2024-04-18T14:43:40.473 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.6904999999999995e-05 2024-04-18T14:43:40.473 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:43:40.473 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T14:43:40.474 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:43:40.474 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:40.474 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:40.474 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "MOSDECSubOpWrite(3.as1 36/30 ECSubWrite(tid=21, reqid=client.4559.0:180, at_version=0'0, trim_to=0'0, roll_forward_to=36'14))", 2024-04-18T14:43:40.474 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T14:43:35.749540+0000", 2024-04-18T14:43:40.474 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 4.6974674959999998, 2024-04-18T14:43:40.474 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0011287910000000001, 2024-04-18T14:43:40.475 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T14:43:40.475 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-04-18T14:43:40.475 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T14:43:40.475 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:40.475 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T14:43:40.475 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:35.749540+0000", 2024-04-18T14:43:40.475 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:43:40.475 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:40.475 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:40.475 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T14:43:40.475 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:35.749540+0000", 2024-04-18T14:43:40.475 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:43:40.476 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:40.476 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:40.476 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T14:43:40.476 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:35.749539+0000", 2024-04-18T14:43:40.476 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999986 2024-04-18T14:43:40.476 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:40.476 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:40.476 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T14:43:40.476 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:35.749561+0000", 2024-04-18T14:43:40.476 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2650000000000002e-05 2024-04-18T14:43:40.476 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:40.476 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:40.476 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T14:43:40.476 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:35.749591+0000", 2024-04-18T14:43:40.477 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.9768e-05 2024-04-18T14:43:40.477 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:40.477 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:40.477 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T14:43:40.477 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:35.749614+0000", 2024-04-18T14:43:40.477 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2657e-05 2024-04-18T14:43:40.477 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:40.478 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:40.478 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T14:43:40.478 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:35.749698+0000", 2024-04-18T14:43:40.478 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.4300000000000003e-05 2024-04-18T14:43:40.478 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:40.479 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:40.479 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_started", 2024-04-18T14:43:40.479 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:35.749711+0000", 2024-04-18T14:43:40.479 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3206e-05 2024-04-18T14:43:40.479 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:40.479 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:40.480 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_committed", 2024-04-18T14:43:40.480 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:35.750638+0000", 2024-04-18T14:43:40.480 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000926299 2024-04-18T14:43:40.480 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:40.480 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:40.480 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T14:43:40.481 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:35.750669+0000", 2024-04-18T14:43:40.481 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.1507000000000002e-05 2024-04-18T14:43:40.481 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:43:40.481 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T14:43:40.481 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:43:40.481 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:40.482 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:40.482 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "MOSDECSubOpRead(3.as1 36/30 ECSubRead(tid=22, to_read={3:504bbe78:::smithi13430248-37:head=0,4096,0}, subchunks={3:504bbe78:::smithi13430248-37:head=[0,1]}, attrs_to_read=))", 2024-04-18T14:43:40.482 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T14:43:35.750805+0000", 2024-04-18T14:43:40.482 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 4.6962028260000004, 2024-04-18T14:43:40.482 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00029772000000000002, 2024-04-18T14:43:40.482 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T14:43:40.483 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-04-18T14:43:40.483 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T14:43:40.483 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:40.483 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T14:43:40.483 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:35.750805+0000", 2024-04-18T14:43:40.484 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:43:40.484 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:40.484 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:40.484 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T14:43:40.484 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:35.750805+0000", 2024-04-18T14:43:40.484 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:43:40.485 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:40.485 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:40.485 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T14:43:40.485 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:35.750803+0000", 2024-04-18T14:43:40.485 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999981 2024-04-18T14:43:40.486 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:40.486 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:40.486 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T14:43:40.486 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:35.750827+0000", 2024-04-18T14:43:40.486 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.3989999999999999e-05 2024-04-18T14:43:40.486 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:40.486 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:40.487 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T14:43:40.487 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:35.750871+0000", 2024-04-18T14:43:40.487 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.3631999999999998e-05 2024-04-18T14:43:40.487 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:40.487 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:40.487 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T14:43:40.487 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:35.750898+0000", 2024-04-18T14:43:40.488 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.7634e-05 2024-04-18T14:43:40.488 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:40.488 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:40.488 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T14:43:40.488 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:35.750981+0000", 2024-04-18T14:43:40.488 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.2188999999999995e-05 2024-04-18T14:43:40.489 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:40.489 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:40.489 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T14:43:40.489 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:35.751103+0000", 2024-04-18T14:43:40.489 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00012212200000000001 2024-04-18T14:43:40.489 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:43:40.489 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T14:43:40.490 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:43:40.490 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:40.490 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:40.490 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "MOSDECSubOpWrite(3.bs5 37/30 ECSubWrite(tid=16, reqid=client.4559.0:185, at_version=37'8, trim_to=0'0, roll_forward_to=33'6))", 2024-04-18T14:43:40.490 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T14:43:36.727016+0000", 2024-04-18T14:43:40.490 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 3.7199914629999999, 2024-04-18T14:43:40.490 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0026379229999999999, 2024-04-18T14:43:40.491 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T14:43:40.491 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-04-18T14:43:40.491 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T14:43:40.491 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:40.491 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T14:43:40.491 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.727016+0000", 2024-04-18T14:43:40.491 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:43:40.491 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:40.492 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:40.492 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T14:43:40.492 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.727016+0000", 2024-04-18T14:43:40.492 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:43:40.492 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:40.492 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:40.492 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T14:43:40.492 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.727016+0000", 2024-04-18T14:43:40.493 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-04-18T14:43:40.493 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:40.493 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:40.493 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T14:43:40.493 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.727074+0000", 2024-04-18T14:43:40.493 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.8285000000000002e-05 2024-04-18T14:43:40.493 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:40.494 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:40.494 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T14:43:40.494 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.727098+0000", 2024-04-18T14:43:40.494 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.3683999999999999e-05 2024-04-18T14:43:40.494 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:40.494 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:40.495 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T14:43:40.495 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.727123+0000", 2024-04-18T14:43:40.495 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.5397000000000001e-05 2024-04-18T14:43:40.495 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:40.495 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:40.495 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T14:43:40.496 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.727286+0000", 2024-04-18T14:43:40.496 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000162745 2024-04-18T14:43:40.496 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:40.496 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:40.496 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_started", 2024-04-18T14:43:40.496 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.727311+0000", 2024-04-18T14:43:40.497 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.5483999999999999e-05 2024-04-18T14:43:40.497 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:40.497 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:40.497 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_committed", 2024-04-18T14:43:40.497 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.729603+0000", 2024-04-18T14:43:40.497 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0022916199999999999 2024-04-18T14:43:40.497 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:40.497 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:40.498 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T14:43:40.498 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.729654+0000", 2024-04-18T14:43:40.498 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.1248000000000001e-05 2024-04-18T14:43:40.498 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:43:40.498 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T14:43:40.498 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:43:40.498 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:40.498 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:40.498 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "MOSDECSubOpWrite(3.bs5 37/30 ECSubWrite(tid=17, reqid=client.4559.0:185, at_version=0'0, trim_to=0'0, roll_forward_to=37'8))", 2024-04-18T14:43:40.499 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T14:43:36.734686+0000", 2024-04-18T14:43:40.499 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 3.712321932, 2024-04-18T14:43:40.499 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0011937549999999999, 2024-04-18T14:43:40.499 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T14:43:40.499 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-04-18T14:43:40.499 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T14:43:40.499 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:40.499 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T14:43:40.499 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.734686+0000", 2024-04-18T14:43:40.500 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:43:40.500 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:40.500 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:40.500 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T14:43:40.500 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.734686+0000", 2024-04-18T14:43:40.500 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:43:40.500 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:40.500 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:40.501 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T14:43:40.501 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.734684+0000", 2024-04-18T14:43:40.501 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999986 2024-04-18T14:43:40.501 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:40.501 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:40.501 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T14:43:40.502 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.734708+0000", 2024-04-18T14:43:40.502 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.4034000000000001e-05 2024-04-18T14:43:40.502 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:40.502 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:40.502 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T14:43:40.502 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.734734+0000", 2024-04-18T14:43:40.502 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.5120999999999999e-05 2024-04-18T14:43:40.503 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:40.503 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:40.503 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T14:43:40.503 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.734748+0000", 2024-04-18T14:43:40.503 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.4627000000000001e-05 2024-04-18T14:43:40.503 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:40.504 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:40.504 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T14:43:40.504 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.734864+0000", 2024-04-18T14:43:40.504 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00011629999999999999 2024-04-18T14:43:40.504 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:40.504 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:40.504 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_started", 2024-04-18T14:43:40.504 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.734879+0000", 2024-04-18T14:43:40.504 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.4996e-05 2024-04-18T14:43:40.504 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:40.505 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:40.505 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_committed", 2024-04-18T14:43:40.505 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.735838+0000", 2024-04-18T14:43:40.505 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00095838599999999998 2024-04-18T14:43:40.505 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:40.505 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:40.505 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T14:43:40.505 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.735880+0000", 2024-04-18T14:43:40.505 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.1783999999999998e-05 2024-04-18T14:43:40.505 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:43:40.505 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T14:43:40.505 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:43:40.505 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:40.505 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:40.506 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "MOSDECSubOpWrite(3.as1 37/30 ECSubWrite(tid=23, reqid=client.4559.0:190, at_version=37'16, trim_to=0'0, roll_forward_to=36'14))", 2024-04-18T14:43:40.506 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T14:43:36.767377+0000", 2024-04-18T14:43:40.506 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 3.6796309890000001, 2024-04-18T14:43:40.506 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00291362, 2024-04-18T14:43:40.506 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T14:43:40.506 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-04-18T14:43:40.506 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T14:43:40.506 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:40.506 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T14:43:40.506 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.767377+0000", 2024-04-18T14:43:40.506 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:43:40.507 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:40.507 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:40.507 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T14:43:40.507 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.767377+0000", 2024-04-18T14:43:40.507 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:43:40.507 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:40.507 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:40.507 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T14:43:40.507 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.767376+0000", 2024-04-18T14:43:40.507 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-04-18T14:43:40.507 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:40.508 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:40.508 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T14:43:40.508 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.767427+0000", 2024-04-18T14:43:40.508 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.1238e-05 2024-04-18T14:43:40.508 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:40.508 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:40.508 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T14:43:40.508 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.767455+0000", 2024-04-18T14:43:40.508 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.7467e-05 2024-04-18T14:43:40.508 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:40.508 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:40.508 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T14:43:40.508 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.767477+0000", 2024-04-18T14:43:40.508 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2268000000000001e-05 2024-04-18T14:43:40.509 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:40.509 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:40.509 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T14:43:40.509 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.767618+0000", 2024-04-18T14:43:40.509 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00014043000000000001 2024-04-18T14:43:40.509 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:40.509 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:40.509 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_started", 2024-04-18T14:43:40.509 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.767644+0000", 2024-04-18T14:43:40.509 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.6509999999999999e-05 2024-04-18T14:43:40.509 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:40.509 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:40.510 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_committed", 2024-04-18T14:43:40.510 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.770243+0000", 2024-04-18T14:43:40.510 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.002599156 2024-04-18T14:43:40.510 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:40.510 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:40.510 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T14:43:40.510 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.770290+0000", 2024-04-18T14:43:40.510 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.7131e-05 2024-04-18T14:43:40.510 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:43:40.510 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T14:43:40.510 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:43:40.510 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:40.510 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:40.511 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "MOSDECSubOpWrite(3.as1 37/30 ECSubWrite(tid=24, reqid=osd.3.0:24, at_version=37'18, trim_to=0'0, roll_forward_to=36'14))", 2024-04-18T14:43:40.511 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T14:43:36.770928+0000", 2024-04-18T14:43:40.511 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 3.6760793290000002, 2024-04-18T14:43:40.511 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0024431710000000001, 2024-04-18T14:43:40.511 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T14:43:40.511 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-04-18T14:43:40.511 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T14:43:40.511 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:40.511 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T14:43:40.511 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.770928+0000", 2024-04-18T14:43:40.511 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:43:40.511 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:40.511 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:40.511 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T14:43:40.512 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.770928+0000", 2024-04-18T14:43:40.512 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:43:40.512 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:40.512 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:40.512 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T14:43:40.512 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.770927+0000", 2024-04-18T14:43:40.512 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999986 2024-04-18T14:43:40.512 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:40.512 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:40.512 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T14:43:40.512 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.770967+0000", 2024-04-18T14:43:40.512 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.9511000000000002e-05 2024-04-18T14:43:40.512 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:40.512 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:40.513 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T14:43:40.513 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.770994+0000", 2024-04-18T14:43:40.513 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.7208000000000001e-05 2024-04-18T14:43:40.513 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:40.513 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:40.513 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T14:43:40.513 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.771016+0000", 2024-04-18T14:43:40.513 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2177000000000001e-05 2024-04-18T14:43:40.513 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:40.513 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:40.513 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T14:43:40.513 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.771132+0000", 2024-04-18T14:43:40.513 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000115726 2024-04-18T14:43:40.513 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:40.513 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:40.514 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_started", 2024-04-18T14:43:40.514 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.771156+0000", 2024-04-18T14:43:40.514 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.4363999999999999e-05 2024-04-18T14:43:40.514 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:40.514 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:40.514 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_committed", 2024-04-18T14:43:40.514 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.773319+0000", 2024-04-18T14:43:40.514 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0021629570000000001 2024-04-18T14:43:40.514 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:40.514 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:40.514 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T14:43:40.515 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.773372+0000", 2024-04-18T14:43:40.515 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.2577999999999997e-05 2024-04-18T14:43:40.515 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:43:40.515 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T14:43:40.515 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:43:40.515 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:40.515 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:40.515 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "MOSDECSubOpWrite(3.as1 37/30 ECSubWrite(tid=25, reqid=osd.3.0:25, at_version=37'20, trim_to=0'0, roll_forward_to=36'14))", 2024-04-18T14:43:40.516 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T14:43:36.773520+0000", 2024-04-18T14:43:40.516 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 3.6734872940000001, 2024-04-18T14:43:40.516 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0025899909999999998, 2024-04-18T14:43:40.516 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T14:43:40.516 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-04-18T14:43:40.516 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T14:43:40.516 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:40.516 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T14:43:40.516 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.773520+0000", 2024-04-18T14:43:40.516 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:43:40.516 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:40.516 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:40.516 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T14:43:40.516 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.773520+0000", 2024-04-18T14:43:40.516 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:43:40.516 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:40.517 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:40.517 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T14:43:40.517 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.773519+0000", 2024-04-18T14:43:40.517 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999981 2024-04-18T14:43:40.517 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:40.517 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:40.517 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T14:43:40.517 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.773576+0000", 2024-04-18T14:43:40.517 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.7034999999999999e-05 2024-04-18T14:43:40.517 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:40.517 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:40.518 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T14:43:40.518 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.773612+0000", 2024-04-18T14:43:40.518 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.5917999999999997e-05 2024-04-18T14:43:40.518 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:40.518 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:40.518 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T14:43:40.518 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.773634+0000", 2024-04-18T14:43:40.518 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2303999999999999e-05 2024-04-18T14:43:40.518 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:40.518 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:40.518 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T14:43:40.518 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.773797+0000", 2024-04-18T14:43:40.518 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000162824 2024-04-18T14:43:40.519 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:40.519 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:40.519 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_started", 2024-04-18T14:43:40.519 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.773819+0000", 2024-04-18T14:43:40.519 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2246999999999999e-05 2024-04-18T14:43:40.519 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:40.519 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:40.519 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_committed", 2024-04-18T14:43:40.519 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.776050+0000", 2024-04-18T14:43:40.519 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0022306890000000001 2024-04-18T14:43:40.519 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:40.519 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:40.519 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T14:43:40.519 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.776110+0000", 2024-04-18T14:43:40.519 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.0871e-05 2024-04-18T14:43:40.519 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:43:40.520 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T14:43:40.520 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:43:40.520 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:40.520 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:40.520 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "MOSDECSubOpWrite(3.as1 37/30 ECSubWrite(tid=26, reqid=osd.3.0:25, at_version=0'0, trim_to=0'0, roll_forward_to=37'20))", 2024-04-18T14:43:40.520 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T14:43:36.778182+0000", 2024-04-18T14:43:40.520 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 3.6688257650000002, 2024-04-18T14:43:40.520 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.001771037, 2024-04-18T14:43:40.520 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T14:43:40.520 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-04-18T14:43:40.520 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T14:43:40.520 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:40.520 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T14:43:40.520 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.778182+0000", 2024-04-18T14:43:40.520 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:43:40.521 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:40.521 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:40.521 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T14:43:40.521 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.778182+0000", 2024-04-18T14:43:40.521 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:43:40.521 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:40.521 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:40.521 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T14:43:40.521 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.778180+0000", 2024-04-18T14:43:40.521 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999986 2024-04-18T14:43:40.521 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:40.521 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:40.521 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T14:43:40.521 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.778207+0000", 2024-04-18T14:43:40.521 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.6574e-05 2024-04-18T14:43:40.522 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:40.522 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:40.522 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T14:43:40.522 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.778249+0000", 2024-04-18T14:43:40.522 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.1761000000000002e-05 2024-04-18T14:43:40.522 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:40.522 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:40.522 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T14:43:40.522 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.778271+0000", 2024-04-18T14:43:40.522 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2761000000000001e-05 2024-04-18T14:43:40.522 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:40.522 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:40.522 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T14:43:40.522 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.778433+0000", 2024-04-18T14:43:40.523 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00016175099999999999 2024-04-18T14:43:40.523 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:40.523 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:40.523 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_started", 2024-04-18T14:43:40.523 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.778457+0000", 2024-04-18T14:43:40.523 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.3536999999999998e-05 2024-04-18T14:43:40.523 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:40.523 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:40.523 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_committed", 2024-04-18T14:43:40.523 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.779898+0000", 2024-04-18T14:43:40.523 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0014416349999999999 2024-04-18T14:43:40.523 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:40.523 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:40.523 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T14:43:40.523 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.779953+0000", 2024-04-18T14:43:40.524 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.4635000000000001e-05 2024-04-18T14:43:40.524 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:43:40.524 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T14:43:40.524 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:43:40.524 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:40.524 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:40.524 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "MOSDECSubOpWrite(3.6s5 37/30 ECSubWrite(tid=37, reqid=client.4559.0:201, at_version=37'10, trim_to=0'0, roll_forward_to=33'8))", 2024-04-18T14:43:40.524 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T14:43:36.780638+0000", 2024-04-18T14:43:40.524 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 3.66637016, 2024-04-18T14:43:40.524 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0030067890000000002, 2024-04-18T14:43:40.524 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T14:43:40.525 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-04-18T14:43:40.525 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T14:43:40.525 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:40.525 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T14:43:40.525 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.780638+0000", 2024-04-18T14:43:40.525 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:43:40.525 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:40.525 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:40.525 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T14:43:40.525 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.780638+0000", 2024-04-18T14:43:40.525 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:43:40.525 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:40.525 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:40.526 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T14:43:40.526 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.780637+0000", 2024-04-18T14:43:40.526 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-18T14:43:40.526 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:40.526 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:40.526 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T14:43:40.526 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.780688+0000", 2024-04-18T14:43:40.527 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.1337e-05 2024-04-18T14:43:40.527 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:40.527 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:40.527 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T14:43:40.527 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.780729+0000", 2024-04-18T14:43:40.527 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.0991000000000001e-05 2024-04-18T14:43:40.527 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:40.527 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:40.527 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T14:43:40.527 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.780754+0000", 2024-04-18T14:43:40.527 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.5191e-05 2024-04-18T14:43:40.528 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:40.528 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:40.528 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T14:43:40.528 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.781018+0000", 2024-04-18T14:43:40.528 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00026336699999999997 2024-04-18T14:43:40.528 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:40.528 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:40.529 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_started", 2024-04-18T14:43:40.529 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.781033+0000", 2024-04-18T14:43:40.529 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5264000000000002e-05 2024-04-18T14:43:40.529 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:40.529 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:40.529 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_committed", 2024-04-18T14:43:40.529 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.783572+0000", 2024-04-18T14:43:40.529 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0025389499999999999 2024-04-18T14:43:40.529 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:40.529 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:40.529 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T14:43:40.530 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.783644+0000", 2024-04-18T14:43:40.530 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.2448999999999997e-05 2024-04-18T14:43:40.530 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:43:40.530 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T14:43:40.530 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:43:40.530 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:40.530 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:40.530 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "MOSDECSubOpWrite(3.6s5 37/30 ECSubWrite(tid=38, reqid=client.4559.0:201, at_version=0'0, trim_to=0'0, roll_forward_to=37'10))", 2024-04-18T14:43:40.530 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T14:43:36.785937+0000", 2024-04-18T14:43:40.531 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 3.6610710950000001, 2024-04-18T14:43:40.531 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0033208719999999999, 2024-04-18T14:43:40.531 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T14:43:40.531 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-04-18T14:43:40.531 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T14:43:40.531 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:40.531 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T14:43:40.531 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.785937+0000", 2024-04-18T14:43:40.531 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:43:40.531 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:40.531 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:40.531 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T14:43:40.531 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.785937+0000", 2024-04-18T14:43:40.531 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:43:40.532 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:40.532 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:40.532 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T14:43:40.532 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.785934+0000", 2024-04-18T14:43:40.532 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999971 2024-04-18T14:43:40.532 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:40.532 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:40.532 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T14:43:40.532 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.785970+0000", 2024-04-18T14:43:40.532 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.6300999999999997e-05 2024-04-18T14:43:40.532 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:40.532 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:40.533 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T14:43:40.533 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.786019+0000", 2024-04-18T14:43:40.533 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.8977000000000002e-05 2024-04-18T14:43:40.533 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:40.533 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:40.533 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T14:43:40.533 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.786041+0000", 2024-04-18T14:43:40.533 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2268000000000001e-05 2024-04-18T14:43:40.533 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:40.533 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:40.533 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T14:43:40.533 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.786153+0000", 2024-04-18T14:43:40.533 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00011198599999999999 2024-04-18T14:43:40.533 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:40.533 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:40.534 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_started", 2024-04-18T14:43:40.534 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.786178+0000", 2024-04-18T14:43:40.534 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.5100999999999999e-05 2024-04-18T14:43:40.534 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:40.534 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:40.534 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_committed", 2024-04-18T14:43:40.534 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.789196+0000", 2024-04-18T14:43:40.534 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0030173230000000001 2024-04-18T14:43:40.534 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:40.535 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:40.535 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T14:43:40.535 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.789258+0000", 2024-04-18T14:43:40.535 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.1882000000000001e-05 2024-04-18T14:43:40.535 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:43:40.535 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T14:43:40.535 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:43:40.535 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:40.535 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:40.535 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "MOSDECSubOpWrite(3.6s5 37/30 ECSubWrite(tid=41, reqid=client.4559.0:206, at_version=37'12, trim_to=0'0, roll_forward_to=37'10))", 2024-04-18T14:43:40.535 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T14:43:36.870018+0000", 2024-04-18T14:43:40.535 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 3.5769901150000001, 2024-04-18T14:43:40.535 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0037207579999999998, 2024-04-18T14:43:40.535 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T14:43:40.535 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-04-18T14:43:40.536 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T14:43:40.536 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:40.536 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T14:43:40.536 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.870018+0000", 2024-04-18T14:43:40.536 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:43:40.536 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:40.536 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:40.536 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T14:43:40.537 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.870018+0000", 2024-04-18T14:43:40.537 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:43:40.537 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:40.537 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:40.537 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T14:43:40.537 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.870015+0000", 2024-04-18T14:43:40.538 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999971 2024-04-18T14:43:40.538 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:40.538 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:40.538 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T14:43:40.538 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.870615+0000", 2024-04-18T14:43:40.538 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00060020799999999997 2024-04-18T14:43:40.538 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:40.538 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:40.538 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T14:43:40.539 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.870659+0000", 2024-04-18T14:43:40.539 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.3727999999999999e-05 2024-04-18T14:43:40.539 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:40.539 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:40.539 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T14:43:40.539 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.870686+0000", 2024-04-18T14:43:40.539 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.7370999999999999e-05 2024-04-18T14:43:40.539 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:40.539 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:40.539 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T14:43:40.539 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.870843+0000", 2024-04-18T14:43:40.539 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00015669100000000001 2024-04-18T14:43:40.539 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:40.539 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:40.539 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_started", 2024-04-18T14:43:40.540 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.870870+0000", 2024-04-18T14:43:40.540 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.7076999999999998e-05 2024-04-18T14:43:40.540 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:40.540 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:40.540 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_committed", 2024-04-18T14:43:40.540 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.873677+0000", 2024-04-18T14:43:40.540 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.002806841 2024-04-18T14:43:40.540 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:40.540 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:40.540 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T14:43:40.540 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.873738+0000", 2024-04-18T14:43:40.540 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.1908000000000004e-05 2024-04-18T14:43:40.540 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:43:40.540 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T14:43:40.540 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:43:40.541 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:40.541 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:40.541 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "MOSDECSubOpWrite(3.6s5 37/30 ECSubWrite(tid=43, reqid=client.4559.0:206, at_version=0'0, trim_to=0'0, roll_forward_to=37'12))", 2024-04-18T14:43:40.541 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T14:43:36.876388+0000", 2024-04-18T14:43:40.541 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 3.5706195469999997, 2024-04-18T14:43:40.541 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.001416411, 2024-04-18T14:43:40.541 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T14:43:40.541 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-04-18T14:43:40.541 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T14:43:40.541 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:40.541 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T14:43:40.541 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.876388+0000", 2024-04-18T14:43:40.542 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:43:40.542 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:40.542 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:40.542 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T14:43:40.542 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.876388+0000", 2024-04-18T14:43:40.542 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:43:40.542 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:40.542 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:40.542 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T14:43:40.542 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.876387+0000", 2024-04-18T14:43:40.543 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999981 2024-04-18T14:43:40.543 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:40.543 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:40.543 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T14:43:40.543 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.876416+0000", 2024-04-18T14:43:40.543 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.9660000000000001e-05 2024-04-18T14:43:40.543 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:40.543 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:40.543 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T14:43:40.543 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.876454+0000", 2024-04-18T14:43:40.543 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.8228000000000001e-05 2024-04-18T14:43:40.543 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:40.543 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:40.543 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T14:43:40.543 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.876478+0000", 2024-04-18T14:43:40.543 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.4049999999999998e-05 2024-04-18T14:43:40.544 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:40.544 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:40.544 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T14:43:40.544 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.876581+0000", 2024-04-18T14:43:40.544 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00010244 2024-04-18T14:43:40.544 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:40.544 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:40.544 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_started", 2024-04-18T14:43:40.544 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.876596+0000", 2024-04-18T14:43:40.544 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5193e-05 2024-04-18T14:43:40.544 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:40.544 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:40.544 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_committed", 2024-04-18T14:43:40.544 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.877758+0000", 2024-04-18T14:43:40.544 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0011619250000000001 2024-04-18T14:43:40.545 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:40.545 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:40.545 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T14:43:40.545 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.877805+0000", 2024-04-18T14:43:40.545 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.6621e-05 2024-04-18T14:43:40.545 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:43:40.545 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T14:43:40.545 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:43:40.545 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:43:40.545 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T14:43:40.545 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-04-18T14:43:40.545 INFO:tasks.thrashosds.thrasher:in_osds: [0, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15] out_osds: [1] dead_osds: [] live_osds: [0, 4, 8, 12, 1, 5, 9, 13, 2, 6, 10, 14, 3, 7, 11, 15] 2024-04-18T14:43:40.546 INFO:tasks.thrashosds.thrasher:choose_action: min_in 8 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-04-18T14:43:40.546 INFO:tasks.thrashosds.thrasher:primary_affinity 2024-04-18T14:43:40.546 INFO:tasks.thrashosds.thrasher:Setting osd 4 primary_affinity to 0.824894 2024-04-18T14:43:40.546 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 4 0.8248943360729512 2024-04-18T14:43:40.548 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.11.asok dump_ops_in_flight 2024-04-18T14:43:40.549 INFO:tasks.ceph.osd.4.smithi086.stderr:2024-04-18T14:43:40.547+0000 7f0c4c462640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 24956) UID: 0 2024-04-18T14:43:40.648 INFO:tasks.ceph.osd.4.smithi086.stderr:2024-04-18T14:43:40.647+0000 7f0c4c462640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 24956) UID: 0 2024-04-18T14:43:40.676 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-04-18T14:43:40.676 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [], 2024-04-18T14:43:40.677 INFO:teuthology.orchestra.run.smithi134.stdout: "num_ops": 0 2024-04-18T14:43:40.677 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-04-18T14:43:40.692 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.11.asok dump_blocked_ops 2024-04-18T14:43:40.749 INFO:tasks.ceph.osd.12.smithi086.stderr:2024-04-18T14:43:40.747+0000 7f6904968640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 12 (PID: 24960) UID: 0 2024-04-18T14:43:40.755 INFO:tasks.rados.rados.0.smithi134.stdout:93: done (0 left) 2024-04-18T14:43:40.755 INFO:tasks.rados.rados.0.smithi134.stdout:94: copy_from oid 5 from oid 31 current snap is 6 2024-04-18T14:43:40.755 INFO:tasks.rados.rados.0.smithi134.stdout:95: read oid 41 snap -1 2024-04-18T14:43:40.755 INFO:tasks.rados.rados.0.smithi134.stdout:95: expect (ObjNum 40 snap 0 seq_num 40) 2024-04-18T14:43:40.755 INFO:tasks.rados.rados.0.smithi134.stdout:96: rollback oid 33 current snap is 6 2024-04-18T14:43:40.755 INFO:tasks.rados.rados.0.smithi134.stdout:rollback oid 33 to 5 2024-04-18T14:43:40.755 INFO:tasks.rados.rados.0.smithi134.stdout:97: copy_from oid 15 from oid 36 current snap is 6 2024-04-18T14:43:40.755 INFO:tasks.rados.rados.0.smithi134.stdout:98: delete oid 32 current snap is 6 2024-04-18T14:43:40.772 INFO:tasks.rados.rados.0.smithi134.stdout:96: finishing rollback tid 1 to smithi13430248-33 2024-04-18T14:43:40.772 INFO:tasks.rados.rados.0.smithi134.stdout:update_object_version oid 33 v 20 (ObjNum 145 snap 0 seq_num 635856521) dirty dne 2024-04-18T14:43:40.774 INFO:tasks.rados.rados.0.smithi134.stdout:96: done (4 left) 2024-04-18T14:43:40.774 INFO:tasks.rados.rados.0.smithi134.stdout:98: done (3 left) 2024-04-18T14:43:40.774 INFO:tasks.rados.rados.0.smithi134.stdout:99: snap_create 2024-04-18T14:43:40.775 INFO:tasks.rados.rados.0.smithi134.stdout:95: expect (ObjNum 40 snap 0 seq_num 40) 2024-04-18T14:43:40.806 INFO:tasks.rados.rados.0.smithi134.stdout:97: finishing copy_from racing read to smithi13430248-15 2024-04-18T14:43:40.806 INFO:tasks.rados.rados.0.smithi134.stdout:94: finishing copy_from to smithi13430248-5 2024-04-18T14:43:40.806 INFO:tasks.rados.rados.0.smithi134.stdout:update_object_version oid 5 v 2 (ObjNum 30 snap 0 seq_num 30) dirty exists 2024-04-18T14:43:40.806 INFO:tasks.rados.rados.0.smithi134.stdout:97: finishing copy_from to smithi13430248-15 2024-04-18T14:43:40.806 INFO:tasks.rados.rados.0.smithi134.stdout:update_object_version oid 15 v 10 (ObjNum 35 snap 0 seq_num 35) dirty exists 2024-04-18T14:43:40.806 INFO:tasks.rados.rados.0.smithi134.stdout:94: finishing copy_from racing read to smithi13430248-5 2024-04-18T14:43:40.832 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-04-18T14:43:40.832 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [], 2024-04-18T14:43:40.832 INFO:teuthology.orchestra.run.smithi134.stdout: "complaint_time": 30, 2024-04-18T14:43:40.832 INFO:teuthology.orchestra.run.smithi134.stdout: "num_blocked_ops": 0 2024-04-18T14:43:40.832 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-04-18T14:43:40.847 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.11.asok dump_historic_ops 2024-04-18T14:43:40.850 INFO:tasks.ceph.osd.13.smithi096.stderr:2024-04-18T14:43:40.851+0000 7f7e72fad640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 13 (PID: 24893) UID: 0 2024-04-18T14:43:40.951 INFO:tasks.ceph.osd.13.smithi096.stderr:2024-04-18T14:43:40.951+0000 7f7e72fad640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 13 (PID: 24893) UID: 0 2024-04-18T14:43:40.967 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-04-18T14:43:40.967 INFO:teuthology.orchestra.run.smithi134.stdout: "size": 20, 2024-04-18T14:43:40.967 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 600, 2024-04-18T14:43:40.967 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [ 2024-04-18T14:43:40.967 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:40.967 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "MOSDECSubOpWrite(3.as6 36/30 ECSubWrite(tid=18, reqid=client.4559.0:178, at_version=36'12, trim_to=0'0, roll_forward_to=35'10))", 2024-04-18T14:43:40.967 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T14:43:35.739302+0000", 2024-04-18T14:43:40.967 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 5.2288339559999999, 2024-04-18T14:43:40.967 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0053465459999999998, 2024-04-18T14:43:40.967 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T14:43:40.967 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-04-18T14:43:40.968 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T14:43:40.968 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:40.968 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T14:43:40.968 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:35.739302+0000", 2024-04-18T14:43:40.968 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:43:40.968 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:40.968 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:40.968 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T14:43:40.968 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:35.739302+0000", 2024-04-18T14:43:40.968 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:43:40.968 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:40.968 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:40.969 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T14:43:40.969 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:35.739302+0000", 2024-04-18T14:43:40.969 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-18T14:43:40.969 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:40.969 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:40.969 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T14:43:40.969 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:35.739603+0000", 2024-04-18T14:43:40.969 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00030119599999999999 2024-04-18T14:43:40.969 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:40.969 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:40.969 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T14:43:40.969 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:35.739718+0000", 2024-04-18T14:43:40.969 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00011539 2024-04-18T14:43:40.970 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:40.970 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:40.970 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T14:43:40.970 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:35.739748+0000", 2024-04-18T14:43:40.970 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.9916999999999998e-05 2024-04-18T14:43:40.970 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:40.970 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:40.970 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T14:43:40.970 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:35.740415+0000", 2024-04-18T14:43:40.970 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00066708100000000003 2024-04-18T14:43:40.970 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:40.970 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:40.970 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_started", 2024-04-18T14:43:40.971 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:35.740432+0000", 2024-04-18T14:43:40.971 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.7337999999999999e-05 2024-04-18T14:43:40.971 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:40.971 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:40.971 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_committed", 2024-04-18T14:43:40.971 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:35.744610+0000", 2024-04-18T14:43:40.971 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0041776590000000002 2024-04-18T14:43:40.971 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:40.971 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:40.971 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T14:43:40.971 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:35.744649+0000", 2024-04-18T14:43:40.971 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.8865000000000001e-05 2024-04-18T14:43:40.971 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:43:40.971 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T14:43:40.971 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:43:40.972 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:40.972 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:40.972 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "MOSDECSubOpWrite(3.7s6 37/30 ECSubWrite(tid=35, reqid=client.4559.0:183, at_version=37'11, trim_to=0'0, roll_forward_to=33'9))", 2024-04-18T14:43:40.972 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T14:43:36.748783+0000", 2024-04-18T14:43:40.972 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 4.2193536739999997, 2024-04-18T14:43:40.972 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0082955609999999999, 2024-04-18T14:43:40.972 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T14:43:40.972 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-04-18T14:43:40.972 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T14:43:40.972 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:40.972 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T14:43:40.972 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.748783+0000", 2024-04-18T14:43:40.973 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:43:40.973 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:40.973 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:40.973 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T14:43:40.973 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.748783+0000", 2024-04-18T14:43:40.973 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:43:40.973 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:40.973 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:40.973 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T14:43:40.973 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.748782+0000", 2024-04-18T14:43:40.973 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-04-18T14:43:40.973 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:40.973 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:40.974 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T14:43:40.974 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.749402+0000", 2024-04-18T14:43:40.974 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00062010899999999998 2024-04-18T14:43:40.974 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:40.974 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:40.974 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T14:43:40.974 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.749431+0000", 2024-04-18T14:43:40.974 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.8858000000000001e-05 2024-04-18T14:43:40.974 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:40.974 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:40.974 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T14:43:40.974 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.749451+0000", 2024-04-18T14:43:40.974 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.9916999999999999e-05 2024-04-18T14:43:40.974 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:40.975 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:40.975 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T14:43:40.975 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.749600+0000", 2024-04-18T14:43:40.975 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00014919 2024-04-18T14:43:40.975 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:40.975 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:40.975 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_started", 2024-04-18T14:43:40.975 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.749628+0000", 2024-04-18T14:43:40.975 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.7260999999999999e-05 2024-04-18T14:43:40.975 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:40.975 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:40.975 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_committed", 2024-04-18T14:43:40.975 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.757022+0000", 2024-04-18T14:43:40.975 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.007394622 2024-04-18T14:43:40.976 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:40.976 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:40.976 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T14:43:40.976 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.757078+0000", 2024-04-18T14:43:40.976 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.5943999999999998e-05 2024-04-18T14:43:40.976 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:43:40.976 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T14:43:40.976 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:43:40.976 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:40.976 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:40.976 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "MOSDECSubOpWrite(3.1s1 37/30 ECSubWrite(tid=19, reqid=client.4559.0:187, at_version=37'13, trim_to=0'0, roll_forward_to=33'10))", 2024-04-18T14:43:40.976 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T14:43:36.764114+0000", 2024-04-18T14:43:40.976 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 4.2040227010000004, 2024-04-18T14:43:40.976 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0099389679999999994, 2024-04-18T14:43:40.977 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T14:43:40.977 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-04-18T14:43:40.977 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T14:43:40.977 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:40.977 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T14:43:40.977 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.764114+0000", 2024-04-18T14:43:40.977 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:43:40.977 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:40.977 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:40.977 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T14:43:40.977 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.764114+0000", 2024-04-18T14:43:40.977 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:43:40.977 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:40.977 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:40.977 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T14:43:40.978 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.764112+0000", 2024-04-18T14:43:40.978 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999986 2024-04-18T14:43:40.978 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:40.978 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:40.978 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T14:43:40.978 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.764282+0000", 2024-04-18T14:43:40.978 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00016998499999999999 2024-04-18T14:43:40.978 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:40.978 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:40.978 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T14:43:40.978 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.764331+0000", 2024-04-18T14:43:40.978 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.8730999999999998e-05 2024-04-18T14:43:40.978 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:40.978 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:40.979 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T14:43:40.979 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.764355+0000", 2024-04-18T14:43:40.979 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.3986999999999999e-05 2024-04-18T14:43:40.979 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:40.979 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:40.979 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T14:43:40.979 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.764467+0000", 2024-04-18T14:43:40.979 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00011267700000000001 2024-04-18T14:43:40.979 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:40.979 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:40.979 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_started", 2024-04-18T14:43:40.979 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.764492+0000", 2024-04-18T14:43:40.979 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.4530000000000001e-05 2024-04-18T14:43:40.979 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:40.979 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:40.980 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_committed", 2024-04-18T14:43:40.980 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.773984+0000", 2024-04-18T14:43:40.980 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0094917830000000002 2024-04-18T14:43:40.980 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:40.980 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:40.980 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T14:43:40.980 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.774053+0000", 2024-04-18T14:43:40.980 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.8938999999999998e-05 2024-04-18T14:43:40.980 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:43:40.980 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T14:43:40.980 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:43:40.980 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:40.980 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:40.981 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "MOSDECSubOpWrite(3.1s1 37/30 ECSubWrite(tid=20, reqid=client.4559.0:188, at_version=37'14, trim_to=0'0, roll_forward_to=33'10))", 2024-04-18T14:43:40.981 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T14:43:36.765784+0000", 2024-04-18T14:43:40.981 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 4.2023520080000001, 2024-04-18T14:43:40.981 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0083259800000000002, 2024-04-18T14:43:40.981 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T14:43:40.981 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-04-18T14:43:40.981 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T14:43:40.981 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:40.981 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T14:43:40.981 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.765784+0000", 2024-04-18T14:43:40.981 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:43:40.981 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:40.981 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:40.981 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T14:43:40.982 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.765784+0000", 2024-04-18T14:43:40.982 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:43:40.982 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:40.982 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:40.982 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T14:43:40.982 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.765783+0000", 2024-04-18T14:43:40.982 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999986 2024-04-18T14:43:40.982 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:40.982 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:40.982 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T14:43:40.982 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.765840+0000", 2024-04-18T14:43:40.982 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.7258e-05 2024-04-18T14:43:40.982 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:40.983 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:40.983 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T14:43:40.983 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.765868+0000", 2024-04-18T14:43:40.983 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.8260999999999999e-05 2024-04-18T14:43:40.983 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:40.983 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:40.983 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T14:43:40.983 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.765883+0000", 2024-04-18T14:43:40.983 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.4327e-05 2024-04-18T14:43:40.983 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:40.983 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:40.983 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T14:43:40.983 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.765989+0000", 2024-04-18T14:43:40.984 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00010590300000000001 2024-04-18T14:43:40.984 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:40.984 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:40.984 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_started", 2024-04-18T14:43:40.984 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.766013+0000", 2024-04-18T14:43:40.984 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.4454e-05 2024-04-18T14:43:40.984 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:40.984 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:40.984 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_committed", 2024-04-18T14:43:40.984 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.774076+0000", 2024-04-18T14:43:40.984 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0080626659999999996 2024-04-18T14:43:40.984 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:40.984 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:40.984 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T14:43:40.984 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.774110+0000", 2024-04-18T14:43:40.985 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.4684000000000002e-05 2024-04-18T14:43:40.985 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:43:40.985 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T14:43:40.985 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:43:40.985 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:40.985 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:40.985 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "MOSDECSubOpWrite(3.as6 37/30 ECSubWrite(tid=23, reqid=client.4559.0:190, at_version=37'16, trim_to=0'0, roll_forward_to=36'14))", 2024-04-18T14:43:40.985 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T14:43:36.767447+0000", 2024-04-18T14:43:40.985 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 4.2006892640000002, 2024-04-18T14:43:40.985 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0070728500000000003, 2024-04-18T14:43:40.985 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T14:43:40.985 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-04-18T14:43:40.985 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T14:43:40.985 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:40.985 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T14:43:40.986 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.767447+0000", 2024-04-18T14:43:40.986 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:43:40.986 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:40.986 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:40.986 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T14:43:40.986 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.767447+0000", 2024-04-18T14:43:40.986 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:43:40.986 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:40.986 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:40.986 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T14:43:40.986 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.767446+0000", 2024-04-18T14:43:40.986 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-04-18T14:43:40.986 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:40.987 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:40.987 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T14:43:40.987 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.767499+0000", 2024-04-18T14:43:40.987 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.2370999999999997e-05 2024-04-18T14:43:40.987 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:40.987 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:40.987 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T14:43:40.987 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.767530+0000", 2024-04-18T14:43:40.987 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.1204000000000001e-05 2024-04-18T14:43:40.987 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:40.987 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:40.987 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T14:43:40.987 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.767551+0000", 2024-04-18T14:43:40.988 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.1311e-05 2024-04-18T14:43:40.988 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:40.988 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:40.988 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T14:43:40.988 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.767710+0000", 2024-04-18T14:43:40.988 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00015860099999999999 2024-04-18T14:43:40.988 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:40.988 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:40.988 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_started", 2024-04-18T14:43:40.988 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.767734+0000", 2024-04-18T14:43:40.988 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.4003999999999999e-05 2024-04-18T14:43:40.988 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:40.988 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:40.988 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_committed", 2024-04-18T14:43:40.988 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.774463+0000", 2024-04-18T14:43:40.989 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0067288740000000001 2024-04-18T14:43:40.989 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:40.989 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:40.989 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T14:43:40.989 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.774520+0000", 2024-04-18T14:43:40.989 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.7138000000000001e-05 2024-04-18T14:43:40.989 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:43:40.989 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T14:43:40.989 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:43:40.989 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:40.989 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:40.989 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "MOSDECSubOpWrite(3.as6 37/30 ECSubWrite(tid=24, reqid=osd.3.0:24, at_version=37'18, trim_to=0'0, roll_forward_to=36'14))", 2024-04-18T14:43:40.989 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T14:43:36.771072+0000", 2024-04-18T14:43:40.989 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 4.1970642209999998, 2024-04-18T14:43:40.989 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.003485297, 2024-04-18T14:43:40.990 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T14:43:40.990 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-04-18T14:43:40.990 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T14:43:40.990 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:40.990 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T14:43:40.990 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.771072+0000", 2024-04-18T14:43:40.990 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:43:40.990 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:40.990 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:40.990 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T14:43:40.990 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.771072+0000", 2024-04-18T14:43:40.990 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:43:40.990 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:40.991 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:40.991 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T14:43:40.991 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.771070+0000", 2024-04-18T14:43:40.991 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999981 2024-04-18T14:43:40.991 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:40.991 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:40.991 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T14:43:40.991 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.771126+0000", 2024-04-18T14:43:40.991 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.5510999999999998e-05 2024-04-18T14:43:40.991 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:40.991 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:40.991 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T14:43:40.991 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.771164+0000", 2024-04-18T14:43:40.991 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.7936999999999999e-05 2024-04-18T14:43:40.991 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:40.992 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:40.992 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T14:43:40.992 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.771190+0000", 2024-04-18T14:43:40.992 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.6427999999999998e-05 2024-04-18T14:43:40.992 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:40.992 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:40.992 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T14:43:40.992 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.771362+0000", 2024-04-18T14:43:40.992 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00017211799999999999 2024-04-18T14:43:40.992 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:40.992 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:40.992 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_started", 2024-04-18T14:43:40.992 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.771386+0000", 2024-04-18T14:43:40.992 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.3977000000000001e-05 2024-04-18T14:43:40.993 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:40.993 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:40.993 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_committed", 2024-04-18T14:43:40.993 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.774528+0000", 2024-04-18T14:43:40.993 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0031419859999999998 2024-04-18T14:43:40.993 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:40.993 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:40.993 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T14:43:40.993 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.774557+0000", 2024-04-18T14:43:40.993 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.9030000000000002e-05 2024-04-18T14:43:40.993 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:43:40.993 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T14:43:40.993 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:43:40.993 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:40.993 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:40.993 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "MOSDECSubOpWrite(3.as6 37/30 ECSubWrite(tid=25, reqid=osd.3.0:25, at_version=37'20, trim_to=0'0, roll_forward_to=36'14))", 2024-04-18T14:43:40.993 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T14:43:36.773408+0000", 2024-04-18T14:43:40.994 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 4.1947283139999998, 2024-04-18T14:43:40.994 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0039971549999999996, 2024-04-18T14:43:40.994 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T14:43:40.994 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-04-18T14:43:40.994 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T14:43:40.994 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:40.994 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T14:43:40.994 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.773408+0000", 2024-04-18T14:43:40.994 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:43:40.994 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:40.994 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:40.994 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T14:43:40.994 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.773408+0000", 2024-04-18T14:43:40.995 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:43:40.995 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:40.995 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:40.995 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T14:43:40.995 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.773406+0000", 2024-04-18T14:43:40.995 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999981 2024-04-18T14:43:40.995 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:40.995 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:40.995 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T14:43:40.995 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.773484+0000", 2024-04-18T14:43:40.995 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.7582000000000004e-05 2024-04-18T14:43:40.995 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:40.995 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:40.995 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T14:43:40.996 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.773517+0000", 2024-04-18T14:43:40.996 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.3266999999999998e-05 2024-04-18T14:43:40.996 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:40.996 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:40.996 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T14:43:40.996 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.773540+0000", 2024-04-18T14:43:40.996 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2824999999999999e-05 2024-04-18T14:43:40.996 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:40.996 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:40.996 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T14:43:40.996 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.773690+0000", 2024-04-18T14:43:40.996 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00015044 2024-04-18T14:43:40.996 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:40.997 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:40.997 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_started", 2024-04-18T14:43:40.997 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.773717+0000", 2024-04-18T14:43:40.997 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.6474000000000001e-05 2024-04-18T14:43:40.997 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:40.997 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:40.997 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_committed", 2024-04-18T14:43:40.997 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.777339+0000", 2024-04-18T14:43:40.997 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0036220509999999998 2024-04-18T14:43:40.997 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:40.997 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:40.997 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T14:43:40.997 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.777405+0000", 2024-04-18T14:43:40.998 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.6482000000000005e-05 2024-04-18T14:43:40.998 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:43:40.998 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T14:43:40.998 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:43:40.998 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:40.998 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:40.998 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "MOSDECSubOpWrite(3.1s1 37/30 ECSubWrite(tid=21, reqid=client.4559.0:188, at_version=0'0, trim_to=0'0, roll_forward_to=37'14))", 2024-04-18T14:43:40.998 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T14:43:36.775284+0000", 2024-04-18T14:43:40.998 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 4.1928522279999996, 2024-04-18T14:43:40.998 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0038624390000000001, 2024-04-18T14:43:40.998 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T14:43:40.998 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-04-18T14:43:40.998 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T14:43:40.999 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:40.999 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T14:43:40.999 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.775284+0000", 2024-04-18T14:43:40.999 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:43:40.999 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:40.999 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:40.999 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T14:43:40.999 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.775284+0000", 2024-04-18T14:43:40.999 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:43:40.999 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:40.999 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:40.999 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T14:43:40.999 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.775283+0000", 2024-04-18T14:43:41.000 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999986 2024-04-18T14:43:41.000 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:41.000 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:41.000 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T14:43:41.000 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.775313+0000", 2024-04-18T14:43:41.000 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.0083999999999999e-05 2024-04-18T14:43:41.000 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:41.000 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:41.000 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T14:43:41.000 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.775349+0000", 2024-04-18T14:43:41.000 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.6486999999999998e-05 2024-04-18T14:43:41.000 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:41.000 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:41.000 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T14:43:41.000 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.775375+0000", 2024-04-18T14:43:41.001 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.6061e-05 2024-04-18T14:43:41.001 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:41.001 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:41.001 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T14:43:41.001 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.775502+0000", 2024-04-18T14:43:41.001 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000127 2024-04-18T14:43:41.001 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:41.001 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:41.001 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_started", 2024-04-18T14:43:41.001 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.775549+0000", 2024-04-18T14:43:41.001 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.6474000000000003e-05 2024-04-18T14:43:41.001 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:41.001 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:41.001 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_committed", 2024-04-18T14:43:41.002 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.779058+0000", 2024-04-18T14:43:41.002 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.003509669 2024-04-18T14:43:41.002 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:41.002 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:41.002 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T14:43:41.002 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.779147+0000", 2024-04-18T14:43:41.002 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.8280000000000002e-05 2024-04-18T14:43:41.002 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:43:41.002 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T14:43:41.002 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:43:41.002 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:41.002 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:41.002 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4559.0:191 3.cs0 3:3c6f96a8:::smithi13430248-14:4 [read 0~229376,checksum,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37)", 2024-04-18T14:43:41.003 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T14:43:36.775946+0000", 2024-04-18T14:43:41.003 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 4.1921901229999996, 2024-04-18T14:43:41.003 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0085641539999999992, 2024-04-18T14:43:41.003 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T14:43:41.003 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-04-18T14:43:41.003 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-18T14:43:41.003 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4559", 2024-04-18T14:43:41.003 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/3113589487", 2024-04-18T14:43:41.003 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 191 2024-04-18T14:43:41.003 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:41.003 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T14:43:41.003 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:41.003 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T14:43:41.003 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.775946+0000", 2024-04-18T14:43:41.004 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:43:41.004 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:41.004 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:41.004 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T14:43:41.004 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.775946+0000", 2024-04-18T14:43:41.004 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:43:41.004 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:41.004 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:41.004 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T14:43:41.004 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.775943+0000", 2024-04-18T14:43:41.004 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999962 2024-04-18T14:43:41.004 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:41.004 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:41.005 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T14:43:41.005 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.775962+0000", 2024-04-18T14:43:41.005 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.9510000000000001e-05 2024-04-18T14:43:41.005 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:41.005 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:41.005 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T14:43:41.005 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.775996+0000", 2024-04-18T14:43:41.005 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.4097999999999998e-05 2024-04-18T14:43:41.005 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:41.005 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:41.005 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T14:43:41.005 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.776019+0000", 2024-04-18T14:43:41.005 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2887999999999998e-05 2024-04-18T14:43:41.005 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:41.006 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:41.006 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T14:43:41.006 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.776181+0000", 2024-04-18T14:43:41.006 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00016150999999999999 2024-04-18T14:43:41.006 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:41.006 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:41.006 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T14:43:41.006 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.776515+0000", 2024-04-18T14:43:41.006 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00033390600000000002 2024-04-18T14:43:41.006 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:41.006 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:41.006 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T14:43:41.006 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.784510+0000", 2024-04-18T14:43:41.006 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0079958560000000008 2024-04-18T14:43:41.007 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:43:41.007 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T14:43:41.007 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:43:41.007 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:41.007 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:41.007 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4559.0:192 3.cs0 3:3c6f96a8:::smithi13430248-14:4 [read 0~229376,checksum] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37)", 2024-04-18T14:43:41.007 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T14:43:36.776089+0000", 2024-04-18T14:43:41.007 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 4.1920478030000003, 2024-04-18T14:43:41.007 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0095438139999999994, 2024-04-18T14:43:41.007 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T14:43:41.007 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-04-18T14:43:41.007 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-18T14:43:41.007 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4559", 2024-04-18T14:43:41.007 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/3113589487", 2024-04-18T14:43:41.007 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 192 2024-04-18T14:43:41.008 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:41.008 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T14:43:41.008 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:41.008 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T14:43:41.008 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.776089+0000", 2024-04-18T14:43:41.008 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:43:41.008 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:41.008 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:41.008 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T14:43:41.008 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.776089+0000", 2024-04-18T14:43:41.008 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:43:41.008 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:41.008 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:41.008 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T14:43:41.009 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.776087+0000", 2024-04-18T14:43:41.009 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999981 2024-04-18T14:43:41.009 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:41.009 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:41.009 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T14:43:41.009 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.776099+0000", 2024-04-18T14:43:41.009 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2624e-05 2024-04-18T14:43:41.009 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:41.009 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:41.009 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T14:43:41.009 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.776121+0000", 2024-04-18T14:43:41.009 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.1489999999999999e-05 2024-04-18T14:43:41.009 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:41.010 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:41.010 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T14:43:41.010 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.776137+0000", 2024-04-18T14:43:41.010 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5794000000000002e-05 2024-04-18T14:43:41.010 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:41.010 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:41.010 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T14:43:41.010 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.779276+0000", 2024-04-18T14:43:41.010 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0031389320000000001 2024-04-18T14:43:41.010 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:41.010 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:41.010 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T14:43:41.010 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.779529+0000", 2024-04-18T14:43:41.011 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000253467 2024-04-18T14:43:41.011 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:41.011 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:41.011 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T14:43:41.011 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.785632+0000", 2024-04-18T14:43:41.011 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0061031940000000002 2024-04-18T14:43:41.011 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:43:41.011 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T14:43:41.011 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:43:41.011 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:41.011 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:41.011 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4559.0:193 3.cs0 3:3c6f96a8:::smithi13430248-14:4 [read 0~229376,checksum] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37)", 2024-04-18T14:43:41.011 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T14:43:36.776151+0000", 2024-04-18T14:43:41.012 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 4.1919858349999997, 2024-04-18T14:43:41.012 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.010393866, 2024-04-18T14:43:41.012 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T14:43:41.012 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-04-18T14:43:41.012 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-18T14:43:41.012 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4559", 2024-04-18T14:43:41.012 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/3113589487", 2024-04-18T14:43:41.012 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 193 2024-04-18T14:43:41.012 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:41.012 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T14:43:41.012 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:41.012 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T14:43:41.012 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.776151+0000", 2024-04-18T14:43:41.013 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:43:41.013 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:41.013 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:41.013 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T14:43:41.013 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.776151+0000", 2024-04-18T14:43:41.013 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:43:41.013 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:41.013 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:41.013 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T14:43:41.013 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.776149+0000", 2024-04-18T14:43:41.013 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999986 2024-04-18T14:43:41.013 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:41.014 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:41.014 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T14:43:41.014 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.776159+0000", 2024-04-18T14:43:41.014 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.3959999999999995e-06 2024-04-18T14:43:41.014 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:41.014 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:41.014 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T14:43:41.014 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.776177+0000", 2024-04-18T14:43:41.014 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8411e-05 2024-04-18T14:43:41.014 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:41.014 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:41.014 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T14:43:41.014 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.776191+0000", 2024-04-18T14:43:41.014 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3827e-05 2024-04-18T14:43:41.015 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:41.015 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:41.015 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T14:43:41.015 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.780347+0000", 2024-04-18T14:43:41.015 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0041559190000000001 2024-04-18T14:43:41.015 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:41.015 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:41.015 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T14:43:41.015 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.780607+0000", 2024-04-18T14:43:41.015 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00025981000000000002 2024-04-18T14:43:41.015 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:41.015 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:41.015 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T14:43:41.015 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.786544+0000", 2024-04-18T14:43:41.016 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0059377060000000001 2024-04-18T14:43:41.016 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:43:41.016 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T14:43:41.016 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:43:41.016 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:41.016 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:41.016 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "MOSDECSubOpWrite(3.as6 37/30 ECSubWrite(tid=26, reqid=osd.3.0:25, at_version=0'0, trim_to=0'0, roll_forward_to=37'20))", 2024-04-18T14:43:41.016 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T14:43:36.778238+0000", 2024-04-18T14:43:41.016 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 4.1898983730000001, 2024-04-18T14:43:41.016 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0040473760000000001, 2024-04-18T14:43:41.016 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T14:43:41.016 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-04-18T14:43:41.016 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T14:43:41.016 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:41.017 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T14:43:41.017 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.778238+0000", 2024-04-18T14:43:41.017 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:43:41.017 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:41.017 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:41.017 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T14:43:41.017 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.778238+0000", 2024-04-18T14:43:41.017 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:43:41.017 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:41.017 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:41.017 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T14:43:41.017 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.778237+0000", 2024-04-18T14:43:41.017 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999986 2024-04-18T14:43:41.017 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:41.018 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:41.018 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T14:43:41.018 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.778263+0000", 2024-04-18T14:43:41.018 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.6554e-05 2024-04-18T14:43:41.018 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:41.018 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:41.018 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T14:43:41.018 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.778298+0000", 2024-04-18T14:43:41.018 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.4718000000000002e-05 2024-04-18T14:43:41.018 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:41.018 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:41.018 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T14:43:41.018 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.778319+0000", 2024-04-18T14:43:41.018 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0744e-05 2024-04-18T14:43:41.019 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:41.019 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:41.019 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T14:43:41.019 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.778463+0000", 2024-04-18T14:43:41.019 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00014403699999999999 2024-04-18T14:43:41.019 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:41.019 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:41.019 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_started", 2024-04-18T14:43:41.019 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.778486+0000", 2024-04-18T14:43:41.019 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.3703999999999999e-05 2024-04-18T14:43:41.019 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:41.019 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:41.019 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_committed", 2024-04-18T14:43:41.019 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.782222+0000", 2024-04-18T14:43:41.019 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0037354269999999999 2024-04-18T14:43:41.020 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:41.020 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:41.020 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T14:43:41.020 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.782285+0000", 2024-04-18T14:43:41.020 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.3615999999999995e-05 2024-04-18T14:43:41.020 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:43:41.020 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T14:43:41.020 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:43:41.020 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:41.020 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:41.020 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "MOSDECSubOpReadReply(3.cs0 37/30 ECSubReadReply(tid=29, attrs_read=0))", 2024-04-18T14:43:41.020 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T14:43:36.778790+0000", 2024-04-18T14:43:41.020 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 4.1893461429999999, 2024-04-18T14:43:41.020 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0036415359999999999, 2024-04-18T14:43:41.020 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T14:43:41.020 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-04-18T14:43:41.021 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T14:43:41.021 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:41.021 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T14:43:41.021 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.778790+0000", 2024-04-18T14:43:41.021 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:43:41.021 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:41.021 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:41.021 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T14:43:41.021 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.778790+0000", 2024-04-18T14:43:41.021 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:43:41.021 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:41.021 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:41.021 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T14:43:41.021 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.778788+0000", 2024-04-18T14:43:41.022 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999976 2024-04-18T14:43:41.022 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:41.022 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:41.022 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T14:43:41.022 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.779380+0000", 2024-04-18T14:43:41.022 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00059188000000000003 2024-04-18T14:43:41.022 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:41.022 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:41.022 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T14:43:41.022 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.779404+0000", 2024-04-18T14:43:41.022 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.3907e-05 2024-04-18T14:43:41.022 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:41.022 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:41.022 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T14:43:41.022 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.779417+0000", 2024-04-18T14:43:41.023 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3644e-05 2024-04-18T14:43:41.023 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:41.023 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:41.023 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T14:43:41.023 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.782329+0000", 2024-04-18T14:43:41.023 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0029112389999999999 2024-04-18T14:43:41.023 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:41.023 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:41.023 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T14:43:41.023 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.782432+0000", 2024-04-18T14:43:41.023 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000103096 2024-04-18T14:43:41.023 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:43:41.023 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T14:43:41.024 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:43:41.024 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:41.024 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:41.024 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "MOSDECSubOpRead(3.cs0 37/30 ECSubRead(tid=29, to_read={3:3c6f96a8:::smithi13430248-14:head=0,57344,0}, subchunks={3:3c6f96a8:::smithi13430248-14:head=[0,1]}, attrs_to_read=))", 2024-04-18T14:43:41.024 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T14:43:36.778954+0000", 2024-04-18T14:43:41.024 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 4.1891820810000002, 2024-04-18T14:43:41.024 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0032931290000000001, 2024-04-18T14:43:41.024 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T14:43:41.024 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-04-18T14:43:41.024 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T14:43:41.024 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:41.024 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T14:43:41.024 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.778954+0000", 2024-04-18T14:43:41.024 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:43:41.024 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:41.025 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:41.025 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T14:43:41.025 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.778954+0000", 2024-04-18T14:43:41.025 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:43:41.025 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:41.025 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:41.025 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T14:43:41.025 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.778954+0000", 2024-04-18T14:43:41.025 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:43:41.025 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:41.025 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:41.026 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T14:43:41.026 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.778954+0000", 2024-04-18T14:43:41.026 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:43:41.026 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:41.026 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:41.026 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T14:43:41.026 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.779261+0000", 2024-04-18T14:43:41.026 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00030661099999999998 2024-04-18T14:43:41.026 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:41.026 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:41.027 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T14:43:41.027 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.779286+0000", 2024-04-18T14:43:41.027 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.5077000000000001e-05 2024-04-18T14:43:41.027 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:41.027 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:41.027 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T14:43:41.027 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.781494+0000", 2024-04-18T14:43:41.027 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0022083979999999999 2024-04-18T14:43:41.027 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:41.027 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:41.027 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T14:43:41.027 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.782247+0000", 2024-04-18T14:43:41.027 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00075304300000000001 2024-04-18T14:43:41.027 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:43:41.028 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T14:43:41.028 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:43:41.028 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:41.028 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:41.028 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "MOSDECSubOpReadReply(3.cs0 37/30 ECSubReadReply(tid=31, attrs_read=0))", 2024-04-18T14:43:41.028 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T14:43:36.783409+0000", 2024-04-18T14:43:41.028 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 4.1847273180000002, 2024-04-18T14:43:41.028 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0031725239999999999, 2024-04-18T14:43:41.028 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T14:43:41.028 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-04-18T14:43:41.028 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T14:43:41.028 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:41.028 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T14:43:41.028 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.783409+0000", 2024-04-18T14:43:41.028 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:43:41.029 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:41.029 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:41.029 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T14:43:41.029 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.783409+0000", 2024-04-18T14:43:41.029 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:43:41.029 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:41.029 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:41.029 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T14:43:41.029 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.783409+0000", 2024-04-18T14:43:41.029 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:43:41.029 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:41.029 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:41.029 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T14:43:41.029 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.783409+0000", 2024-04-18T14:43:41.030 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:43:41.030 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:41.030 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:41.030 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T14:43:41.030 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.783470+0000", 2024-04-18T14:43:41.030 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.1317999999999998e-05 2024-04-18T14:43:41.030 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:41.030 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:41.030 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T14:43:41.030 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.783550+0000", 2024-04-18T14:43:41.031 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.9232000000000003e-05 2024-04-18T14:43:41.031 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:41.031 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:41.031 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T14:43:41.031 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.785892+0000", 2024-04-18T14:43:41.031 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0023420089999999999 2024-04-18T14:43:41.031 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:41.031 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:41.031 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T14:43:41.031 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.786582+0000", 2024-04-18T14:43:41.031 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00068996499999999996 2024-04-18T14:43:41.031 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:43:41.031 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T14:43:41.032 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:43:41.032 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:41.032 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:41.032 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "MOSDECSubOpWrite(3.7s6 37/30 ECSubWrite(tid=42, reqid=client.4559.0:208, at_version=37'13, trim_to=0'0, roll_forward_to=37'11))", 2024-04-18T14:43:41.032 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T14:43:36.875514+0000", 2024-04-18T14:43:41.032 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 4.0926227900000001, 2024-04-18T14:43:41.032 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.003356482, 2024-04-18T14:43:41.032 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T14:43:41.032 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-04-18T14:43:41.032 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T14:43:41.032 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:41.032 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T14:43:41.032 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.875514+0000", 2024-04-18T14:43:41.032 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:43:41.033 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:41.033 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:41.033 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T14:43:41.033 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.875514+0000", 2024-04-18T14:43:41.033 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:43:41.033 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:41.033 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:41.033 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T14:43:41.033 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.875511+0000", 2024-04-18T14:43:41.033 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999976 2024-04-18T14:43:41.033 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:41.033 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:41.033 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T14:43:41.033 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.875845+0000", 2024-04-18T14:43:41.034 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00033404499999999999 2024-04-18T14:43:41.034 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:41.034 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:41.034 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T14:43:41.034 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.875879+0000", 2024-04-18T14:43:41.034 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.3918000000000003e-05 2024-04-18T14:43:41.034 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:41.034 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:41.034 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T14:43:41.034 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.875906+0000", 2024-04-18T14:43:41.034 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.7367000000000001e-05 2024-04-18T14:43:41.034 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:41.034 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:41.034 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T14:43:41.035 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.876046+0000", 2024-04-18T14:43:41.035 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00013982400000000001 2024-04-18T14:43:41.035 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:41.035 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:41.035 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_started", 2024-04-18T14:43:41.035 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.876066+0000", 2024-04-18T14:43:41.035 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.9357000000000001e-05 2024-04-18T14:43:41.035 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:41.035 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:41.035 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_committed", 2024-04-18T14:43:41.035 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.878805+0000", 2024-04-18T14:43:41.035 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0027395789999999998 2024-04-18T14:43:41.035 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:41.035 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:41.036 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T14:43:41.036 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.878870+0000", 2024-04-18T14:43:41.036 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.4892000000000001e-05 2024-04-18T14:43:41.036 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:43:41.036 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T14:43:41.036 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:43:41.036 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:41.036 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:41.036 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4559.0:248 3.fs0 3:f85be22b:::smithi13430248-15:head [copy-from ver 10] snapc 8=[8,7,4,2] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-04-18T14:43:41.036 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T14:43:40.759371+0000", 2024-04-18T14:43:41.036 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.20876510600000001, 2024-04-18T14:43:41.036 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.032405762999999997, 2024-04-18T14:43:41.036 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T14:43:41.036 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T14:43:41.037 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-18T14:43:41.037 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4559", 2024-04-18T14:43:41.037 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/3113589487", 2024-04-18T14:43:41.037 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 248 2024-04-18T14:43:41.037 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:41.037 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T14:43:41.037 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:41.037 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T14:43:41.037 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:40.759371+0000", 2024-04-18T14:43:41.037 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:43:41.037 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:41.037 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:41.037 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T14:43:41.038 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:40.759371+0000", 2024-04-18T14:43:41.038 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:43:41.038 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:41.038 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:41.038 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T14:43:41.038 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:40.759369+0000", 2024-04-18T14:43:41.038 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999971 2024-04-18T14:43:41.038 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:41.038 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:41.038 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T14:43:41.038 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:40.759383+0000", 2024-04-18T14:43:41.038 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.4307e-05 2024-04-18T14:43:41.038 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:41.039 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:41.039 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T14:43:41.039 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:40.759418+0000", 2024-04-18T14:43:41.039 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.5154000000000003e-05 2024-04-18T14:43:41.039 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:41.039 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:41.039 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T14:43:41.039 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:40.759440+0000", 2024-04-18T14:43:41.039 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2056999999999999e-05 2024-04-18T14:43:41.039 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:41.039 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:41.039 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T14:43:41.039 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:40.759512+0000", 2024-04-18T14:43:41.039 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.2267000000000005e-05 2024-04-18T14:43:41.039 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:41.040 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:41.040 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op must wait for map", 2024-04-18T14:43:41.040 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:40.759521+0000", 2024-04-18T14:43:41.040 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.6370000000000005e-06 2024-04-18T14:43:41.040 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:41.040 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:41.040 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T14:43:41.040 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:40.764362+0000", 2024-04-18T14:43:41.040 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0048409990000000003 2024-04-18T14:43:41.040 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:41.040 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:41.040 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T14:43:41.040 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:40.764642+0000", 2024-04-18T14:43:41.040 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00028021600000000002 2024-04-18T14:43:41.040 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:41.041 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:41.041 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_started", 2024-04-18T14:43:41.041 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:40.785675+0000", 2024-04-18T14:43:41.041 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.021032894999999999 2024-04-18T14:43:41.041 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:41.041 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:41.041 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_committed", 2024-04-18T14:43:41.041 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:40.789679+0000", 2024-04-18T14:43:41.041 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0040040939999999997 2024-04-18T14:43:41.041 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:41.041 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:41.041 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T14:43:41.041 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:40.791620+0000", 2024-04-18T14:43:41.042 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0019413430000000001 2024-04-18T14:43:41.042 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:41.042 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:41.042 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T14:43:41.042 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:40.791777+0000", 2024-04-18T14:43:41.042 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00015652999999999999 2024-04-18T14:43:41.042 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:43:41.042 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T14:43:41.042 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:43:41.042 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:41.042 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:41.042 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4559.0:249 3.fs0 3:f85be22b:::smithi13430248-15:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e41)", 2024-04-18T14:43:41.042 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T14:43:40.759469+0000", 2024-04-18T14:43:41.043 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.20866698, 2024-04-18T14:43:41.043 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.028934334999999999, 2024-04-18T14:43:41.043 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T14:43:41.043 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-04-18T14:43:41.043 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-18T14:43:41.043 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4559", 2024-04-18T14:43:41.043 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/3113589487", 2024-04-18T14:43:41.043 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 249 2024-04-18T14:43:41.043 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:41.043 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T14:43:41.043 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:41.043 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T14:43:41.043 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:40.759469+0000", 2024-04-18T14:43:41.043 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:43:41.044 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:41.044 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:41.044 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T14:43:41.044 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:40.759469+0000", 2024-04-18T14:43:41.044 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:43:41.044 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:41.044 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:41.044 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T14:43:41.044 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:40.759468+0000", 2024-04-18T14:43:41.044 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999981 2024-04-18T14:43:41.044 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:41.044 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:41.044 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T14:43:41.045 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:40.759476+0000", 2024-04-18T14:43:41.045 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.0069999999999997e-06 2024-04-18T14:43:41.045 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:41.045 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:41.045 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T14:43:41.045 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:40.759496+0000", 2024-04-18T14:43:41.045 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0287000000000001e-05 2024-04-18T14:43:41.045 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:41.045 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:41.045 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T14:43:41.045 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:40.759512+0000", 2024-04-18T14:43:41.045 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5843999999999999e-05 2024-04-18T14:43:41.045 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:41.045 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:41.046 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T14:43:41.046 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:40.759627+0000", 2024-04-18T14:43:41.046 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000115699 2024-04-18T14:43:41.046 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:41.046 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:41.046 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting_for_map not empty", 2024-04-18T14:43:41.046 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:40.759645+0000", 2024-04-18T14:43:41.046 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8063999999999998e-05 2024-04-18T14:43:41.046 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:41.046 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:41.046 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T14:43:41.046 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:40.765114+0000", 2024-04-18T14:43:41.046 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0054689079999999998 2024-04-18T14:43:41.046 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:41.047 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:41.047 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for blocked object", 2024-04-18T14:43:41.047 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:40.765242+0000", 2024-04-18T14:43:41.047 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00012731999999999999 2024-04-18T14:43:41.047 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:41.047 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:41.047 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T14:43:41.047 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:40.788026+0000", 2024-04-18T14:43:41.047 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.022784764999999998 2024-04-18T14:43:41.047 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:41.047 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:41.047 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T14:43:41.047 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:40.788178+0000", 2024-04-18T14:43:41.047 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000151819 2024-04-18T14:43:41.047 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:41.047 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:41.048 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T14:43:41.048 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:40.788404+0000", 2024-04-18T14:43:41.048 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000225479 2024-04-18T14:43:41.048 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:43:41.048 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T14:43:41.048 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:43:41.048 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:41.048 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:41.048 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "MOSDECSubOpWrite(3.7s6 41/30 ECSubWrite(tid=50, reqid=osd.14.0:49, at_version=0'0, trim_to=0'0, roll_forward_to=41'17))", 2024-04-18T14:43:41.048 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T14:43:40.765419+0000", 2024-04-18T14:43:41.048 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.202717811, 2024-04-18T14:43:41.048 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0059668270000000001, 2024-04-18T14:43:41.048 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T14:43:41.048 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-04-18T14:43:41.048 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T14:43:41.049 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:41.049 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T14:43:41.049 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:40.765419+0000", 2024-04-18T14:43:41.049 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:43:41.049 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:41.049 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:41.049 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T14:43:41.049 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:40.765419+0000", 2024-04-18T14:43:41.049 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:43:41.049 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:41.049 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:41.049 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T14:43:41.049 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:40.765418+0000", 2024-04-18T14:43:41.049 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-18T14:43:41.049 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:41.050 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:41.050 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T14:43:41.050 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:40.765432+0000", 2024-04-18T14:43:41.050 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.4037e-05 2024-04-18T14:43:41.050 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:41.050 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:41.050 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T14:43:41.050 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:40.765442+0000", 2024-04-18T14:43:41.050 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.042e-05 2024-04-18T14:43:41.050 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:41.050 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:41.050 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T14:43:41.050 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:40.765453+0000", 2024-04-18T14:43:41.050 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0455000000000001e-05 2024-04-18T14:43:41.051 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:41.051 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:41.051 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T14:43:41.051 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:40.765569+0000", 2024-04-18T14:43:41.051 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000116246 2024-04-18T14:43:41.051 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:41.051 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:41.051 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_started", 2024-04-18T14:43:41.051 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:40.765632+0000", 2024-04-18T14:43:41.051 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.2671999999999999e-05 2024-04-18T14:43:41.051 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:41.051 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:41.051 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_committed", 2024-04-18T14:43:41.051 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:40.771334+0000", 2024-04-18T14:43:41.051 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.005702787 2024-04-18T14:43:41.051 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:41.052 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:41.052 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T14:43:41.052 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:40.771385+0000", 2024-04-18T14:43:41.052 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.0998000000000002e-05 2024-04-18T14:43:41.052 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:43:41.052 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T14:43:41.052 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:43:41.052 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:41.052 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:41.052 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "MOSDECSubOpWrite(3.7s6 41/30 ECSubWrite(tid=51, reqid=client.4559.0:242, at_version=41'19, trim_to=0'0, roll_forward_to=41'17))", 2024-04-18T14:43:41.052 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T14:43:40.784586+0000", 2024-04-18T14:43:41.052 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.183550186, 2024-04-18T14:43:41.052 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.003371911, 2024-04-18T14:43:41.052 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T14:43:41.052 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-04-18T14:43:41.052 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T14:43:41.053 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:41.053 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T14:43:41.053 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:40.784586+0000", 2024-04-18T14:43:41.053 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:43:41.053 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:41.053 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:41.053 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T14:43:41.053 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:40.784586+0000", 2024-04-18T14:43:41.053 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:43:41.053 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:41.053 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:41.053 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T14:43:41.053 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:40.784585+0000", 2024-04-18T14:43:41.053 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-18T14:43:41.053 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:41.053 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:41.053 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T14:43:41.054 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:40.784819+0000", 2024-04-18T14:43:41.054 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000234019 2024-04-18T14:43:41.054 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:41.054 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:41.054 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T14:43:41.054 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:40.784838+0000", 2024-04-18T14:43:41.054 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8972000000000001e-05 2024-04-18T14:43:41.054 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:41.054 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:41.054 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T14:43:41.054 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:40.784857+0000", 2024-04-18T14:43:41.054 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8423e-05 2024-04-18T14:43:41.055 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:41.055 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:41.055 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T14:43:41.055 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:40.784934+0000", 2024-04-18T14:43:41.055 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.6761000000000006e-05 2024-04-18T14:43:41.055 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:41.055 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:41.055 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_started", 2024-04-18T14:43:41.055 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:40.784947+0000", 2024-04-18T14:43:41.055 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.323e-05 2024-04-18T14:43:41.055 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:41.055 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:41.055 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_committed", 2024-04-18T14:43:41.055 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:40.787906+0000", 2024-04-18T14:43:41.055 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0029590229999999999 2024-04-18T14:43:41.056 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:41.056 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:41.056 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T14:43:41.056 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:40.787958+0000", 2024-04-18T14:43:41.056 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.2268000000000002e-05 2024-04-18T14:43:41.056 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:43:41.056 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T14:43:41.056 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:43:41.056 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:43:41.056 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T14:43:41.056 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-04-18T14:43:41.058 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.15.asok dump_ops_in_flight 2024-04-18T14:43:41.058 INFO:tasks.ceph.osd.13.smithi096.stderr:2024-04-18T14:43:41.055+0000 7f7e72fad640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 13 (PID: 24893) UID: 0 2024-04-18T14:43:41.159 INFO:tasks.ceph.osd.11.smithi134.stderr:2024-04-18T14:43:41.160+0000 7f2d36f12640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 11 (PID: 25216) UID: 0 2024-04-18T14:43:41.183 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-04-18T14:43:41.183 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [], 2024-04-18T14:43:41.183 INFO:teuthology.orchestra.run.smithi134.stdout: "num_ops": 0 2024-04-18T14:43:41.183 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-04-18T14:43:41.197 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.15.asok dump_blocked_ops 2024-04-18T14:43:41.260 INFO:tasks.ceph.osd.5.smithi096.stderr:2024-04-18T14:43:41.259+0000 7fc33f25b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 24889) UID: 0 2024-04-18T14:43:41.361 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-04-18T14:43:41.361 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [], 2024-04-18T14:43:41.361 INFO:teuthology.orchestra.run.smithi134.stdout: "complaint_time": 30, 2024-04-18T14:43:41.361 INFO:teuthology.orchestra.run.smithi134.stdout: "num_blocked_ops": 0 2024-04-18T14:43:41.361 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-04-18T14:43:41.362 INFO:tasks.ceph.osd.8.smithi086.stderr:2024-04-18T14:43:41.363+0000 7f29f7b9d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 8 (PID: 24958) UID: 0 2024-04-18T14:43:41.376 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.15.asok dump_historic_ops 2024-04-18T14:43:41.463 INFO:tasks.ceph.osd.14.smithi119.stderr:2024-04-18T14:43:41.462+0000 7f180f599640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 14 (PID: 24900) UID: 0 2024-04-18T14:43:41.497 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-04-18T14:43:41.497 INFO:teuthology.orchestra.run.smithi134.stdout: "size": 20, 2024-04-18T14:43:41.497 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 600, 2024-04-18T14:43:41.497 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [ 2024-04-18T14:43:41.497 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:41.497 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "MOSDECSubOpWrite(3.9s4 35/30 ECSubWrite(tid=27, reqid=client.4559.0:175, at_version=35'15, trim_to=0'0, roll_forward_to=33'13))", 2024-04-18T14:43:41.497 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T14:43:34.712215+0000", 2024-04-18T14:43:41.497 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 6.7855695310000002, 2024-04-18T14:43:41.497 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0016997760000000001, 2024-04-18T14:43:41.497 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T14:43:41.497 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-04-18T14:43:41.498 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T14:43:41.498 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:41.498 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T14:43:41.498 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:34.712215+0000", 2024-04-18T14:43:41.498 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:43:41.498 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:41.498 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:41.498 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T14:43:41.498 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:34.712215+0000", 2024-04-18T14:43:41.498 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:43:41.498 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:41.498 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:41.499 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T14:43:41.499 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:34.712215+0000", 2024-04-18T14:43:41.499 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-04-18T14:43:41.499 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:41.499 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:41.499 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T14:43:41.499 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:34.712261+0000", 2024-04-18T14:43:41.500 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.6081000000000001e-05 2024-04-18T14:43:41.500 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:41.500 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:41.500 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T14:43:41.500 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:34.712283+0000", 2024-04-18T14:43:41.500 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.1937999999999999e-05 2024-04-18T14:43:41.500 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:41.500 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:41.500 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T14:43:41.500 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:34.712303+0000", 2024-04-18T14:43:41.500 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0783000000000001e-05 2024-04-18T14:43:41.500 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:41.501 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:41.501 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T14:43:41.501 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:34.712393+0000", 2024-04-18T14:43:41.501 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.9994999999999995e-05 2024-04-18T14:43:41.501 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:41.501 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:41.501 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_started", 2024-04-18T14:43:41.501 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:34.712408+0000", 2024-04-18T14:43:41.501 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.4304000000000001e-05 2024-04-18T14:43:41.501 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:41.501 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:41.501 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_committed", 2024-04-18T14:43:41.501 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:34.713882+0000", 2024-04-18T14:43:41.501 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0014744739999999999 2024-04-18T14:43:41.501 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:41.501 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:41.502 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T14:43:41.502 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:34.713915+0000", 2024-04-18T14:43:41.502 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.2545000000000001e-05 2024-04-18T14:43:41.502 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:43:41.502 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T14:43:41.502 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:43:41.502 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:41.502 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:41.502 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "MOSDECSubOpWrite(3.as5 36/30 ECSubWrite(tid=18, reqid=client.4559.0:178, at_version=36'12, trim_to=0'0, roll_forward_to=35'10))", 2024-04-18T14:43:41.503 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T14:43:35.738927+0000", 2024-04-18T14:43:41.503 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 5.7588571489999998, 2024-04-18T14:43:41.503 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0070694529999999998, 2024-04-18T14:43:41.503 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T14:43:41.503 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-04-18T14:43:41.503 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T14:43:41.503 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:41.503 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T14:43:41.503 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:35.738927+0000", 2024-04-18T14:43:41.504 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:43:41.504 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:41.504 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:41.504 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T14:43:41.504 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:35.738927+0000", 2024-04-18T14:43:41.504 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:43:41.504 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:41.504 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:41.504 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T14:43:41.504 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:35.738927+0000", 2024-04-18T14:43:41.504 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-04-18T14:43:41.504 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:41.504 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:41.504 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T14:43:41.505 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:35.739134+0000", 2024-04-18T14:43:41.505 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00020758699999999999 2024-04-18T14:43:41.505 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:41.505 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:41.505 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T14:43:41.505 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:35.739157+0000", 2024-04-18T14:43:41.505 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2577000000000001e-05 2024-04-18T14:43:41.505 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:41.505 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:41.505 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T14:43:41.505 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:35.739187+0000", 2024-04-18T14:43:41.505 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.0329e-05 2024-04-18T14:43:41.505 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:41.505 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:41.506 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T14:43:41.506 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:35.739334+0000", 2024-04-18T14:43:41.506 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000146883 2024-04-18T14:43:41.506 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:41.506 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:41.506 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_started", 2024-04-18T14:43:41.506 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:35.739360+0000", 2024-04-18T14:43:41.506 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.6451000000000001e-05 2024-04-18T14:43:41.506 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:41.507 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:41.507 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_committed", 2024-04-18T14:43:41.507 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:35.745931+0000", 2024-04-18T14:43:41.507 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0065700660000000003 2024-04-18T14:43:41.507 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:41.507 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:41.507 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T14:43:41.507 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:35.745997+0000", 2024-04-18T14:43:41.507 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.6192000000000006e-05 2024-04-18T14:43:41.507 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:43:41.507 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T14:43:41.507 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:43:41.507 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:41.508 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:41.508 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "MOSDECSubOpWrite(3.as5 36/30 ECSubWrite(tid=19, reqid=client.4559.0:179, at_version=36'13, trim_to=0'0, roll_forward_to=35'10))", 2024-04-18T14:43:41.508 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T14:43:35.744139+0000", 2024-04-18T14:43:41.508 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 5.7536449599999999, 2024-04-18T14:43:41.508 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0030246439999999999, 2024-04-18T14:43:41.508 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T14:43:41.508 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-04-18T14:43:41.508 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T14:43:41.509 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:41.509 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T14:43:41.509 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:35.744139+0000", 2024-04-18T14:43:41.509 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:43:41.509 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:41.509 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:41.509 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T14:43:41.510 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:35.744139+0000", 2024-04-18T14:43:41.510 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:43:41.510 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:41.510 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:41.510 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T14:43:41.510 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:35.744138+0000", 2024-04-18T14:43:41.510 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999986 2024-04-18T14:43:41.510 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:41.510 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:41.511 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T14:43:41.511 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:35.744221+0000", 2024-04-18T14:43:41.511 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.2887999999999997e-05 2024-04-18T14:43:41.511 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:41.511 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:41.511 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T14:43:41.511 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:35.744246+0000", 2024-04-18T14:43:41.511 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.4811e-05 2024-04-18T14:43:41.511 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:41.511 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:41.511 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T14:43:41.511 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:35.744262+0000", 2024-04-18T14:43:41.511 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6629e-05 2024-04-18T14:43:41.511 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:41.511 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:41.511 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T14:43:41.512 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:35.744849+0000", 2024-04-18T14:43:41.512 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00058696400000000004 2024-04-18T14:43:41.512 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:41.512 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:41.512 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_started", 2024-04-18T14:43:41.512 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:35.744881+0000", 2024-04-18T14:43:41.512 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.1761000000000003e-05 2024-04-18T14:43:41.512 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:41.512 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:41.512 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_committed", 2024-04-18T14:43:41.512 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:35.747096+0000", 2024-04-18T14:43:41.512 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.002215327 2024-04-18T14:43:41.512 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:41.512 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:41.513 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T14:43:41.513 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:35.747164+0000", 2024-04-18T14:43:41.513 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.7922000000000005e-05 2024-04-18T14:43:41.513 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:43:41.513 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T14:43:41.513 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:43:41.513 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:41.513 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:41.514 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "MOSDECSubOpWrite(3.as5 36/30 ECSubWrite(tid=20, reqid=client.4559.0:180, at_version=36'14, trim_to=0'0, roll_forward_to=35'10))", 2024-04-18T14:43:41.514 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T14:43:35.746275+0000", 2024-04-18T14:43:41.514 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 5.7515091299999996, 2024-04-18T14:43:41.514 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.001910742, 2024-04-18T14:43:41.514 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T14:43:41.514 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-04-18T14:43:41.514 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T14:43:41.514 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:41.514 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T14:43:41.514 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:35.746275+0000", 2024-04-18T14:43:41.514 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:43:41.514 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:41.515 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:41.515 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T14:43:41.515 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:35.746275+0000", 2024-04-18T14:43:41.515 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:43:41.515 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:41.515 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:41.515 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T14:43:41.515 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:35.746274+0000", 2024-04-18T14:43:41.515 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-18T14:43:41.515 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:41.515 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:41.515 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T14:43:41.515 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:35.746304+0000", 2024-04-18T14:43:41.515 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.9431999999999999e-05 2024-04-18T14:43:41.515 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:41.516 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:41.516 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T14:43:41.516 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:35.746318+0000", 2024-04-18T14:43:41.516 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.4486e-05 2024-04-18T14:43:41.516 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:41.516 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:41.516 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T14:43:41.516 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:35.746327+0000", 2024-04-18T14:43:41.516 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.1970000000000002e-06 2024-04-18T14:43:41.517 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:41.517 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:41.517 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T14:43:41.517 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:35.746382+0000", 2024-04-18T14:43:41.517 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.5028999999999998e-05 2024-04-18T14:43:41.517 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:41.518 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:41.518 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_started", 2024-04-18T14:43:41.518 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:35.746395+0000", 2024-04-18T14:43:41.518 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.224e-05 2024-04-18T14:43:41.518 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:41.518 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:41.519 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_committed", 2024-04-18T14:43:41.519 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:35.748132+0000", 2024-04-18T14:43:41.519 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.001737892 2024-04-18T14:43:41.519 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:41.519 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:41.519 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T14:43:41.519 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:35.748186+0000", 2024-04-18T14:43:41.520 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.3621e-05 2024-04-18T14:43:41.520 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:43:41.520 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T14:43:41.520 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:43:41.520 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:41.520 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:41.520 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "MOSDECSubOpWrite(3.as5 36/30 ECSubWrite(tid=21, reqid=client.4559.0:180, at_version=0'0, trim_to=0'0, roll_forward_to=36'14))", 2024-04-18T14:43:41.521 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T14:43:35.749608+0000", 2024-04-18T14:43:41.521 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 5.7481767069999998, 2024-04-18T14:43:41.521 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0017109079999999999, 2024-04-18T14:43:41.521 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T14:43:41.521 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-04-18T14:43:41.521 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T14:43:41.522 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:41.522 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T14:43:41.522 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:35.749608+0000", 2024-04-18T14:43:41.522 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:43:41.522 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:41.522 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:41.523 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T14:43:41.523 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:35.749608+0000", 2024-04-18T14:43:41.523 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:43:41.523 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:41.523 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:41.523 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T14:43:41.524 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:35.749607+0000", 2024-04-18T14:43:41.524 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-18T14:43:41.524 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:41.524 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:41.524 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T14:43:41.524 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:35.749646+0000", 2024-04-18T14:43:41.524 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.9292999999999998e-05 2024-04-18T14:43:41.525 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:41.525 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:41.525 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T14:43:41.525 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:35.749676+0000", 2024-04-18T14:43:41.525 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.9672999999999999e-05 2024-04-18T14:43:41.525 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:41.525 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:41.526 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T14:43:41.526 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:35.749694+0000", 2024-04-18T14:43:41.526 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8348000000000001e-05 2024-04-18T14:43:41.526 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:41.526 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:41.526 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T14:43:41.526 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:35.749779+0000", 2024-04-18T14:43:41.526 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.4757000000000002e-05 2024-04-18T14:43:41.527 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:41.527 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:41.527 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_started", 2024-04-18T14:43:41.527 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:35.749791+0000", 2024-04-18T14:43:41.527 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2021999999999999e-05 2024-04-18T14:43:41.527 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:41.528 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:41.528 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_committed", 2024-04-18T14:43:41.528 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:35.751280+0000", 2024-04-18T14:43:41.528 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.001489354 2024-04-18T14:43:41.528 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:41.528 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:41.528 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T14:43:41.528 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:35.751319+0000", 2024-04-18T14:43:41.528 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.8600999999999999e-05 2024-04-18T14:43:41.528 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:43:41.528 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T14:43:41.528 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:43:41.528 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:41.529 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:41.529 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "MOSDECSubOpWrite(3.9s4 37/30 ECSubWrite(tid=30, reqid=osd.12.0:30, at_version=37'17, trim_to=0'0, roll_forward_to=35'15))", 2024-04-18T14:43:41.529 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T14:43:36.741704+0000", 2024-04-18T14:43:41.529 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 4.7560807010000001, 2024-04-18T14:43:41.529 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.001888423, 2024-04-18T14:43:41.529 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T14:43:41.529 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-04-18T14:43:41.529 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T14:43:41.529 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:41.529 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T14:43:41.529 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.741704+0000", 2024-04-18T14:43:41.529 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:43:41.529 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:41.530 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:41.530 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T14:43:41.530 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.741704+0000", 2024-04-18T14:43:41.530 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:43:41.530 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:41.530 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:41.530 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T14:43:41.530 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.741703+0000", 2024-04-18T14:43:41.530 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-04-18T14:43:41.530 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:41.530 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:41.530 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T14:43:41.530 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.741745+0000", 2024-04-18T14:43:41.531 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.1838000000000002e-05 2024-04-18T14:43:41.531 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:41.531 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:41.531 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T14:43:41.531 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.741773+0000", 2024-04-18T14:43:41.531 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.7860000000000001e-05 2024-04-18T14:43:41.531 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:41.531 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:41.531 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T14:43:41.531 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.741790+0000", 2024-04-18T14:43:41.531 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.7034e-05 2024-04-18T14:43:41.532 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:41.532 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:41.532 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T14:43:41.532 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.741908+0000", 2024-04-18T14:43:41.532 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000118207 2024-04-18T14:43:41.532 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:41.532 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:41.533 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_started", 2024-04-18T14:43:41.533 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.741931+0000", 2024-04-18T14:43:41.533 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2424000000000001e-05 2024-04-18T14:43:41.533 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:41.533 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:41.533 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_committed", 2024-04-18T14:43:41.533 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.743542+0000", 2024-04-18T14:43:41.534 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.001611405 2024-04-18T14:43:41.534 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:41.534 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:41.534 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T14:43:41.534 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.743592+0000", 2024-04-18T14:43:41.535 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.9978000000000002e-05 2024-04-18T14:43:41.535 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:43:41.535 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T14:43:41.535 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:43:41.535 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:41.535 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:41.536 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "MOSDECSubOpWrite(3.as5 37/30 ECSubWrite(tid=23, reqid=client.4559.0:190, at_version=37'16, trim_to=0'0, roll_forward_to=36'14))", 2024-04-18T14:43:41.536 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T14:43:36.768753+0000", 2024-04-18T14:43:41.536 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 4.7290311230000004, 2024-04-18T14:43:41.536 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0038396509999999999, 2024-04-18T14:43:41.536 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T14:43:41.536 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-04-18T14:43:41.536 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T14:43:41.537 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:41.537 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T14:43:41.537 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.768753+0000", 2024-04-18T14:43:41.537 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:43:41.537 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:41.537 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:41.537 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T14:43:41.537 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.768753+0000", 2024-04-18T14:43:41.537 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:43:41.538 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:41.538 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:41.538 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T14:43:41.538 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.768752+0000", 2024-04-18T14:43:41.538 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-18T14:43:41.538 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:41.538 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:41.538 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T14:43:41.539 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.768796+0000", 2024-04-18T14:43:41.539 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.3417999999999997e-05 2024-04-18T14:43:41.539 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:41.539 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:41.539 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T14:43:41.539 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.768829+0000", 2024-04-18T14:43:41.539 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.3763999999999997e-05 2024-04-18T14:43:41.539 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:41.539 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:41.540 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T14:43:41.540 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.768853+0000", 2024-04-18T14:43:41.540 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.3597000000000001e-05 2024-04-18T14:43:41.540 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:41.540 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:41.540 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T14:43:41.540 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.769023+0000", 2024-04-18T14:43:41.540 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000170168 2024-04-18T14:43:41.541 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:41.541 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:41.541 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_started", 2024-04-18T14:43:41.541 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.769048+0000", 2024-04-18T14:43:41.541 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.5077000000000001e-05 2024-04-18T14:43:41.541 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:41.541 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:41.541 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_committed", 2024-04-18T14:43:41.541 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.772525+0000", 2024-04-18T14:43:41.541 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0034766150000000002 2024-04-18T14:43:41.541 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:41.542 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:41.542 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T14:43:41.542 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.772593+0000", 2024-04-18T14:43:41.542 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.8082000000000003e-05 2024-04-18T14:43:41.542 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:43:41.542 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T14:43:41.542 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:43:41.542 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:41.542 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:41.542 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "MOSDECSubOpWrite(3.as5 37/30 ECSubWrite(tid=24, reqid=osd.3.0:24, at_version=37'18, trim_to=0'0, roll_forward_to=36'14))", 2024-04-18T14:43:41.542 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T14:43:36.771095+0000", 2024-04-18T14:43:41.542 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 4.7266895680000003, 2024-04-18T14:43:41.542 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0033041469999999999, 2024-04-18T14:43:41.542 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T14:43:41.543 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-04-18T14:43:41.543 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T14:43:41.543 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:41.543 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T14:43:41.543 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.771095+0000", 2024-04-18T14:43:41.543 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:43:41.543 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:41.543 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:41.543 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T14:43:41.543 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.771095+0000", 2024-04-18T14:43:41.543 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:43:41.543 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:41.543 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:41.543 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T14:43:41.543 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.771093+0000", 2024-04-18T14:43:41.544 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999986 2024-04-18T14:43:41.544 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:41.544 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:41.544 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T14:43:41.544 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.771140+0000", 2024-04-18T14:43:41.544 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.7274999999999997e-05 2024-04-18T14:43:41.544 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:41.544 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:41.544 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T14:43:41.544 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.771171+0000", 2024-04-18T14:43:41.544 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.0196999999999999e-05 2024-04-18T14:43:41.544 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:41.544 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:41.544 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T14:43:41.544 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.771187+0000", 2024-04-18T14:43:41.544 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5903999999999999e-05 2024-04-18T14:43:41.545 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:41.545 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:41.545 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T14:43:41.545 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.771304+0000", 2024-04-18T14:43:41.545 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000117423 2024-04-18T14:43:41.545 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:41.545 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:41.545 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_started", 2024-04-18T14:43:41.545 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.771328+0000", 2024-04-18T14:43:41.545 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.3910999999999999e-05 2024-04-18T14:43:41.545 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:41.545 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:41.545 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_committed", 2024-04-18T14:43:41.545 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.774343+0000", 2024-04-18T14:43:41.545 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0030147360000000001 2024-04-18T14:43:41.546 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:41.546 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:41.546 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T14:43:41.546 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.774399+0000", 2024-04-18T14:43:41.546 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.6368e-05 2024-04-18T14:43:41.546 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:43:41.546 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T14:43:41.546 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:43:41.546 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:41.546 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:41.546 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "MOSDECSubOpWrite(3.as5 37/30 ECSubWrite(tid=25, reqid=osd.3.0:25, at_version=37'20, trim_to=0'0, roll_forward_to=36'14))", 2024-04-18T14:43:41.546 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T14:43:36.773217+0000", 2024-04-18T14:43:41.546 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 4.724567349, 2024-04-18T14:43:41.546 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0042251509999999999, 2024-04-18T14:43:41.546 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T14:43:41.547 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-04-18T14:43:41.547 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T14:43:41.547 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:41.547 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T14:43:41.547 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.773217+0000", 2024-04-18T14:43:41.547 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:43:41.547 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:41.547 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:41.547 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T14:43:41.547 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.773217+0000", 2024-04-18T14:43:41.547 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:43:41.547 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:41.547 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:41.547 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T14:43:41.547 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.773215+0000", 2024-04-18T14:43:41.548 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999981 2024-04-18T14:43:41.548 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:41.548 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:41.548 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T14:43:41.548 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.773275+0000", 2024-04-18T14:43:41.548 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.9348999999999997e-05 2024-04-18T14:43:41.548 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:41.548 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:41.548 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T14:43:41.548 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.773314+0000", 2024-04-18T14:43:41.548 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.9280999999999999e-05 2024-04-18T14:43:41.548 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:41.548 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:41.548 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T14:43:41.548 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.773339+0000", 2024-04-18T14:43:41.549 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.4556999999999999e-05 2024-04-18T14:43:41.549 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:41.549 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:41.549 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T14:43:41.549 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.773518+0000", 2024-04-18T14:43:41.549 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00017901500000000001 2024-04-18T14:43:41.549 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:41.549 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:41.549 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_started", 2024-04-18T14:43:41.549 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.773543+0000", 2024-04-18T14:43:41.549 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.5667e-05 2024-04-18T14:43:41.549 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:41.549 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:41.549 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_committed", 2024-04-18T14:43:41.549 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.777380+0000", 2024-04-18T14:43:41.550 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0038370639999999998 2024-04-18T14:43:41.550 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:41.550 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:41.550 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T14:43:41.550 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.777442+0000", 2024-04-18T14:43:41.550 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.1934999999999996e-05 2024-04-18T14:43:41.550 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:43:41.550 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T14:43:41.550 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:43:41.550 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:41.550 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:41.550 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "pg_update_log_missing(3.9s4 epoch 37/30 rep_tid 32 entries 37'18 (0'0) error 3:967bb897:::smithi13430248-25:head by client.4559.0:197 0.000000 0 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 35'15)", 2024-04-18T14:43:41.550 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T14:43:36.776812+0000", 2024-04-18T14:43:41.550 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 4.7209724580000003, 2024-04-18T14:43:41.550 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0036160749999999998, 2024-04-18T14:43:41.551 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T14:43:41.551 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-04-18T14:43:41.551 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T14:43:41.551 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:41.551 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T14:43:41.551 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.776812+0000", 2024-04-18T14:43:41.551 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:43:41.551 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:41.551 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:41.551 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T14:43:41.551 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.776812+0000", 2024-04-18T14:43:41.551 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:43:41.551 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:41.551 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:41.552 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T14:43:41.552 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.776810+0000", 2024-04-18T14:43:41.552 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999981 2024-04-18T14:43:41.552 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:41.552 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:41.552 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T14:43:41.552 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.776834+0000", 2024-04-18T14:43:41.552 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.4423999999999999e-05 2024-04-18T14:43:41.552 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:41.552 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:41.552 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T14:43:41.552 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.776878+0000", 2024-04-18T14:43:41.552 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.3281000000000001e-05 2024-04-18T14:43:41.552 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:41.553 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:41.553 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T14:43:41.553 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.776911+0000", 2024-04-18T14:43:41.553 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.3518e-05 2024-04-18T14:43:41.553 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:41.553 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:41.553 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T14:43:41.553 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.777060+0000", 2024-04-18T14:43:41.554 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00014921100000000001 2024-04-18T14:43:41.554 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:41.554 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:41.554 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T14:43:41.554 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.780428+0000", 2024-04-18T14:43:41.554 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0033675879999999999 2024-04-18T14:43:41.555 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:43:41.555 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T14:43:41.555 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:43:41.555 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:41.555 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:41.555 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "MOSDECSubOpWrite(3.as5 37/30 ECSubWrite(tid=26, reqid=osd.3.0:25, at_version=0'0, trim_to=0'0, roll_forward_to=37'20))", 2024-04-18T14:43:41.555 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T14:43:36.778261+0000", 2024-04-18T14:43:41.555 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 4.7195232230000004, 2024-04-18T14:43:41.556 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0039882110000000002, 2024-04-18T14:43:41.556 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T14:43:41.556 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-04-18T14:43:41.556 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T14:43:41.556 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:41.556 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T14:43:41.556 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.778261+0000", 2024-04-18T14:43:41.556 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:43:41.557 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:41.557 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:41.557 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T14:43:41.557 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.778261+0000", 2024-04-18T14:43:41.557 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:43:41.557 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:41.557 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:41.557 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T14:43:41.557 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.778260+0000", 2024-04-18T14:43:41.558 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999986 2024-04-18T14:43:41.558 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:41.558 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:41.558 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T14:43:41.558 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.778304+0000", 2024-04-18T14:43:41.558 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.4038000000000001e-05 2024-04-18T14:43:41.558 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:41.559 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:41.559 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T14:43:41.559 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.778364+0000", 2024-04-18T14:43:41.559 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.0807999999999998e-05 2024-04-18T14:43:41.559 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:41.559 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:41.559 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T14:43:41.559 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.778391+0000", 2024-04-18T14:43:41.559 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.6505000000000001e-05 2024-04-18T14:43:41.559 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:41.560 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:41.560 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T14:43:41.560 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.778577+0000", 2024-04-18T14:43:41.560 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00018615099999999999 2024-04-18T14:43:41.560 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:41.560 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:41.560 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_started", 2024-04-18T14:43:41.560 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.778601+0000", 2024-04-18T14:43:41.560 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.3801000000000001e-05 2024-04-18T14:43:41.560 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:41.560 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:41.560 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_committed", 2024-04-18T14:43:41.560 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.782189+0000", 2024-04-18T14:43:41.560 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.003587827 2024-04-18T14:43:41.560 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:41.561 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:41.561 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T14:43:41.561 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.782249+0000", 2024-04-18T14:43:41.561 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.0665000000000003e-05 2024-04-18T14:43:41.561 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:43:41.561 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T14:43:41.561 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:43:41.561 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:41.561 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:41.561 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "MOSDECSubOpWrite(3.6s3 37/30 ECSubWrite(tid=37, reqid=client.4559.0:201, at_version=37'10, trim_to=0'0, roll_forward_to=33'8))", 2024-04-18T14:43:41.561 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T14:43:36.780891+0000", 2024-04-18T14:43:41.561 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 4.7168935980000004, 2024-04-18T14:43:41.561 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0037438219999999999, 2024-04-18T14:43:41.561 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T14:43:41.561 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-04-18T14:43:41.562 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T14:43:41.562 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:41.562 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T14:43:41.562 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.780891+0000", 2024-04-18T14:43:41.562 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:43:41.562 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:41.562 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:41.562 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T14:43:41.562 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.780891+0000", 2024-04-18T14:43:41.562 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:43:41.562 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:41.562 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:41.562 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T14:43:41.562 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.780890+0000", 2024-04-18T14:43:41.563 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-18T14:43:41.563 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:41.563 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:41.563 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T14:43:41.563 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.780971+0000", 2024-04-18T14:43:41.563 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.1354999999999996e-05 2024-04-18T14:43:41.563 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:41.563 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:41.563 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T14:43:41.563 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.781005+0000", 2024-04-18T14:43:41.563 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.3074000000000002e-05 2024-04-18T14:43:41.563 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:41.563 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:41.563 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T14:43:41.563 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.781027+0000", 2024-04-18T14:43:41.564 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2041000000000001e-05 2024-04-18T14:43:41.564 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:41.564 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:41.564 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T14:43:41.564 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.781188+0000", 2024-04-18T14:43:41.564 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00016168399999999999 2024-04-18T14:43:41.564 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:41.564 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:41.564 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_started", 2024-04-18T14:43:41.564 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.781213+0000", 2024-04-18T14:43:41.564 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.5143999999999998e-05 2024-04-18T14:43:41.564 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:41.564 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:41.564 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_committed", 2024-04-18T14:43:41.564 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.784575+0000", 2024-04-18T14:43:41.564 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0033616850000000001 2024-04-18T14:43:41.565 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:41.565 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:41.565 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T14:43:41.565 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.784635+0000", 2024-04-18T14:43:41.565 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.9574999999999998e-05 2024-04-18T14:43:41.565 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:43:41.565 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T14:43:41.565 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:43:41.565 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:41.565 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:41.565 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "MOSDECSubOpWrite(3.9s4 37/30 ECSubWrite(tid=33, reqid=client.4559.0:205, at_version=37'20, trim_to=0'0, roll_forward_to=37'17))", 2024-04-18T14:43:41.565 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T14:43:36.855236+0000", 2024-04-18T14:43:41.565 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 4.6425482840000001, 2024-04-18T14:43:41.565 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0020258630000000001, 2024-04-18T14:43:41.565 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T14:43:41.565 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-04-18T14:43:41.566 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T14:43:41.566 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:41.566 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T14:43:41.566 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.855236+0000", 2024-04-18T14:43:41.566 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:43:41.566 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:41.566 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:41.566 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T14:43:41.566 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.855236+0000", 2024-04-18T14:43:41.566 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:43:41.566 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:41.566 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:41.566 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T14:43:41.566 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.855234+0000", 2024-04-18T14:43:41.566 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999981 2024-04-18T14:43:41.566 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:41.567 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:41.567 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T14:43:41.567 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.855295+0000", 2024-04-18T14:43:41.567 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.1246000000000003e-05 2024-04-18T14:43:41.567 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:41.567 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:41.567 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T14:43:41.567 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.855327+0000", 2024-04-18T14:43:41.567 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.2094000000000001e-05 2024-04-18T14:43:41.567 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:41.567 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:41.567 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T14:43:41.567 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.855344+0000", 2024-04-18T14:43:41.568 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6586999999999999e-05 2024-04-18T14:43:41.568 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:41.568 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:41.568 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T14:43:41.568 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.855451+0000", 2024-04-18T14:43:41.568 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000106619 2024-04-18T14:43:41.568 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:41.568 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:41.568 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_started", 2024-04-18T14:43:41.568 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.855471+0000", 2024-04-18T14:43:41.568 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.9944000000000001e-05 2024-04-18T14:43:41.568 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:41.568 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:41.568 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_committed", 2024-04-18T14:43:41.568 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.857230+0000", 2024-04-18T14:43:41.568 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.001759484 2024-04-18T14:43:41.569 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:41.569 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:41.569 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T14:43:41.569 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.857262+0000", 2024-04-18T14:43:41.569 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.1906000000000003e-05 2024-04-18T14:43:41.569 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:43:41.569 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T14:43:41.569 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:43:41.569 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:41.569 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:41.569 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "MOSDECSubOpWrite(3.6s3 37/30 ECSubWrite(tid=41, reqid=client.4559.0:206, at_version=37'12, trim_to=0'0, roll_forward_to=37'10))", 2024-04-18T14:43:41.569 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T14:43:36.870019+0000", 2024-04-18T14:43:41.569 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 4.627765868, 2024-04-18T14:43:41.569 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.003577607, 2024-04-18T14:43:41.570 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T14:43:41.570 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-04-18T14:43:41.570 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T14:43:41.570 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:41.570 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T14:43:41.570 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.870019+0000", 2024-04-18T14:43:41.570 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:43:41.570 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:41.570 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:41.570 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T14:43:41.570 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.870019+0000", 2024-04-18T14:43:41.570 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:43:41.570 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:41.571 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:41.571 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T14:43:41.571 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.870017+0000", 2024-04-18T14:43:41.571 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999981 2024-04-18T14:43:41.571 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:41.571 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:41.571 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T14:43:41.571 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.870648+0000", 2024-04-18T14:43:41.571 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00063149600000000005 2024-04-18T14:43:41.571 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:41.571 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:41.571 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T14:43:41.571 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.870679+0000", 2024-04-18T14:43:41.571 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.0171e-05 2024-04-18T14:43:41.571 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:41.572 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:41.572 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T14:43:41.572 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.870699+0000", 2024-04-18T14:43:41.572 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0171000000000001e-05 2024-04-18T14:43:41.572 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:41.572 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:41.572 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T14:43:41.572 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.870815+0000", 2024-04-18T14:43:41.573 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000116699 2024-04-18T14:43:41.573 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:41.573 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:41.573 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_started", 2024-04-18T14:43:41.573 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.870831+0000", 2024-04-18T14:43:41.573 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5469999999999999e-05 2024-04-18T14:43:41.573 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:41.573 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:41.573 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_committed", 2024-04-18T14:43:41.574 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.873534+0000", 2024-04-18T14:43:41.574 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0027031109999999998 2024-04-18T14:43:41.574 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:41.574 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:41.574 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T14:43:41.574 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.873596+0000", 2024-04-18T14:43:41.574 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.2168999999999994e-05 2024-04-18T14:43:41.574 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:43:41.574 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T14:43:41.574 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:43:41.574 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:41.574 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:41.574 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "MOSDECSubOpWrite(3.8s5 41/30 ECSubWrite(tid=35, reqid=client.4559.0:250, at_version=41'18, trim_to=0'0, roll_forward_to=38'16))", 2024-04-18T14:43:41.574 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T14:43:40.766176+0000", 2024-04-18T14:43:41.574 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.73160830700000001, 2024-04-18T14:43:41.575 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0050703090000000003, 2024-04-18T14:43:41.575 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T14:43:41.575 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-04-18T14:43:41.575 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T14:43:41.575 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:41.575 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T14:43:41.575 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:40.766176+0000", 2024-04-18T14:43:41.575 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:43:41.575 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:41.575 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:41.575 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T14:43:41.575 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:40.766176+0000", 2024-04-18T14:43:41.575 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:43:41.575 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:41.575 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:41.576 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T14:43:41.576 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:40.766175+0000", 2024-04-18T14:43:41.576 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-04-18T14:43:41.576 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:41.576 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:41.576 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T14:43:41.576 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:40.766245+0000", 2024-04-18T14:43:41.576 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.9363999999999995e-05 2024-04-18T14:43:41.576 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:41.576 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:41.576 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T14:43:41.576 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:40.766278+0000", 2024-04-18T14:43:41.576 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.2713999999999999e-05 2024-04-18T14:43:41.576 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:41.577 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:41.577 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T14:43:41.577 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:40.766300+0000", 2024-04-18T14:43:41.577 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2164e-05 2024-04-18T14:43:41.577 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:41.577 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:41.577 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T14:43:41.577 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:40.766368+0000", 2024-04-18T14:43:41.577 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.8492999999999996e-05 2024-04-18T14:43:41.577 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:41.577 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:41.577 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_started", 2024-04-18T14:43:41.577 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:40.766379+0000", 2024-04-18T14:43:41.577 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0957e-05 2024-04-18T14:43:41.578 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:41.578 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:41.578 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_committed", 2024-04-18T14:43:41.578 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:40.771183+0000", 2024-04-18T14:43:41.578 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0048041550000000001 2024-04-18T14:43:41.578 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:41.578 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:41.578 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T14:43:41.578 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:40.771246+0000", 2024-04-18T14:43:41.578 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.3151999999999994e-05 2024-04-18T14:43:41.578 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:43:41.578 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T14:43:41.578 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:43:41.578 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:41.578 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:41.579 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "pg_update_log_missing(3.9s4 epoch 41/30 rep_tid 40 entries 41'25 (0'0) error 3:936e42fd:::smithi13430248-33:head by client.4559.0:247 0.000000 0 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 38'23)", 2024-04-18T14:43:41.579 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T14:43:40.767532+0000", 2024-04-18T14:43:41.579 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.73025245500000002, 2024-04-18T14:43:41.579 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0052167969999999996, 2024-04-18T14:43:41.579 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T14:43:41.579 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-04-18T14:43:41.579 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T14:43:41.579 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:41.579 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T14:43:41.579 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:40.767532+0000", 2024-04-18T14:43:41.579 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:43:41.579 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:41.579 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:41.579 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T14:43:41.579 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:40.767532+0000", 2024-04-18T14:43:41.580 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:43:41.580 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:41.580 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:41.580 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T14:43:41.580 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:40.767532+0000", 2024-04-18T14:43:41.580 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-04-18T14:43:41.580 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:41.580 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:41.580 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T14:43:41.580 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:40.767547+0000", 2024-04-18T14:43:41.580 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5007e-05 2024-04-18T14:43:41.580 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:41.580 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:41.580 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T14:43:41.580 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:40.767560+0000", 2024-04-18T14:43:41.581 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3550000000000001e-05 2024-04-18T14:43:41.581 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:41.581 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:41.581 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T14:43:41.581 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:40.767572+0000", 2024-04-18T14:43:41.581 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1507e-05 2024-04-18T14:43:41.581 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:41.581 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:41.581 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T14:43:41.581 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:40.767739+0000", 2024-04-18T14:43:41.581 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000166997 2024-04-18T14:43:41.581 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:41.581 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:41.581 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T14:43:41.581 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:40.772749+0000", 2024-04-18T14:43:41.581 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0050099749999999998 2024-04-18T14:43:41.582 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:43:41.582 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T14:43:41.582 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:43:41.582 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:41.582 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:41.582 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "MOSDECSubOpWrite(3.8s5 41/30 ECSubWrite(tid=36, reqid=osd.5.0:36, at_version=41'20, trim_to=0'0, roll_forward_to=38'16))", 2024-04-18T14:43:41.582 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T14:43:40.769059+0000", 2024-04-18T14:43:41.582 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.72872587300000002, 2024-04-18T14:43:41.582 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0039424680000000002, 2024-04-18T14:43:41.582 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T14:43:41.582 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-04-18T14:43:41.582 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T14:43:41.582 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:41.582 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T14:43:41.583 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:40.769059+0000", 2024-04-18T14:43:41.583 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:43:41.583 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:41.583 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:41.583 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T14:43:41.583 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:40.769059+0000", 2024-04-18T14:43:41.583 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:43:41.583 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:41.583 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:41.583 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T14:43:41.583 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:40.769057+0000", 2024-04-18T14:43:41.583 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999986 2024-04-18T14:43:41.583 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:41.583 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:41.583 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T14:43:41.583 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:40.769099+0000", 2024-04-18T14:43:41.584 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.1721000000000003e-05 2024-04-18T14:43:41.584 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:41.584 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:41.584 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T14:43:41.584 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:40.769126+0000", 2024-04-18T14:43:41.584 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.7477000000000001e-05 2024-04-18T14:43:41.584 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:41.584 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:41.584 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T14:43:41.584 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:40.769141+0000", 2024-04-18T14:43:41.584 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.4464000000000001e-05 2024-04-18T14:43:41.584 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:41.584 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:41.584 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T14:43:41.585 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:40.769277+0000", 2024-04-18T14:43:41.585 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00013659300000000001 2024-04-18T14:43:41.585 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:41.585 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:41.585 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_started", 2024-04-18T14:43:41.585 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:40.769304+0000", 2024-04-18T14:43:41.585 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.709e-05 2024-04-18T14:43:41.585 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:41.585 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:41.585 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_committed", 2024-04-18T14:43:41.585 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:40.772875+0000", 2024-04-18T14:43:41.585 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0035703029999999999 2024-04-18T14:43:41.585 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:41.585 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:41.585 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T14:43:41.586 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:40.773001+0000", 2024-04-18T14:43:41.586 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00012646000000000001 2024-04-18T14:43:41.586 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:43:41.586 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T14:43:41.586 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:43:41.586 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:41.586 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:41.586 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "MOSDECSubOpWrite(3.9s4 41/30 ECSubWrite(tid=41, reqid=osd.12.0:41, at_version=41'27, trim_to=0'0, roll_forward_to=38'24))", 2024-04-18T14:43:41.586 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T14:43:40.770353+0000", 2024-04-18T14:43:41.586 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.72743143799999999, 2024-04-18T14:43:41.586 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.004114665, 2024-04-18T14:43:41.586 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T14:43:41.586 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-04-18T14:43:41.586 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T14:43:41.586 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:41.587 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T14:43:41.587 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:40.770353+0000", 2024-04-18T14:43:41.587 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:43:41.587 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:41.587 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:41.587 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T14:43:41.587 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:40.770353+0000", 2024-04-18T14:43:41.587 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:43:41.587 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:41.587 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:41.587 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T14:43:41.587 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:40.770351+0000", 2024-04-18T14:43:41.587 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999986 2024-04-18T14:43:41.587 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:41.587 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:41.588 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T14:43:41.588 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:40.770401+0000", 2024-04-18T14:43:41.588 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.9181000000000002e-05 2024-04-18T14:43:41.588 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:41.588 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:41.588 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T14:43:41.588 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:40.770432+0000", 2024-04-18T14:43:41.588 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.1087000000000002e-05 2024-04-18T14:43:41.588 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:41.588 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:41.588 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T14:43:41.588 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:40.770452+0000", 2024-04-18T14:43:41.588 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.9953999999999999e-05 2024-04-18T14:43:41.588 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:41.588 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:41.588 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T14:43:41.589 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:40.770576+0000", 2024-04-18T14:43:41.589 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000124079 2024-04-18T14:43:41.589 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:41.589 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:41.589 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_started", 2024-04-18T14:43:41.589 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:40.770600+0000", 2024-04-18T14:43:41.589 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.4474e-05 2024-04-18T14:43:41.589 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:41.589 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:41.589 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_committed", 2024-04-18T14:43:41.589 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:40.774424+0000", 2024-04-18T14:43:41.589 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0038238249999999999 2024-04-18T14:43:41.589 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:41.589 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:41.589 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T14:43:41.590 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:40.774468+0000", 2024-04-18T14:43:41.590 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.3640999999999998e-05 2024-04-18T14:43:41.590 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:43:41.590 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T14:43:41.590 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:43:41.590 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:41.590 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:41.590 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "MOSDECSubOpWrite(3.9s4 41/30 ECSubWrite(tid=42, reqid=osd.12.0:41, at_version=0'0, trim_to=0'0, roll_forward_to=41'27))", 2024-04-18T14:43:41.590 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T14:43:40.779760+0000", 2024-04-18T14:43:41.590 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.71802465199999999, 2024-04-18T14:43:41.590 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.004685959, 2024-04-18T14:43:41.590 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T14:43:41.591 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-04-18T14:43:41.591 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T14:43:41.591 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:41.591 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T14:43:41.591 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:40.779760+0000", 2024-04-18T14:43:41.591 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:43:41.591 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:41.591 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:41.591 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T14:43:41.591 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:40.779760+0000", 2024-04-18T14:43:41.591 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:43:41.591 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:41.591 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:41.591 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T14:43:41.591 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:40.779758+0000", 2024-04-18T14:43:41.591 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999986 2024-04-18T14:43:41.592 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:41.592 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:41.592 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T14:43:41.592 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:40.779785+0000", 2024-04-18T14:43:41.592 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.6480999999999999e-05 2024-04-18T14:43:41.592 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:41.592 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:41.592 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T14:43:41.592 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:40.779812+0000", 2024-04-18T14:43:41.592 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.7093e-05 2024-04-18T14:43:41.592 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:41.592 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:41.592 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T14:43:41.592 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:40.779835+0000", 2024-04-18T14:43:41.592 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2915e-05 2024-04-18T14:43:41.592 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:41.593 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:41.593 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T14:43:41.593 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:40.779901+0000", 2024-04-18T14:43:41.593 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.5668999999999998e-05 2024-04-18T14:43:41.593 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:41.593 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:41.593 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_started", 2024-04-18T14:43:41.593 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:40.779912+0000", 2024-04-18T14:43:41.593 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1620000000000001e-05 2024-04-18T14:43:41.593 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:41.593 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:41.593 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_committed", 2024-04-18T14:43:41.593 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:40.784381+0000", 2024-04-18T14:43:41.593 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0044684420000000004 2024-04-18T14:43:41.594 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:41.594 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:41.594 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T14:43:41.594 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:40.784446+0000", 2024-04-18T14:43:41.594 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.5139000000000001e-05 2024-04-18T14:43:41.594 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:43:41.594 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T14:43:41.594 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:43:41.594 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:41.594 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:41.594 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "MOSDECSubOpWrite(3.8s5 41/30 ECSubWrite(tid=38, reqid=osd.5.0:36, at_version=0'0, trim_to=0'0, roll_forward_to=41'20))", 2024-04-18T14:43:41.594 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T14:43:40.780111+0000", 2024-04-18T14:43:41.594 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.71767334100000002, 2024-04-18T14:43:41.595 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0064127400000000001, 2024-04-18T14:43:41.595 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T14:43:41.595 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-04-18T14:43:41.595 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T14:43:41.595 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:41.595 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T14:43:41.595 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:40.780111+0000", 2024-04-18T14:43:41.595 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:43:41.595 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:41.595 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:41.595 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T14:43:41.595 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:40.780111+0000", 2024-04-18T14:43:41.595 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:43:41.595 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:41.595 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:41.596 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T14:43:41.596 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:40.780109+0000", 2024-04-18T14:43:41.596 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999986 2024-04-18T14:43:41.596 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:41.596 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:41.596 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T14:43:41.596 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:40.780138+0000", 2024-04-18T14:43:41.596 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.9023999999999999e-05 2024-04-18T14:43:41.596 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:41.596 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:41.596 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T14:43:41.596 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:40.780168+0000", 2024-04-18T14:43:41.596 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.9420999999999998e-05 2024-04-18T14:43:41.596 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:41.596 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:41.597 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T14:43:41.597 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:40.780194+0000", 2024-04-18T14:43:41.597 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.5667e-05 2024-04-18T14:43:41.597 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:41.597 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:41.597 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T14:43:41.597 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:40.780358+0000", 2024-04-18T14:43:41.597 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00016448999999999999 2024-04-18T14:43:41.597 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:41.597 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:41.597 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_started", 2024-04-18T14:43:41.597 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:40.780382+0000", 2024-04-18T14:43:41.597 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.3971000000000001e-05 2024-04-18T14:43:41.597 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:41.597 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:41.597 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_committed", 2024-04-18T14:43:41.598 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:40.786461+0000", 2024-04-18T14:43:41.598 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0060789770000000002 2024-04-18T14:43:41.598 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:41.598 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:41.598 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T14:43:41.598 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:40.786524+0000", 2024-04-18T14:43:41.598 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.2849999999999996e-05 2024-04-18T14:43:41.598 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:43:41.598 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T14:43:41.598 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:43:41.598 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:43:41.598 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T14:43:41.598 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-04-18T14:43:41.599 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-18T14:43:41.600 INFO:tasks.ceph.osd.13.smithi096.stderr:2024-04-18T14:43:41.599+0000 7f7e72fad640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 13 (PID: 24893) UID: 0 2024-04-18T14:43:41.601 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-18T14:43:41.701 INFO:tasks.ceph.osd.7.smithi134.stderr:2024-04-18T14:43:41.704+0000 7fd7de549640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25213) UID: 0 2024-04-18T14:43:41.726 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-04-18T14:43:41.727 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [], 2024-04-18T14:43:41.727 INFO:teuthology.orchestra.run.smithi086.stdout: "num_ops": 0 2024-04-18T14:43:41.727 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-04-18T14:43:41.741 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-18T14:43:41.746 INFO:teuthology.orchestra.run.smithi086.stdout:osd.0: {} 2024-04-18T14:43:41.746 INFO:teuthology.orchestra.run.smithi086.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-18T14:43:41.759 INFO:teuthology.orchestra.run.smithi086.stderr:set osd.4 primary-affinity to 0.824894 (8540602) 2024-04-18T14:43:41.764 INFO:tasks.rados.rados.0.smithi134.stdout:94: done (3 left) 2024-04-18T14:43:41.764 INFO:tasks.rados.rados.0.smithi134.stdout:95: done (2 left) 2024-04-18T14:43:41.764 INFO:tasks.rados.rados.0.smithi134.stdout:97: done (1 left) 2024-04-18T14:43:41.764 INFO:tasks.rados.rados.0.smithi134.stdout:99: done (0 left) 2024-04-18T14:43:41.764 INFO:tasks.rados.rados.0.smithi134.stdout:100: rmattr oid 22 current snap is 7 2024-04-18T14:43:41.764 INFO:tasks.rados.rados.0.smithi134.stdout:100: done (0 left) 2024-04-18T14:43:41.764 INFO:tasks.rados.rados.0.smithi134.stdout:101: snap_create 2024-04-18T14:43:41.767 INFO:teuthology.orchestra.run.smithi086.stdout:osd.1: {} 2024-04-18T14:43:41.767 INFO:teuthology.orchestra.run.smithi086.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-18T14:43:41.771 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-04-18T14:43:41.788 INFO:teuthology.orchestra.run.smithi086.stdout:osd.2: {} 2024-04-18T14:43:41.788 INFO:teuthology.orchestra.run.smithi086.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-18T14:43:41.802 INFO:tasks.ceph.osd.4.smithi086.stderr:2024-04-18T14:43:41.803+0000 7f0c4c462640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 24956) UID: 0 2024-04-18T14:43:41.808 INFO:teuthology.orchestra.run.smithi086.stdout:osd.3: {} 2024-04-18T14:43:41.808 INFO:teuthology.orchestra.run.smithi086.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-18T14:43:41.823 INFO:teuthology.orchestra.run.smithi086.stdout:osd.4: {} 2024-04-18T14:43:41.824 INFO:teuthology.orchestra.run.smithi086.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-18T14:43:41.843 INFO:teuthology.orchestra.run.smithi086.stdout:osd.5: {} 2024-04-18T14:43:41.843 INFO:teuthology.orchestra.run.smithi086.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-18T14:43:41.854 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-04-18T14:43:41.854 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T14:43:41.863 INFO:teuthology.orchestra.run.smithi086.stdout:osd.6: {} 2024-04-18T14:43:41.863 INFO:teuthology.orchestra.run.smithi086.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-18T14:43:41.868 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-18T14:43:41.882 INFO:teuthology.orchestra.run.smithi086.stdout:osd.7: {} 2024-04-18T14:43:41.883 INFO:teuthology.orchestra.run.smithi086.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-18T14:43:41.903 INFO:teuthology.orchestra.run.smithi086.stdout:osd.8: {} 2024-04-18T14:43:41.903 INFO:teuthology.orchestra.run.smithi086.stderr:osd.8: osd_enable_op_tracker = '' 2024-04-18T14:43:41.903 INFO:tasks.ceph.osd.8.smithi086.stderr:2024-04-18T14:43:41.903+0000 7f29f7b9d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 8 (PID: 24958) UID: 0 2024-04-18T14:43:41.935 INFO:teuthology.orchestra.run.smithi086.stdout:osd.9: {} 2024-04-18T14:43:41.935 INFO:teuthology.orchestra.run.smithi086.stderr:osd.9: osd_enable_op_tracker = '' 2024-04-18T14:43:41.954 INFO:teuthology.orchestra.run.smithi086.stdout:osd.10: {} 2024-04-18T14:43:41.955 INFO:teuthology.orchestra.run.smithi086.stderr:osd.10: osd_enable_op_tracker = '' 2024-04-18T14:43:41.974 INFO:teuthology.orchestra.run.smithi086.stdout:osd.11: {} 2024-04-18T14:43:41.974 INFO:teuthology.orchestra.run.smithi086.stderr:osd.11: osd_enable_op_tracker = '' 2024-04-18T14:43:41.989 INFO:teuthology.orchestra.run.smithi086.stdout:osd.12: {} 2024-04-18T14:43:41.989 INFO:teuthology.orchestra.run.smithi086.stderr:osd.12: osd_enable_op_tracker = '' 2024-04-18T14:43:42.000 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-04-18T14:43:42.000 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T14:43:42.004 INFO:tasks.ceph.osd.13.smithi096.stderr:2024-04-18T14:43:42.003+0000 7f7e72fad640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 13 (PID: 24893) UID: 0 2024-04-18T14:43:42.008 INFO:teuthology.orchestra.run.smithi086.stdout:osd.13: {} 2024-04-18T14:43:42.009 INFO:teuthology.orchestra.run.smithi086.stderr:osd.13: osd_enable_op_tracker = '' 2024-04-18T14:43:42.013 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-04-18T14:43:42.028 INFO:teuthology.orchestra.run.smithi086.stdout:osd.14: {} 2024-04-18T14:43:42.029 INFO:teuthology.orchestra.run.smithi086.stderr:osd.14: osd_enable_op_tracker = '' 2024-04-18T14:43:42.031 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-18T14:43:42.031+0000 7f2adf7fe640 0 -- 172.21.15.86:0/3426717222 >> [v2:172.21.15.134:6808/25223,v1:172.21.15.134:6812/25223] conn(0x7f2ae0223770 msgr2=0x7f2ae0225b60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-04-18T14:43:42.051 INFO:teuthology.orchestra.run.smithi086.stdout:osd.15: {} 2024-04-18T14:43:42.051 INFO:teuthology.orchestra.run.smithi086.stderr:osd.15: osd_enable_op_tracker = '' 2024-04-18T14:43:42.105 INFO:tasks.ceph.osd.9.smithi096.stderr:2024-04-18T14:43:42.107+0000 7fa2c1cbf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 9 (PID: 24891) UID: 0 2024-04-18T14:43:42.134 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-04-18T14:43:42.134 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T14:43:42.146 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-04-18T14:43:42.206 INFO:tasks.ceph.osd.9.smithi096.stderr:2024-04-18T14:43:42.207+0000 7fa2c1cbf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 9 (PID: 24891) UID: 0 2024-04-18T14:43:42.258 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-04-18T14:43:42.258 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T14:43:42.271 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-04-18T14:43:42.307 INFO:tasks.ceph.osd.14.smithi119.stderr:2024-04-18T14:43:42.306+0000 7f180f599640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 14 (PID: 24900) UID: 0 2024-04-18T14:43:42.391 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-04-18T14:43:42.392 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T14:43:42.406 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.8.asok dump_ops_in_flight 2024-04-18T14:43:42.407 INFO:tasks.ceph.osd.0.smithi086.stderr:2024-04-18T14:43:42.407+0000 7f7cdfd78640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 24953) UID: 0 2024-04-18T14:43:42.508 INFO:tasks.ceph.osd.13.smithi096.stderr:2024-04-18T14:43:42.507+0000 7f7e72fad640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 13 (PID: 24893) UID: 0 2024-04-18T14:43:42.524 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-04-18T14:43:42.524 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T14:43:42.538 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.8.asok dump_blocked_ops 2024-04-18T14:43:42.610 INFO:tasks.ceph.osd.15.smithi134.stderr:2024-04-18T14:43:42.612+0000 7f08e6a51640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 15 (PID: 25218) UID: 0 2024-04-18T14:43:42.653 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-04-18T14:43:42.653 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T14:43:42.667 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.8.asok dump_historic_ops 2024-04-18T14:43:42.711 INFO:tasks.ceph.osd.6.smithi119.stderr:2024-04-18T14:43:42.710+0000 7fb7cb8bd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 24896) UID: 0 2024-04-18T14:43:42.763 INFO:teuthology.orchestra.run.smithi086.stderr:nodeep-scrub is set 2024-04-18T14:43:42.766 INFO:tasks.rados.rados.0.smithi134.stdout:101: done (0 left) 2024-04-18T14:43:42.766 INFO:tasks.rados.rados.0.smithi134.stdout:102: delete oid 33 current snap is 8 2024-04-18T14:43:42.776 INFO:tasks.rados.rados.0.smithi134.stdout:102: done (0 left) 2024-04-18T14:43:42.777 INFO:tasks.rados.rados.0.smithi134.stdout:103: copy_from oid 23 from oid 45 current snap is 8 2024-04-18T14:43:42.777 INFO:tasks.rados.rados.0.smithi134.stdout:104: rmattr oid 4 current snap is 8 2024-04-18T14:43:42.777 INFO:tasks.rados.rados.0.smithi134.stdout:104: done (1 left) 2024-04-18T14:43:42.777 INFO:tasks.rados.rados.0.smithi134.stdout:append oid 39 current snap is 8 2024-04-18T14:43:42.777 INFO:tasks.rados.rados.0.smithi134.stdout:105: seq_num 64 ranges {638976=704512,1343488=376832} 2024-04-18T14:43:42.785 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-04-18T14:43:42.785 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T14:43:42.799 INFO:tasks.rados.rados.0.smithi134.stdout:105: writing smithi13430248-39 from 638976 to 1343488 tid 1 2024-04-18T14:43:42.800 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.12.asok dump_ops_in_flight 2024-04-18T14:43:42.806 INFO:tasks.rados.rados.0.smithi134.stdout:105: writing smithi13430248-39 from 1343488 to 1720320 tid 2 2024-04-18T14:43:42.806 INFO:tasks.rados.rados.0.smithi134.stdout:106: rollback oid 12 current snap is 8 2024-04-18T14:43:42.809 INFO:tasks.rados.rados.0.smithi134.stdout:rollback oid 12 to 4 2024-04-18T14:43:42.809 INFO:tasks.rados.rados.0.smithi134.stdout:103: finishing copy_from racing read to smithi13430248-23 2024-04-18T14:43:42.809 INFO:tasks.rados.rados.0.smithi134.stdout:103: finishing copy_from to smithi13430248-23 2024-04-18T14:43:42.809 INFO:tasks.rados.rados.0.smithi134.stdout:update_object_version oid 23 v 8 (ObjNum 44 snap 0 seq_num 44) dirty exists 2024-04-18T14:43:42.810 INFO:tasks.rados.rados.0.smithi134.stdout:103: done (2 left) 2024-04-18T14:43:42.810 INFO:tasks.rados.rados.0.smithi134.stdout:107: read oid 26 snap -1 2024-04-18T14:43:42.810 INFO:tasks.rados.rados.0.smithi134.stdout:107: expect (ObjNum 5 snap 0 seq_num 5) 2024-04-18T14:43:42.810 INFO:tasks.rados.rados.0.smithi134.stdout:108: copy_from oid 11 from oid 31 current snap is 8 2024-04-18T14:43:42.810 INFO:tasks.rados.rados.0.smithi134.stdout:109: rollback oid 42 current snap is 8 2024-04-18T14:43:42.810 INFO:tasks.rados.rados.0.smithi134.stdout:rollback oid 42 to 7 2024-04-18T14:43:42.810 INFO:tasks.rados.rados.0.smithi134.stdout:110: snap_remove snap 2 2024-04-18T14:43:42.847 INFO:tasks.ceph.osd.0.smithi086.stderr:2024-04-18T14:43:42.847+0000 7f7cdfd78640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 24953) UID: 0 2024-04-18T14:43:42.913 INFO:tasks.ceph.osd.2.smithi119.stderr:2024-04-18T14:43:42.914+0000 7fcbd30c0640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 24894) UID: 0 2024-04-18T14:43:42.961 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-04-18T14:43:42.961 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T14:43:42.975 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.12.asok dump_blocked_ops 2024-04-18T14:43:43.014 INFO:tasks.ceph.osd.5.smithi096.stderr:2024-04-18T14:43:43.011+0000 7fc33f25b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 24889) UID: 0 2024-04-18T14:43:43.097 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-04-18T14:43:43.097 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T14:43:43.111 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.12.asok dump_historic_ops 2024-04-18T14:43:43.114 INFO:tasks.ceph.osd.3.smithi134.stderr:2024-04-18T14:43:43.116+0000 7fe7a4443640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25211) UID: 0 2024-04-18T14:43:43.215 INFO:tasks.ceph.osd.0.smithi086.stderr:2024-04-18T14:43:43.215+0000 7f7cdfd78640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 24953) UID: 0 2024-04-18T14:43:43.232 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-04-18T14:43:43.232 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T14:43:43.246 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-18T14:43:43.317 INFO:tasks.ceph.osd.3.smithi134.stderr:2024-04-18T14:43:43.320+0000 7fe7a4443640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25211) UID: 0 2024-04-18T14:43:43.379 INFO:teuthology.orchestra.run.smithi096.stdout:ERROR: (22) Invalid argument 2024-04-18T14:43:43.379 INFO:teuthology.orchestra.run.smithi096.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T14:43:43.392 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-18T14:43:43.417 INFO:tasks.ceph.osd.10.smithi119.stderr:2024-04-18T14:43:43.418+0000 7f6f24c12640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 10 (PID: 24898) UID: 0 2024-04-18T14:43:43.513 INFO:teuthology.orchestra.run.smithi096.stdout:ERROR: (22) Invalid argument 2024-04-18T14:43:43.513 INFO:teuthology.orchestra.run.smithi096.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T14:43:43.518 INFO:tasks.ceph.osd.11.smithi134.stderr:2024-04-18T14:43:43.520+0000 7f2d36f12640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 11 (PID: 25216) UID: 0 2024-04-18T14:43:43.527 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-18T14:43:43.619 INFO:tasks.ceph.osd.15.smithi134.stderr:2024-04-18T14:43:43.620+0000 7f08e6a51640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 15 (PID: 25218) UID: 0 2024-04-18T14:43:43.642 INFO:teuthology.orchestra.run.smithi096.stdout:ERROR: (22) Invalid argument 2024-04-18T14:43:43.643 INFO:teuthology.orchestra.run.smithi096.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T14:43:43.656 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-04-18T14:43:43.720 INFO:tasks.ceph.osd.12.smithi086.stderr:2024-04-18T14:43:43.719+0000 7f6904968640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 12 (PID: 24960) UID: 0 2024-04-18T14:43:43.778 INFO:teuthology.orchestra.run.smithi096.stdout:ERROR: (22) Invalid argument 2024-04-18T14:43:43.778 INFO:teuthology.orchestra.run.smithi096.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T14:43:43.781 INFO:tasks.rados.rados.0.smithi134.stdout:110: done (5 left) 2024-04-18T14:43:43.781 INFO:tasks.rados.rados.0.smithi134.stdout:append oid 8 current snap is 8 2024-04-18T14:43:43.781 INFO:tasks.rados.rados.0.smithi134.stdout:111: seq_num 65 ranges {1130496=720896,1851392=376832} 2024-04-18T14:43:43.798 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-04-18T14:43:43.817 INFO:tasks.rados.rados.0.smithi134.stdout:111: writing smithi13430248-8 from 1130496 to 1851392 tid 1 2024-04-18T14:43:43.821 INFO:tasks.ceph.osd.6.smithi119.stderr:2024-04-18T14:43:43.822+0000 7fb7cb8bd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 24896) UID: 0 2024-04-18T14:43:43.825 INFO:tasks.rados.rados.0.smithi134.stdout:111: writing smithi13430248-8 from 1851392 to 2228224 tid 2 2024-04-18T14:43:43.825 INFO:tasks.rados.rados.0.smithi134.stdout:112: rollback oid 28 current snap is 8 2024-04-18T14:43:43.825 INFO:tasks.rados.rados.0.smithi134.stdout:rollback oid 28 to 7 2024-04-18T14:43:43.825 INFO:tasks.rados.rados.0.smithi134.stdout:106: finishing rollback tid 0 to smithi13430248-12 2024-04-18T14:43:43.825 INFO:tasks.rados.rados.0.smithi134.stdout:107: expect (ObjNum 5 snap 0 seq_num 5) 2024-04-18T14:43:43.848 INFO:tasks.rados.rados.0.smithi134.stdout:105: finishing write tid 1 to smithi13430248-39 2024-04-18T14:43:43.848 INFO:tasks.rados.rados.0.smithi134.stdout:106: finishing rollback tid 1 to smithi13430248-12 2024-04-18T14:43:43.848 INFO:tasks.rados.rados.0.smithi134.stdout:106: finishing rollback tid 2 to smithi13430248-12 2024-04-18T14:43:43.848 INFO:tasks.rados.rados.0.smithi134.stdout:update_object_version oid 12 v 32 (ObjNum 11 snap 0 seq_num 11) dirty exists 2024-04-18T14:43:43.849 INFO:tasks.rados.rados.0.smithi134.stdout:109: finishing rollback tid 1 to smithi13430248-42 2024-04-18T14:43:43.849 INFO:tasks.rados.rados.0.smithi134.stdout:update_object_version oid 42 v 8 (ObjNum 33 snap 0 seq_num 2029364568) dirty dne 2024-04-18T14:43:43.849 INFO:tasks.rados.rados.0.smithi134.stdout:105: finishing write tid 2 to smithi13430248-39 2024-04-18T14:43:43.849 INFO:tasks.rados.rados.0.smithi134.stdout:105: finishing write tid 3 to smithi13430248-39 2024-04-18T14:43:43.849 INFO:tasks.rados.rados.0.smithi134.stdout:105: finishing write tid 4 to smithi13430248-39 2024-04-18T14:43:43.849 INFO:tasks.rados.rados.0.smithi134.stdout:105: oid 39 updating version 0 to 6 2024-04-18T14:43:43.849 INFO:tasks.rados.rados.0.smithi134.stdout:105: oid 39 version 6 is already newer than 4 2024-04-18T14:43:43.849 INFO:tasks.rados.rados.0.smithi134.stdout:105: oid 39 version 6 is already newer than 5 2024-04-18T14:43:43.849 INFO:tasks.rados.rados.0.smithi134.stdout:update_object_version oid 39 v 6 (ObjNum 64 snap 8 seq_num 64) dirty exists 2024-04-18T14:43:43.849 INFO:tasks.rados.rados.0.smithi134.stdout:105: left oid 39 (ObjNum 64 snap 8 seq_num 64) 2024-04-18T14:43:43.849 INFO:tasks.rados.rados.0.smithi134.stdout:108: finishing copy_from racing read to smithi13430248-11 2024-04-18T14:43:43.849 INFO:tasks.rados.rados.0.smithi134.stdout:108: finishing copy_from to smithi13430248-11 2024-04-18T14:43:43.849 INFO:tasks.rados.rados.0.smithi134.stdout:update_object_version oid 11 v 2 (ObjNum 30 snap 0 seq_num 30) dirty exists 2024-04-18T14:43:43.849 INFO:tasks.rados.rados.0.smithi134.stdout:111: finishing write tid 1 to smithi13430248-8 2024-04-18T14:43:43.849 INFO:tasks.rados.rados.0.smithi134.stdout:111: finishing write tid 2 to smithi13430248-8 2024-04-18T14:43:43.850 INFO:tasks.rados.rados.0.smithi134.stdout:111: finishing write tid 3 to smithi13430248-8 2024-04-18T14:43:43.850 INFO:tasks.rados.rados.0.smithi134.stdout:111: finishing write tid 4 to smithi13430248-8 2024-04-18T14:43:43.850 INFO:tasks.rados.rados.0.smithi134.stdout:111: oid 8 updating version 0 to 30 2024-04-18T14:43:43.850 INFO:tasks.rados.rados.0.smithi134.stdout:111: oid 8 updating version 30 to 31 2024-04-18T14:43:43.850 INFO:tasks.rados.rados.0.smithi134.stdout:111: oid 8 updating version 31 to 32 2024-04-18T14:43:43.850 INFO:tasks.rados.rados.0.smithi134.stdout:update_object_version oid 8 v 32 (ObjNum 65 snap 8 seq_num 65) dirty exists 2024-04-18T14:43:43.850 INFO:tasks.rados.rados.0.smithi134.stdout:111: left oid 8 (ObjNum 65 snap 8 seq_num 65) 2024-04-18T14:43:43.850 INFO:tasks.rados.rados.0.smithi134.stdout:112: finishing rollback tid 0 to smithi13430248-28 2024-04-18T14:43:43.850 INFO:tasks.rados.rados.0.smithi134.stdout:112: finishing rollback tid 1 to smithi13430248-28 2024-04-18T14:43:43.850 INFO:tasks.rados.rados.0.smithi134.stdout:112: finishing rollback tid 2 to smithi13430248-28 2024-04-18T14:43:43.850 INFO:tasks.rados.rados.0.smithi134.stdout:update_object_version oid 28 v 11 (ObjNum 27 snap 0 seq_num 27) dirty exists 2024-04-18T14:43:43.850 INFO:tasks.rados.rados.0.smithi134.stdout:105: done (6 left) 2024-04-18T14:43:43.850 INFO:tasks.rados.rados.0.smithi134.stdout:106: done (5 left) 2024-04-18T14:43:43.851 INFO:tasks.rados.rados.0.smithi134.stdout:107: done (4 left) 2024-04-18T14:43:43.851 INFO:tasks.rados.rados.0.smithi134.stdout:108: done (3 left) 2024-04-18T14:43:43.851 INFO:tasks.rados.rados.0.smithi134.stdout:109: done (2 left) 2024-04-18T14:43:43.851 INFO:tasks.rados.rados.0.smithi134.stdout:111: done (1 left) 2024-04-18T14:43:43.851 INFO:tasks.rados.rados.0.smithi134.stdout:112: done (0 left) 2024-04-18T14:43:43.851 INFO:tasks.rados.rados.0.smithi134.stdout:113: rollback oid 26 current snap is 8 2024-04-18T14:43:43.851 INFO:tasks.rados.rados.0.smithi134.stdout:rollback oid 26 to 5 2024-04-18T14:43:43.851 INFO:tasks.rados.rados.0.smithi134.stdout:114: setattr oid 21 current snap is 8 2024-04-18T14:43:43.851 INFO:tasks.rados.rados.0.smithi134.stdout:115: snap_create 2024-04-18T14:43:43.856 INFO:tasks.rados.rados.0.smithi134.stdout:113: finishing rollback tid 0 to smithi13430248-26 2024-04-18T14:43:43.858 INFO:tasks.rados.rados.0.smithi134.stdout:update_object_version oid 21 v 30 (ObjNum 20 snap 0 seq_num 20) dirty exists 2024-04-18T14:43:43.859 INFO:tasks.rados.rados.0.smithi134.stdout:113: finishing rollback tid 1 to smithi13430248-26 2024-04-18T14:43:43.861 INFO:tasks.rados.rados.0.smithi134.stdout:113: finishing rollback tid 2 to smithi13430248-26 2024-04-18T14:43:43.861 INFO:tasks.rados.rados.0.smithi134.stdout:update_object_version oid 26 v 12 (ObjNum 5 snap 0 seq_num 5) dirty exists 2024-04-18T14:43:43.922 INFO:tasks.ceph.osd.14.smithi119.stderr:2024-04-18T14:43:43.926+0000 7f180f599640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 14 (PID: 24900) UID: 0 2024-04-18T14:43:43.926 INFO:teuthology.orchestra.run.smithi096.stdout:ERROR: (22) Invalid argument 2024-04-18T14:43:43.926 INFO:teuthology.orchestra.run.smithi096.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T14:43:43.940 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-04-18T14:43:44.023 INFO:tasks.ceph.osd.8.smithi086.stderr:2024-04-18T14:43:44.023+0000 7f29f7b9d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 8 (PID: 24958) UID: 0 2024-04-18T14:43:44.064 INFO:teuthology.orchestra.run.smithi096.stdout:ERROR: (22) Invalid argument 2024-04-18T14:43:44.064 INFO:teuthology.orchestra.run.smithi096.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T14:43:44.068 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-18T14:43:44.079 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.9.asok dump_ops_in_flight 2024-04-18T14:43:44.123 INFO:tasks.ceph.osd.2.smithi119.stderr:2024-04-18T14:43:44.122+0000 7fcbd30c0640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 24894) UID: 0 2024-04-18T14:43:44.202 INFO:teuthology.orchestra.run.smithi096.stdout:ERROR: (22) Invalid argument 2024-04-18T14:43:44.202 INFO:teuthology.orchestra.run.smithi096.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T14:43:44.216 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.9.asok dump_blocked_ops 2024-04-18T14:43:44.221 INFO:teuthology.orchestra.run.smithi086.stdout:osd.0: {} 2024-04-18T14:43:44.221 INFO:teuthology.orchestra.run.smithi086.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-18T14:43:44.224 INFO:tasks.ceph.osd.12.smithi086.stderr:2024-04-18T14:43:44.223+0000 7f6904968640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 12 (PID: 24960) UID: 0 2024-04-18T14:43:44.240 INFO:teuthology.orchestra.run.smithi086.stdout:osd.1: {} 2024-04-18T14:43:44.240 INFO:teuthology.orchestra.run.smithi086.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-18T14:43:44.260 INFO:teuthology.orchestra.run.smithi086.stdout:osd.2: {} 2024-04-18T14:43:44.260 INFO:teuthology.orchestra.run.smithi086.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-18T14:43:44.281 INFO:teuthology.orchestra.run.smithi086.stdout:osd.3: {} 2024-04-18T14:43:44.281 INFO:teuthology.orchestra.run.smithi086.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-18T14:43:44.298 INFO:teuthology.orchestra.run.smithi086.stdout:osd.4: {} 2024-04-18T14:43:44.298 INFO:teuthology.orchestra.run.smithi086.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-18T14:43:44.316 INFO:teuthology.orchestra.run.smithi086.stdout:osd.5: {} 2024-04-18T14:43:44.316 INFO:teuthology.orchestra.run.smithi086.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-18T14:43:44.326 INFO:tasks.ceph.osd.6.smithi119.stderr:2024-04-18T14:43:44.326+0000 7fb7cb8bd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 24896) UID: 0 2024-04-18T14:43:44.336 INFO:teuthology.orchestra.run.smithi086.stdout:osd.6: {} 2024-04-18T14:43:44.336 INFO:teuthology.orchestra.run.smithi086.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-18T14:43:44.340 INFO:teuthology.orchestra.run.smithi096.stdout:ERROR: (22) Invalid argument 2024-04-18T14:43:44.340 INFO:teuthology.orchestra.run.smithi096.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T14:43:44.354 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.9.asok dump_historic_ops 2024-04-18T14:43:44.356 INFO:teuthology.orchestra.run.smithi086.stdout:osd.7: {} 2024-04-18T14:43:44.356 INFO:teuthology.orchestra.run.smithi086.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-18T14:43:44.368 INFO:tasks.rados.rados.0.smithi134.stdout:113: done (2 left) 2024-04-18T14:43:44.368 INFO:tasks.rados.rados.0.smithi134.stdout:114: done (1 left) 2024-04-18T14:43:44.368 INFO:tasks.rados.rados.0.smithi134.stdout:115: done (0 left) 2024-04-18T14:43:44.368 INFO:tasks.rados.rados.0.smithi134.stdout:116: rollback oid 22 current snap is 9 2024-04-18T14:43:44.368 INFO:tasks.rados.rados.0.smithi134.stdout:rollback oid 22 to 5 2024-04-18T14:43:44.368 INFO:tasks.rados.rados.0.smithi134.stdout:117: read oid 19 snap 0 2024-04-18T14:43:44.368 INFO:tasks.rados.rados.0.smithi134.stdout:117: expect (ObjNum 18 snap 0 seq_num 18) 2024-04-18T14:43:44.368 INFO:tasks.rados.rados.0.smithi134.stdout:118: read oid 15 snap -1 2024-04-18T14:43:44.369 INFO:tasks.rados.rados.0.smithi134.stdout:118: expect (ObjNum 35 snap 0 seq_num 35) 2024-04-18T14:43:44.369 INFO:tasks.rados.rados.0.smithi134.stdout:append oid 12 current snap is 9 2024-04-18T14:43:44.369 INFO:tasks.rados.rados.0.smithi134.stdout:119: seq_num 66 ranges {196608=737280,933888=376832} 2024-04-18T14:43:44.375 INFO:teuthology.orchestra.run.smithi086.stdout:osd.8: {} 2024-04-18T14:43:44.375 INFO:teuthology.orchestra.run.smithi086.stderr:osd.8: osd_enable_op_tracker = '' 2024-04-18T14:43:44.387 INFO:tasks.rados.rados.0.smithi134.stdout:119: writing smithi13430248-12 from 196608 to 933888 tid 1 2024-04-18T14:43:44.395 INFO:tasks.rados.rados.0.smithi134.stdout:119: writing smithi13430248-12 from 933888 to 1310720 tid 2 2024-04-18T14:43:44.395 INFO:tasks.rados.rados.0.smithi134.stdout:120: rmattr oid 10 current snap is 9 2024-04-18T14:43:44.395 INFO:tasks.rados.rados.0.smithi134.stdout:117: expect (ObjNum 18 snap 0 seq_num 18) 2024-04-18T14:43:44.396 INFO:teuthology.orchestra.run.smithi086.stdout:osd.9: {} 2024-04-18T14:43:44.396 INFO:teuthology.orchestra.run.smithi086.stderr:osd.9: osd_enable_op_tracker = '' 2024-04-18T14:43:44.419 INFO:teuthology.orchestra.run.smithi086.stdout:osd.10: {} 2024-04-18T14:43:44.419 INFO:teuthology.orchestra.run.smithi086.stderr:osd.10: osd_enable_op_tracker = '' 2024-04-18T14:43:44.421 INFO:tasks.rados.rados.0.smithi134.stdout:116: finishing rollback tid 0 to smithi13430248-22 2024-04-18T14:43:44.421 INFO:tasks.rados.rados.0.smithi134.stdout:117: done (4 left) 2024-04-18T14:43:44.421 INFO:tasks.rados.rados.0.smithi134.stdout:121: rollback oid 35 current snap is 9 2024-04-18T14:43:44.421 INFO:tasks.rados.rados.0.smithi134.stdout:rollback oid 35 to 6 2024-04-18T14:43:44.421 INFO:tasks.rados.rados.0.smithi134.stdout:122: read oid 21 snap -1 2024-04-18T14:43:44.421 INFO:tasks.rados.rados.0.smithi134.stdout:122: expect (ObjNum 20 snap 0 seq_num 20) 2024-04-18T14:43:44.422 INFO:tasks.rados.rados.0.smithi134.stdout:123: delete oid 39 current snap is 9 2024-04-18T14:43:44.422 INFO:tasks.rados.rados.0.smithi134.stdout:116: finishing rollback tid 1 to smithi13430248-22 2024-04-18T14:43:44.422 INFO:tasks.rados.rados.0.smithi134.stdout:116: finishing rollback tid 2 to smithi13430248-22 2024-04-18T14:43:44.422 INFO:tasks.rados.rados.0.smithi134.stdout:update_object_version oid 22 v 13 (ObjNum 21 snap 0 seq_num 21) dirty exists 2024-04-18T14:43:44.422 INFO:tasks.rados.rados.0.smithi134.stdout:118: expect (ObjNum 35 snap 0 seq_num 35) 2024-04-18T14:43:44.426 INFO:tasks.ceph.osd.1.smithi096.stderr:2024-04-18T14:43:44.427+0000 7f56a7a98640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 24887) UID: 0 2024-04-18T14:43:44.441 INFO:teuthology.orchestra.run.smithi086.stdout:osd.11: {} 2024-04-18T14:43:44.441 INFO:teuthology.orchestra.run.smithi086.stderr:osd.11: osd_enable_op_tracker = '' 2024-04-18T14:43:44.457 INFO:teuthology.orchestra.run.smithi086.stdout:osd.12: {} 2024-04-18T14:43:44.458 INFO:teuthology.orchestra.run.smithi086.stderr:osd.12: osd_enable_op_tracker = '' 2024-04-18T14:43:44.465 INFO:tasks.rados.rados.0.smithi134.stdout:update_object_version oid 10 v 0 (ObjNum 58 snap 4 seq_num 58) dirty exists 2024-04-18T14:43:44.465 INFO:tasks.rados.rados.0.smithi134.stdout:119: finishing write tid 1 to smithi13430248-12 2024-04-18T14:43:44.465 INFO:tasks.rados.rados.0.smithi134.stdout:119: finishing write tid 2 to smithi13430248-12 2024-04-18T14:43:44.466 INFO:tasks.rados.rados.0.smithi134.stdout:119: finishing write tid 3 to smithi13430248-12 2024-04-18T14:43:44.466 INFO:tasks.rados.rados.0.smithi134.stdout:119: finishing write tid 4 to smithi13430248-12 2024-04-18T14:43:44.466 INFO:tasks.rados.rados.0.smithi134.stdout:119: oid 12 updating version 0 to 42 2024-04-18T14:43:44.466 INFO:tasks.rados.rados.0.smithi134.stdout:119: oid 12 version 42 is already newer than 40 2024-04-18T14:43:44.466 INFO:tasks.rados.rados.0.smithi134.stdout:119: oid 12 version 42 is already newer than 41 2024-04-18T14:43:44.466 INFO:tasks.rados.rados.0.smithi134.stdout:update_object_version oid 12 v 42 (ObjNum 66 snap 9 seq_num 66) dirty exists 2024-04-18T14:43:44.466 INFO:tasks.rados.rados.0.smithi134.stdout:119: left oid 12 (ObjNum 66 snap 9 seq_num 66) 2024-04-18T14:43:44.466 INFO:tasks.rados.rados.0.smithi134.stdout:121: finishing rollback tid 0 to smithi13430248-35 2024-04-18T14:43:44.466 INFO:tasks.rados.rados.0.smithi134.stdout:116: done (6 left) 2024-04-18T14:43:44.466 INFO:tasks.rados.rados.0.smithi134.stdout:118: done (5 left) 2024-04-18T14:43:44.466 INFO:tasks.rados.rados.0.smithi134.stdout:119: done (4 left) 2024-04-18T14:43:44.466 INFO:tasks.rados.rados.0.smithi134.stdout:120: done (3 left) 2024-04-18T14:43:44.467 INFO:tasks.rados.rados.0.smithi134.stdout:123: done (2 left) 2024-04-18T14:43:44.467 INFO:tasks.rados.rados.0.smithi134.stdout:124: rollback oid 36 current snap is 9 2024-04-18T14:43:44.467 INFO:tasks.rados.rados.0.smithi134.stdout:rollback oid 36 to 5 2024-04-18T14:43:44.467 INFO:tasks.rados.rados.0.smithi134.stdout:121: finishing rollback tid 1 to smithi13430248-35 2024-04-18T14:43:44.467 INFO:tasks.rados.rados.0.smithi134.stdout:121: finishing rollback tid 2 to smithi13430248-35 2024-04-18T14:43:44.467 INFO:tasks.rados.rados.0.smithi134.stdout:update_object_version oid 35 v 36 (ObjNum 34 snap 0 seq_num 34) dirty exists 2024-04-18T14:43:44.467 INFO:tasks.rados.rados.0.smithi134.stdout:122: expect (ObjNum 20 snap 0 seq_num 20) 2024-04-18T14:43:44.479 INFO:teuthology.orchestra.run.smithi086.stdout:osd.13: {} 2024-04-18T14:43:44.479 INFO:teuthology.orchestra.run.smithi086.stderr:osd.13: osd_enable_op_tracker = '' 2024-04-18T14:43:44.482 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2024-04-18T14:43:44.482 INFO:teuthology.orchestra.run.smithi096.stdout: "size": 20, 2024-04-18T14:43:44.482 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 600, 2024-04-18T14:43:44.482 INFO:teuthology.orchestra.run.smithi096.stdout: "ops": [ 2024-04-18T14:43:44.482 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:44.482 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "MOSDECSubOpWrite(3.as3 35/30 ECSubWrite(tid=16, reqid=client.4559.0:176, at_version=35'10, trim_to=0'0, roll_forward_to=33'8))", 2024-04-18T14:43:44.482 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-04-18T14:43:34.719444+0000", 2024-04-18T14:43:44.482 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 9.7642759189999992, 2024-04-18T14:43:44.482 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.001980931, 2024-04-18T14:43:44.483 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-04-18T14:43:44.483 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "reached pg", 2024-04-18T14:43:44.483 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-04-18T14:43:44.483 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:44.483 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-04-18T14:43:44.483 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:34.719444+0000", 2024-04-18T14:43:44.483 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:43:44.483 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:44.483 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:44.483 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-04-18T14:43:44.483 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:34.719444+0000", 2024-04-18T14:43:44.483 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:43:44.483 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:44.483 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:44.484 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-04-18T14:43:44.484 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:34.719443+0000", 2024-04-18T14:43:44.484 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 4294967295.999999 2024-04-18T14:43:44.484 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:44.484 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:44.484 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-04-18T14:43:44.484 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:34.719504+0000", 2024-04-18T14:43:44.484 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 6.0559000000000001e-05 2024-04-18T14:43:44.484 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:44.484 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:44.484 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-04-18T14:43:44.484 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:34.719537+0000", 2024-04-18T14:43:44.484 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.3429000000000001e-05 2024-04-18T14:43:44.484 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:44.484 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:44.484 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-04-18T14:43:44.485 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:34.719566+0000", 2024-04-18T14:43:44.485 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.8904999999999999e-05 2024-04-18T14:43:44.485 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:44.485 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:44.485 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-04-18T14:43:44.485 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:34.719669+0000", 2024-04-18T14:43:44.485 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000102837 2024-04-18T14:43:44.485 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:44.485 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:44.485 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_started", 2024-04-18T14:43:44.485 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:34.719687+0000", 2024-04-18T14:43:44.485 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.8133000000000001e-05 2024-04-18T14:43:44.485 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:44.486 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:44.486 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_committed", 2024-04-18T14:43:44.486 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:34.721366+0000", 2024-04-18T14:43:44.486 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.001678208 2024-04-18T14:43:44.486 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:44.486 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:44.486 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-04-18T14:43:44.486 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:34.721425+0000", 2024-04-18T14:43:44.486 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 5.9636000000000003e-05 2024-04-18T14:43:44.486 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:43:44.486 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T14:43:44.486 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:43:44.486 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:44.486 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:44.487 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "MOSDECSubOpWrite(3.as3 35/30 ECSubWrite(tid=17, reqid=client.4559.0:176, at_version=0'0, trim_to=0'0, roll_forward_to=35'10))", 2024-04-18T14:43:44.487 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-04-18T14:43:34.727119+0000", 2024-04-18T14:43:44.487 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 9.7566014750000001, 2024-04-18T14:43:44.487 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.001465056, 2024-04-18T14:43:44.488 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-04-18T14:43:44.488 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "reached pg", 2024-04-18T14:43:44.488 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-04-18T14:43:44.488 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:44.488 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-04-18T14:43:44.488 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:34.727119+0000", 2024-04-18T14:43:44.488 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:43:44.488 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:44.488 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:44.488 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-04-18T14:43:44.488 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:34.727119+0000", 2024-04-18T14:43:44.488 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:43:44.488 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:44.489 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:44.489 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-04-18T14:43:44.489 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:34.727117+0000", 2024-04-18T14:43:44.489 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 4294967295.9999981 2024-04-18T14:43:44.489 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:44.489 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:44.489 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-04-18T14:43:44.489 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:34.727140+0000", 2024-04-18T14:43:44.489 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.3164999999999999e-05 2024-04-18T14:43:44.489 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:44.489 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:44.489 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-04-18T14:43:44.489 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:34.727170+0000", 2024-04-18T14:43:44.489 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.0032e-05 2024-04-18T14:43:44.490 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:44.490 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:44.490 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-04-18T14:43:44.490 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:34.727203+0000", 2024-04-18T14:43:44.490 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.2400999999999997e-05 2024-04-18T14:43:44.490 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:44.490 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:44.490 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-04-18T14:43:44.490 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:34.727324+0000", 2024-04-18T14:43:44.490 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000120994 2024-04-18T14:43:44.490 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:44.490 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:44.490 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_started", 2024-04-18T14:43:44.490 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:34.727351+0000", 2024-04-18T14:43:44.491 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.7847999999999998e-05 2024-04-18T14:43:44.491 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:44.491 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:44.491 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_committed", 2024-04-18T14:43:44.491 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:34.728544+0000", 2024-04-18T14:43:44.491 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.001192432 2024-04-18T14:43:44.491 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:44.491 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:44.491 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-04-18T14:43:44.491 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:34.728584+0000", 2024-04-18T14:43:44.491 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.9934000000000001e-05 2024-04-18T14:43:44.491 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:43:44.491 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T14:43:44.492 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:43:44.492 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:44.492 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:44.492 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "MOSDECSubOpWrite(3.as3 36/30 ECSubWrite(tid=18, reqid=client.4559.0:178, at_version=36'12, trim_to=0'0, roll_forward_to=35'10))", 2024-04-18T14:43:44.492 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-04-18T14:43:35.737991+0000", 2024-04-18T14:43:44.492 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 8.7457295300000002, 2024-04-18T14:43:44.492 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0022125930000000001, 2024-04-18T14:43:44.492 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-04-18T14:43:44.492 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "reached pg", 2024-04-18T14:43:44.492 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-04-18T14:43:44.492 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:44.492 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-04-18T14:43:44.492 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:35.737991+0000", 2024-04-18T14:43:44.492 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:43:44.493 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:44.493 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:44.493 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-04-18T14:43:44.493 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:35.737991+0000", 2024-04-18T14:43:44.493 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:43:44.493 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:44.493 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:44.493 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-04-18T14:43:44.493 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:35.737990+0000", 2024-04-18T14:43:44.493 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 4294967295.9999995 2024-04-18T14:43:44.493 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:44.493 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:44.493 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-04-18T14:43:44.493 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:35.738352+0000", 2024-04-18T14:43:44.494 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00036129400000000001 2024-04-18T14:43:44.494 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:44.494 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:44.494 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-04-18T14:43:44.494 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:35.738380+0000", 2024-04-18T14:43:44.494 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.7971e-05 2024-04-18T14:43:44.494 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:44.494 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:44.494 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-04-18T14:43:44.494 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:35.738396+0000", 2024-04-18T14:43:44.494 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.5988999999999999e-05 2024-04-18T14:43:44.494 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:44.494 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:44.494 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-04-18T14:43:44.494 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:35.738470+0000", 2024-04-18T14:43:44.495 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 7.4394000000000006e-05 2024-04-18T14:43:44.495 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:44.495 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:44.495 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_started", 2024-04-18T14:43:44.495 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:35.738483+0000", 2024-04-18T14:43:44.495 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.3447e-05 2024-04-18T14:43:44.495 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:44.495 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:44.495 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_committed", 2024-04-18T14:43:44.495 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:35.740181+0000", 2024-04-18T14:43:44.495 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0016976890000000001 2024-04-18T14:43:44.495 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:44.495 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:44.495 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-04-18T14:43:44.496 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:35.740203+0000", 2024-04-18T14:43:44.496 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.2161999999999999e-05 2024-04-18T14:43:44.496 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:43:44.496 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T14:43:44.496 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:43:44.496 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:44.496 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:44.496 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "MOSDECSubOpWrite(3.as3 36/30 ECSubWrite(tid=21, reqid=client.4559.0:180, at_version=0'0, trim_to=0'0, roll_forward_to=36'14))", 2024-04-18T14:43:44.496 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-04-18T14:43:35.748986+0000", 2024-04-18T14:43:44.496 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 8.7347338640000007, 2024-04-18T14:43:44.496 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.001167579, 2024-04-18T14:43:44.496 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-04-18T14:43:44.496 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "reached pg", 2024-04-18T14:43:44.496 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-04-18T14:43:44.497 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:44.497 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-04-18T14:43:44.497 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:35.748986+0000", 2024-04-18T14:43:44.497 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:43:44.497 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:44.497 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:44.497 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-04-18T14:43:44.497 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:35.748986+0000", 2024-04-18T14:43:44.497 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:43:44.497 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:44.497 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:44.497 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-04-18T14:43:44.497 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:35.748985+0000", 2024-04-18T14:43:44.497 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 4294967295.999999 2024-04-18T14:43:44.498 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:44.498 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:44.498 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-04-18T14:43:44.498 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:35.749001+0000", 2024-04-18T14:43:44.498 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.5681000000000001e-05 2024-04-18T14:43:44.498 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:44.498 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:44.498 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-04-18T14:43:44.498 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:35.749025+0000", 2024-04-18T14:43:44.498 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.4261999999999999e-05 2024-04-18T14:43:44.498 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:44.499 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:44.499 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-04-18T14:43:44.499 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:35.749038+0000", 2024-04-18T14:43:44.499 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.258e-05 2024-04-18T14:43:44.499 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:44.499 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:44.499 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-04-18T14:43:44.499 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:35.749152+0000", 2024-04-18T14:43:44.499 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000113891 2024-04-18T14:43:44.499 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:44.499 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:44.499 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_started", 2024-04-18T14:43:44.499 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:35.749176+0000", 2024-04-18T14:43:44.500 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.4465999999999999e-05 2024-04-18T14:43:44.500 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:44.500 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:44.500 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_committed", 2024-04-18T14:43:44.500 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:35.750126+0000", 2024-04-18T14:43:44.500 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00095033900000000002 2024-04-18T14:43:44.500 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:44.500 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:44.500 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-04-18T14:43:44.500 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:35.750154+0000", 2024-04-18T14:43:44.500 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.7379999999999999e-05 2024-04-18T14:43:44.500 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:43:44.500 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T14:43:44.500 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:43:44.501 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:44.501 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:44.501 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "MOSDECSubOpWrite(3.bs3 37/30 ECSubWrite(tid=16, reqid=client.4559.0:185, at_version=37'8, trim_to=0'0, roll_forward_to=33'6))", 2024-04-18T14:43:44.501 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-04-18T14:43:36.726068+0000", 2024-04-18T14:43:44.501 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 7.7576520090000001, 2024-04-18T14:43:44.501 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0015823670000000001, 2024-04-18T14:43:44.501 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-04-18T14:43:44.501 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "reached pg", 2024-04-18T14:43:44.501 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-04-18T14:43:44.501 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:44.501 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-04-18T14:43:44.501 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:36.726068+0000", 2024-04-18T14:43:44.501 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:43:44.501 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:44.501 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:44.502 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-04-18T14:43:44.502 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:36.726068+0000", 2024-04-18T14:43:44.502 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:43:44.502 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:44.502 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:44.502 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-04-18T14:43:44.502 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:36.726068+0000", 2024-04-18T14:43:44.502 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 4294967295.9999995 2024-04-18T14:43:44.502 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:44.502 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:44.502 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-04-18T14:43:44.502 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:36.726113+0000", 2024-04-18T14:43:44.502 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 4.5602999999999997e-05 2024-04-18T14:43:44.502 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:44.503 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:44.503 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-04-18T14:43:44.503 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:36.726127+0000", 2024-04-18T14:43:44.503 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.4114000000000001e-05 2024-04-18T14:43:44.503 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:44.503 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:44.503 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-04-18T14:43:44.503 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:36.726142+0000", 2024-04-18T14:43:44.503 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.5098e-05 2024-04-18T14:43:44.503 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:44.503 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:44.503 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-04-18T14:43:44.503 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:36.726199+0000", 2024-04-18T14:43:44.504 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 5.6592000000000003e-05 2024-04-18T14:43:44.504 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:44.504 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:44.504 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_started", 2024-04-18T14:43:44.504 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:36.726209+0000", 2024-04-18T14:43:44.504 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 9.4970000000000007e-06 2024-04-18T14:43:44.504 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:44.504 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:44.504 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_committed", 2024-04-18T14:43:44.504 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:36.727620+0000", 2024-04-18T14:43:44.504 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.001411352 2024-04-18T14:43:44.504 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:44.504 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:44.504 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-04-18T14:43:44.504 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:36.727651+0000", 2024-04-18T14:43:44.505 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.0626999999999997e-05 2024-04-18T14:43:44.505 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:43:44.505 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T14:43:44.505 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:43:44.505 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:44.505 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:44.505 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "MOSDECSubOpWrite(3.7s2 37/30 ECSubWrite(tid=35, reqid=client.4559.0:183, at_version=37'11, trim_to=0'0, roll_forward_to=33'9))", 2024-04-18T14:43:44.505 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-04-18T14:43:36.748095+0000", 2024-04-18T14:43:44.505 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 7.7356254040000003, 2024-04-18T14:43:44.505 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.001760033, 2024-04-18T14:43:44.505 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-04-18T14:43:44.505 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "reached pg", 2024-04-18T14:43:44.505 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-04-18T14:43:44.505 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:44.505 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-04-18T14:43:44.506 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:36.748095+0000", 2024-04-18T14:43:44.506 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:43:44.506 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:44.506 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:44.506 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-04-18T14:43:44.506 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:36.748095+0000", 2024-04-18T14:43:44.506 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:43:44.506 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:44.506 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:44.506 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-04-18T14:43:44.506 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:36.748094+0000", 2024-04-18T14:43:44.506 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 4294967295.9999995 2024-04-18T14:43:44.506 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:44.507 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:44.507 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-04-18T14:43:44.507 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:36.748576+0000", 2024-04-18T14:43:44.507 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00048122900000000001 2024-04-18T14:43:44.507 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:44.507 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:44.507 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-04-18T14:43:44.507 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:36.748591+0000", 2024-04-18T14:43:44.507 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.5398000000000001e-05 2024-04-18T14:43:44.507 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:44.507 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:44.507 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-04-18T14:43:44.507 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:36.748603+0000", 2024-04-18T14:43:44.508 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.2078e-05 2024-04-18T14:43:44.508 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:44.508 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:44.508 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-04-18T14:43:44.508 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:36.748669+0000", 2024-04-18T14:43:44.508 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 6.5759000000000005e-05 2024-04-18T14:43:44.508 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:44.508 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:44.508 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_started", 2024-04-18T14:43:44.508 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:36.748679+0000", 2024-04-18T14:43:44.508 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.0241000000000001e-05 2024-04-18T14:43:44.508 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:44.508 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:44.508 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_committed", 2024-04-18T14:43:44.508 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:36.749822+0000", 2024-04-18T14:43:44.508 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0011429140000000001 2024-04-18T14:43:44.509 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:44.509 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:44.509 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-04-18T14:43:44.509 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:36.749855+0000", 2024-04-18T14:43:44.509 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.2780999999999997e-05 2024-04-18T14:43:44.509 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:43:44.509 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T14:43:44.509 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:43:44.509 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:44.509 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:44.509 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "MOSDECSubOpWrite(3.1s2 37/30 ECSubWrite(tid=18, reqid=client.4559.0:186, at_version=37'12, trim_to=0'0, roll_forward_to=33'10))", 2024-04-18T14:43:44.509 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-04-18T14:43:36.760051+0000", 2024-04-18T14:43:44.510 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 7.7236693939999999, 2024-04-18T14:43:44.510 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0021448830000000002, 2024-04-18T14:43:44.510 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-04-18T14:43:44.510 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "reached pg", 2024-04-18T14:43:44.510 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-04-18T14:43:44.510 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:44.510 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-04-18T14:43:44.510 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:36.760051+0000", 2024-04-18T14:43:44.510 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:43:44.510 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:44.510 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:44.510 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-04-18T14:43:44.511 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:36.760051+0000", 2024-04-18T14:43:44.511 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:43:44.511 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:44.511 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:44.511 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-04-18T14:43:44.511 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:36.760050+0000", 2024-04-18T14:43:44.511 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 4294967295.9999995 2024-04-18T14:43:44.511 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:44.511 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:44.511 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-04-18T14:43:44.511 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:36.760726+0000", 2024-04-18T14:43:44.511 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00067511800000000005 2024-04-18T14:43:44.511 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:44.511 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:44.512 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-04-18T14:43:44.512 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:36.760741+0000", 2024-04-18T14:43:44.512 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.5764999999999999e-05 2024-04-18T14:43:44.512 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:44.512 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:44.512 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-04-18T14:43:44.512 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:36.760750+0000", 2024-04-18T14:43:44.512 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 8.2670000000000006e-06 2024-04-18T14:43:44.512 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:44.512 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:44.512 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-04-18T14:43:44.512 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:36.760815+0000", 2024-04-18T14:43:44.513 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 6.5833000000000005e-05 2024-04-18T14:43:44.513 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:44.513 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:44.513 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_started", 2024-04-18T14:43:44.513 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:36.760827+0000", 2024-04-18T14:43:44.513 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.1849e-05 2024-04-18T14:43:44.513 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:44.513 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:44.513 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_committed", 2024-04-18T14:43:44.513 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:36.762161+0000", 2024-04-18T14:43:44.513 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0013340730000000001 2024-04-18T14:43:44.513 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:44.513 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:44.514 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-04-18T14:43:44.514 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:36.762196+0000", 2024-04-18T14:43:44.514 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.4255999999999999e-05 2024-04-18T14:43:44.514 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:43:44.514 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T14:43:44.514 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:43:44.514 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:44.514 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:44.514 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "MOSDECSubOpWrite(3.1s2 37/30 ECSubWrite(tid=19, reqid=client.4559.0:187, at_version=37'13, trim_to=0'0, roll_forward_to=33'10))", 2024-04-18T14:43:44.514 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-04-18T14:43:36.762821+0000", 2024-04-18T14:43:44.514 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 7.7208988959999996, 2024-04-18T14:43:44.514 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.001711862, 2024-04-18T14:43:44.514 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-04-18T14:43:44.515 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "reached pg", 2024-04-18T14:43:44.515 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-04-18T14:43:44.515 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:44.515 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-04-18T14:43:44.515 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:36.762821+0000", 2024-04-18T14:43:44.515 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:43:44.515 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:44.515 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:44.515 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-04-18T14:43:44.515 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:36.762821+0000", 2024-04-18T14:43:44.515 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:43:44.515 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:44.515 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:44.516 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-04-18T14:43:44.516 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:36.762820+0000", 2024-04-18T14:43:44.516 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 4294967295.999999 2024-04-18T14:43:44.516 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:44.516 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:44.516 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-04-18T14:43:44.516 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:36.762933+0000", 2024-04-18T14:43:44.516 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00011226 2024-04-18T14:43:44.516 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:44.516 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:44.516 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-04-18T14:43:44.516 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:36.762952+0000", 2024-04-18T14:43:44.517 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.9752e-05 2024-04-18T14:43:44.517 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:44.517 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:44.517 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-04-18T14:43:44.517 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:36.762963+0000", 2024-04-18T14:43:44.517 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.0822000000000001e-05 2024-04-18T14:43:44.517 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:44.517 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:44.517 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-04-18T14:43:44.517 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:36.763024+0000", 2024-04-18T14:43:44.517 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 6.0615000000000002e-05 2024-04-18T14:43:44.517 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:44.517 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:44.518 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_started", 2024-04-18T14:43:44.518 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:36.763032+0000", 2024-04-18T14:43:44.518 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 7.7999999999999999e-06 2024-04-18T14:43:44.518 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:44.518 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:44.518 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_committed", 2024-04-18T14:43:44.518 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:36.764508+0000", 2024-04-18T14:43:44.518 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0014759389999999999 2024-04-18T14:43:44.518 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:44.518 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:44.518 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-04-18T14:43:44.518 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:36.764533+0000", 2024-04-18T14:43:44.519 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.5598000000000001e-05 2024-04-18T14:43:44.519 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:43:44.519 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T14:43:44.519 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:43:44.519 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:44.519 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:44.519 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "MOSDECSubOpWrite(3.as3 37/30 ECSubWrite(tid=23, reqid=client.4559.0:190, at_version=37'16, trim_to=0'0, roll_forward_to=36'14))", 2024-04-18T14:43:44.519 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-04-18T14:43:36.766473+0000", 2024-04-18T14:43:44.519 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 7.7172470149999999, 2024-04-18T14:43:44.519 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00093055899999999997, 2024-04-18T14:43:44.519 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-04-18T14:43:44.519 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "reached pg", 2024-04-18T14:43:44.519 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-04-18T14:43:44.519 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:44.519 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-04-18T14:43:44.520 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:36.766473+0000", 2024-04-18T14:43:44.520 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:43:44.520 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:44.520 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:44.520 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-04-18T14:43:44.520 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:36.766473+0000", 2024-04-18T14:43:44.520 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:43:44.520 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:44.520 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:44.520 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-04-18T14:43:44.520 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:36.766473+0000", 2024-04-18T14:43:44.521 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 4294967295.9999995 2024-04-18T14:43:44.521 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:44.521 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:44.521 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-04-18T14:43:44.521 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:36.766494+0000", 2024-04-18T14:43:44.521 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.0713e-05 2024-04-18T14:43:44.521 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:44.521 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:44.521 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-04-18T14:43:44.521 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:36.766505+0000", 2024-04-18T14:43:44.521 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.1364e-05 2024-04-18T14:43:44.521 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:44.521 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:44.522 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-04-18T14:43:44.522 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:36.766513+0000", 2024-04-18T14:43:44.522 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 8.2749999999999995e-06 2024-04-18T14:43:44.522 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:44.522 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:44.522 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-04-18T14:43:44.522 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:36.766572+0000", 2024-04-18T14:43:44.522 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 5.9178000000000002e-05 2024-04-18T14:43:44.522 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:44.522 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:44.522 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_started", 2024-04-18T14:43:44.522 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:36.766579+0000", 2024-04-18T14:43:44.522 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 6.99e-06 2024-04-18T14:43:44.522 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:44.523 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:44.523 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_committed", 2024-04-18T14:43:44.523 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:36.767359+0000", 2024-04-18T14:43:44.523 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00077919899999999995 2024-04-18T14:43:44.523 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:44.523 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:44.523 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-04-18T14:43:44.523 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:36.767404+0000", 2024-04-18T14:43:44.523 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 4.5157000000000002e-05 2024-04-18T14:43:44.523 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:43:44.523 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T14:43:44.523 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:43:44.523 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:44.523 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:44.523 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "MOSDECSubOpWrite(3.6s6 37/30 ECSubWrite(tid=37, reqid=client.4559.0:201, at_version=37'10, trim_to=0'0, roll_forward_to=33'8))", 2024-04-18T14:43:44.524 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-04-18T14:43:36.779695+0000", 2024-04-18T14:43:44.524 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 7.7040249530000002, 2024-04-18T14:43:44.524 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.001320426, 2024-04-18T14:43:44.524 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-04-18T14:43:44.524 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "reached pg", 2024-04-18T14:43:44.524 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-04-18T14:43:44.524 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:44.524 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-04-18T14:43:44.524 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:36.779695+0000", 2024-04-18T14:43:44.524 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:43:44.524 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:44.524 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:44.524 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-04-18T14:43:44.524 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:36.779695+0000", 2024-04-18T14:43:44.525 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:43:44.525 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:44.525 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:44.525 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-04-18T14:43:44.525 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:36.779694+0000", 2024-04-18T14:43:44.525 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 4294967295.999999 2024-04-18T14:43:44.525 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:44.525 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:44.525 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-04-18T14:43:44.525 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:36.779733+0000", 2024-04-18T14:43:44.525 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.8581000000000002e-05 2024-04-18T14:43:44.525 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:44.525 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:44.525 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-04-18T14:43:44.525 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:36.779747+0000", 2024-04-18T14:43:44.526 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.3893000000000001e-05 2024-04-18T14:43:44.526 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:44.526 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:44.526 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-04-18T14:43:44.526 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:36.779758+0000", 2024-04-18T14:43:44.526 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.0847e-05 2024-04-18T14:43:44.526 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:44.526 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:44.526 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-04-18T14:43:44.526 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:36.779820+0000", 2024-04-18T14:43:44.526 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 6.2624000000000002e-05 2024-04-18T14:43:44.526 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:44.526 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:44.527 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_started", 2024-04-18T14:43:44.527 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:36.779833+0000", 2024-04-18T14:43:44.527 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.2395000000000001e-05 2024-04-18T14:43:44.527 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:44.527 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:44.527 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_committed", 2024-04-18T14:43:44.527 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:36.780965+0000", 2024-04-18T14:43:44.527 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0011319170000000001 2024-04-18T14:43:44.527 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:44.527 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:44.527 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-04-18T14:43:44.527 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:36.781016+0000", 2024-04-18T14:43:44.528 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 5.0943999999999999e-05 2024-04-18T14:43:44.528 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:43:44.528 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T14:43:44.528 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:43:44.528 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:44.528 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:44.528 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "MOSDECSubOpWrite(3.6s6 37/30 ECSubWrite(tid=38, reqid=client.4559.0:201, at_version=0'0, trim_to=0'0, roll_forward_to=37'10))", 2024-04-18T14:43:44.528 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-04-18T14:43:36.785006+0000", 2024-04-18T14:43:44.528 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 7.6987140319999998, 2024-04-18T14:43:44.528 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.001024767, 2024-04-18T14:43:44.528 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-04-18T14:43:44.528 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "reached pg", 2024-04-18T14:43:44.529 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-04-18T14:43:44.529 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:44.529 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-04-18T14:43:44.529 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:36.785006+0000", 2024-04-18T14:43:44.529 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:43:44.529 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:44.529 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:44.529 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-04-18T14:43:44.529 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:36.785006+0000", 2024-04-18T14:43:44.529 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:43:44.529 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:44.529 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:44.529 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-04-18T14:43:44.529 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:36.785005+0000", 2024-04-18T14:43:44.530 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 4294967295.999999 2024-04-18T14:43:44.530 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:44.530 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:44.530 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-04-18T14:43:44.530 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:36.785019+0000", 2024-04-18T14:43:44.530 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.3178e-05 2024-04-18T14:43:44.530 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:44.530 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:44.530 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-04-18T14:43:44.530 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:36.785034+0000", 2024-04-18T14:43:44.530 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.5707000000000001e-05 2024-04-18T14:43:44.531 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:44.531 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:44.531 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-04-18T14:43:44.531 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:36.785043+0000", 2024-04-18T14:43:44.531 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 8.8759999999999994e-06 2024-04-18T14:43:44.531 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:44.531 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:44.531 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-04-18T14:43:44.531 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:36.785098+0000", 2024-04-18T14:43:44.531 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 5.5305e-05 2024-04-18T14:43:44.531 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:44.531 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:44.532 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_started", 2024-04-18T14:43:44.532 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:36.785109+0000", 2024-04-18T14:43:44.532 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.0441999999999999e-05 2024-04-18T14:43:44.532 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:44.532 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:44.532 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_committed", 2024-04-18T14:43:44.532 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:36.785993+0000", 2024-04-18T14:43:44.532 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000884481 2024-04-18T14:43:44.532 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:44.532 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:44.532 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-04-18T14:43:44.532 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:36.786031+0000", 2024-04-18T14:43:44.533 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.7512000000000003e-05 2024-04-18T14:43:44.533 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:43:44.533 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T14:43:44.533 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:43:44.533 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:44.533 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:44.533 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "MOSDECSubOpWrite(3.6s6 37/30 ECSubWrite(tid=41, reqid=client.4559.0:206, at_version=37'12, trim_to=0'0, roll_forward_to=37'10))", 2024-04-18T14:43:44.533 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-04-18T14:43:36.869175+0000", 2024-04-18T14:43:44.533 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 7.6145448030000003, 2024-04-18T14:43:44.533 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0019598200000000001, 2024-04-18T14:43:44.533 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-04-18T14:43:44.533 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "reached pg", 2024-04-18T14:43:44.534 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-04-18T14:43:44.534 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:44.534 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-04-18T14:43:44.534 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:36.869175+0000", 2024-04-18T14:43:44.534 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:43:44.534 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:44.534 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:44.534 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-04-18T14:43:44.534 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:36.869175+0000", 2024-04-18T14:43:44.534 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:43:44.534 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:44.534 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:44.535 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-04-18T14:43:44.535 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:36.869174+0000", 2024-04-18T14:43:44.535 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 4294967295.999999 2024-04-18T14:43:44.535 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:44.535 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:44.535 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-04-18T14:43:44.535 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:36.869385+0000", 2024-04-18T14:43:44.535 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000210776 2024-04-18T14:43:44.535 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:44.535 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:44.535 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-04-18T14:43:44.535 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:36.869401+0000", 2024-04-18T14:43:44.535 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.6081000000000001e-05 2024-04-18T14:43:44.535 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:44.535 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:44.536 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-04-18T14:43:44.536 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:36.869412+0000", 2024-04-18T14:43:44.536 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.0278999999999999e-05 2024-04-18T14:43:44.536 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:44.536 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:44.536 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-04-18T14:43:44.536 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:36.869480+0000", 2024-04-18T14:43:44.536 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 6.8885000000000002e-05 2024-04-18T14:43:44.538 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:44.538 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:44.538 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_started", 2024-04-18T14:43:44.538 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:36.869496+0000", 2024-04-18T14:43:44.538 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.5690999999999999e-05 2024-04-18T14:43:44.538 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:44.538 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:44.538 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_committed", 2024-04-18T14:43:44.538 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:36.871098+0000", 2024-04-18T14:43:44.539 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00160195 2024-04-18T14:43:44.539 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:44.539 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:44.539 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-04-18T14:43:44.539 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:36.871135+0000", 2024-04-18T14:43:44.539 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.7078e-05 2024-04-18T14:43:44.539 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:43:44.539 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T14:43:44.539 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:43:44.539 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:44.539 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:44.539 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "MOSDECSubOpWrite(3.7s2 37/30 ECSubWrite(tid=42, reqid=client.4559.0:208, at_version=37'13, trim_to=0'0, roll_forward_to=37'11))", 2024-04-18T14:43:44.539 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-04-18T14:43:36.875002+0000", 2024-04-18T14:43:44.539 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 7.6087181820000005, 2024-04-18T14:43:44.540 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.001753487, 2024-04-18T14:43:44.540 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-04-18T14:43:44.540 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "reached pg", 2024-04-18T14:43:44.540 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-04-18T14:43:44.540 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:44.540 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-04-18T14:43:44.540 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:36.875002+0000", 2024-04-18T14:43:44.540 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:43:44.540 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:44.540 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:44.540 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-04-18T14:43:44.540 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:36.875002+0000", 2024-04-18T14:43:44.540 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:43:44.541 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:44.541 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:44.541 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-04-18T14:43:44.541 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:36.875001+0000", 2024-04-18T14:43:44.541 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 4294967295.999999 2024-04-18T14:43:44.541 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:44.541 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:44.541 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-04-18T14:43:44.541 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:36.875225+0000", 2024-04-18T14:43:44.541 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00022414399999999999 2024-04-18T14:43:44.541 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:44.541 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:44.541 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-04-18T14:43:44.541 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:36.875238+0000", 2024-04-18T14:43:44.542 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.2814e-05 2024-04-18T14:43:44.542 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:44.542 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:44.542 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-04-18T14:43:44.542 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:36.875245+0000", 2024-04-18T14:43:44.542 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 6.8510000000000001e-06 2024-04-18T14:43:44.542 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:44.542 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:44.542 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-04-18T14:43:44.542 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:36.875311+0000", 2024-04-18T14:43:44.542 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 6.5741999999999995e-05 2024-04-18T14:43:44.542 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:44.543 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:44.543 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_started", 2024-04-18T14:43:44.543 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:36.875326+0000", 2024-04-18T14:43:44.543 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.5082000000000001e-05 2024-04-18T14:43:44.543 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:44.543 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:44.543 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_committed", 2024-04-18T14:43:44.543 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:36.876734+0000", 2024-04-18T14:43:44.543 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.001407841 2024-04-18T14:43:44.543 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:44.543 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:44.544 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-04-18T14:43:44.544 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:36.876755+0000", 2024-04-18T14:43:44.544 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.1767999999999999e-05 2024-04-18T14:43:44.544 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:43:44.544 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T14:43:44.544 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:43:44.544 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:44.544 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:44.544 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "MOSDECSubOpWrite(3.7s2 41/30 ECSubWrite(tid=49, reqid=osd.14.0:49, at_version=41'17, trim_to=0'0, roll_forward_to=38'15))", 2024-04-18T14:43:44.544 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-04-18T14:43:40.758426+0000", 2024-04-18T14:43:44.544 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 3.7252938659999999, 2024-04-18T14:43:44.544 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00221762, 2024-04-18T14:43:44.544 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-04-18T14:43:44.544 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "reached pg", 2024-04-18T14:43:44.545 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-04-18T14:43:44.545 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:44.545 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-04-18T14:43:44.545 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:40.758426+0000", 2024-04-18T14:43:44.545 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:43:44.545 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:44.545 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:44.545 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-04-18T14:43:44.545 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:40.758426+0000", 2024-04-18T14:43:44.545 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:43:44.545 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:44.545 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:44.545 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-04-18T14:43:44.545 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:40.758426+0000", 2024-04-18T14:43:44.545 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 4294967295.9999995 2024-04-18T14:43:44.546 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:44.546 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:44.546 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-04-18T14:43:44.546 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:40.758471+0000", 2024-04-18T14:43:44.546 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 4.5028000000000003e-05 2024-04-18T14:43:44.546 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:44.546 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:44.546 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-04-18T14:43:44.546 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:40.758499+0000", 2024-04-18T14:43:44.546 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.8208000000000002e-05 2024-04-18T14:43:44.546 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:44.546 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:44.547 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-04-18T14:43:44.547 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:40.758521+0000", 2024-04-18T14:43:44.547 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.2209e-05 2024-04-18T14:43:44.547 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:44.547 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:44.547 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-04-18T14:43:44.547 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:40.758655+0000", 2024-04-18T14:43:44.547 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000133557 2024-04-18T14:43:44.547 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:44.547 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:44.547 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_started", 2024-04-18T14:43:44.547 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:40.758682+0000", 2024-04-18T14:43:44.547 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.7589e-05 2024-04-18T14:43:44.548 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:44.548 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:44.548 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_committed", 2024-04-18T14:43:44.548 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:40.760578+0000", 2024-04-18T14:43:44.548 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.001895529 2024-04-18T14:43:44.548 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:44.548 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:44.548 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-04-18T14:43:44.548 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:40.760644+0000", 2024-04-18T14:43:44.548 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 6.6082999999999997e-05 2024-04-18T14:43:44.548 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:43:44.548 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T14:43:44.548 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:43:44.549 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:44.549 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:44.549 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "MOSDECSubOpWrite(3.7s2 41/30 ECSubWrite(tid=50, reqid=osd.14.0:49, at_version=0'0, trim_to=0'0, roll_forward_to=41'17))", 2024-04-18T14:43:44.549 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-04-18T14:43:40.763283+0000", 2024-04-18T14:43:44.549 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 3.720437183, 2024-04-18T14:43:44.549 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0014354599999999999, 2024-04-18T14:43:44.549 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-04-18T14:43:44.549 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "reached pg", 2024-04-18T14:43:44.549 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-04-18T14:43:44.549 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:44.549 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-04-18T14:43:44.550 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:40.763283+0000", 2024-04-18T14:43:44.550 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:43:44.550 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:44.550 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:44.550 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-04-18T14:43:44.550 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:40.763283+0000", 2024-04-18T14:43:44.550 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:43:44.550 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:44.550 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:44.550 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-04-18T14:43:44.550 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:40.763281+0000", 2024-04-18T14:43:44.550 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 4294967295.9999986 2024-04-18T14:43:44.550 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:44.550 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:44.551 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-04-18T14:43:44.551 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:40.763309+0000", 2024-04-18T14:43:44.551 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.7396e-05 2024-04-18T14:43:44.551 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:44.551 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:44.551 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-04-18T14:43:44.551 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:40.763343+0000", 2024-04-18T14:43:44.551 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.4421999999999997e-05 2024-04-18T14:43:44.551 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:44.551 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:44.551 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-04-18T14:43:44.551 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:40.763365+0000", 2024-04-18T14:43:44.551 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.2221999999999998e-05 2024-04-18T14:43:44.551 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:44.551 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:44.552 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-04-18T14:43:44.552 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:40.763470+0000", 2024-04-18T14:43:44.552 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000104899 2024-04-18T14:43:44.552 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:44.552 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:44.552 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_started", 2024-04-18T14:43:44.552 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:40.763488+0000", 2024-04-18T14:43:44.552 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.7178999999999999e-05 2024-04-18T14:43:44.552 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:44.553 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:44.553 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_committed", 2024-04-18T14:43:44.553 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:40.764660+0000", 2024-04-18T14:43:44.553 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0011722080000000001 2024-04-18T14:43:44.553 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:44.553 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:44.553 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-04-18T14:43:44.553 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:40.764718+0000", 2024-04-18T14:43:44.554 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 5.8684000000000003e-05 2024-04-18T14:43:44.554 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:43:44.554 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T14:43:44.554 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:43:44.554 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:44.554 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:44.554 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "MOSDECSubOpRead(3.as3 41/30 ECSubRead(tid=27, to_read={3:577932fb:::smithi13430248-41:head=0,172032,0}, subchunks={3:577932fb:::smithi13430248-41:head=[0,1]}, attrs_to_read=))", 2024-04-18T14:43:44.554 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-04-18T14:43:40.765429+0000", 2024-04-18T14:43:44.554 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 3.7182907329999999, 2024-04-18T14:43:44.554 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0018859390000000001, 2024-04-18T14:43:44.554 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-04-18T14:43:44.554 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "reached pg", 2024-04-18T14:43:44.554 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-04-18T14:43:44.555 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:44.555 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-04-18T14:43:44.555 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:40.765429+0000", 2024-04-18T14:43:44.555 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:43:44.555 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:44.555 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:44.555 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-04-18T14:43:44.555 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:40.765429+0000", 2024-04-18T14:43:44.555 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:43:44.555 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:44.555 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:44.555 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-04-18T14:43:44.555 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:40.765429+0000", 2024-04-18T14:43:44.555 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 4294967295.999999 2024-04-18T14:43:44.555 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:44.556 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:44.556 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-04-18T14:43:44.556 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:40.765446+0000", 2024-04-18T14:43:44.556 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.7326e-05 2024-04-18T14:43:44.556 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:44.556 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:44.556 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-04-18T14:43:44.556 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:40.765476+0000", 2024-04-18T14:43:44.556 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.9926000000000001e-05 2024-04-18T14:43:44.556 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:44.556 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:44.556 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-04-18T14:43:44.556 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:40.765502+0000", 2024-04-18T14:43:44.556 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.5655000000000001e-05 2024-04-18T14:43:44.556 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:44.557 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:44.557 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-04-18T14:43:44.557 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:40.765678+0000", 2024-04-18T14:43:44.557 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000176195 2024-04-18T14:43:44.557 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:44.557 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:44.557 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-04-18T14:43:44.557 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:40.767315+0000", 2024-04-18T14:43:44.557 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0016376240000000001 2024-04-18T14:43:44.557 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:43:44.557 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T14:43:44.557 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:43:44.557 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:44.557 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:44.557 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "MOSDECSubOpRead(3.as3 41/30 ECSubRead(tid=28, to_read={3:577932fb:::smithi13430248-41:head=0,172032,0}, subchunks={3:577932fb:::smithi13430248-41:head=[0,1]}, attrs_to_read=))", 2024-04-18T14:43:44.558 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-04-18T14:43:40.765967+0000", 2024-04-18T14:43:44.558 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 3.7177535310000001, 2024-04-18T14:43:44.558 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0018729650000000001, 2024-04-18T14:43:44.558 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-04-18T14:43:44.558 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "reached pg", 2024-04-18T14:43:44.558 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-04-18T14:43:44.558 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:44.558 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-04-18T14:43:44.558 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:40.765967+0000", 2024-04-18T14:43:44.558 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:43:44.558 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:44.558 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:44.558 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-04-18T14:43:44.559 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:40.765967+0000", 2024-04-18T14:43:44.559 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:43:44.559 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:44.559 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:44.559 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-04-18T14:43:44.559 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:40.765964+0000", 2024-04-18T14:43:44.559 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 4294967295.9999976 2024-04-18T14:43:44.559 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:44.559 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:44.559 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-04-18T14:43:44.559 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:40.765986+0000", 2024-04-18T14:43:44.559 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.1202000000000001e-05 2024-04-18T14:43:44.559 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:44.560 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:44.560 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-04-18T14:43:44.560 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:40.766013+0000", 2024-04-18T14:43:44.560 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.7608999999999999e-05 2024-04-18T14:43:44.560 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:44.560 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:44.560 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-04-18T14:43:44.560 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:40.766044+0000", 2024-04-18T14:43:44.560 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.1121000000000002e-05 2024-04-18T14:43:44.560 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:44.560 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:44.560 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-04-18T14:43:44.560 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:40.767492+0000", 2024-04-18T14:43:44.560 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0014477730000000001 2024-04-18T14:43:44.560 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:44.561 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:44.561 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-04-18T14:43:44.561 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:40.767840+0000", 2024-04-18T14:43:44.561 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00034745000000000002 2024-04-18T14:43:44.561 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:43:44.561 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T14:43:44.561 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:43:44.561 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:44.561 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:44.561 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "MOSDECSubOpRead(3.as3 41/30 ECSubRead(tid=29, to_read={3:577932fb:::smithi13430248-41:head=0,172032,0}, subchunks={3:577932fb:::smithi13430248-41:head=[0,1]}, attrs_to_read=))", 2024-04-18T14:43:44.561 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-04-18T14:43:40.766829+0000", 2024-04-18T14:43:44.561 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 3.7168915120000001, 2024-04-18T14:43:44.561 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.001362727, 2024-04-18T14:43:44.561 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-04-18T14:43:44.561 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "reached pg", 2024-04-18T14:43:44.561 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-04-18T14:43:44.562 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:44.562 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-04-18T14:43:44.562 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:40.766829+0000", 2024-04-18T14:43:44.562 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:43:44.562 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:44.562 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:44.562 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-04-18T14:43:44.562 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:40.766829+0000", 2024-04-18T14:43:44.562 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:43:44.562 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:44.562 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:44.562 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-04-18T14:43:44.562 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:40.766827+0000", 2024-04-18T14:43:44.563 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 4294967295.9999981 2024-04-18T14:43:44.563 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:44.563 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:44.563 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-04-18T14:43:44.563 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:40.766847+0000", 2024-04-18T14:43:44.563 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.9998999999999999e-05 2024-04-18T14:43:44.563 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:44.563 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:44.563 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-04-18T14:43:44.563 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:40.766889+0000", 2024-04-18T14:43:44.563 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 4.2122000000000001e-05 2024-04-18T14:43:44.563 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:44.563 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:44.563 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-04-18T14:43:44.563 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:40.766916+0000", 2024-04-18T14:43:44.564 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.6798e-05 2024-04-18T14:43:44.564 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:44.564 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:44.564 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-04-18T14:43:44.564 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:40.767925+0000", 2024-04-18T14:43:44.564 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.001009039 2024-04-18T14:43:44.564 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:44.564 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:44.565 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-04-18T14:43:44.565 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:40.768191+0000", 2024-04-18T14:43:44.565 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00026647200000000002 2024-04-18T14:43:44.565 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:43:44.566 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T14:43:44.566 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:43:44.566 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:44.566 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:44.566 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "MOSDECSubOpWrite(3.7s2 41/30 ECSubWrite(tid=51, reqid=client.4559.0:242, at_version=41'19, trim_to=0'0, roll_forward_to=41'17))", 2024-04-18T14:43:44.566 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-04-18T14:43:40.782775+0000", 2024-04-18T14:43:44.566 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 3.7009454339999999, 2024-04-18T14:43:44.566 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0029201380000000001, 2024-04-18T14:43:44.566 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-04-18T14:43:44.566 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "reached pg", 2024-04-18T14:43:44.566 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-04-18T14:43:44.566 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:44.566 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-04-18T14:43:44.566 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:40.782775+0000", 2024-04-18T14:43:44.566 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:43:44.567 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:44.567 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:44.567 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-04-18T14:43:44.567 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:40.782775+0000", 2024-04-18T14:43:44.567 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:43:44.567 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:44.567 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:44.567 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-04-18T14:43:44.567 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:40.782773+0000", 2024-04-18T14:43:44.567 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 4294967295.9999981 2024-04-18T14:43:44.567 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:44.567 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:44.567 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-04-18T14:43:44.567 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:40.783249+0000", 2024-04-18T14:43:44.567 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00047569399999999998 2024-04-18T14:43:44.568 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:44.568 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:44.568 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-04-18T14:43:44.568 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:40.783278+0000", 2024-04-18T14:43:44.568 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.9374999999999999e-05 2024-04-18T14:43:44.568 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:44.568 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:44.568 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-04-18T14:43:44.568 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:40.783294+0000", 2024-04-18T14:43:44.568 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.5722999999999998e-05 2024-04-18T14:43:44.568 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:44.568 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:44.568 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-04-18T14:43:44.569 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:40.783413+0000", 2024-04-18T14:43:44.569 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000119055 2024-04-18T14:43:44.569 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:44.569 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:44.569 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_started", 2024-04-18T14:43:44.569 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:40.783432+0000", 2024-04-18T14:43:44.569 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.8702000000000002e-05 2024-04-18T14:43:44.569 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:44.569 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:44.569 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_committed", 2024-04-18T14:43:44.569 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:40.785612+0000", 2024-04-18T14:43:44.569 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0021809379999999999 2024-04-18T14:43:44.569 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:44.569 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:44.570 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-04-18T14:43:44.570 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:40.785695+0000", 2024-04-18T14:43:44.570 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 8.2369999999999999e-05 2024-04-18T14:43:44.570 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:43:44.570 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T14:43:44.570 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:43:44.570 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:44.570 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:44.570 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "MOSDECSubOpWrite(3.7s2 41/30 ECSubWrite(tid=52, reqid=client.4559.0:242, at_version=0'0, trim_to=0'0, roll_forward_to=41'19))", 2024-04-18T14:43:44.570 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-04-18T14:43:40.789618+0000", 2024-04-18T14:43:44.570 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 3.6941019499999999, 2024-04-18T14:43:44.570 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0013766290000000001, 2024-04-18T14:43:44.570 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-04-18T14:43:44.570 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "reached pg", 2024-04-18T14:43:44.570 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-04-18T14:43:44.571 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:44.571 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-04-18T14:43:44.571 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:40.789618+0000", 2024-04-18T14:43:44.571 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:43:44.571 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:44.571 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:44.571 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-04-18T14:43:44.571 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:40.789618+0000", 2024-04-18T14:43:44.571 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:43:44.571 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:44.571 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:44.571 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-04-18T14:43:44.571 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:40.789611+0000", 2024-04-18T14:43:44.571 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 4294967295.9999928 2024-04-18T14:43:44.571 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:44.572 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:44.572 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-04-18T14:43:44.572 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:40.789656+0000", 2024-04-18T14:43:44.572 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 4.5215e-05 2024-04-18T14:43:44.572 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:44.572 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:44.572 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-04-18T14:43:44.572 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:40.789687+0000", 2024-04-18T14:43:44.572 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.0258999999999999e-05 2024-04-18T14:43:44.572 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:44.572 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:44.572 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-04-18T14:43:44.572 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:40.789709+0000", 2024-04-18T14:43:44.572 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.2014999999999998e-05 2024-04-18T14:43:44.572 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:44.572 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:44.573 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-04-18T14:43:44.573 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:40.789806+0000", 2024-04-18T14:43:44.573 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 9.7266e-05 2024-04-18T14:43:44.573 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:44.573 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:44.574 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_started", 2024-04-18T14:43:44.574 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:40.789844+0000", 2024-04-18T14:43:44.574 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.7960999999999998e-05 2024-04-18T14:43:44.574 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:44.574 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:44.574 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_committed", 2024-04-18T14:43:44.574 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:40.790931+0000", 2024-04-18T14:43:44.574 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.001087553 2024-04-18T14:43:44.574 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:44.574 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:44.574 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-04-18T14:43:44.574 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:40.790995+0000", 2024-04-18T14:43:44.574 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 6.3369999999999998e-05 2024-04-18T14:43:44.575 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:43:44.575 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T14:43:44.575 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:43:44.575 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:43:44.575 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T14:43:44.575 INFO:teuthology.orchestra.run.smithi096.stdout:} 2024-04-18T14:43:44.576 INFO:teuthology.orchestra.run.smithi086.stdout:osd.14: {} 2024-04-18T14:43:44.577 INFO:teuthology.orchestra.run.smithi086.stderr:osd.14: osd_enable_op_tracker = '' 2024-04-18T14:43:44.578 INFO:teuthology.orchestra.run.smithi086.stdout:osd.15: {} 2024-04-18T14:43:44.578 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.13.asok dump_ops_in_flight 2024-04-18T14:43:44.579 INFO:tasks.ceph.osd.9.smithi096.stderr:2024-04-18T14:43:44.575+0000 7fa2c1cbf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 9 (PID: 24891) UID: 0 2024-04-18T14:43:44.580 INFO:teuthology.orchestra.run.smithi086.stderr:osd.15: osd_enable_op_tracker = '' 2024-04-18T14:43:44.580 INFO:tasks.rados.rados.0.smithi134.stdout:124: finishing rollback tid 0 to smithi13430248-36 2024-04-18T14:43:44.580 INFO:tasks.rados.rados.0.smithi134.stdout:124: finishing rollback tid 1 to smithi13430248-36 2024-04-18T14:43:44.581 INFO:tasks.rados.rados.0.smithi134.stdout:124: finishing rollback tid 2 to smithi13430248-36 2024-04-18T14:43:44.581 INFO:tasks.rados.rados.0.smithi134.stdout:update_object_version oid 36 v 40 (ObjNum 35 snap 0 seq_num 35) dirty exists 2024-04-18T14:43:44.581 INFO:tasks.rados.rados.0.smithi134.stdout:121: done (2 left) 2024-04-18T14:43:44.581 INFO:tasks.rados.rados.0.smithi134.stdout:122: done (1 left) 2024-04-18T14:43:44.581 INFO:tasks.rados.rados.0.smithi134.stdout:124: done (0 left) 2024-04-18T14:43:44.581 INFO:tasks.rados.rados.0.smithi134.stdout:append oid 6 current snap is 9 2024-04-18T14:43:44.581 INFO:tasks.rados.rados.0.smithi134.stdout:125: seq_num 68 ranges {98304=770048,868352=376832} 2024-04-18T14:43:44.581 INFO:tasks.rados.rados.0.smithi134.stdout:125: writing smithi13430248-6 from 98304 to 868352 tid 1 2024-04-18T14:43:44.581 INFO:tasks.rados.rados.0.smithi134.stdout:125: writing smithi13430248-6 from 868352 to 1245184 tid 2 2024-04-18T14:43:44.581 INFO:tasks.rados.rados.0.smithi134.stdout:append oid 4 current snap is 9 2024-04-18T14:43:44.581 INFO:tasks.rados.rados.0.smithi134.stdout:126: seq_num 69 ranges {507904=786432,1294336=376832} 2024-04-18T14:43:44.581 INFO:tasks.rados.rados.0.smithi134.stdout:126: writing smithi13430248-4 from 507904 to 1294336 tid 1 2024-04-18T14:43:44.581 INFO:tasks.rados.rados.0.smithi134.stdout:126: writing smithi13430248-4 from 1294336 to 1671168 tid 2 2024-04-18T14:43:44.581 INFO:tasks.rados.rados.0.smithi134.stdout:append oid 44 current snap is 9 2024-04-18T14:43:44.581 INFO:tasks.rados.rados.0.smithi134.stdout:127: seq_num 70 ranges {737280=802816,1540096=376832} 2024-04-18T14:43:44.581 INFO:tasks.rados.rados.0.smithi134.stdout:127: writing smithi13430248-44 from 737280 to 1540096 tid 1 2024-04-18T14:43:44.582 INFO:tasks.rados.rados.0.smithi134.stdout:127: writing smithi13430248-44 from 1540096 to 1916928 tid 2 2024-04-18T14:43:44.582 INFO:tasks.rados.rados.0.smithi134.stdout:125: finishing write tid 1 to smithi13430248-6 2024-04-18T14:43:44.582 INFO:tasks.rados.rados.0.smithi134.stdout:125: finishing write tid 2 to smithi13430248-6 2024-04-18T14:43:44.582 INFO:tasks.rados.rados.0.smithi134.stdout:125: finishing write tid 3 to smithi13430248-6 2024-04-18T14:43:44.582 INFO:tasks.rados.rados.0.smithi134.stdout:125: finishing write tid 4 to smithi13430248-6 2024-04-18T14:43:44.582 INFO:tasks.rados.rados.0.smithi134.stdout:125: oid 6 updating version 0 to 15 2024-04-18T14:43:44.582 INFO:tasks.rados.rados.0.smithi134.stdout:125: oid 6 version 15 is already newer than 14 2024-04-18T14:43:44.582 INFO:tasks.rados.rados.0.smithi134.stdout:125: oid 6 version 15 is already newer than 13 2024-04-18T14:43:44.582 INFO:tasks.rados.rados.0.smithi134.stdout:update_object_version oid 6 v 15 (ObjNum 68 snap 9 seq_num 68) dirty exists 2024-04-18T14:43:44.582 INFO:tasks.rados.rados.0.smithi134.stdout:125: left oid 6 (ObjNum 68 snap 9 seq_num 68) 2024-04-18T14:43:44.582 INFO:tasks.rados.rados.0.smithi134.stdout:126: finishing write tid 1 to smithi13430248-4 2024-04-18T14:43:44.582 INFO:tasks.rados.rados.0.smithi134.stdout:126: finishing write tid 2 to smithi13430248-4 2024-04-18T14:43:44.582 INFO:tasks.rados.rados.0.smithi134.stdout:126: finishing write tid 3 to smithi13430248-4 2024-04-18T14:43:44.582 INFO:tasks.rados.rados.0.smithi134.stdout:126: finishing write tid 4 to smithi13430248-4 2024-04-18T14:43:44.582 INFO:tasks.rados.rados.0.smithi134.stdout:126: oid 4 updating version 0 to 20 2024-04-18T14:43:44.582 INFO:tasks.rados.rados.0.smithi134.stdout:126: oid 4 version 20 is already newer than 19 2024-04-18T14:43:44.583 INFO:tasks.rados.rados.0.smithi134.stdout:126: oid 4 updating version 20 to 21 2024-04-18T14:43:44.583 INFO:tasks.rados.rados.0.smithi134.stdout:update_object_version oid 4 v 21 (ObjNum 69 snap 9 seq_num 69) dirty exists 2024-04-18T14:43:44.583 INFO:tasks.rados.rados.0.smithi134.stdout:126: left oid 4 (ObjNum 69 snap 9 seq_num 69) 2024-04-18T14:43:44.583 INFO:tasks.rados.rados.0.smithi134.stdout:125: done (2 left) 2024-04-18T14:43:44.583 INFO:tasks.rados.rados.0.smithi134.stdout:126: done (1 left) 2024-04-18T14:43:44.583 INFO:tasks.rados.rados.0.smithi134.stdout:128: rollback oid 49 current snap is 9 2024-04-18T14:43:44.583 INFO:tasks.rados.rados.0.smithi134.stdout:rollback oid 49 to 0 2024-04-18T14:43:44.583 INFO:tasks.rados.rados.0.smithi134.stdout:129: snap_remove snap 8 2024-04-18T14:43:44.677 INFO:tasks.ceph.osd.8.smithi086.stderr:2024-04-18T14:43:44.675+0000 7f29f7b9d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 8 (PID: 24958) UID: 0 2024-04-18T14:43:44.751 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2024-04-18T14:43:44.751 INFO:teuthology.orchestra.run.smithi096.stdout: "ops": [], 2024-04-18T14:43:44.751 INFO:teuthology.orchestra.run.smithi096.stdout: "num_ops": 0 2024-04-18T14:43:44.751 INFO:teuthology.orchestra.run.smithi096.stdout:} 2024-04-18T14:43:44.765 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.13.asok dump_blocked_ops 2024-04-18T14:43:44.778 INFO:tasks.ceph.osd.15.smithi134.stderr:2024-04-18T14:43:44.780+0000 7f08e6a51640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 15 (PID: 25218) UID: 0 2024-04-18T14:43:44.788 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-04-18T14:43:44.879 INFO:tasks.ceph.osd.10.smithi119.stderr:2024-04-18T14:43:44.878+0000 7f6f24c12640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 10 (PID: 24898) UID: 0 2024-04-18T14:43:44.885 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2024-04-18T14:43:44.885 INFO:teuthology.orchestra.run.smithi096.stdout: "ops": [], 2024-04-18T14:43:44.885 INFO:teuthology.orchestra.run.smithi096.stdout: "complaint_time": 30, 2024-04-18T14:43:44.885 INFO:teuthology.orchestra.run.smithi096.stdout: "num_blocked_ops": 0 2024-04-18T14:43:44.885 INFO:teuthology.orchestra.run.smithi096.stdout:} 2024-04-18T14:43:44.899 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.13.asok dump_historic_ops 2024-04-18T14:43:44.980 INFO:tasks.ceph.osd.6.smithi119.stderr:2024-04-18T14:43:44.978+0000 7fb7cb8bd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 24896) UID: 0 2024-04-18T14:43:45.017 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2024-04-18T14:43:45.017 INFO:teuthology.orchestra.run.smithi096.stdout: "size": 20, 2024-04-18T14:43:45.017 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 600, 2024-04-18T14:43:45.017 INFO:teuthology.orchestra.run.smithi096.stdout: "ops": [ 2024-04-18T14:43:45.017 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:45.017 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4212.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-18T14:43:45.017 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-04-18T14:43:19.321281+0000", 2024-04-18T14:43:45.017 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 25.696333807999999, 2024-04-18T14:43:45.017 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.0074994820000001, 2024-04-18T14:43:45.017 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-04-18T14:43:45.018 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T14:43:45.018 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-04-18T14:43:45.018 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4212", 2024-04-18T14:43:45.018 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "172.21.15.134:0/3325451476", 2024-04-18T14:43:45.018 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 1 2024-04-18T14:43:45.018 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:45.018 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-04-18T14:43:45.018 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:45.018 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-04-18T14:43:45.018 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:19.321281+0000", 2024-04-18T14:43:45.018 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:43:45.018 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:45.018 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:45.018 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-04-18T14:43:45.019 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:19.321281+0000", 2024-04-18T14:43:45.019 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:43:45.019 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:45.019 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:45.019 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-04-18T14:43:45.019 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:19.321279+0000", 2024-04-18T14:43:45.019 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 4294967295.9999971 2024-04-18T14:43:45.019 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:45.019 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:45.019 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-04-18T14:43:45.019 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:19.321299+0000", 2024-04-18T14:43:45.019 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.0098e-05 2024-04-18T14:43:45.019 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:45.019 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:45.020 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-04-18T14:43:45.020 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:19.321342+0000", 2024-04-18T14:43:45.020 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 4.3146000000000003e-05 2024-04-18T14:43:45.020 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:45.020 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:45.020 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-04-18T14:43:45.020 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:19.321367+0000", 2024-04-18T14:43:45.020 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.5318000000000001e-05 2024-04-18T14:43:45.020 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:45.020 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:45.020 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-04-18T14:43:45.020 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:19.321511+0000", 2024-04-18T14:43:45.020 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000143981 2024-04-18T14:43:45.021 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:45.021 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:45.021 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for peered", 2024-04-18T14:43:45.021 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:19.321560+0000", 2024-04-18T14:43:45.021 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 4.8279999999999999e-05 2024-04-18T14:43:45.021 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:45.021 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:45.021 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-04-18T14:43:45.021 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.324154+0000", 2024-04-18T14:43:45.021 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.0025947829999999 2024-04-18T14:43:45.021 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:45.021 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:45.021 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-04-18T14:43:45.021 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.324558+0000", 2024-04-18T14:43:45.021 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00040310999999999998 2024-04-18T14:43:45.022 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:45.022 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:45.022 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for subops from 0", 2024-04-18T14:43:45.022 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.325049+0000", 2024-04-18T14:43:45.022 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00049149000000000003 2024-04-18T14:43:45.022 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:45.022 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:45.022 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_commit_rec", 2024-04-18T14:43:45.022 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.326473+0000", 2024-04-18T14:43:45.022 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.001423517 2024-04-18T14:43:45.022 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:45.022 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:45.022 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-04-18T14:43:45.023 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.328533+0000", 2024-04-18T14:43:45.023 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0020606779999999998 2024-04-18T14:43:45.023 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:45.023 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:45.023 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-04-18T14:43:45.023 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.328679+0000", 2024-04-18T14:43:45.023 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00014585800000000001 2024-04-18T14:43:45.023 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:45.023 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:45.023 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-04-18T14:43:45.023 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.328781+0000", 2024-04-18T14:43:45.023 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000101872 2024-04-18T14:43:45.023 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:43:45.024 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T14:43:45.024 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:43:45.024 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:45.024 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:45.024 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4212.0:110 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-04-18T14:43:45.024 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-04-18T14:43:20.700822+0000", 2024-04-18T14:43:45.024 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 24.316793014000002, 2024-04-18T14:43:45.024 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.021022381999999999, 2024-04-18T14:43:45.025 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-04-18T14:43:45.025 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T14:43:45.025 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-04-18T14:43:45.025 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4212", 2024-04-18T14:43:45.025 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "172.21.15.134:0/3325451476", 2024-04-18T14:43:45.025 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 110 2024-04-18T14:43:45.025 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:45.025 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-04-18T14:43:45.025 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:45.025 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-04-18T14:43:45.025 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.700822+0000", 2024-04-18T14:43:45.025 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:43:45.025 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:45.026 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:45.026 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-04-18T14:43:45.026 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.700822+0000", 2024-04-18T14:43:45.026 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:43:45.026 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:45.026 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:45.026 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-04-18T14:43:45.026 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.700821+0000", 2024-04-18T14:43:45.026 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 4294967295.999999 2024-04-18T14:43:45.026 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:45.026 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:45.027 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-04-18T14:43:45.027 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.700828+0000", 2024-04-18T14:43:45.027 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 6.9269999999999999e-06 2024-04-18T14:43:45.027 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:45.027 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:45.027 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-04-18T14:43:45.027 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.700839+0000", 2024-04-18T14:43:45.027 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.0702e-05 2024-04-18T14:43:45.027 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:45.027 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:45.027 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-04-18T14:43:45.027 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.700847+0000", 2024-04-18T14:43:45.027 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 7.6020000000000002e-06 2024-04-18T14:43:45.028 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:45.028 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:45.028 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-04-18T14:43:45.028 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.709488+0000", 2024-04-18T14:43:45.028 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0086410080000000004 2024-04-18T14:43:45.028 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:45.028 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:45.028 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-04-18T14:43:45.028 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.709751+0000", 2024-04-18T14:43:45.028 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000263272 2024-04-18T14:43:45.028 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:45.028 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:45.028 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for subops from 0", 2024-04-18T14:43:45.029 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.710106+0000", 2024-04-18T14:43:45.029 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000355037 2024-04-18T14:43:45.029 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:45.029 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:45.029 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-04-18T14:43:45.029 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.714026+0000", 2024-04-18T14:43:45.029 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0039202860000000003 2024-04-18T14:43:45.029 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:45.029 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:45.029 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_commit_rec", 2024-04-18T14:43:45.029 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.721600+0000", 2024-04-18T14:43:45.029 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0075740879999999997 2024-04-18T14:43:45.029 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:45.029 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:45.030 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-04-18T14:43:45.030 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.721740+0000", 2024-04-18T14:43:45.030 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00013932500000000001 2024-04-18T14:43:45.030 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:45.030 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:45.030 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-04-18T14:43:45.030 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.721845+0000", 2024-04-18T14:43:45.030 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000104992 2024-04-18T14:43:45.030 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:43:45.030 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T14:43:45.030 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:43:45.030 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:45.030 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:45.031 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4212.0:111 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-04-18T14:43:45.031 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-04-18T14:43:20.700855+0000", 2024-04-18T14:43:45.031 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 24.316760129999999, 2024-04-18T14:43:45.031 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.021347998, 2024-04-18T14:43:45.031 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-04-18T14:43:45.031 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T14:43:45.031 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-04-18T14:43:45.031 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4212", 2024-04-18T14:43:45.031 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "172.21.15.134:0/3325451476", 2024-04-18T14:43:45.031 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 111 2024-04-18T14:43:45.031 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:45.031 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-04-18T14:43:45.031 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:45.032 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-04-18T14:43:45.032 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.700855+0000", 2024-04-18T14:43:45.032 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:43:45.032 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:45.032 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:45.032 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-04-18T14:43:45.032 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.700855+0000", 2024-04-18T14:43:45.032 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:43:45.032 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:45.032 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:45.032 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-04-18T14:43:45.032 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.700854+0000", 2024-04-18T14:43:45.032 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 4294967295.999999 2024-04-18T14:43:45.032 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:45.033 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:45.033 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-04-18T14:43:45.033 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.700860+0000", 2024-04-18T14:43:45.033 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 5.7189999999999998e-06 2024-04-18T14:43:45.033 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:45.033 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:45.033 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-04-18T14:43:45.033 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.700869+0000", 2024-04-18T14:43:45.033 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 8.9889999999999998e-06 2024-04-18T14:43:45.033 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:45.033 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:45.033 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-04-18T14:43:45.033 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.700876+0000", 2024-04-18T14:43:45.034 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 7.0430000000000002e-06 2024-04-18T14:43:45.034 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:45.034 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:45.034 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-04-18T14:43:45.034 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.711224+0000", 2024-04-18T14:43:45.034 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.010347897 2024-04-18T14:43:45.034 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:45.034 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:45.034 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-04-18T14:43:45.034 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.711463+0000", 2024-04-18T14:43:45.035 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00023920699999999999 2024-04-18T14:43:45.035 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:45.035 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:45.035 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for subops from 0", 2024-04-18T14:43:45.035 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.711805+0000", 2024-04-18T14:43:45.035 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00034209600000000001 2024-04-18T14:43:45.035 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:45.035 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:45.035 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-04-18T14:43:45.035 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.715645+0000", 2024-04-18T14:43:45.035 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.003839309 2024-04-18T14:43:45.035 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:45.035 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:45.036 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_commit_rec", 2024-04-18T14:43:45.036 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.721971+0000", 2024-04-18T14:43:45.036 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0063267729999999999 2024-04-18T14:43:45.036 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:45.036 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:45.036 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-04-18T14:43:45.036 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.722107+0000", 2024-04-18T14:43:45.036 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00013514500000000001 2024-04-18T14:43:45.036 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:45.036 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:45.037 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-04-18T14:43:45.037 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.722203+0000", 2024-04-18T14:43:45.037 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 9.6545999999999993e-05 2024-04-18T14:43:45.037 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:43:45.037 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T14:43:45.037 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:43:45.037 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:45.037 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:45.037 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4212.0:112 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-04-18T14:43:45.037 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-04-18T14:43:20.700902+0000", 2024-04-18T14:43:45.037 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 24.316712986999999, 2024-04-18T14:43:45.037 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.021658816000000001, 2024-04-18T14:43:45.037 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-04-18T14:43:45.038 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T14:43:45.038 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-04-18T14:43:45.038 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4212", 2024-04-18T14:43:45.038 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "172.21.15.134:0/3325451476", 2024-04-18T14:43:45.038 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 112 2024-04-18T14:43:45.038 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:45.038 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-04-18T14:43:45.038 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:45.038 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-04-18T14:43:45.038 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.700902+0000", 2024-04-18T14:43:45.038 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:43:45.038 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:45.038 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:45.039 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-04-18T14:43:45.039 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.700902+0000", 2024-04-18T14:43:45.039 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:43:45.039 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:45.039 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:45.039 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-04-18T14:43:45.039 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.700901+0000", 2024-04-18T14:43:45.039 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 4294967295.999999 2024-04-18T14:43:45.039 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:45.039 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:45.039 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-04-18T14:43:45.039 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.701003+0000", 2024-04-18T14:43:45.039 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000102205 2024-04-18T14:43:45.039 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:45.040 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:45.040 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-04-18T14:43:45.040 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.701016+0000", 2024-04-18T14:43:45.040 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.2908000000000001e-05 2024-04-18T14:43:45.040 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:45.040 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:45.040 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-04-18T14:43:45.040 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.701025+0000", 2024-04-18T14:43:45.040 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 8.7229999999999993e-06 2024-04-18T14:43:45.040 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:45.040 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:45.040 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-04-18T14:43:45.040 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.712558+0000", 2024-04-18T14:43:45.041 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.011533181 2024-04-18T14:43:45.041 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:45.041 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:45.041 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-04-18T14:43:45.041 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.712690+0000", 2024-04-18T14:43:45.041 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00013159200000000001 2024-04-18T14:43:45.041 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:45.041 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:45.041 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for subops from 0", 2024-04-18T14:43:45.041 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.712895+0000", 2024-04-18T14:43:45.041 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000205126 2024-04-18T14:43:45.041 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:45.041 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:45.041 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-04-18T14:43:45.042 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.721499+0000", 2024-04-18T14:43:45.042 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0086041469999999995 2024-04-18T14:43:45.042 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:45.042 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:45.042 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_commit_rec", 2024-04-18T14:43:45.042 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.722336+0000", 2024-04-18T14:43:45.042 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00083725200000000003 2024-04-18T14:43:45.042 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:45.042 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:45.042 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-04-18T14:43:45.042 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.722461+0000", 2024-04-18T14:43:45.042 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00012457899999999999 2024-04-18T14:43:45.043 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:45.043 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:45.043 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-04-18T14:43:45.043 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.722561+0000", 2024-04-18T14:43:45.043 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000100066 2024-04-18T14:43:45.043 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:43:45.043 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T14:43:45.043 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:43:45.043 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:45.043 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:45.043 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4212.0:113 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-04-18T14:43:45.043 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-04-18T14:43:20.701035+0000", 2024-04-18T14:43:45.043 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 24.316579801, 2024-04-18T14:43:45.043 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.021756507000000001, 2024-04-18T14:43:45.044 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-04-18T14:43:45.044 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T14:43:45.044 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-04-18T14:43:45.044 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4212", 2024-04-18T14:43:45.044 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "172.21.15.134:0/3325451476", 2024-04-18T14:43:45.044 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 113 2024-04-18T14:43:45.044 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:45.044 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-04-18T14:43:45.044 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:45.044 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-04-18T14:43:45.044 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.701035+0000", 2024-04-18T14:43:45.045 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:43:45.045 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:45.045 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:45.045 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-04-18T14:43:45.045 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.701035+0000", 2024-04-18T14:43:45.045 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:43:45.045 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:45.045 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:45.045 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-04-18T14:43:45.045 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.701035+0000", 2024-04-18T14:43:45.045 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 4294967295.999999 2024-04-18T14:43:45.046 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:45.046 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:45.046 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-04-18T14:43:45.046 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.701041+0000", 2024-04-18T14:43:45.046 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 6.0290000000000002e-06 2024-04-18T14:43:45.046 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:45.046 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:45.046 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-04-18T14:43:45.046 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.701050+0000", 2024-04-18T14:43:45.046 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 9.0299999999999999e-06 2024-04-18T14:43:45.046 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:45.046 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:45.046 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-04-18T14:43:45.046 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.701057+0000", 2024-04-18T14:43:45.047 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 6.9550000000000003e-06 2024-04-18T14:43:45.047 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:45.047 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:45.047 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-04-18T14:43:45.047 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.714308+0000", 2024-04-18T14:43:45.047 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.013251281 2024-04-18T14:43:45.047 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:45.047 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:45.047 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-04-18T14:43:45.047 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.714542+0000", 2024-04-18T14:43:45.047 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00023440000000000001 2024-04-18T14:43:45.047 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:45.047 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:45.048 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for subops from 0", 2024-04-18T14:43:45.048 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.714898+0000", 2024-04-18T14:43:45.048 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00035589500000000001 2024-04-18T14:43:45.048 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:45.048 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:45.048 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-04-18T14:43:45.048 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.721874+0000", 2024-04-18T14:43:45.048 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0069761620000000002 2024-04-18T14:43:45.048 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:45.048 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:45.048 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_commit_rec", 2024-04-18T14:43:45.048 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.722665+0000", 2024-04-18T14:43:45.048 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00079023299999999999 2024-04-18T14:43:45.048 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:45.049 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:45.049 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-04-18T14:43:45.049 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.722737+0000", 2024-04-18T14:43:45.049 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 7.2156999999999994e-05 2024-04-18T14:43:45.049 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:45.049 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:45.049 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-04-18T14:43:45.049 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.722792+0000", 2024-04-18T14:43:45.049 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 5.5095e-05 2024-04-18T14:43:45.049 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:43:45.049 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T14:43:45.049 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:43:45.049 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:45.049 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:45.050 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4212.0:114 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-04-18T14:43:45.050 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-04-18T14:43:20.701065+0000", 2024-04-18T14:43:45.050 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 24.31655014, 2024-04-18T14:43:45.050 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.022072597999999999, 2024-04-18T14:43:45.050 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-04-18T14:43:45.050 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T14:43:45.050 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-04-18T14:43:45.050 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4212", 2024-04-18T14:43:45.050 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "172.21.15.134:0/3325451476", 2024-04-18T14:43:45.050 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 114 2024-04-18T14:43:45.050 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:45.050 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-04-18T14:43:45.051 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:45.051 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-04-18T14:43:45.051 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.701065+0000", 2024-04-18T14:43:45.051 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:43:45.051 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:45.051 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:45.051 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-04-18T14:43:45.051 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.701065+0000", 2024-04-18T14:43:45.051 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:43:45.051 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:45.051 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:45.051 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-04-18T14:43:45.051 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.701064+0000", 2024-04-18T14:43:45.052 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 4294967295.9999995 2024-04-18T14:43:45.052 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:45.052 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:45.052 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-04-18T14:43:45.052 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.701070+0000", 2024-04-18T14:43:45.052 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 5.6400000000000002e-06 2024-04-18T14:43:45.052 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:45.052 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:45.052 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-04-18T14:43:45.052 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.701079+0000", 2024-04-18T14:43:45.052 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 8.9590000000000001e-06 2024-04-18T14:43:45.052 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:45.052 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:45.052 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-04-18T14:43:45.053 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.701086+0000", 2024-04-18T14:43:45.053 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 6.8499999999999996e-06 2024-04-18T14:43:45.053 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:45.053 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:45.053 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-04-18T14:43:45.053 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.715764+0000", 2024-04-18T14:43:45.053 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.01467833 2024-04-18T14:43:45.053 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:45.053 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:45.053 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-04-18T14:43:45.053 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.715902+0000", 2024-04-18T14:43:45.054 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00013763499999999999 2024-04-18T14:43:45.054 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:45.054 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:45.054 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for subops from 0", 2024-04-18T14:43:45.054 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.716201+0000", 2024-04-18T14:43:45.054 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00029946200000000001 2024-04-18T14:43:45.054 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:45.054 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:45.054 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-04-18T14:43:45.054 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.721892+0000", 2024-04-18T14:43:45.054 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0056902680000000001 2024-04-18T14:43:45.054 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:45.054 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:45.055 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_commit_rec", 2024-04-18T14:43:45.055 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.722918+0000", 2024-04-18T14:43:45.055 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0010263130000000001 2024-04-18T14:43:45.055 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:45.055 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:45.055 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-04-18T14:43:45.055 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.723034+0000", 2024-04-18T14:43:45.055 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000116481 2024-04-18T14:43:45.055 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:45.055 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:45.056 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-04-18T14:43:45.056 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.723138+0000", 2024-04-18T14:43:45.056 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000103274 2024-04-18T14:43:45.056 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:43:45.056 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T14:43:45.056 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:43:45.056 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:45.056 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:45.056 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4212.0:115 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-04-18T14:43:45.056 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-04-18T14:43:20.701238+0000", 2024-04-18T14:43:45.057 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 24.316376744999999, 2024-04-18T14:43:45.057 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.02214089, 2024-04-18T14:43:45.057 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-04-18T14:43:45.057 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T14:43:45.057 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-04-18T14:43:45.057 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4212", 2024-04-18T14:43:45.057 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "172.21.15.134:0/3325451476", 2024-04-18T14:43:45.057 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 115 2024-04-18T14:43:45.057 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:45.057 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-04-18T14:43:45.057 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:45.057 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-04-18T14:43:45.057 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.701238+0000", 2024-04-18T14:43:45.058 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:43:45.058 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:45.058 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:45.058 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-04-18T14:43:45.058 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.701238+0000", 2024-04-18T14:43:45.058 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:43:45.058 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:45.058 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:45.058 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-04-18T14:43:45.058 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.701237+0000", 2024-04-18T14:43:45.058 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 4294967295.9999986 2024-04-18T14:43:45.058 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:45.058 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:45.058 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-04-18T14:43:45.058 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.701377+0000", 2024-04-18T14:43:45.059 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000139849 2024-04-18T14:43:45.059 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:45.059 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:45.059 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-04-18T14:43:45.059 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.701392+0000", 2024-04-18T14:43:45.059 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.5322e-05 2024-04-18T14:43:45.059 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:45.059 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:45.059 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-04-18T14:43:45.059 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.701401+0000", 2024-04-18T14:43:45.059 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 8.9430000000000006e-06 2024-04-18T14:43:45.059 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:45.059 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:45.059 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-04-18T14:43:45.060 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.719830+0000", 2024-04-18T14:43:45.060 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.018429009999999999 2024-04-18T14:43:45.060 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:45.060 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:45.060 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-04-18T14:43:45.060 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.720057+0000", 2024-04-18T14:43:45.060 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00022700500000000001 2024-04-18T14:43:45.060 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:45.060 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:45.060 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for subops from 0", 2024-04-18T14:43:45.060 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.720408+0000", 2024-04-18T14:43:45.060 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00035086399999999999 2024-04-18T14:43:45.060 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:45.060 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:45.060 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-04-18T14:43:45.061 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.723171+0000", 2024-04-18T14:43:45.061 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.002762708 2024-04-18T14:43:45.061 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:45.061 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:45.061 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_commit_rec", 2024-04-18T14:43:45.061 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.723264+0000", 2024-04-18T14:43:45.061 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 9.2888999999999998e-05 2024-04-18T14:43:45.061 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:45.061 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:45.061 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-04-18T14:43:45.061 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.723329+0000", 2024-04-18T14:43:45.061 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 6.5394000000000004e-05 2024-04-18T14:43:45.062 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:45.062 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:45.062 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-04-18T14:43:45.062 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.723379+0000", 2024-04-18T14:43:45.062 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 5.0126000000000001e-05 2024-04-18T14:43:45.062 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:43:45.062 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T14:43:45.062 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:43:45.062 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:45.062 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:45.062 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4212.0:116 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-04-18T14:43:45.062 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-04-18T14:43:20.701416+0000", 2024-04-18T14:43:45.062 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 24.316199469000001, 2024-04-18T14:43:45.062 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.024681692000000002, 2024-04-18T14:43:45.062 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-04-18T14:43:45.063 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T14:43:45.063 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-04-18T14:43:45.063 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4212", 2024-04-18T14:43:45.063 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "172.21.15.134:0/3325451476", 2024-04-18T14:43:45.063 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 116 2024-04-18T14:43:45.063 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:45.063 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-04-18T14:43:45.063 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:45.063 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-04-18T14:43:45.063 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.701416+0000", 2024-04-18T14:43:45.063 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:43:45.063 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:45.063 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:45.063 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-04-18T14:43:45.064 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.701416+0000", 2024-04-18T14:43:45.064 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:43:45.064 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:45.064 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:45.064 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-04-18T14:43:45.064 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.701415+0000", 2024-04-18T14:43:45.064 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 4294967295.999999 2024-04-18T14:43:45.064 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:45.064 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:45.064 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-04-18T14:43:45.064 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.701434+0000", 2024-04-18T14:43:45.064 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.9258000000000001e-05 2024-04-18T14:43:45.064 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:45.064 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:45.065 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-04-18T14:43:45.065 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.701445+0000", 2024-04-18T14:43:45.065 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.0485999999999999e-05 2024-04-18T14:43:45.065 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:45.065 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:45.065 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-04-18T14:43:45.065 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.701452+0000", 2024-04-18T14:43:45.066 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 7.9060000000000002e-06 2024-04-18T14:43:45.066 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:45.066 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:45.066 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-04-18T14:43:45.066 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.723471+0000", 2024-04-18T14:43:45.066 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.022019047 2024-04-18T14:43:45.066 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:45.066 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:45.066 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-04-18T14:43:45.066 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.723697+0000", 2024-04-18T14:43:45.066 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000225634 2024-04-18T14:43:45.066 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:45.066 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:45.067 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for subops from 0", 2024-04-18T14:43:45.067 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.724053+0000", 2024-04-18T14:43:45.067 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000355798 2024-04-18T14:43:45.067 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:45.067 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:45.067 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_commit_rec", 2024-04-18T14:43:45.067 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.725675+0000", 2024-04-18T14:43:45.067 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.001622264 2024-04-18T14:43:45.067 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:45.067 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:45.067 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-04-18T14:43:45.067 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.725879+0000", 2024-04-18T14:43:45.067 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00020390299999999999 2024-04-18T14:43:45.067 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:45.067 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:45.068 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-04-18T14:43:45.068 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.725994+0000", 2024-04-18T14:43:45.068 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000115158 2024-04-18T14:43:45.068 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:45.068 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:45.068 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-04-18T14:43:45.068 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.726097+0000", 2024-04-18T14:43:45.068 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000103231 2024-04-18T14:43:45.068 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:43:45.068 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T14:43:45.068 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:43:45.068 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:45.069 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:45.069 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4212.0:117 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-04-18T14:43:45.069 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-04-18T14:43:20.701462+0000", 2024-04-18T14:43:45.069 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 24.316153635999999, 2024-04-18T14:43:45.069 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.025118439999999999, 2024-04-18T14:43:45.069 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-04-18T14:43:45.069 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T14:43:45.069 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-04-18T14:43:45.069 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4212", 2024-04-18T14:43:45.069 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "172.21.15.134:0/3325451476", 2024-04-18T14:43:45.069 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 117 2024-04-18T14:43:45.069 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:45.069 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-04-18T14:43:45.070 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:45.070 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-04-18T14:43:45.070 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.701462+0000", 2024-04-18T14:43:45.070 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:43:45.070 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:45.070 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:45.070 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-04-18T14:43:45.070 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.701462+0000", 2024-04-18T14:43:45.070 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:43:45.070 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:45.070 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:45.070 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-04-18T14:43:45.070 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.701461+0000", 2024-04-18T14:43:45.071 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 4294967295.9999995 2024-04-18T14:43:45.071 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:45.071 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:45.071 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-04-18T14:43:45.071 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.701468+0000", 2024-04-18T14:43:45.071 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 6.6630000000000004e-06 2024-04-18T14:43:45.071 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:45.071 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:45.071 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-04-18T14:43:45.071 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.701478+0000", 2024-04-18T14:43:45.071 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.0796e-05 2024-04-18T14:43:45.071 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:45.071 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:45.071 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-04-18T14:43:45.071 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.701486+0000", 2024-04-18T14:43:45.072 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 7.3490000000000003e-06 2024-04-18T14:43:45.072 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:45.072 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:45.072 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-04-18T14:43:45.072 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.724772+0000", 2024-04-18T14:43:45.072 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.023286554000000001 2024-04-18T14:43:45.072 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:45.072 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:45.072 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-04-18T14:43:45.072 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.724901+0000", 2024-04-18T14:43:45.072 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00012827499999999999 2024-04-18T14:43:45.072 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:45.072 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:45.073 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for subops from 0", 2024-04-18T14:43:45.073 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.725102+0000", 2024-04-18T14:43:45.073 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000201471 2024-04-18T14:43:45.073 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:45.073 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:45.073 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_commit_rec", 2024-04-18T14:43:45.073 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.726349+0000", 2024-04-18T14:43:45.073 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.001247061 2024-04-18T14:43:45.073 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:45.073 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:45.073 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-04-18T14:43:45.073 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.726373+0000", 2024-04-18T14:43:45.073 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.4207999999999999e-05 2024-04-18T14:43:45.073 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:45.073 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:45.074 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-04-18T14:43:45.074 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.726488+0000", 2024-04-18T14:43:45.074 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000115118 2024-04-18T14:43:45.074 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:45.074 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:45.074 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-04-18T14:43:45.074 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.726580+0000", 2024-04-18T14:43:45.074 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 9.1612000000000003e-05 2024-04-18T14:43:45.074 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:43:45.074 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T14:43:45.074 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:43:45.074 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:45.074 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:45.075 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4212.0:141 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-04-18T14:43:45.075 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-04-18T14:43:20.875689+0000", 2024-04-18T14:43:45.075 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 24.141926180999999, 2024-04-18T14:43:45.075 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.018885018999999999, 2024-04-18T14:43:45.075 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-04-18T14:43:45.075 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T14:43:45.075 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-04-18T14:43:45.075 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4212", 2024-04-18T14:43:45.075 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "172.21.15.134:0/3325451476", 2024-04-18T14:43:45.076 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 141 2024-04-18T14:43:45.076 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:45.076 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-04-18T14:43:45.076 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:45.076 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-04-18T14:43:45.076 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.875689+0000", 2024-04-18T14:43:45.076 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:43:45.076 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:45.076 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:45.076 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-04-18T14:43:45.076 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.875689+0000", 2024-04-18T14:43:45.076 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:43:45.077 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:45.077 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:45.077 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-04-18T14:43:45.077 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.875689+0000", 2024-04-18T14:43:45.077 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 4294967295.9999995 2024-04-18T14:43:45.077 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:45.077 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:45.077 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-04-18T14:43:45.077 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.875692+0000", 2024-04-18T14:43:45.077 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.095e-06 2024-04-18T14:43:45.077 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:45.077 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:45.077 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-04-18T14:43:45.077 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.875695+0000", 2024-04-18T14:43:45.078 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.552e-06 2024-04-18T14:43:45.078 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:45.078 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:45.078 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-04-18T14:43:45.078 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.875698+0000", 2024-04-18T14:43:45.078 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.9900000000000002e-06 2024-04-18T14:43:45.078 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:45.078 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:45.078 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-04-18T14:43:45.078 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.884737+0000", 2024-04-18T14:43:45.078 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0090389530000000006 2024-04-18T14:43:45.078 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:45.078 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:45.078 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-04-18T14:43:45.079 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.884963+0000", 2024-04-18T14:43:45.079 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00022563800000000001 2024-04-18T14:43:45.079 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:45.079 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:45.079 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for subops from 0", 2024-04-18T14:43:45.079 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.885324+0000", 2024-04-18T14:43:45.079 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000360804 2024-04-18T14:43:45.079 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:45.079 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:45.079 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-04-18T14:43:45.079 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.891966+0000", 2024-04-18T14:43:45.079 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0066426539999999996 2024-04-18T14:43:45.079 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:45.080 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:45.080 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_commit_rec", 2024-04-18T14:43:45.080 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.894346+0000", 2024-04-18T14:43:45.080 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.002379899 2024-04-18T14:43:45.080 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:45.080 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:45.080 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-04-18T14:43:45.080 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.894472+0000", 2024-04-18T14:43:45.080 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00012594900000000001 2024-04-18T14:43:45.080 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:45.080 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:45.080 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-04-18T14:43:45.080 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.894574+0000", 2024-04-18T14:43:45.081 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000101852 2024-04-18T14:43:45.081 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:43:45.081 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T14:43:45.081 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:43:45.081 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:45.081 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:45.081 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4212.0:163 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-04-18T14:43:45.081 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-04-18T14:43:21.039657+0000", 2024-04-18T14:43:45.081 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 23.977957836000002, 2024-04-18T14:43:45.081 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.019955601999999999, 2024-04-18T14:43:45.081 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-04-18T14:43:45.081 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T14:43:45.081 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-04-18T14:43:45.081 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4212", 2024-04-18T14:43:45.081 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "172.21.15.134:0/3325451476", 2024-04-18T14:43:45.082 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 163 2024-04-18T14:43:45.082 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:45.082 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-04-18T14:43:45.082 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:45.082 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-04-18T14:43:45.082 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:21.039657+0000", 2024-04-18T14:43:45.082 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:43:45.082 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:45.082 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:45.082 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-04-18T14:43:45.082 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:21.039657+0000", 2024-04-18T14:43:45.082 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:43:45.082 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:45.083 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:45.083 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-04-18T14:43:45.083 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:21.039657+0000", 2024-04-18T14:43:45.083 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 4294967295.999999 2024-04-18T14:43:45.083 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:45.083 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:45.083 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-04-18T14:43:45.083 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:21.039663+0000", 2024-04-18T14:43:45.083 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 6.4300000000000003e-06 2024-04-18T14:43:45.083 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:45.083 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:45.083 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-04-18T14:43:45.083 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:21.039673+0000", 2024-04-18T14:43:45.083 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.0105999999999999e-05 2024-04-18T14:43:45.084 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:45.084 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:45.084 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-04-18T14:43:45.084 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:21.039681+0000", 2024-04-18T14:43:45.084 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 7.5560000000000002e-06 2024-04-18T14:43:45.084 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:45.084 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:45.084 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-04-18T14:43:45.084 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:21.054744+0000", 2024-04-18T14:43:45.084 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.015062766 2024-04-18T14:43:45.084 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:45.084 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:45.084 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-04-18T14:43:45.084 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:21.054971+0000", 2024-04-18T14:43:45.085 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00022734200000000001 2024-04-18T14:43:45.085 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:45.085 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:45.085 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for subops from 0", 2024-04-18T14:43:45.085 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:21.055343+0000", 2024-04-18T14:43:45.085 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000372004 2024-04-18T14:43:45.085 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:45.085 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:45.085 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-04-18T14:43:45.085 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:21.059373+0000", 2024-04-18T14:43:45.085 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0040298080000000002 2024-04-18T14:43:45.085 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:45.085 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:45.085 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_commit_rec", 2024-04-18T14:43:45.085 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:21.059468+0000", 2024-04-18T14:43:45.086 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 9.5753000000000003e-05 2024-04-18T14:43:45.086 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:45.086 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:45.086 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-04-18T14:43:45.086 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:21.059553+0000", 2024-04-18T14:43:45.086 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 8.4538999999999998e-05 2024-04-18T14:43:45.086 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:45.086 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:45.086 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-04-18T14:43:45.086 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:21.059613+0000", 2024-04-18T14:43:45.086 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 6.0055e-05 2024-04-18T14:43:45.087 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:43:45.087 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T14:43:45.087 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:43:45.087 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:45.087 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:45.087 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4212.0:164 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-04-18T14:43:45.087 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-04-18T14:43:21.039689+0000", 2024-04-18T14:43:45.087 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 23.977925965000001, 2024-04-18T14:43:45.087 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.020243589999999999, 2024-04-18T14:43:45.087 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-04-18T14:43:45.087 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T14:43:45.088 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-04-18T14:43:45.088 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4212", 2024-04-18T14:43:45.088 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "172.21.15.134:0/3325451476", 2024-04-18T14:43:45.088 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 164 2024-04-18T14:43:45.088 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:45.088 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-04-18T14:43:45.088 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:45.088 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-04-18T14:43:45.088 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:21.039689+0000", 2024-04-18T14:43:45.088 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:43:45.088 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:45.088 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:45.088 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-04-18T14:43:45.089 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:21.039689+0000", 2024-04-18T14:43:45.089 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:43:45.089 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:45.089 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:45.089 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-04-18T14:43:45.089 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:21.039689+0000", 2024-04-18T14:43:45.089 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 4294967295.9999995 2024-04-18T14:43:45.089 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:45.089 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:45.089 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-04-18T14:43:45.089 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:21.039773+0000", 2024-04-18T14:43:45.089 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 8.4040000000000002e-05 2024-04-18T14:43:45.089 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:45.089 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:45.090 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-04-18T14:43:45.090 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:21.039783+0000", 2024-04-18T14:43:45.090 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.0786e-05 2024-04-18T14:43:45.090 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:45.090 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:45.090 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-04-18T14:43:45.090 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:21.039791+0000", 2024-04-18T14:43:45.090 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 7.8320000000000006e-06 2024-04-18T14:43:45.090 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:45.090 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:45.090 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-04-18T14:43:45.090 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:21.056266+0000", 2024-04-18T14:43:45.090 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.016474586999999999 2024-04-18T14:43:45.091 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:45.091 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:45.091 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-04-18T14:43:45.091 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:21.056394+0000", 2024-04-18T14:43:45.091 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00012773299999999999 2024-04-18T14:43:45.091 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:45.091 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:45.091 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for subops from 0", 2024-04-18T14:43:45.091 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:21.056584+0000", 2024-04-18T14:43:45.091 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00019052500000000001 2024-04-18T14:43:45.091 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:45.091 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:45.091 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_commit_rec", 2024-04-18T14:43:45.091 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:21.059718+0000", 2024-04-18T14:43:45.092 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0031340999999999999 2024-04-18T14:43:45.092 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:45.092 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:45.092 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-04-18T14:43:45.092 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:21.059746+0000", 2024-04-18T14:43:45.092 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.7447999999999999e-05 2024-04-18T14:43:45.092 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:45.092 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:45.092 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-04-18T14:43:45.092 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:21.059876+0000", 2024-04-18T14:43:45.092 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00013080599999999999 2024-04-18T14:43:45.092 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:45.092 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:45.092 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-04-18T14:43:45.093 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:21.059933+0000", 2024-04-18T14:43:45.093 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 5.6372999999999997e-05 2024-04-18T14:43:45.093 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:43:45.093 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T14:43:45.093 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:43:45.093 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:45.093 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:45.093 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4212.0:165 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-04-18T14:43:45.093 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-04-18T14:43:21.039800+0000", 2024-04-18T14:43:45.093 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 23.977814764000001, 2024-04-18T14:43:45.093 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.022777954, 2024-04-18T14:43:45.093 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-04-18T14:43:45.093 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T14:43:45.094 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-04-18T14:43:45.094 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4212", 2024-04-18T14:43:45.094 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "172.21.15.134:0/3325451476", 2024-04-18T14:43:45.094 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 165 2024-04-18T14:43:45.094 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:45.094 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-04-18T14:43:45.094 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:45.094 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-04-18T14:43:45.094 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:21.039800+0000", 2024-04-18T14:43:45.094 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:43:45.094 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:45.094 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:45.094 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-04-18T14:43:45.094 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:21.039800+0000", 2024-04-18T14:43:45.095 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:43:45.095 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:45.095 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:45.095 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-04-18T14:43:45.095 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:21.039800+0000", 2024-04-18T14:43:45.095 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 4294967295.999999 2024-04-18T14:43:45.095 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:45.095 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:45.095 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-04-18T14:43:45.095 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:21.039806+0000", 2024-04-18T14:43:45.095 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 6.263e-06 2024-04-18T14:43:45.095 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:45.095 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:45.095 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-04-18T14:43:45.096 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:21.039815+0000", 2024-04-18T14:43:45.096 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 9.0790000000000007e-06 2024-04-18T14:43:45.096 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:45.096 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:45.096 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-04-18T14:43:45.096 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:21.039822+0000", 2024-04-18T14:43:45.096 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 6.9929999999999998e-06 2024-04-18T14:43:45.096 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:45.096 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:45.096 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-04-18T14:43:45.096 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:21.058092+0000", 2024-04-18T14:43:45.096 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.018269884 2024-04-18T14:43:45.096 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:45.096 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:45.096 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-04-18T14:43:45.097 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:21.058307+0000", 2024-04-18T14:43:45.097 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00021547600000000001 2024-04-18T14:43:45.097 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:45.097 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:45.097 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for subops from 0", 2024-04-18T14:43:45.097 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:21.058667+0000", 2024-04-18T14:43:45.097 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00035945500000000001 2024-04-18T14:43:45.097 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:45.097 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:45.097 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_commit_rec", 2024-04-18T14:43:45.097 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:21.060393+0000", 2024-04-18T14:43:45.097 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0017262619999999999 2024-04-18T14:43:45.098 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:45.098 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:45.098 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-04-18T14:43:45.098 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:21.062336+0000", 2024-04-18T14:43:45.098 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.001943078 2024-04-18T14:43:45.098 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:45.098 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:45.098 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-04-18T14:43:45.098 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:21.062471+0000", 2024-04-18T14:43:45.098 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00013455300000000001 2024-04-18T14:43:45.098 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:45.098 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:45.098 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-04-18T14:43:45.099 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:21.062578+0000", 2024-04-18T14:43:45.099 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00010770800000000001 2024-04-18T14:43:45.099 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:43:45.099 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T14:43:45.099 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:43:45.099 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:45.099 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:45.099 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4212.0:183 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-04-18T14:43:45.099 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-04-18T14:43:21.210978+0000", 2024-04-18T14:43:45.099 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 23.806637483999999, 2024-04-18T14:43:45.099 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.018803698000000001, 2024-04-18T14:43:45.099 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-04-18T14:43:45.099 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T14:43:45.099 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-04-18T14:43:45.100 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4212", 2024-04-18T14:43:45.100 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "172.21.15.134:0/3325451476", 2024-04-18T14:43:45.100 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 183 2024-04-18T14:43:45.100 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:45.100 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-04-18T14:43:45.100 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:45.100 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-04-18T14:43:45.100 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:21.210978+0000", 2024-04-18T14:43:45.100 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:43:45.100 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:45.100 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:45.100 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-04-18T14:43:45.100 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:21.210978+0000", 2024-04-18T14:43:45.101 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:43:45.101 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:45.101 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:45.101 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-04-18T14:43:45.101 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:21.210977+0000", 2024-04-18T14:43:45.101 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 4294967295.999999 2024-04-18T14:43:45.101 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:45.101 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:45.101 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-04-18T14:43:45.101 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:21.210984+0000", 2024-04-18T14:43:45.101 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 7.199e-06 2024-04-18T14:43:45.101 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:45.101 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:45.102 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-04-18T14:43:45.102 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:21.210994+0000", 2024-04-18T14:43:45.102 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.0353000000000001e-05 2024-04-18T14:43:45.102 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:45.102 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:45.102 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-04-18T14:43:45.102 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:21.211001+0000", 2024-04-18T14:43:45.102 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 6.9630000000000001e-06 2024-04-18T14:43:45.102 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:45.102 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:45.102 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-04-18T14:43:45.102 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:21.220821+0000", 2024-04-18T14:43:45.102 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0098195509999999993 2024-04-18T14:43:45.102 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:45.102 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:45.103 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-04-18T14:43:45.103 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:21.220960+0000", 2024-04-18T14:43:45.103 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000138942 2024-04-18T14:43:45.103 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:45.103 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:45.103 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for subops from 0", 2024-04-18T14:43:45.103 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:21.221161+0000", 2024-04-18T14:43:45.103 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00020154999999999999 2024-04-18T14:43:45.103 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:45.103 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:45.103 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_commit_rec", 2024-04-18T14:43:45.103 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:21.226409+0000", 2024-04-18T14:43:45.103 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0052475489999999998 2024-04-18T14:43:45.103 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:45.103 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:45.104 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-04-18T14:43:45.104 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:21.229544+0000", 2024-04-18T14:43:45.104 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0031353129999999998 2024-04-18T14:43:45.104 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:45.104 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:45.104 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-04-18T14:43:45.104 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:21.229680+0000", 2024-04-18T14:43:45.104 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00013617300000000001 2024-04-18T14:43:45.104 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:45.104 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:45.104 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-04-18T14:43:45.104 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:21.229781+0000", 2024-04-18T14:43:45.104 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000101062 2024-04-18T14:43:45.105 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:43:45.105 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T14:43:45.105 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:43:45.105 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:45.105 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:45.105 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4212.0:184 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-04-18T14:43:45.105 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-04-18T14:43:21.211009+0000", 2024-04-18T14:43:45.105 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 23.806606064, 2024-04-18T14:43:45.105 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.018995425999999999, 2024-04-18T14:43:45.105 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-04-18T14:43:45.105 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T14:43:45.105 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-04-18T14:43:45.105 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4212", 2024-04-18T14:43:45.105 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "172.21.15.134:0/3325451476", 2024-04-18T14:43:45.106 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 184 2024-04-18T14:43:45.106 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:45.106 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-04-18T14:43:45.106 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:45.106 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-04-18T14:43:45.106 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:21.211009+0000", 2024-04-18T14:43:45.106 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:43:45.106 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:45.106 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:45.106 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-04-18T14:43:45.106 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:21.211009+0000", 2024-04-18T14:43:45.106 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:43:45.106 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:45.107 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:45.107 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-04-18T14:43:45.107 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:21.211009+0000", 2024-04-18T14:43:45.107 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 4294967295.9999995 2024-04-18T14:43:45.107 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:45.107 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:45.107 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-04-18T14:43:45.107 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:21.211014+0000", 2024-04-18T14:43:45.107 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 5.5339999999999999e-06 2024-04-18T14:43:45.107 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:45.107 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:45.107 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-04-18T14:43:45.107 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:21.211023+0000", 2024-04-18T14:43:45.107 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 9.0319999999999992e-06 2024-04-18T14:43:45.108 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:45.108 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:45.108 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-04-18T14:43:45.108 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:21.211035+0000", 2024-04-18T14:43:45.108 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.1875999999999999e-05 2024-04-18T14:43:45.108 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:45.108 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:45.108 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-04-18T14:43:45.108 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:21.222820+0000", 2024-04-18T14:43:45.108 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.011784901 2024-04-18T14:43:45.108 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:45.109 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:45.109 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-04-18T14:43:45.109 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:21.222958+0000", 2024-04-18T14:43:45.109 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00013764199999999999 2024-04-18T14:43:45.109 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:45.109 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:45.109 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for subops from 0", 2024-04-18T14:43:45.109 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:21.223154+0000", 2024-04-18T14:43:45.109 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000196701 2024-04-18T14:43:45.109 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:45.109 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:45.109 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_commit_rec", 2024-04-18T14:43:45.109 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:21.229521+0000", 2024-04-18T14:43:45.110 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0063666130000000001 2024-04-18T14:43:45.110 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:45.110 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:45.110 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-04-18T14:43:45.110 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:21.229803+0000", 2024-04-18T14:43:45.110 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00028222700000000002 2024-04-18T14:43:45.110 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:45.110 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:45.110 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-04-18T14:43:45.110 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:21.229913+0000", 2024-04-18T14:43:45.110 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000109441 2024-04-18T14:43:45.110 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:45.110 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:45.110 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-04-18T14:43:45.111 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:21.230005+0000", 2024-04-18T14:43:45.111 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 9.2078999999999997e-05 2024-04-18T14:43:45.111 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:43:45.111 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T14:43:45.111 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:43:45.111 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:45.111 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:45.111 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4212.0:185 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-04-18T14:43:45.111 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-04-18T14:43:21.211070+0000", 2024-04-18T14:43:45.111 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 23.806545251999999, 2024-04-18T14:43:45.111 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.019187958000000001, 2024-04-18T14:43:45.111 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-04-18T14:43:45.111 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T14:43:45.112 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-04-18T14:43:45.112 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4212", 2024-04-18T14:43:45.112 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "172.21.15.134:0/3325451476", 2024-04-18T14:43:45.112 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 185 2024-04-18T14:43:45.112 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:45.112 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-04-18T14:43:45.112 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:45.112 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-04-18T14:43:45.112 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:21.211070+0000", 2024-04-18T14:43:45.112 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:43:45.112 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:45.112 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:45.112 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-04-18T14:43:45.112 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:21.211070+0000", 2024-04-18T14:43:45.113 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:43:45.113 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:45.113 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:45.113 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-04-18T14:43:45.113 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:21.211069+0000", 2024-04-18T14:43:45.113 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 4294967295.9999986 2024-04-18T14:43:45.113 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:45.113 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:45.113 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-04-18T14:43:45.113 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:21.211194+0000", 2024-04-18T14:43:45.113 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00012547599999999999 2024-04-18T14:43:45.113 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:45.113 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:45.113 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-04-18T14:43:45.114 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:21.211233+0000", 2024-04-18T14:43:45.114 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.8556999999999997e-05 2024-04-18T14:43:45.114 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:45.114 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:45.114 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-04-18T14:43:45.114 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:21.211242+0000", 2024-04-18T14:43:45.114 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 9.5929999999999995e-06 2024-04-18T14:43:45.114 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:45.114 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:45.114 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-04-18T14:43:45.114 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:21.223832+0000", 2024-04-18T14:43:45.114 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.01258977 2024-04-18T14:43:45.115 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:45.115 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:45.115 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-04-18T14:43:45.115 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:21.224067+0000", 2024-04-18T14:43:45.115 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00023518399999999999 2024-04-18T14:43:45.115 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:45.115 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:45.115 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for subops from 0", 2024-04-18T14:43:45.115 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:21.224435+0000", 2024-04-18T14:43:45.115 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00036764399999999998 2024-04-18T14:43:45.115 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:45.115 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:45.115 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-04-18T14:43:45.116 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:21.230024+0000", 2024-04-18T14:43:45.116 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0055886479999999999 2024-04-18T14:43:45.116 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:45.116 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:45.116 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_commit_rec", 2024-04-18T14:43:45.116 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:21.230124+0000", 2024-04-18T14:43:45.116 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00010045899999999999 2024-04-18T14:43:45.116 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:45.116 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:45.116 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-04-18T14:43:45.116 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:21.230201+0000", 2024-04-18T14:43:45.116 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 7.6509999999999998e-05 2024-04-18T14:43:45.117 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:45.117 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:45.117 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-04-18T14:43:45.117 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:21.230258+0000", 2024-04-18T14:43:45.117 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 5.7395999999999997e-05 2024-04-18T14:43:45.117 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:43:45.117 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T14:43:45.117 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:43:45.117 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:45.117 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:45.117 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4212.0:186 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-04-18T14:43:45.117 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-04-18T14:43:21.211255+0000", 2024-04-18T14:43:45.117 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 23.806360643000001, 2024-04-18T14:43:45.117 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.019388148000000001, 2024-04-18T14:43:45.118 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-04-18T14:43:45.118 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T14:43:45.118 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-04-18T14:43:45.118 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4212", 2024-04-18T14:43:45.118 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "172.21.15.134:0/3325451476", 2024-04-18T14:43:45.118 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 186 2024-04-18T14:43:45.118 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:45.118 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-04-18T14:43:45.118 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:45.118 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-04-18T14:43:45.118 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:21.211255+0000", 2024-04-18T14:43:45.118 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:43:45.118 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:45.119 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:45.119 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-04-18T14:43:45.119 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:21.211255+0000", 2024-04-18T14:43:45.119 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:43:45.119 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:45.119 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:45.119 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-04-18T14:43:45.119 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:21.211254+0000", 2024-04-18T14:43:45.119 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 4294967295.999999 2024-04-18T14:43:45.121 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:45.122 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:45.122 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-04-18T14:43:45.122 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:21.211261+0000", 2024-04-18T14:43:45.122 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 7.0190000000000001e-06 2024-04-18T14:43:45.122 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:45.122 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:45.122 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-04-18T14:43:45.122 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:21.211270+0000", 2024-04-18T14:43:45.122 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 9.5189999999999998e-06 2024-04-18T14:43:45.122 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:45.122 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:45.123 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-04-18T14:43:45.123 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:21.211277+0000", 2024-04-18T14:43:45.123 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 7.1400000000000002e-06 2024-04-18T14:43:45.123 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:45.123 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:45.123 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-04-18T14:43:45.123 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:21.226501+0000", 2024-04-18T14:43:45.123 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.015224115999999999 2024-04-18T14:43:45.123 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:45.123 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:45.123 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-04-18T14:43:45.123 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:21.226767+0000", 2024-04-18T14:43:45.123 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00026582199999999998 2024-04-18T14:43:45.123 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:45.124 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:45.124 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for subops from 0", 2024-04-18T14:43:45.124 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:21.227160+0000", 2024-04-18T14:43:45.124 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000392803 2024-04-18T14:43:45.124 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:45.124 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:45.124 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_commit_rec", 2024-04-18T14:43:45.124 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:21.230391+0000", 2024-04-18T14:43:45.124 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.003231182 2024-04-18T14:43:45.124 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:45.124 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:45.124 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-04-18T14:43:45.124 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:21.230414+0000", 2024-04-18T14:43:45.125 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.3045e-05 2024-04-18T14:43:45.125 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:45.125 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:45.125 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-04-18T14:43:45.125 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:21.230543+0000", 2024-04-18T14:43:45.125 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00012871900000000001 2024-04-18T14:43:45.125 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:45.125 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:45.125 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-04-18T14:43:45.125 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:21.230643+0000", 2024-04-18T14:43:45.125 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 9.9766000000000007e-05 2024-04-18T14:43:45.125 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:43:45.125 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T14:43:45.126 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:43:45.126 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:45.126 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:45.126 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4212.0:187 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-04-18T14:43:45.126 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-04-18T14:43:21.211285+0000", 2024-04-18T14:43:45.126 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 23.806329831999999, 2024-04-18T14:43:45.126 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.022261811999999999, 2024-04-18T14:43:45.126 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-04-18T14:43:45.126 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T14:43:45.126 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-04-18T14:43:45.126 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4212", 2024-04-18T14:43:45.126 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "172.21.15.134:0/3325451476", 2024-04-18T14:43:45.126 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 187 2024-04-18T14:43:45.127 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:45.127 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-04-18T14:43:45.127 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:45.127 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-04-18T14:43:45.127 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:21.211285+0000", 2024-04-18T14:43:45.127 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:43:45.127 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:45.127 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:45.127 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-04-18T14:43:45.127 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:21.211285+0000", 2024-04-18T14:43:45.127 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:43:45.127 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:45.127 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:45.127 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-04-18T14:43:45.127 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:21.211285+0000", 2024-04-18T14:43:45.128 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 4294967295.9999995 2024-04-18T14:43:45.128 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:45.128 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:45.128 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-04-18T14:43:45.128 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:21.211290+0000", 2024-04-18T14:43:45.128 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 5.6999999999999996e-06 2024-04-18T14:43:45.128 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:45.128 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:45.128 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-04-18T14:43:45.128 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:21.211300+0000", 2024-04-18T14:43:45.128 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 9.0890000000000006e-06 2024-04-18T14:43:45.128 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:45.129 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:45.129 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-04-18T14:43:45.129 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:21.211306+0000", 2024-04-18T14:43:45.129 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 6.8029999999999999e-06 2024-04-18T14:43:45.129 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:45.129 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:45.129 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-04-18T14:43:45.129 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:21.228301+0000", 2024-04-18T14:43:45.129 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.016994598999999999 2024-04-18T14:43:45.129 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:45.129 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:45.129 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-04-18T14:43:45.129 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:21.228558+0000", 2024-04-18T14:43:45.129 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00025666600000000001 2024-04-18T14:43:45.130 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:45.130 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:45.130 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for subops from 0", 2024-04-18T14:43:45.130 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:21.228844+0000", 2024-04-18T14:43:45.130 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00028685700000000001 2024-04-18T14:43:45.130 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:45.130 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:45.130 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-04-18T14:43:45.130 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:21.233311+0000", 2024-04-18T14:43:45.130 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0044661400000000004 2024-04-18T14:43:45.130 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:45.130 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:45.130 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_commit_rec", 2024-04-18T14:43:45.131 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:21.233386+0000", 2024-04-18T14:43:45.131 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 7.5184000000000004e-05 2024-04-18T14:43:45.131 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:45.131 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:45.131 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-04-18T14:43:45.131 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:21.233457+0000", 2024-04-18T14:43:45.131 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 7.0914999999999994e-05 2024-04-18T14:43:45.131 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:45.131 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:45.131 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-04-18T14:43:45.131 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:21.233547+0000", 2024-04-18T14:43:45.131 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 9.0486000000000001e-05 2024-04-18T14:43:45.132 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:43:45.132 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T14:43:45.132 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:43:45.132 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:45.132 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:45.132 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4212.0:188 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-04-18T14:43:45.132 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-04-18T14:43:21.211314+0000", 2024-04-18T14:43:45.132 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 23.806301084000001, 2024-04-18T14:43:45.132 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.022928674999999999, 2024-04-18T14:43:45.132 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-04-18T14:43:45.132 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T14:43:45.132 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-04-18T14:43:45.132 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4212", 2024-04-18T14:43:45.132 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "172.21.15.134:0/3325451476", 2024-04-18T14:43:45.133 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 188 2024-04-18T14:43:45.133 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:45.133 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-04-18T14:43:45.133 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:45.133 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-04-18T14:43:45.133 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:21.211314+0000", 2024-04-18T14:43:45.133 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:43:45.133 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:45.133 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:45.133 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-04-18T14:43:45.133 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:21.211314+0000", 2024-04-18T14:43:45.133 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:43:45.133 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:45.134 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:45.134 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-04-18T14:43:45.134 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:21.211314+0000", 2024-04-18T14:43:45.134 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 4294967295.9999995 2024-04-18T14:43:45.134 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:45.134 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:45.134 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-04-18T14:43:45.134 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:21.211413+0000", 2024-04-18T14:43:45.134 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 9.9754999999999996e-05 2024-04-18T14:43:45.134 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:45.134 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:45.135 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-04-18T14:43:45.135 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:21.211425+0000", 2024-04-18T14:43:45.135 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.1259e-05 2024-04-18T14:43:45.135 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:45.135 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:45.135 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-04-18T14:43:45.135 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:21.211435+0000", 2024-04-18T14:43:45.135 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 9.9990000000000003e-06 2024-04-18T14:43:45.135 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:45.135 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:45.135 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-04-18T14:43:45.135 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:21.230726+0000", 2024-04-18T14:43:45.135 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.019291490000000001 2024-04-18T14:43:45.136 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:45.136 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:45.136 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-04-18T14:43:45.136 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:21.230855+0000", 2024-04-18T14:43:45.136 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000129102 2024-04-18T14:43:45.136 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:45.136 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:45.136 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for subops from 0", 2024-04-18T14:43:45.136 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:21.231049+0000", 2024-04-18T14:43:45.136 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00019388900000000001 2024-04-18T14:43:45.136 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:45.136 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:45.136 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-04-18T14:43:45.137 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:21.233333+0000", 2024-04-18T14:43:45.137 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0022836309999999999 2024-04-18T14:43:45.137 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:45.137 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:45.137 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_commit_rec", 2024-04-18T14:43:45.137 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:21.234118+0000", 2024-04-18T14:43:45.137 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00078523999999999998 2024-04-18T14:43:45.137 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:45.137 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:45.137 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-04-18T14:43:45.137 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:21.234191+0000", 2024-04-18T14:43:45.137 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 7.3028000000000006e-05 2024-04-18T14:43:45.137 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:45.137 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:45.138 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-04-18T14:43:45.138 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:21.234243+0000", 2024-04-18T14:43:45.138 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 5.1898999999999999e-05 2024-04-18T14:43:45.138 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:43:45.138 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T14:43:45.138 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:43:45.138 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:45.138 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:45.138 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4212.0:189 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-04-18T14:43:45.138 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-04-18T14:43:21.211444+0000", 2024-04-18T14:43:45.138 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 23.806171141, 2024-04-18T14:43:45.138 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.023955757000000001, 2024-04-18T14:43:45.138 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-04-18T14:43:45.138 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T14:43:45.139 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-04-18T14:43:45.139 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4212", 2024-04-18T14:43:45.139 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "172.21.15.134:0/3325451476", 2024-04-18T14:43:45.139 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 189 2024-04-18T14:43:45.139 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:45.139 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-04-18T14:43:45.139 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:45.139 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-04-18T14:43:45.139 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:21.211444+0000", 2024-04-18T14:43:45.139 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:43:45.139 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:45.139 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:45.139 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-04-18T14:43:45.139 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:21.211444+0000", 2024-04-18T14:43:45.140 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:43:45.140 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:45.140 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:45.140 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-04-18T14:43:45.140 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:21.211443+0000", 2024-04-18T14:43:45.140 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 4294967295.999999 2024-04-18T14:43:45.140 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:45.140 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:45.140 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-04-18T14:43:45.140 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:21.211450+0000", 2024-04-18T14:43:45.140 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 6.28e-06 2024-04-18T14:43:45.140 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:45.140 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:45.140 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-04-18T14:43:45.141 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:21.211459+0000", 2024-04-18T14:43:45.141 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 9.132e-06 2024-04-18T14:43:45.141 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:45.141 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:45.141 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-04-18T14:43:45.141 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:21.211466+0000", 2024-04-18T14:43:45.141 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 6.8530000000000003e-06 2024-04-18T14:43:45.141 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:45.141 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:45.141 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-04-18T14:43:45.141 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:21.231986+0000", 2024-04-18T14:43:45.141 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.020520218 2024-04-18T14:43:45.141 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:45.141 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:45.142 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-04-18T14:43:45.142 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:21.232208+0000", 2024-04-18T14:43:45.142 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000222208 2024-04-18T14:43:45.142 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:45.142 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:45.142 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for subops from 0", 2024-04-18T14:43:45.142 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:21.232551+0000", 2024-04-18T14:43:45.142 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00034289999999999999 2024-04-18T14:43:45.142 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:45.142 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:45.143 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-04-18T14:43:45.143 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:21.233981+0000", 2024-04-18T14:43:45.143 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0014303390000000001 2024-04-18T14:43:45.143 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:45.143 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:45.143 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_commit_rec", 2024-04-18T14:43:45.143 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:21.235295+0000", 2024-04-18T14:43:45.143 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0013134189999999999 2024-04-18T14:43:45.143 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:45.143 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:45.143 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-04-18T14:43:45.143 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:21.235354+0000", 2024-04-18T14:43:45.144 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 5.8928000000000002e-05 2024-04-18T14:43:45.144 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:45.144 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:45.144 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-04-18T14:43:45.144 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:21.235400+0000", 2024-04-18T14:43:45.144 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 4.6273999999999998e-05 2024-04-18T14:43:45.144 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:43:45.144 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T14:43:45.144 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:43:45.144 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:43:45.144 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T14:43:45.144 INFO:teuthology.orchestra.run.smithi096.stdout:} 2024-04-18T14:43:45.146 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-18T14:43:45.147 INFO:tasks.ceph.osd.4.smithi086.stderr:2024-04-18T14:43:45.147+0000 7f0c4c462640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 24956) UID: 0 2024-04-18T14:43:45.247 INFO:tasks.ceph.osd.0.smithi086.stderr:2024-04-18T14:43:45.247+0000 7f7cdfd78640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 24953) UID: 0 2024-04-18T14:43:45.277 INFO:teuthology.orchestra.run.smithi119.stdout:{ 2024-04-18T14:43:45.277 INFO:teuthology.orchestra.run.smithi119.stdout: "ops": [], 2024-04-18T14:43:45.277 INFO:teuthology.orchestra.run.smithi119.stdout: "num_ops": 0 2024-04-18T14:43:45.277 INFO:teuthology.orchestra.run.smithi119.stdout:} 2024-04-18T14:43:45.291 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-18T14:43:45.347 INFO:tasks.ceph.osd.11.smithi134.stderr:2024-04-18T14:43:45.352+0000 7f2d36f12640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 11 (PID: 25216) UID: 0 2024-04-18T14:43:45.369 INFO:teuthology.orchestra.run.smithi086.stderr:noscrub is unset 2024-04-18T14:43:45.370 INFO:tasks.rados.rados.0.smithi134.stdout:129: done (2 left) 2024-04-18T14:43:45.370 INFO:tasks.rados.rados.0.smithi134.stdout:130: rollback oid 31 current snap is 9 2024-04-18T14:43:45.370 INFO:tasks.rados.rados.0.smithi134.stdout:rollback oid 31 to 6 2024-04-18T14:43:45.370 INFO:tasks.rados.rados.0.smithi134.stdout:127: finishing write tid 1 to smithi13430248-44 2024-04-18T14:43:45.370 INFO:tasks.rados.rados.0.smithi134.stdout:128: finishing rollback tid 0 to smithi13430248-49 2024-04-18T14:43:45.370 INFO:tasks.rados.rados.0.smithi134.stdout:127: finishing write tid 2 to smithi13430248-44 2024-04-18T14:43:45.370 INFO:tasks.rados.rados.0.smithi134.stdout:127: finishing write tid 3 to smithi13430248-44 2024-04-18T14:43:45.370 INFO:tasks.rados.rados.0.smithi134.stdout:128: finishing rollback tid 1 to smithi13430248-49 2024-04-18T14:43:45.370 INFO:tasks.rados.rados.0.smithi134.stdout:127: finishing write tid 4 to smithi13430248-44 2024-04-18T14:43:45.370 INFO:tasks.rados.rados.0.smithi134.stdout:127: oid 44 updating version 0 to 7 2024-04-18T14:43:45.371 INFO:tasks.rados.rados.0.smithi134.stdout:127: oid 44 updating version 7 to 8 2024-04-18T14:43:45.371 INFO:tasks.rados.rados.0.smithi134.stdout:127: oid 44 version 8 is already newer than 6 2024-04-18T14:43:45.371 INFO:tasks.rados.rados.0.smithi134.stdout:update_object_version oid 44 v 8 (ObjNum 70 snap 9 seq_num 70) dirty exists 2024-04-18T14:43:45.371 INFO:tasks.rados.rados.0.smithi134.stdout:127: left oid 44 (ObjNum 70 snap 9 seq_num 70) 2024-04-18T14:43:45.371 INFO:tasks.rados.rados.0.smithi134.stdout:128: finishing rollback tid 2 to smithi13430248-49 2024-04-18T14:43:45.371 INFO:tasks.rados.rados.0.smithi134.stdout:update_object_version oid 49 v 20 (ObjNum 48 snap 0 seq_num 48) dirty exists 2024-04-18T14:43:45.371 INFO:tasks.rados.rados.0.smithi134.stdout:127: done (2 left) 2024-04-18T14:43:45.371 INFO:tasks.rados.rados.0.smithi134.stdout:128: done (1 left) 2024-04-18T14:43:45.371 INFO:tasks.rados.rados.0.smithi134.stdout:131: snap_create 2024-04-18T14:43:45.387 INFO:tasks.rados.rados.0.smithi134.stdout:130: finishing rollback tid 0 to smithi13430248-31 2024-04-18T14:43:45.387 INFO:tasks.rados.rados.0.smithi134.stdout:130: finishing rollback tid 1 to smithi13430248-31 2024-04-18T14:43:45.388 INFO:tasks.rados.rados.0.smithi134.stdout:130: finishing rollback tid 2 to smithi13430248-31 2024-04-18T14:43:45.388 INFO:tasks.rados.rados.0.smithi134.stdout:update_object_version oid 31 v 6 (ObjNum 30 snap 0 seq_num 30) dirty exists 2024-04-18T14:43:45.421 INFO:teuthology.orchestra.run.smithi119.stdout:{ 2024-04-18T14:43:45.421 INFO:teuthology.orchestra.run.smithi119.stdout: "ops": [], 2024-04-18T14:43:45.421 INFO:teuthology.orchestra.run.smithi119.stdout: "complaint_time": 30, 2024-04-18T14:43:45.421 INFO:teuthology.orchestra.run.smithi119.stdout: "num_blocked_ops": 0 2024-04-18T14:43:45.421 INFO:teuthology.orchestra.run.smithi119.stdout:} 2024-04-18T14:43:45.435 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-18T14:43:45.448 INFO:tasks.ceph.osd.1.smithi096.stderr:2024-04-18T14:43:45.447+0000 7f56a7a98640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 24887) UID: 0 2024-04-18T14:43:45.549 INFO:tasks.ceph.osd.8.smithi086.stderr:2024-04-18T14:43:45.547+0000 7f29f7b9d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 8 (PID: 24958) UID: 0 2024-04-18T14:43:45.555 INFO:teuthology.orchestra.run.smithi119.stdout:{ 2024-04-18T14:43:45.555 INFO:teuthology.orchestra.run.smithi119.stdout: "size": 20, 2024-04-18T14:43:45.555 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 600, 2024-04-18T14:43:45.555 INFO:teuthology.orchestra.run.smithi119.stdout: "ops": [ 2024-04-18T14:43:45.555 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:45.555 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "MOSDECSubOpWrite(3.7s4 37/30 ECSubWrite(tid=35, reqid=client.4559.0:183, at_version=37'11, trim_to=0'0, roll_forward_to=33'9))", 2024-04-18T14:43:45.555 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-04-18T14:43:36.748125+0000", 2024-04-18T14:43:45.555 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 8.8076172889999995, 2024-04-18T14:43:45.556 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0044053160000000003, 2024-04-18T14:43:45.556 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-04-18T14:43:45.556 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "reached pg", 2024-04-18T14:43:45.556 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-04-18T14:43:45.556 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:45.556 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-04-18T14:43:45.556 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:36.748125+0000", 2024-04-18T14:43:45.556 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:43:45.556 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:45.557 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:45.557 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-04-18T14:43:45.557 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:36.748125+0000", 2024-04-18T14:43:45.557 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:43:45.557 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:45.557 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:45.557 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-04-18T14:43:45.557 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:36.748124+0000", 2024-04-18T14:43:45.557 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4294967295.999999 2024-04-18T14:43:45.557 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:45.557 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:45.557 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-04-18T14:43:45.557 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:36.748453+0000", 2024-04-18T14:43:45.557 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00032812199999999997 2024-04-18T14:43:45.558 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:45.558 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:45.558 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-04-18T14:43:45.558 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:36.748496+0000", 2024-04-18T14:43:45.558 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4.3631000000000003e-05 2024-04-18T14:43:45.558 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:45.558 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:45.558 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-04-18T14:43:45.558 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:36.748524+0000", 2024-04-18T14:43:45.558 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.7900999999999999e-05 2024-04-18T14:43:45.558 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:45.558 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:45.558 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-04-18T14:43:45.558 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:36.748680+0000", 2024-04-18T14:43:45.558 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00015593399999999999 2024-04-18T14:43:45.559 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:45.559 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:45.559 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_started", 2024-04-18T14:43:45.559 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:36.748711+0000", 2024-04-18T14:43:45.559 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.1117e-05 2024-04-18T14:43:45.559 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:45.559 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:45.559 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_committed", 2024-04-18T14:43:45.559 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:36.752490+0000", 2024-04-18T14:43:45.559 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.003778726 2024-04-18T14:43:45.559 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:45.559 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:45.559 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-04-18T14:43:45.559 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:36.752531+0000", 2024-04-18T14:43:45.560 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4.0967999999999998e-05 2024-04-18T14:43:45.560 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:43:45.560 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-04-18T14:43:45.560 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:43:45.560 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:45.560 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:45.560 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "MOSDECSubOpWrite(3.7s4 37/30 ECSubWrite(tid=36, reqid=client.4559.0:183, at_version=0'0, trim_to=0'0, roll_forward_to=37'11))", 2024-04-18T14:43:45.560 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-04-18T14:43:36.757881+0000", 2024-04-18T14:43:45.560 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 8.7978621029999999, 2024-04-18T14:43:45.560 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0017422900000000001, 2024-04-18T14:43:45.560 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-04-18T14:43:45.560 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "reached pg", 2024-04-18T14:43:45.560 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-04-18T14:43:45.560 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:45.560 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-04-18T14:43:45.560 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:36.757881+0000", 2024-04-18T14:43:45.560 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:43:45.561 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:45.561 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:45.561 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-04-18T14:43:45.561 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:36.757881+0000", 2024-04-18T14:43:45.561 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:43:45.561 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:45.561 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:45.561 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-04-18T14:43:45.561 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:36.757878+0000", 2024-04-18T14:43:45.561 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4294967295.9999976 2024-04-18T14:43:45.561 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:45.561 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:45.561 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-04-18T14:43:45.561 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:36.757910+0000", 2024-04-18T14:43:45.562 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.1754000000000001e-05 2024-04-18T14:43:45.562 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:45.562 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:45.562 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-04-18T14:43:45.562 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:36.757952+0000", 2024-04-18T14:43:45.562 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4.1527999999999999e-05 2024-04-18T14:43:45.562 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:45.562 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:45.562 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-04-18T14:43:45.562 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:36.757974+0000", 2024-04-18T14:43:45.562 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.2323999999999998e-05 2024-04-18T14:43:45.562 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:45.562 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:45.562 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-04-18T14:43:45.563 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:36.758111+0000", 2024-04-18T14:43:45.563 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000137284 2024-04-18T14:43:45.563 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:45.563 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:45.563 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_started", 2024-04-18T14:43:45.563 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:36.758142+0000", 2024-04-18T14:43:45.563 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.0607e-05 2024-04-18T14:43:45.563 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:45.563 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:45.563 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_committed", 2024-04-18T14:43:45.563 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:36.759555+0000", 2024-04-18T14:43:45.563 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.001413318 2024-04-18T14:43:45.563 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:45.563 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:45.565 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-04-18T14:43:45.565 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:36.759623+0000", 2024-04-18T14:43:45.566 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 6.7685e-05 2024-04-18T14:43:45.566 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:43:45.566 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-04-18T14:43:45.566 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:43:45.566 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:45.566 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:45.566 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "MOSDECSubOpWrite(3.7s4 41/30 ECSubWrite(tid=49, reqid=osd.14.0:49, at_version=41'17, trim_to=0'0, roll_forward_to=38'15))", 2024-04-18T14:43:45.566 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-04-18T14:43:40.759145+0000", 2024-04-18T14:43:45.566 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 4.7965978570000001, 2024-04-18T14:43:45.566 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0032242780000000001, 2024-04-18T14:43:45.566 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-04-18T14:43:45.566 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "reached pg", 2024-04-18T14:43:45.566 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-04-18T14:43:45.566 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:45.566 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-04-18T14:43:45.567 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:40.759145+0000", 2024-04-18T14:43:45.567 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:43:45.567 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:45.567 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:45.567 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-04-18T14:43:45.567 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:40.759145+0000", 2024-04-18T14:43:45.567 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:43:45.567 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:45.567 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:45.567 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-04-18T14:43:45.567 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:40.759144+0000", 2024-04-18T14:43:45.567 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4294967295.999999 2024-04-18T14:43:45.567 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:45.567 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:45.567 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-04-18T14:43:45.568 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:40.759204+0000", 2024-04-18T14:43:45.568 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 6.0058e-05 2024-04-18T14:43:45.568 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:45.568 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:45.568 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-04-18T14:43:45.568 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:40.759238+0000", 2024-04-18T14:43:45.568 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.3343999999999998e-05 2024-04-18T14:43:45.568 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:45.568 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:45.568 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-04-18T14:43:45.568 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:40.759265+0000", 2024-04-18T14:43:45.568 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.7206999999999999e-05 2024-04-18T14:43:45.568 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:45.568 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:45.569 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-04-18T14:43:45.569 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:40.759533+0000", 2024-04-18T14:43:45.569 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00026866999999999999 2024-04-18T14:43:45.569 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:45.569 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:45.569 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_started", 2024-04-18T14:43:45.569 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:40.759562+0000", 2024-04-18T14:43:45.569 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.8592999999999999e-05 2024-04-18T14:43:45.569 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:45.569 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:45.569 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_committed", 2024-04-18T14:43:45.569 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:40.762314+0000", 2024-04-18T14:43:45.569 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0027515880000000001 2024-04-18T14:43:45.569 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:45.570 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:45.570 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-04-18T14:43:45.570 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:40.762369+0000", 2024-04-18T14:43:45.570 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 5.5615000000000002e-05 2024-04-18T14:43:45.570 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:43:45.570 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-04-18T14:43:45.570 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:43:45.570 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:45.570 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:45.570 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "MOSDECSubOpWrite(3.7s4 41/30 ECSubWrite(tid=50, reqid=osd.14.0:49, at_version=0'0, trim_to=0'0, roll_forward_to=41'17))", 2024-04-18T14:43:45.570 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-04-18T14:43:40.764162+0000", 2024-04-18T14:43:45.570 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 4.7915808489999998, 2024-04-18T14:43:45.571 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0095130979999999993, 2024-04-18T14:43:45.571 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-04-18T14:43:45.571 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "reached pg", 2024-04-18T14:43:45.571 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-04-18T14:43:45.571 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:45.571 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-04-18T14:43:45.571 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:40.764162+0000", 2024-04-18T14:43:45.571 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:43:45.571 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:45.571 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:45.571 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-04-18T14:43:45.571 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:40.764162+0000", 2024-04-18T14:43:45.571 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:43:45.572 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:45.572 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:45.572 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-04-18T14:43:45.572 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:40.764160+0000", 2024-04-18T14:43:45.572 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4294967295.9999981 2024-04-18T14:43:45.572 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:45.572 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:45.572 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-04-18T14:43:45.572 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:40.764189+0000", 2024-04-18T14:43:45.572 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.9257000000000001e-05 2024-04-18T14:43:45.572 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:45.572 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:45.572 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-04-18T14:43:45.573 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:40.764249+0000", 2024-04-18T14:43:45.573 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 5.9945000000000003e-05 2024-04-18T14:43:45.573 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:45.573 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:45.573 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-04-18T14:43:45.573 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:40.764272+0000", 2024-04-18T14:43:45.573 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.3091e-05 2024-04-18T14:43:45.573 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:45.573 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:45.573 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-04-18T14:43:45.573 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:40.764476+0000", 2024-04-18T14:43:45.573 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00020318100000000001 2024-04-18T14:43:45.573 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:45.573 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:45.573 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_started", 2024-04-18T14:43:45.574 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:40.764490+0000", 2024-04-18T14:43:45.574 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.4634000000000001e-05 2024-04-18T14:43:45.574 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:45.574 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:45.574 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_committed", 2024-04-18T14:43:45.574 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:40.773620+0000", 2024-04-18T14:43:45.574 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0091299390000000001 2024-04-18T14:43:45.574 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:45.574 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:45.574 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-04-18T14:43:45.574 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:40.773675+0000", 2024-04-18T14:43:45.574 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 5.4948000000000003e-05 2024-04-18T14:43:45.574 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:43:45.575 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-04-18T14:43:45.575 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:43:45.575 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:45.575 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:45.575 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "MOSDECSubOpWrite(3.cs5 41/30 ECSubWrite(tid=45, reqid=osd.11.0:45, at_version=41'22, trim_to=0'0, roll_forward_to=39'20))", 2024-04-18T14:43:45.575 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-04-18T14:43:40.764595+0000", 2024-04-18T14:43:45.575 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 4.7911474759999999, 2024-04-18T14:43:45.575 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.010712411999999999, 2024-04-18T14:43:45.575 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-04-18T14:43:45.575 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "reached pg", 2024-04-18T14:43:45.575 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-04-18T14:43:45.575 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:45.575 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-04-18T14:43:45.575 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:40.764595+0000", 2024-04-18T14:43:45.575 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:43:45.576 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:45.576 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:45.576 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-04-18T14:43:45.576 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:40.764595+0000", 2024-04-18T14:43:45.576 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:43:45.576 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:45.576 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:45.576 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-04-18T14:43:45.576 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:40.764594+0000", 2024-04-18T14:43:45.576 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4294967295.999999 2024-04-18T14:43:45.576 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:45.576 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:45.576 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-04-18T14:43:45.576 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:40.764660+0000", 2024-04-18T14:43:45.576 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 6.5122000000000004e-05 2024-04-18T14:43:45.577 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:45.577 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:45.577 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-04-18T14:43:45.577 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:40.764693+0000", 2024-04-18T14:43:45.577 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.3213999999999997e-05 2024-04-18T14:43:45.577 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:45.577 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:45.577 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-04-18T14:43:45.577 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:40.764715+0000", 2024-04-18T14:43:45.577 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.2580000000000001e-05 2024-04-18T14:43:45.577 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:45.577 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:45.577 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-04-18T14:43:45.577 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:40.764838+0000", 2024-04-18T14:43:45.577 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00012281299999999999 2024-04-18T14:43:45.578 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:45.578 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:45.578 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_started", 2024-04-18T14:43:45.578 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:40.764853+0000", 2024-04-18T14:43:45.578 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.5237e-05 2024-04-18T14:43:45.578 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:45.578 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:45.578 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_committed", 2024-04-18T14:43:45.578 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:40.775242+0000", 2024-04-18T14:43:45.578 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.010388807999999999 2024-04-18T14:43:45.578 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:45.578 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:45.578 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-04-18T14:43:45.578 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:40.775308+0000", 2024-04-18T14:43:45.578 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 6.5494999999999995e-05 2024-04-18T14:43:45.579 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:43:45.579 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-04-18T14:43:45.579 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:43:45.579 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:45.579 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:45.579 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "MOSDECSubOpWrite(3.cs5 41/30 ECSubWrite(tid=46, reqid=osd.11.0:46, at_version=41'24, trim_to=0'0, roll_forward_to=39'20))", 2024-04-18T14:43:45.579 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-04-18T14:43:40.765803+0000", 2024-04-18T14:43:45.579 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 4.7899397260000001, 2024-04-18T14:43:45.579 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.010134018999999999, 2024-04-18T14:43:45.579 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-04-18T14:43:45.579 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "reached pg", 2024-04-18T14:43:45.579 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-04-18T14:43:45.579 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:45.579 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-04-18T14:43:45.580 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:40.765803+0000", 2024-04-18T14:43:45.580 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:43:45.580 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:45.580 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:45.580 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-04-18T14:43:45.580 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:40.765803+0000", 2024-04-18T14:43:45.580 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:43:45.580 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:45.580 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:45.580 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-04-18T14:43:45.580 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:40.765801+0000", 2024-04-18T14:43:45.580 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4294967295.9999981 2024-04-18T14:43:45.580 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:45.580 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:45.580 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-04-18T14:43:45.581 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:40.765857+0000", 2024-04-18T14:43:45.581 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 5.6385000000000003e-05 2024-04-18T14:43:45.581 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:45.581 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:45.581 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-04-18T14:43:45.581 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:40.765888+0000", 2024-04-18T14:43:45.581 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.0886999999999998e-05 2024-04-18T14:43:45.581 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:45.581 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:45.581 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-04-18T14:43:45.581 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:40.765910+0000", 2024-04-18T14:43:45.581 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.2084000000000001e-05 2024-04-18T14:43:45.581 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:45.581 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:45.581 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-04-18T14:43:45.581 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:40.767603+0000", 2024-04-18T14:43:45.582 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0016922409999999999 2024-04-18T14:43:45.582 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:45.582 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:45.582 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_started", 2024-04-18T14:43:45.582 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:40.767627+0000", 2024-04-18T14:43:45.582 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.4204000000000001e-05 2024-04-18T14:43:45.582 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:45.582 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:45.582 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_committed", 2024-04-18T14:43:45.582 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:40.775885+0000", 2024-04-18T14:43:45.582 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0082576769999999997 2024-04-18T14:43:45.582 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:45.582 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:45.582 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-04-18T14:43:45.583 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:40.775937+0000", 2024-04-18T14:43:45.583 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 5.2537999999999997e-05 2024-04-18T14:43:45.583 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:43:45.583 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-04-18T14:43:45.583 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:43:45.583 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:45.583 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:45.583 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "MOSDECSubOpWrite(3.cs5 41/30 ECSubWrite(tid=47, reqid=osd.11.0:46, at_version=0'0, trim_to=0'0, roll_forward_to=41'24))", 2024-04-18T14:43:45.583 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-04-18T14:43:40.781770+0000", 2024-04-18T14:43:45.583 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 4.7739726640000004, 2024-04-18T14:43:45.583 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0037569000000000001, 2024-04-18T14:43:45.583 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-04-18T14:43:45.583 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "reached pg", 2024-04-18T14:43:45.584 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-04-18T14:43:45.584 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:45.584 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-04-18T14:43:45.584 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:40.781770+0000", 2024-04-18T14:43:45.584 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:43:45.584 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:45.584 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:45.584 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-04-18T14:43:45.584 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:40.781770+0000", 2024-04-18T14:43:45.584 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:43:45.584 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:45.584 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:45.584 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-04-18T14:43:45.584 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:40.781769+0000", 2024-04-18T14:43:45.585 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4294967295.999999 2024-04-18T14:43:45.585 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:45.585 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:45.585 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-04-18T14:43:45.585 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:40.781794+0000", 2024-04-18T14:43:45.585 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.4766999999999999e-05 2024-04-18T14:43:45.585 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:45.585 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:45.585 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-04-18T14:43:45.585 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:40.781819+0000", 2024-04-18T14:43:45.585 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.5670999999999999e-05 2024-04-18T14:43:45.585 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:45.585 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:45.585 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-04-18T14:43:45.585 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:40.781845+0000", 2024-04-18T14:43:45.586 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.5236999999999999e-05 2024-04-18T14:43:45.586 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:45.586 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:45.586 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-04-18T14:43:45.586 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:40.782557+0000", 2024-04-18T14:43:45.586 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00071190200000000004 2024-04-18T14:43:45.586 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:45.586 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:45.586 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_started", 2024-04-18T14:43:45.586 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:40.782581+0000", 2024-04-18T14:43:45.586 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.4811e-05 2024-04-18T14:43:45.586 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:45.586 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:45.586 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_committed", 2024-04-18T14:43:45.586 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:40.785472+0000", 2024-04-18T14:43:45.587 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.002890821 2024-04-18T14:43:45.587 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:45.587 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:45.587 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-04-18T14:43:45.587 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:40.785527+0000", 2024-04-18T14:43:45.587 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 5.4864000000000002e-05 2024-04-18T14:43:45.587 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:43:45.587 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-04-18T14:43:45.587 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:43:45.587 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:45.587 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:45.587 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "MOSDECSubOpWrite(3.7s4 41/30 ECSubWrite(tid=51, reqid=client.4559.0:242, at_version=41'19, trim_to=0'0, roll_forward_to=41'17))", 2024-04-18T14:43:45.587 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-04-18T14:43:40.783711+0000", 2024-04-18T14:43:45.588 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 4.7720317439999995, 2024-04-18T14:43:45.588 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0046884939999999996, 2024-04-18T14:43:45.588 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-04-18T14:43:45.588 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "reached pg", 2024-04-18T14:43:45.588 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-04-18T14:43:45.588 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:45.588 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-04-18T14:43:45.588 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:40.783711+0000", 2024-04-18T14:43:45.588 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:43:45.588 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:45.588 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:45.588 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-04-18T14:43:45.588 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:40.783711+0000", 2024-04-18T14:43:45.588 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:43:45.589 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:45.589 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:45.589 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-04-18T14:43:45.589 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:40.783677+0000", 2024-04-18T14:43:45.589 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4294967295.9999657 2024-04-18T14:43:45.589 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:45.589 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:45.589 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-04-18T14:43:45.589 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:40.784033+0000", 2024-04-18T14:43:45.589 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00035661200000000002 2024-04-18T14:43:45.589 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:45.589 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:45.589 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-04-18T14:43:45.590 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:40.784064+0000", 2024-04-18T14:43:45.590 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.0480999999999998e-05 2024-04-18T14:43:45.590 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:45.590 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:45.590 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-04-18T14:43:45.590 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:40.784088+0000", 2024-04-18T14:43:45.590 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.4335999999999999e-05 2024-04-18T14:43:45.590 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:45.590 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:45.590 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-04-18T14:43:45.590 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:40.784212+0000", 2024-04-18T14:43:45.590 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00012333999999999999 2024-04-18T14:43:45.590 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:45.590 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:45.591 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_started", 2024-04-18T14:43:45.591 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:40.784236+0000", 2024-04-18T14:43:45.591 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.4657000000000001e-05 2024-04-18T14:43:45.591 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:45.591 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:45.591 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_committed", 2024-04-18T14:43:45.591 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:40.788326+0000", 2024-04-18T14:43:45.591 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0040892350000000001 2024-04-18T14:43:45.591 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:45.591 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:45.591 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-04-18T14:43:45.591 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:40.788400+0000", 2024-04-18T14:43:45.591 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 7.3993999999999997e-05 2024-04-18T14:43:45.591 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:43:45.592 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-04-18T14:43:45.592 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:43:45.592 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:45.592 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:45.592 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "MOSDECSubOpWrite(3.fs6 41/30 ECSubWrite(tid=48, reqid=client.4559.0:248, at_version=41'6, trim_to=0'0, roll_forward_to=33'4))", 2024-04-18T14:43:45.592 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-04-18T14:43:40.785695+0000", 2024-04-18T14:43:45.592 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 4.7700475459999998, 2024-04-18T14:43:45.592 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0039156299999999998, 2024-04-18T14:43:45.592 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-04-18T14:43:45.592 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "reached pg", 2024-04-18T14:43:45.592 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-04-18T14:43:45.592 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:45.592 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-04-18T14:43:45.593 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:40.785695+0000", 2024-04-18T14:43:45.593 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:43:45.593 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:45.593 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:45.593 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-04-18T14:43:45.593 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:40.785695+0000", 2024-04-18T14:43:45.593 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:43:45.593 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:45.593 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:45.593 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-04-18T14:43:45.593 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:40.785694+0000", 2024-04-18T14:43:45.593 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4294967295.9999986 2024-04-18T14:43:45.593 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:45.593 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:45.593 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-04-18T14:43:45.594 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:40.786396+0000", 2024-04-18T14:43:45.594 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000701949 2024-04-18T14:43:45.594 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:45.594 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:45.594 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-04-18T14:43:45.594 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:40.786428+0000", 2024-04-18T14:43:45.594 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.2036999999999998e-05 2024-04-18T14:43:45.594 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:45.594 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:45.594 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-04-18T14:43:45.594 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:40.786449+0000", 2024-04-18T14:43:45.594 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.1447999999999999e-05 2024-04-18T14:43:45.594 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:45.594 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:45.594 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-04-18T14:43:45.594 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:40.786573+0000", 2024-04-18T14:43:45.595 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000123616 2024-04-18T14:43:45.595 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:45.595 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:45.595 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_started", 2024-04-18T14:43:45.595 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:40.786598+0000", 2024-04-18T14:43:45.595 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.5133000000000001e-05 2024-04-18T14:43:45.595 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:45.595 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:45.595 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_committed", 2024-04-18T14:43:45.595 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:40.789548+0000", 2024-04-18T14:43:45.595 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0029500759999999998 2024-04-18T14:43:45.595 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:45.595 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:45.596 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-04-18T14:43:45.596 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:40.789611+0000", 2024-04-18T14:43:45.596 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 6.2978000000000006e-05 2024-04-18T14:43:45.596 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:43:45.596 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-04-18T14:43:45.596 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:43:45.596 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:45.596 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:45.596 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "MOSDECSubOpWrite(3.7s4 41/30 ECSubWrite(tid=52, reqid=client.4559.0:242, at_version=0'0, trim_to=0'0, roll_forward_to=41'19))", 2024-04-18T14:43:45.596 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-04-18T14:43:40.790649+0000", 2024-04-18T14:43:45.596 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 4.7650941629999997, 2024-04-18T14:43:45.596 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0021787519999999999, 2024-04-18T14:43:45.596 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-04-18T14:43:45.596 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "reached pg", 2024-04-18T14:43:45.596 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-04-18T14:43:45.596 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:45.597 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-04-18T14:43:45.597 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:40.790649+0000", 2024-04-18T14:43:45.597 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:43:45.597 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:45.597 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:45.597 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-04-18T14:43:45.597 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:40.790649+0000", 2024-04-18T14:43:45.597 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:43:45.597 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:45.597 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:45.597 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-04-18T14:43:45.597 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:40.790647+0000", 2024-04-18T14:43:45.597 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4294967295.9999981 2024-04-18T14:43:45.597 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:45.598 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:45.598 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-04-18T14:43:45.598 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:40.790670+0000", 2024-04-18T14:43:45.598 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.3498000000000001e-05 2024-04-18T14:43:45.598 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:45.598 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:45.598 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-04-18T14:43:45.598 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:40.790700+0000", 2024-04-18T14:43:45.598 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.9907e-05 2024-04-18T14:43:45.598 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:45.598 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:45.598 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-04-18T14:43:45.598 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:40.790715+0000", 2024-04-18T14:43:45.598 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.4630000000000001e-05 2024-04-18T14:43:45.599 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:45.599 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:45.599 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-04-18T14:43:45.599 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:40.790846+0000", 2024-04-18T14:43:45.599 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000131433 2024-04-18T14:43:45.599 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:45.599 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:45.599 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_started", 2024-04-18T14:43:45.599 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:40.790871+0000", 2024-04-18T14:43:45.599 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.4814e-05 2024-04-18T14:43:45.599 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:45.599 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:45.599 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_committed", 2024-04-18T14:43:45.599 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:40.792772+0000", 2024-04-18T14:43:45.600 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0019008619999999999 2024-04-18T14:43:45.600 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:45.600 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:45.600 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-04-18T14:43:45.600 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:40.792827+0000", 2024-04-18T14:43:45.600 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 5.5328000000000003e-05 2024-04-18T14:43:45.600 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:43:45.600 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-04-18T14:43:45.600 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:43:45.600 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:45.600 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:45.600 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "MOSDECSubOpWrite(3.fs6 45/30 ECSubWrite(tid=57, reqid=client.4559.0:282, at_version=45'10, trim_to=0'0, roll_forward_to=44'8))", 2024-04-18T14:43:45.601 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-04-18T14:43:44.379194+0000", 2024-04-18T14:43:45.601 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 1.176548943, 2024-04-18T14:43:45.601 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0039029809999999998, 2024-04-18T14:43:45.601 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-04-18T14:43:45.601 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "reached pg", 2024-04-18T14:43:45.601 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-04-18T14:43:45.601 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:45.601 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-04-18T14:43:45.601 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:44.379194+0000", 2024-04-18T14:43:45.601 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:43:45.601 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:45.601 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:45.601 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-04-18T14:43:45.601 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:44.379194+0000", 2024-04-18T14:43:45.601 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:43:45.602 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:45.602 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:45.602 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-04-18T14:43:45.602 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:44.379193+0000", 2024-04-18T14:43:45.602 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4294967295.9999995 2024-04-18T14:43:45.602 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:45.602 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:45.602 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-04-18T14:43:45.602 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:44.379232+0000", 2024-04-18T14:43:45.602 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.8568000000000001e-05 2024-04-18T14:43:45.602 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:45.602 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:45.602 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-04-18T14:43:45.603 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:44.379260+0000", 2024-04-18T14:43:45.603 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.832e-05 2024-04-18T14:43:45.603 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:45.603 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:45.603 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-04-18T14:43:45.603 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:44.379275+0000", 2024-04-18T14:43:45.603 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.5358000000000001e-05 2024-04-18T14:43:45.603 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:45.603 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:45.603 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-04-18T14:43:45.603 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:44.379420+0000", 2024-04-18T14:43:45.603 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00014484200000000001 2024-04-18T14:43:45.603 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:45.603 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:45.603 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_started", 2024-04-18T14:43:45.604 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:44.379447+0000", 2024-04-18T14:43:45.604 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.6276999999999999e-05 2024-04-18T14:43:45.604 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:45.604 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:45.604 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_committed", 2024-04-18T14:43:45.604 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:44.383036+0000", 2024-04-18T14:43:45.604 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.003589769 2024-04-18T14:43:45.604 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:45.604 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:45.604 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-04-18T14:43:45.604 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:44.383097+0000", 2024-04-18T14:43:45.604 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 6.0430999999999998e-05 2024-04-18T14:43:45.604 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:43:45.605 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-04-18T14:43:45.605 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:43:45.605 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:45.605 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:45.605 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "MOSDECSubOpWrite(3.fs6 45/30 ECSubWrite(tid=58, reqid=client.4559.0:283, at_version=45'11, trim_to=0'0, roll_forward_to=44'8))", 2024-04-18T14:43:45.605 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-04-18T14:43:44.381979+0000", 2024-04-18T14:43:45.605 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 1.173763696, 2024-04-18T14:43:45.605 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0031108540000000001, 2024-04-18T14:43:45.605 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-04-18T14:43:45.605 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "reached pg", 2024-04-18T14:43:45.605 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-04-18T14:43:45.605 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:45.605 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-04-18T14:43:45.605 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:44.381979+0000", 2024-04-18T14:43:45.606 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:43:45.606 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:45.606 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:45.606 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-04-18T14:43:45.606 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:44.381979+0000", 2024-04-18T14:43:45.606 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:43:45.606 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:45.606 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:45.606 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-04-18T14:43:45.606 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:44.381977+0000", 2024-04-18T14:43:45.606 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4294967295.9999981 2024-04-18T14:43:45.606 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:45.606 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:45.607 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-04-18T14:43:45.607 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:44.382048+0000", 2024-04-18T14:43:45.607 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 7.0827999999999993e-05 2024-04-18T14:43:45.607 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:45.607 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:45.607 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-04-18T14:43:45.607 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:44.382080+0000", 2024-04-18T14:43:45.607 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.2323999999999997e-05 2024-04-18T14:43:45.607 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:45.607 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:45.607 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-04-18T14:43:45.607 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:44.382102+0000", 2024-04-18T14:43:45.607 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.1971e-05 2024-04-18T14:43:45.608 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:45.608 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:45.608 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-04-18T14:43:45.608 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:44.382288+0000", 2024-04-18T14:43:45.608 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00018613700000000001 2024-04-18T14:43:45.608 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:45.608 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:45.608 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_started", 2024-04-18T14:43:45.608 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:44.382314+0000", 2024-04-18T14:43:45.608 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.5205999999999999e-05 2024-04-18T14:43:45.608 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:45.608 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:45.608 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_committed", 2024-04-18T14:43:45.609 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:44.385031+0000", 2024-04-18T14:43:45.609 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.002717484 2024-04-18T14:43:45.609 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:45.609 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:45.609 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-04-18T14:43:45.609 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:44.385090+0000", 2024-04-18T14:43:45.609 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 5.8814000000000003e-05 2024-04-18T14:43:45.609 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:43:45.609 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-04-18T14:43:45.609 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:43:45.609 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:45.609 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:45.610 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "MOSDECSubOpWrite(3.fs6 45/30 ECSubWrite(tid=59, reqid=client.4559.0:284, at_version=45'12, trim_to=0'0, roll_forward_to=44'8))", 2024-04-18T14:43:45.610 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-04-18T14:43:44.385507+0000", 2024-04-18T14:43:45.610 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 1.1702359170000001, 2024-04-18T14:43:45.610 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0021914529999999999, 2024-04-18T14:43:45.610 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-04-18T14:43:45.610 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "reached pg", 2024-04-18T14:43:45.610 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-04-18T14:43:45.610 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:45.610 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-04-18T14:43:45.610 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:44.385507+0000", 2024-04-18T14:43:45.610 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:43:45.610 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:45.610 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:45.611 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-04-18T14:43:45.611 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:44.385507+0000", 2024-04-18T14:43:45.611 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:43:45.611 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:45.611 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:45.611 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-04-18T14:43:45.611 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:44.385500+0000", 2024-04-18T14:43:45.611 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4294967295.9999928 2024-04-18T14:43:45.611 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:45.611 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:45.612 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-04-18T14:43:45.612 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:44.385553+0000", 2024-04-18T14:43:45.612 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 5.3117e-05 2024-04-18T14:43:45.612 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:45.612 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:45.612 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-04-18T14:43:45.612 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:44.385591+0000", 2024-04-18T14:43:45.612 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.8464000000000003e-05 2024-04-18T14:43:45.612 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:45.613 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:45.613 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-04-18T14:43:45.613 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:44.385618+0000", 2024-04-18T14:43:45.613 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.6633999999999999e-05 2024-04-18T14:43:45.613 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:45.613 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:45.613 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-04-18T14:43:45.613 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:44.385743+0000", 2024-04-18T14:43:45.613 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00012546599999999999 2024-04-18T14:43:45.614 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:45.614 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:45.614 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_started", 2024-04-18T14:43:45.614 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:44.385770+0000", 2024-04-18T14:43:45.614 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.6950000000000001e-05 2024-04-18T14:43:45.614 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:45.614 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:45.615 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_committed", 2024-04-18T14:43:45.615 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:44.387639+0000", 2024-04-18T14:43:45.615 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0018685049999999999 2024-04-18T14:43:45.615 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:45.615 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:45.615 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-04-18T14:43:45.615 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:44.387698+0000", 2024-04-18T14:43:45.615 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 5.9383999999999999e-05 2024-04-18T14:43:45.615 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:43:45.615 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-04-18T14:43:45.615 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:43:45.616 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:45.616 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:45.616 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "MOSDECSubOpWrite(3.fs6 45/30 ECSubWrite(tid=62, reqid=client.4559.0:284, at_version=0'0, trim_to=0'0, roll_forward_to=45'12))", 2024-04-18T14:43:45.616 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-04-18T14:43:44.393657+0000", 2024-04-18T14:43:45.616 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 1.162085488, 2024-04-18T14:43:45.616 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.002470828, 2024-04-18T14:43:45.616 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-04-18T14:43:45.616 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "reached pg", 2024-04-18T14:43:45.616 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-04-18T14:43:45.616 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:45.616 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-04-18T14:43:45.616 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:44.393657+0000", 2024-04-18T14:43:45.616 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:43:45.616 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:45.617 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:45.617 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-04-18T14:43:45.617 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:44.393657+0000", 2024-04-18T14:43:45.617 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:43:45.617 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:45.617 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:45.617 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-04-18T14:43:45.617 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:44.393656+0000", 2024-04-18T14:43:45.617 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4294967295.9999981 2024-04-18T14:43:45.617 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:45.617 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:45.617 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-04-18T14:43:45.617 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:44.393684+0000", 2024-04-18T14:43:45.617 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.8500000000000002e-05 2024-04-18T14:43:45.617 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:45.618 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:45.618 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-04-18T14:43:45.618 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:44.393725+0000", 2024-04-18T14:43:45.618 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4.0454000000000003e-05 2024-04-18T14:43:45.618 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:45.618 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:45.618 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-04-18T14:43:45.618 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:44.393749+0000", 2024-04-18T14:43:45.618 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.4864000000000001e-05 2024-04-18T14:43:45.618 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:45.618 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:45.618 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-04-18T14:43:45.618 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:44.393882+0000", 2024-04-18T14:43:45.618 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000132636 2024-04-18T14:43:45.619 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:45.619 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:45.619 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_started", 2024-04-18T14:43:45.619 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:44.393913+0000", 2024-04-18T14:43:45.619 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.0827000000000001e-05 2024-04-18T14:43:45.619 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:45.619 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:45.619 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_committed", 2024-04-18T14:43:45.619 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:44.396086+0000", 2024-04-18T14:43:45.619 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0021727090000000001 2024-04-18T14:43:45.619 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:45.619 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:45.619 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-04-18T14:43:45.619 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:44.396128+0000", 2024-04-18T14:43:45.620 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4.2527999999999997e-05 2024-04-18T14:43:45.620 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:43:45.620 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-04-18T14:43:45.620 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:43:45.620 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:45.620 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:45.620 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "MOSDECSubOpWrite(3.es4 45/30 ECSubWrite(tid=21, reqid=client.4559.0:306, at_version=45'13, trim_to=0'0, roll_forward_to=44'11))", 2024-04-18T14:43:45.620 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-04-18T14:43:44.508291+0000", 2024-04-18T14:43:45.620 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 1.0474515499999999, 2024-04-18T14:43:45.620 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0067478729999999997, 2024-04-18T14:43:45.620 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-04-18T14:43:45.620 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "reached pg", 2024-04-18T14:43:45.620 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-04-18T14:43:45.621 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:45.621 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-04-18T14:43:45.621 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:44.508291+0000", 2024-04-18T14:43:45.621 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:43:45.621 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:45.621 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:45.621 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-04-18T14:43:45.621 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:44.508291+0000", 2024-04-18T14:43:45.621 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:43:45.621 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:45.621 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:45.621 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-04-18T14:43:45.621 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:44.508291+0000", 2024-04-18T14:43:45.621 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4294967295.9999995 2024-04-18T14:43:45.621 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:45.622 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:45.622 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-04-18T14:43:45.622 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:44.508827+0000", 2024-04-18T14:43:45.622 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00053615599999999998 2024-04-18T14:43:45.622 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:45.622 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:45.622 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-04-18T14:43:45.622 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:44.508857+0000", 2024-04-18T14:43:45.622 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.04e-05 2024-04-18T14:43:45.622 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:45.622 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:45.622 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-04-18T14:43:45.622 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:44.508880+0000", 2024-04-18T14:43:45.622 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.2895e-05 2024-04-18T14:43:45.623 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:45.623 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:45.623 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-04-18T14:43:45.623 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:44.508988+0000", 2024-04-18T14:43:45.623 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000107252 2024-04-18T14:43:45.623 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:45.623 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:45.623 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_started", 2024-04-18T14:43:45.623 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:44.509007+0000", 2024-04-18T14:43:45.623 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.9585999999999998e-05 2024-04-18T14:43:45.623 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:45.623 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:45.623 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_committed", 2024-04-18T14:43:45.623 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:44.514973+0000", 2024-04-18T14:43:45.623 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0059656190000000001 2024-04-18T14:43:45.624 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:45.624 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:45.624 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-04-18T14:43:45.624 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:44.515039+0000", 2024-04-18T14:43:45.624 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 6.6328000000000006e-05 2024-04-18T14:43:45.624 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:43:45.624 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-04-18T14:43:45.624 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:43:45.624 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:45.624 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:45.624 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "MOSDECSubOpWrite(3.es4 45/30 ECSubWrite(tid=22, reqid=client.4559.0:307, at_version=45'14, trim_to=0'0, roll_forward_to=44'11))", 2024-04-18T14:43:45.624 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-04-18T14:43:44.513888+0000", 2024-04-18T14:43:45.624 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 1.0418550010000001, 2024-04-18T14:43:45.624 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0039862389999999999, 2024-04-18T14:43:45.625 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-04-18T14:43:45.625 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "reached pg", 2024-04-18T14:43:45.625 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-04-18T14:43:45.625 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:45.625 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-04-18T14:43:45.625 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:44.513888+0000", 2024-04-18T14:43:45.625 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:43:45.625 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:45.625 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:45.625 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-04-18T14:43:45.625 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:44.513888+0000", 2024-04-18T14:43:45.625 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:43:45.625 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:45.625 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:45.626 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-04-18T14:43:45.626 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:44.513886+0000", 2024-04-18T14:43:45.626 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4294967295.9999981 2024-04-18T14:43:45.626 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:45.626 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:45.626 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-04-18T14:43:45.626 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:44.514000+0000", 2024-04-18T14:43:45.626 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00011363599999999999 2024-04-18T14:43:45.626 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:45.626 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:45.626 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-04-18T14:43:45.626 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:44.514030+0000", 2024-04-18T14:43:45.626 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.0817e-05 2024-04-18T14:43:45.626 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:45.626 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:45.627 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-04-18T14:43:45.627 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:44.514055+0000", 2024-04-18T14:43:45.627 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.4491e-05 2024-04-18T14:43:45.627 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:45.627 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:45.627 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-04-18T14:43:45.627 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:44.514145+0000", 2024-04-18T14:43:45.627 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 8.9901000000000005e-05 2024-04-18T14:43:45.627 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:45.627 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:45.627 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_started", 2024-04-18T14:43:45.627 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:44.514161+0000", 2024-04-18T14:43:45.627 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.6350000000000001e-05 2024-04-18T14:43:45.628 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:45.628 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:45.628 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_committed", 2024-04-18T14:43:45.628 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:44.517801+0000", 2024-04-18T14:43:45.628 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0036396369999999998 2024-04-18T14:43:45.628 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:45.628 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:45.628 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-04-18T14:43:45.628 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:44.517874+0000", 2024-04-18T14:43:45.628 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 7.3140999999999996e-05 2024-04-18T14:43:45.628 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:43:45.628 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-04-18T14:43:45.629 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:43:45.629 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:45.629 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:45.629 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "MOSDECSubOpWrite(3.es4 45/30 ECSubWrite(tid=23, reqid=client.4559.0:308, at_version=45'15, trim_to=0'0, roll_forward_to=44'11))", 2024-04-18T14:43:45.629 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-04-18T14:43:44.515143+0000", 2024-04-18T14:43:45.629 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 1.040600068, 2024-04-18T14:43:45.629 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0036726509999999999, 2024-04-18T14:43:45.629 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-04-18T14:43:45.629 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "reached pg", 2024-04-18T14:43:45.629 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-04-18T14:43:45.629 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:45.629 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-04-18T14:43:45.630 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:44.515143+0000", 2024-04-18T14:43:45.630 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:43:45.630 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:45.630 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:45.630 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-04-18T14:43:45.630 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:44.515143+0000", 2024-04-18T14:43:45.630 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:43:45.630 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:45.630 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:45.631 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-04-18T14:43:45.631 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:44.515141+0000", 2024-04-18T14:43:45.631 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4294967295.9999986 2024-04-18T14:43:45.631 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:45.631 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:45.631 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-04-18T14:43:45.631 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:44.515170+0000", 2024-04-18T14:43:45.631 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.8901e-05 2024-04-18T14:43:45.632 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:45.632 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:45.632 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-04-18T14:43:45.632 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:44.515192+0000", 2024-04-18T14:43:45.632 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.2172999999999999e-05 2024-04-18T14:43:45.632 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:45.632 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:45.632 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-04-18T14:43:45.632 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:44.515212+0000", 2024-04-18T14:43:45.633 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.9837e-05 2024-04-18T14:43:45.633 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:45.633 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:45.633 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-04-18T14:43:45.633 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:44.515312+0000", 2024-04-18T14:43:45.633 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 9.9559e-05 2024-04-18T14:43:45.633 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:45.633 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:45.633 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_started", 2024-04-18T14:43:45.634 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:44.515325+0000", 2024-04-18T14:43:45.634 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.3577000000000001e-05 2024-04-18T14:43:45.634 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:45.634 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:45.634 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_committed", 2024-04-18T14:43:45.634 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:44.518740+0000", 2024-04-18T14:43:45.634 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0034142090000000001 2024-04-18T14:43:45.635 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:45.635 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:45.635 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-04-18T14:43:45.635 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:44.518815+0000", 2024-04-18T14:43:45.635 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 7.5694999999999999e-05 2024-04-18T14:43:45.635 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:43:45.635 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-04-18T14:43:45.635 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:43:45.635 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:45.635 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:45.635 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "MOSDECSubOpWrite(3.es4 46/30 ECSubWrite(tid=26, reqid=osd.8.0:26, at_version=46'17, trim_to=0'0, roll_forward_to=45'15))", 2024-04-18T14:43:45.635 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-04-18T14:43:45.389490+0000", 2024-04-18T14:43:45.636 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 0.16625251999999999, 2024-04-18T14:43:45.636 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0024337400000000002, 2024-04-18T14:43:45.636 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-04-18T14:43:45.636 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "reached pg", 2024-04-18T14:43:45.636 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-04-18T14:43:45.636 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:45.636 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-04-18T14:43:45.636 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:45.389490+0000", 2024-04-18T14:43:45.636 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:43:45.636 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:45.636 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:45.636 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-04-18T14:43:45.636 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:45.389490+0000", 2024-04-18T14:43:45.636 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:43:45.637 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:45.637 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:45.637 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-04-18T14:43:45.637 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:45.389490+0000", 2024-04-18T14:43:45.637 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4294967295.9999995 2024-04-18T14:43:45.637 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:45.637 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:45.637 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-04-18T14:43:45.637 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:45.389509+0000", 2024-04-18T14:43:45.637 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.9296999999999998e-05 2024-04-18T14:43:45.637 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:45.637 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:45.637 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-04-18T14:43:45.638 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:45.389523+0000", 2024-04-18T14:43:45.638 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.3692e-05 2024-04-18T14:43:45.638 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:45.638 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:45.638 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-04-18T14:43:45.638 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:45.389534+0000", 2024-04-18T14:43:45.638 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.1361e-05 2024-04-18T14:43:45.638 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:45.638 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:45.638 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-04-18T14:43:45.638 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:45.389674+0000", 2024-04-18T14:43:45.638 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00013999699999999999 2024-04-18T14:43:45.638 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:45.639 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:45.639 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_started", 2024-04-18T14:43:45.639 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:45.389692+0000", 2024-04-18T14:43:45.639 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.8236999999999998e-05 2024-04-18T14:43:45.639 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:45.639 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:45.639 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_committed", 2024-04-18T14:43:45.639 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:45.391893+0000", 2024-04-18T14:43:45.639 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0022007860000000001 2024-04-18T14:43:45.639 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:45.639 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:45.639 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-04-18T14:43:45.639 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:45.391924+0000", 2024-04-18T14:43:45.639 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.0744000000000002e-05 2024-04-18T14:43:45.639 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:43:45.640 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-04-18T14:43:45.640 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:43:45.640 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:45.640 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:45.640 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "MOSDECSubOpWrite(3.fs6 46/30 ECSubWrite(tid=67, reqid=osd.11.0:67, at_version=46'14, trim_to=0'0, roll_forward_to=45'12))", 2024-04-18T14:43:45.640 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-04-18T14:43:45.394369+0000", 2024-04-18T14:43:45.640 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 0.16137373199999999, 2024-04-18T14:43:45.640 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0021668600000000001, 2024-04-18T14:43:45.640 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-04-18T14:43:45.640 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "reached pg", 2024-04-18T14:43:45.640 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-04-18T14:43:45.640 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:45.640 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-04-18T14:43:45.641 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:45.394369+0000", 2024-04-18T14:43:45.641 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:43:45.641 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:45.641 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:45.641 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-04-18T14:43:45.641 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:45.394369+0000", 2024-04-18T14:43:45.641 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:43:45.641 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:45.641 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:45.641 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-04-18T14:43:45.641 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:45.394368+0000", 2024-04-18T14:43:45.641 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4294967295.999999 2024-04-18T14:43:45.641 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:45.642 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:45.642 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-04-18T14:43:45.642 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:45.394421+0000", 2024-04-18T14:43:45.642 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 5.2587999999999999e-05 2024-04-18T14:43:45.642 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:45.642 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:45.642 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-04-18T14:43:45.642 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:45.394446+0000", 2024-04-18T14:43:45.642 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.5505999999999999e-05 2024-04-18T14:43:45.642 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:45.642 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:45.642 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-04-18T14:43:45.642 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:45.394468+0000", 2024-04-18T14:43:45.643 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.1835e-05 2024-04-18T14:43:45.643 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:45.643 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:45.643 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-04-18T14:43:45.643 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:45.394655+0000", 2024-04-18T14:43:45.643 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00018661599999999999 2024-04-18T14:43:45.643 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:45.643 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:45.643 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_started", 2024-04-18T14:43:45.643 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:45.394681+0000", 2024-04-18T14:43:45.643 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.6449999999999999e-05 2024-04-18T14:43:45.643 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:45.643 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:45.643 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_committed", 2024-04-18T14:43:45.643 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:45.396464+0000", 2024-04-18T14:43:45.644 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0017829810000000001 2024-04-18T14:43:45.644 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:45.644 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:45.644 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-04-18T14:43:45.644 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:45.396536+0000", 2024-04-18T14:43:45.644 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 7.1971000000000006e-05 2024-04-18T14:43:45.644 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:43:45.644 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-04-18T14:43:45.644 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:43:45.644 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:45.644 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:45.644 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "MOSDECSubOpWrite(3.fs6 46/30 ECSubWrite(tid=68, reqid=osd.11.0:67, at_version=0'0, trim_to=0'0, roll_forward_to=46'14))", 2024-04-18T14:43:45.644 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-04-18T14:43:45.401554+0000", 2024-04-18T14:43:45.645 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 0.15418865400000001, 2024-04-18T14:43:45.645 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0022726259999999998, 2024-04-18T14:43:45.645 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-04-18T14:43:45.645 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "reached pg", 2024-04-18T14:43:45.645 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-04-18T14:43:45.645 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:45.645 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-04-18T14:43:45.645 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:45.401554+0000", 2024-04-18T14:43:45.645 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:43:45.645 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:45.645 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:45.645 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-04-18T14:43:45.645 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:45.401554+0000", 2024-04-18T14:43:45.646 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:43:45.646 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:45.646 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:45.646 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-04-18T14:43:45.646 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:45.401553+0000", 2024-04-18T14:43:45.646 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4294967295.9999995 2024-04-18T14:43:45.646 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:45.646 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:45.646 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-04-18T14:43:45.646 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:45.401567+0000", 2024-04-18T14:43:45.646 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.3055e-05 2024-04-18T14:43:45.646 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:45.646 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:45.646 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-04-18T14:43:45.647 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:45.401578+0000", 2024-04-18T14:43:45.647 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.1533e-05 2024-04-18T14:43:45.647 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:45.647 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:45.647 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-04-18T14:43:45.647 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:45.401586+0000", 2024-04-18T14:43:45.647 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 8.259e-06 2024-04-18T14:43:45.647 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:45.647 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:45.647 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-04-18T14:43:45.647 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:45.401627+0000", 2024-04-18T14:43:45.647 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4.1205000000000003e-05 2024-04-18T14:43:45.647 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:45.648 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:45.648 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_started", 2024-04-18T14:43:45.648 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:45.401635+0000", 2024-04-18T14:43:45.648 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 7.8890000000000002e-06 2024-04-18T14:43:45.648 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:45.648 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:45.648 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_committed", 2024-04-18T14:43:45.648 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:45.403801+0000", 2024-04-18T14:43:45.648 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0021653570000000001 2024-04-18T14:43:45.648 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:45.648 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:45.648 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-04-18T14:43:45.648 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:45.403827+0000", 2024-04-18T14:43:45.648 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.6007e-05 2024-04-18T14:43:45.649 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:43:45.649 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-04-18T14:43:45.649 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:43:45.649 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:43:45.649 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-04-18T14:43:45.649 INFO:teuthology.orchestra.run.smithi119.stdout:} 2024-04-18T14:43:45.651 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-04-18T14:43:45.652 INFO:tasks.ceph.osd.12.smithi086.stderr:2024-04-18T14:43:45.651+0000 7f6904968640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 12 (PID: 24960) UID: 0 2024-04-18T14:43:45.751 INFO:tasks.ceph.osd.2.smithi119.stderr:2024-04-18T14:43:45.750+0000 7fcbd30c0640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 24894) UID: 0 2024-04-18T14:43:45.778 INFO:teuthology.orchestra.run.smithi119.stdout:{ 2024-04-18T14:43:45.778 INFO:teuthology.orchestra.run.smithi119.stdout: "ops": [], 2024-04-18T14:43:45.778 INFO:teuthology.orchestra.run.smithi119.stdout: "num_ops": 0 2024-04-18T14:43:45.778 INFO:teuthology.orchestra.run.smithi119.stdout:} 2024-04-18T14:43:45.793 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-04-18T14:43:45.852 INFO:tasks.ceph.osd.15.smithi134.stderr:2024-04-18T14:43:45.856+0000 7f08e6a51640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 15 (PID: 25218) UID: 0 2024-04-18T14:43:45.953 INFO:tasks.ceph.osd.1.smithi096.stderr:2024-04-18T14:43:45.950+0000 7f56a7a98640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 24887) UID: 0 2024-04-18T14:43:45.956 INFO:teuthology.orchestra.run.smithi119.stdout:{ 2024-04-18T14:43:45.956 INFO:teuthology.orchestra.run.smithi119.stdout: "ops": [], 2024-04-18T14:43:45.956 INFO:teuthology.orchestra.run.smithi119.stdout: "complaint_time": 30, 2024-04-18T14:43:45.956 INFO:teuthology.orchestra.run.smithi119.stdout: "num_blocked_ops": 0 2024-04-18T14:43:45.957 INFO:teuthology.orchestra.run.smithi119.stdout:} 2024-04-18T14:43:45.970 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-04-18T14:43:46.054 INFO:tasks.ceph.osd.1.smithi096.stderr:2024-04-18T14:43:46.054+0000 7f56a7a98640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 24887) UID: 0 2024-04-18T14:43:46.092 INFO:teuthology.orchestra.run.smithi119.stdout:{ 2024-04-18T14:43:46.093 INFO:teuthology.orchestra.run.smithi119.stdout: "size": 20, 2024-04-18T14:43:46.093 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 600, 2024-04-18T14:43:46.093 INFO:teuthology.orchestra.run.smithi119.stdout: "ops": [ 2024-04-18T14:43:46.093 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:46.093 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "MOSDECSubOpWrite(3.bs1 37/30 ECSubWrite(tid=16, reqid=client.4559.0:185, at_version=37'8, trim_to=0'0, roll_forward_to=33'6))", 2024-04-18T14:43:46.093 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-04-18T14:43:36.726885+0000", 2024-04-18T14:43:46.093 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 9.3685648480000001, 2024-04-18T14:43:46.093 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0062646220000000001, 2024-04-18T14:43:46.093 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-04-18T14:43:46.093 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "reached pg", 2024-04-18T14:43:46.093 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-04-18T14:43:46.093 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:46.093 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-04-18T14:43:46.094 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:36.726885+0000", 2024-04-18T14:43:46.094 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:43:46.094 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:46.094 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:46.094 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-04-18T14:43:46.094 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:36.726885+0000", 2024-04-18T14:43:46.094 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:43:46.094 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:46.094 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:46.094 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-04-18T14:43:46.094 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:36.726884+0000", 2024-04-18T14:43:46.094 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4294967295.999999 2024-04-18T14:43:46.094 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:46.094 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:46.095 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-04-18T14:43:46.095 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:36.726985+0000", 2024-04-18T14:43:46.095 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000100243 2024-04-18T14:43:46.095 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:46.095 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:46.095 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-04-18T14:43:46.095 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:36.727020+0000", 2024-04-18T14:43:46.095 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.5630999999999998e-05 2024-04-18T14:43:46.095 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:46.095 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:46.095 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-04-18T14:43:46.095 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:36.727045+0000", 2024-04-18T14:43:46.095 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.4737e-05 2024-04-18T14:43:46.095 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:46.095 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:46.095 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-04-18T14:43:46.096 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:36.727185+0000", 2024-04-18T14:43:46.096 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000139777 2024-04-18T14:43:46.096 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:46.096 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:46.096 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_started", 2024-04-18T14:43:46.096 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:36.727211+0000", 2024-04-18T14:43:46.096 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.5931e-05 2024-04-18T14:43:46.096 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:46.096 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:46.096 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_committed", 2024-04-18T14:43:46.096 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:36.733091+0000", 2024-04-18T14:43:46.096 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0058807479999999999 2024-04-18T14:43:46.096 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:46.096 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:46.097 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-04-18T14:43:46.097 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:36.733150+0000", 2024-04-18T14:43:46.097 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 5.8322000000000002e-05 2024-04-18T14:43:46.097 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:43:46.097 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-04-18T14:43:46.097 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:43:46.097 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:46.097 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:46.097 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(client.4559.0:186 3.1s0 3:8de3c091:::smithi13430248-9:head [append 0~540672] snapc 4=[4,2] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-18T14:43:46.097 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-04-18T14:43:36.754855+0000", 2024-04-18T14:43:46.097 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 9.3405948799999994, 2024-04-18T14:43:46.097 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.011816834, 2024-04-18T14:43:46.097 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-04-18T14:43:46.097 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T14:43:46.097 INFO:teuthology.orchestra.run.smithi119.stdout: "client_info": { 2024-04-18T14:43:46.097 INFO:teuthology.orchestra.run.smithi119.stdout: "client": "client.4559", 2024-04-18T14:43:46.098 INFO:teuthology.orchestra.run.smithi119.stdout: "client_addr": "172.21.15.134:0/3113589487", 2024-04-18T14:43:46.098 INFO:teuthology.orchestra.run.smithi119.stdout: "tid": 186 2024-04-18T14:43:46.098 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:46.098 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-04-18T14:43:46.098 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:46.098 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-04-18T14:43:46.098 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:36.754855+0000", 2024-04-18T14:43:46.098 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:43:46.098 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:46.098 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:46.098 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-04-18T14:43:46.098 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:36.754855+0000", 2024-04-18T14:43:46.098 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:43:46.098 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:46.099 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:46.099 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-04-18T14:43:46.099 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:36.754850+0000", 2024-04-18T14:43:46.099 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4294967295.9999952 2024-04-18T14:43:46.099 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:46.099 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:46.099 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-04-18T14:43:46.099 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:36.756415+0000", 2024-04-18T14:43:46.099 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0015650550000000001 2024-04-18T14:43:46.099 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:46.099 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:46.099 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-04-18T14:43:46.099 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:36.756448+0000", 2024-04-18T14:43:46.099 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.2657000000000003e-05 2024-04-18T14:43:46.099 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:46.099 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:46.100 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-04-18T14:43:46.100 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:36.756464+0000", 2024-04-18T14:43:46.100 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.6044000000000001e-05 2024-04-18T14:43:46.100 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:46.100 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:46.100 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-04-18T14:43:46.100 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:36.756562+0000", 2024-04-18T14:43:46.100 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 9.8208999999999994e-05 2024-04-18T14:43:46.100 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:46.100 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:46.100 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-04-18T14:43:46.100 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:36.756733+0000", 2024-04-18T14:43:46.100 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00017070799999999999 2024-04-18T14:43:46.100 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:46.100 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:46.100 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_started", 2024-04-18T14:43:46.101 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:36.758906+0000", 2024-04-18T14:43:46.101 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0021729869999999999 2024-04-18T14:43:46.101 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:46.101 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:46.101 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_committed", 2024-04-18T14:43:46.101 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:36.766167+0000", 2024-04-18T14:43:46.101 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0072611739999999996 2024-04-18T14:43:46.101 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:46.101 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:46.101 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-04-18T14:43:46.101 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:36.766546+0000", 2024-04-18T14:43:46.101 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00037840699999999998 2024-04-18T14:43:46.101 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:46.101 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:46.101 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-04-18T14:43:46.102 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:36.766672+0000", 2024-04-18T14:43:46.102 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00012634300000000001 2024-04-18T14:43:46.102 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:43:46.102 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-04-18T14:43:46.102 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:43:46.102 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:46.102 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:46.102 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(client.4559.0:187 3.1s0 3:8de3c091:::smithi13430248-9:head [append 0~376832] snapc 4=[4,2] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-18T14:43:46.102 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-04-18T14:43:36.761169+0000", 2024-04-18T14:43:46.102 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 9.3342805099999993, 2024-04-18T14:43:46.102 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.013441859, 2024-04-18T14:43:46.102 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-04-18T14:43:46.102 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T14:43:46.102 INFO:teuthology.orchestra.run.smithi119.stdout: "client_info": { 2024-04-18T14:43:46.102 INFO:teuthology.orchestra.run.smithi119.stdout: "client": "client.4559", 2024-04-18T14:43:46.103 INFO:teuthology.orchestra.run.smithi119.stdout: "client_addr": "172.21.15.134:0/3113589487", 2024-04-18T14:43:46.103 INFO:teuthology.orchestra.run.smithi119.stdout: "tid": 187 2024-04-18T14:43:46.103 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:46.103 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-04-18T14:43:46.103 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:46.103 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-04-18T14:43:46.103 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:36.761169+0000", 2024-04-18T14:43:46.103 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:43:46.103 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:46.103 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:46.103 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-04-18T14:43:46.103 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:36.761169+0000", 2024-04-18T14:43:46.103 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:43:46.103 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:46.103 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:46.104 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-04-18T14:43:46.104 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:36.761167+0000", 2024-04-18T14:43:46.104 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4294967295.9999976 2024-04-18T14:43:46.104 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:46.104 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:46.104 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-04-18T14:43:46.104 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:36.761787+0000", 2024-04-18T14:43:46.104 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00062004300000000003 2024-04-18T14:43:46.104 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:46.104 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:46.104 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-04-18T14:43:46.104 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:36.761816+0000", 2024-04-18T14:43:46.104 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.8527e-05 2024-04-18T14:43:46.104 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:46.104 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:46.104 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-04-18T14:43:46.105 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:36.761831+0000", 2024-04-18T14:43:46.105 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.5654e-05 2024-04-18T14:43:46.105 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:46.105 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:46.105 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-04-18T14:43:46.105 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:36.762166+0000", 2024-04-18T14:43:46.105 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00033494200000000002 2024-04-18T14:43:46.105 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:46.105 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:46.105 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-04-18T14:43:46.105 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:36.762326+0000", 2024-04-18T14:43:46.105 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00015945799999999999 2024-04-18T14:43:46.105 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:46.105 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:46.105 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_started", 2024-04-18T14:43:46.106 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:36.763464+0000", 2024-04-18T14:43:46.106 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00113849 2024-04-18T14:43:46.106 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:46.106 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:46.106 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_committed", 2024-04-18T14:43:46.106 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:36.766311+0000", 2024-04-18T14:43:46.106 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0028469379999999998 2024-04-18T14:43:46.106 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:46.106 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:46.106 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-04-18T14:43:46.106 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:36.774508+0000", 2024-04-18T14:43:46.106 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0081971209999999999 2024-04-18T14:43:46.106 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:46.106 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:46.107 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-04-18T14:43:46.107 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:36.774611+0000", 2024-04-18T14:43:46.107 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000103063 2024-04-18T14:43:46.107 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:43:46.107 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-04-18T14:43:46.107 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:43:46.107 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:46.107 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:46.107 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(client.4559.0:188 3.1s0 3:8de3c091:::smithi13430248-9:head [setxattr _header (55) in=7b] snapc 4=[4,2] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-18T14:43:46.107 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-04-18T14:43:36.761844+0000", 2024-04-18T14:43:46.107 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 9.3336056460000005, 2024-04-18T14:43:46.107 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.013080046999999999, 2024-04-18T14:43:46.107 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-04-18T14:43:46.107 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T14:43:46.107 INFO:teuthology.orchestra.run.smithi119.stdout: "client_info": { 2024-04-18T14:43:46.107 INFO:teuthology.orchestra.run.smithi119.stdout: "client": "client.4559", 2024-04-18T14:43:46.108 INFO:teuthology.orchestra.run.smithi119.stdout: "client_addr": "172.21.15.134:0/3113589487", 2024-04-18T14:43:46.108 INFO:teuthology.orchestra.run.smithi119.stdout: "tid": 188 2024-04-18T14:43:46.108 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:46.108 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-04-18T14:43:46.108 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:46.108 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-04-18T14:43:46.108 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:36.761844+0000", 2024-04-18T14:43:46.108 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:43:46.108 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:46.108 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:46.108 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-04-18T14:43:46.108 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:36.761844+0000", 2024-04-18T14:43:46.108 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:43:46.108 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:46.108 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:46.109 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-04-18T14:43:46.109 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:36.761843+0000", 2024-04-18T14:43:46.109 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4294967295.999999 2024-04-18T14:43:46.109 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:46.109 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:46.109 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-04-18T14:43:46.109 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:36.761850+0000", 2024-04-18T14:43:46.109 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 6.7900000000000002e-06 2024-04-18T14:43:46.109 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:46.109 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:46.109 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-04-18T14:43:46.109 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:36.761863+0000", 2024-04-18T14:43:46.109 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.2554e-05 2024-04-18T14:43:46.109 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:46.109 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:46.109 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-04-18T14:43:46.110 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:36.761873+0000", 2024-04-18T14:43:46.110 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.0854e-05 2024-04-18T14:43:46.110 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:46.110 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:46.110 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-04-18T14:43:46.110 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:36.764403+0000", 2024-04-18T14:43:46.110 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0025291459999999999 2024-04-18T14:43:46.110 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:46.110 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:46.110 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-04-18T14:43:46.110 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:36.764592+0000", 2024-04-18T14:43:46.110 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00018972800000000001 2024-04-18T14:43:46.110 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:46.110 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:46.110 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_started", 2024-04-18T14:43:46.111 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:36.765646+0000", 2024-04-18T14:43:46.111 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.001053944 2024-04-18T14:43:46.111 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:46.111 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:46.111 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_committed", 2024-04-18T14:43:46.111 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:36.767122+0000", 2024-04-18T14:43:46.111 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0014754150000000001 2024-04-18T14:43:46.111 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:46.111 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:46.111 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-04-18T14:43:46.111 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:36.774806+0000", 2024-04-18T14:43:46.111 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0076844890000000001 2024-04-18T14:43:46.111 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:46.111 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:46.111 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-04-18T14:43:46.111 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:36.774924+0000", 2024-04-18T14:43:46.112 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00011815 2024-04-18T14:43:46.112 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:43:46.112 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-04-18T14:43:46.112 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:43:46.112 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:46.112 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:46.112 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(client.4559.0:189 3.1s0 3:8de3c091:::smithi13430248-9:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e37)", 2024-04-18T14:43:46.112 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-04-18T14:43:36.761939+0000", 2024-04-18T14:43:46.112 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 9.3335107599999994, 2024-04-18T14:43:46.112 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.018164527, 2024-04-18T14:43:46.112 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-04-18T14:43:46.112 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "started", 2024-04-18T14:43:46.112 INFO:teuthology.orchestra.run.smithi119.stdout: "client_info": { 2024-04-18T14:43:46.112 INFO:teuthology.orchestra.run.smithi119.stdout: "client": "client.4559", 2024-04-18T14:43:46.112 INFO:teuthology.orchestra.run.smithi119.stdout: "client_addr": "172.21.15.134:0/3113589487", 2024-04-18T14:43:46.113 INFO:teuthology.orchestra.run.smithi119.stdout: "tid": 189 2024-04-18T14:43:46.113 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:46.113 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-04-18T14:43:46.113 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:46.113 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-04-18T14:43:46.113 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:36.761939+0000", 2024-04-18T14:43:46.113 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:43:46.113 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:46.113 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:46.113 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-04-18T14:43:46.113 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:36.761939+0000", 2024-04-18T14:43:46.113 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:43:46.113 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:46.113 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:46.113 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-04-18T14:43:46.113 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:36.761938+0000", 2024-04-18T14:43:46.114 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4294967295.9999986 2024-04-18T14:43:46.114 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:46.114 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:46.114 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-04-18T14:43:46.114 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:36.761947+0000", 2024-04-18T14:43:46.114 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 9.2399999999999996e-06 2024-04-18T14:43:46.114 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:46.114 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:46.114 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-04-18T14:43:46.114 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:36.761967+0000", 2024-04-18T14:43:46.114 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.9956999999999999e-05 2024-04-18T14:43:46.114 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:46.114 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:46.114 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-04-18T14:43:46.114 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:36.761988+0000", 2024-04-18T14:43:46.115 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.1115e-05 2024-04-18T14:43:46.115 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:46.115 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:46.115 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-04-18T14:43:46.115 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:36.767166+0000", 2024-04-18T14:43:46.115 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0051778420000000002 2024-04-18T14:43:46.115 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:46.115 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:46.115 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for rw locks", 2024-04-18T14:43:46.115 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:36.767335+0000", 2024-04-18T14:43:46.115 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00016923099999999999 2024-04-18T14:43:46.115 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:46.115 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:46.115 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-04-18T14:43:46.115 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:36.775552+0000", 2024-04-18T14:43:46.115 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0082173460000000004 2024-04-18T14:43:46.116 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:46.116 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:46.116 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-04-18T14:43:46.116 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:36.775682+0000", 2024-04-18T14:43:46.116 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000129803 2024-04-18T14:43:46.116 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:46.116 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:46.116 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-04-18T14:43:46.116 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:36.780104+0000", 2024-04-18T14:43:46.116 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0044214129999999999 2024-04-18T14:43:46.116 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:43:46.116 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-04-18T14:43:46.116 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:43:46.116 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:46.116 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:46.116 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "MOSDECSubOpWriteReply(3.1s0 37/30 ECSubWriteReply(tid=18, last_complete=37'12, committed=1, applied=1))", 2024-04-18T14:43:46.117 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-04-18T14:43:36.762473+0000", 2024-04-18T14:43:46.117 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 9.3329771560000001, 2024-04-18T14:43:46.117 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0036971069999999998, 2024-04-18T14:43:46.117 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-04-18T14:43:46.117 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "reached pg", 2024-04-18T14:43:46.117 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-04-18T14:43:46.117 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:46.117 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-04-18T14:43:46.117 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:36.762473+0000", 2024-04-18T14:43:46.117 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:43:46.117 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:46.117 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:46.117 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-04-18T14:43:46.117 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:36.762473+0000", 2024-04-18T14:43:46.117 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:43:46.118 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:46.118 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:46.118 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-04-18T14:43:46.118 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:36.762471+0000", 2024-04-18T14:43:46.118 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4294967295.9999981 2024-04-18T14:43:46.118 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:46.118 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:46.118 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-04-18T14:43:46.118 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:36.762484+0000", 2024-04-18T14:43:46.118 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.3067e-05 2024-04-18T14:43:46.118 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:46.118 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:46.118 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-04-18T14:43:46.118 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:36.762527+0000", 2024-04-18T14:43:46.118 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4.2588e-05 2024-04-18T14:43:46.119 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:46.119 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:46.119 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-04-18T14:43:46.119 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:36.762548+0000", 2024-04-18T14:43:46.119 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.1160000000000001e-05 2024-04-18T14:43:46.119 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:46.119 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:46.119 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-04-18T14:43:46.119 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:36.766142+0000", 2024-04-18T14:43:46.119 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0035945109999999999 2024-04-18T14:43:46.119 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:46.119 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:46.119 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-04-18T14:43:46.119 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:36.766170+0000", 2024-04-18T14:43:46.119 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.7511000000000001e-05 2024-04-18T14:43:46.120 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:43:46.120 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-04-18T14:43:46.120 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:43:46.120 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:46.120 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:46.120 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "MOSDECSubOpWrite(3.6s4 37/30 ECSubWrite(tid=41, reqid=client.4559.0:206, at_version=37'12, trim_to=0'0, roll_forward_to=37'10))", 2024-04-18T14:43:46.120 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-04-18T14:43:36.869645+0000", 2024-04-18T14:43:46.120 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 9.2258045860000006, 2024-04-18T14:43:46.120 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0053467499999999999, 2024-04-18T14:43:46.120 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-04-18T14:43:46.120 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "reached pg", 2024-04-18T14:43:46.120 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-04-18T14:43:46.120 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:46.120 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-04-18T14:43:46.120 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:36.869645+0000", 2024-04-18T14:43:46.121 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:43:46.121 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:46.121 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:46.121 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-04-18T14:43:46.121 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:36.869645+0000", 2024-04-18T14:43:46.121 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:43:46.121 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:46.121 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:46.121 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-04-18T14:43:46.121 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:36.869643+0000", 2024-04-18T14:43:46.121 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4294967295.9999976 2024-04-18T14:43:46.121 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:46.121 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:46.121 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-04-18T14:43:46.121 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:36.869856+0000", 2024-04-18T14:43:46.122 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000213002 2024-04-18T14:43:46.122 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:46.122 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:46.122 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-04-18T14:43:46.122 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:36.869905+0000", 2024-04-18T14:43:46.122 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4.9221999999999997e-05 2024-04-18T14:43:46.122 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:46.122 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:46.122 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-04-18T14:43:46.122 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:36.869932+0000", 2024-04-18T14:43:46.122 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.7120000000000001e-05 2024-04-18T14:43:46.122 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:46.122 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:46.122 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-04-18T14:43:46.123 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:36.870067+0000", 2024-04-18T14:43:46.123 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00013443999999999999 2024-04-18T14:43:46.123 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:46.123 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:46.123 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_started", 2024-04-18T14:43:46.123 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:36.870097+0000", 2024-04-18T14:43:46.123 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.9904999999999999e-05 2024-04-18T14:43:46.123 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:46.123 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:46.123 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_committed", 2024-04-18T14:43:46.123 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:36.874921+0000", 2024-04-18T14:43:46.123 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.004824732 2024-04-18T14:43:46.123 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:46.123 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:46.123 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-04-18T14:43:46.124 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:36.874992+0000", 2024-04-18T14:43:46.124 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 7.0568999999999995e-05 2024-04-18T14:43:46.124 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:43:46.124 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-04-18T14:43:46.124 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:43:46.124 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:46.124 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:46.124 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "MOSDECSubOpWrite(3.cs6 41/30 ECSubWrite(tid=45, reqid=osd.11.0:45, at_version=41'22, trim_to=0'0, roll_forward_to=39'20))", 2024-04-18T14:43:46.124 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-04-18T14:43:40.766098+0000", 2024-04-18T14:43:46.124 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 5.3293517369999996, 2024-04-18T14:43:46.124 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0054644350000000001, 2024-04-18T14:43:46.124 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-04-18T14:43:46.124 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "reached pg", 2024-04-18T14:43:46.124 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-04-18T14:43:46.124 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:46.124 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-04-18T14:43:46.125 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:40.766098+0000", 2024-04-18T14:43:46.125 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:43:46.125 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:46.125 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:46.125 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-04-18T14:43:46.125 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:40.766098+0000", 2024-04-18T14:43:46.125 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:43:46.125 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:46.125 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:46.125 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-04-18T14:43:46.125 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:40.766097+0000", 2024-04-18T14:43:46.125 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4294967295.999999 2024-04-18T14:43:46.125 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:46.125 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:46.126 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-04-18T14:43:46.126 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:40.766212+0000", 2024-04-18T14:43:46.126 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000114919 2024-04-18T14:43:46.126 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:46.126 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:46.126 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-04-18T14:43:46.126 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:40.766249+0000", 2024-04-18T14:43:46.126 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.7261000000000001e-05 2024-04-18T14:43:46.126 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:46.126 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:46.126 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-04-18T14:43:46.126 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:40.766273+0000", 2024-04-18T14:43:46.126 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.3683999999999999e-05 2024-04-18T14:43:46.126 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:46.126 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:46.127 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-04-18T14:43:46.127 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:40.766597+0000", 2024-04-18T14:43:46.127 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00032354399999999999 2024-04-18T14:43:46.127 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:46.127 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:46.127 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_started", 2024-04-18T14:43:46.127 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:40.766623+0000", 2024-04-18T14:43:46.127 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.5870000000000001e-05 2024-04-18T14:43:46.127 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:46.127 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:46.127 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_committed", 2024-04-18T14:43:46.127 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:40.771502+0000", 2024-04-18T14:43:46.127 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0048793889999999996 2024-04-18T14:43:46.127 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:46.127 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:46.127 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-04-18T14:43:46.128 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:40.771563+0000", 2024-04-18T14:43:46.128 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 6.0637999999999998e-05 2024-04-18T14:43:46.128 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:43:46.128 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-04-18T14:43:46.128 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:43:46.128 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:46.128 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:46.128 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "MOSDECSubOpWrite(3.cs6 41/30 ECSubWrite(tid=46, reqid=osd.11.0:46, at_version=41'24, trim_to=0'0, roll_forward_to=39'20))", 2024-04-18T14:43:46.128 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-04-18T14:43:40.766310+0000", 2024-04-18T14:43:46.128 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 5.3291398360000004, 2024-04-18T14:43:46.128 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0085406670000000001, 2024-04-18T14:43:46.128 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-04-18T14:43:46.128 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "reached pg", 2024-04-18T14:43:46.128 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-04-18T14:43:46.128 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:46.129 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-04-18T14:43:46.129 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:40.766310+0000", 2024-04-18T14:43:46.129 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:43:46.129 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:46.129 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:46.129 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-04-18T14:43:46.129 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:40.766310+0000", 2024-04-18T14:43:46.129 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:43:46.129 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:46.129 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:46.129 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-04-18T14:43:46.129 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:40.766309+0000", 2024-04-18T14:43:46.129 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4294967295.999999 2024-04-18T14:43:46.129 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:46.129 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:46.130 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-04-18T14:43:46.130 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:40.766357+0000", 2024-04-18T14:43:46.130 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4.7984e-05 2024-04-18T14:43:46.130 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:46.130 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:46.130 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-04-18T14:43:46.130 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:40.766384+0000", 2024-04-18T14:43:46.130 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.6656999999999999e-05 2024-04-18T14:43:46.130 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:46.130 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:46.130 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-04-18T14:43:46.130 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:40.766403+0000", 2024-04-18T14:43:46.130 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.8947999999999999e-05 2024-04-18T14:43:46.130 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:46.130 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:46.130 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-04-18T14:43:46.131 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:40.768792+0000", 2024-04-18T14:43:46.131 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0023896299999999998 2024-04-18T14:43:46.131 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:46.131 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:46.131 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_started", 2024-04-18T14:43:46.131 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:40.768817+0000", 2024-04-18T14:43:46.131 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.4263000000000001e-05 2024-04-18T14:43:46.131 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:46.131 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:46.131 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_committed", 2024-04-18T14:43:46.131 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:40.774817+0000", 2024-04-18T14:43:46.131 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0060000440000000004 2024-04-18T14:43:46.131 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:46.131 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:46.131 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-04-18T14:43:46.132 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:40.774851+0000", 2024-04-18T14:43:46.132 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.4037e-05 2024-04-18T14:43:46.132 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:43:46.132 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-04-18T14:43:46.132 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:43:46.132 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:46.132 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:46.132 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "pg_update_log_missing(3.9s6 epoch 41/30 rep_tid 40 entries 41'25 (0'0) error 3:936e42fd:::smithi13430248-33:head by client.4559.0:247 0.000000 0 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 38'23)", 2024-04-18T14:43:46.132 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-04-18T14:43:40.768388+0000", 2024-04-18T14:43:46.132 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 5.3270614419999998, 2024-04-18T14:43:46.132 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0042996750000000002, 2024-04-18T14:43:46.132 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-04-18T14:43:46.132 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "reached pg", 2024-04-18T14:43:46.132 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-04-18T14:43:46.132 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:46.133 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-04-18T14:43:46.133 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:40.768388+0000", 2024-04-18T14:43:46.133 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:43:46.133 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:46.133 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:46.133 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-04-18T14:43:46.133 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:40.768388+0000", 2024-04-18T14:43:46.133 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:43:46.133 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:46.133 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:46.133 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-04-18T14:43:46.133 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:40.768388+0000", 2024-04-18T14:43:46.133 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4294967295.9999995 2024-04-18T14:43:46.133 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:46.133 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:46.134 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-04-18T14:43:46.134 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:40.768402+0000", 2024-04-18T14:43:46.134 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.4327e-05 2024-04-18T14:43:46.134 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:46.134 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:46.134 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-04-18T14:43:46.134 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:40.768436+0000", 2024-04-18T14:43:46.134 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.3834000000000002e-05 2024-04-18T14:43:46.134 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:46.134 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:46.134 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-04-18T14:43:46.134 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:40.768467+0000", 2024-04-18T14:43:46.134 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.0851e-05 2024-04-18T14:43:46.134 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:46.134 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:46.135 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-04-18T14:43:46.135 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:40.769013+0000", 2024-04-18T14:43:46.135 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000546479 2024-04-18T14:43:46.135 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:46.135 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:46.135 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-04-18T14:43:46.135 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:40.772688+0000", 2024-04-18T14:43:46.135 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0036747279999999999 2024-04-18T14:43:46.135 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:43:46.135 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-04-18T14:43:46.135 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:43:46.135 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:46.135 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:46.135 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "MOSDECSubOpWrite(3.9s6 41/30 ECSubWrite(tid=41, reqid=osd.12.0:41, at_version=41'27, trim_to=0'0, roll_forward_to=38'24))", 2024-04-18T14:43:46.135 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-04-18T14:43:40.770348+0000", 2024-04-18T14:43:46.136 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 5.325101869, 2024-04-18T14:43:46.136 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0059093879999999998, 2024-04-18T14:43:46.136 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-04-18T14:43:46.136 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "reached pg", 2024-04-18T14:43:46.136 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-04-18T14:43:46.136 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:46.136 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-04-18T14:43:46.136 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:40.770348+0000", 2024-04-18T14:43:46.136 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:43:46.136 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:46.136 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:46.136 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-04-18T14:43:46.136 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:40.770348+0000", 2024-04-18T14:43:46.136 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:43:46.136 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:46.137 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:46.137 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-04-18T14:43:46.137 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:40.770346+0000", 2024-04-18T14:43:46.137 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4294967295.9999986 2024-04-18T14:43:46.137 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:46.137 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:46.137 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-04-18T14:43:46.137 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:40.770399+0000", 2024-04-18T14:43:46.137 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 5.2231000000000002e-05 2024-04-18T14:43:46.137 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:46.137 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:46.137 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-04-18T14:43:46.137 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:40.770430+0000", 2024-04-18T14:43:46.137 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.1294000000000002e-05 2024-04-18T14:43:46.137 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:46.138 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:46.138 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-04-18T14:43:46.138 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:40.770452+0000", 2024-04-18T14:43:46.138 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.2155e-05 2024-04-18T14:43:46.138 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:46.138 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:46.138 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-04-18T14:43:46.138 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:40.770580+0000", 2024-04-18T14:43:46.138 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00012803200000000001 2024-04-18T14:43:46.138 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:46.138 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:46.138 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_started", 2024-04-18T14:43:46.138 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:40.770606+0000", 2024-04-18T14:43:46.138 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.6207000000000002e-05 2024-04-18T14:43:46.138 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:46.139 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:46.139 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_committed", 2024-04-18T14:43:46.139 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:40.776212+0000", 2024-04-18T14:43:46.139 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0056061949999999996 2024-04-18T14:43:46.139 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:46.139 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:46.139 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-04-18T14:43:46.139 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:40.776257+0000", 2024-04-18T14:43:46.139 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4.4931000000000001e-05 2024-04-18T14:43:46.139 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:43:46.139 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-04-18T14:43:46.139 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:43:46.139 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:46.139 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:46.139 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(client.4559.0:285 3.1s0 3:891e68bf:::smithi13430248-19:2 [read 0~311296,checksum,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-04-18T14:43:46.139 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-04-18T14:43:44.372864+0000", 2024-04-18T14:43:46.140 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 1.722585577, 2024-04-18T14:43:46.140 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.010186044, 2024-04-18T14:43:46.140 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-04-18T14:43:46.140 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "started", 2024-04-18T14:43:46.140 INFO:teuthology.orchestra.run.smithi119.stdout: "client_info": { 2024-04-18T14:43:46.140 INFO:teuthology.orchestra.run.smithi119.stdout: "client": "client.4559", 2024-04-18T14:43:46.140 INFO:teuthology.orchestra.run.smithi119.stdout: "client_addr": "172.21.15.134:0/3113589487", 2024-04-18T14:43:46.140 INFO:teuthology.orchestra.run.smithi119.stdout: "tid": 285 2024-04-18T14:43:46.140 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:46.140 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-04-18T14:43:46.140 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:46.140 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-04-18T14:43:46.140 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:44.372864+0000", 2024-04-18T14:43:46.140 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:43:46.140 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:46.140 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:46.141 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-04-18T14:43:46.141 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:44.372864+0000", 2024-04-18T14:43:46.141 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:43:46.141 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:46.141 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:46.141 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-04-18T14:43:46.141 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:44.372862+0000", 2024-04-18T14:43:46.141 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4294967295.9999971 2024-04-18T14:43:46.141 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:46.141 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:46.141 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-04-18T14:43:46.141 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:44.372880+0000", 2024-04-18T14:43:46.141 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.8688000000000001e-05 2024-04-18T14:43:46.141 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:46.141 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:46.142 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-04-18T14:43:46.142 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:44.372914+0000", 2024-04-18T14:43:46.142 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.3837000000000001e-05 2024-04-18T14:43:46.142 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:46.142 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:46.142 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-04-18T14:43:46.142 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:44.372950+0000", 2024-04-18T14:43:46.142 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.5604e-05 2024-04-18T14:43:46.142 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:46.142 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:46.142 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-04-18T14:43:46.142 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:44.373068+0000", 2024-04-18T14:43:46.142 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000118385 2024-04-18T14:43:46.142 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:46.142 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:46.143 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "op must wait for map", 2024-04-18T14:43:46.143 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:44.373082+0000", 2024-04-18T14:43:46.143 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.4087000000000001e-05 2024-04-18T14:43:46.143 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:46.143 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:46.143 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-04-18T14:43:46.143 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:44.377259+0000", 2024-04-18T14:43:46.143 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0041765300000000003 2024-04-18T14:43:46.143 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:46.143 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:46.143 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-04-18T14:43:46.143 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:44.377542+0000", 2024-04-18T14:43:46.143 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00028300500000000002 2024-04-18T14:43:46.143 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:46.143 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:46.143 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-04-18T14:43:46.144 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:44.383050+0000", 2024-04-18T14:43:46.144 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0055085749999999999 2024-04-18T14:43:46.144 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:43:46.144 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-04-18T14:43:46.144 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:43:46.144 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:46.144 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:46.144 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(client.4559.0:286 3.1s0 3:891e68bf:::smithi13430248-19:2 [read 0~311296,checksum] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-04-18T14:43:46.144 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-04-18T14:43:44.372973+0000", 2024-04-18T14:43:46.144 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 1.7224766680000001, 2024-04-18T14:43:46.144 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.011021772000000001, 2024-04-18T14:43:46.144 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-04-18T14:43:46.144 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "started", 2024-04-18T14:43:46.144 INFO:teuthology.orchestra.run.smithi119.stdout: "client_info": { 2024-04-18T14:43:46.145 INFO:teuthology.orchestra.run.smithi119.stdout: "client": "client.4559", 2024-04-18T14:43:46.145 INFO:teuthology.orchestra.run.smithi119.stdout: "client_addr": "172.21.15.134:0/3113589487", 2024-04-18T14:43:46.145 INFO:teuthology.orchestra.run.smithi119.stdout: "tid": 286 2024-04-18T14:43:46.145 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:46.145 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-04-18T14:43:46.145 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:46.145 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-04-18T14:43:46.145 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:44.372973+0000", 2024-04-18T14:43:46.145 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:43:46.145 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:46.145 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:46.145 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-04-18T14:43:46.145 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:44.372973+0000", 2024-04-18T14:43:46.145 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:43:46.145 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:46.145 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:46.146 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-04-18T14:43:46.146 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:44.372972+0000", 2024-04-18T14:43:46.146 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4294967295.999999 2024-04-18T14:43:46.146 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:46.146 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:46.146 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-04-18T14:43:46.146 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:44.372979+0000", 2024-04-18T14:43:46.146 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 7.0509999999999999e-06 2024-04-18T14:43:46.146 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:46.146 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:46.146 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-04-18T14:43:46.146 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:44.373015+0000", 2024-04-18T14:43:46.146 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.5583999999999997e-05 2024-04-18T14:43:46.146 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:46.147 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:46.147 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-04-18T14:43:46.147 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:44.373026+0000", 2024-04-18T14:43:46.147 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.1586000000000001e-05 2024-04-18T14:43:46.147 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:46.147 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:46.147 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-04-18T14:43:46.147 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:44.373222+0000", 2024-04-18T14:43:46.147 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000195391 2024-04-18T14:43:46.147 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:46.147 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:46.147 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting_for_map not empty", 2024-04-18T14:43:46.147 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:44.373233+0000", 2024-04-18T14:43:46.147 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.1586999999999999e-05 2024-04-18T14:43:46.147 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:46.147 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:46.148 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-04-18T14:43:46.148 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:44.379041+0000", 2024-04-18T14:43:46.148 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0058081030000000002 2024-04-18T14:43:46.148 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:46.148 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:46.148 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-04-18T14:43:46.148 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:44.379196+0000", 2024-04-18T14:43:46.148 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00015440199999999999 2024-04-18T14:43:46.148 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:46.148 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:46.148 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-04-18T14:43:46.148 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:44.383995+0000", 2024-04-18T14:43:46.148 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0047992419999999996 2024-04-18T14:43:46.148 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:43:46.148 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-04-18T14:43:46.149 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:43:46.149 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:46.149 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:46.149 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(client.4559.0:287 3.1s0 3:891e68bf:::smithi13430248-19:2 [read 0~311296,checksum] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-04-18T14:43:46.149 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-04-18T14:43:44.373037+0000", 2024-04-18T14:43:46.149 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 1.7224125770000001, 2024-04-18T14:43:46.149 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.015018301, 2024-04-18T14:43:46.149 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-04-18T14:43:46.149 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "started", 2024-04-18T14:43:46.149 INFO:teuthology.orchestra.run.smithi119.stdout: "client_info": { 2024-04-18T14:43:46.149 INFO:teuthology.orchestra.run.smithi119.stdout: "client": "client.4559", 2024-04-18T14:43:46.149 INFO:teuthology.orchestra.run.smithi119.stdout: "client_addr": "172.21.15.134:0/3113589487", 2024-04-18T14:43:46.149 INFO:teuthology.orchestra.run.smithi119.stdout: "tid": 287 2024-04-18T14:43:46.149 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:46.149 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-04-18T14:43:46.149 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:46.150 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-04-18T14:43:46.150 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:44.373037+0000", 2024-04-18T14:43:46.150 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:43:46.150 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:46.150 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:46.150 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-04-18T14:43:46.150 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:44.373037+0000", 2024-04-18T14:43:46.150 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:43:46.150 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:46.150 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:46.150 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-04-18T14:43:46.150 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:44.373036+0000", 2024-04-18T14:43:46.150 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4294967295.999999 2024-04-18T14:43:46.150 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:46.150 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:46.151 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-04-18T14:43:46.151 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:44.373042+0000", 2024-04-18T14:43:46.151 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 5.8370000000000002e-06 2024-04-18T14:43:46.151 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:46.151 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:46.151 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-04-18T14:43:46.151 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:44.373052+0000", 2024-04-18T14:43:46.151 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 9.9869999999999994e-06 2024-04-18T14:43:46.151 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:46.151 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:46.151 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-04-18T14:43:46.151 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:44.373060+0000", 2024-04-18T14:43:46.151 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 7.34e-06 2024-04-18T14:43:46.151 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:46.151 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:46.151 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-04-18T14:43:46.152 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:44.373308+0000", 2024-04-18T14:43:46.152 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00024842100000000003 2024-04-18T14:43:46.152 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:46.152 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:46.152 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting_for_map not empty", 2024-04-18T14:43:46.152 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:44.373327+0000", 2024-04-18T14:43:46.152 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.9417000000000001e-05 2024-04-18T14:43:46.152 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:46.152 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:46.152 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-04-18T14:43:46.152 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:44.384088+0000", 2024-04-18T14:43:46.152 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.010760357 2024-04-18T14:43:46.152 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:46.152 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:46.152 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-04-18T14:43:46.153 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:44.384388+0000", 2024-04-18T14:43:46.153 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00029992499999999999 2024-04-18T14:43:46.153 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:46.153 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:46.153 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-04-18T14:43:46.153 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:44.388056+0000", 2024-04-18T14:43:46.153 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0036678499999999998 2024-04-18T14:43:46.153 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:43:46.153 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-04-18T14:43:46.153 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:43:46.153 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:46.153 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:46.153 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "MOSDECSubOpWrite(3.9s6 45/30 ECSubWrite(tid=53, reqid=client.4559.0:291, at_version=45'40, trim_to=0'0, roll_forward_to=44'38))", 2024-04-18T14:43:46.153 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-04-18T14:43:44.395110+0000", 2024-04-18T14:43:46.153 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 1.700340183, 2024-04-18T14:43:46.153 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0067441330000000002, 2024-04-18T14:43:46.154 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-04-18T14:43:46.154 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "reached pg", 2024-04-18T14:43:46.154 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-04-18T14:43:46.154 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:46.154 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-04-18T14:43:46.154 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:44.395110+0000", 2024-04-18T14:43:46.154 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:43:46.154 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:46.154 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:46.154 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-04-18T14:43:46.154 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:44.395110+0000", 2024-04-18T14:43:46.154 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:43:46.154 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:46.154 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:46.154 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-04-18T14:43:46.155 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:44.395109+0000", 2024-04-18T14:43:46.155 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4294967295.9999995 2024-04-18T14:43:46.155 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:46.155 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:46.155 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-04-18T14:43:46.155 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:44.395842+0000", 2024-04-18T14:43:46.155 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00073260100000000004 2024-04-18T14:43:46.155 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:46.155 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:46.155 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-04-18T14:43:46.155 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:44.395883+0000", 2024-04-18T14:43:46.155 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4.1114e-05 2024-04-18T14:43:46.155 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:46.155 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:46.155 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-04-18T14:43:46.155 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:44.395907+0000", 2024-04-18T14:43:46.156 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.4077e-05 2024-04-18T14:43:46.156 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:46.156 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:46.156 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-04-18T14:43:46.156 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:44.396117+0000", 2024-04-18T14:43:46.156 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00021007400000000001 2024-04-18T14:43:46.156 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:46.156 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:46.156 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_started", 2024-04-18T14:43:46.156 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:44.396143+0000", 2024-04-18T14:43:46.156 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.6480000000000001e-05 2024-04-18T14:43:46.156 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:46.156 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:46.156 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_committed", 2024-04-18T14:43:46.156 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:44.401800+0000", 2024-04-18T14:43:46.157 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.005656777 2024-04-18T14:43:46.157 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:46.157 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:46.157 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-04-18T14:43:46.157 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:44.401854+0000", 2024-04-18T14:43:46.157 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 5.3677000000000001e-05 2024-04-18T14:43:46.157 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:43:46.157 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-04-18T14:43:46.157 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:43:46.157 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:46.157 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:46.157 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "MOSDECSubOpWrite(3.5s1 45/30 ECSubWrite(tid=11, reqid=client.4559.0:302, at_version=45'10, trim_to=0'0, roll_forward_to=44'8))", 2024-04-18T14:43:46.157 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-04-18T14:43:44.428466+0000", 2024-04-18T14:43:46.157 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 1.66698423, 2024-04-18T14:43:46.157 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0055255340000000003, 2024-04-18T14:43:46.158 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-04-18T14:43:46.158 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "reached pg", 2024-04-18T14:43:46.158 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-04-18T14:43:46.158 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:46.158 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-04-18T14:43:46.158 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:44.428466+0000", 2024-04-18T14:43:46.158 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:43:46.158 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:46.158 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:46.158 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-04-18T14:43:46.158 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:44.428466+0000", 2024-04-18T14:43:46.158 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:43:46.158 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:46.158 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:46.158 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-04-18T14:43:46.159 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:44.428465+0000", 2024-04-18T14:43:46.159 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4294967295.999999 2024-04-18T14:43:46.159 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:46.159 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:46.159 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-04-18T14:43:46.159 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:44.428516+0000", 2024-04-18T14:43:46.159 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 5.1094000000000002e-05 2024-04-18T14:43:46.159 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:46.159 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:46.159 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-04-18T14:43:46.159 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:44.428554+0000", 2024-04-18T14:43:46.159 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.8266999999999998e-05 2024-04-18T14:43:46.159 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:46.159 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:46.159 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-04-18T14:43:46.159 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:44.428577+0000", 2024-04-18T14:43:46.160 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.2807e-05 2024-04-18T14:43:46.160 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:46.160 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:46.160 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-04-18T14:43:46.160 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:44.428719+0000", 2024-04-18T14:43:46.160 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000141843 2024-04-18T14:43:46.160 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:46.160 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:46.160 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_started", 2024-04-18T14:43:46.160 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:44.428746+0000", 2024-04-18T14:43:46.160 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.7433999999999999e-05 2024-04-18T14:43:46.160 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:46.160 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:46.160 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_committed", 2024-04-18T14:43:46.160 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:44.433933+0000", 2024-04-18T14:43:46.161 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0051871180000000001 2024-04-18T14:43:46.161 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:46.161 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:46.161 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-04-18T14:43:46.161 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:44.433991+0000", 2024-04-18T14:43:46.161 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 5.7944e-05 2024-04-18T14:43:46.161 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:43:46.161 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-04-18T14:43:46.161 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:43:46.161 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:46.161 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:46.161 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "MOSDECSubOpWrite(3.6s4 45/30 ECSubWrite(tid=62, reqid=client.4559.0:310, at_version=45'19, trim_to=0'0, roll_forward_to=44'17))", 2024-04-18T14:43:46.161 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-04-18T14:43:44.540068+0000", 2024-04-18T14:43:46.161 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 1.55538212, 2024-04-18T14:43:46.161 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0043683369999999999, 2024-04-18T14:43:46.161 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-04-18T14:43:46.162 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "reached pg", 2024-04-18T14:43:46.162 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-04-18T14:43:46.162 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:46.162 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-04-18T14:43:46.162 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:44.540068+0000", 2024-04-18T14:43:46.162 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:43:46.162 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:46.162 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:46.162 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-04-18T14:43:46.162 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:44.540068+0000", 2024-04-18T14:43:46.162 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:43:46.162 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:46.162 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:46.162 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-04-18T14:43:46.163 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:44.540067+0000", 2024-04-18T14:43:46.163 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4294967295.999999 2024-04-18T14:43:46.163 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:46.163 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:46.163 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-04-18T14:43:46.163 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:44.540684+0000", 2024-04-18T14:43:46.163 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00061696799999999997 2024-04-18T14:43:46.163 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:46.163 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:46.163 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-04-18T14:43:46.163 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:44.540726+0000", 2024-04-18T14:43:46.163 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4.1916999999999999e-05 2024-04-18T14:43:46.163 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:46.163 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:46.163 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-04-18T14:43:46.163 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:44.540755+0000", 2024-04-18T14:43:46.164 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.9643999999999999e-05 2024-04-18T14:43:46.164 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:46.164 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:46.164 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-04-18T14:43:46.164 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:44.541185+0000", 2024-04-18T14:43:46.164 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000429071 2024-04-18T14:43:46.164 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:46.164 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:46.164 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_started", 2024-04-18T14:43:46.164 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:44.541225+0000", 2024-04-18T14:43:46.164 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4.0377999999999999e-05 2024-04-18T14:43:46.164 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:46.164 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:46.164 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_committed", 2024-04-18T14:43:46.164 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:44.544386+0000", 2024-04-18T14:43:46.164 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0031610240000000001 2024-04-18T14:43:46.165 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:46.165 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:46.165 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-04-18T14:43:46.165 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:44.544436+0000", 2024-04-18T14:43:46.165 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 5.0180999999999999e-05 2024-04-18T14:43:46.165 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:43:46.165 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-04-18T14:43:46.165 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:43:46.165 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:46.165 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:46.165 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(client.4559.0:318 3.1s0 3:86043532:::smithi13430248-49:head [append 0~0] snapc d=[d,b,a,8,7,2] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-18T14:43:46.165 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-04-18T14:43:44.563537+0000", 2024-04-18T14:43:46.166 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 1.531912714, 2024-04-18T14:43:46.166 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0072091849999999999, 2024-04-18T14:43:46.166 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-04-18T14:43:46.166 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T14:43:46.166 INFO:teuthology.orchestra.run.smithi119.stdout: "client_info": { 2024-04-18T14:43:46.166 INFO:teuthology.orchestra.run.smithi119.stdout: "client": "client.4559", 2024-04-18T14:43:46.166 INFO:teuthology.orchestra.run.smithi119.stdout: "client_addr": "172.21.15.134:0/3113589487", 2024-04-18T14:43:46.166 INFO:teuthology.orchestra.run.smithi119.stdout: "tid": 318 2024-04-18T14:43:46.166 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:46.166 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-04-18T14:43:46.166 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:46.166 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-04-18T14:43:46.166 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:44.563537+0000", 2024-04-18T14:43:46.166 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:43:46.166 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:46.167 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:46.167 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-04-18T14:43:46.167 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:44.563537+0000", 2024-04-18T14:43:46.167 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:43:46.167 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:46.167 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:46.167 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-04-18T14:43:46.167 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:44.563534+0000", 2024-04-18T14:43:46.167 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4294967295.9999971 2024-04-18T14:43:46.167 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:46.167 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:46.167 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-04-18T14:43:46.167 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:44.563547+0000", 2024-04-18T14:43:46.167 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.3370000000000001e-05 2024-04-18T14:43:46.167 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:46.168 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:46.168 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-04-18T14:43:46.168 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:44.563580+0000", 2024-04-18T14:43:46.168 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.2597e-05 2024-04-18T14:43:46.168 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:46.168 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:46.168 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-04-18T14:43:46.168 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:44.563595+0000", 2024-04-18T14:43:46.168 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.4554e-05 2024-04-18T14:43:46.168 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:46.168 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:46.168 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-04-18T14:43:46.168 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:44.563705+0000", 2024-04-18T14:43:46.168 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000110078 2024-04-18T14:43:46.168 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:46.168 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:46.169 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-04-18T14:43:46.169 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:44.563881+0000", 2024-04-18T14:43:46.169 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000176613 2024-04-18T14:43:46.169 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:46.169 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:46.169 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_started", 2024-04-18T14:43:46.169 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:44.565067+0000", 2024-04-18T14:43:46.169 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.001185282 2024-04-18T14:43:46.169 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:46.169 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:46.169 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_committed", 2024-04-18T14:43:46.169 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:44.569679+0000", 2024-04-18T14:43:46.169 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0046123809999999996 2024-04-18T14:43:46.169 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:46.169 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:46.170 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-04-18T14:43:46.170 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:44.570582+0000", 2024-04-18T14:43:46.170 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00090253700000000002 2024-04-18T14:43:46.170 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:46.170 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:46.170 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-04-18T14:43:46.170 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:44.570746+0000", 2024-04-18T14:43:46.170 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000164833 2024-04-18T14:43:46.170 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:43:46.170 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-04-18T14:43:46.170 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:43:46.170 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:46.170 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:46.170 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(client.4559.0:319 3.1s0 3:86043532:::smithi13430248-49:head [rollback 2] snapc d=[d,b,a,8,7,2] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-18T14:43:46.171 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-04-18T14:43:44.563613+0000", 2024-04-18T14:43:46.171 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 1.5318370159999999, 2024-04-18T14:43:46.171 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.010064484, 2024-04-18T14:43:46.171 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-04-18T14:43:46.171 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T14:43:46.171 INFO:teuthology.orchestra.run.smithi119.stdout: "client_info": { 2024-04-18T14:43:46.171 INFO:teuthology.orchestra.run.smithi119.stdout: "client": "client.4559", 2024-04-18T14:43:46.171 INFO:teuthology.orchestra.run.smithi119.stdout: "client_addr": "172.21.15.134:0/3113589487", 2024-04-18T14:43:46.171 INFO:teuthology.orchestra.run.smithi119.stdout: "tid": 319 2024-04-18T14:43:46.171 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:46.171 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-04-18T14:43:46.171 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:46.171 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-04-18T14:43:46.171 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:44.563613+0000", 2024-04-18T14:43:46.171 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:43:46.171 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:46.172 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:46.172 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-04-18T14:43:46.172 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:44.563613+0000", 2024-04-18T14:43:46.172 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:43:46.172 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:46.172 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:46.172 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-04-18T14:43:46.172 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:44.563612+0000", 2024-04-18T14:43:46.172 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4294967295.999999 2024-04-18T14:43:46.172 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:46.172 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:46.172 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-04-18T14:43:46.172 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:44.563618+0000", 2024-04-18T14:43:46.172 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 6.4829999999999996e-06 2024-04-18T14:43:46.172 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:46.173 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:46.173 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-04-18T14:43:46.173 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:44.563631+0000", 2024-04-18T14:43:46.173 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.2594e-05 2024-04-18T14:43:46.173 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:46.173 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:46.173 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-04-18T14:43:46.173 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:44.563639+0000", 2024-04-18T14:43:46.173 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 8.1969999999999996e-06 2024-04-18T14:43:46.173 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:46.173 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:46.173 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-04-18T14:43:46.173 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:44.566084+0000", 2024-04-18T14:43:46.173 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0024452609999999998 2024-04-18T14:43:46.173 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:46.174 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:46.174 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-04-18T14:43:46.174 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:44.566366+0000", 2024-04-18T14:43:46.174 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00028144200000000002 2024-04-18T14:43:46.174 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:46.174 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:46.174 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_started", 2024-04-18T14:43:46.174 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:44.567405+0000", 2024-04-18T14:43:46.174 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0010387319999999999 2024-04-18T14:43:46.174 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:46.174 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:46.174 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_committed", 2024-04-18T14:43:46.174 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:44.569681+0000", 2024-04-18T14:43:46.174 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0022766420000000002 2024-04-18T14:43:46.174 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:46.175 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:46.175 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-04-18T14:43:46.175 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:44.573577+0000", 2024-04-18T14:43:46.175 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0038952349999999999 2024-04-18T14:43:46.175 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:46.175 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:46.175 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-04-18T14:43:46.175 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:44.573677+0000", 2024-04-18T14:43:46.175 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00010084799999999999 2024-04-18T14:43:46.175 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:43:46.175 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-04-18T14:43:46.175 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:43:46.175 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:46.175 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:46.175 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(client.4559.0:320 3.1s0 3:86043532:::smithi13430248-49:head [append 0~0] snapc d=[d,b,a,8,7,2] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-18T14:43:46.176 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-04-18T14:43:44.563733+0000", 2024-04-18T14:43:46.176 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 1.5317167409999999, 2024-04-18T14:43:46.176 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.010280269, 2024-04-18T14:43:46.176 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-04-18T14:43:46.176 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T14:43:46.176 INFO:teuthology.orchestra.run.smithi119.stdout: "client_info": { 2024-04-18T14:43:46.176 INFO:teuthology.orchestra.run.smithi119.stdout: "client": "client.4559", 2024-04-18T14:43:46.176 INFO:teuthology.orchestra.run.smithi119.stdout: "client_addr": "172.21.15.134:0/3113589487", 2024-04-18T14:43:46.176 INFO:teuthology.orchestra.run.smithi119.stdout: "tid": 320 2024-04-18T14:43:46.176 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:46.176 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-04-18T14:43:46.176 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:46.176 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-04-18T14:43:46.176 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:44.563733+0000", 2024-04-18T14:43:46.176 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:43:46.176 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:46.177 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:46.177 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-04-18T14:43:46.177 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:44.563733+0000", 2024-04-18T14:43:46.177 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:43:46.177 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:46.177 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:46.177 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-04-18T14:43:46.177 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:44.563731+0000", 2024-04-18T14:43:46.177 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4294967295.9999976 2024-04-18T14:43:46.177 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:46.177 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:46.177 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-04-18T14:43:46.177 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:44.563744+0000", 2024-04-18T14:43:46.177 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.311e-05 2024-04-18T14:43:46.177 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:46.178 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:46.178 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-04-18T14:43:46.178 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:44.563777+0000", 2024-04-18T14:43:46.178 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.2984000000000001e-05 2024-04-18T14:43:46.178 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:46.178 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:46.178 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-04-18T14:43:46.178 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:44.563812+0000", 2024-04-18T14:43:46.178 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.4793999999999999e-05 2024-04-18T14:43:46.178 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:46.178 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:46.178 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-04-18T14:43:46.178 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:44.568010+0000", 2024-04-18T14:43:46.178 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0041978069999999996 2024-04-18T14:43:46.178 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:46.178 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:46.179 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-04-18T14:43:46.179 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:44.568172+0000", 2024-04-18T14:43:46.179 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00016264599999999999 2024-04-18T14:43:46.179 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:46.179 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:46.179 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_started", 2024-04-18T14:43:46.179 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:44.568987+0000", 2024-04-18T14:43:46.179 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00081480500000000004 2024-04-18T14:43:46.179 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:46.179 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:46.179 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_committed", 2024-04-18T14:43:46.179 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:44.570293+0000", 2024-04-18T14:43:46.179 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0013059499999999999 2024-04-18T14:43:46.179 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:46.179 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:46.180 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-04-18T14:43:46.180 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:44.573919+0000", 2024-04-18T14:43:46.180 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0036257400000000001 2024-04-18T14:43:46.180 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:46.180 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:46.180 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-04-18T14:43:46.180 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:44.574013+0000", 2024-04-18T14:43:46.180 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 9.4769e-05 2024-04-18T14:43:46.180 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:43:46.180 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-04-18T14:43:46.180 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:43:46.180 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:43:46.180 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-04-18T14:43:46.180 INFO:teuthology.orchestra.run.smithi119.stdout:} 2024-04-18T14:43:46.182 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.10.asok dump_ops_in_flight 2024-04-18T14:43:46.183 INFO:tasks.ceph.osd.0.smithi086.stderr:2024-04-18T14:43:46.183+0000 7f7cdfd78640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 24953) UID: 0 2024-04-18T14:43:46.284 INFO:tasks.ceph.osd.13.smithi096.stderr:2024-04-18T14:43:46.282+0000 7f7e72fad640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 13 (PID: 24893) UID: 0 2024-04-18T14:43:46.308 INFO:teuthology.orchestra.run.smithi119.stdout:{ 2024-04-18T14:43:46.309 INFO:teuthology.orchestra.run.smithi119.stdout: "ops": [], 2024-04-18T14:43:46.309 INFO:teuthology.orchestra.run.smithi119.stdout: "num_ops": 0 2024-04-18T14:43:46.309 INFO:teuthology.orchestra.run.smithi119.stdout:} 2024-04-18T14:43:46.323 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.10.asok dump_blocked_ops 2024-04-18T14:43:46.371 INFO:tasks.rados.rados.0.smithi134.stdout:130: done (1 left) 2024-04-18T14:43:46.371 INFO:tasks.rados.rados.0.smithi134.stdout:131: done (0 left) 2024-04-18T14:43:46.371 INFO:tasks.rados.rados.0.smithi134.stdout:132: copy_from oid 39 from oid 12 current snap is 10 2024-04-18T14:43:46.371 INFO:tasks.rados.rados.0.smithi134.stdout:133: read oid 2 snap -1 2024-04-18T14:43:46.372 INFO:tasks.rados.rados.0.smithi134.stdout:133: expect (ObjNum 1 snap 0 seq_num 1) 2024-04-18T14:43:46.372 INFO:tasks.rados.rados.0.smithi134.stdout:134: snap_create 2024-04-18T14:43:46.379 INFO:tasks.rados.rados.0.smithi134.stdout:133: expect (ObjNum 1 snap 0 seq_num 1) 2024-04-18T14:43:46.386 INFO:tasks.ceph.osd.4.smithi086.stderr:2024-04-18T14:43:46.387+0000 7f0c4c462640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 24956) UID: 0 2024-04-18T14:43:46.394 INFO:tasks.rados.rados.0.smithi134.stdout:132: finishing copy_from racing read to smithi13430248-39 2024-04-18T14:43:46.396 INFO:tasks.rados.rados.0.smithi134.stdout:132: finishing copy_from to smithi13430248-39 2024-04-18T14:43:46.396 INFO:tasks.rados.rados.0.smithi134.stdout:update_object_version oid 39 v 42 (ObjNum 66 snap 9 seq_num 66) dirty exists 2024-04-18T14:43:46.446 INFO:teuthology.orchestra.run.smithi119.stdout:{ 2024-04-18T14:43:46.446 INFO:teuthology.orchestra.run.smithi119.stdout: "ops": [], 2024-04-18T14:43:46.446 INFO:teuthology.orchestra.run.smithi119.stdout: "complaint_time": 30, 2024-04-18T14:43:46.447 INFO:teuthology.orchestra.run.smithi119.stdout: "num_blocked_ops": 0 2024-04-18T14:43:46.447 INFO:teuthology.orchestra.run.smithi119.stdout:} 2024-04-18T14:43:46.460 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.10.asok dump_historic_ops 2024-04-18T14:43:46.487 INFO:tasks.ceph.osd.8.smithi086.stderr:2024-04-18T14:43:46.487+0000 7f29f7b9d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 8 (PID: 24958) UID: 0 2024-04-18T14:43:46.581 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-18T14:43:46.584 INFO:teuthology.orchestra.run.smithi119.stdout:{ 2024-04-18T14:43:46.584 INFO:teuthology.orchestra.run.smithi119.stdout: "size": 20, 2024-04-18T14:43:46.584 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 600, 2024-04-18T14:43:46.584 INFO:teuthology.orchestra.run.smithi119.stdout: "ops": [ 2024-04-18T14:43:46.584 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:46.584 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "MOSDECSubOpWrite(3.9s5 35/30 ECSubWrite(tid=28, reqid=client.4559.0:175, at_version=0'0, trim_to=0'0, roll_forward_to=35'15))", 2024-04-18T14:43:46.584 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-04-18T14:43:34.715491+0000", 2024-04-18T14:43:46.584 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 11.869807696000001, 2024-04-18T14:43:46.584 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0047634060000000004, 2024-04-18T14:43:46.584 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-04-18T14:43:46.585 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "reached pg", 2024-04-18T14:43:46.585 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-04-18T14:43:46.585 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:46.585 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-04-18T14:43:46.585 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:34.715491+0000", 2024-04-18T14:43:46.585 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:43:46.585 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:46.585 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:46.585 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-04-18T14:43:46.585 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:34.715491+0000", 2024-04-18T14:43:46.585 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:43:46.585 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:46.585 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:46.585 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-04-18T14:43:46.585 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:34.715489+0000", 2024-04-18T14:43:46.585 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4294967295.9999986 2024-04-18T14:43:46.586 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:46.586 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:46.586 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-04-18T14:43:46.586 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:34.715517+0000", 2024-04-18T14:43:46.586 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.7611e-05 2024-04-18T14:43:46.586 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:46.586 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:46.586 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-04-18T14:43:46.586 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:34.715548+0000", 2024-04-18T14:43:46.586 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.1207000000000001e-05 2024-04-18T14:43:46.586 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:46.586 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:46.586 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-04-18T14:43:46.586 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:34.715571+0000", 2024-04-18T14:43:46.586 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.2614000000000001e-05 2024-04-18T14:43:46.587 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:46.587 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:46.587 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-04-18T14:43:46.587 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:34.715756+0000", 2024-04-18T14:43:46.587 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00018525599999999999 2024-04-18T14:43:46.587 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:46.587 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:46.587 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_started", 2024-04-18T14:43:46.587 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:34.715779+0000", 2024-04-18T14:43:46.587 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.3153e-05 2024-04-18T14:43:46.587 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:46.587 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:46.587 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_committed", 2024-04-18T14:43:46.587 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:34.720199+0000", 2024-04-18T14:43:46.587 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0044199240000000004 2024-04-18T14:43:46.588 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:46.588 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:46.588 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-04-18T14:43:46.588 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:34.720254+0000", 2024-04-18T14:43:46.588 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 5.5201000000000002e-05 2024-04-18T14:43:46.588 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:43:46.588 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-04-18T14:43:46.588 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:43:46.588 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:46.588 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:46.588 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(client.4559.0:185 3.bs0 3:db6a9fd1:::smithi13430248-42:head [delete] snapc 4=[4,2] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e37)", 2024-04-18T14:43:46.588 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-04-18T14:43:36.725191+0000", 2024-04-18T14:43:46.588 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 9.8601069700000004, 2024-04-18T14:43:46.588 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0090198750000000001, 2024-04-18T14:43:46.588 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-04-18T14:43:46.589 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T14:43:46.589 INFO:teuthology.orchestra.run.smithi119.stdout: "client_info": { 2024-04-18T14:43:46.589 INFO:teuthology.orchestra.run.smithi119.stdout: "client": "client.4559", 2024-04-18T14:43:46.589 INFO:teuthology.orchestra.run.smithi119.stdout: "client_addr": "172.21.15.134:0/3113589487", 2024-04-18T14:43:46.589 INFO:teuthology.orchestra.run.smithi119.stdout: "tid": 185 2024-04-18T14:43:46.589 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:46.589 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-04-18T14:43:46.589 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:46.589 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-04-18T14:43:46.589 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:36.725191+0000", 2024-04-18T14:43:46.589 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:43:46.589 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:46.589 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:46.589 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-04-18T14:43:46.589 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:36.725191+0000", 2024-04-18T14:43:46.589 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:43:46.590 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:46.590 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:46.590 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-04-18T14:43:46.590 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:36.725188+0000", 2024-04-18T14:43:46.590 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4294967295.9999967 2024-04-18T14:43:46.590 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:46.590 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:46.590 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-04-18T14:43:46.590 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:36.725206+0000", 2024-04-18T14:43:46.590 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.8051e-05 2024-04-18T14:43:46.590 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:46.590 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:46.590 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-04-18T14:43:46.591 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:36.725239+0000", 2024-04-18T14:43:46.591 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.2416999999999998e-05 2024-04-18T14:43:46.591 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:46.591 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:46.591 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-04-18T14:43:46.591 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:36.725262+0000", 2024-04-18T14:43:46.591 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.3638e-05 2024-04-18T14:43:46.591 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:46.591 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:46.591 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-04-18T14:43:46.591 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:36.725389+0000", 2024-04-18T14:43:46.591 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00012678599999999999 2024-04-18T14:43:46.591 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:46.591 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:46.591 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-04-18T14:43:46.592 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:36.725609+0000", 2024-04-18T14:43:46.592 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00022012299999999999 2024-04-18T14:43:46.592 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:46.592 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:46.592 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_started", 2024-04-18T14:43:46.592 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:36.726907+0000", 2024-04-18T14:43:46.592 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.001297458 2024-04-18T14:43:46.592 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:46.592 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:46.592 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_committed", 2024-04-18T14:43:46.592 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:36.729252+0000", 2024-04-18T14:43:46.592 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0023456810000000001 2024-04-18T14:43:46.592 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:46.592 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:46.592 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-04-18T14:43:46.593 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:36.734032+0000", 2024-04-18T14:43:46.593 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0047791630000000003 2024-04-18T14:43:46.593 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:46.593 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:46.593 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-04-18T14:43:46.593 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:36.734211+0000", 2024-04-18T14:43:46.593 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00017970799999999999 2024-04-18T14:43:46.593 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:43:46.593 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-04-18T14:43:46.593 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:43:46.593 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:46.593 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:46.593 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "MOSDECSubOpWrite(3.9s5 37/30 ECSubWrite(tid=31, reqid=osd.12.0:30, at_version=0'0, trim_to=0'0, roll_forward_to=37'17))", 2024-04-18T14:43:46.593 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-04-18T14:43:36.744894+0000", 2024-04-18T14:43:46.593 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 9.8404042109999992, 2024-04-18T14:43:46.594 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0045695900000000001, 2024-04-18T14:43:46.594 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-04-18T14:43:46.594 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "reached pg", 2024-04-18T14:43:46.594 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-04-18T14:43:46.594 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:46.594 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-04-18T14:43:46.594 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:36.744894+0000", 2024-04-18T14:43:46.594 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:43:46.594 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:46.594 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:46.594 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-04-18T14:43:46.594 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:36.744894+0000", 2024-04-18T14:43:46.594 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:43:46.594 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:46.594 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:46.595 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-04-18T14:43:46.595 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:36.744892+0000", 2024-04-18T14:43:46.595 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4294967295.9999976 2024-04-18T14:43:46.595 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:46.595 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:46.595 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-04-18T14:43:46.595 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:36.744920+0000", 2024-04-18T14:43:46.595 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.8330000000000002e-05 2024-04-18T14:43:46.595 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:46.595 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:46.595 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-04-18T14:43:46.595 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:36.744973+0000", 2024-04-18T14:43:46.595 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 5.2729000000000003e-05 2024-04-18T14:43:46.595 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:46.595 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:46.596 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-04-18T14:43:46.596 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:36.744996+0000", 2024-04-18T14:43:46.596 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.2863000000000001e-05 2024-04-18T14:43:46.596 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:46.596 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:46.596 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-04-18T14:43:46.596 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:36.745090+0000", 2024-04-18T14:43:46.596 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 9.3976999999999998e-05 2024-04-18T14:43:46.596 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:46.596 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:46.596 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_started", 2024-04-18T14:43:46.596 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:36.745104+0000", 2024-04-18T14:43:46.596 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.447e-05 2024-04-18T14:43:46.596 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:46.597 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:46.597 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_committed", 2024-04-18T14:43:46.597 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:36.749385+0000", 2024-04-18T14:43:46.597 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0042806349999999996 2024-04-18T14:43:46.597 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:46.597 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:46.597 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-04-18T14:43:46.597 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:36.749464+0000", 2024-04-18T14:43:46.597 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 7.9105999999999998e-05 2024-04-18T14:43:46.597 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:43:46.597 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-04-18T14:43:46.597 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:43:46.597 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:46.597 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:46.597 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(client.4559.0:198 3.4s0 3:253cfff6:::smithi13430248-31:2 [read 0~507904,checksum,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37)", 2024-04-18T14:43:46.598 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-04-18T14:43:36.777890+0000", 2024-04-18T14:43:46.598 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 9.8074083109999997, 2024-04-18T14:43:46.598 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.007730888, 2024-04-18T14:43:46.598 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-04-18T14:43:46.598 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "started", 2024-04-18T14:43:46.598 INFO:teuthology.orchestra.run.smithi119.stdout: "client_info": { 2024-04-18T14:43:46.598 INFO:teuthology.orchestra.run.smithi119.stdout: "client": "client.4559", 2024-04-18T14:43:46.598 INFO:teuthology.orchestra.run.smithi119.stdout: "client_addr": "172.21.15.134:0/3113589487", 2024-04-18T14:43:46.598 INFO:teuthology.orchestra.run.smithi119.stdout: "tid": 198 2024-04-18T14:43:46.598 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:46.598 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-04-18T14:43:46.598 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:46.598 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-04-18T14:43:46.599 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:36.777890+0000", 2024-04-18T14:43:46.599 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:43:46.599 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:46.599 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:46.599 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-04-18T14:43:46.599 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:36.777890+0000", 2024-04-18T14:43:46.599 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:43:46.599 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:46.599 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:46.599 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-04-18T14:43:46.599 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:36.777887+0000", 2024-04-18T14:43:46.599 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4294967295.9999967 2024-04-18T14:43:46.599 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:46.599 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:46.599 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-04-18T14:43:46.599 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:36.777903+0000", 2024-04-18T14:43:46.600 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.6078000000000001e-05 2024-04-18T14:43:46.600 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:46.600 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:46.600 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-04-18T14:43:46.600 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:36.777968+0000", 2024-04-18T14:43:46.600 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 6.5154999999999995e-05 2024-04-18T14:43:46.600 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:46.600 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:46.600 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-04-18T14:43:46.600 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:36.777986+0000", 2024-04-18T14:43:46.600 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.7856999999999999e-05 2024-04-18T14:43:46.600 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:46.600 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:46.600 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-04-18T14:43:46.600 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:36.778086+0000", 2024-04-18T14:43:46.600 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000100453 2024-04-18T14:43:46.601 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:46.601 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:46.601 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-04-18T14:43:46.601 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:36.778378+0000", 2024-04-18T14:43:46.601 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000291897 2024-04-18T14:43:46.601 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:46.601 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:46.601 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-04-18T14:43:46.601 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:36.785621+0000", 2024-04-18T14:43:46.601 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0072427749999999999 2024-04-18T14:43:46.601 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:43:46.601 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-04-18T14:43:46.601 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:43:46.601 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:46.601 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:46.601 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(client.4559.0:199 3.4s0 3:253cfff6:::smithi13430248-31:2 [read 0~507904,checksum] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37)", 2024-04-18T14:43:46.602 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-04-18T14:43:36.778006+0000", 2024-04-18T14:43:46.602 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 9.8072921879999999, 2024-04-18T14:43:46.602 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0092398740000000004, 2024-04-18T14:43:46.602 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-04-18T14:43:46.602 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "started", 2024-04-18T14:43:46.602 INFO:teuthology.orchestra.run.smithi119.stdout: "client_info": { 2024-04-18T14:43:46.602 INFO:teuthology.orchestra.run.smithi119.stdout: "client": "client.4559", 2024-04-18T14:43:46.602 INFO:teuthology.orchestra.run.smithi119.stdout: "client_addr": "172.21.15.134:0/3113589487", 2024-04-18T14:43:46.602 INFO:teuthology.orchestra.run.smithi119.stdout: "tid": 199 2024-04-18T14:43:46.602 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:46.602 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-04-18T14:43:46.602 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:46.602 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-04-18T14:43:46.602 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:36.778006+0000", 2024-04-18T14:43:46.602 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:43:46.602 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:46.603 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:46.603 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-04-18T14:43:46.603 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:36.778006+0000", 2024-04-18T14:43:46.603 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:43:46.603 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:46.603 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:46.603 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-04-18T14:43:46.603 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:36.778005+0000", 2024-04-18T14:43:46.603 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4294967295.9999986 2024-04-18T14:43:46.603 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:46.603 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:46.603 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-04-18T14:43:46.603 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:36.778015+0000", 2024-04-18T14:43:46.603 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.0603e-05 2024-04-18T14:43:46.603 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:46.604 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:46.604 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-04-18T14:43:46.604 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:36.778452+0000", 2024-04-18T14:43:46.604 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00043702500000000001 2024-04-18T14:43:46.604 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:46.604 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:46.604 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-04-18T14:43:46.604 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:36.778487+0000", 2024-04-18T14:43:46.604 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.4610999999999998e-05 2024-04-18T14:43:46.604 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:46.604 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:46.604 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-04-18T14:43:46.604 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:36.779721+0000", 2024-04-18T14:43:46.604 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.001234076 2024-04-18T14:43:46.604 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:46.605 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:46.605 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-04-18T14:43:46.605 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:36.779994+0000", 2024-04-18T14:43:46.605 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00027332700000000002 2024-04-18T14:43:46.605 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:46.605 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:46.605 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-04-18T14:43:46.605 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:36.787246+0000", 2024-04-18T14:43:46.605 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0072518779999999998 2024-04-18T14:43:46.605 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:43:46.605 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-04-18T14:43:46.605 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:43:46.605 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:46.605 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:46.605 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(client.4559.0:200 3.4s0 3:253cfff6:::smithi13430248-31:2 [read 0~507904,checksum] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37)", 2024-04-18T14:43:46.605 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-04-18T14:43:36.778511+0000", 2024-04-18T14:43:46.606 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 9.806787108, 2024-04-18T14:43:46.606 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.009537841, 2024-04-18T14:43:46.606 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-04-18T14:43:46.606 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "started", 2024-04-18T14:43:46.606 INFO:teuthology.orchestra.run.smithi119.stdout: "client_info": { 2024-04-18T14:43:46.606 INFO:teuthology.orchestra.run.smithi119.stdout: "client": "client.4559", 2024-04-18T14:43:46.606 INFO:teuthology.orchestra.run.smithi119.stdout: "client_addr": "172.21.15.134:0/3113589487", 2024-04-18T14:43:46.606 INFO:teuthology.orchestra.run.smithi119.stdout: "tid": 200 2024-04-18T14:43:46.606 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:46.606 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-04-18T14:43:46.606 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:46.606 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-04-18T14:43:46.606 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:36.778511+0000", 2024-04-18T14:43:46.606 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:43:46.606 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:46.606 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:46.607 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-04-18T14:43:46.607 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:36.778511+0000", 2024-04-18T14:43:46.607 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:43:46.607 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:46.607 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:46.607 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-04-18T14:43:46.607 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:36.778509+0000", 2024-04-18T14:43:46.607 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4294967295.9999981 2024-04-18T14:43:46.607 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:46.607 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:46.607 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-04-18T14:43:46.607 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:36.778522+0000", 2024-04-18T14:43:46.607 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.2167000000000001e-05 2024-04-18T14:43:46.607 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:46.607 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:46.607 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-04-18T14:43:46.608 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:36.778542+0000", 2024-04-18T14:43:46.608 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.9996999999999998e-05 2024-04-18T14:43:46.608 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:46.608 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:46.608 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-04-18T14:43:46.608 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:36.778555+0000", 2024-04-18T14:43:46.608 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.3176999999999999e-05 2024-04-18T14:43:46.608 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:46.608 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:46.608 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-04-18T14:43:46.608 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:36.782090+0000", 2024-04-18T14:43:46.608 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0035351499999999999 2024-04-18T14:43:46.608 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:46.608 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:46.608 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-04-18T14:43:46.609 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:36.782278+0000", 2024-04-18T14:43:46.609 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00018805100000000001 2024-04-18T14:43:46.609 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:46.609 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:46.609 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-04-18T14:43:46.609 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:36.788049+0000", 2024-04-18T14:43:46.609 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0057712290000000001 2024-04-18T14:43:46.609 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:43:46.609 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-04-18T14:43:46.609 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:43:46.609 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:46.609 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:46.609 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(osd.14.21:5 3.4s0 3:253cfff6:::smithi13430248-31:head [assert-version v2,copy-get max 8388608] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-04-18T14:43:46.609 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-04-18T14:43:40.761159+0000", 2024-04-18T14:43:46.610 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 5.8241393500000003, 2024-04-18T14:43:46.610 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.018141377, 2024-04-18T14:43:46.610 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-04-18T14:43:46.610 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "started", 2024-04-18T14:43:46.610 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-04-18T14:43:46.610 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:46.610 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-04-18T14:43:46.610 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:40.761159+0000", 2024-04-18T14:43:46.610 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:43:46.610 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:46.610 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:46.610 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-04-18T14:43:46.610 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:40.761159+0000", 2024-04-18T14:43:46.610 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:43:46.611 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:46.611 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:46.611 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-04-18T14:43:46.611 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:40.761154+0000", 2024-04-18T14:43:46.611 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4294967295.9999952 2024-04-18T14:43:46.611 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:46.611 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:46.611 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-04-18T14:43:46.611 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:40.761176+0000", 2024-04-18T14:43:46.611 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.1684000000000001e-05 2024-04-18T14:43:46.611 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:46.611 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:46.611 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-04-18T14:43:46.611 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:40.761228+0000", 2024-04-18T14:43:46.611 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 5.2130999999999999e-05 2024-04-18T14:43:46.611 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:46.612 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:46.612 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-04-18T14:43:46.612 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:40.761253+0000", 2024-04-18T14:43:46.612 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.4624e-05 2024-04-18T14:43:46.612 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:46.612 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:46.612 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-04-18T14:43:46.612 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:40.761416+0000", 2024-04-18T14:43:46.612 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000162993 2024-04-18T14:43:46.612 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:46.612 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:46.612 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "op must wait for map", 2024-04-18T14:43:46.612 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:40.761441+0000", 2024-04-18T14:43:46.612 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.4814e-05 2024-04-18T14:43:46.613 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:46.613 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:46.613 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-04-18T14:43:46.613 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:40.768188+0000", 2024-04-18T14:43:46.613 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0067475540000000002 2024-04-18T14:43:46.613 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:46.613 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:46.613 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-04-18T14:43:46.613 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:40.768430+0000", 2024-04-18T14:43:46.613 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000241969 2024-04-18T14:43:46.613 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:46.613 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:46.613 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-04-18T14:43:46.613 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:40.779300+0000", 2024-04-18T14:43:46.613 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.010870434999999999 2024-04-18T14:43:46.614 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:43:46.614 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-04-18T14:43:46.614 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:43:46.614 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:46.614 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:46.614 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "MOSDECSubOpWrite(3.cs1 41/30 ECSubWrite(tid=45, reqid=osd.11.0:45, at_version=41'22, trim_to=0'0, roll_forward_to=39'20))", 2024-04-18T14:43:46.614 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-04-18T14:43:40.765474+0000", 2024-04-18T14:43:46.614 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 5.8198248169999998, 2024-04-18T14:43:46.614 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0046346030000000002, 2024-04-18T14:43:46.614 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-04-18T14:43:46.614 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "reached pg", 2024-04-18T14:43:46.614 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-04-18T14:43:46.614 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:46.614 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-04-18T14:43:46.615 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:40.765474+0000", 2024-04-18T14:43:46.615 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:43:46.615 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:46.615 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:46.615 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-04-18T14:43:46.615 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:40.765474+0000", 2024-04-18T14:43:46.615 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:43:46.615 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:46.615 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:46.615 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-04-18T14:43:46.615 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:40.765473+0000", 2024-04-18T14:43:46.615 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4294967295.9999995 2024-04-18T14:43:46.615 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:46.615 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:46.615 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-04-18T14:43:46.616 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:40.765532+0000", 2024-04-18T14:43:46.616 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 5.8814999999999998e-05 2024-04-18T14:43:46.616 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:46.616 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:46.616 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-04-18T14:43:46.616 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:40.765657+0000", 2024-04-18T14:43:46.616 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00012523600000000001 2024-04-18T14:43:46.616 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:46.616 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:46.616 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-04-18T14:43:46.616 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:40.765684+0000", 2024-04-18T14:43:46.616 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.6653999999999999e-05 2024-04-18T14:43:46.616 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:46.616 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:46.616 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-04-18T14:43:46.616 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:40.765995+0000", 2024-04-18T14:43:46.617 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00031176000000000001 2024-04-18T14:43:46.617 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:46.617 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:46.617 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_started", 2024-04-18T14:43:46.617 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:40.766009+0000", 2024-04-18T14:43:46.617 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.3271000000000001e-05 2024-04-18T14:43:46.617 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:46.617 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:46.617 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_committed", 2024-04-18T14:43:46.617 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:40.770052+0000", 2024-04-18T14:43:46.617 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0040436129999999997 2024-04-18T14:43:46.617 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:46.617 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:46.617 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-04-18T14:43:46.617 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:40.770108+0000", 2024-04-18T14:43:46.617 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 5.5948e-05 2024-04-18T14:43:46.618 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:43:46.618 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-04-18T14:43:46.618 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:43:46.618 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:46.618 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:46.618 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "MOSDECSubOpWrite(3.cs1 41/30 ECSubWrite(tid=46, reqid=osd.11.0:46, at_version=41'24, trim_to=0'0, roll_forward_to=39'20))", 2024-04-18T14:43:46.618 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-04-18T14:43:40.765734+0000", 2024-04-18T14:43:46.618 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 5.8195648379999998, 2024-04-18T14:43:46.618 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.01275631, 2024-04-18T14:43:46.618 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-04-18T14:43:46.618 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "reached pg", 2024-04-18T14:43:46.618 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-04-18T14:43:46.618 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:46.618 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-04-18T14:43:46.618 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:40.765734+0000", 2024-04-18T14:43:46.619 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:43:46.619 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:46.619 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:46.619 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-04-18T14:43:46.619 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:40.765734+0000", 2024-04-18T14:43:46.619 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:43:46.619 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:46.619 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:46.619 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-04-18T14:43:46.619 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:40.765733+0000", 2024-04-18T14:43:46.619 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4294967295.999999 2024-04-18T14:43:46.619 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:46.619 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:46.619 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-04-18T14:43:46.619 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:40.765777+0000", 2024-04-18T14:43:46.619 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4.4790999999999999e-05 2024-04-18T14:43:46.620 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:46.620 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:46.620 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-04-18T14:43:46.620 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:40.765799+0000", 2024-04-18T14:43:46.620 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.1891000000000001e-05 2024-04-18T14:43:46.620 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:46.620 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:46.620 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-04-18T14:43:46.620 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:40.765817+0000", 2024-04-18T14:43:46.620 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.7863000000000002e-05 2024-04-18T14:43:46.620 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:46.620 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:46.620 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-04-18T14:43:46.620 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:40.766689+0000", 2024-04-18T14:43:46.620 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00087157000000000001 2024-04-18T14:43:46.620 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:46.621 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:46.621 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_started", 2024-04-18T14:43:46.621 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:40.766712+0000", 2024-04-18T14:43:46.621 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.3609999999999999e-05 2024-04-18T14:43:46.621 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:46.621 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:46.621 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_committed", 2024-04-18T14:43:46.621 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:40.778433+0000", 2024-04-18T14:43:46.621 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.011720774 2024-04-18T14:43:46.621 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:46.621 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:46.621 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-04-18T14:43:46.621 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:40.778490+0000", 2024-04-18T14:43:46.621 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 5.6845000000000002e-05 2024-04-18T14:43:46.621 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:43:46.622 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-04-18T14:43:46.622 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:43:46.622 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:46.622 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:46.622 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "MOSDECSubOpWrite(3.8s1 41/30 ECSubWrite(tid=35, reqid=client.4559.0:250, at_version=41'18, trim_to=0'0, roll_forward_to=38'16))", 2024-04-18T14:43:46.622 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-04-18T14:43:40.768038+0000", 2024-04-18T14:43:46.622 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 5.8172601369999999, 2024-04-18T14:43:46.622 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0093087900000000008, 2024-04-18T14:43:46.622 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-04-18T14:43:46.622 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "reached pg", 2024-04-18T14:43:46.622 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-04-18T14:43:46.622 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:46.622 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-04-18T14:43:46.622 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:40.768038+0000", 2024-04-18T14:43:46.623 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:43:46.623 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:46.623 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:46.623 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-04-18T14:43:46.623 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:40.768038+0000", 2024-04-18T14:43:46.623 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:43:46.623 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:46.623 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:46.623 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-04-18T14:43:46.623 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:40.768038+0000", 2024-04-18T14:43:46.623 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4294967295.999999 2024-04-18T14:43:46.623 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:46.623 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:46.623 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-04-18T14:43:46.623 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:40.768094+0000", 2024-04-18T14:43:46.623 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 5.6161e-05 2024-04-18T14:43:46.624 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:46.624 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:46.624 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-04-18T14:43:46.624 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:40.768123+0000", 2024-04-18T14:43:46.624 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.8773999999999999e-05 2024-04-18T14:43:46.624 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:46.624 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:46.624 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-04-18T14:43:46.624 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:40.768142+0000", 2024-04-18T14:43:46.624 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.9766999999999999e-05 2024-04-18T14:43:46.624 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:46.624 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:46.624 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-04-18T14:43:46.624 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:40.768269+0000", 2024-04-18T14:43:46.624 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000126873 2024-04-18T14:43:46.625 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:46.625 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:46.625 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_started", 2024-04-18T14:43:46.625 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:40.768293+0000", 2024-04-18T14:43:46.625 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.4063999999999999e-05 2024-04-18T14:43:46.625 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:46.625 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:46.625 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_committed", 2024-04-18T14:43:46.625 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:40.777286+0000", 2024-04-18T14:43:46.625 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0089925600000000001 2024-04-18T14:43:46.625 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:46.625 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:46.625 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-04-18T14:43:46.625 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:40.777347+0000", 2024-04-18T14:43:46.625 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 6.1323999999999998e-05 2024-04-18T14:43:46.626 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:43:46.626 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-04-18T14:43:46.626 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:43:46.626 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:46.626 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:46.626 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "pg_update_log_missing(3.9s5 epoch 41/30 rep_tid 40 entries 41'25 (0'0) error 3:936e42fd:::smithi13430248-33:head by client.4559.0:247 0.000000 0 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 38'23)", 2024-04-18T14:43:46.626 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-04-18T14:43:40.768200+0000", 2024-04-18T14:43:46.626 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 5.8170981130000001, 2024-04-18T14:43:46.626 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0042211829999999999, 2024-04-18T14:43:46.626 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-04-18T14:43:46.626 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "reached pg", 2024-04-18T14:43:46.626 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-04-18T14:43:46.626 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:46.626 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-04-18T14:43:46.626 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:40.768200+0000", 2024-04-18T14:43:46.627 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:43:46.627 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:46.627 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:46.627 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-04-18T14:43:46.627 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:40.768200+0000", 2024-04-18T14:43:46.627 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:43:46.627 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:46.627 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:46.627 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-04-18T14:43:46.627 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:40.768200+0000", 2024-04-18T14:43:46.627 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4294967295.9999995 2024-04-18T14:43:46.627 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:46.627 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:46.627 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-04-18T14:43:46.628 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:40.768216+0000", 2024-04-18T14:43:46.628 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.6293000000000001e-05 2024-04-18T14:43:46.628 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:46.628 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:46.628 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-04-18T14:43:46.628 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:40.768261+0000", 2024-04-18T14:43:46.628 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4.5215e-05 2024-04-18T14:43:46.628 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:46.628 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:46.628 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-04-18T14:43:46.628 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:40.768295+0000", 2024-04-18T14:43:46.628 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.3627000000000002e-05 2024-04-18T14:43:46.628 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:46.628 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:46.628 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-04-18T14:43:46.629 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:40.768493+0000", 2024-04-18T14:43:46.629 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00019789100000000001 2024-04-18T14:43:46.629 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:46.629 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:46.629 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-04-18T14:43:46.629 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:40.772422+0000", 2024-04-18T14:43:46.629 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.003928857 2024-04-18T14:43:46.629 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:43:46.629 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-04-18T14:43:46.629 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:43:46.629 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:46.629 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:46.629 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "MOSDECSubOpWrite(3.9s5 41/30 ECSubWrite(tid=41, reqid=osd.12.0:41, at_version=41'27, trim_to=0'0, roll_forward_to=38'24))", 2024-04-18T14:43:46.629 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-04-18T14:43:40.769926+0000", 2024-04-18T14:43:46.629 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 5.8153727249999996, 2024-04-18T14:43:46.630 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0075040769999999996, 2024-04-18T14:43:46.630 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-04-18T14:43:46.630 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "reached pg", 2024-04-18T14:43:46.630 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-04-18T14:43:46.630 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:46.630 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-04-18T14:43:46.630 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:40.769926+0000", 2024-04-18T14:43:46.630 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:43:46.630 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:46.630 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:46.630 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-04-18T14:43:46.630 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:40.769926+0000", 2024-04-18T14:43:46.630 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:43:46.630 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:46.630 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:46.631 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-04-18T14:43:46.631 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:40.769924+0000", 2024-04-18T14:43:46.631 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4294967295.9999986 2024-04-18T14:43:46.631 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:46.631 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:46.631 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-04-18T14:43:46.631 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:40.769990+0000", 2024-04-18T14:43:46.631 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 6.5333999999999995e-05 2024-04-18T14:43:46.631 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:46.631 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:46.631 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-04-18T14:43:46.631 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:40.770015+0000", 2024-04-18T14:43:46.631 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.5238000000000001e-05 2024-04-18T14:43:46.631 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:46.631 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:46.631 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-04-18T14:43:46.632 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:40.770033+0000", 2024-04-18T14:43:46.632 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.7742999999999999e-05 2024-04-18T14:43:46.632 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:46.632 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:46.632 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-04-18T14:43:46.632 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:40.770420+0000", 2024-04-18T14:43:46.632 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00038710600000000002 2024-04-18T14:43:46.632 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:46.632 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:46.632 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_started", 2024-04-18T14:43:46.632 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:40.770442+0000", 2024-04-18T14:43:46.632 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.2413e-05 2024-04-18T14:43:46.632 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:46.632 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:46.633 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_committed", 2024-04-18T14:43:46.633 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:40.777373+0000", 2024-04-18T14:43:46.633 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0069311479999999998 2024-04-18T14:43:46.633 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:46.633 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:46.633 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-04-18T14:43:46.633 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:40.777430+0000", 2024-04-18T14:43:46.633 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 5.6598000000000003e-05 2024-04-18T14:43:46.633 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:43:46.633 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-04-18T14:43:46.633 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:43:46.633 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:46.633 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:46.633 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "MOSDECSubOpReadReply(3.4s0 41/30 ECSubReadReply(tid=22, attrs_read=0))", 2024-04-18T14:43:46.633 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-04-18T14:43:40.770441+0000", 2024-04-18T14:43:46.633 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 5.8148576399999996, 2024-04-18T14:43:46.633 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0080556589999999997, 2024-04-18T14:43:46.634 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-04-18T14:43:46.634 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "reached pg", 2024-04-18T14:43:46.634 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-04-18T14:43:46.634 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:46.634 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-04-18T14:43:46.634 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:40.770441+0000", 2024-04-18T14:43:46.634 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:43:46.634 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:46.634 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:46.634 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-04-18T14:43:46.635 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:40.770441+0000", 2024-04-18T14:43:46.635 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:43:46.635 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:46.635 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:46.635 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-04-18T14:43:46.635 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:40.770440+0000", 2024-04-18T14:43:46.635 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4294967295.9999986 2024-04-18T14:43:46.635 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:46.635 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:46.635 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-04-18T14:43:46.635 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:40.770735+0000", 2024-04-18T14:43:46.635 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00029500700000000002 2024-04-18T14:43:46.635 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:46.635 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:46.635 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-04-18T14:43:46.636 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:40.770757+0000", 2024-04-18T14:43:46.636 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.268e-05 2024-04-18T14:43:46.636 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:46.636 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:46.636 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-04-18T14:43:46.636 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:40.770774+0000", 2024-04-18T14:43:46.636 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.6390999999999999e-05 2024-04-18T14:43:46.636 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:46.636 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:46.636 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-04-18T14:43:46.636 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:40.778318+0000", 2024-04-18T14:43:46.636 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.007544345 2024-04-18T14:43:46.636 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:46.636 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:46.636 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-04-18T14:43:46.637 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:40.778496+0000", 2024-04-18T14:43:46.637 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00017851999999999999 2024-04-18T14:43:46.637 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:43:46.637 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-04-18T14:43:46.637 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:43:46.637 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:46.637 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:46.637 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "MOSDECSubOpWrite(3.8s1 41/30 ECSubWrite(tid=36, reqid=osd.5.0:36, at_version=41'20, trim_to=0'0, roll_forward_to=38'16))", 2024-04-18T14:43:46.637 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-04-18T14:43:40.770901+0000", 2024-04-18T14:43:46.637 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 5.8143973300000003, 2024-04-18T14:43:46.637 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0074121889999999996, 2024-04-18T14:43:46.637 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-04-18T14:43:46.637 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "reached pg", 2024-04-18T14:43:46.637 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-04-18T14:43:46.637 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:46.638 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-04-18T14:43:46.638 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:40.770901+0000", 2024-04-18T14:43:46.638 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:43:46.638 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:46.638 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:46.638 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-04-18T14:43:46.638 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:40.770901+0000", 2024-04-18T14:43:46.638 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:43:46.638 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:46.638 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:46.638 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-04-18T14:43:46.638 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:40.770900+0000", 2024-04-18T14:43:46.638 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4294967295.9999986 2024-04-18T14:43:46.638 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:46.638 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:46.638 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-04-18T14:43:46.639 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:40.770953+0000", 2024-04-18T14:43:46.639 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 5.3214000000000002e-05 2024-04-18T14:43:46.639 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:46.639 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:46.639 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-04-18T14:43:46.639 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:40.770982+0000", 2024-04-18T14:43:46.639 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.8943999999999999e-05 2024-04-18T14:43:46.639 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:46.639 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:46.639 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-04-18T14:43:46.639 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:40.771020+0000", 2024-04-18T14:43:46.639 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.7784000000000003e-05 2024-04-18T14:43:46.639 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:46.639 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:46.639 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-04-18T14:43:46.640 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:40.771112+0000", 2024-04-18T14:43:46.640 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 9.2368999999999996e-05 2024-04-18T14:43:46.640 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:46.640 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:46.640 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_started", 2024-04-18T14:43:46.640 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:40.771137+0000", 2024-04-18T14:43:46.640 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.4496999999999999e-05 2024-04-18T14:43:46.640 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:46.640 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:46.640 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_committed", 2024-04-18T14:43:46.640 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:40.778250+0000", 2024-04-18T14:43:46.640 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0071137650000000002 2024-04-18T14:43:46.640 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:46.640 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:46.640 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-04-18T14:43:46.640 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:40.778313+0000", 2024-04-18T14:43:46.641 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 6.2978999999999995e-05 2024-04-18T14:43:46.641 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:43:46.641 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-04-18T14:43:46.641 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:43:46.641 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:46.641 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:46.641 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "MOSDECSubOpReadReply(3.4s0 41/30 ECSubReadReply(tid=22, attrs_read=0))", 2024-04-18T14:43:46.641 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-04-18T14:43:40.772387+0000", 2024-04-18T14:43:46.641 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 5.812911937, 2024-04-18T14:43:46.641 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0061772440000000001, 2024-04-18T14:43:46.641 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-04-18T14:43:46.641 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "reached pg", 2024-04-18T14:43:46.641 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-04-18T14:43:46.641 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:46.641 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-04-18T14:43:46.642 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:40.772387+0000", 2024-04-18T14:43:46.642 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:43:46.642 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:46.642 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:46.642 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-04-18T14:43:46.642 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:40.772387+0000", 2024-04-18T14:43:46.642 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:43:46.642 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:46.642 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:46.642 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-04-18T14:43:46.642 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:40.772385+0000", 2024-04-18T14:43:46.642 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4294967295.9999986 2024-04-18T14:43:46.642 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:46.642 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:46.642 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-04-18T14:43:46.643 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:40.773022+0000", 2024-04-18T14:43:46.643 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000636781 2024-04-18T14:43:46.643 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:46.643 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:46.643 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-04-18T14:43:46.643 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:40.773053+0000", 2024-04-18T14:43:46.643 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.1347000000000003e-05 2024-04-18T14:43:46.643 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:46.643 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:46.643 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-04-18T14:43:46.643 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:40.773071+0000", 2024-04-18T14:43:46.643 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.7801000000000001e-05 2024-04-18T14:43:46.643 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:46.643 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:46.643 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-04-18T14:43:46.644 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:40.778482+0000", 2024-04-18T14:43:46.644 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.005411183 2024-04-18T14:43:46.644 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:46.644 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:46.644 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-04-18T14:43:46.644 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:40.778564+0000", 2024-04-18T14:43:46.644 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 8.1722000000000001e-05 2024-04-18T14:43:46.644 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:43:46.644 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-04-18T14:43:46.644 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:43:46.644 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:46.644 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:46.644 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "MOSDECSubOpWrite(3.8s1 41/30 ECSubWrite(tid=38, reqid=osd.5.0:36, at_version=0'0, trim_to=0'0, roll_forward_to=41'20))", 2024-04-18T14:43:46.644 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-04-18T14:43:40.780232+0000", 2024-04-18T14:43:46.644 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 5.8050661960000003, 2024-04-18T14:43:46.644 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0056086349999999998, 2024-04-18T14:43:46.645 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-04-18T14:43:46.645 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "reached pg", 2024-04-18T14:43:46.645 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-04-18T14:43:46.645 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:46.645 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-04-18T14:43:46.645 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:40.780232+0000", 2024-04-18T14:43:46.645 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:43:46.645 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:46.645 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:46.645 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-04-18T14:43:46.645 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:40.780232+0000", 2024-04-18T14:43:46.645 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:43:46.645 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:46.645 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:46.645 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-04-18T14:43:46.646 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:40.780230+0000", 2024-04-18T14:43:46.646 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4294967295.9999981 2024-04-18T14:43:46.646 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:46.646 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:46.646 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-04-18T14:43:46.646 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:40.780261+0000", 2024-04-18T14:43:46.646 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.0457e-05 2024-04-18T14:43:46.646 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:46.646 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:46.646 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-04-18T14:43:46.646 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:40.780294+0000", 2024-04-18T14:43:46.646 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.3157999999999997e-05 2024-04-18T14:43:46.646 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:46.646 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:46.646 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-04-18T14:43:46.646 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:40.780317+0000", 2024-04-18T14:43:46.647 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.3087000000000001e-05 2024-04-18T14:43:46.647 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:46.647 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:46.647 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-04-18T14:43:46.647 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:40.780680+0000", 2024-04-18T14:43:46.647 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00036323799999999999 2024-04-18T14:43:46.647 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:46.647 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:46.647 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_started", 2024-04-18T14:43:46.647 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:40.780703+0000", 2024-04-18T14:43:46.647 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.2904e-05 2024-04-18T14:43:46.647 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:46.647 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:46.647 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_committed", 2024-04-18T14:43:46.647 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:40.785780+0000", 2024-04-18T14:43:46.647 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0050769200000000004 2024-04-18T14:43:46.648 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:46.648 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:46.648 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-04-18T14:43:46.648 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:40.785841+0000", 2024-04-18T14:43:46.648 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 6.0993999999999999e-05 2024-04-18T14:43:46.648 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:43:46.648 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-04-18T14:43:46.648 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:43:46.648 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:46.648 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:46.648 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "MOSDECSubOpWrite(3.9s5 41/30 ECSubWrite(tid=42, reqid=osd.12.0:41, at_version=0'0, trim_to=0'0, roll_forward_to=41'27))", 2024-04-18T14:43:46.648 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-04-18T14:43:40.780450+0000", 2024-04-18T14:43:46.648 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 5.804848164, 2024-04-18T14:43:46.648 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0052259730000000001, 2024-04-18T14:43:46.648 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-04-18T14:43:46.649 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "reached pg", 2024-04-18T14:43:46.649 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-04-18T14:43:46.649 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:46.649 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-04-18T14:43:46.649 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:40.780450+0000", 2024-04-18T14:43:46.649 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:43:46.649 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:46.649 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:46.649 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-04-18T14:43:46.649 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:40.780450+0000", 2024-04-18T14:43:46.649 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:43:46.649 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:46.649 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:46.649 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-04-18T14:43:46.649 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:40.780443+0000", 2024-04-18T14:43:46.649 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4294967295.9999924 2024-04-18T14:43:46.650 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:46.650 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:46.650 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-04-18T14:43:46.650 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:40.780473+0000", 2024-04-18T14:43:46.650 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.0145e-05 2024-04-18T14:43:46.650 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:46.650 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:46.650 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-04-18T14:43:46.650 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:40.780500+0000", 2024-04-18T14:43:46.650 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.6570000000000001e-05 2024-04-18T14:43:46.650 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:46.650 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:46.650 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-04-18T14:43:46.651 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:40.780520+0000", 2024-04-18T14:43:46.651 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.0203999999999998e-05 2024-04-18T14:43:46.651 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:46.651 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:46.651 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-04-18T14:43:46.651 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:40.780634+0000", 2024-04-18T14:43:46.651 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000114072 2024-04-18T14:43:46.651 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:46.651 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:46.651 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_started", 2024-04-18T14:43:46.651 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:40.780661+0000", 2024-04-18T14:43:46.651 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.6718000000000001e-05 2024-04-18T14:43:46.651 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:46.651 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:46.651 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_committed", 2024-04-18T14:43:46.651 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:40.785623+0000", 2024-04-18T14:43:46.652 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0049628069999999996 2024-04-18T14:43:46.652 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:46.652 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:46.652 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-04-18T14:43:46.652 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:40.785676+0000", 2024-04-18T14:43:46.652 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 5.2861000000000001e-05 2024-04-18T14:43:46.652 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:43:46.652 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-04-18T14:43:46.652 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:43:46.652 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:46.652 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:46.652 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(client.4559.0:322 3.4s0 3:253cfff6:::smithi13430248-31:head [append 0~0] snapc d=[b,a,8,7,2] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-04-18T14:43:46.652 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-04-18T14:43:45.374943+0000", 2024-04-18T14:43:46.652 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 1.210355759, 2024-04-18T14:43:46.652 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.016060366, 2024-04-18T14:43:46.652 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-04-18T14:43:46.653 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T14:43:46.653 INFO:teuthology.orchestra.run.smithi119.stdout: "client_info": { 2024-04-18T14:43:46.653 INFO:teuthology.orchestra.run.smithi119.stdout: "client": "client.4559", 2024-04-18T14:43:46.653 INFO:teuthology.orchestra.run.smithi119.stdout: "client_addr": "172.21.15.134:0/3113589487", 2024-04-18T14:43:46.653 INFO:teuthology.orchestra.run.smithi119.stdout: "tid": 322 2024-04-18T14:43:46.653 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:46.653 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-04-18T14:43:46.653 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:46.653 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-04-18T14:43:46.653 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:45.374943+0000", 2024-04-18T14:43:46.653 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:43:46.653 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:46.653 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:46.653 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-04-18T14:43:46.653 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:45.374943+0000", 2024-04-18T14:43:46.654 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:43:46.654 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:46.654 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:46.654 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-04-18T14:43:46.654 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:45.374939+0000", 2024-04-18T14:43:46.654 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4294967295.9999962 2024-04-18T14:43:46.654 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:46.654 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:46.654 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-04-18T14:43:46.654 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:45.374958+0000", 2024-04-18T14:43:46.654 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.9037000000000001e-05 2024-04-18T14:43:46.654 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:46.654 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:46.654 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-04-18T14:43:46.654 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:45.375005+0000", 2024-04-18T14:43:46.654 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4.6733999999999997e-05 2024-04-18T14:43:46.655 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:46.655 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:46.655 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-04-18T14:43:46.655 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:45.375036+0000", 2024-04-18T14:43:46.655 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.1414000000000001e-05 2024-04-18T14:43:46.655 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:46.655 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:46.655 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-04-18T14:43:46.655 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:45.375147+0000", 2024-04-18T14:43:46.655 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000111199 2024-04-18T14:43:46.655 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:46.655 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:46.655 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "op must wait for map", 2024-04-18T14:43:46.655 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:45.375157+0000", 2024-04-18T14:43:46.655 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 9.5289999999999997e-06 2024-04-18T14:43:46.655 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:46.656 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:46.656 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-04-18T14:43:46.656 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:45.377821+0000", 2024-04-18T14:43:46.656 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0026638769999999998 2024-04-18T14:43:46.656 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:46.656 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:46.656 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-04-18T14:43:46.656 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:45.378116+0000", 2024-04-18T14:43:46.656 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00029550799999999999 2024-04-18T14:43:46.656 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:46.656 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:46.656 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_started", 2024-04-18T14:43:46.656 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:45.380261+0000", 2024-04-18T14:43:46.656 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0021443550000000001 2024-04-18T14:43:46.656 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:46.656 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:46.657 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_committed", 2024-04-18T14:43:46.657 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:45.382507+0000", 2024-04-18T14:43:46.657 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0022458669999999999 2024-04-18T14:43:46.657 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:46.657 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:46.657 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-04-18T14:43:46.657 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:45.390928+0000", 2024-04-18T14:43:46.657 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0084211870000000001 2024-04-18T14:43:46.657 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:46.657 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:46.657 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-04-18T14:43:46.657 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:45.391003+0000", 2024-04-18T14:43:46.657 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 7.5296000000000006e-05 2024-04-18T14:43:46.657 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:43:46.657 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-04-18T14:43:46.657 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:43:46.657 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:46.658 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:46.658 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(client.4559.0:323 3.4s0 3:253cfff6:::smithi13430248-31:head [rollback a] snapc d=[b,a,8,7,2] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-04-18T14:43:46.658 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-04-18T14:43:45.375072+0000", 2024-04-18T14:43:46.658 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 1.210226384, 2024-04-18T14:43:46.658 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.017411607999999999, 2024-04-18T14:43:46.658 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-04-18T14:43:46.658 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T14:43:46.658 INFO:teuthology.orchestra.run.smithi119.stdout: "client_info": { 2024-04-18T14:43:46.658 INFO:teuthology.orchestra.run.smithi119.stdout: "client": "client.4559", 2024-04-18T14:43:46.658 INFO:teuthology.orchestra.run.smithi119.stdout: "client_addr": "172.21.15.134:0/3113589487", 2024-04-18T14:43:46.658 INFO:teuthology.orchestra.run.smithi119.stdout: "tid": 323 2024-04-18T14:43:46.658 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:46.658 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-04-18T14:43:46.658 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:46.658 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-04-18T14:43:46.659 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:45.375072+0000", 2024-04-18T14:43:46.659 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:43:46.659 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:46.659 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:46.659 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-04-18T14:43:46.659 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:45.375072+0000", 2024-04-18T14:43:46.659 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:43:46.659 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:46.659 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:46.659 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-04-18T14:43:46.659 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:45.375071+0000", 2024-04-18T14:43:46.659 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4294967295.9999986 2024-04-18T14:43:46.659 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:46.659 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:46.659 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-04-18T14:43:46.659 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:45.375079+0000", 2024-04-18T14:43:46.660 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 8.6470000000000004e-06 2024-04-18T14:43:46.660 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:46.660 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:46.660 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-04-18T14:43:46.660 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:45.375100+0000", 2024-04-18T14:43:46.660 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.0421e-05 2024-04-18T14:43:46.660 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:46.660 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:46.660 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-04-18T14:43:46.660 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:45.375109+0000", 2024-04-18T14:43:46.660 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 8.9770000000000006e-06 2024-04-18T14:43:46.660 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:46.660 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:46.660 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-04-18T14:43:46.660 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:45.375223+0000", 2024-04-18T14:43:46.660 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000114269 2024-04-18T14:43:46.661 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:46.661 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:46.661 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting_for_map not empty", 2024-04-18T14:43:46.661 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:45.375229+0000", 2024-04-18T14:43:46.661 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 6.1890000000000004e-06 2024-04-18T14:43:46.661 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:46.661 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:46.661 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-04-18T14:43:46.661 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:45.381020+0000", 2024-04-18T14:43:46.661 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0057905040000000001 2024-04-18T14:43:46.661 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:46.661 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:46.661 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-04-18T14:43:46.661 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:45.381093+0000", 2024-04-18T14:43:46.661 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 7.2962999999999999e-05 2024-04-18T14:43:46.662 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:46.662 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:46.662 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_started", 2024-04-18T14:43:46.662 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:45.381554+0000", 2024-04-18T14:43:46.662 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00046082499999999999 2024-04-18T14:43:46.662 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:46.662 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:46.662 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_committed", 2024-04-18T14:43:46.662 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:45.382509+0000", 2024-04-18T14:43:46.662 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00095550799999999999 2024-04-18T14:43:46.662 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:46.662 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:46.662 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-04-18T14:43:46.662 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:45.392417+0000", 2024-04-18T14:43:46.662 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0099082270000000004 2024-04-18T14:43:46.663 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:46.663 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:46.663 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-04-18T14:43:46.663 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:45.392484+0000", 2024-04-18T14:43:46.663 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 6.6445000000000005e-05 2024-04-18T14:43:46.663 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:43:46.663 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-04-18T14:43:46.663 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:43:46.663 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:46.663 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:46.663 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(client.4559.0:324 3.4s0 3:253cfff6:::smithi13430248-31:head [append 0~0] snapc d=[b,a,8,7,2] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-04-18T14:43:46.663 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-04-18T14:43:45.375117+0000", 2024-04-18T14:43:46.663 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 1.2101815629999999, 2024-04-18T14:43:46.663 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.017657787000000001, 2024-04-18T14:43:46.663 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-04-18T14:43:46.663 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T14:43:46.664 INFO:teuthology.orchestra.run.smithi119.stdout: "client_info": { 2024-04-18T14:43:46.664 INFO:teuthology.orchestra.run.smithi119.stdout: "client": "client.4559", 2024-04-18T14:43:46.664 INFO:teuthology.orchestra.run.smithi119.stdout: "client_addr": "172.21.15.134:0/3113589487", 2024-04-18T14:43:46.664 INFO:teuthology.orchestra.run.smithi119.stdout: "tid": 324 2024-04-18T14:43:46.664 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:46.664 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-04-18T14:43:46.664 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:46.664 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-04-18T14:43:46.664 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:45.375117+0000", 2024-04-18T14:43:46.664 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:43:46.664 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:46.664 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:46.664 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-04-18T14:43:46.664 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:45.375117+0000", 2024-04-18T14:43:46.664 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:43:46.664 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:46.665 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:46.665 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-04-18T14:43:46.665 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:45.375116+0000", 2024-04-18T14:43:46.665 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4294967295.999999 2024-04-18T14:43:46.665 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:46.665 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:46.665 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-04-18T14:43:46.665 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:45.375122+0000", 2024-04-18T14:43:46.665 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 5.8270000000000003e-06 2024-04-18T14:43:46.665 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:46.665 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:46.665 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-04-18T14:43:46.665 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:45.375135+0000", 2024-04-18T14:43:46.665 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.3373000000000001e-05 2024-04-18T14:43:46.665 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:46.665 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:46.665 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-04-18T14:43:46.666 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:45.375143+0000", 2024-04-18T14:43:46.666 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 7.5739999999999998e-06 2024-04-18T14:43:46.666 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:46.666 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:46.666 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-04-18T14:43:46.666 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:45.375251+0000", 2024-04-18T14:43:46.666 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00010815999999999999 2024-04-18T14:43:46.666 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:46.666 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:46.666 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting_for_map not empty", 2024-04-18T14:43:46.666 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:45.375255+0000", 2024-04-18T14:43:46.666 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.9369999999999997e-06 2024-04-18T14:43:46.666 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:46.666 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:46.666 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-04-18T14:43:46.667 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:45.381914+0000", 2024-04-18T14:43:46.667 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.006658537 2024-04-18T14:43:46.667 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:46.667 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:46.667 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-04-18T14:43:46.667 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:45.381977+0000", 2024-04-18T14:43:46.667 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 6.3929000000000004e-05 2024-04-18T14:43:46.667 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:46.667 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:46.667 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_started", 2024-04-18T14:43:46.667 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:45.382319+0000", 2024-04-18T14:43:46.667 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000341365 2024-04-18T14:43:46.667 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:46.667 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:46.667 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_committed", 2024-04-18T14:43:46.667 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:45.383423+0000", 2024-04-18T14:43:46.668 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.001104584 2024-04-18T14:43:46.668 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:46.668 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:46.668 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-04-18T14:43:46.668 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:45.392699+0000", 2024-04-18T14:43:46.668 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0092753390000000005 2024-04-18T14:43:46.668 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:46.668 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:46.668 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-04-18T14:43:46.668 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:45.392775+0000", 2024-04-18T14:43:46.668 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 7.5899e-05 2024-04-18T14:43:46.668 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:43:46.668 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-04-18T14:43:46.668 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:43:46.668 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:43:46.668 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-04-18T14:43:46.669 INFO:teuthology.orchestra.run.smithi119.stdout:} 2024-04-18T14:43:46.670 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.14.asok dump_ops_in_flight 2024-04-18T14:43:46.671 INFO:tasks.ceph.osd.11.smithi134.stderr:2024-04-18T14:43:46.672+0000 7f2d36f12640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 11 (PID: 25216) UID: 0 2024-04-18T14:43:46.734 INFO:teuthology.orchestra.run.smithi086.stdout:osd.0: {} 2024-04-18T14:43:46.734 INFO:teuthology.orchestra.run.smithi086.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-18T14:43:46.755 INFO:teuthology.orchestra.run.smithi086.stdout:osd.1: {} 2024-04-18T14:43:46.755 INFO:teuthology.orchestra.run.smithi086.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-18T14:43:46.770 INFO:tasks.ceph.osd.4.smithi086.stderr:2024-04-18T14:43:46.771+0000 7f0c4c462640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 24956) UID: 0 2024-04-18T14:43:46.774 INFO:teuthology.orchestra.run.smithi086.stdout:osd.2: {} 2024-04-18T14:43:46.774 INFO:teuthology.orchestra.run.smithi086.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-18T14:43:46.779 INFO:tasks.thrashosds.thrasher:in_osds: [0, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15] out_osds: [1] dead_osds: [] live_osds: [0, 4, 8, 12, 1, 5, 9, 13, 2, 6, 10, 14, 3, 7, 11, 15] 2024-04-18T14:43:46.779 INFO:tasks.thrashosds.thrasher:choose_action: min_in 8 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-04-18T14:43:46.779 INFO:tasks.thrashosds.thrasher:primary_affinity 2024-04-18T14:43:46.779 INFO:tasks.thrashosds.thrasher:Setting osd 0 primary_affinity to 0.000000 2024-04-18T14:43:46.780 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 0 0 2024-04-18T14:43:46.795 INFO:teuthology.orchestra.run.smithi086.stdout:osd.3: {} 2024-04-18T14:43:46.795 INFO:teuthology.orchestra.run.smithi086.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-18T14:43:46.797 INFO:teuthology.orchestra.run.smithi119.stdout:{ 2024-04-18T14:43:46.797 INFO:teuthology.orchestra.run.smithi119.stdout: "ops": [], 2024-04-18T14:43:46.797 INFO:teuthology.orchestra.run.smithi119.stdout: "num_ops": 0 2024-04-18T14:43:46.797 INFO:teuthology.orchestra.run.smithi119.stdout:} 2024-04-18T14:43:46.811 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.14.asok dump_blocked_ops 2024-04-18T14:43:46.812 INFO:teuthology.orchestra.run.smithi086.stdout:osd.4: {} 2024-04-18T14:43:46.812 INFO:teuthology.orchestra.run.smithi086.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-18T14:43:46.831 INFO:teuthology.orchestra.run.smithi086.stdout:osd.5: {} 2024-04-18T14:43:46.831 INFO:teuthology.orchestra.run.smithi086.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-18T14:43:46.849 INFO:teuthology.orchestra.run.smithi086.stdout:osd.6: {} 2024-04-18T14:43:46.849 INFO:teuthology.orchestra.run.smithi086.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-18T14:43:46.869 INFO:teuthology.orchestra.run.smithi086.stdout:osd.7: {} 2024-04-18T14:43:46.869 INFO:teuthology.orchestra.run.smithi086.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-18T14:43:46.872 INFO:tasks.ceph.osd.5.smithi096.stderr:2024-04-18T14:43:46.870+0000 7fc33f25b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 24889) UID: 0 2024-04-18T14:43:46.887 INFO:teuthology.orchestra.run.smithi086.stdout:osd.8: {} 2024-04-18T14:43:46.887 INFO:teuthology.orchestra.run.smithi086.stderr:osd.8: osd_enable_op_tracker = '' 2024-04-18T14:43:46.907 INFO:teuthology.orchestra.run.smithi086.stdout:osd.9: {} 2024-04-18T14:43:46.907 INFO:teuthology.orchestra.run.smithi086.stderr:osd.9: osd_enable_op_tracker = '' 2024-04-18T14:43:46.927 INFO:teuthology.orchestra.run.smithi086.stdout:osd.10: {} 2024-04-18T14:43:46.928 INFO:teuthology.orchestra.run.smithi086.stderr:osd.10: osd_enable_op_tracker = '' 2024-04-18T14:43:46.933 INFO:teuthology.orchestra.run.smithi119.stdout:{ 2024-04-18T14:43:46.933 INFO:teuthology.orchestra.run.smithi119.stdout: "ops": [], 2024-04-18T14:43:46.933 INFO:teuthology.orchestra.run.smithi119.stdout: "complaint_time": 30, 2024-04-18T14:43:46.934 INFO:teuthology.orchestra.run.smithi119.stdout: "num_blocked_ops": 0 2024-04-18T14:43:46.934 INFO:teuthology.orchestra.run.smithi119.stdout:} 2024-04-18T14:43:46.947 INFO:teuthology.orchestra.run.smithi086.stdout:osd.11: {} 2024-04-18T14:43:46.947 INFO:teuthology.orchestra.run.smithi086.stderr:osd.11: osd_enable_op_tracker = '' 2024-04-18T14:43:46.948 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.14.asok dump_historic_ops 2024-04-18T14:43:46.964 INFO:teuthology.orchestra.run.smithi086.stdout:osd.12: {} 2024-04-18T14:43:46.964 INFO:teuthology.orchestra.run.smithi086.stderr:osd.12: osd_enable_op_tracker = '' 2024-04-18T14:43:46.973 INFO:tasks.ceph.osd.12.smithi086.stderr:2024-04-18T14:43:46.971+0000 7f6904968640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 12 (PID: 24960) UID: 0 2024-04-18T14:43:46.983 INFO:teuthology.orchestra.run.smithi086.stdout:osd.13: {} 2024-04-18T14:43:46.984 INFO:teuthology.orchestra.run.smithi086.stderr:osd.13: osd_enable_op_tracker = '' 2024-04-18T14:43:47.001 INFO:teuthology.orchestra.run.smithi086.stdout:osd.14: {} 2024-04-18T14:43:47.001 INFO:teuthology.orchestra.run.smithi086.stderr:osd.14: osd_enable_op_tracker = '' 2024-04-18T14:43:47.020 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-18T14:43:47.019+0000 7f9e21d45640 0 -- 172.21.15.86:0/3142638931 >> [v2:172.21.15.134:6808/25223,v1:172.21.15.134:6812/25223] conn(0x7f9e1c21f240 msgr2=0x7f9e1c221630 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-04-18T14:43:47.020 INFO:teuthology.orchestra.run.smithi086.stdout:osd.15: {} 2024-04-18T14:43:47.021 INFO:teuthology.orchestra.run.smithi086.stderr:osd.15: osd_enable_op_tracker = '' 2024-04-18T14:43:47.066 INFO:teuthology.orchestra.run.smithi119.stdout:ERROR: (22) Invalid argument 2024-04-18T14:43:47.066 INFO:teuthology.orchestra.run.smithi119.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T14:43:47.079 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-04-18T14:43:47.082 INFO:tasks.ceph.osd.8.smithi086.stderr:2024-04-18T14:43:47.083+0000 7f29f7b9d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 8 (PID: 24958) UID: 0 2024-04-18T14:43:47.175 INFO:tasks.ceph.osd.12.smithi086.stderr:2024-04-18T14:43:47.175+0000 7f6904968640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 12 (PID: 24960) UID: 0 2024-04-18T14:43:47.211 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-04-18T14:43:47.211 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T14:43:47.225 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-04-18T14:43:47.276 INFO:tasks.ceph.osd.13.smithi096.stderr:2024-04-18T14:43:47.274+0000 7f7e72fad640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 13 (PID: 24893) UID: 0 2024-04-18T14:43:47.347 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-04-18T14:43:47.347 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T14:43:47.361 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-04-18T14:43:47.373 INFO:teuthology.orchestra.run.smithi086.stderr:set osd.0 primary-affinity to 0 (802) 2024-04-18T14:43:47.375 INFO:tasks.rados.rados.0.smithi134.stdout:132: done (2 left) 2024-04-18T14:43:47.375 INFO:tasks.rados.rados.0.smithi134.stdout:133: done (1 left) 2024-04-18T14:43:47.375 INFO:tasks.rados.rados.0.smithi134.stdout:134: done (0 left) 2024-04-18T14:43:47.375 INFO:tasks.rados.rados.0.smithi134.stdout:135: setattr oid 23 current snap is 11 2024-04-18T14:43:47.376 INFO:tasks.ceph.osd.11.smithi134.stderr:2024-04-18T14:43:47.380+0000 7f2d36f12640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 11 (PID: 25216) UID: 0 2024-04-18T14:43:47.377 INFO:tasks.rados.rados.0.smithi134.stdout:136: read oid 20 snap 0 2024-04-18T14:43:47.377 INFO:tasks.rados.rados.0.smithi134.stdout:136: expect (ObjNum 19 snap 0 seq_num 19) 2024-04-18T14:43:47.377 INFO:tasks.rados.rados.0.smithi134.stdout:137: delete oid 31 current snap is 11 2024-04-18T14:43:47.388 INFO:tasks.rados.rados.0.smithi134.stdout:136: expect (ObjNum 19 snap 0 seq_num 19) 2024-04-18T14:43:47.400 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-04-18T14:43:47.402 INFO:tasks.rados.rados.0.smithi134.stdout:update_object_version oid 23 v 46 (ObjNum 44 snap 0 seq_num 44) dirty exists 2024-04-18T14:43:47.402 INFO:tasks.rados.rados.0.smithi134.stdout:135: done (2 left) 2024-04-18T14:43:47.402 INFO:tasks.rados.rados.0.smithi134.stdout:136: done (1 left) 2024-04-18T14:43:47.402 INFO:tasks.rados.rados.0.smithi134.stdout:137: done (0 left) 2024-04-18T14:43:47.402 INFO:tasks.rados.rados.0.smithi134.stdout:138: snap_create 2024-04-18T14:43:47.478 INFO:tasks.ceph.osd.9.smithi096.stderr:2024-04-18T14:43:47.474+0000 7fa2c1cbf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 9 (PID: 24891) UID: 0 2024-04-18T14:43:47.486 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-04-18T14:43:47.486 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T14:43:47.500 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-04-18T14:43:47.579 INFO:tasks.ceph.osd.1.smithi096.stderr:2024-04-18T14:43:47.578+0000 7f56a7a98640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 24887) UID: 0 2024-04-18T14:43:47.665 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-04-18T14:43:47.665 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T14:43:47.679 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-04-18T14:43:47.680 INFO:tasks.ceph.osd.12.smithi086.stderr:2024-04-18T14:43:47.679+0000 7f6904968640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 12 (PID: 24960) UID: 0 2024-04-18T14:43:47.782 INFO:tasks.ceph.osd.1.smithi096.stderr:2024-04-18T14:43:47.778+0000 7f56a7a98640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 24887) UID: 0 2024-04-18T14:43:47.799 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-04-18T14:43:47.799 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T14:43:47.814 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-04-18T14:43:47.883 INFO:tasks.ceph.osd.7.smithi134.stderr:2024-04-18T14:43:47.884+0000 7fd7de549640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25213) UID: 0 2024-04-18T14:43:47.938 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-04-18T14:43:47.938 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T14:43:47.952 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.11.asok dump_ops_in_flight 2024-04-18T14:43:47.984 INFO:tasks.ceph.osd.10.smithi119.stderr:2024-04-18T14:43:47.986+0000 7f6f24c12640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 10 (PID: 24898) UID: 0 2024-04-18T14:43:48.085 INFO:tasks.ceph.osd.13.smithi096.stderr:2024-04-18T14:43:48.082+0000 7f7e72fad640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 13 (PID: 24893) UID: 0 2024-04-18T14:43:48.116 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-04-18T14:43:48.116 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T14:43:48.130 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.11.asok dump_blocked_ops 2024-04-18T14:43:48.186 INFO:tasks.ceph.osd.12.smithi086.stderr:2024-04-18T14:43:48.187+0000 7f6904968640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 12 (PID: 24960) UID: 0 2024-04-18T14:43:48.246 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-04-18T14:43:48.246 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T14:43:48.260 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.11.asok dump_historic_ops 2024-04-18T14:43:48.287 INFO:tasks.ceph.osd.5.smithi096.stderr:2024-04-18T14:43:48.286+0000 7fc33f25b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 24889) UID: 0 2024-04-18T14:43:48.378 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-04-18T14:43:48.379 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T14:43:48.385 INFO:teuthology.orchestra.run.smithi086.stderr:nodeep-scrub is unset 2024-04-18T14:43:48.387 INFO:tasks.rados.rados.0.smithi134.stdout:138: done (0 left) 2024-04-18T14:43:48.387 INFO:tasks.rados.rados.0.smithi134.stdout:append oid 4 current snap is 12 2024-04-18T14:43:48.387 INFO:tasks.rados.rados.0.smithi134.stdout:139: seq_num 72 ranges {1671168=442368,2113536=720896,2834432=49152} 2024-04-18T14:43:48.387 INFO:tasks.ceph.osd.9.smithi096.stderr:2024-04-18T14:43:48.386+0000 7fa2c1cbf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 9 (PID: 24891) UID: 0 2024-04-18T14:43:48.394 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.15.asok dump_ops_in_flight 2024-04-18T14:43:48.398 INFO:tasks.rados.rados.0.smithi134.stdout:139: writing smithi13430248-4 from 1671168 to 2113536 tid 1 2024-04-18T14:43:48.402 INFO:tasks.rados.rados.0.smithi134.stdout:139: writing smithi13430248-4 from 2113536 to 2834432 tid 2 2024-04-18T14:43:48.404 INFO:tasks.rados.rados.0.smithi134.stdout:139: writing smithi13430248-4 from 2834432 to 2883584 tid 3 2024-04-18T14:43:48.404 INFO:tasks.rados.rados.0.smithi134.stdout:140: read oid 21 snap 5 2024-04-18T14:43:48.404 INFO:tasks.rados.rados.0.smithi134.stdout:140: expect (ObjNum 20 snap 0 seq_num 20) 2024-04-18T14:43:48.404 INFO:tasks.rados.rados.0.smithi134.stdout:141: read oid 38 snap -1 2024-04-18T14:43:48.404 INFO:tasks.rados.rados.0.smithi134.stdout:141: expect (ObjNum 60 snap 4 seq_num 60) 2024-04-18T14:43:48.405 INFO:tasks.rados.rados.0.smithi134.stdout:142: rollback oid 34 current snap is 12 2024-04-18T14:43:48.405 INFO:tasks.rados.rados.0.smithi134.stdout:rollback oid 34 to 4 2024-04-18T14:43:48.405 INFO:tasks.rados.rados.0.smithi134.stdout:143: rollback oid 46 current snap is 12 2024-04-18T14:43:48.405 INFO:tasks.rados.rados.0.smithi134.stdout:rollback oid 46 to 9 2024-04-18T14:43:48.405 INFO:tasks.rados.rados.0.smithi134.stdout:144: copy_from oid 40 from oid 48 current snap is 12 2024-04-18T14:43:48.405 INFO:tasks.rados.rados.0.smithi134.stdout:145: snap_remove snap 10 2024-04-18T14:43:48.488 INFO:tasks.ceph.osd.2.smithi119.stderr:2024-04-18T14:43:48.490+0000 7fcbd30c0640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 24894) UID: 0 2024-04-18T14:43:48.524 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-04-18T14:43:48.524 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T14:43:48.538 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.15.asok dump_blocked_ops 2024-04-18T14:43:48.589 INFO:tasks.ceph.osd.4.smithi086.stderr:2024-04-18T14:43:48.587+0000 7f0c4c462640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 24956) UID: 0 2024-04-18T14:43:48.690 INFO:tasks.ceph.osd.0.smithi086.stderr:2024-04-18T14:43:48.691+0000 7f7cdfd78640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 24953) UID: 0 2024-04-18T14:43:48.699 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-04-18T14:43:48.699 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T14:43:48.713 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.15.asok dump_historic_ops 2024-04-18T14:43:48.791 INFO:tasks.ceph.osd.4.smithi086.stderr:2024-04-18T14:43:48.791+0000 7f0c4c462640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 24956) UID: 0 2024-04-18T14:43:48.837 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-04-18T14:43:48.837 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T14:43:48.849 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-18T14:43:48.892 INFO:tasks.ceph.osd.13.smithi096.stderr:2024-04-18T14:43:48.894+0000 7f7e72fad640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 13 (PID: 24893) UID: 0 2024-04-18T14:43:48.979 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-04-18T14:43:48.979 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T14:43:48.993 INFO:tasks.ceph.osd.4.smithi086.stderr:2024-04-18T14:43:48.991+0000 7f0c4c462640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 24956) UID: 0 2024-04-18T14:43:48.994 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-18T14:43:49.038 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-18T14:43:49.093 INFO:tasks.ceph.osd.12.smithi086.stderr:2024-04-18T14:43:49.091+0000 7f6904968640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 12 (PID: 24960) UID: 0 2024-04-18T14:43:49.167 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-04-18T14:43:49.168 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T14:43:49.181 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-18T14:43:49.182 INFO:teuthology.orchestra.run.smithi086.stdout:osd.0: {} 2024-04-18T14:43:49.183 INFO:teuthology.orchestra.run.smithi086.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-18T14:43:49.195 INFO:tasks.ceph.osd.10.smithi119.stderr:2024-04-18T14:43:49.194+0000 7f6f24c12640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 10 (PID: 24898) UID: 0 2024-04-18T14:43:49.203 INFO:teuthology.orchestra.run.smithi086.stdout:osd.1: {} 2024-04-18T14:43:49.203 INFO:teuthology.orchestra.run.smithi086.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-18T14:43:49.223 INFO:teuthology.orchestra.run.smithi086.stdout:osd.2: {} 2024-04-18T14:43:49.223 INFO:teuthology.orchestra.run.smithi086.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-18T14:43:49.243 INFO:teuthology.orchestra.run.smithi086.stdout:osd.3: {} 2024-04-18T14:43:49.243 INFO:teuthology.orchestra.run.smithi086.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-18T14:43:49.260 INFO:teuthology.orchestra.run.smithi086.stdout:osd.4: {} 2024-04-18T14:43:49.260 INFO:teuthology.orchestra.run.smithi086.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-18T14:43:49.280 INFO:teuthology.orchestra.run.smithi086.stdout:osd.5: {} 2024-04-18T14:43:49.281 INFO:teuthology.orchestra.run.smithi086.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-18T14:43:49.296 INFO:tasks.ceph.osd.11.smithi134.stderr:2024-04-18T14:43:49.300+0000 7f2d36f12640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 11 (PID: 25216) UID: 0 2024-04-18T14:43:49.299 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-04-18T14:43:49.299 INFO:teuthology.orchestra.run.smithi086.stdout: "size": 20, 2024-04-18T14:43:49.300 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 600, 2024-04-18T14:43:49.300 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [ 2024-04-18T14:43:49.300 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:49.300 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(client.4212.0:108 1.0 e25/24 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 25'70, mlcod=25'65)", 2024-04-18T14:43:49.300 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-04-18T14:43:20.706300+0000", 2024-04-18T14:43:49.300 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 28.594694283999999, 2024-04-18T14:43:49.300 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0044871939999999999, 2024-04-18T14:43:49.300 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-04-18T14:43:49.300 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T14:43:49.300 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-04-18T14:43:49.300 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:49.300 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-04-18T14:43:49.300 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:20.706300+0000", 2024-04-18T14:43:49.300 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:43:49.301 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:49.301 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:49.301 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-04-18T14:43:49.301 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:20.706300+0000", 2024-04-18T14:43:49.301 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:43:49.301 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:49.301 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:49.301 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-04-18T14:43:49.301 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:20.706298+0000", 2024-04-18T14:43:49.301 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999986 2024-04-18T14:43:49.301 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:49.301 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:49.301 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-04-18T14:43:49.301 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:20.706321+0000", 2024-04-18T14:43:49.301 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.2935999999999999e-05 2024-04-18T14:43:49.302 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:49.302 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:49.302 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-04-18T14:43:49.302 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:20.706347+0000", 2024-04-18T14:43:49.302 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.6461e-05 2024-04-18T14:43:49.302 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:49.302 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:49.302 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-04-18T14:43:49.302 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:20.706375+0000", 2024-04-18T14:43:49.302 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.7334999999999998e-05 2024-04-18T14:43:49.302 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:49.302 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:49.302 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-04-18T14:43:49.302 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:20.706411+0000", 2024-04-18T14:43:49.303 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.6083e-05 2024-04-18T14:43:49.303 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:49.303 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:49.303 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-04-18T14:43:49.303 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:20.706424+0000", 2024-04-18T14:43:49.303 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.2814e-05 2024-04-18T14:43:49.303 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:49.303 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:49.303 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-04-18T14:43:49.303 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:20.710754+0000", 2024-04-18T14:43:49.303 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0043298529999999998 2024-04-18T14:43:49.303 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:49.303 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:49.303 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-04-18T14:43:49.303 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:20.710787+0000", 2024-04-18T14:43:49.303 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.3334999999999998e-05 2024-04-18T14:43:49.304 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:43:49.304 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-04-18T14:43:49.304 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:43:49.304 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:49.304 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:49.304 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(client.4212.0:109 1.0 e25/24 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 25'71, mlcod=25'67)", 2024-04-18T14:43:49.304 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-04-18T14:43:20.708477+0000", 2024-04-18T14:43:49.304 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 28.592516878000001, 2024-04-18T14:43:49.304 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0044164190000000004, 2024-04-18T14:43:49.304 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-04-18T14:43:49.304 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T14:43:49.304 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-04-18T14:43:49.304 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:49.304 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-04-18T14:43:49.304 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:20.708477+0000", 2024-04-18T14:43:49.304 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:43:49.304 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:49.305 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:49.305 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-04-18T14:43:49.305 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:20.708477+0000", 2024-04-18T14:43:49.305 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:43:49.305 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:49.305 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:49.305 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-04-18T14:43:49.305 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:20.708476+0000", 2024-04-18T14:43:49.305 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-04-18T14:43:49.305 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:49.305 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:49.305 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-04-18T14:43:49.305 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:20.708562+0000", 2024-04-18T14:43:49.305 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.6508000000000006e-05 2024-04-18T14:43:49.305 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:49.305 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:49.305 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-04-18T14:43:49.306 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:20.708595+0000", 2024-04-18T14:43:49.306 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.2756999999999998e-05 2024-04-18T14:43:49.306 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:49.306 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:49.306 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-04-18T14:43:49.306 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:20.708613+0000", 2024-04-18T14:43:49.306 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.7958999999999999e-05 2024-04-18T14:43:49.306 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:49.306 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:49.306 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-04-18T14:43:49.306 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:20.708646+0000", 2024-04-18T14:43:49.306 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.2657000000000003e-05 2024-04-18T14:43:49.306 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:49.306 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:49.306 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-04-18T14:43:49.307 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:20.708659+0000", 2024-04-18T14:43:49.307 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.3266e-05 2024-04-18T14:43:49.307 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:49.307 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:49.307 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-04-18T14:43:49.307 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:20.712857+0000", 2024-04-18T14:43:49.307 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0041983769999999997 2024-04-18T14:43:49.307 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:49.307 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:49.307 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-04-18T14:43:49.307 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:20.712894+0000", 2024-04-18T14:43:49.307 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.6081999999999998e-05 2024-04-18T14:43:49.307 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:43:49.307 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-04-18T14:43:49.307 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:43:49.307 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:49.307 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:49.307 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(client.4212.0:110 1.0 e25/24 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 25'72, mlcod=25'67)", 2024-04-18T14:43:49.308 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-04-18T14:43:20.710157+0000", 2024-04-18T14:43:49.308 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 28.590836622000001, 2024-04-18T14:43:49.308 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0054967820000000004, 2024-04-18T14:43:49.308 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-04-18T14:43:49.308 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T14:43:49.308 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-04-18T14:43:49.308 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:49.308 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-04-18T14:43:49.308 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:20.710157+0000", 2024-04-18T14:43:49.308 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:43:49.308 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:49.308 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:49.308 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-04-18T14:43:49.308 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:20.710157+0000", 2024-04-18T14:43:49.308 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:43:49.308 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:49.308 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:49.309 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-04-18T14:43:49.309 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:20.710155+0000", 2024-04-18T14:43:49.309 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999976 2024-04-18T14:43:49.309 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:49.309 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:49.309 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-04-18T14:43:49.309 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:20.710177+0000", 2024-04-18T14:43:49.309 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.2002999999999999e-05 2024-04-18T14:43:49.309 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:49.309 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:49.309 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-04-18T14:43:49.309 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:20.710200+0000", 2024-04-18T14:43:49.309 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.2833999999999999e-05 2024-04-18T14:43:49.309 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:49.310 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:49.310 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-04-18T14:43:49.310 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:20.710221+0000", 2024-04-18T14:43:49.310 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.1576000000000001e-05 2024-04-18T14:43:49.310 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:49.310 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:49.310 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-04-18T14:43:49.310 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:20.710313+0000", 2024-04-18T14:43:49.310 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.2102999999999996e-05 2024-04-18T14:43:49.310 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:49.310 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:49.310 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-04-18T14:43:49.310 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:20.710349+0000", 2024-04-18T14:43:49.310 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.5488000000000003e-05 2024-04-18T14:43:49.310 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:49.311 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:49.311 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-04-18T14:43:49.311 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:20.715618+0000", 2024-04-18T14:43:49.311 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.005269625 2024-04-18T14:43:49.311 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:49.311 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:49.311 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-04-18T14:43:49.311 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:20.715654+0000", 2024-04-18T14:43:49.311 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.5722999999999997e-05 2024-04-18T14:43:49.311 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:43:49.311 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-04-18T14:43:49.311 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:43:49.311 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:49.311 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:49.311 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(client.4212.0:111 1.0 e25/24 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 25'73, mlcod=25'68)", 2024-04-18T14:43:49.311 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-04-18T14:43:20.711720+0000", 2024-04-18T14:43:49.312 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 28.589274456999998, 2024-04-18T14:43:49.312 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00396263, 2024-04-18T14:43:49.312 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-04-18T14:43:49.312 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T14:43:49.312 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-04-18T14:43:49.312 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:49.312 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-04-18T14:43:49.312 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:20.711720+0000", 2024-04-18T14:43:49.312 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:43:49.312 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:49.312 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:49.312 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-04-18T14:43:49.312 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:20.711720+0000", 2024-04-18T14:43:49.312 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:43:49.312 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:49.313 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:49.313 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-04-18T14:43:49.313 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:20.711718+0000", 2024-04-18T14:43:49.313 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-04-18T14:43:49.313 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:49.313 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:49.313 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-04-18T14:43:49.313 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:20.711736+0000", 2024-04-18T14:43:49.313 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.7249e-05 2024-04-18T14:43:49.313 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:49.313 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:49.313 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-04-18T14:43:49.313 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:20.711762+0000", 2024-04-18T14:43:49.313 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.6471000000000001e-05 2024-04-18T14:43:49.313 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:49.313 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:49.314 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-04-18T14:43:49.314 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:20.711784+0000", 2024-04-18T14:43:49.314 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.2319000000000001e-05 2024-04-18T14:43:49.314 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:49.314 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:49.314 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-04-18T14:43:49.314 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:20.711815+0000", 2024-04-18T14:43:49.314 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.0582e-05 2024-04-18T14:43:49.314 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:49.314 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:49.314 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-04-18T14:43:49.315 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:20.711827+0000", 2024-04-18T14:43:49.315 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.2432000000000001e-05 2024-04-18T14:43:49.315 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:49.315 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:49.315 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-04-18T14:43:49.315 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:20.715657+0000", 2024-04-18T14:43:49.315 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0038293379999999998 2024-04-18T14:43:49.315 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:49.315 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:49.315 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-04-18T14:43:49.315 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:20.715682+0000", 2024-04-18T14:43:49.315 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.5369000000000001e-05 2024-04-18T14:43:49.315 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:43:49.315 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-04-18T14:43:49.315 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:43:49.315 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:49.316 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:49.316 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(client.4212.0:112 1.0 e25/24 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 25'74, mlcod=25'68)", 2024-04-18T14:43:49.316 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-04-18T14:43:20.712903+0000", 2024-04-18T14:43:49.316 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 28.588090608999998, 2024-04-18T14:43:49.316 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0055161020000000002, 2024-04-18T14:43:49.316 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-04-18T14:43:49.316 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T14:43:49.316 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-04-18T14:43:49.316 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:49.316 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-04-18T14:43:49.316 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:20.712903+0000", 2024-04-18T14:43:49.316 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:43:49.316 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:49.316 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:49.316 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-04-18T14:43:49.317 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:20.712903+0000", 2024-04-18T14:43:49.317 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:43:49.317 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:49.317 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:49.317 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-04-18T14:43:49.317 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:20.712902+0000", 2024-04-18T14:43:49.317 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-04-18T14:43:49.317 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:49.317 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:49.317 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-04-18T14:43:49.317 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:20.712992+0000", 2024-04-18T14:43:49.317 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.0004000000000001e-05 2024-04-18T14:43:49.317 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:49.317 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:49.317 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-04-18T14:43:49.318 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:20.713009+0000", 2024-04-18T14:43:49.318 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.6722e-05 2024-04-18T14:43:49.318 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:49.318 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:49.318 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-04-18T14:43:49.318 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:20.713019+0000", 2024-04-18T14:43:49.318 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.5359999999999998e-06 2024-04-18T14:43:49.318 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:49.318 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:49.318 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-04-18T14:43:49.318 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:20.713054+0000", 2024-04-18T14:43:49.318 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.5074999999999999e-05 2024-04-18T14:43:49.318 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:49.318 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:49.318 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-04-18T14:43:49.319 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:20.713068+0000", 2024-04-18T14:43:49.319 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.4032000000000001e-05 2024-04-18T14:43:49.319 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:49.319 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:49.319 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-04-18T14:43:49.319 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:20.718385+0000", 2024-04-18T14:43:49.319 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.005317113 2024-04-18T14:43:49.319 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:49.319 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:49.319 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-04-18T14:43:49.319 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:20.718419+0000", 2024-04-18T14:43:49.319 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.4567000000000003e-05 2024-04-18T14:43:49.319 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:43:49.319 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-04-18T14:43:49.319 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:43:49.319 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:49.320 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:49.320 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(client.4212.0:132 1.0 e25/24 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 25'90, mlcod=25'85)", 2024-04-18T14:43:49.320 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-04-18T14:43:20.877663+0000", 2024-04-18T14:43:49.320 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 28.423331253000001, 2024-04-18T14:43:49.320 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0045707120000000002, 2024-04-18T14:43:49.320 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-04-18T14:43:49.320 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T14:43:49.320 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-04-18T14:43:49.320 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:49.320 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-04-18T14:43:49.320 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:20.877663+0000", 2024-04-18T14:43:49.320 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:43:49.320 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:49.320 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:49.320 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-04-18T14:43:49.321 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:20.877663+0000", 2024-04-18T14:43:49.321 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:43:49.321 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:49.321 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:49.321 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-04-18T14:43:49.321 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:20.877661+0000", 2024-04-18T14:43:49.321 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999986 2024-04-18T14:43:49.321 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:49.321 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:49.321 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-04-18T14:43:49.321 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:20.877674+0000", 2024-04-18T14:43:49.321 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.2859e-05 2024-04-18T14:43:49.321 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:49.321 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:49.321 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-04-18T14:43:49.321 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:20.877698+0000", 2024-04-18T14:43:49.321 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.3847999999999999e-05 2024-04-18T14:43:49.322 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:49.322 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:49.322 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-04-18T14:43:49.322 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:20.877710+0000", 2024-04-18T14:43:49.322 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.2493e-05 2024-04-18T14:43:49.322 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:49.322 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:49.322 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-04-18T14:43:49.322 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:20.878008+0000", 2024-04-18T14:43:49.322 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00029780600000000001 2024-04-18T14:43:49.322 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:49.322 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:49.322 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-04-18T14:43:49.322 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:20.878064+0000", 2024-04-18T14:43:49.323 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.5676e-05 2024-04-18T14:43:49.323 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:49.323 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:49.323 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-04-18T14:43:49.323 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:20.882171+0000", 2024-04-18T14:43:49.323 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0041069210000000004 2024-04-18T14:43:49.323 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:49.323 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:49.323 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-04-18T14:43:49.323 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:20.882233+0000", 2024-04-18T14:43:49.323 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.2701999999999997e-05 2024-04-18T14:43:49.323 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:43:49.323 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-04-18T14:43:49.323 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:43:49.323 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:49.324 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:49.324 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(client.4212.0:133 1.0 e25/24 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 25'91, mlcod=25'85)", 2024-04-18T14:43:49.324 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-04-18T14:43:20.878523+0000", 2024-04-18T14:43:49.324 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 28.422471336000001, 2024-04-18T14:43:49.324 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0047242610000000004, 2024-04-18T14:43:49.324 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-04-18T14:43:49.324 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T14:43:49.324 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-04-18T14:43:49.324 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:49.324 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-04-18T14:43:49.324 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:20.878523+0000", 2024-04-18T14:43:49.324 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:43:49.324 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:49.324 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:49.324 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-04-18T14:43:49.324 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:20.878523+0000", 2024-04-18T14:43:49.325 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:43:49.325 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:49.325 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:49.325 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-04-18T14:43:49.325 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:20.878521+0000", 2024-04-18T14:43:49.325 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999986 2024-04-18T14:43:49.325 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:49.325 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:49.325 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-04-18T14:43:49.325 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:20.878532+0000", 2024-04-18T14:43:49.325 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.0479000000000001e-05 2024-04-18T14:43:49.325 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:49.325 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:49.325 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-04-18T14:43:49.325 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:20.878550+0000", 2024-04-18T14:43:49.325 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.8014999999999999e-05 2024-04-18T14:43:49.325 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:49.326 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:49.326 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-04-18T14:43:49.326 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:20.878560+0000", 2024-04-18T14:43:49.326 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.8959999999999998e-06 2024-04-18T14:43:49.326 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:49.326 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:49.326 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-04-18T14:43:49.326 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:20.878740+0000", 2024-04-18T14:43:49.326 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00018028099999999999 2024-04-18T14:43:49.326 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:49.326 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:49.326 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-04-18T14:43:49.326 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:20.878774+0000", 2024-04-18T14:43:49.326 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.3898e-05 2024-04-18T14:43:49.326 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:49.327 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:49.327 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-04-18T14:43:49.327 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:20.883171+0000", 2024-04-18T14:43:49.327 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0043973939999999998 2024-04-18T14:43:49.327 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:49.327 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:49.327 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-04-18T14:43:49.327 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:20.883247+0000", 2024-04-18T14:43:49.327 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.5561000000000004e-05 2024-04-18T14:43:49.327 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:43:49.327 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-04-18T14:43:49.327 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:43:49.327 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:49.327 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:49.327 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(client.4212.0:137 1.0 e25/24 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 25'95, mlcod=25'88)", 2024-04-18T14:43:49.328 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-04-18T14:43:20.881121+0000", 2024-04-18T14:43:49.328 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 28.419873303999999, 2024-04-18T14:43:49.328 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0068217629999999998, 2024-04-18T14:43:49.328 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-04-18T14:43:49.328 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T14:43:49.328 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-04-18T14:43:49.328 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:49.328 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-04-18T14:43:49.328 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:20.881121+0000", 2024-04-18T14:43:49.328 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:43:49.328 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:49.328 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:49.328 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-04-18T14:43:49.328 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:20.881121+0000", 2024-04-18T14:43:49.328 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:43:49.328 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:49.328 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:49.328 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-04-18T14:43:49.329 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:20.881120+0000", 2024-04-18T14:43:49.329 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-04-18T14:43:49.329 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:49.329 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:49.329 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-04-18T14:43:49.329 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:20.881248+0000", 2024-04-18T14:43:49.329 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000128668 2024-04-18T14:43:49.329 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:49.329 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:49.329 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-04-18T14:43:49.329 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:20.881265+0000", 2024-04-18T14:43:49.329 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.7241999999999999e-05 2024-04-18T14:43:49.329 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:49.329 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:49.329 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-04-18T14:43:49.329 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:20.881276+0000", 2024-04-18T14:43:49.330 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.0249e-05 2024-04-18T14:43:49.330 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:49.330 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:49.330 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-04-18T14:43:49.330 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:20.881354+0000", 2024-04-18T14:43:49.330 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.8721999999999996e-05 2024-04-18T14:43:49.330 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:49.330 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:49.330 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-04-18T14:43:49.330 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:20.881396+0000", 2024-04-18T14:43:49.330 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.1739999999999997e-05 2024-04-18T14:43:49.330 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:49.331 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:49.331 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-04-18T14:43:49.331 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:20.887866+0000", 2024-04-18T14:43:49.331 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0064697330000000001 2024-04-18T14:43:49.331 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:49.331 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:49.331 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-04-18T14:43:49.331 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:20.887942+0000", 2024-04-18T14:43:49.331 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.6542e-05 2024-04-18T14:43:49.331 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:43:49.331 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-04-18T14:43:49.331 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:43:49.331 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:49.331 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:49.331 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(client.4212.0:138 1.0 e25/24 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 25'96, mlcod=25'88)", 2024-04-18T14:43:49.331 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-04-18T14:43:20.882338+0000", 2024-04-18T14:43:49.332 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 28.418655991000001, 2024-04-18T14:43:49.332 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0064705229999999997, 2024-04-18T14:43:49.332 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-04-18T14:43:49.332 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T14:43:49.332 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-04-18T14:43:49.332 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:49.332 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-04-18T14:43:49.332 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:20.882338+0000", 2024-04-18T14:43:49.332 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:43:49.332 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:49.332 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:49.332 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-04-18T14:43:49.332 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:20.882338+0000", 2024-04-18T14:43:49.332 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:43:49.332 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:49.332 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:49.332 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-04-18T14:43:49.333 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:20.882337+0000", 2024-04-18T14:43:49.333 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999986 2024-04-18T14:43:49.333 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:49.333 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:49.333 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-04-18T14:43:49.333 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:20.882349+0000", 2024-04-18T14:43:49.334 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.2381999999999999e-05 2024-04-18T14:43:49.334 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:49.334 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:49.334 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-04-18T14:43:49.334 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:20.882373+0000", 2024-04-18T14:43:49.334 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.3935e-05 2024-04-18T14:43:49.335 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:49.335 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:49.335 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-04-18T14:43:49.335 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:20.882387+0000", 2024-04-18T14:43:49.335 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.4528999999999999e-05 2024-04-18T14:43:49.335 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:49.336 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:49.336 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-04-18T14:43:49.336 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:20.882482+0000", 2024-04-18T14:43:49.336 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.4930000000000001e-05 2024-04-18T14:43:49.336 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:49.336 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:49.336 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-04-18T14:43:49.336 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:20.882532+0000", 2024-04-18T14:43:49.336 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.0033e-05 2024-04-18T14:43:49.336 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:49.336 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:49.337 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-04-18T14:43:49.337 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:20.888732+0000", 2024-04-18T14:43:49.337 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0061996229999999996 2024-04-18T14:43:49.337 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:49.337 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:49.337 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-04-18T14:43:49.337 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:20.888809+0000", 2024-04-18T14:43:49.338 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.6470999999999993e-05 2024-04-18T14:43:49.338 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:43:49.338 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-04-18T14:43:49.338 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:43:49.338 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:49.338 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:49.338 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(client.4212.0:139 1.0 e25/24 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 25'97, mlcod=25'88)", 2024-04-18T14:43:49.338 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-04-18T14:43:20.883426+0000", 2024-04-18T14:43:49.338 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 28.417568024000001, 2024-04-18T14:43:49.338 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0054388659999999997, 2024-04-18T14:43:49.339 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-04-18T14:43:49.339 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T14:43:49.339 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-04-18T14:43:49.339 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:49.339 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-04-18T14:43:49.339 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:20.883426+0000", 2024-04-18T14:43:49.339 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:43:49.339 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:49.339 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:49.339 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-04-18T14:43:49.339 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:20.883426+0000", 2024-04-18T14:43:49.340 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:43:49.340 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:49.340 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:49.340 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-04-18T14:43:49.340 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:20.883425+0000", 2024-04-18T14:43:49.340 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999986 2024-04-18T14:43:49.340 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:49.340 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:49.341 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-04-18T14:43:49.341 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:20.883437+0000", 2024-04-18T14:43:49.341 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.1861999999999999e-05 2024-04-18T14:43:49.341 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:49.341 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:49.341 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-04-18T14:43:49.342 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:20.883461+0000", 2024-04-18T14:43:49.342 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.3995e-05 2024-04-18T14:43:49.342 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:49.342 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:49.342 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-04-18T14:43:49.342 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:20.883478+0000", 2024-04-18T14:43:49.342 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.7762e-05 2024-04-18T14:43:49.342 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:49.342 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:49.343 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-04-18T14:43:49.343 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:20.883572+0000", 2024-04-18T14:43:49.343 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.3586999999999997e-05 2024-04-18T14:43:49.343 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:49.343 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:49.343 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-04-18T14:43:49.343 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:20.883632+0000", 2024-04-18T14:43:49.343 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.0202999999999999e-05 2024-04-18T14:43:49.343 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:49.343 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:49.344 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-04-18T14:43:49.344 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:20.888815+0000", 2024-04-18T14:43:49.344 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0051830920000000003 2024-04-18T14:43:49.344 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:49.344 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:49.344 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-04-18T14:43:49.344 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:20.888865+0000", 2024-04-18T14:43:49.344 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.9660999999999998e-05 2024-04-18T14:43:49.344 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:43:49.344 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-04-18T14:43:49.344 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:43:49.345 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:49.345 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:49.345 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(client.4212.0:140 1.0 e25/24 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 25'98, mlcod=25'90)", 2024-04-18T14:43:49.345 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-04-18T14:43:20.884221+0000", 2024-04-18T14:43:49.345 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 28.416772908999999, 2024-04-18T14:43:49.345 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0069705119999999999, 2024-04-18T14:43:49.345 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-04-18T14:43:49.345 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T14:43:49.346 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-04-18T14:43:49.346 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:49.346 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-04-18T14:43:49.346 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:20.884221+0000", 2024-04-18T14:43:49.346 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:43:49.346 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:49.346 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:49.346 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-04-18T14:43:49.346 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:20.884221+0000", 2024-04-18T14:43:49.346 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:43:49.347 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:49.347 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:49.347 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-04-18T14:43:49.347 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:20.884219+0000", 2024-04-18T14:43:49.347 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999981 2024-04-18T14:43:49.347 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:49.347 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:49.348 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-04-18T14:43:49.348 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:20.884318+0000", 2024-04-18T14:43:49.348 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.9103000000000003e-05 2024-04-18T14:43:49.348 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:49.348 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:49.348 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-04-18T14:43:49.348 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:20.884342+0000", 2024-04-18T14:43:49.348 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.3864000000000001e-05 2024-04-18T14:43:49.348 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:49.349 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:49.349 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-04-18T14:43:49.349 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:20.884355+0000", 2024-04-18T14:43:49.349 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.2829e-05 2024-04-18T14:43:49.349 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:49.349 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:49.349 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-04-18T14:43:49.349 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:20.884446+0000", 2024-04-18T14:43:49.349 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.1328000000000004e-05 2024-04-18T14:43:49.349 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:49.350 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:49.350 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-04-18T14:43:49.350 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:20.884499+0000", 2024-04-18T14:43:49.350 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.2238999999999999e-05 2024-04-18T14:43:49.350 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:49.350 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:49.350 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-04-18T14:43:49.351 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:20.891116+0000", 2024-04-18T14:43:49.351 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0066174229999999999 2024-04-18T14:43:49.351 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:49.351 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:49.351 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-04-18T14:43:49.351 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:20.891192+0000", 2024-04-18T14:43:49.352 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.5542000000000003e-05 2024-04-18T14:43:49.352 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:43:49.352 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-04-18T14:43:49.352 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:43:49.352 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:49.352 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:49.352 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(client.4212.0:141 1.0 e25/24 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 25'99, mlcod=25'90)", 2024-04-18T14:43:49.353 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-04-18T14:43:20.885297+0000", 2024-04-18T14:43:49.353 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 28.415696573999998, 2024-04-18T14:43:49.353 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0085544120000000008, 2024-04-18T14:43:49.353 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-04-18T14:43:49.353 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T14:43:49.353 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-04-18T14:43:49.353 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:49.353 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-04-18T14:43:49.354 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:20.885297+0000", 2024-04-18T14:43:49.354 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:43:49.354 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:49.354 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:49.354 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-04-18T14:43:49.354 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:20.885297+0000", 2024-04-18T14:43:49.354 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:43:49.354 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:49.354 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:49.354 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-04-18T14:43:49.354 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:20.885296+0000", 2024-04-18T14:43:49.354 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999981 2024-04-18T14:43:49.354 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:49.354 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:49.355 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-04-18T14:43:49.355 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:20.885309+0000", 2024-04-18T14:43:49.355 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.3532e-05 2024-04-18T14:43:49.355 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:49.355 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:49.355 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-04-18T14:43:49.355 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:20.885334+0000", 2024-04-18T14:43:49.355 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.4360999999999999e-05 2024-04-18T14:43:49.356 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:49.356 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:49.356 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-04-18T14:43:49.356 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:20.885348+0000", 2024-04-18T14:43:49.356 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.4069e-05 2024-04-18T14:43:49.356 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:49.357 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:49.357 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-04-18T14:43:49.357 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:20.888020+0000", 2024-04-18T14:43:49.357 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0026719650000000001 2024-04-18T14:43:49.357 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:49.357 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:49.357 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-04-18T14:43:49.358 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:20.888077+0000", 2024-04-18T14:43:49.358 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.6938999999999998e-05 2024-04-18T14:43:49.358 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:49.358 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:49.358 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-04-18T14:43:49.358 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:20.893781+0000", 2024-04-18T14:43:49.358 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0057041399999999999 2024-04-18T14:43:49.358 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:49.358 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:49.359 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-04-18T14:43:49.359 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:20.893852+0000", 2024-04-18T14:43:49.359 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.1112000000000006e-05 2024-04-18T14:43:49.359 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:43:49.359 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-04-18T14:43:49.359 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:43:49.359 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:49.359 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:49.359 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(client.4212.0:203 1.0 e26/24 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 26'149, mlcod=25'145)", 2024-04-18T14:43:49.359 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-04-18T14:43:23.027038+0000", 2024-04-18T14:43:49.359 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 26.273955866000001, 2024-04-18T14:43:49.360 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0080089600000000007, 2024-04-18T14:43:49.360 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-04-18T14:43:49.360 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T14:43:49.360 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-04-18T14:43:49.360 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:49.360 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-04-18T14:43:49.360 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:23.027038+0000", 2024-04-18T14:43:49.360 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:43:49.360 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:49.360 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:49.360 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-04-18T14:43:49.360 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:23.027038+0000", 2024-04-18T14:43:49.360 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:43:49.360 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:49.361 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:49.361 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-04-18T14:43:49.361 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:23.027037+0000", 2024-04-18T14:43:49.361 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-04-18T14:43:49.361 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:49.361 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:49.362 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-04-18T14:43:49.362 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:23.027199+0000", 2024-04-18T14:43:49.362 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00016148000000000001 2024-04-18T14:43:49.362 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:49.362 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:49.362 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-04-18T14:43:49.363 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:23.027217+0000", 2024-04-18T14:43:49.363 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.7975e-05 2024-04-18T14:43:49.363 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:49.363 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:49.363 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-04-18T14:43:49.363 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:23.027226+0000", 2024-04-18T14:43:49.363 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.4579999999999999e-06 2024-04-18T14:43:49.363 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:49.363 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:49.363 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-04-18T14:43:49.363 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:23.027271+0000", 2024-04-18T14:43:49.364 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.5323e-05 2024-04-18T14:43:49.364 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:49.364 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:49.364 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-04-18T14:43:49.364 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:23.027291+0000", 2024-04-18T14:43:49.364 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.9264000000000001e-05 2024-04-18T14:43:49.364 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:49.364 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:49.365 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-04-18T14:43:49.365 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:23.034994+0000", 2024-04-18T14:43:49.365 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0077035519999999998 2024-04-18T14:43:49.365 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:49.365 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:49.365 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-04-18T14:43:49.365 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:23.035047+0000", 2024-04-18T14:43:49.365 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.2824000000000001e-05 2024-04-18T14:43:49.365 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:43:49.365 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-04-18T14:43:49.365 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:43:49.365 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:49.365 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:49.365 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(client.4212.0:204 1.0 e26/24 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 26'150, mlcod=25'145)", 2024-04-18T14:43:49.366 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-04-18T14:43:23.028329+0000", 2024-04-18T14:43:49.366 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 26.272665149000002, 2024-04-18T14:43:49.366 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.006743481, 2024-04-18T14:43:49.366 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-04-18T14:43:49.366 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T14:43:49.366 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-04-18T14:43:49.367 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:49.367 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-04-18T14:43:49.367 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:23.028329+0000", 2024-04-18T14:43:49.367 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:43:49.367 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:49.367 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:49.367 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-04-18T14:43:49.368 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:23.028329+0000", 2024-04-18T14:43:49.368 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:43:49.368 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:49.368 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:49.368 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-04-18T14:43:49.368 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:23.028328+0000", 2024-04-18T14:43:49.368 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-04-18T14:43:49.368 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:49.368 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:49.368 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-04-18T14:43:49.368 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:23.028337+0000", 2024-04-18T14:43:49.369 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.2399999999999996e-06 2024-04-18T14:43:49.369 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:49.369 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:49.369 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-04-18T14:43:49.369 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:23.028353+0000", 2024-04-18T14:43:49.369 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.6308999999999999e-05 2024-04-18T14:43:49.369 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:49.369 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:49.369 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-04-18T14:43:49.369 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:23.028362+0000", 2024-04-18T14:43:49.369 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.6910000000000003e-06 2024-04-18T14:43:49.369 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:49.370 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:49.370 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-04-18T14:43:49.370 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:23.028427+0000", 2024-04-18T14:43:49.370 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.4844000000000005e-05 2024-04-18T14:43:49.370 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:49.370 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:49.370 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-04-18T14:43:49.370 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:23.028453+0000", 2024-04-18T14:43:49.371 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.6259999999999999e-05 2024-04-18T14:43:49.371 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:49.371 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:49.371 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-04-18T14:43:49.371 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:23.035050+0000", 2024-04-18T14:43:49.371 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0065966740000000003 2024-04-18T14:43:49.372 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:49.372 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:49.372 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-04-18T14:43:49.372 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:23.035072+0000", 2024-04-18T14:43:49.372 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.2364000000000001e-05 2024-04-18T14:43:49.372 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:43:49.372 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-04-18T14:43:49.372 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:43:49.372 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:49.372 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:49.373 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(client.4212.0:205 1.0 e26/24 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 26'151, mlcod=26'146)", 2024-04-18T14:43:49.373 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-04-18T14:43:23.029545+0000", 2024-04-18T14:43:49.373 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 26.271448745000001, 2024-04-18T14:43:49.373 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0060327799999999997, 2024-04-18T14:43:49.373 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-04-18T14:43:49.373 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T14:43:49.373 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-04-18T14:43:49.373 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:49.373 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-04-18T14:43:49.374 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:23.029545+0000", 2024-04-18T14:43:49.374 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:43:49.374 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:49.374 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:49.374 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-04-18T14:43:49.374 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:23.029545+0000", 2024-04-18T14:43:49.374 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:43:49.374 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:49.375 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:49.375 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-04-18T14:43:49.375 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:23.029544+0000", 2024-04-18T14:43:49.375 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-04-18T14:43:49.375 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:49.375 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:49.376 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-04-18T14:43:49.376 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:23.029552+0000", 2024-04-18T14:43:49.376 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.5490000000000001e-06 2024-04-18T14:43:49.376 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:49.376 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:49.376 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-04-18T14:43:49.376 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:23.029567+0000", 2024-04-18T14:43:49.376 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.5211999999999999e-05 2024-04-18T14:43:49.376 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:49.377 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:49.377 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-04-18T14:43:49.377 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:23.029575+0000", 2024-04-18T14:43:49.377 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.1110000000000008e-06 2024-04-18T14:43:49.377 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:49.377 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:49.377 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-04-18T14:43:49.377 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:23.029616+0000", 2024-04-18T14:43:49.377 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.0756000000000001e-05 2024-04-18T14:43:49.377 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:49.377 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:49.378 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-04-18T14:43:49.378 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:23.029635+0000", 2024-04-18T14:43:49.378 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.9012e-05 2024-04-18T14:43:49.378 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:49.378 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:49.378 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-04-18T14:43:49.378 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:23.035542+0000", 2024-04-18T14:43:49.378 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0059065130000000004 2024-04-18T14:43:49.378 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:49.378 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:49.378 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-04-18T14:43:49.379 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:23.035578+0000", 2024-04-18T14:43:49.379 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.6477999999999999e-05 2024-04-18T14:43:49.379 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:43:49.379 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-04-18T14:43:49.379 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:43:49.379 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:49.380 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:49.380 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(client.4212.0:206 1.0 e26/24 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 26'152, mlcod=26'146)", 2024-04-18T14:43:49.380 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-04-18T14:43:23.030575+0000", 2024-04-18T14:43:49.380 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 26.270419362999998, 2024-04-18T14:43:49.380 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0050234140000000004, 2024-04-18T14:43:49.380 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-04-18T14:43:49.381 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T14:43:49.381 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-04-18T14:43:49.381 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:49.381 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-04-18T14:43:49.381 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:23.030575+0000", 2024-04-18T14:43:49.381 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:43:49.381 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:49.381 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:49.381 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-04-18T14:43:49.381 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:23.030575+0000", 2024-04-18T14:43:49.381 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:43:49.381 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:49.381 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:49.382 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-04-18T14:43:49.382 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:23.030574+0000", 2024-04-18T14:43:49.382 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-04-18T14:43:49.382 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:49.382 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:49.382 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-04-18T14:43:49.382 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:23.030660+0000", 2024-04-18T14:43:49.382 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.5902000000000005e-05 2024-04-18T14:43:49.382 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:49.382 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:49.383 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-04-18T14:43:49.383 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:23.030677+0000", 2024-04-18T14:43:49.383 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.7079e-05 2024-04-18T14:43:49.383 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:49.383 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:49.383 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-04-18T14:43:49.383 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:23.030684+0000", 2024-04-18T14:43:49.383 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.5020000000000003e-06 2024-04-18T14:43:49.384 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:49.384 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:49.384 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-04-18T14:43:49.384 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:23.030736+0000", 2024-04-18T14:43:49.384 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.1526000000000001e-05 2024-04-18T14:43:49.385 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:49.385 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:49.385 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-04-18T14:43:49.385 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:23.030755+0000", 2024-04-18T14:43:49.385 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.895e-05 2024-04-18T14:43:49.385 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:49.385 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:49.385 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-04-18T14:43:49.385 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:23.035580+0000", 2024-04-18T14:43:49.385 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0048251880000000002 2024-04-18T14:43:49.385 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:49.386 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:49.386 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-04-18T14:43:49.386 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:23.035598+0000", 2024-04-18T14:43:49.386 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.8111e-05 2024-04-18T14:43:49.386 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:43:49.386 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-04-18T14:43:49.386 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:43:49.386 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:49.386 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:49.387 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(client.4212.0:210 1.0 e26/24 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 26'156, mlcod=26'154)", 2024-04-18T14:43:49.387 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-04-18T14:43:23.041625+0000", 2024-04-18T14:43:49.387 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 26.259369241000002, 2024-04-18T14:43:49.387 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0037965350000000002, 2024-04-18T14:43:49.387 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-04-18T14:43:49.387 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T14:43:49.387 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-04-18T14:43:49.387 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:49.387 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-04-18T14:43:49.387 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:23.041625+0000", 2024-04-18T14:43:49.388 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:43:49.388 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:49.388 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:49.388 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-04-18T14:43:49.388 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:23.041625+0000", 2024-04-18T14:43:49.388 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:43:49.389 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:49.389 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:49.389 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-04-18T14:43:49.389 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:23.041623+0000", 2024-04-18T14:43:49.389 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999981 2024-04-18T14:43:49.389 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:49.389 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:49.389 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-04-18T14:43:49.390 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:23.041636+0000", 2024-04-18T14:43:49.390 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.3478e-05 2024-04-18T14:43:49.390 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:49.390 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:49.390 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-04-18T14:43:49.390 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:23.041657+0000", 2024-04-18T14:43:49.390 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.0327999999999999e-05 2024-04-18T14:43:49.390 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:49.390 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:49.390 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-04-18T14:43:49.391 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:23.041668+0000", 2024-04-18T14:43:49.391 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.1059e-05 2024-04-18T14:43:49.391 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:49.391 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:49.391 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-04-18T14:43:49.391 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:23.041761+0000", 2024-04-18T14:43:49.391 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.2857999999999998e-05 2024-04-18T14:43:49.391 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:49.391 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:49.391 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-04-18T14:43:49.391 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:23.041785+0000", 2024-04-18T14:43:49.391 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.3818000000000001e-05 2024-04-18T14:43:49.391 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:49.391 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:49.392 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-04-18T14:43:49.392 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:23.045366+0000", 2024-04-18T14:43:49.392 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0035812919999999998 2024-04-18T14:43:49.392 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:49.392 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:49.392 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-04-18T14:43:49.393 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:23.045421+0000", 2024-04-18T14:43:49.393 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.5452999999999999e-05 2024-04-18T14:43:49.393 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:43:49.393 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-04-18T14:43:49.393 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:43:49.393 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:49.394 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:49.394 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "MOSDECSubOpWrite(3.8s2 41/30 ECSubWrite(tid=35, reqid=client.4559.0:250, at_version=41'18, trim_to=0'0, roll_forward_to=38'16))", 2024-04-18T14:43:49.394 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-04-18T14:43:40.763953+0000", 2024-04-18T14:43:49.394 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 8.5370413379999999, 2024-04-18T14:43:49.394 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0053911749999999998, 2024-04-18T14:43:49.394 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-04-18T14:43:49.394 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "reached pg", 2024-04-18T14:43:49.394 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-04-18T14:43:49.394 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:49.394 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-04-18T14:43:49.394 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:40.763953+0000", 2024-04-18T14:43:49.395 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:43:49.395 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:49.395 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:49.395 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-04-18T14:43:49.395 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:40.763953+0000", 2024-04-18T14:43:49.395 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:43:49.395 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:49.395 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:49.395 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-04-18T14:43:49.395 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:40.763952+0000", 2024-04-18T14:43:49.395 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-04-18T14:43:49.396 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:49.396 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:49.396 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-04-18T14:43:49.396 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:40.764008+0000", 2024-04-18T14:43:49.396 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.6538e-05 2024-04-18T14:43:49.396 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:49.396 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:49.396 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-04-18T14:43:49.396 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:40.764051+0000", 2024-04-18T14:43:49.396 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.2534999999999998e-05 2024-04-18T14:43:49.396 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:49.396 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:49.396 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-04-18T14:43:49.396 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:40.764074+0000", 2024-04-18T14:43:49.396 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.3292e-05 2024-04-18T14:43:49.396 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:49.397 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:49.397 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-04-18T14:43:49.397 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:40.764189+0000", 2024-04-18T14:43:49.397 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000114645 2024-04-18T14:43:49.397 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:49.397 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:49.397 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_started", 2024-04-18T14:43:49.397 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:40.764211+0000", 2024-04-18T14:43:49.397 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.2558999999999999e-05 2024-04-18T14:43:49.397 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:49.397 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:49.397 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_committed", 2024-04-18T14:43:49.397 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:40.769315+0000", 2024-04-18T14:43:49.397 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0051034740000000002 2024-04-18T14:43:49.397 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:49.397 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:49.398 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-04-18T14:43:49.398 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:40.769344+0000", 2024-04-18T14:43:49.398 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.8886000000000001e-05 2024-04-18T14:43:49.398 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:43:49.398 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-04-18T14:43:49.398 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:43:49.398 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:49.398 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:49.398 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "MOSDECSubOpWrite(3.es5 45/30 ECSubWrite(tid=21, reqid=client.4559.0:306, at_version=45'13, trim_to=0'0, roll_forward_to=44'11))", 2024-04-18T14:43:49.398 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-04-18T14:43:44.506553+0000", 2024-04-18T14:43:49.398 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 4.7944411259999997, 2024-04-18T14:43:49.398 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0046027179999999996, 2024-04-18T14:43:49.398 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-04-18T14:43:49.398 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "reached pg", 2024-04-18T14:43:49.398 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-04-18T14:43:49.398 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:49.399 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-04-18T14:43:49.399 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:44.506553+0000", 2024-04-18T14:43:49.399 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:43:49.399 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:49.399 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:49.399 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-04-18T14:43:49.399 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:44.506553+0000", 2024-04-18T14:43:49.399 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:43:49.399 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:49.399 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:49.399 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-04-18T14:43:49.399 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:44.506552+0000", 2024-04-18T14:43:49.399 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-04-18T14:43:49.399 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:49.399 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:49.399 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-04-18T14:43:49.400 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:44.506714+0000", 2024-04-18T14:43:49.400 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00016213299999999999 2024-04-18T14:43:49.400 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:49.400 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:49.400 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-04-18T14:43:49.400 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:44.506732+0000", 2024-04-18T14:43:49.400 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.7274000000000001e-05 2024-04-18T14:43:49.400 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:49.400 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:49.400 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-04-18T14:43:49.400 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:44.506743+0000", 2024-04-18T14:43:49.400 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.0834e-05 2024-04-18T14:43:49.400 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:49.400 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:49.400 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-04-18T14:43:49.401 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:44.506815+0000", 2024-04-18T14:43:49.401 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.2082999999999994e-05 2024-04-18T14:43:49.401 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:49.401 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:49.401 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_started", 2024-04-18T14:43:49.401 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:44.506826+0000", 2024-04-18T14:43:49.401 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.097e-05 2024-04-18T14:43:49.401 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:49.401 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:49.401 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_committed", 2024-04-18T14:43:49.401 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:44.511114+0000", 2024-04-18T14:43:49.401 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0042886629999999999 2024-04-18T14:43:49.401 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:49.401 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:49.401 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-04-18T14:43:49.402 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:44.511156+0000", 2024-04-18T14:43:49.402 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.1291000000000002e-05 2024-04-18T14:43:49.402 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:43:49.402 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-04-18T14:43:49.402 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:43:49.402 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:49.402 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:49.402 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "MOSDECSubOpWrite(3.es5 45/30 ECSubWrite(tid=22, reqid=client.4559.0:307, at_version=45'14, trim_to=0'0, roll_forward_to=44'11))", 2024-04-18T14:43:49.402 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-04-18T14:43:44.512199+0000", 2024-04-18T14:43:49.402 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 4.7887948649999998, 2024-04-18T14:43:49.402 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0038508539999999999, 2024-04-18T14:43:49.402 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-04-18T14:43:49.402 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "reached pg", 2024-04-18T14:43:49.402 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-04-18T14:43:49.402 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:49.403 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-04-18T14:43:49.403 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:44.512199+0000", 2024-04-18T14:43:49.403 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:43:49.403 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:49.403 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:49.403 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-04-18T14:43:49.403 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:44.512199+0000", 2024-04-18T14:43:49.403 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:43:49.403 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:49.403 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:49.403 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-04-18T14:43:49.403 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:44.512198+0000", 2024-04-18T14:43:49.403 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-04-18T14:43:49.403 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:49.403 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:49.403 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-04-18T14:43:49.404 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:44.512256+0000", 2024-04-18T14:43:49.404 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.7787000000000001e-05 2024-04-18T14:43:49.404 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:49.404 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:49.404 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-04-18T14:43:49.404 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:44.512275+0000", 2024-04-18T14:43:49.404 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.8664e-05 2024-04-18T14:43:49.404 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:49.404 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:49.404 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-04-18T14:43:49.404 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:44.512285+0000", 2024-04-18T14:43:49.404 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.0271999999999999e-05 2024-04-18T14:43:49.404 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:49.404 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:49.404 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-04-18T14:43:49.405 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:44.512377+0000", 2024-04-18T14:43:49.405 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.2094000000000003e-05 2024-04-18T14:43:49.405 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:49.405 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:49.405 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_started", 2024-04-18T14:43:49.405 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:44.512390+0000", 2024-04-18T14:43:49.405 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.3416e-05 2024-04-18T14:43:49.405 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:49.405 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:49.405 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_committed", 2024-04-18T14:43:49.405 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:44.516022+0000", 2024-04-18T14:43:49.405 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0036316949999999999 2024-04-18T14:43:49.405 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:49.405 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:49.405 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-04-18T14:43:49.406 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:44.516050+0000", 2024-04-18T14:43:49.406 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.7983999999999998e-05 2024-04-18T14:43:49.406 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:43:49.406 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-04-18T14:43:49.406 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:43:49.406 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:43:49.406 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-04-18T14:43:49.406 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-04-18T14:43:49.407 INFO:teuthology.orchestra.run.smithi086.stdout:osd.6: {} 2024-04-18T14:43:49.408 INFO:teuthology.orchestra.run.smithi086.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-18T14:43:49.408 INFO:tasks.rados.rados.0.smithi134.stdout:145: done (6 left) 2024-04-18T14:43:49.408 INFO:tasks.rados.rados.0.smithi134.stdout:146: snap_create 2024-04-18T14:43:49.408 INFO:tasks.rados.rados.0.smithi134.stdout:140: expect (ObjNum 20 snap 0 seq_num 20) 2024-04-18T14:43:49.408 INFO:tasks.rados.rados.0.smithi134.stdout:143: finishing rollback tid 0 to smithi13430248-46 2024-04-18T14:43:49.408 INFO:tasks.rados.rados.0.smithi134.stdout:142: finishing rollback tid 0 to smithi13430248-34 2024-04-18T14:43:49.408 INFO:tasks.rados.rados.0.smithi134.stdout:143: finishing rollback tid 1 to smithi13430248-46 2024-04-18T14:43:49.408 INFO:tasks.rados.rados.0.smithi134.stdout:141: expect (ObjNum 60 snap 4 seq_num 60) 2024-04-18T14:43:49.409 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-04-18T14:43:49.409 INFO:teuthology.orchestra.run.smithi086.stdout:osd.7: {} 2024-04-18T14:43:49.410 INFO:teuthology.orchestra.run.smithi086.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-18T14:43:49.410 INFO:teuthology.orchestra.run.smithi086.stdout:osd.8: {} 2024-04-18T14:43:49.410 INFO:teuthology.orchestra.run.smithi086.stderr:osd.8: osd_enable_op_tracker = '' 2024-04-18T14:43:49.411 INFO:teuthology.orchestra.run.smithi086.stdout:osd.9: {} 2024-04-18T14:43:49.411 INFO:teuthology.orchestra.run.smithi086.stderr:osd.9: osd_enable_op_tracker = '' 2024-04-18T14:43:49.411 INFO:teuthology.orchestra.run.smithi086.stdout:osd.10: {} 2024-04-18T14:43:49.411 INFO:teuthology.orchestra.run.smithi086.stderr:osd.10: osd_enable_op_tracker = '' 2024-04-18T14:43:49.412 INFO:tasks.ceph.osd.8.smithi086.stderr:2024-04-18T14:43:49.407+0000 7f29f7b9d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 8 (PID: 24958) UID: 0 2024-04-18T14:43:49.412 INFO:teuthology.orchestra.run.smithi086.stdout:osd.11: {} 2024-04-18T14:43:49.412 INFO:teuthology.orchestra.run.smithi086.stderr:osd.11: osd_enable_op_tracker = '' 2024-04-18T14:43:49.427 INFO:teuthology.orchestra.run.smithi086.stdout:osd.12: {} 2024-04-18T14:43:49.427 INFO:teuthology.orchestra.run.smithi086.stderr:osd.12: osd_enable_op_tracker = '' 2024-04-18T14:43:49.447 INFO:teuthology.orchestra.run.smithi086.stdout:osd.13: {} 2024-04-18T14:43:49.447 INFO:teuthology.orchestra.run.smithi086.stderr:osd.13: osd_enable_op_tracker = '' 2024-04-18T14:43:49.467 INFO:teuthology.orchestra.run.smithi086.stdout:osd.14: {} 2024-04-18T14:43:49.467 INFO:teuthology.orchestra.run.smithi086.stderr:osd.14: osd_enable_op_tracker = '' 2024-04-18T14:43:49.487 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-18T14:43:49.487+0000 7f461e312640 0 -- 172.21.15.86:0/2999313915 >> [v2:172.21.15.134:6808/25223,v1:172.21.15.134:6812/25223] conn(0x7f4618221680 msgr2=0x7f4618223a70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-04-18T14:43:49.488 INFO:tasks.rados.rados.0.smithi134.stdout:142: finishing rollback tid 1 to smithi13430248-34 2024-04-18T14:43:49.488 INFO:tasks.rados.rados.0.smithi134.stdout:142: finishing rollback tid 2 to smithi13430248-34 2024-04-18T14:43:49.488 INFO:tasks.rados.rados.0.smithi134.stdout:update_object_version oid 34 v 9 (ObjNum 33 snap 0 seq_num 33) dirty exists 2024-04-18T14:43:49.488 INFO:tasks.rados.rados.0.smithi134.stdout:143: finishing rollback tid 2 to smithi13430248-46 2024-04-18T14:43:49.488 INFO:tasks.rados.rados.0.smithi134.stdout:update_object_version oid 46 v 29 (ObjNum 37 snap 0 seq_num 37) dirty exists 2024-04-18T14:43:49.488 INFO:tasks.rados.rados.0.smithi134.stdout:139: finishing write tid 1 to smithi13430248-4 2024-04-18T14:43:49.488 INFO:tasks.rados.rados.0.smithi134.stdout:139: finishing write tid 2 to smithi13430248-4 2024-04-18T14:43:49.488 INFO:tasks.rados.rados.0.smithi134.stdout:139: finishing write tid 3 to smithi13430248-4 2024-04-18T14:43:49.488 INFO:tasks.rados.rados.0.smithi134.stdout:139: finishing write tid 4 to smithi13430248-4 2024-04-18T14:43:49.488 INFO:tasks.rados.rados.0.smithi134.stdout:139: finishing write tid 5 to smithi13430248-4 2024-04-18T14:43:49.488 INFO:tasks.rados.rados.0.smithi134.stdout:139: oid 4 updating version 0 to 28 2024-04-18T14:43:49.488 INFO:tasks.rados.rados.0.smithi134.stdout:139: oid 4 version 28 is already newer than 26 2024-04-18T14:43:49.488 INFO:tasks.rados.rados.0.smithi134.stdout:139: oid 4 version 28 is already newer than 27 2024-04-18T14:43:49.488 INFO:tasks.rados.rados.0.smithi134.stdout:139: oid 4 version 28 is already newer than 25 2024-04-18T14:43:49.489 INFO:tasks.rados.rados.0.smithi134.stdout:update_object_version oid 4 v 28 (ObjNum 72 snap 12 seq_num 72) dirty exists 2024-04-18T14:43:49.489 INFO:tasks.rados.rados.0.smithi134.stdout:139: left oid 4 (ObjNum 72 snap 12 seq_num 72) 2024-04-18T14:43:49.489 INFO:tasks.rados.rados.0.smithi134.stdout:144: finishing copy_from racing read to smithi13430248-40 2024-04-18T14:43:49.489 INFO:tasks.rados.rados.0.smithi134.stdout:144: finishing copy_from to smithi13430248-40 2024-04-18T14:43:49.489 INFO:tasks.rados.rados.0.smithi134.stdout:update_object_version oid 40 v 5 (ObjNum 47 snap 0 seq_num 47) dirty exists 2024-04-18T14:43:49.491 INFO:teuthology.orchestra.run.smithi086.stdout:osd.15: {} 2024-04-18T14:43:49.508 INFO:tasks.ceph.osd.14.smithi119.stderr:2024-04-18T14:43:49.510+0000 7f180f599640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 14 (PID: 24900) UID: 0 2024-04-18T14:43:49.547 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-04-18T14:43:49.547 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [], 2024-04-18T14:43:49.547 INFO:teuthology.orchestra.run.smithi086.stdout: "num_ops": 0 2024-04-18T14:43:49.547 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-04-18T14:43:49.561 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-04-18T14:43:49.609 INFO:tasks.ceph.osd.14.smithi119.stderr:2024-04-18T14:43:49.610+0000 7f180f599640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 14 (PID: 24900) UID: 0 2024-04-18T14:43:49.711 INFO:tasks.ceph.osd.8.smithi086.stderr:2024-04-18T14:43:49.711+0000 7f29f7b9d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 8 (PID: 24958) UID: 0 2024-04-18T14:43:49.726 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-04-18T14:43:49.726 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [], 2024-04-18T14:43:49.726 INFO:teuthology.orchestra.run.smithi086.stdout: "complaint_time": 30, 2024-04-18T14:43:49.726 INFO:teuthology.orchestra.run.smithi086.stdout: "num_blocked_ops": 0 2024-04-18T14:43:49.726 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-04-18T14:43:49.740 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-04-18T14:43:49.812 INFO:tasks.ceph.osd.5.smithi096.stderr:2024-04-18T14:43:49.814+0000 7fc33f25b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 24889) UID: 0 2024-04-18T14:43:49.900 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-04-18T14:43:49.900 INFO:teuthology.orchestra.run.smithi086.stdout: "size": 20, 2024-04-18T14:43:49.900 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 600, 2024-04-18T14:43:49.900 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [ 2024-04-18T14:43:49.900 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:49.900 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "MOSDECSubOpWrite(3.bs2 37/30 ECSubWrite(tid=17, reqid=client.4559.0:185, at_version=0'0, trim_to=0'0, roll_forward_to=37'8))", 2024-04-18T14:43:49.901 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-04-18T14:43:36.733786+0000", 2024-04-18T14:43:49.901 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 13.166064207, 2024-04-18T14:43:49.901 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0030773710000000002, 2024-04-18T14:43:49.901 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-04-18T14:43:49.901 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "reached pg", 2024-04-18T14:43:49.901 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-04-18T14:43:49.901 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:49.901 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-04-18T14:43:49.901 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:36.733786+0000", 2024-04-18T14:43:49.901 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:43:49.901 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:49.901 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:49.901 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-04-18T14:43:49.901 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:36.733786+0000", 2024-04-18T14:43:49.901 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:43:49.902 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:49.902 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:49.902 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-04-18T14:43:49.902 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:36.733785+0000", 2024-04-18T14:43:49.902 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-04-18T14:43:49.902 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:49.902 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:49.902 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-04-18T14:43:49.902 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:36.733801+0000", 2024-04-18T14:43:49.902 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.6053e-05 2024-04-18T14:43:49.902 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:49.902 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:49.902 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-04-18T14:43:49.902 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:36.733814+0000", 2024-04-18T14:43:49.903 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.2843999999999999e-05 2024-04-18T14:43:49.903 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:49.903 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:49.903 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-04-18T14:43:49.903 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:36.733824+0000", 2024-04-18T14:43:49.903 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.0752e-05 2024-04-18T14:43:49.903 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:49.903 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:49.903 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-04-18T14:43:49.903 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:36.733900+0000", 2024-04-18T14:43:49.903 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.5709000000000003e-05 2024-04-18T14:43:49.903 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:49.903 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:49.903 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_started", 2024-04-18T14:43:49.903 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:36.733916+0000", 2024-04-18T14:43:49.904 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.6064000000000001e-05 2024-04-18T14:43:49.904 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:49.904 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:49.904 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_committed", 2024-04-18T14:43:49.904 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:36.736832+0000", 2024-04-18T14:43:49.904 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0029157110000000001 2024-04-18T14:43:49.904 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:49.904 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:49.904 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-04-18T14:43:49.904 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:36.736863+0000", 2024-04-18T14:43:49.904 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.1180000000000003e-05 2024-04-18T14:43:49.904 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:43:49.904 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-04-18T14:43:49.904 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:43:49.904 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:49.904 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:49.905 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "MOSDECSubOpWrite(3.7s3 41/30 ECSubWrite(tid=49, reqid=osd.14.0:49, at_version=41'17, trim_to=0'0, roll_forward_to=38'15))", 2024-04-18T14:43:49.905 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-04-18T14:43:40.758377+0000", 2024-04-18T14:43:49.905 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 9.1414729900000005, 2024-04-18T14:43:49.905 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0033455249999999998, 2024-04-18T14:43:49.905 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-04-18T14:43:49.905 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "reached pg", 2024-04-18T14:43:49.905 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-04-18T14:43:49.905 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:49.905 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-04-18T14:43:49.905 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:40.758377+0000", 2024-04-18T14:43:49.905 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:43:49.905 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:49.905 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:49.905 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-04-18T14:43:49.905 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:40.758377+0000", 2024-04-18T14:43:49.906 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:43:49.906 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:49.906 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:49.906 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-04-18T14:43:49.906 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:40.758376+0000", 2024-04-18T14:43:49.906 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-04-18T14:43:49.906 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:49.906 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:49.906 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-04-18T14:43:49.906 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:40.758425+0000", 2024-04-18T14:43:49.906 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.9208e-05 2024-04-18T14:43:49.906 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:49.906 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:49.906 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-04-18T14:43:49.906 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:40.758453+0000", 2024-04-18T14:43:49.907 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.7648999999999999e-05 2024-04-18T14:43:49.907 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:49.907 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:49.907 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-04-18T14:43:49.907 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:40.758475+0000", 2024-04-18T14:43:49.907 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.1849e-05 2024-04-18T14:43:49.907 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:49.907 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:49.907 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-04-18T14:43:49.907 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:40.758662+0000", 2024-04-18T14:43:49.907 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00018721499999999999 2024-04-18T14:43:49.907 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:49.907 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:49.907 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_started", 2024-04-18T14:43:49.907 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:40.758690+0000", 2024-04-18T14:43:49.908 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.7898999999999998e-05 2024-04-18T14:43:49.908 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:49.908 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:49.908 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_committed", 2024-04-18T14:43:49.908 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:40.761690+0000", 2024-04-18T14:43:49.908 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.003000211 2024-04-18T14:43:49.908 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:49.908 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:49.908 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-04-18T14:43:49.908 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:40.761722+0000", 2024-04-18T14:43:49.908 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.2233999999999997e-05 2024-04-18T14:43:49.908 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:43:49.908 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-04-18T14:43:49.908 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:43:49.908 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:49.909 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:49.909 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "MOSDECSubOpWrite(3.7s3 41/30 ECSubWrite(tid=50, reqid=osd.14.0:49, at_version=0'0, trim_to=0'0, roll_forward_to=41'17))", 2024-04-18T14:43:49.909 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-04-18T14:43:40.762947+0000", 2024-04-18T14:43:49.909 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 9.1369024220000004, 2024-04-18T14:43:49.909 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0096923070000000007, 2024-04-18T14:43:49.909 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-04-18T14:43:49.909 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "reached pg", 2024-04-18T14:43:49.909 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-04-18T14:43:49.909 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:49.909 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-04-18T14:43:49.909 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:40.762947+0000", 2024-04-18T14:43:49.909 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:43:49.909 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:49.909 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:49.909 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-04-18T14:43:49.910 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:40.762947+0000", 2024-04-18T14:43:49.910 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:43:49.910 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:49.910 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:49.910 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-04-18T14:43:49.910 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:40.762946+0000", 2024-04-18T14:43:49.910 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999986 2024-04-18T14:43:49.910 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:49.910 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:49.910 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-04-18T14:43:49.910 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:40.762974+0000", 2024-04-18T14:43:49.910 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.8242000000000002e-05 2024-04-18T14:43:49.910 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:49.910 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:49.911 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-04-18T14:43:49.911 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:40.763004+0000", 2024-04-18T14:43:49.911 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.9932000000000001e-05 2024-04-18T14:43:49.911 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:49.911 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:49.911 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-04-18T14:43:49.911 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:40.763027+0000", 2024-04-18T14:43:49.911 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.2526000000000001e-05 2024-04-18T14:43:49.911 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:49.911 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:49.911 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-04-18T14:43:49.911 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:40.763080+0000", 2024-04-18T14:43:49.911 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.3529000000000002e-05 2024-04-18T14:43:49.911 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:49.911 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:49.911 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_started", 2024-04-18T14:43:49.912 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:40.763090+0000", 2024-04-18T14:43:49.912 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.7249999999999992e-06 2024-04-18T14:43:49.912 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:49.912 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:49.912 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_committed", 2024-04-18T14:43:49.912 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:40.772540+0000", 2024-04-18T14:43:49.912 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0094502969999999999 2024-04-18T14:43:49.912 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:49.912 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:49.912 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-04-18T14:43:49.912 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:40.772640+0000", 2024-04-18T14:43:49.912 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.9636000000000006e-05 2024-04-18T14:43:49.912 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:43:49.912 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-04-18T14:43:49.912 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:43:49.913 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:49.913 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:49.913 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "MOSDECSubOpWrite(3.8s3 41/30 ECSubWrite(tid=35, reqid=client.4559.0:250, at_version=41'18, trim_to=0'0, roll_forward_to=38'16))", 2024-04-18T14:43:49.913 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-04-18T14:43:40.763913+0000", 2024-04-18T14:43:49.913 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 9.1359369770000001, 2024-04-18T14:43:49.913 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.011255968999999999, 2024-04-18T14:43:49.913 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-04-18T14:43:49.913 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "reached pg", 2024-04-18T14:43:49.913 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-04-18T14:43:49.913 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:49.913 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-04-18T14:43:49.913 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:40.763913+0000", 2024-04-18T14:43:49.913 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:43:49.913 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:49.913 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:49.914 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-04-18T14:43:49.914 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:40.763913+0000", 2024-04-18T14:43:49.914 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:43:49.914 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:49.914 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:49.914 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-04-18T14:43:49.914 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:40.763912+0000", 2024-04-18T14:43:49.914 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-04-18T14:43:49.914 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:49.914 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:49.914 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-04-18T14:43:49.914 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:40.763957+0000", 2024-04-18T14:43:49.914 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.4271999999999999e-05 2024-04-18T14:43:49.914 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:49.915 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:49.915 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-04-18T14:43:49.915 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:40.765627+0000", 2024-04-18T14:43:49.915 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.001670878 2024-04-18T14:43:49.915 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:49.915 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:49.915 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-04-18T14:43:49.915 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:40.765654+0000", 2024-04-18T14:43:49.915 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.6435999999999999e-05 2024-04-18T14:43:49.915 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:49.915 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:49.915 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-04-18T14:43:49.916 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:40.765722+0000", 2024-04-18T14:43:49.916 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.8376999999999999e-05 2024-04-18T14:43:49.916 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:49.916 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:49.916 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_started", 2024-04-18T14:43:49.916 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:40.765732+0000", 2024-04-18T14:43:49.916 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.4870000000000008e-06 2024-04-18T14:43:49.916 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:49.916 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:49.916 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_committed", 2024-04-18T14:43:49.916 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:40.775138+0000", 2024-04-18T14:43:49.916 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0094060670000000006 2024-04-18T14:43:49.916 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:49.916 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:49.916 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-04-18T14:43:49.917 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:40.775169+0000", 2024-04-18T14:43:49.917 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.1068999999999997e-05 2024-04-18T14:43:49.917 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:43:49.917 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-04-18T14:43:49.917 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:43:49.917 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:49.917 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:49.917 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "MOSDECSubOpWrite(3.cs4 41/30 ECSubWrite(tid=45, reqid=osd.11.0:45, at_version=41'22, trim_to=0'0, roll_forward_to=39'20))", 2024-04-18T14:43:49.917 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-04-18T14:43:40.764604+0000", 2024-04-18T14:43:49.917 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 9.1352454559999998, 2024-04-18T14:43:49.917 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0073682449999999998, 2024-04-18T14:43:49.917 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-04-18T14:43:49.917 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "reached pg", 2024-04-18T14:43:49.917 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-04-18T14:43:49.917 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:49.918 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-04-18T14:43:49.918 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:40.764604+0000", 2024-04-18T14:43:49.918 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:43:49.918 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:49.918 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:49.918 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-04-18T14:43:49.918 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:40.764604+0000", 2024-04-18T14:43:49.918 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:43:49.918 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:49.918 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:49.918 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-04-18T14:43:49.918 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:40.764604+0000", 2024-04-18T14:43:49.918 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-04-18T14:43:49.918 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:49.919 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:49.919 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-04-18T14:43:49.919 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:40.764673+0000", 2024-04-18T14:43:49.919 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.9608000000000002e-05 2024-04-18T14:43:49.919 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:49.919 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:49.919 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-04-18T14:43:49.919 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:40.764714+0000", 2024-04-18T14:43:49.919 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.0794999999999998e-05 2024-04-18T14:43:49.919 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:49.919 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:49.919 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-04-18T14:43:49.919 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:40.764738+0000", 2024-04-18T14:43:49.919 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.3881999999999999e-05 2024-04-18T14:43:49.919 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:49.920 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:49.920 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-04-18T14:43:49.920 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:40.764809+0000", 2024-04-18T14:43:49.920 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.1100999999999996e-05 2024-04-18T14:43:49.920 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:49.920 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:49.920 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_started", 2024-04-18T14:43:49.920 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:40.764818+0000", 2024-04-18T14:43:49.920 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.0739999999999999e-06 2024-04-18T14:43:49.920 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:49.920 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:49.920 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_committed", 2024-04-18T14:43:49.920 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:40.771915+0000", 2024-04-18T14:43:49.920 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0070967479999999999 2024-04-18T14:43:49.920 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:49.921 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:49.921 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-04-18T14:43:49.921 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:40.771973+0000", 2024-04-18T14:43:49.921 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.7821000000000001e-05 2024-04-18T14:43:49.921 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:43:49.921 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-04-18T14:43:49.921 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:43:49.921 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:49.921 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:49.921 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "MOSDECSubOpWrite(3.cs4 41/30 ECSubWrite(tid=46, reqid=osd.11.0:46, at_version=41'24, trim_to=0'0, roll_forward_to=39'20))", 2024-04-18T14:43:49.921 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-04-18T14:43:40.764769+0000", 2024-04-18T14:43:49.921 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 9.135080876, 2024-04-18T14:43:49.921 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0098445330000000008, 2024-04-18T14:43:49.921 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-04-18T14:43:49.921 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "reached pg", 2024-04-18T14:43:49.922 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-04-18T14:43:49.922 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:49.922 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-04-18T14:43:49.922 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:40.764769+0000", 2024-04-18T14:43:49.922 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:43:49.922 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:49.922 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:49.922 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-04-18T14:43:49.922 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:40.764769+0000", 2024-04-18T14:43:49.922 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:43:49.922 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:49.922 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:49.922 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-04-18T14:43:49.922 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:40.764768+0000", 2024-04-18T14:43:49.922 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-04-18T14:43:49.923 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:49.923 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:49.923 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-04-18T14:43:49.923 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:40.764809+0000", 2024-04-18T14:43:49.923 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.0917999999999997e-05 2024-04-18T14:43:49.923 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:49.923 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:49.923 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-04-18T14:43:49.923 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:40.764861+0000", 2024-04-18T14:43:49.923 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.2088e-05 2024-04-18T14:43:49.923 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:49.923 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:49.923 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-04-18T14:43:49.923 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:40.764881+0000", 2024-04-18T14:43:49.923 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.0372000000000001e-05 2024-04-18T14:43:49.923 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:49.924 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:49.924 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-04-18T14:43:49.924 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:40.765246+0000", 2024-04-18T14:43:49.924 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00036430499999999999 2024-04-18T14:43:49.924 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:49.924 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:49.924 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_started", 2024-04-18T14:43:49.924 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:40.765271+0000", 2024-04-18T14:43:49.924 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.5083e-05 2024-04-18T14:43:49.924 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:49.924 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:49.924 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_committed", 2024-04-18T14:43:49.924 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:40.774586+0000", 2024-04-18T14:43:49.924 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0093148369999999994 2024-04-18T14:43:49.925 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:49.925 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:49.925 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-04-18T14:43:49.925 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:40.774613+0000", 2024-04-18T14:43:49.925 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.7803000000000001e-05 2024-04-18T14:43:49.925 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:43:49.925 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-04-18T14:43:49.925 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:43:49.925 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:49.925 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:49.925 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "pg_update_log_missing(3.9s3 epoch 41/30 rep_tid 40 entries 41'25 (0'0) error 3:936e42fd:::smithi13430248-33:head by client.4559.0:247 0.000000 0 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 38'23)", 2024-04-18T14:43:49.925 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-04-18T14:43:40.769974+0000", 2024-04-18T14:43:49.925 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 9.1298762490000005, 2024-04-18T14:43:49.925 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0046830320000000002, 2024-04-18T14:43:49.925 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-04-18T14:43:49.926 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "reached pg", 2024-04-18T14:43:49.926 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-04-18T14:43:49.926 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:49.926 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-04-18T14:43:49.926 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:40.769974+0000", 2024-04-18T14:43:49.926 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:43:49.926 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:49.926 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:49.926 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-04-18T14:43:49.926 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:40.769974+0000", 2024-04-18T14:43:49.926 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:43:49.926 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:49.926 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:49.926 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-04-18T14:43:49.927 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:40.769973+0000", 2024-04-18T14:43:49.927 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-04-18T14:43:49.927 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:49.927 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:49.927 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-04-18T14:43:49.927 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:40.769989+0000", 2024-04-18T14:43:49.927 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.6113e-05 2024-04-18T14:43:49.927 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:49.927 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:49.927 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-04-18T14:43:49.927 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:40.770024+0000", 2024-04-18T14:43:49.927 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.4856e-05 2024-04-18T14:43:49.927 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:49.927 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:49.928 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-04-18T14:43:49.928 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:40.770052+0000", 2024-04-18T14:43:49.928 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.7996000000000001e-05 2024-04-18T14:43:49.928 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:49.928 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:49.928 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-04-18T14:43:49.928 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:40.770132+0000", 2024-04-18T14:43:49.928 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.9791999999999998e-05 2024-04-18T14:43:49.928 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:49.928 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:49.928 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-04-18T14:43:49.928 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:40.774657+0000", 2024-04-18T14:43:49.928 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0045247969999999997 2024-04-18T14:43:49.928 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:43:49.928 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-04-18T14:43:49.929 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:43:49.929 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:49.929 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:49.929 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "MOSDECSubOpWrite(3.9s3 41/30 ECSubWrite(tid=41, reqid=osd.12.0:41, at_version=41'27, trim_to=0'0, roll_forward_to=38'24))", 2024-04-18T14:43:49.929 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-04-18T14:43:40.770088+0000", 2024-04-18T14:43:49.929 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 9.1297620760000004, 2024-04-18T14:43:49.929 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0073282030000000001, 2024-04-18T14:43:49.929 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-04-18T14:43:49.929 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "reached pg", 2024-04-18T14:43:49.929 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-04-18T14:43:49.929 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:49.929 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-04-18T14:43:49.929 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:40.770088+0000", 2024-04-18T14:43:49.929 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:43:49.930 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:49.930 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:49.930 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-04-18T14:43:49.930 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:40.770088+0000", 2024-04-18T14:43:49.930 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:43:49.930 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:49.930 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:49.930 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-04-18T14:43:49.930 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:40.770087+0000", 2024-04-18T14:43:49.930 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-04-18T14:43:49.930 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:49.930 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:49.930 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-04-18T14:43:49.930 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:40.770161+0000", 2024-04-18T14:43:49.931 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.3917000000000004e-05 2024-04-18T14:43:49.931 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:49.931 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:49.931 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-04-18T14:43:49.931 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:40.770184+0000", 2024-04-18T14:43:49.931 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.3244e-05 2024-04-18T14:43:49.931 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:49.931 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:49.931 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-04-18T14:43:49.931 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:40.770202+0000", 2024-04-18T14:43:49.931 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.7997000000000001e-05 2024-04-18T14:43:49.931 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:49.931 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:49.931 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-04-18T14:43:49.931 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:40.770279+0000", 2024-04-18T14:43:49.932 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.7689999999999996e-05 2024-04-18T14:43:49.932 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:49.932 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:49.932 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_started", 2024-04-18T14:43:49.932 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:40.770288+0000", 2024-04-18T14:43:49.932 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.5609999999999999e-06 2024-04-18T14:43:49.932 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:49.932 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:49.932 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_committed", 2024-04-18T14:43:49.932 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:40.777381+0000", 2024-04-18T14:43:49.932 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0070933189999999998 2024-04-18T14:43:49.932 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:49.932 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:49.932 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-04-18T14:43:49.932 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:40.777416+0000", 2024-04-18T14:43:49.933 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.4649e-05 2024-04-18T14:43:49.933 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:43:49.933 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-04-18T14:43:49.933 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:43:49.933 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:49.933 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:49.933 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "MOSDECSubOpWrite(3.8s3 41/30 ECSubWrite(tid=36, reqid=osd.5.0:36, at_version=41'20, trim_to=0'0, roll_forward_to=38'16))", 2024-04-18T14:43:49.933 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-04-18T14:43:40.770246+0000", 2024-04-18T14:43:49.933 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 9.1296037680000008, 2024-04-18T14:43:49.933 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0072291999999999999, 2024-04-18T14:43:49.933 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-04-18T14:43:49.933 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "reached pg", 2024-04-18T14:43:49.933 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-04-18T14:43:49.933 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:49.933 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-04-18T14:43:49.934 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:40.770246+0000", 2024-04-18T14:43:49.934 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:43:49.934 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:49.934 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:49.934 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-04-18T14:43:49.934 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:40.770246+0000", 2024-04-18T14:43:49.934 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:43:49.934 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:49.934 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:49.934 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-04-18T14:43:49.934 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:40.770245+0000", 2024-04-18T14:43:49.934 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-04-18T14:43:49.934 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:49.934 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:49.935 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-04-18T14:43:49.935 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:40.770279+0000", 2024-04-18T14:43:49.935 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.3759e-05 2024-04-18T14:43:49.935 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:49.935 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:49.935 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-04-18T14:43:49.935 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:40.770298+0000", 2024-04-18T14:43:49.935 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.9048000000000001e-05 2024-04-18T14:43:49.935 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:49.935 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:49.935 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-04-18T14:43:49.935 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:40.770313+0000", 2024-04-18T14:43:49.935 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.4934e-05 2024-04-18T14:43:49.935 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:49.935 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:49.936 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-04-18T14:43:49.936 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:40.770695+0000", 2024-04-18T14:43:49.936 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00038176900000000001 2024-04-18T14:43:49.936 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:49.936 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:49.936 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_started", 2024-04-18T14:43:49.936 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:40.770719+0000", 2024-04-18T14:43:49.936 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.3992e-05 2024-04-18T14:43:49.936 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:49.936 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:49.936 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_committed", 2024-04-18T14:43:49.936 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:40.777426+0000", 2024-04-18T14:43:49.936 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0067069989999999999 2024-04-18T14:43:49.936 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:49.936 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:49.937 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-04-18T14:43:49.937 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:40.777475+0000", 2024-04-18T14:43:49.937 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.9713999999999999e-05 2024-04-18T14:43:49.937 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:43:49.937 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-04-18T14:43:49.937 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:43:49.937 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:49.937 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:49.937 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "MOSDECSubOpRead(3.8s3 41/30 ECSubRead(tid=37, to_read={3:1890b7c2:::smithi13430248-36:head=0,147456,0}, subchunks={3:1890b7c2:::smithi13430248-36:head=[0,1]}, attrs_to_read=))", 2024-04-18T14:43:49.937 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-04-18T14:43:40.770350+0000", 2024-04-18T14:43:49.937 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 9.1294995869999997, 2024-04-18T14:43:49.937 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0047603380000000002, 2024-04-18T14:43:49.937 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-04-18T14:43:49.937 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "reached pg", 2024-04-18T14:43:49.937 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-04-18T14:43:49.938 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:49.938 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-04-18T14:43:49.938 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:40.770350+0000", 2024-04-18T14:43:49.938 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:43:49.938 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:49.938 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:49.938 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-04-18T14:43:49.938 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:40.770350+0000", 2024-04-18T14:43:49.938 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:43:49.938 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:49.938 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:49.938 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-04-18T14:43:49.938 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:40.770350+0000", 2024-04-18T14:43:49.938 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-04-18T14:43:49.938 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:49.939 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:49.939 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-04-18T14:43:49.939 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:40.770361+0000", 2024-04-18T14:43:49.939 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.1979e-05 2024-04-18T14:43:49.939 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:49.939 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:49.939 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-04-18T14:43:49.939 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:40.770384+0000", 2024-04-18T14:43:49.939 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.2487999999999999e-05 2024-04-18T14:43:49.939 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:49.939 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:49.939 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-04-18T14:43:49.939 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:40.770404+0000", 2024-04-18T14:43:49.939 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.9568e-05 2024-04-18T14:43:49.939 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:49.940 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:49.940 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-04-18T14:43:49.940 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:40.773174+0000", 2024-04-18T14:43:49.940 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00277013 2024-04-18T14:43:49.940 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:49.940 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:49.940 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-04-18T14:43:49.940 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:40.775111+0000", 2024-04-18T14:43:49.940 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.001936901 2024-04-18T14:43:49.940 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:43:49.940 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-04-18T14:43:49.940 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:43:49.940 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:49.940 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:49.940 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "MOSDECSubOpWrite(3.8s3 41/30 ECSubWrite(tid=38, reqid=osd.5.0:36, at_version=0'0, trim_to=0'0, roll_forward_to=41'20))", 2024-04-18T14:43:49.941 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-04-18T14:43:40.778628+0000", 2024-04-18T14:43:49.941 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 9.1212220249999998, 2024-04-18T14:43:49.941 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0042091699999999999, 2024-04-18T14:43:49.941 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-04-18T14:43:49.941 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "reached pg", 2024-04-18T14:43:49.941 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-04-18T14:43:49.941 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:49.941 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-04-18T14:43:49.941 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:40.778628+0000", 2024-04-18T14:43:49.941 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:43:49.941 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:49.941 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:49.941 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-04-18T14:43:49.942 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:40.778628+0000", 2024-04-18T14:43:49.942 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:43:49.942 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:49.942 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:49.942 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-04-18T14:43:49.942 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:40.778621+0000", 2024-04-18T14:43:49.942 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999933 2024-04-18T14:43:49.942 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:49.942 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:49.942 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-04-18T14:43:49.942 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:40.778653+0000", 2024-04-18T14:43:49.942 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.1912999999999998e-05 2024-04-18T14:43:49.942 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:49.942 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:49.942 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-04-18T14:43:49.943 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:40.778680+0000", 2024-04-18T14:43:49.943 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.6730999999999999e-05 2024-04-18T14:43:49.943 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:49.943 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:49.943 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-04-18T14:43:49.943 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:40.778699+0000", 2024-04-18T14:43:49.943 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.9819000000000001e-05 2024-04-18T14:43:49.943 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:49.943 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:49.943 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-04-18T14:43:49.943 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:40.778822+0000", 2024-04-18T14:43:49.943 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000122531 2024-04-18T14:43:49.943 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:49.943 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:49.943 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_started", 2024-04-18T14:43:49.944 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:40.778841+0000", 2024-04-18T14:43:49.944 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.9151999999999999e-05 2024-04-18T14:43:49.944 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:49.944 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:49.944 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_committed", 2024-04-18T14:43:49.944 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:40.782765+0000", 2024-04-18T14:43:49.944 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0039238700000000003 2024-04-18T14:43:49.944 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:49.944 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:49.944 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-04-18T14:43:49.944 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:40.782837+0000", 2024-04-18T14:43:49.944 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.1996999999999995e-05 2024-04-18T14:43:49.944 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:43:49.944 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-04-18T14:43:49.945 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:43:49.945 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:49.945 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:49.945 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "MOSDECSubOpWrite(3.cs4 41/30 ECSubWrite(tid=47, reqid=osd.11.0:46, at_version=0'0, trim_to=0'0, roll_forward_to=41'24))", 2024-04-18T14:43:49.945 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-04-18T14:43:40.778754+0000", 2024-04-18T14:43:49.945 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 9.1210956890000006, 2024-04-18T14:43:49.945 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0040452040000000002, 2024-04-18T14:43:49.945 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-04-18T14:43:49.945 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "reached pg", 2024-04-18T14:43:49.945 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-04-18T14:43:49.945 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:49.945 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-04-18T14:43:49.945 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:40.778754+0000", 2024-04-18T14:43:49.945 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:43:49.946 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:49.946 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:49.946 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-04-18T14:43:49.946 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:40.778754+0000", 2024-04-18T14:43:49.946 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:43:49.946 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:49.946 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:49.946 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-04-18T14:43:49.946 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:40.778752+0000", 2024-04-18T14:43:49.946 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999981 2024-04-18T14:43:49.946 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:49.946 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:49.946 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-04-18T14:43:49.946 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:40.778809+0000", 2024-04-18T14:43:49.946 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.6743999999999997e-05 2024-04-18T14:43:49.947 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:49.947 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:49.947 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-04-18T14:43:49.947 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:40.778839+0000", 2024-04-18T14:43:49.947 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.0298999999999999e-05 2024-04-18T14:43:49.947 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:49.947 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:49.947 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-04-18T14:43:49.947 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:40.778861+0000", 2024-04-18T14:43:49.947 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.1616000000000001e-05 2024-04-18T14:43:49.947 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:49.947 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:49.947 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-04-18T14:43:49.947 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:40.778975+0000", 2024-04-18T14:43:49.947 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000113859 2024-04-18T14:43:49.948 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:49.948 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:49.948 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_started", 2024-04-18T14:43:49.948 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:40.778999+0000", 2024-04-18T14:43:49.948 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.4502e-05 2024-04-18T14:43:49.948 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:49.948 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:49.948 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_committed", 2024-04-18T14:43:49.948 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:40.782773+0000", 2024-04-18T14:43:49.948 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0037741599999999999 2024-04-18T14:43:49.948 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:49.948 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:49.948 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-04-18T14:43:49.948 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:40.782799+0000", 2024-04-18T14:43:49.949 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.5941000000000001e-05 2024-04-18T14:43:49.949 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:43:49.949 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-04-18T14:43:49.949 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:43:49.949 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:49.949 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:49.949 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "MOSDECSubOpWrite(3.7s3 41/30 ECSubWrite(tid=51, reqid=client.4559.0:242, at_version=41'19, trim_to=0'0, roll_forward_to=41'17))", 2024-04-18T14:43:49.949 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-04-18T14:43:40.782356+0000", 2024-04-18T14:43:49.949 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 9.1174936070000001, 2024-04-18T14:43:49.949 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0044232849999999999, 2024-04-18T14:43:49.949 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-04-18T14:43:49.949 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "reached pg", 2024-04-18T14:43:49.949 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-04-18T14:43:49.949 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:49.950 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-04-18T14:43:49.950 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:40.782356+0000", 2024-04-18T14:43:49.950 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:43:49.950 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:49.950 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:49.950 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-04-18T14:43:49.950 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:40.782356+0000", 2024-04-18T14:43:49.950 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:43:49.950 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:49.950 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:49.950 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-04-18T14:43:49.950 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:40.782355+0000", 2024-04-18T14:43:49.950 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999986 2024-04-18T14:43:49.950 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:49.951 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:49.951 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-04-18T14:43:49.951 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:40.783082+0000", 2024-04-18T14:43:49.951 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00072718800000000003 2024-04-18T14:43:49.951 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:49.951 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:49.951 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-04-18T14:43:49.951 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:40.783108+0000", 2024-04-18T14:43:49.951 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.5559e-05 2024-04-18T14:43:49.951 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:49.951 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:49.951 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-04-18T14:43:49.951 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:40.783126+0000", 2024-04-18T14:43:49.951 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.8689999999999999e-05 2024-04-18T14:43:49.951 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:49.951 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:49.952 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-04-18T14:43:49.952 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:40.783261+0000", 2024-04-18T14:43:49.952 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00013474799999999999 2024-04-18T14:43:49.952 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:49.952 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:49.952 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_started", 2024-04-18T14:43:49.952 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:40.783277+0000", 2024-04-18T14:43:49.952 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.5761999999999999e-05 2024-04-18T14:43:49.952 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:49.952 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:49.952 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_committed", 2024-04-18T14:43:49.952 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:40.786722+0000", 2024-04-18T14:43:49.952 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0034453280000000001 2024-04-18T14:43:49.952 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:49.953 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:49.953 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-04-18T14:43:49.953 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:40.786780+0000", 2024-04-18T14:43:49.953 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.7389999999999998e-05 2024-04-18T14:43:49.953 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:43:49.953 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-04-18T14:43:49.953 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:43:49.953 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:49.953 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:49.953 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "MOSDECSubOpWrite(3.fs2 41/30 ECSubWrite(tid=48, reqid=client.4559.0:248, at_version=41'6, trim_to=0'0, roll_forward_to=33'4))", 2024-04-18T14:43:49.953 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-04-18T14:43:40.784387+0000", 2024-04-18T14:43:49.953 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 9.1154624089999992, 2024-04-18T14:43:49.953 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0037665889999999999, 2024-04-18T14:43:49.953 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-04-18T14:43:49.954 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "reached pg", 2024-04-18T14:43:49.954 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-04-18T14:43:49.954 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:49.954 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-04-18T14:43:49.954 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:40.784387+0000", 2024-04-18T14:43:49.954 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:43:49.954 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:49.954 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:49.954 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-04-18T14:43:49.954 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:40.784387+0000", 2024-04-18T14:43:49.954 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:43:49.954 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:49.954 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:49.954 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-04-18T14:43:49.955 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:40.784386+0000", 2024-04-18T14:43:49.955 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999986 2024-04-18T14:43:49.955 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:49.955 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:49.955 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-04-18T14:43:49.955 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:40.784844+0000", 2024-04-18T14:43:49.955 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00045801099999999998 2024-04-18T14:43:49.955 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:49.955 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:49.955 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-04-18T14:43:49.955 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:40.784901+0000", 2024-04-18T14:43:49.955 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.6705e-05 2024-04-18T14:43:49.955 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:49.955 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:49.956 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-04-18T14:43:49.956 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:40.784929+0000", 2024-04-18T14:43:49.956 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.8334e-05 2024-04-18T14:43:49.956 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:49.956 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:49.956 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-04-18T14:43:49.956 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:40.785029+0000", 2024-04-18T14:43:49.956 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.9619999999999998e-05 2024-04-18T14:43:49.956 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:49.956 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:49.956 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_started", 2024-04-18T14:43:49.956 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:40.785053+0000", 2024-04-18T14:43:49.956 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.4572000000000001e-05 2024-04-18T14:43:49.956 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:49.957 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:49.957 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_committed", 2024-04-18T14:43:49.957 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:40.788104+0000", 2024-04-18T14:43:49.957 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0030502670000000002 2024-04-18T14:43:49.957 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:49.957 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:49.957 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-04-18T14:43:49.957 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:40.788154+0000", 2024-04-18T14:43:49.957 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.0275000000000002e-05 2024-04-18T14:43:49.957 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:43:49.957 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-04-18T14:43:49.957 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:43:49.957 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:49.957 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:49.957 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "MOSDECSubOpWrite(3.es2 45/30 ECSubWrite(tid=21, reqid=client.4559.0:306, at_version=45'13, trim_to=0'0, roll_forward_to=44'11))", 2024-04-18T14:43:49.958 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-04-18T14:43:44.506726+0000", 2024-04-18T14:43:49.958 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 5.3931241679999999, 2024-04-18T14:43:49.958 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0047354449999999996, 2024-04-18T14:43:49.958 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-04-18T14:43:49.958 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "reached pg", 2024-04-18T14:43:49.958 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-04-18T14:43:49.958 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:49.958 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-04-18T14:43:49.958 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:44.506726+0000", 2024-04-18T14:43:49.958 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:43:49.958 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:49.958 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:49.958 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-04-18T14:43:49.958 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:44.506726+0000", 2024-04-18T14:43:49.958 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:43:49.959 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:49.959 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:49.959 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-04-18T14:43:49.959 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:44.506725+0000", 2024-04-18T14:43:49.959 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-04-18T14:43:49.959 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:49.959 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:49.959 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-04-18T14:43:49.959 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:44.506952+0000", 2024-04-18T14:43:49.959 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00022749599999999999 2024-04-18T14:43:49.959 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:49.959 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:49.959 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-04-18T14:43:49.959 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:44.506971+0000", 2024-04-18T14:43:49.960 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.8549000000000001e-05 2024-04-18T14:43:49.960 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:49.960 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:49.960 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-04-18T14:43:49.960 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:44.506983+0000", 2024-04-18T14:43:49.960 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.1579999999999999e-05 2024-04-18T14:43:49.960 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:49.960 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:49.960 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-04-18T14:43:49.960 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:44.507106+0000", 2024-04-18T14:43:49.960 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00012304800000000001 2024-04-18T14:43:49.960 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:49.960 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:49.960 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_started", 2024-04-18T14:43:49.960 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:44.507115+0000", 2024-04-18T14:43:49.960 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.7880000000000001e-06 2024-04-18T14:43:49.961 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:49.961 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:49.961 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_committed", 2024-04-18T14:43:49.961 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:44.511433+0000", 2024-04-18T14:43:49.961 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0043175239999999997 2024-04-18T14:43:49.961 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:49.961 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:49.961 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-04-18T14:43:49.961 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:44.511461+0000", 2024-04-18T14:43:49.961 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.8215999999999999e-05 2024-04-18T14:43:49.961 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:43:49.961 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-04-18T14:43:49.961 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:43:49.961 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:49.962 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:49.962 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "MOSDECSubOpWrite(3.es2 45/30 ECSubWrite(tid=22, reqid=client.4559.0:307, at_version=45'14, trim_to=0'0, roll_forward_to=44'11))", 2024-04-18T14:43:49.962 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-04-18T14:43:44.512280+0000", 2024-04-18T14:43:49.962 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 5.3875693929999997, 2024-04-18T14:43:49.962 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0041586169999999999, 2024-04-18T14:43:49.962 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-04-18T14:43:49.962 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "reached pg", 2024-04-18T14:43:49.962 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-04-18T14:43:49.962 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:49.962 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-04-18T14:43:49.962 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:44.512280+0000", 2024-04-18T14:43:49.962 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:43:49.962 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:49.962 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:49.962 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-04-18T14:43:49.963 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:44.512280+0000", 2024-04-18T14:43:49.963 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:43:49.963 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:49.963 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:49.963 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-04-18T14:43:49.963 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:44.512279+0000", 2024-04-18T14:43:49.963 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999986 2024-04-18T14:43:49.963 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:49.963 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:49.963 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-04-18T14:43:49.963 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:44.512356+0000", 2024-04-18T14:43:49.963 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.7235000000000002e-05 2024-04-18T14:43:49.963 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:49.963 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:49.963 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-04-18T14:43:49.964 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:44.512391+0000", 2024-04-18T14:43:49.964 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.4269e-05 2024-04-18T14:43:49.964 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:49.964 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:49.964 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-04-18T14:43:49.964 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:44.512402+0000", 2024-04-18T14:43:49.964 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.1425e-05 2024-04-18T14:43:49.964 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:49.964 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:49.964 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-04-18T14:43:49.964 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:44.512458+0000", 2024-04-18T14:43:49.964 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.6076999999999999e-05 2024-04-18T14:43:49.964 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:49.964 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:49.964 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_started", 2024-04-18T14:43:49.964 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:44.512468+0000", 2024-04-18T14:43:49.965 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.0295999999999999e-05 2024-04-18T14:43:49.965 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:49.965 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:49.965 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_committed", 2024-04-18T14:43:49.965 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:44.516412+0000", 2024-04-18T14:43:49.965 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0039440220000000002 2024-04-18T14:43:49.965 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:49.965 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:49.965 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-04-18T14:43:49.965 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:44.516439+0000", 2024-04-18T14:43:49.965 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.6727999999999999e-05 2024-04-18T14:43:49.965 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:43:49.965 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-04-18T14:43:49.965 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:43:49.965 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:49.966 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:49.966 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "MOSDECSubOpWrite(3.es2 45/30 ECSubWrite(tid=23, reqid=client.4559.0:308, at_version=45'15, trim_to=0'0, roll_forward_to=44'11))", 2024-04-18T14:43:49.966 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-04-18T14:43:44.513692+0000", 2024-04-18T14:43:49.966 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 5.3861579129999999, 2024-04-18T14:43:49.966 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.003890068, 2024-04-18T14:43:49.966 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-04-18T14:43:49.966 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "reached pg", 2024-04-18T14:43:49.966 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-04-18T14:43:49.966 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:49.966 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-04-18T14:43:49.966 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:44.513692+0000", 2024-04-18T14:43:49.966 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:43:49.966 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:49.966 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:49.967 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-04-18T14:43:49.967 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:44.513692+0000", 2024-04-18T14:43:49.967 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:43:49.967 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:49.967 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:49.967 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-04-18T14:43:49.967 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:44.513691+0000", 2024-04-18T14:43:49.967 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-04-18T14:43:49.967 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:49.967 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:49.967 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-04-18T14:43:49.967 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:44.513714+0000", 2024-04-18T14:43:49.967 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.3394e-05 2024-04-18T14:43:49.967 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:49.967 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:49.968 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-04-18T14:43:49.968 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:44.513732+0000", 2024-04-18T14:43:49.968 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.7844000000000001e-05 2024-04-18T14:43:49.968 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:49.968 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:49.968 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-04-18T14:43:49.968 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:44.513745+0000", 2024-04-18T14:43:49.968 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.3078000000000001e-05 2024-04-18T14:43:49.968 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:49.968 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:49.968 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-04-18T14:43:49.968 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:44.513798+0000", 2024-04-18T14:43:49.968 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.3046e-05 2024-04-18T14:43:49.968 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:49.968 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:49.969 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_started", 2024-04-18T14:43:49.969 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:44.513808+0000", 2024-04-18T14:43:49.969 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.8360000000000004e-06 2024-04-18T14:43:49.969 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:49.969 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:49.969 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_committed", 2024-04-18T14:43:49.969 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:44.517553+0000", 2024-04-18T14:43:49.969 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0037451749999999999 2024-04-18T14:43:49.969 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:49.969 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:49.969 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-04-18T14:43:49.969 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:44.517582+0000", 2024-04-18T14:43:49.969 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.8612999999999999e-05 2024-04-18T14:43:49.969 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:43:49.970 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-04-18T14:43:49.970 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:43:49.970 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:49.970 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:49.970 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "MOSDECSubOpWrite(3.9s3 46/30 ECSubWrite(tid=58, reqid=osd.12.0:58, at_version=46'44, trim_to=0'0, roll_forward_to=45'42))", 2024-04-18T14:43:49.970 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-04-18T14:43:45.384154+0000", 2024-04-18T14:43:49.970 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 4.5156961740000003, 2024-04-18T14:43:49.970 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0031414149999999998, 2024-04-18T14:43:49.970 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-04-18T14:43:49.970 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "reached pg", 2024-04-18T14:43:49.970 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-04-18T14:43:49.970 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:49.970 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-04-18T14:43:49.970 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:45.384154+0000", 2024-04-18T14:43:49.970 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:43:49.971 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:49.971 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:49.971 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-04-18T14:43:49.971 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:45.384154+0000", 2024-04-18T14:43:49.971 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:43:49.971 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:49.971 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:49.971 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-04-18T14:43:49.971 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:45.384153+0000", 2024-04-18T14:43:49.971 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-04-18T14:43:49.971 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:49.971 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:49.971 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-04-18T14:43:49.971 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:45.384183+0000", 2024-04-18T14:43:49.972 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.9961e-05 2024-04-18T14:43:49.972 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:49.972 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:49.972 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-04-18T14:43:49.972 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:45.384202+0000", 2024-04-18T14:43:49.972 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.8493000000000001e-05 2024-04-18T14:43:49.972 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:49.972 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:49.972 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-04-18T14:43:49.972 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:45.384215+0000", 2024-04-18T14:43:49.972 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.2841e-05 2024-04-18T14:43:49.972 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:49.972 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:49.972 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-04-18T14:43:49.972 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:45.384296+0000", 2024-04-18T14:43:49.973 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.1396999999999993e-05 2024-04-18T14:43:49.973 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:49.973 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:49.973 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_started", 2024-04-18T14:43:49.973 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:45.384310+0000", 2024-04-18T14:43:49.973 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.3749e-05 2024-04-18T14:43:49.973 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:49.973 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:49.973 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_committed", 2024-04-18T14:43:49.973 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:45.387253+0000", 2024-04-18T14:43:49.973 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0029429460000000001 2024-04-18T14:43:49.973 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:49.973 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:49.973 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-04-18T14:43:49.974 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:45.387295+0000", 2024-04-18T14:43:49.974 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.2372e-05 2024-04-18T14:43:49.974 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:43:49.974 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-04-18T14:43:49.974 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:43:49.974 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:49.974 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:49.974 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "MOSDECSubOpWrite(3.8s3 50/30 ECSubWrite(tid=63, reqid=osd.5.0:63, at_version=50'48, trim_to=0'0, roll_forward_to=48'46))", 2024-04-18T14:43:49.974 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-04-18T14:43:49.403838+0000", 2024-04-18T14:43:49.974 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 0.49601150599999999, 2024-04-18T14:43:49.974 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0035919459999999999, 2024-04-18T14:43:49.974 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-04-18T14:43:49.974 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "reached pg", 2024-04-18T14:43:49.974 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-04-18T14:43:49.975 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:49.975 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-04-18T14:43:49.975 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:49.403838+0000", 2024-04-18T14:43:49.975 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:43:49.975 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:49.975 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:49.975 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-04-18T14:43:49.975 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:49.403838+0000", 2024-04-18T14:43:49.975 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:43:49.975 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:49.975 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:49.975 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-04-18T14:43:49.975 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:49.403838+0000", 2024-04-18T14:43:49.975 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-04-18T14:43:49.975 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:49.976 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:49.976 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-04-18T14:43:49.976 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:49.403878+0000", 2024-04-18T14:43:49.976 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.9836999999999998e-05 2024-04-18T14:43:49.976 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:49.976 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:49.976 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-04-18T14:43:49.976 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:49.403891+0000", 2024-04-18T14:43:49.976 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.3166000000000001e-05 2024-04-18T14:43:49.976 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:49.976 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:49.976 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-04-18T14:43:49.976 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:49.403903+0000", 2024-04-18T14:43:49.976 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.2177999999999999e-05 2024-04-18T14:43:49.976 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:49.977 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:49.977 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-04-18T14:43:49.977 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:49.403954+0000", 2024-04-18T14:43:49.977 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.0933000000000002e-05 2024-04-18T14:43:49.977 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:49.977 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:49.977 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_started", 2024-04-18T14:43:49.977 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:49.403964+0000", 2024-04-18T14:43:49.977 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.6469999999999993e-06 2024-04-18T14:43:49.977 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:49.977 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:49.977 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_committed", 2024-04-18T14:43:49.977 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:49.407402+0000", 2024-04-18T14:43:49.977 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.003437804 2024-04-18T14:43:49.978 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:49.978 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:49.978 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-04-18T14:43:49.978 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:49.407430+0000", 2024-04-18T14:43:49.978 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.8694999999999999e-05 2024-04-18T14:43:49.978 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:43:49.978 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-04-18T14:43:49.978 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:43:49.978 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:49.978 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:49.978 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "MOSDECSubOpWrite(3.7s3 50/30 ECSubWrite(tid=84, reqid=osd.14.0:81, at_version=0'0, trim_to=0'0, roll_forward_to=50'31))", 2024-04-18T14:43:49.978 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-04-18T14:43:49.411295+0000", 2024-04-18T14:43:49.978 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 0.488554667, 2024-04-18T14:43:49.978 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0051775679999999996, 2024-04-18T14:43:49.978 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-04-18T14:43:49.979 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "reached pg", 2024-04-18T14:43:49.979 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-04-18T14:43:49.979 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:49.979 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-04-18T14:43:49.979 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:49.411295+0000", 2024-04-18T14:43:49.979 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:43:49.979 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:49.979 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:49.979 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-04-18T14:43:49.979 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:49.411295+0000", 2024-04-18T14:43:49.979 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:43:49.979 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:49.979 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:49.979 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-04-18T14:43:49.979 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:49.411294+0000", 2024-04-18T14:43:49.980 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-04-18T14:43:49.980 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:49.980 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:49.980 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-04-18T14:43:49.980 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:49.411309+0000", 2024-04-18T14:43:49.980 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.5058000000000001e-05 2024-04-18T14:43:49.980 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:49.980 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:49.980 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-04-18T14:43:49.980 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:49.411322+0000", 2024-04-18T14:43:49.980 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.2208999999999999e-05 2024-04-18T14:43:49.980 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:49.980 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:49.980 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-04-18T14:43:49.980 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:49.411329+0000", 2024-04-18T14:43:49.981 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.3139999999999998e-06 2024-04-18T14:43:49.981 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:49.981 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:49.981 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-04-18T14:43:49.981 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:49.411380+0000", 2024-04-18T14:43:49.981 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.0639000000000001e-05 2024-04-18T14:43:49.981 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:49.981 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:49.981 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_started", 2024-04-18T14:43:49.981 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:49.411390+0000", 2024-04-18T14:43:49.981 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.0584999999999999e-05 2024-04-18T14:43:49.981 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:49.981 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:49.981 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_committed", 2024-04-18T14:43:49.981 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:49.416441+0000", 2024-04-18T14:43:49.981 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0050509810000000004 2024-04-18T14:43:49.982 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:49.982 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:49.982 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-04-18T14:43:49.982 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:49.416473+0000", 2024-04-18T14:43:49.982 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.167e-05 2024-04-18T14:43:49.982 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:43:49.982 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-04-18T14:43:49.982 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:43:49.982 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:43:49.982 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-04-18T14:43:49.982 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-04-18T14:43:49.984 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.8.asok dump_ops_in_flight 2024-04-18T14:43:49.984 INFO:tasks.ceph.osd.9.smithi096.stderr:2024-04-18T14:43:49.982+0000 7fa2c1cbf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 9 (PID: 24891) UID: 0 2024-04-18T14:43:50.084 INFO:tasks.ceph.osd.8.smithi086.stderr:2024-04-18T14:43:50.083+0000 7f29f7b9d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 8 (PID: 24958) UID: 0 2024-04-18T14:43:50.112 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-04-18T14:43:50.112 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [], 2024-04-18T14:43:50.112 INFO:teuthology.orchestra.run.smithi086.stdout: "num_ops": 0 2024-04-18T14:43:50.112 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-04-18T14:43:50.126 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.8.asok dump_blocked_ops 2024-04-18T14:43:50.185 INFO:tasks.ceph.osd.9.smithi096.stderr:2024-04-18T14:43:50.182+0000 7fa2c1cbf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 9 (PID: 24891) UID: 0 2024-04-18T14:43:50.287 INFO:tasks.ceph.osd.11.smithi134.stderr:2024-04-18T14:43:50.288+0000 7f2d36f12640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 11 (PID: 25216) UID: 0 2024-04-18T14:43:50.287 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-04-18T14:43:50.287 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [], 2024-04-18T14:43:50.287 INFO:teuthology.orchestra.run.smithi086.stdout: "complaint_time": 30, 2024-04-18T14:43:50.288 INFO:teuthology.orchestra.run.smithi086.stdout: "num_blocked_ops": 0 2024-04-18T14:43:50.288 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-04-18T14:43:50.302 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.8.asok dump_historic_ops 2024-04-18T14:43:50.371 INFO:tasks.rados.rados.0.smithi134.stdout:139: done (6 left) 2024-04-18T14:43:50.371 INFO:tasks.rados.rados.0.smithi134.stdout:140: done (5 left) 2024-04-18T14:43:50.371 INFO:tasks.rados.rados.0.smithi134.stdout:141: done (4 left) 2024-04-18T14:43:50.371 INFO:tasks.rados.rados.0.smithi134.stdout:142: done (3 left) 2024-04-18T14:43:50.372 INFO:tasks.rados.rados.0.smithi134.stdout:143: done (2 left) 2024-04-18T14:43:50.372 INFO:tasks.rados.rados.0.smithi134.stdout:144: done (1 left) 2024-04-18T14:43:50.372 INFO:tasks.rados.rados.0.smithi134.stdout:146: done (0 left) 2024-04-18T14:43:50.372 INFO:tasks.rados.rados.0.smithi134.stdout:147: rollback oid 45 current snap is 13 2024-04-18T14:43:50.372 INFO:tasks.rados.rados.0.smithi134.stdout:rollback oid 45 to 12 2024-04-18T14:43:50.372 INFO:tasks.rados.rados.0.smithi134.stdout:148: rollback oid 11 current snap is 13 2024-04-18T14:43:50.372 INFO:tasks.rados.rados.0.smithi134.stdout:rollback oid 11 to 4 2024-04-18T14:43:50.372 INFO:tasks.rados.rados.0.smithi134.stdout:149: read oid 1 snap -1 2024-04-18T14:43:50.372 INFO:tasks.rados.rados.0.smithi134.stdout:149: expect (ObjNum 0 snap 0 seq_num 0) 2024-04-18T14:43:50.372 INFO:tasks.rados.rados.0.smithi134.stdout:150: read oid 46 snap -1 2024-04-18T14:43:50.372 INFO:tasks.rados.rados.0.smithi134.stdout:150: expect (ObjNum 37 snap 0 seq_num 37) 2024-04-18T14:43:50.372 INFO:tasks.rados.rados.0.smithi134.stdout:151: rmattr oid 22 current snap is 13 2024-04-18T14:43:50.372 INFO:tasks.rados.rados.0.smithi134.stdout:151: done (4 left) 2024-04-18T14:43:50.372 INFO:tasks.rados.rados.0.smithi134.stdout:152: copy_from oid 27 from oid 20 current snap is 13 2024-04-18T14:43:50.372 INFO:tasks.rados.rados.0.smithi134.stdout:153: read oid 9 snap -1 2024-04-18T14:43:50.373 INFO:tasks.rados.rados.0.smithi134.stdout:153: expect (ObjNum 54 snap 3 seq_num 54) 2024-04-18T14:43:50.373 INFO:tasks.rados.rados.0.smithi134.stdout:append oid 5 current snap is 13 2024-04-18T14:43:50.373 INFO:tasks.rados.rados.0.smithi134.stdout:154: seq_num 73 ranges {507904=458752,966656=475136,1441792=294912} 2024-04-18T14:43:50.388 INFO:tasks.ceph.osd.13.smithi096.stderr:2024-04-18T14:43:50.386+0000 7f7e72fad640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 13 (PID: 24893) UID: 0 2024-04-18T14:43:50.391 INFO:tasks.rados.rados.0.smithi134.stdout:154: writing smithi13430248-5 from 507904 to 966656 tid 1 2024-04-18T14:43:50.400 INFO:tasks.rados.rados.0.smithi134.stdout:154: writing smithi13430248-5 from 966656 to 1441792 tid 2 2024-04-18T14:43:50.405 INFO:tasks.rados.rados.0.smithi134.stdout:154: writing smithi13430248-5 from 1441792 to 1736704 tid 3 2024-04-18T14:43:50.405 INFO:tasks.rados.rados.0.smithi134.stdout:155: copy_from oid 43 from oid 26 current snap is 13 2024-04-18T14:43:50.405 INFO:tasks.rados.rados.0.smithi134.stdout:147: finishing rollback tid 0 to smithi13430248-45 2024-04-18T14:43:50.405 INFO:tasks.rados.rados.0.smithi134.stdout:147: finishing rollback tid 1 to smithi13430248-45 2024-04-18T14:43:50.406 INFO:tasks.rados.rados.0.smithi134.stdout:149: expect (ObjNum 0 snap 0 seq_num 0) 2024-04-18T14:43:50.410 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-04-18T14:43:50.411 INFO:tasks.rados.rados.0.smithi134.stdout:147: finishing rollback tid 2 to smithi13430248-45 2024-04-18T14:43:50.411 INFO:tasks.rados.rados.0.smithi134.stdout:update_object_version oid 45 v 38 (ObjNum 44 snap 0 seq_num 44) dirty exists 2024-04-18T14:43:50.411 INFO:tasks.rados.rados.0.smithi134.stdout:152: finishing copy_from to smithi13430248-27 2024-04-18T14:43:50.411 INFO:tasks.rados.rados.0.smithi134.stdout:152: got expected ENOENT (src dne) 2024-04-18T14:43:50.411 INFO:tasks.rados.rados.0.smithi134.stdout:147: done (7 left) 2024-04-18T14:43:50.411 INFO:tasks.rados.rados.0.smithi134.stdout:149: done (6 left) 2024-04-18T14:43:50.411 INFO:tasks.rados.rados.0.smithi134.stdout:156: read oid 8 snap -1 2024-04-18T14:43:50.411 INFO:tasks.rados.rados.0.smithi134.stdout:156: expect (ObjNum 65 snap 8 seq_num 65) 2024-04-18T14:43:50.411 INFO:tasks.rados.rados.0.smithi134.stdout:157: snap_create 2024-04-18T14:43:50.411 INFO:tasks.rados.rados.0.smithi134.stdout:148: finishing rollback tid 0 to smithi13430248-11 2024-04-18T14:43:50.411 INFO:tasks.rados.rados.0.smithi134.stdout:152: finishing copy_from racing read to smithi13430248-27 2024-04-18T14:43:50.411 INFO:tasks.rados.rados.0.smithi134.stdout:148: finishing rollback tid 1 to smithi13430248-11 2024-04-18T14:43:50.411 INFO:tasks.rados.rados.0.smithi134.stdout:update_object_version oid 11 v 28 (ObjNum 273 snap 0 seq_num 0) dirty dne 2024-04-18T14:43:50.412 INFO:tasks.rados.rados.0.smithi134.stdout:150: expect (ObjNum 37 snap 0 seq_num 37) 2024-04-18T14:43:50.430 INFO:tasks.rados.rados.0.smithi134.stdout:153: expect (ObjNum 54 snap 3 seq_num 54) 2024-04-18T14:43:50.438 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-04-18T14:43:50.438 INFO:teuthology.orchestra.run.smithi086.stdout: "size": 20, 2024-04-18T14:43:50.438 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 600, 2024-04-18T14:43:50.438 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [ 2024-04-18T14:43:50.438 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:50.438 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "MOSDECSubOpWrite(3.as4 36/30 ECSubWrite(tid=18, reqid=client.4559.0:178, at_version=36'12, trim_to=0'0, roll_forward_to=35'10))", 2024-04-18T14:43:50.439 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-04-18T14:43:35.737700+0000", 2024-04-18T14:43:50.439 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 14.701344957, 2024-04-18T14:43:50.439 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0019804879999999999, 2024-04-18T14:43:50.439 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-04-18T14:43:50.439 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "reached pg", 2024-04-18T14:43:50.439 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-04-18T14:43:50.439 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:50.439 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-04-18T14:43:50.439 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:35.737700+0000", 2024-04-18T14:43:50.439 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:43:50.439 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:50.439 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:50.439 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-04-18T14:43:50.439 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:35.737700+0000", 2024-04-18T14:43:50.439 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:43:50.440 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:50.440 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:50.440 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-04-18T14:43:50.440 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:35.737700+0000", 2024-04-18T14:43:50.440 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967296 2024-04-18T14:43:50.440 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:50.440 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:50.440 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-04-18T14:43:50.440 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:35.738094+0000", 2024-04-18T14:43:50.440 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00039394099999999997 2024-04-18T14:43:50.440 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:50.440 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:50.440 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-04-18T14:43:50.440 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:35.738111+0000", 2024-04-18T14:43:50.441 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.6375000000000002e-05 2024-04-18T14:43:50.441 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:50.441 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:50.441 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-04-18T14:43:50.441 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:35.738120+0000", 2024-04-18T14:43:50.441 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.7200000000000001e-06 2024-04-18T14:43:50.441 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:50.441 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:50.441 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-04-18T14:43:50.441 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:35.738187+0000", 2024-04-18T14:43:50.441 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.6396999999999995e-05 2024-04-18T14:43:50.441 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:50.441 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:50.441 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_started", 2024-04-18T14:43:50.441 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:35.738200+0000", 2024-04-18T14:43:50.442 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.3726999999999999e-05 2024-04-18T14:43:50.442 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:50.442 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:50.442 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_committed", 2024-04-18T14:43:50.442 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:35.739630+0000", 2024-04-18T14:43:50.442 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0014296770000000001 2024-04-18T14:43:50.442 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:50.442 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:50.442 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-04-18T14:43:50.442 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:35.739681+0000", 2024-04-18T14:43:50.442 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.0835999999999999e-05 2024-04-18T14:43:50.442 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:43:50.442 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-04-18T14:43:50.442 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:43:50.443 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:50.443 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:50.443 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "MOSDECSubOpWrite(3.as4 36/30 ECSubWrite(tid=19, reqid=client.4559.0:179, at_version=36'13, trim_to=0'0, roll_forward_to=35'10))", 2024-04-18T14:43:50.443 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-04-18T14:43:35.744028+0000", 2024-04-18T14:43:50.443 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 14.695017463999999, 2024-04-18T14:43:50.443 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0035996689999999998, 2024-04-18T14:43:50.443 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-04-18T14:43:50.443 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "reached pg", 2024-04-18T14:43:50.443 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-04-18T14:43:50.443 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:50.443 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-04-18T14:43:50.443 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:35.744028+0000", 2024-04-18T14:43:50.443 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:43:50.443 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:50.444 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:50.444 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-04-18T14:43:50.444 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:35.744028+0000", 2024-04-18T14:43:50.444 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:43:50.444 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:50.444 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:50.444 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-04-18T14:43:50.444 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:35.744027+0000", 2024-04-18T14:43:50.444 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999986 2024-04-18T14:43:50.444 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:50.444 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:50.444 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-04-18T14:43:50.444 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:35.744176+0000", 2024-04-18T14:43:50.444 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00014954899999999999 2024-04-18T14:43:50.445 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:50.445 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:50.445 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-04-18T14:43:50.445 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:35.744204+0000", 2024-04-18T14:43:50.445 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.7682999999999999e-05 2024-04-18T14:43:50.445 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:50.445 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:50.445 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-04-18T14:43:50.445 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:35.744218+0000", 2024-04-18T14:43:50.445 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.4602e-05 2024-04-18T14:43:50.445 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:50.445 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:50.445 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-04-18T14:43:50.445 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:35.744310+0000", 2024-04-18T14:43:50.445 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.1846000000000001e-05 2024-04-18T14:43:50.445 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:50.446 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:50.446 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_started", 2024-04-18T14:43:50.446 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:35.744332+0000", 2024-04-18T14:43:50.446 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.1605000000000001e-05 2024-04-18T14:43:50.446 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:50.446 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:50.446 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_committed", 2024-04-18T14:43:50.446 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:35.747597+0000", 2024-04-18T14:43:50.446 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.003265422 2024-04-18T14:43:50.446 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:50.446 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:50.446 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-04-18T14:43:50.446 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:35.747628+0000", 2024-04-18T14:43:50.446 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.0275000000000001e-05 2024-04-18T14:43:50.447 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:43:50.447 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-04-18T14:43:50.447 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:43:50.447 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:50.447 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:50.447 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "MOSDECSubOpWrite(3.as4 36/30 ECSubWrite(tid=20, reqid=client.4559.0:180, at_version=36'14, trim_to=0'0, roll_forward_to=35'10))", 2024-04-18T14:43:50.447 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-04-18T14:43:35.745292+0000", 2024-04-18T14:43:50.447 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 14.693752870000001, 2024-04-18T14:43:50.447 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0028120689999999999, 2024-04-18T14:43:50.447 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-04-18T14:43:50.447 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "reached pg", 2024-04-18T14:43:50.447 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-04-18T14:43:50.447 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:50.447 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-04-18T14:43:50.448 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:35.745292+0000", 2024-04-18T14:43:50.448 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:43:50.448 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:50.448 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:50.448 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-04-18T14:43:50.448 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:35.745292+0000", 2024-04-18T14:43:50.448 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:43:50.448 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:50.448 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:50.448 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-04-18T14:43:50.448 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:35.745291+0000", 2024-04-18T14:43:50.448 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999986 2024-04-18T14:43:50.448 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:50.448 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:50.448 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-04-18T14:43:50.448 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:35.745348+0000", 2024-04-18T14:43:50.449 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.6641999999999997e-05 2024-04-18T14:43:50.449 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:50.449 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:50.449 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-04-18T14:43:50.449 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:35.745371+0000", 2024-04-18T14:43:50.449 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.2694999999999999e-05 2024-04-18T14:43:50.449 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:50.449 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:50.449 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-04-18T14:43:50.449 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:35.745383+0000", 2024-04-18T14:43:50.449 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.2376e-05 2024-04-18T14:43:50.449 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:50.449 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:50.449 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-04-18T14:43:50.449 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:35.745453+0000", 2024-04-18T14:43:50.449 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.0473000000000001e-05 2024-04-18T14:43:50.450 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:50.450 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:50.450 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_started", 2024-04-18T14:43:50.450 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:35.745465+0000", 2024-04-18T14:43:50.450 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.1674999999999999e-05 2024-04-18T14:43:50.450 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:50.450 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:50.450 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_committed", 2024-04-18T14:43:50.450 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:35.748074+0000", 2024-04-18T14:43:50.450 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0026085380000000001 2024-04-18T14:43:50.450 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:50.450 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:50.450 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-04-18T14:43:50.450 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:35.748105+0000", 2024-04-18T14:43:50.450 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.0929999999999997e-05 2024-04-18T14:43:50.451 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:43:50.451 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-04-18T14:43:50.451 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:43:50.451 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:50.451 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:50.451 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "MOSDECSubOpWrite(3.7s1 37/30 ECSubWrite(tid=35, reqid=client.4559.0:183, at_version=37'11, trim_to=0'0, roll_forward_to=33'9))", 2024-04-18T14:43:50.451 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-04-18T14:43:36.747409+0000", 2024-04-18T14:43:50.451 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 13.691636076, 2024-04-18T14:43:50.451 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.002107874, 2024-04-18T14:43:50.451 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-04-18T14:43:50.451 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "reached pg", 2024-04-18T14:43:50.451 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-04-18T14:43:50.451 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:50.451 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-04-18T14:43:50.452 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:36.747409+0000", 2024-04-18T14:43:50.452 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:43:50.452 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:50.452 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:50.452 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-04-18T14:43:50.452 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:36.747409+0000", 2024-04-18T14:43:50.452 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:43:50.452 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:50.452 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:50.452 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-04-18T14:43:50.452 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:36.747409+0000", 2024-04-18T14:43:50.452 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967296 2024-04-18T14:43:50.452 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:50.452 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:50.452 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-04-18T14:43:50.453 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:36.747999+0000", 2024-04-18T14:43:50.453 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00058955100000000001 2024-04-18T14:43:50.453 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:50.453 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:50.453 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-04-18T14:43:50.453 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:36.748015+0000", 2024-04-18T14:43:50.453 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.6045999999999998e-05 2024-04-18T14:43:50.453 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:50.453 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:50.453 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-04-18T14:43:50.453 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:36.748026+0000", 2024-04-18T14:43:50.453 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.1103e-05 2024-04-18T14:43:50.453 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:50.453 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:50.454 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-04-18T14:43:50.454 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:36.748106+0000", 2024-04-18T14:43:50.454 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.9901999999999995e-05 2024-04-18T14:43:50.454 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:50.454 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:50.454 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_started", 2024-04-18T14:43:50.454 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:36.748122+0000", 2024-04-18T14:43:50.454 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.6392000000000002e-05 2024-04-18T14:43:50.454 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:50.454 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:50.454 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_committed", 2024-04-18T14:43:50.454 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:36.749491+0000", 2024-04-18T14:43:50.454 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0013690690000000001 2024-04-18T14:43:50.454 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:50.454 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:50.455 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-04-18T14:43:50.455 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:36.749517+0000", 2024-04-18T14:43:50.455 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.5982999999999998e-05 2024-04-18T14:43:50.455 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:43:50.455 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-04-18T14:43:50.455 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:43:50.455 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:50.455 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:50.455 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "MOSDECSubOpWrite(3.7s1 37/30 ECSubWrite(tid=42, reqid=client.4559.0:208, at_version=37'13, trim_to=0'0, roll_forward_to=37'11))", 2024-04-18T14:43:50.455 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-04-18T14:43:36.874839+0000", 2024-04-18T14:43:50.455 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 13.564206768, 2024-04-18T14:43:50.455 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0016246920000000001, 2024-04-18T14:43:50.455 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-04-18T14:43:50.455 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "reached pg", 2024-04-18T14:43:50.455 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-04-18T14:43:50.456 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:50.456 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-04-18T14:43:50.456 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:36.874839+0000", 2024-04-18T14:43:50.456 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:43:50.456 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:50.456 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:50.456 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-04-18T14:43:50.456 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:36.874839+0000", 2024-04-18T14:43:50.456 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:43:50.456 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:50.456 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:50.456 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-04-18T14:43:50.456 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:36.874838+0000", 2024-04-18T14:43:50.456 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-04-18T14:43:50.456 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:50.457 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:50.457 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-04-18T14:43:50.457 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:36.874988+0000", 2024-04-18T14:43:50.457 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000150001 2024-04-18T14:43:50.457 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:50.457 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:50.457 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-04-18T14:43:50.457 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:36.875004+0000", 2024-04-18T14:43:50.457 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.6674999999999999e-05 2024-04-18T14:43:50.457 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:50.457 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:50.457 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-04-18T14:43:50.457 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:36.875014+0000", 2024-04-18T14:43:50.457 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.0244000000000001e-05 2024-04-18T14:43:50.457 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:50.458 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:50.458 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-04-18T14:43:50.458 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:36.875103+0000", 2024-04-18T14:43:50.458 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.8803999999999999e-05 2024-04-18T14:43:50.458 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:50.458 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:50.458 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_started", 2024-04-18T14:43:50.458 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:36.875119+0000", 2024-04-18T14:43:50.458 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.5809999999999999e-05 2024-04-18T14:43:50.458 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:50.458 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:50.458 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_committed", 2024-04-18T14:43:50.458 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:36.876440+0000", 2024-04-18T14:43:50.458 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.001321044 2024-04-18T14:43:50.459 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:50.459 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:50.459 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-04-18T14:43:50.459 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:36.876463+0000", 2024-04-18T14:43:50.459 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.3124000000000001e-05 2024-04-18T14:43:50.459 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:43:50.459 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-04-18T14:43:50.459 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:43:50.459 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:50.459 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:50.459 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "MOSDECSubOpWrite(3.7s1 41/30 ECSubWrite(tid=49, reqid=osd.14.0:49, at_version=41'17, trim_to=0'0, roll_forward_to=38'15))", 2024-04-18T14:43:50.459 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-04-18T14:43:40.758295+0000", 2024-04-18T14:43:50.459 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 9.6807504929999997, 2024-04-18T14:43:50.459 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.001641673, 2024-04-18T14:43:50.459 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-04-18T14:43:50.460 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "reached pg", 2024-04-18T14:43:50.460 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-04-18T14:43:50.460 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:50.460 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-04-18T14:43:50.460 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:40.758295+0000", 2024-04-18T14:43:50.460 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:43:50.460 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:50.460 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:50.460 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-04-18T14:43:50.460 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:40.758295+0000", 2024-04-18T14:43:50.460 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:43:50.460 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:50.460 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:50.460 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-04-18T14:43:50.461 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:40.758294+0000", 2024-04-18T14:43:50.461 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-04-18T14:43:50.461 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:50.461 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:50.461 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-04-18T14:43:50.461 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:40.758358+0000", 2024-04-18T14:43:50.461 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.3434000000000003e-05 2024-04-18T14:43:50.461 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:50.461 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:50.461 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-04-18T14:43:50.461 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:40.758394+0000", 2024-04-18T14:43:50.461 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.6365000000000002e-05 2024-04-18T14:43:50.461 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:50.461 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:50.461 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-04-18T14:43:50.461 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:40.758418+0000", 2024-04-18T14:43:50.462 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.3635999999999999e-05 2024-04-18T14:43:50.462 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:50.462 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:50.462 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-04-18T14:43:50.462 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:40.758485+0000", 2024-04-18T14:43:50.462 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.6760000000000005e-05 2024-04-18T14:43:50.462 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:50.462 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:50.462 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_started", 2024-04-18T14:43:50.462 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:40.758496+0000", 2024-04-18T14:43:50.462 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.1671000000000001e-05 2024-04-18T14:43:50.462 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:50.462 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:50.462 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_committed", 2024-04-18T14:43:50.462 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:40.759873+0000", 2024-04-18T14:43:50.463 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.001376887 2024-04-18T14:43:50.463 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:50.463 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:50.463 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-04-18T14:43:50.463 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:40.759937+0000", 2024-04-18T14:43:50.463 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.3319999999999997e-05 2024-04-18T14:43:50.463 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:43:50.463 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-04-18T14:43:50.463 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:43:50.463 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:50.463 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:50.463 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "MOSDECSubOpWrite(3.7s1 41/30 ECSubWrite(tid=50, reqid=osd.14.0:49, at_version=0'0, trim_to=0'0, roll_forward_to=41'17))", 2024-04-18T14:43:50.463 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-04-18T14:43:40.763159+0000", 2024-04-18T14:43:50.463 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 9.6758861270000001, 2024-04-18T14:43:50.463 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0031478589999999998, 2024-04-18T14:43:50.464 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-04-18T14:43:50.464 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "reached pg", 2024-04-18T14:43:50.464 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-04-18T14:43:50.464 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:50.464 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-04-18T14:43:50.464 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:40.763159+0000", 2024-04-18T14:43:50.464 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:43:50.464 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:50.464 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:50.464 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-04-18T14:43:50.464 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:40.763159+0000", 2024-04-18T14:43:50.464 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:43:50.464 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:50.464 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:50.464 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-04-18T14:43:50.465 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:40.763157+0000", 2024-04-18T14:43:50.465 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999981 2024-04-18T14:43:50.465 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:50.465 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:50.465 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-04-18T14:43:50.465 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:40.763185+0000", 2024-04-18T14:43:50.465 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.7498999999999999e-05 2024-04-18T14:43:50.465 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:50.465 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:50.465 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-04-18T14:43:50.465 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:40.763217+0000", 2024-04-18T14:43:50.465 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.2048999999999998e-05 2024-04-18T14:43:50.465 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:50.465 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:50.466 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-04-18T14:43:50.466 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:40.763238+0000", 2024-04-18T14:43:50.466 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.1183e-05 2024-04-18T14:43:50.466 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:50.466 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:50.466 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-04-18T14:43:50.466 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:40.763540+0000", 2024-04-18T14:43:50.466 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00030200700000000002 2024-04-18T14:43:50.466 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:50.466 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:50.466 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_started", 2024-04-18T14:43:50.466 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:40.763568+0000", 2024-04-18T14:43:50.466 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.7345e-05 2024-04-18T14:43:50.466 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:50.466 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:50.467 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_committed", 2024-04-18T14:43:50.467 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:40.766234+0000", 2024-04-18T14:43:50.467 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0026666189999999998 2024-04-18T14:43:50.467 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:50.467 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:50.467 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-04-18T14:43:50.467 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:40.766307+0000", 2024-04-18T14:43:50.467 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.2906999999999998e-05 2024-04-18T14:43:50.467 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:43:50.467 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-04-18T14:43:50.467 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:43:50.467 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:50.467 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:50.467 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "MOSDECSubOpWrite(3.7s1 41/30 ECSubWrite(tid=51, reqid=client.4559.0:242, at_version=41'19, trim_to=0'0, roll_forward_to=41'17))", 2024-04-18T14:43:50.468 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-04-18T14:43:40.782525+0000", 2024-04-18T14:43:50.468 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 9.6565203949999994, 2024-04-18T14:43:50.468 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0036558799999999998, 2024-04-18T14:43:50.468 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-04-18T14:43:50.468 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "reached pg", 2024-04-18T14:43:50.468 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-04-18T14:43:50.468 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:50.468 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-04-18T14:43:50.468 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:40.782525+0000", 2024-04-18T14:43:50.468 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:43:50.468 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:50.468 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:50.468 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-04-18T14:43:50.468 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:40.782525+0000", 2024-04-18T14:43:50.468 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:43:50.469 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:50.469 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:50.469 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-04-18T14:43:50.469 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:40.782523+0000", 2024-04-18T14:43:50.469 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999981 2024-04-18T14:43:50.469 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:50.469 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:50.469 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-04-18T14:43:50.469 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:40.783074+0000", 2024-04-18T14:43:50.469 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00055112599999999998 2024-04-18T14:43:50.469 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:50.469 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:50.469 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-04-18T14:43:50.469 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:40.783105+0000", 2024-04-18T14:43:50.470 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.1358e-05 2024-04-18T14:43:50.470 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:50.470 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:50.470 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-04-18T14:43:50.470 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:40.783125+0000", 2024-04-18T14:43:50.470 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.929e-05 2024-04-18T14:43:50.470 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:50.470 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:50.470 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-04-18T14:43:50.470 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:40.783263+0000", 2024-04-18T14:43:50.470 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00013819900000000001 2024-04-18T14:43:50.470 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:50.470 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:50.470 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_started", 2024-04-18T14:43:50.471 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:40.783292+0000", 2024-04-18T14:43:50.471 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.9507999999999999e-05 2024-04-18T14:43:50.471 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:50.471 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:50.471 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_committed", 2024-04-18T14:43:50.471 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:40.786144+0000", 2024-04-18T14:43:50.471 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.002851283 2024-04-18T14:43:50.471 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:50.471 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:50.471 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-04-18T14:43:50.471 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:40.786181+0000", 2024-04-18T14:43:50.471 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.7058999999999999e-05 2024-04-18T14:43:50.471 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:43:50.471 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-04-18T14:43:50.471 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:43:50.472 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:50.472 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:50.472 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "MOSDECSubOpWrite(3.5s6 45/30 ECSubWrite(tid=11, reqid=client.4559.0:302, at_version=45'10, trim_to=0'0, roll_forward_to=44'8))", 2024-04-18T14:43:50.472 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-04-18T14:43:44.427467+0000", 2024-04-18T14:43:50.472 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 6.0115785930000003, 2024-04-18T14:43:50.472 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0025731629999999998, 2024-04-18T14:43:50.472 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-04-18T14:43:50.472 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "reached pg", 2024-04-18T14:43:50.472 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-04-18T14:43:50.472 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:50.472 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-04-18T14:43:50.472 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:44.427467+0000", 2024-04-18T14:43:50.472 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:43:50.472 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:50.472 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:50.472 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-04-18T14:43:50.473 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:44.427467+0000", 2024-04-18T14:43:50.473 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:43:50.473 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:50.473 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:50.473 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-04-18T14:43:50.473 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:44.427466+0000", 2024-04-18T14:43:50.473 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-04-18T14:43:50.473 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:50.473 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:50.473 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-04-18T14:43:50.473 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:44.427501+0000", 2024-04-18T14:43:50.473 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.4885000000000002e-05 2024-04-18T14:43:50.473 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:50.473 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:50.473 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-04-18T14:43:50.474 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:44.427529+0000", 2024-04-18T14:43:50.474 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.7478999999999999e-05 2024-04-18T14:43:50.474 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:50.474 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:50.474 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-04-18T14:43:50.474 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:44.427544+0000", 2024-04-18T14:43:50.474 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.5512999999999999e-05 2024-04-18T14:43:50.474 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:50.474 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:50.474 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-04-18T14:43:50.474 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:44.427605+0000", 2024-04-18T14:43:50.474 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.0708000000000002e-05 2024-04-18T14:43:50.474 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:50.474 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:50.474 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_started", 2024-04-18T14:43:50.475 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:44.427613+0000", 2024-04-18T14:43:50.475 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.1780000000000003e-06 2024-04-18T14:43:50.475 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:50.475 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:50.475 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_committed", 2024-04-18T14:43:50.475 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:44.430006+0000", 2024-04-18T14:43:50.475 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0023928650000000001 2024-04-18T14:43:50.475 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:50.475 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:50.475 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-04-18T14:43:50.475 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:44.430040+0000", 2024-04-18T14:43:50.475 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.3924999999999998e-05 2024-04-18T14:43:50.475 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:43:50.475 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-04-18T14:43:50.475 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:43:50.476 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:50.476 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:50.476 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4559.0:306 3.es0 3:780bca72:::smithi13430248-6:head [append 0~770048] snapc d=[d,b,a,8,7,2] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-18T14:43:50.476 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-04-18T14:43:44.504007+0000", 2024-04-18T14:43:50.476 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 5.9350383600000001, 2024-04-18T14:43:50.476 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.011648129, 2024-04-18T14:43:50.476 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-04-18T14:43:50.476 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T14:43:50.476 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-04-18T14:43:50.476 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4559", 2024-04-18T14:43:50.476 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.134:0/3113589487", 2024-04-18T14:43:50.476 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 306 2024-04-18T14:43:50.476 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:50.476 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-04-18T14:43:50.476 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:50.477 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-04-18T14:43:50.477 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:44.504007+0000", 2024-04-18T14:43:50.477 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:43:50.477 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:50.477 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:50.477 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-04-18T14:43:50.477 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:44.504007+0000", 2024-04-18T14:43:50.477 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:43:50.477 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:50.477 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:50.477 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-04-18T14:43:50.477 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:44.504004+0000", 2024-04-18T14:43:50.477 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999967 2024-04-18T14:43:50.477 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:50.477 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:50.478 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-04-18T14:43:50.478 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:44.505037+0000", 2024-04-18T14:43:50.478 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0010331030000000001 2024-04-18T14:43:50.478 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:50.478 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:50.478 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-04-18T14:43:50.478 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:44.505057+0000", 2024-04-18T14:43:50.478 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.0579999999999999e-05 2024-04-18T14:43:50.478 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:50.478 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:50.478 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-04-18T14:43:50.478 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:44.505066+0000", 2024-04-18T14:43:50.478 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.4349999999999997e-06 2024-04-18T14:43:50.478 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:50.479 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:50.479 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-04-18T14:43:50.479 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:44.505117+0000", 2024-04-18T14:43:50.479 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.0782999999999998e-05 2024-04-18T14:43:50.479 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:50.479 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:50.479 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-04-18T14:43:50.479 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:44.505215+0000", 2024-04-18T14:43:50.479 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.8090000000000004e-05 2024-04-18T14:43:50.479 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:50.479 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:50.479 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_started", 2024-04-18T14:43:50.479 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:44.506696+0000", 2024-04-18T14:43:50.479 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0014812429999999999 2024-04-18T14:43:50.479 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:50.480 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:50.480 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_committed", 2024-04-18T14:43:50.480 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:44.512780+0000", 2024-04-18T14:43:50.480 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0060844430000000001 2024-04-18T14:43:50.480 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:50.480 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:50.481 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-04-18T14:43:50.481 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:44.515586+0000", 2024-04-18T14:43:50.481 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.002805896 2024-04-18T14:43:50.482 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:50.482 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:50.482 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-04-18T14:43:50.482 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:44.515655+0000", 2024-04-18T14:43:50.482 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.8749000000000002e-05 2024-04-18T14:43:50.482 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:43:50.482 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-04-18T14:43:50.482 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:43:50.482 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:50.482 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:50.482 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4559.0:307 3.es0 3:780bca72:::smithi13430248-6:head [append 0~376832] snapc d=[d,b,a,8,7,2] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-18T14:43:50.482 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-04-18T14:43:44.510926+0000", 2024-04-18T14:43:50.482 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 5.9281195709999999, 2024-04-18T14:43:50.482 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.005843755, 2024-04-18T14:43:50.482 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-04-18T14:43:50.483 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T14:43:50.483 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-04-18T14:43:50.483 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4559", 2024-04-18T14:43:50.483 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.134:0/3113589487", 2024-04-18T14:43:50.483 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 307 2024-04-18T14:43:50.483 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:50.483 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-04-18T14:43:50.483 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:50.483 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-04-18T14:43:50.483 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:44.510926+0000", 2024-04-18T14:43:50.483 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:43:50.483 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:50.483 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:50.483 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-04-18T14:43:50.484 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:44.510926+0000", 2024-04-18T14:43:50.484 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:43:50.484 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:50.484 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:50.484 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-04-18T14:43:50.484 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:44.510924+0000", 2024-04-18T14:43:50.484 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999981 2024-04-18T14:43:50.484 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:50.484 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:50.484 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-04-18T14:43:50.484 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:44.511403+0000", 2024-04-18T14:43:50.484 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00047906199999999999 2024-04-18T14:43:50.484 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:50.484 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:50.484 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-04-18T14:43:50.485 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:44.511418+0000", 2024-04-18T14:43:50.485 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.4674999999999999e-05 2024-04-18T14:43:50.485 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:50.485 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:50.485 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-04-18T14:43:50.485 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:44.511428+0000", 2024-04-18T14:43:50.485 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.0411000000000001e-05 2024-04-18T14:43:50.485 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:50.485 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:50.485 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-04-18T14:43:50.485 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:44.511538+0000", 2024-04-18T14:43:50.485 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000109796 2024-04-18T14:43:50.485 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:50.485 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:50.485 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-04-18T14:43:50.485 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:44.511623+0000", 2024-04-18T14:43:50.486 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.5395999999999994e-05 2024-04-18T14:43:50.486 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:50.486 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:50.486 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_started", 2024-04-18T14:43:50.486 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:44.512194+0000", 2024-04-18T14:43:50.486 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00057113200000000002 2024-04-18T14:43:50.486 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:50.486 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:50.486 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_committed", 2024-04-18T14:43:50.486 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:44.515727+0000", 2024-04-18T14:43:50.486 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0035322999999999999 2024-04-18T14:43:50.486 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:50.486 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:50.486 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-04-18T14:43:50.486 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:44.516704+0000", 2024-04-18T14:43:50.487 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00097737400000000004 2024-04-18T14:43:50.487 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:50.487 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:50.487 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-04-18T14:43:50.487 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:44.516770+0000", 2024-04-18T14:43:50.487 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.5433999999999997e-05 2024-04-18T14:43:50.487 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:43:50.487 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-04-18T14:43:50.487 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:43:50.487 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:50.487 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:50.487 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4559.0:308 3.es0 3:780bca72:::smithi13430248-6:head [setxattr _header (55) in=7b] snapc d=[d,b,a,8,7,2] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-18T14:43:50.487 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-04-18T14:43:44.511486+0000", 2024-04-18T14:43:50.487 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 5.9275592379999997, 2024-04-18T14:43:50.487 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0064367519999999996, 2024-04-18T14:43:50.488 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-04-18T14:43:50.488 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T14:43:50.488 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-04-18T14:43:50.488 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4559", 2024-04-18T14:43:50.488 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.134:0/3113589487", 2024-04-18T14:43:50.488 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 308 2024-04-18T14:43:50.488 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:50.488 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-04-18T14:43:50.488 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:50.488 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-04-18T14:43:50.488 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:44.511486+0000", 2024-04-18T14:43:50.488 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:43:50.488 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:50.488 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:50.489 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-04-18T14:43:50.489 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:44.511486+0000", 2024-04-18T14:43:50.489 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:43:50.489 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:50.489 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:50.489 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-04-18T14:43:50.489 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:44.511485+0000", 2024-04-18T14:43:50.489 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-04-18T14:43:50.489 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:50.489 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:50.489 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-04-18T14:43:50.489 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:44.511492+0000", 2024-04-18T14:43:50.489 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.5760000000000002e-06 2024-04-18T14:43:50.489 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:50.489 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:50.489 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-04-18T14:43:50.490 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:44.511501+0000", 2024-04-18T14:43:50.490 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.1050000000000001e-06 2024-04-18T14:43:50.490 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:50.490 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:50.490 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-04-18T14:43:50.490 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:44.511508+0000", 2024-04-18T14:43:50.490 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.3799999999999996e-06 2024-04-18T14:43:50.490 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:50.490 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:50.490 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-04-18T14:43:50.490 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:44.512827+0000", 2024-04-18T14:43:50.490 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0013185060000000001 2024-04-18T14:43:50.490 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:50.490 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:50.490 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-04-18T14:43:50.491 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:44.512972+0000", 2024-04-18T14:43:50.491 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00014464299999999999 2024-04-18T14:43:50.491 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:50.491 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:50.491 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_started", 2024-04-18T14:43:50.491 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:44.513626+0000", 2024-04-18T14:43:50.491 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000654037 2024-04-18T14:43:50.491 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:50.491 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:50.491 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_committed", 2024-04-18T14:43:50.491 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:44.517315+0000", 2024-04-18T14:43:50.491 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0036897140000000002 2024-04-18T14:43:50.491 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:50.491 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:50.491 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-04-18T14:43:50.492 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:44.517814+0000", 2024-04-18T14:43:50.492 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00049903399999999998 2024-04-18T14:43:50.492 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:50.492 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:50.492 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-04-18T14:43:50.492 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:44.517923+0000", 2024-04-18T14:43:50.492 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00010855 2024-04-18T14:43:50.492 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:43:50.492 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-04-18T14:43:50.492 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:43:50.492 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:50.492 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:50.492 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "MOSDECSubOpWriteReply(3.es0 45/30 ECSubWriteReply(tid=21, last_complete=45'13, committed=1, applied=1))", 2024-04-18T14:43:50.492 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-04-18T14:43:44.511516+0000", 2024-04-18T14:43:50.493 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 5.9275290050000002, 2024-04-18T14:43:50.493 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0025087550000000001, 2024-04-18T14:43:50.493 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-04-18T14:43:50.493 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "reached pg", 2024-04-18T14:43:50.493 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-04-18T14:43:50.493 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:50.493 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-04-18T14:43:50.493 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:44.511516+0000", 2024-04-18T14:43:50.493 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:43:50.493 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:50.493 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:50.493 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-04-18T14:43:50.493 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:44.511516+0000", 2024-04-18T14:43:50.493 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:43:50.493 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:50.493 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:50.494 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-04-18T14:43:50.494 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:44.511515+0000", 2024-04-18T14:43:50.494 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-04-18T14:43:50.494 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:50.494 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:50.494 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-04-18T14:43:50.494 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:44.511523+0000", 2024-04-18T14:43:50.494 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.3189999999999997e-06 2024-04-18T14:43:50.494 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:50.494 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:50.494 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-04-18T14:43:50.494 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:44.511539+0000", 2024-04-18T14:43:50.494 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.5897e-05 2024-04-18T14:43:50.495 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:50.495 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:50.495 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-04-18T14:43:50.495 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:44.511549+0000", 2024-04-18T14:43:50.495 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.8870000000000004e-06 2024-04-18T14:43:50.495 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:50.495 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:50.495 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-04-18T14:43:50.495 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:44.514007+0000", 2024-04-18T14:43:50.495 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0024588499999999998 2024-04-18T14:43:50.495 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:50.495 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:50.495 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-04-18T14:43:50.495 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:44.514025+0000", 2024-04-18T14:43:50.495 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.7686e-05 2024-04-18T14:43:50.496 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:43:50.496 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-04-18T14:43:50.496 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:43:50.496 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:50.496 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:50.496 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4559.0:309 3.es0 3:780bca72:::smithi13430248-6:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e45)", 2024-04-18T14:43:50.496 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-04-18T14:43:44.511535+0000", 2024-04-18T14:43:50.496 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 5.9275106429999997, 2024-04-18T14:43:50.496 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0096989789999999999, 2024-04-18T14:43:50.496 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-04-18T14:43:50.496 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-04-18T14:43:50.496 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-04-18T14:43:50.496 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4559", 2024-04-18T14:43:50.496 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.134:0/3113589487", 2024-04-18T14:43:50.496 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 309 2024-04-18T14:43:50.496 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:50.497 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-04-18T14:43:50.497 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:50.497 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-04-18T14:43:50.497 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:44.511535+0000", 2024-04-18T14:43:50.497 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:43:50.497 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:50.497 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:50.497 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-04-18T14:43:50.497 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:44.511535+0000", 2024-04-18T14:43:50.497 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:43:50.497 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:50.497 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:50.497 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-04-18T14:43:50.497 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:44.511534+0000", 2024-04-18T14:43:50.498 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-04-18T14:43:50.498 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:50.498 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:50.498 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-04-18T14:43:50.498 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:44.511538+0000", 2024-04-18T14:43:50.498 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.72e-06 2024-04-18T14:43:50.498 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:50.498 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:50.498 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-04-18T14:43:50.498 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:44.511546+0000", 2024-04-18T14:43:50.498 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.7589999999999997e-06 2024-04-18T14:43:50.498 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:50.498 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:50.498 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-04-18T14:43:50.499 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:44.511549+0000", 2024-04-18T14:43:50.499 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.6720000000000002e-06 2024-04-18T14:43:50.499 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:50.499 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:50.499 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-04-18T14:43:50.499 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:44.514147+0000", 2024-04-18T14:43:50.499 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0025982100000000001 2024-04-18T14:43:50.499 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:50.499 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:50.499 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for rw locks", 2024-04-18T14:43:50.499 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:44.514218+0000", 2024-04-18T14:43:50.499 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.1007000000000006e-05 2024-04-18T14:43:50.499 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:50.499 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:50.499 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-04-18T14:43:50.500 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:44.518351+0000", 2024-04-18T14:43:50.500 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.004132241 2024-04-18T14:43:50.500 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:50.500 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:50.500 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-04-18T14:43:50.500 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:44.518432+0000", 2024-04-18T14:43:50.500 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.1116000000000001e-05 2024-04-18T14:43:50.500 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:50.500 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:50.500 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-04-18T14:43:50.500 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:44.521234+0000", 2024-04-18T14:43:50.500 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0028019400000000002 2024-04-18T14:43:50.500 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:43:50.500 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-04-18T14:43:50.500 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:43:50.500 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:50.500 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:50.501 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "MOSDECSubOpWriteReply(3.es0 45/30 ECSubWriteReply(tid=21, last_complete=45'13, committed=1, applied=1))", 2024-04-18T14:43:50.501 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-04-18T14:43:44.512519+0000", 2024-04-18T14:43:50.501 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 5.9265266990000001, 2024-04-18T14:43:50.501 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0015517949999999999, 2024-04-18T14:43:50.501 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-04-18T14:43:50.501 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "reached pg", 2024-04-18T14:43:50.501 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-04-18T14:43:50.501 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:50.501 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-04-18T14:43:50.501 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:44.512519+0000", 2024-04-18T14:43:50.501 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:43:50.501 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:50.501 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:50.501 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-04-18T14:43:50.502 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:44.512519+0000", 2024-04-18T14:43:50.502 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:43:50.502 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:50.502 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:50.502 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-04-18T14:43:50.502 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:44.512518+0000", 2024-04-18T14:43:50.502 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-04-18T14:43:50.502 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:50.502 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:50.502 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-04-18T14:43:50.502 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:44.512533+0000", 2024-04-18T14:43:50.502 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.5455e-05 2024-04-18T14:43:50.502 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:50.502 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:50.502 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-04-18T14:43:50.503 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:44.512551+0000", 2024-04-18T14:43:50.503 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.7416000000000001e-05 2024-04-18T14:43:50.503 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:50.503 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:50.503 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-04-18T14:43:50.503 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:44.512562+0000", 2024-04-18T14:43:50.503 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.1456e-05 2024-04-18T14:43:50.503 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:50.503 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:50.503 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-04-18T14:43:50.503 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:44.514059+0000", 2024-04-18T14:43:50.503 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0014969079999999999 2024-04-18T14:43:50.503 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:50.503 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:50.503 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-04-18T14:43:50.503 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:44.514070+0000", 2024-04-18T14:43:50.504 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.1388e-05 2024-04-18T14:43:50.504 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:43:50.504 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-04-18T14:43:50.504 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:43:50.504 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:50.504 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:50.504 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "MOSDECSubOpReadReply(3.es0 45/30 ECSubReadReply(tid=25, attrs_read=0))", 2024-04-18T14:43:50.504 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-04-18T14:43:44.518873+0000", 2024-04-18T14:43:50.504 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 5.9201718530000003, 2024-04-18T14:43:50.504 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0016556609999999999, 2024-04-18T14:43:50.504 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-04-18T14:43:50.504 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "reached pg", 2024-04-18T14:43:50.504 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-04-18T14:43:50.504 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:50.504 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-04-18T14:43:50.505 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:44.518873+0000", 2024-04-18T14:43:50.505 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:43:50.505 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:50.505 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:50.505 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-04-18T14:43:50.505 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:44.518873+0000", 2024-04-18T14:43:50.505 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:43:50.505 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:50.505 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:50.505 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-04-18T14:43:50.505 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:44.518873+0000", 2024-04-18T14:43:50.505 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-04-18T14:43:50.505 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:50.505 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:50.505 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-04-18T14:43:50.506 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:44.518897+0000", 2024-04-18T14:43:50.506 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.4159999999999999e-05 2024-04-18T14:43:50.506 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:50.506 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:50.506 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-04-18T14:43:50.506 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:44.518904+0000", 2024-04-18T14:43:50.506 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.1380000000000001e-06 2024-04-18T14:43:50.506 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:50.506 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:50.506 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-04-18T14:43:50.506 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:44.518909+0000", 2024-04-18T14:43:50.506 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.5850000000000001e-06 2024-04-18T14:43:50.506 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:50.506 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:50.506 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-04-18T14:43:50.507 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:44.520486+0000", 2024-04-18T14:43:50.507 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.001576926 2024-04-18T14:43:50.507 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:50.507 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:50.507 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-04-18T14:43:50.507 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:44.520529+0000", 2024-04-18T14:43:50.507 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.3544000000000002e-05 2024-04-18T14:43:50.507 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:43:50.507 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-04-18T14:43:50.507 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:43:50.507 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:50.507 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:50.507 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "MOSDECSubOpWriteReply(3.es0 45/30 ECSubWriteReply(tid=24, last_complete=45'15, committed=1, applied=1))", 2024-04-18T14:43:50.507 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-04-18T14:43:44.518912+0000", 2024-04-18T14:43:50.508 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 5.9201328950000001, 2024-04-18T14:43:50.508 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0016600180000000001, 2024-04-18T14:43:50.508 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-04-18T14:43:50.508 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "reached pg", 2024-04-18T14:43:50.508 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-04-18T14:43:50.508 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:50.508 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-04-18T14:43:50.508 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:44.518912+0000", 2024-04-18T14:43:50.508 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:43:50.508 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:50.508 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:50.508 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-04-18T14:43:50.508 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:44.518912+0000", 2024-04-18T14:43:50.508 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:43:50.508 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:50.509 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:50.509 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-04-18T14:43:50.509 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:44.518911+0000", 2024-04-18T14:43:50.509 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999986 2024-04-18T14:43:50.509 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:50.509 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:50.509 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-04-18T14:43:50.509 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:44.518921+0000", 2024-04-18T14:43:50.509 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.4669999999999993e-06 2024-04-18T14:43:50.509 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:50.509 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:50.509 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-04-18T14:43:50.509 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:44.518949+0000", 2024-04-18T14:43:50.509 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.7951999999999999e-05 2024-04-18T14:43:50.509 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:50.509 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:50.510 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-04-18T14:43:50.510 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:44.518973+0000", 2024-04-18T14:43:50.510 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.4266000000000001e-05 2024-04-18T14:43:50.510 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:50.510 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:50.510 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-04-18T14:43:50.510 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:44.520560+0000", 2024-04-18T14:43:50.510 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0015876130000000001 2024-04-18T14:43:50.510 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:50.510 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:50.510 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-04-18T14:43:50.510 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:44.520572+0000", 2024-04-18T14:43:50.510 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.2064e-05 2024-04-18T14:43:50.510 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:43:50.511 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-04-18T14:43:50.511 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:43:50.511 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:50.511 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:50.511 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "MOSDECSubOpWrite(3.5s6 47/30 ECSubWrite(tid=15, reqid=client.4559.0:326, at_version=47'13, trim_to=0'0, roll_forward_to=46'12))", 2024-04-18T14:43:50.511 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-04-18T14:43:46.393789+0000", 2024-04-18T14:43:50.511 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 4.0452562209999998, 2024-04-18T14:43:50.511 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0046310489999999999, 2024-04-18T14:43:50.511 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-04-18T14:43:50.511 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "reached pg", 2024-04-18T14:43:50.511 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-04-18T14:43:50.511 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:50.511 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-04-18T14:43:50.511 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:46.393789+0000", 2024-04-18T14:43:50.511 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:43:50.511 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:50.512 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:50.512 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-04-18T14:43:50.512 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:46.393789+0000", 2024-04-18T14:43:50.512 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:43:50.512 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:50.512 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:50.512 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-04-18T14:43:50.512 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:46.393789+0000", 2024-04-18T14:43:50.512 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-04-18T14:43:50.512 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:50.512 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:50.512 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-04-18T14:43:50.512 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:46.395549+0000", 2024-04-18T14:43:50.512 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.001760417 2024-04-18T14:43:50.512 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:50.513 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:50.513 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-04-18T14:43:50.513 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:46.395581+0000", 2024-04-18T14:43:50.513 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.2069000000000001e-05 2024-04-18T14:43:50.513 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:50.513 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:50.513 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-04-18T14:43:50.513 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:46.395601+0000", 2024-04-18T14:43:50.513 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.9619e-05 2024-04-18T14:43:50.513 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:50.513 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:50.513 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-04-18T14:43:50.513 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:46.395747+0000", 2024-04-18T14:43:50.513 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000146231 2024-04-18T14:43:50.513 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:50.514 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:50.514 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_started", 2024-04-18T14:43:50.514 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:46.395776+0000", 2024-04-18T14:43:50.514 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.9045999999999999e-05 2024-04-18T14:43:50.514 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:50.514 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:50.514 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_committed", 2024-04-18T14:43:50.514 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:46.398372+0000", 2024-04-18T14:43:50.514 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.002595918 2024-04-18T14:43:50.514 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:50.514 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:50.514 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-04-18T14:43:50.514 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:46.398420+0000", 2024-04-18T14:43:50.514 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.8145000000000001e-05 2024-04-18T14:43:50.514 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:43:50.514 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-04-18T14:43:50.515 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:43:50.515 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:50.515 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:50.515 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "MOSDECSubOpWrite(3.7s1 50/30 ECSubWrite(tid=81, reqid=osd.14.0:81, at_version=50'31, trim_to=0'0, roll_forward_to=49'29))", 2024-04-18T14:43:50.515 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-04-18T14:43:49.395055+0000", 2024-04-18T14:43:50.515 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 1.0439901570000001, 2024-04-18T14:43:50.515 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0020859260000000001, 2024-04-18T14:43:50.515 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-04-18T14:43:50.515 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "reached pg", 2024-04-18T14:43:50.515 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-04-18T14:43:50.515 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:50.515 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-04-18T14:43:50.515 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:49.395055+0000", 2024-04-18T14:43:50.515 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:43:50.516 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:50.516 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:50.516 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-04-18T14:43:50.516 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:49.395055+0000", 2024-04-18T14:43:50.516 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:43:50.516 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:50.516 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:50.516 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-04-18T14:43:50.516 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:49.395055+0000", 2024-04-18T14:43:50.516 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967296 2024-04-18T14:43:50.516 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:50.516 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:50.516 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-04-18T14:43:50.516 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:49.395087+0000", 2024-04-18T14:43:50.516 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.2230000000000001e-05 2024-04-18T14:43:50.516 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:50.517 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:50.517 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-04-18T14:43:50.517 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:49.395096+0000", 2024-04-18T14:43:50.517 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.901e-06 2024-04-18T14:43:50.517 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:50.517 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:50.517 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-04-18T14:43:50.517 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:49.395104+0000", 2024-04-18T14:43:50.517 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.8539999999999997e-06 2024-04-18T14:43:50.517 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:50.517 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:50.517 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-04-18T14:43:50.517 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:49.395163+0000", 2024-04-18T14:43:50.517 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.9138999999999997e-05 2024-04-18T14:43:50.517 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:50.518 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:50.518 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_started", 2024-04-18T14:43:50.518 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:49.395174+0000", 2024-04-18T14:43:50.518 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.0519999999999999e-05 2024-04-18T14:43:50.518 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:50.518 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:50.518 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_committed", 2024-04-18T14:43:50.518 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:49.397094+0000", 2024-04-18T14:43:50.518 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00192037 2024-04-18T14:43:50.518 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:50.518 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:50.518 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-04-18T14:43:50.518 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:49.397141+0000", 2024-04-18T14:43:50.518 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.7138000000000002e-05 2024-04-18T14:43:50.518 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:43:50.519 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-04-18T14:43:50.519 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:43:50.519 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:50.519 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:50.519 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "MOSDECSubOpWrite(3.7s1 50/30 ECSubWrite(tid=84, reqid=osd.14.0:81, at_version=0'0, trim_to=0'0, roll_forward_to=50'31))", 2024-04-18T14:43:50.519 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-04-18T14:43:49.411599+0000", 2024-04-18T14:43:50.519 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 1.0274466980000001, 2024-04-18T14:43:50.519 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.007513924, 2024-04-18T14:43:50.519 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-04-18T14:43:50.519 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "reached pg", 2024-04-18T14:43:50.519 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-04-18T14:43:50.519 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:50.519 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-04-18T14:43:50.519 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:49.411599+0000", 2024-04-18T14:43:50.519 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:43:50.519 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:50.520 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:50.520 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-04-18T14:43:50.520 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:49.411599+0000", 2024-04-18T14:43:50.520 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:43:50.520 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:50.520 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:50.520 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-04-18T14:43:50.520 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:49.411598+0000", 2024-04-18T14:43:50.520 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-04-18T14:43:50.520 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:50.520 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:50.520 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-04-18T14:43:50.520 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:49.411613+0000", 2024-04-18T14:43:50.520 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.5648e-05 2024-04-18T14:43:50.520 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:50.520 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:50.521 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-04-18T14:43:50.521 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:49.411628+0000", 2024-04-18T14:43:50.521 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.4405e-05 2024-04-18T14:43:50.521 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:50.521 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:50.521 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-04-18T14:43:50.521 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:49.411635+0000", 2024-04-18T14:43:50.521 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.3950000000000003e-06 2024-04-18T14:43:50.521 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:50.521 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:50.521 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-04-18T14:43:50.521 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:49.411682+0000", 2024-04-18T14:43:50.521 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.7287000000000003e-05 2024-04-18T14:43:50.521 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:50.521 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:50.522 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_started", 2024-04-18T14:43:50.522 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:49.411691+0000", 2024-04-18T14:43:50.522 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.4500000000000004e-06 2024-04-18T14:43:50.522 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:50.522 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:50.522 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_committed", 2024-04-18T14:43:50.522 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:49.419080+0000", 2024-04-18T14:43:50.522 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0073891779999999997 2024-04-18T14:43:50.522 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:50.522 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:50.522 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-04-18T14:43:50.522 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:49.419113+0000", 2024-04-18T14:43:50.522 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.2601000000000002e-05 2024-04-18T14:43:50.522 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:43:50.522 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-04-18T14:43:50.522 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:43:50.523 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:43:50.523 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-04-18T14:43:50.523 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-04-18T14:43:50.524 INFO:tasks.rados.rados.0.smithi134.stdout:154: finishing write tid 1 to smithi13430248-5 2024-04-18T14:43:50.524 INFO:tasks.rados.rados.0.smithi134.stdout:154: finishing write tid 2 to smithi13430248-5 2024-04-18T14:43:50.524 INFO:tasks.rados.rados.0.smithi134.stdout:154: finishing write tid 3 to smithi13430248-5 2024-04-18T14:43:50.524 INFO:tasks.rados.rados.0.smithi134.stdout:154: finishing write tid 4 to smithi13430248-5 2024-04-18T14:43:50.524 INFO:tasks.rados.rados.0.smithi134.stdout:155: finishing copy_from racing read to smithi13430248-43 2024-04-18T14:43:50.524 INFO:tasks.rados.rados.0.smithi134.stdout:154: finishing write tid 5 to smithi13430248-5 2024-04-18T14:43:50.524 INFO:tasks.rados.rados.0.smithi134.stdout:154: oid 5 updating version 0 to 34 2024-04-18T14:43:50.524 INFO:tasks.rados.rados.0.smithi134.stdout:154: oid 5 updating version 34 to 35 2024-04-18T14:43:50.524 INFO:tasks.rados.rados.0.smithi134.stdout:154: oid 5 updating version 35 to 36 2024-04-18T14:43:50.524 INFO:tasks.rados.rados.0.smithi134.stdout:154: oid 5 version 36 is already newer than 33 2024-04-18T14:43:50.524 INFO:tasks.rados.rados.0.smithi134.stdout:update_object_version oid 5 v 36 (ObjNum 73 snap 13 seq_num 73) dirty exists 2024-04-18T14:43:50.524 INFO:tasks.rados.rados.0.smithi134.stdout:154: left oid 5 (ObjNum 73 snap 13 seq_num 73) 2024-04-18T14:43:50.524 INFO:tasks.rados.rados.0.smithi134.stdout:155: finishing copy_from to smithi13430248-43 2024-04-18T14:43:50.525 INFO:tasks.rados.rados.0.smithi134.stdout:update_object_version oid 43 v 12 (ObjNum 5 snap 0 seq_num 5) dirty exists 2024-04-18T14:43:50.525 INFO:tasks.rados.rados.0.smithi134.stdout:156: expect (ObjNum 65 snap 8 seq_num 65) 2024-04-18T14:43:50.526 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.12.asok dump_ops_in_flight 2024-04-18T14:43:50.526 INFO:tasks.ceph.osd.7.smithi134.stderr:2024-04-18T14:43:50.528+0000 7fd7de549640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25213) UID: 0 2024-04-18T14:43:50.624 INFO:tasks.ceph.osd.12.smithi086.stderr:2024-04-18T14:43:50.623+0000 7f6904968640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 12 (PID: 24960) UID: 0 2024-04-18T14:43:50.686 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-04-18T14:43:50.686 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [], 2024-04-18T14:43:50.686 INFO:teuthology.orchestra.run.smithi086.stdout: "num_ops": 0 2024-04-18T14:43:50.686 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-04-18T14:43:50.698 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.12.asok dump_blocked_ops 2024-04-18T14:43:50.726 INFO:tasks.ceph.osd.5.smithi096.stderr:2024-04-18T14:43:50.722+0000 7fc33f25b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 24889) UID: 0 2024-04-18T14:43:50.827 INFO:tasks.ceph.osd.15.smithi134.stderr:2024-04-18T14:43:50.828+0000 7f08e6a51640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 15 (PID: 25218) UID: 0 2024-04-18T14:43:50.864 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-04-18T14:43:50.864 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [], 2024-04-18T14:43:50.864 INFO:teuthology.orchestra.run.smithi086.stdout: "complaint_time": 30, 2024-04-18T14:43:50.864 INFO:teuthology.orchestra.run.smithi086.stdout: "num_blocked_ops": 0 2024-04-18T14:43:50.864 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-04-18T14:43:50.878 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.12.asok dump_historic_ops 2024-04-18T14:43:50.927 INFO:tasks.ceph.osd.4.smithi086.stderr:2024-04-18T14:43:50.927+0000 7f0c4c462640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 24956) UID: 0 2024-04-18T14:43:51.000 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-04-18T14:43:51.001 INFO:teuthology.orchestra.run.smithi086.stdout: "size": 20, 2024-04-18T14:43:51.001 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 600, 2024-04-18T14:43:51.001 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [ 2024-04-18T14:43:51.001 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:51.001 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4559.0:175 3.9s0 3:967bb897:::smithi13430248-25:head [stat,delete] snapc 3=[3,2] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-04-18T14:43:51.001 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-04-18T14:43:34.708488+0000", 2024-04-18T14:43:51.001 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 16.291586653, 2024-04-18T14:43:51.001 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0059938609999999996, 2024-04-18T14:43:51.001 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-04-18T14:43:51.001 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T14:43:51.001 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-04-18T14:43:51.001 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4559", 2024-04-18T14:43:51.001 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.134:0/3113589487", 2024-04-18T14:43:51.001 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 175 2024-04-18T14:43:51.001 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:51.002 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-04-18T14:43:51.002 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:51.002 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-04-18T14:43:51.002 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:34.708488+0000", 2024-04-18T14:43:51.002 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:43:51.002 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:51.002 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:51.002 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-04-18T14:43:51.002 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:34.708488+0000", 2024-04-18T14:43:51.002 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:43:51.002 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:51.002 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:51.002 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-04-18T14:43:51.002 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:34.708486+0000", 2024-04-18T14:43:51.002 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999981 2024-04-18T14:43:51.003 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:51.003 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:51.003 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-04-18T14:43:51.003 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:34.708497+0000", 2024-04-18T14:43:51.003 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.1328999999999999e-05 2024-04-18T14:43:51.003 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:51.003 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:51.003 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-04-18T14:43:51.003 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:34.708513+0000", 2024-04-18T14:43:51.003 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.5991999999999999e-05 2024-04-18T14:43:51.003 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:51.003 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:51.003 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-04-18T14:43:51.003 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:34.708521+0000", 2024-04-18T14:43:51.003 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.8560000000000007e-06 2024-04-18T14:43:51.004 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:51.004 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:51.004 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-04-18T14:43:51.004 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:34.708582+0000", 2024-04-18T14:43:51.004 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.0693999999999999e-05 2024-04-18T14:43:51.004 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:51.004 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:51.004 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op must wait for map", 2024-04-18T14:43:51.004 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:34.708591+0000", 2024-04-18T14:43:51.004 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.9510000000000001e-06 2024-04-18T14:43:51.004 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:51.004 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:51.004 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-04-18T14:43:51.004 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:34.710385+0000", 2024-04-18T14:43:51.004 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0017931329999999999 2024-04-18T14:43:51.005 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:51.005 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:51.005 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-04-18T14:43:51.005 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:34.710489+0000", 2024-04-18T14:43:51.005 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000104275 2024-04-18T14:43:51.005 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:51.005 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:51.005 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_started", 2024-04-18T14:43:51.005 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:34.711275+0000", 2024-04-18T14:43:51.005 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00078623799999999998 2024-04-18T14:43:51.005 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:51.005 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:51.005 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_committed", 2024-04-18T14:43:51.005 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:34.712040+0000", 2024-04-18T14:43:51.005 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00076439800000000001 2024-04-18T14:43:51.005 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:51.006 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:51.006 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-04-18T14:43:51.006 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:34.714446+0000", 2024-04-18T14:43:51.006 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.002406821 2024-04-18T14:43:51.006 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:51.006 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:51.006 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-04-18T14:43:51.006 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:34.714482+0000", 2024-04-18T14:43:51.006 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.5303999999999999e-05 2024-04-18T14:43:51.006 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:43:51.006 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-04-18T14:43:51.006 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:43:51.006 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:51.006 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:51.006 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "MOSDECSubOpWrite(3.as2 36/30 ECSubWrite(tid=19, reqid=client.4559.0:179, at_version=36'13, trim_to=0'0, roll_forward_to=35'10))", 2024-04-18T14:43:51.007 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-04-18T14:43:35.744258+0000", 2024-04-18T14:43:51.007 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 15.255815988, 2024-04-18T14:43:51.007 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0036224159999999998, 2024-04-18T14:43:51.007 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-04-18T14:43:51.007 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "reached pg", 2024-04-18T14:43:51.007 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-04-18T14:43:51.007 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:51.007 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-04-18T14:43:51.007 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:35.744258+0000", 2024-04-18T14:43:51.007 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:43:51.007 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:51.007 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:51.007 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-04-18T14:43:51.007 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:35.744258+0000", 2024-04-18T14:43:51.007 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:43:51.007 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:51.008 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:51.008 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-04-18T14:43:51.008 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:35.744258+0000", 2024-04-18T14:43:51.008 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-04-18T14:43:51.008 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:51.008 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:51.008 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-04-18T14:43:51.008 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:35.744370+0000", 2024-04-18T14:43:51.008 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000112036 2024-04-18T14:43:51.008 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:51.008 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:51.008 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-04-18T14:43:51.008 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:35.744386+0000", 2024-04-18T14:43:51.008 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.6447999999999999e-05 2024-04-18T14:43:51.008 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:51.008 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:51.009 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-04-18T14:43:51.009 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:35.744395+0000", 2024-04-18T14:43:51.009 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.3829999999999998e-06 2024-04-18T14:43:51.009 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:51.009 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:51.009 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-04-18T14:43:51.009 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:35.744457+0000", 2024-04-18T14:43:51.009 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.1957000000000003e-05 2024-04-18T14:43:51.009 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:51.009 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:51.009 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_started", 2024-04-18T14:43:51.009 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:35.744470+0000", 2024-04-18T14:43:51.009 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.2867000000000001e-05 2024-04-18T14:43:51.009 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:51.009 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:51.010 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_committed", 2024-04-18T14:43:51.010 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:35.747842+0000", 2024-04-18T14:43:51.010 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0033714890000000001 2024-04-18T14:43:51.010 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:51.010 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:51.010 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-04-18T14:43:51.010 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:35.747881+0000", 2024-04-18T14:43:51.010 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.9131999999999997e-05 2024-04-18T14:43:51.010 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:43:51.010 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-04-18T14:43:51.010 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:43:51.010 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:51.010 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:51.010 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "MOSDECSubOpWrite(3.as2 36/30 ECSubWrite(tid=20, reqid=client.4559.0:180, at_version=36'14, trim_to=0'0, roll_forward_to=35'10))", 2024-04-18T14:43:51.010 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-04-18T14:43:35.745408+0000", 2024-04-18T14:43:51.010 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 15.254666793, 2024-04-18T14:43:51.011 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.002788965, 2024-04-18T14:43:51.011 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-04-18T14:43:51.011 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "reached pg", 2024-04-18T14:43:51.011 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-04-18T14:43:51.011 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:51.011 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-04-18T14:43:51.011 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:35.745408+0000", 2024-04-18T14:43:51.011 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:43:51.011 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:51.011 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:51.011 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-04-18T14:43:51.011 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:35.745408+0000", 2024-04-18T14:43:51.011 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:43:51.011 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:51.011 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:51.012 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-04-18T14:43:51.012 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:35.745407+0000", 2024-04-18T14:43:51.012 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-04-18T14:43:51.012 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:51.012 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:51.012 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-04-18T14:43:51.012 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:35.745426+0000", 2024-04-18T14:43:51.012 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.9550000000000001e-05 2024-04-18T14:43:51.012 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:51.012 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:51.012 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-04-18T14:43:51.012 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:35.745443+0000", 2024-04-18T14:43:51.012 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.6894000000000001e-05 2024-04-18T14:43:51.012 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:51.012 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:51.012 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-04-18T14:43:51.013 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:35.745455+0000", 2024-04-18T14:43:51.013 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.1272e-05 2024-04-18T14:43:51.013 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:51.013 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:51.013 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-04-18T14:43:51.013 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:35.745518+0000", 2024-04-18T14:43:51.013 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.3145999999999995e-05 2024-04-18T14:43:51.013 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:51.013 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:51.013 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_started", 2024-04-18T14:43:51.013 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:35.745532+0000", 2024-04-18T14:43:51.013 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.4049000000000001e-05 2024-04-18T14:43:51.013 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:51.013 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:51.013 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_committed", 2024-04-18T14:43:51.014 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:35.748171+0000", 2024-04-18T14:43:51.014 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0026392400000000002 2024-04-18T14:43:51.014 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:51.014 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:51.014 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-04-18T14:43:51.014 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:35.748197+0000", 2024-04-18T14:43:51.014 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.5663000000000001e-05 2024-04-18T14:43:51.014 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:43:51.014 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-04-18T14:43:51.014 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:43:51.014 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:51.014 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:51.014 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "MOSDECSubOpWrite(3.as2 36/30 ECSubWrite(tid=21, reqid=client.4559.0:180, at_version=0'0, trim_to=0'0, roll_forward_to=36'14))", 2024-04-18T14:43:51.014 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-04-18T14:43:35.748687+0000", 2024-04-18T14:43:51.014 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 15.251387706999999, 2024-04-18T14:43:51.015 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0024657239999999999, 2024-04-18T14:43:51.015 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-04-18T14:43:51.015 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "reached pg", 2024-04-18T14:43:51.015 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-04-18T14:43:51.015 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:51.015 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-04-18T14:43:51.015 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:35.748687+0000", 2024-04-18T14:43:51.015 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:43:51.015 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:51.015 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:51.015 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-04-18T14:43:51.015 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:35.748687+0000", 2024-04-18T14:43:51.015 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:43:51.015 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:51.015 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:51.015 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-04-18T14:43:51.016 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:35.748686+0000", 2024-04-18T14:43:51.016 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-04-18T14:43:51.016 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:51.016 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:51.016 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-04-18T14:43:51.016 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:35.748713+0000", 2024-04-18T14:43:51.016 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.7801999999999999e-05 2024-04-18T14:43:51.016 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:51.016 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:51.016 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-04-18T14:43:51.016 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:35.748748+0000", 2024-04-18T14:43:51.016 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.5045000000000001e-05 2024-04-18T14:43:51.016 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:51.016 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:51.016 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-04-18T14:43:51.016 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:35.748766+0000", 2024-04-18T14:43:51.017 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.7275999999999999e-05 2024-04-18T14:43:51.017 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:51.017 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:51.017 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-04-18T14:43:51.017 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:35.748823+0000", 2024-04-18T14:43:51.017 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.7484000000000001e-05 2024-04-18T14:43:51.017 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:51.017 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:51.017 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_started", 2024-04-18T14:43:51.017 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:35.748832+0000", 2024-04-18T14:43:51.017 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.2399999999999996e-06 2024-04-18T14:43:51.017 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:51.017 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:51.017 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_committed", 2024-04-18T14:43:51.017 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:35.751132+0000", 2024-04-18T14:43:51.018 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0022999169999999998 2024-04-18T14:43:51.018 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:51.018 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:51.018 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-04-18T14:43:51.018 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:35.751152+0000", 2024-04-18T14:43:51.018 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.0129999999999999e-05 2024-04-18T14:43:51.018 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:43:51.018 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-04-18T14:43:51.018 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:43:51.018 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:51.018 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:51.019 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(osd.14.21:1 3.9s0 3:94766bb7:::smithi13430248-17:head [assert-version v12,copy-get max 8388608] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37)", 2024-04-18T14:43:51.019 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-04-18T14:43:36.734132+0000", 2024-04-18T14:43:51.019 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 14.265942627999999, 2024-04-18T14:43:51.019 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0072589020000000002, 2024-04-18T14:43:51.019 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-04-18T14:43:51.019 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-04-18T14:43:51.019 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-04-18T14:43:51.019 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:51.019 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-04-18T14:43:51.019 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:36.734132+0000", 2024-04-18T14:43:51.019 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:43:51.019 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:51.019 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:51.019 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-04-18T14:43:51.019 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:36.734132+0000", 2024-04-18T14:43:51.019 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:43:51.020 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:51.020 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:51.020 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-04-18T14:43:51.020 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:36.734130+0000", 2024-04-18T14:43:51.020 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999981 2024-04-18T14:43:51.020 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:51.020 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:51.020 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-04-18T14:43:51.020 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:36.734141+0000", 2024-04-18T14:43:51.020 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.1493e-05 2024-04-18T14:43:51.020 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:51.021 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:51.021 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-04-18T14:43:51.021 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:36.734158+0000", 2024-04-18T14:43:51.021 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.6874000000000001e-05 2024-04-18T14:43:51.021 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:51.021 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:51.021 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-04-18T14:43:51.021 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:36.734168+0000", 2024-04-18T14:43:51.021 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.0020999999999999e-05 2024-04-18T14:43:51.021 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:51.021 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:51.021 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-04-18T14:43:51.021 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:36.734224+0000", 2024-04-18T14:43:51.021 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.6181000000000003e-05 2024-04-18T14:43:51.021 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:51.022 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:51.022 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op must wait for map", 2024-04-18T14:43:51.022 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:36.734233+0000", 2024-04-18T14:43:51.022 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.9239999999999996e-06 2024-04-18T14:43:51.022 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:51.022 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:51.022 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-04-18T14:43:51.022 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:36.737807+0000", 2024-04-18T14:43:51.022 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0035738689999999999 2024-04-18T14:43:51.022 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:51.022 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:51.022 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-04-18T14:43:51.022 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:36.737912+0000", 2024-04-18T14:43:51.022 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000105226 2024-04-18T14:43:51.022 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:51.023 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:51.023 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-04-18T14:43:51.023 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:36.741391+0000", 2024-04-18T14:43:51.023 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.003478241 2024-04-18T14:43:51.023 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:43:51.023 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-04-18T14:43:51.023 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:43:51.023 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:51.023 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:51.023 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4559.0:197 3.9s0 3:967bb897:::smithi13430248-25:head [rollback 4] snapc 4=[4,2] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-18T14:43:51.023 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-04-18T14:43:36.775336+0000", 2024-04-18T14:43:51.023 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 14.22473828, 2024-04-18T14:43:51.023 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0076977149999999999, 2024-04-18T14:43:51.023 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-04-18T14:43:51.023 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-04-18T14:43:51.024 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-04-18T14:43:51.024 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4559", 2024-04-18T14:43:51.024 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.134:0/3113589487", 2024-04-18T14:43:51.024 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 197 2024-04-18T14:43:51.024 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:51.024 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-04-18T14:43:51.024 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:51.024 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-04-18T14:43:51.024 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:36.775336+0000", 2024-04-18T14:43:51.024 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:43:51.024 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:51.024 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:51.024 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-04-18T14:43:51.024 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:36.775336+0000", 2024-04-18T14:43:51.024 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:43:51.024 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:51.025 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:51.025 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-04-18T14:43:51.025 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:36.775334+0000", 2024-04-18T14:43:51.025 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999981 2024-04-18T14:43:51.025 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:51.025 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:51.025 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-04-18T14:43:51.025 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:36.775341+0000", 2024-04-18T14:43:51.025 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.4099999999999996e-06 2024-04-18T14:43:51.025 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:51.025 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:51.025 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-04-18T14:43:51.025 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:36.775354+0000", 2024-04-18T14:43:51.025 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.2656e-05 2024-04-18T14:43:51.025 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:51.025 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:51.026 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-04-18T14:43:51.026 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:36.775360+0000", 2024-04-18T14:43:51.026 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.156e-06 2024-04-18T14:43:51.026 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:51.026 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:51.026 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-04-18T14:43:51.026 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:36.775394+0000", 2024-04-18T14:43:51.026 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.4369000000000002e-05 2024-04-18T14:43:51.026 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:51.026 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:51.026 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-04-18T14:43:51.026 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:36.775465+0000", 2024-04-18T14:43:51.026 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.1215000000000002e-05 2024-04-18T14:43:51.026 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:51.027 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:51.027 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-04-18T14:43:51.027 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:36.783034+0000", 2024-04-18T14:43:51.027 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.007568623 2024-04-18T14:43:51.027 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:43:51.027 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-04-18T14:43:51.027 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:43:51.027 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:51.027 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:51.027 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4559.0:205 3.9s0 3:936e42fd:::smithi13430248-33:head [delete] snapc 4=[4,2] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e37)", 2024-04-18T14:43:51.027 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-04-18T14:43:36.853163+0000", 2024-04-18T14:43:51.027 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 14.146911185, 2024-04-18T14:43:51.027 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0040011120000000002, 2024-04-18T14:43:51.027 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-04-18T14:43:51.027 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T14:43:51.028 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-04-18T14:43:51.028 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4559", 2024-04-18T14:43:51.028 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.134:0/3113589487", 2024-04-18T14:43:51.028 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 205 2024-04-18T14:43:51.028 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:51.028 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-04-18T14:43:51.028 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:51.028 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-04-18T14:43:51.028 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:36.853163+0000", 2024-04-18T14:43:51.028 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:43:51.028 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:51.028 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:51.028 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-04-18T14:43:51.028 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:36.853163+0000", 2024-04-18T14:43:51.028 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:43:51.029 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:51.029 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:51.029 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-04-18T14:43:51.029 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:36.853162+0000", 2024-04-18T14:43:51.029 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999986 2024-04-18T14:43:51.029 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:51.029 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:51.029 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-04-18T14:43:51.029 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:36.853170+0000", 2024-04-18T14:43:51.029 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.9149999999999996e-06 2024-04-18T14:43:51.029 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:51.029 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:51.029 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-04-18T14:43:51.029 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:36.853184+0000", 2024-04-18T14:43:51.029 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.4455e-05 2024-04-18T14:43:51.029 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:51.030 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:51.030 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-04-18T14:43:51.030 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:36.853200+0000", 2024-04-18T14:43:51.030 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.5559000000000001e-05 2024-04-18T14:43:51.030 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:51.030 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:51.030 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-04-18T14:43:51.030 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:36.853255+0000", 2024-04-18T14:43:51.030 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.4864999999999997e-05 2024-04-18T14:43:51.030 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:51.030 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:51.030 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-04-18T14:43:51.030 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:36.853369+0000", 2024-04-18T14:43:51.030 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000114573 2024-04-18T14:43:51.030 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:51.031 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:51.031 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_started", 2024-04-18T14:43:51.031 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:36.854094+0000", 2024-04-18T14:43:51.031 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00072491199999999997 2024-04-18T14:43:51.031 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:51.031 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:51.031 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_committed", 2024-04-18T14:43:51.031 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:36.855093+0000", 2024-04-18T14:43:51.031 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00099909700000000001 2024-04-18T14:43:51.031 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:51.031 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:51.031 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-04-18T14:43:51.031 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:36.857110+0000", 2024-04-18T14:43:51.031 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0020167499999999999 2024-04-18T14:43:51.031 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:51.032 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:51.032 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-04-18T14:43:51.032 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:36.857164+0000", 2024-04-18T14:43:51.032 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.4543999999999998e-05 2024-04-18T14:43:51.032 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:43:51.032 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-04-18T14:43:51.032 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:43:51.032 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:51.032 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:51.032 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4559.0:247 3.9s0 3:936e42fd:::smithi13430248-33:head [rollback 8] snapc 8=[8,7,4,2] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-04-18T14:43:51.032 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-04-18T14:43:40.758084+0000", 2024-04-18T14:43:51.032 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 10.241990062999999, 2024-04-18T14:43:51.032 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.01694913, 2024-04-18T14:43:51.032 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-04-18T14:43:51.032 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-04-18T14:43:51.032 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-04-18T14:43:51.033 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4559", 2024-04-18T14:43:51.033 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.134:0/3113589487", 2024-04-18T14:43:51.033 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 247 2024-04-18T14:43:51.033 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:51.033 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-04-18T14:43:51.033 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:51.033 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-04-18T14:43:51.033 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:40.758084+0000", 2024-04-18T14:43:51.033 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:43:51.033 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:51.033 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:51.033 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-04-18T14:43:51.033 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:40.758084+0000", 2024-04-18T14:43:51.033 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:43:51.033 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:51.034 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:51.034 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-04-18T14:43:51.034 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:40.758082+0000", 2024-04-18T14:43:51.034 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999976 2024-04-18T14:43:51.034 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:51.034 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:51.034 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-04-18T14:43:51.034 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:40.758095+0000", 2024-04-18T14:43:51.034 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.2542e-05 2024-04-18T14:43:51.034 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:51.034 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:51.034 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-04-18T14:43:51.034 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:40.758121+0000", 2024-04-18T14:43:51.034 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.6653e-05 2024-04-18T14:43:51.034 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:51.035 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:51.035 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-04-18T14:43:51.035 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:40.758136+0000", 2024-04-18T14:43:51.035 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.4647999999999999e-05 2024-04-18T14:43:51.035 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:51.035 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:51.035 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-04-18T14:43:51.035 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:40.758238+0000", 2024-04-18T14:43:51.035 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000102221 2024-04-18T14:43:51.035 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:51.035 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:51.035 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op must wait for map", 2024-04-18T14:43:51.035 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:40.758252+0000", 2024-04-18T14:43:51.035 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.4409999999999999e-05 2024-04-18T14:43:51.035 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:51.035 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:51.036 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-04-18T14:43:51.036 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:40.764488+0000", 2024-04-18T14:43:51.036 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0062357890000000003 2024-04-18T14:43:51.036 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:51.036 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:51.036 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-04-18T14:43:51.036 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:40.764705+0000", 2024-04-18T14:43:51.036 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00021706000000000001 2024-04-18T14:43:51.036 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:51.036 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:51.036 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-04-18T14:43:51.036 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:40.775034+0000", 2024-04-18T14:43:51.036 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.010328198 2024-04-18T14:43:51.036 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:43:51.036 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-04-18T14:43:51.036 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:43:51.037 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:51.037 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:51.037 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "MOSDECSubOpWrite(3.cs3 41/30 ECSubWrite(tid=45, reqid=osd.11.0:45, at_version=41'22, trim_to=0'0, roll_forward_to=39'20))", 2024-04-18T14:43:51.037 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-04-18T14:43:40.766299+0000", 2024-04-18T14:43:51.037 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 10.233775367, 2024-04-18T14:43:51.037 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0056213399999999998, 2024-04-18T14:43:51.037 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-04-18T14:43:51.037 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "reached pg", 2024-04-18T14:43:51.037 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-04-18T14:43:51.037 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:51.037 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-04-18T14:43:51.037 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:40.766299+0000", 2024-04-18T14:43:51.037 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:43:51.037 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:51.037 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:51.038 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-04-18T14:43:51.038 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:40.766299+0000", 2024-04-18T14:43:51.038 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:43:51.038 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:51.038 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:51.038 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-04-18T14:43:51.038 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:40.766299+0000", 2024-04-18T14:43:51.038 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-04-18T14:43:51.038 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:51.038 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:51.038 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-04-18T14:43:51.038 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:40.766346+0000", 2024-04-18T14:43:51.038 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.7478000000000002e-05 2024-04-18T14:43:51.038 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:51.038 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:51.039 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-04-18T14:43:51.039 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:40.766371+0000", 2024-04-18T14:43:51.039 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.4661999999999999e-05 2024-04-18T14:43:51.039 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:51.039 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:51.039 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-04-18T14:43:51.039 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:40.766388+0000", 2024-04-18T14:43:51.039 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.7710000000000002e-05 2024-04-18T14:43:51.039 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:51.039 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:51.039 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-04-18T14:43:51.039 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:40.767050+0000", 2024-04-18T14:43:51.039 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00066135100000000002 2024-04-18T14:43:51.039 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:51.039 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:51.040 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_started", 2024-04-18T14:43:51.040 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:40.767071+0000", 2024-04-18T14:43:51.040 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.1145000000000002e-05 2024-04-18T14:43:51.040 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:51.040 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:51.040 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_committed", 2024-04-18T14:43:51.040 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:40.771878+0000", 2024-04-18T14:43:51.040 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0048075130000000002 2024-04-18T14:43:51.040 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:51.040 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:51.040 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-04-18T14:43:51.040 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:40.771920+0000", 2024-04-18T14:43:51.040 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.2024000000000003e-05 2024-04-18T14:43:51.040 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:43:51.040 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-04-18T14:43:51.040 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:43:51.041 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:51.041 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:51.041 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "MOSDECSubOpWrite(3.cs3 41/30 ECSubWrite(tid=46, reqid=osd.11.0:46, at_version=41'24, trim_to=0'0, roll_forward_to=39'20))", 2024-04-18T14:43:51.041 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-04-18T14:43:40.766414+0000", 2024-04-18T14:43:51.041 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 10.233660112000001, 2024-04-18T14:43:51.041 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0055367039999999999, 2024-04-18T14:43:51.041 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-04-18T14:43:51.041 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "reached pg", 2024-04-18T14:43:51.041 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-04-18T14:43:51.041 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:51.041 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-04-18T14:43:51.041 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:40.766414+0000", 2024-04-18T14:43:51.041 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:43:51.041 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:51.041 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:51.042 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-04-18T14:43:51.042 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:40.766414+0000", 2024-04-18T14:43:51.042 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:43:51.042 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:51.042 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:51.042 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-04-18T14:43:51.042 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:40.766414+0000", 2024-04-18T14:43:51.042 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-04-18T14:43:51.042 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:51.042 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:51.042 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-04-18T14:43:51.043 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:40.766455+0000", 2024-04-18T14:43:51.043 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.0980999999999999e-05 2024-04-18T14:43:51.043 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:51.043 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:51.043 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-04-18T14:43:51.043 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:40.766475+0000", 2024-04-18T14:43:51.043 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.0659999999999999e-05 2024-04-18T14:43:51.043 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:51.043 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:51.043 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-04-18T14:43:51.043 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:40.766490+0000", 2024-04-18T14:43:51.043 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.4976e-05 2024-04-18T14:43:51.043 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:51.043 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:51.043 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-04-18T14:43:51.044 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:40.768329+0000", 2024-04-18T14:43:51.044 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0018381879999999999 2024-04-18T14:43:51.044 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:51.044 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:51.044 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_started", 2024-04-18T14:43:51.044 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:40.768349+0000", 2024-04-18T14:43:51.044 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.0693999999999999e-05 2024-04-18T14:43:51.044 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:51.044 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:51.044 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_committed", 2024-04-18T14:43:51.044 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:40.771926+0000", 2024-04-18T14:43:51.044 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.003577158 2024-04-18T14:43:51.044 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:51.044 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:51.044 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-04-18T14:43:51.045 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:40.771951+0000", 2024-04-18T14:43:51.045 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.4672999999999999e-05 2024-04-18T14:43:51.045 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:43:51.045 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-04-18T14:43:51.045 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:43:51.045 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:51.045 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:51.045 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "MOSDECSubOpWrite(3.fs1 41/30 ECSubWrite(tid=48, reqid=client.4559.0:248, at_version=41'6, trim_to=0'0, roll_forward_to=33'4))", 2024-04-18T14:43:51.045 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-04-18T14:43:40.784618+0000", 2024-04-18T14:43:51.045 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 10.215456405999999, 2024-04-18T14:43:51.045 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0031654719999999999, 2024-04-18T14:43:51.045 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-04-18T14:43:51.045 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "reached pg", 2024-04-18T14:43:51.046 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-04-18T14:43:51.046 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:51.046 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-04-18T14:43:51.046 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:40.784618+0000", 2024-04-18T14:43:51.046 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:43:51.046 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:51.046 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:51.046 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-04-18T14:43:51.046 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:40.784618+0000", 2024-04-18T14:43:51.046 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:43:51.046 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:51.046 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:51.046 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-04-18T14:43:51.047 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:40.784616+0000", 2024-04-18T14:43:51.047 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999981 2024-04-18T14:43:51.047 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:51.047 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:51.047 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-04-18T14:43:51.047 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:40.785218+0000", 2024-04-18T14:43:51.047 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00060158 2024-04-18T14:43:51.047 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:51.047 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:51.047 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-04-18T14:43:51.047 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:40.785234+0000", 2024-04-18T14:43:51.047 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.6062e-05 2024-04-18T14:43:51.047 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:51.047 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:51.047 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-04-18T14:43:51.048 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:40.785243+0000", 2024-04-18T14:43:51.048 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.3549999999999994e-06 2024-04-18T14:43:51.048 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:51.048 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:51.048 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-04-18T14:43:51.048 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:40.785373+0000", 2024-04-18T14:43:51.048 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00012996399999999999 2024-04-18T14:43:51.048 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:51.048 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:51.048 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_started", 2024-04-18T14:43:51.048 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:40.785402+0000", 2024-04-18T14:43:51.048 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.8606e-05 2024-04-18T14:43:51.048 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:51.048 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:51.048 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_committed", 2024-04-18T14:43:51.049 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:40.787729+0000", 2024-04-18T14:43:51.049 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0023269219999999999 2024-04-18T14:43:51.049 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:51.049 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:51.049 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-04-18T14:43:51.049 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:40.787784+0000", 2024-04-18T14:43:51.049 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.4784999999999998e-05 2024-04-18T14:43:51.049 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:43:51.049 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-04-18T14:43:51.049 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:43:51.049 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:51.049 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:51.049 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "MOSDECSubOpWrite(3.1s4 45/30 ECSubWrite(tid=28, reqid=client.4559.0:318, at_version=45'18, trim_to=0'0, roll_forward_to=44'16))", 2024-04-18T14:43:51.049 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-04-18T14:43:44.563626+0000", 2024-04-18T14:43:51.050 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 6.4364481390000003, 2024-04-18T14:43:51.050 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0032668710000000002, 2024-04-18T14:43:51.050 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-04-18T14:43:51.050 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "reached pg", 2024-04-18T14:43:51.050 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-04-18T14:43:51.050 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:51.050 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-04-18T14:43:51.050 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:44.563626+0000", 2024-04-18T14:43:51.050 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:43:51.050 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:51.050 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:51.050 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-04-18T14:43:51.050 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:44.563626+0000", 2024-04-18T14:43:51.050 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:43:51.051 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:51.051 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:51.051 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-04-18T14:43:51.051 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:44.563626+0000", 2024-04-18T14:43:51.051 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-04-18T14:43:51.051 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:51.051 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:51.051 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-04-18T14:43:51.051 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:44.563648+0000", 2024-04-18T14:43:51.051 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.2155e-05 2024-04-18T14:43:51.051 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:51.051 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:51.051 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-04-18T14:43:51.051 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:44.563660+0000", 2024-04-18T14:43:51.051 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.2438e-05 2024-04-18T14:43:51.052 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:51.052 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:51.052 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-04-18T14:43:51.052 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:44.563668+0000", 2024-04-18T14:43:51.052 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.0709999999999995e-06 2024-04-18T14:43:51.052 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:51.052 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:51.052 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-04-18T14:43:51.052 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:44.563754+0000", 2024-04-18T14:43:51.052 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.5342999999999999e-05 2024-04-18T14:43:51.052 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:51.052 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:51.052 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_started", 2024-04-18T14:43:51.052 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:44.563776+0000", 2024-04-18T14:43:51.052 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.2694999999999999e-05 2024-04-18T14:43:51.053 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:51.053 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:51.053 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_committed", 2024-04-18T14:43:51.053 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:44.566863+0000", 2024-04-18T14:43:51.053 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0030862440000000001 2024-04-18T14:43:51.053 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:51.053 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:51.053 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-04-18T14:43:51.053 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:44.566893+0000", 2024-04-18T14:43:51.053 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.0645999999999998e-05 2024-04-18T14:43:51.053 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:43:51.053 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-04-18T14:43:51.053 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:43:51.054 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:51.054 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:51.054 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "MOSDECSubOpWrite(3.4s1 46/30 ECSubWrite(tid=28, reqid=client.4559.0:323, at_version=46'5, trim_to=0'0, roll_forward_to=33'2))", 2024-04-18T14:43:51.054 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-04-18T14:43:45.380532+0000", 2024-04-18T14:43:51.054 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 5.6195427240000004, 2024-04-18T14:43:51.054 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0027417269999999998, 2024-04-18T14:43:51.054 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-04-18T14:43:51.054 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "reached pg", 2024-04-18T14:43:51.054 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-04-18T14:43:51.054 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:51.054 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-04-18T14:43:51.054 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:45.380532+0000", 2024-04-18T14:43:51.054 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:43:51.054 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:51.054 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:51.055 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-04-18T14:43:51.055 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:45.380532+0000", 2024-04-18T14:43:51.055 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:43:51.055 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:51.055 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:51.055 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-04-18T14:43:51.055 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:45.380530+0000", 2024-04-18T14:43:51.055 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999986 2024-04-18T14:43:51.055 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:51.055 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:51.055 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-04-18T14:43:51.055 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:45.380561+0000", 2024-04-18T14:43:51.055 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.0617999999999997e-05 2024-04-18T14:43:51.056 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:51.056 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:51.056 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-04-18T14:43:51.056 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:45.380582+0000", 2024-04-18T14:43:51.056 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.1180000000000001e-05 2024-04-18T14:43:51.056 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:51.057 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:51.057 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-04-18T14:43:51.057 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:45.380598+0000", 2024-04-18T14:43:51.057 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.6127999999999999e-05 2024-04-18T14:43:51.057 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:51.057 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:51.057 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-04-18T14:43:51.057 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:45.380660+0000", 2024-04-18T14:43:51.057 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.1199999999999997e-05 2024-04-18T14:43:51.058 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:51.058 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:51.058 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_started", 2024-04-18T14:43:51.058 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:45.380669+0000", 2024-04-18T14:43:51.058 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.2799999999999992e-06 2024-04-18T14:43:51.058 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:51.058 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:51.058 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_committed", 2024-04-18T14:43:51.058 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:45.383231+0000", 2024-04-18T14:43:51.058 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0025616990000000002 2024-04-18T14:43:51.058 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:51.058 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:51.058 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-04-18T14:43:51.058 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:45.383273+0000", 2024-04-18T14:43:51.059 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.2935000000000001e-05 2024-04-18T14:43:51.059 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:43:51.059 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-04-18T14:43:51.059 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:43:51.059 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:51.059 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:51.059 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "MOSDECSubOpWrite(3.2s1 46/30 ECSubWrite(tid=190, reqid=osd.13.0:190, at_version=46'10, trim_to=0'0, roll_forward_to=45'8))", 2024-04-18T14:43:51.059 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-04-18T14:43:45.383718+0000", 2024-04-18T14:43:51.059 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 5.6163559870000004, 2024-04-18T14:43:51.059 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.004115685, 2024-04-18T14:43:51.059 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-04-18T14:43:51.059 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "reached pg", 2024-04-18T14:43:51.059 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-04-18T14:43:51.060 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:51.060 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-04-18T14:43:51.060 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:45.383718+0000", 2024-04-18T14:43:51.060 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:43:51.060 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:51.060 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:51.060 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-04-18T14:43:51.060 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:45.383718+0000", 2024-04-18T14:43:51.061 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:43:51.061 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:51.061 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:51.061 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-04-18T14:43:51.061 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:45.383718+0000", 2024-04-18T14:43:51.061 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-04-18T14:43:51.061 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:51.061 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:51.061 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-04-18T14:43:51.061 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:45.383752+0000", 2024-04-18T14:43:51.061 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.3983000000000003e-05 2024-04-18T14:43:51.061 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:51.062 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:51.062 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-04-18T14:43:51.062 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:45.383771+0000", 2024-04-18T14:43:51.062 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.9259e-05 2024-04-18T14:43:51.062 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:51.062 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:51.062 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-04-18T14:43:51.062 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:45.383785+0000", 2024-04-18T14:43:51.062 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.3813e-05 2024-04-18T14:43:51.062 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:51.062 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:51.062 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-04-18T14:43:51.062 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:45.384036+0000", 2024-04-18T14:43:51.062 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00025046200000000002 2024-04-18T14:43:51.062 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:51.063 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:51.063 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_started", 2024-04-18T14:43:51.063 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:45.384049+0000", 2024-04-18T14:43:51.063 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.3665999999999999e-05 2024-04-18T14:43:51.063 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:51.063 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:51.063 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_committed", 2024-04-18T14:43:51.063 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:45.387768+0000", 2024-04-18T14:43:51.063 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0037188239999999999 2024-04-18T14:43:51.063 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:51.063 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:51.063 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-04-18T14:43:51.063 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:45.387834+0000", 2024-04-18T14:43:51.063 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.6058999999999999e-05 2024-04-18T14:43:51.064 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:43:51.064 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-04-18T14:43:51.064 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:43:51.064 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:51.064 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:51.064 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "MOSDECSubOpWrite(3.1s4 46/30 ECSubWrite(tid=32, reqid=osd.6.0:32, at_version=46'22, trim_to=0'0, roll_forward_to=45'20))", 2024-04-18T14:43:51.065 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-04-18T14:43:45.384932+0000", 2024-04-18T14:43:51.065 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 5.6151423959999995, 2024-04-18T14:43:51.065 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0028124320000000001, 2024-04-18T14:43:51.065 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-04-18T14:43:51.065 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "reached pg", 2024-04-18T14:43:51.065 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-04-18T14:43:51.065 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:51.065 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-04-18T14:43:51.065 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:45.384932+0000", 2024-04-18T14:43:51.066 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:43:51.066 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:51.066 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:51.066 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-04-18T14:43:51.066 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:45.384932+0000", 2024-04-18T14:43:51.066 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:43:51.067 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:51.067 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:51.067 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-04-18T14:43:51.067 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:45.384932+0000", 2024-04-18T14:43:51.067 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-04-18T14:43:51.067 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:51.067 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:51.068 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-04-18T14:43:51.068 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:45.384962+0000", 2024-04-18T14:43:51.068 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.0124000000000002e-05 2024-04-18T14:43:51.068 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:51.068 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:51.068 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-04-18T14:43:51.069 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:45.384974+0000", 2024-04-18T14:43:51.069 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.2534000000000001e-05 2024-04-18T14:43:51.069 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:51.069 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:51.069 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-04-18T14:43:51.069 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:45.384985+0000", 2024-04-18T14:43:51.069 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.0679999999999999e-05 2024-04-18T14:43:51.070 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:51.070 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:51.070 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-04-18T14:43:51.070 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:45.385346+0000", 2024-04-18T14:43:51.070 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00036047100000000001 2024-04-18T14:43:51.070 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:51.071 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:51.071 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_started", 2024-04-18T14:43:51.071 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:45.385361+0000", 2024-04-18T14:43:51.071 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.5801e-05 2024-04-18T14:43:51.071 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:51.071 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:51.071 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_committed", 2024-04-18T14:43:51.072 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:45.387713+0000", 2024-04-18T14:43:51.072 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0023516169999999999 2024-04-18T14:43:51.072 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:51.072 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:51.072 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-04-18T14:43:51.072 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:45.387744+0000", 2024-04-18T14:43:51.073 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.1503e-05 2024-04-18T14:43:51.073 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:43:51.073 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-04-18T14:43:51.073 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:43:51.073 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:51.073 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:51.074 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "MOSDECSubOpWrite(3.6s2 46/30 ECSubWrite(tid=67, reqid=osd.14.0:67, at_version=46'23, trim_to=0'0, roll_forward_to=45'21))", 2024-04-18T14:43:51.074 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-04-18T14:43:45.385361+0000", 2024-04-18T14:43:51.074 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 5.6147138979999998, 2024-04-18T14:43:51.074 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0024207780000000002, 2024-04-18T14:43:51.074 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-04-18T14:43:51.074 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "reached pg", 2024-04-18T14:43:51.075 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-04-18T14:43:51.075 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:51.075 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-04-18T14:43:51.075 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:45.385361+0000", 2024-04-18T14:43:51.075 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:43:51.075 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:51.075 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:51.076 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-04-18T14:43:51.076 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:45.385361+0000", 2024-04-18T14:43:51.076 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:43:51.076 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:51.076 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:51.076 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-04-18T14:43:51.077 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:45.385360+0000", 2024-04-18T14:43:51.077 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-04-18T14:43:51.077 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:51.077 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:51.077 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-04-18T14:43:51.077 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:45.385387+0000", 2024-04-18T14:43:51.077 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.7682999999999999e-05 2024-04-18T14:43:51.078 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:51.078 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:51.078 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-04-18T14:43:51.078 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:45.385404+0000", 2024-04-18T14:43:51.078 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.6453e-05 2024-04-18T14:43:51.078 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:51.079 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:51.079 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-04-18T14:43:51.079 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:45.385415+0000", 2024-04-18T14:43:51.079 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.1644999999999999e-05 2024-04-18T14:43:51.079 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:51.079 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:51.079 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-04-18T14:43:51.079 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:45.385515+0000", 2024-04-18T14:43:51.080 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.9134000000000003e-05 2024-04-18T14:43:51.080 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:51.080 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:51.080 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_started", 2024-04-18T14:43:51.080 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:45.385529+0000", 2024-04-18T14:43:51.080 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.4494999999999999e-05 2024-04-18T14:43:51.080 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:51.081 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:51.081 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_committed", 2024-04-18T14:43:51.081 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:45.387745+0000", 2024-04-18T14:43:51.081 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0022153889999999999 2024-04-18T14:43:51.081 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:51.081 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:51.082 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-04-18T14:43:51.082 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:45.387781+0000", 2024-04-18T14:43:51.082 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.6820999999999999e-05 2024-04-18T14:43:51.082 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:43:51.082 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-04-18T14:43:51.082 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:43:51.083 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:51.083 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:51.083 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(osd.15.23:1 3.9s0 3:9ca71dbb:::smithi13430248-12:head [assert-version v42,copy-get max 8388608] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-04-18T14:43:51.083 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-04-18T14:43:46.381967+0000", 2024-04-18T14:43:51.083 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 4.6181078790000001, 2024-04-18T14:43:51.083 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0044412089999999998, 2024-04-18T14:43:51.083 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-04-18T14:43:51.083 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-04-18T14:43:51.083 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-04-18T14:43:51.084 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:51.084 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-04-18T14:43:51.084 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:46.381967+0000", 2024-04-18T14:43:51.084 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:43:51.084 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:51.085 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:51.085 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-04-18T14:43:51.085 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:46.381967+0000", 2024-04-18T14:43:51.085 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:43:51.085 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:51.086 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:51.086 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-04-18T14:43:51.086 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:46.381964+0000", 2024-04-18T14:43:51.086 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999976 2024-04-18T14:43:51.086 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:51.086 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:51.086 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-04-18T14:43:51.086 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:46.381977+0000", 2024-04-18T14:43:51.086 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.2542e-05 2024-04-18T14:43:51.086 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:51.086 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:51.086 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-04-18T14:43:51.087 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:46.381999+0000", 2024-04-18T14:43:51.087 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.1832999999999999e-05 2024-04-18T14:43:51.087 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:51.087 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:51.087 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-04-18T14:43:51.087 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:46.382020+0000", 2024-04-18T14:43:51.087 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.1503000000000001e-05 2024-04-18T14:43:51.087 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:51.087 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:51.088 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-04-18T14:43:51.088 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:46.382108+0000", 2024-04-18T14:43:51.088 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.7535999999999997e-05 2024-04-18T14:43:51.088 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:51.088 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:51.088 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-04-18T14:43:51.088 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:46.382279+0000", 2024-04-18T14:43:51.088 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00017127399999999999 2024-04-18T14:43:51.088 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:51.088 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:51.088 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-04-18T14:43:51.088 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:46.386408+0000", 2024-04-18T14:43:51.088 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.004128914 2024-04-18T14:43:51.088 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:43:51.089 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-04-18T14:43:51.089 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:43:51.089 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:51.089 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:51.089 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "MOSDECSubOpWrite(3.6s2 51/30 ECSubWrite(tid=90, reqid=client.4559.0:361, at_version=51'38, trim_to=0'0, roll_forward_to=50'34))", 2024-04-18T14:43:51.089 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-04-18T14:43:50.380516+0000", 2024-04-18T14:43:51.089 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 0.61955855000000004, 2024-04-18T14:43:51.089 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.002278871, 2024-04-18T14:43:51.089 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-04-18T14:43:51.089 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "reached pg", 2024-04-18T14:43:51.089 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-04-18T14:43:51.089 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:51.089 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-04-18T14:43:51.089 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:50.380516+0000", 2024-04-18T14:43:51.089 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:43:51.090 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:51.090 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:51.090 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-04-18T14:43:51.090 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:50.380516+0000", 2024-04-18T14:43:51.090 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:43:51.090 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:51.090 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:51.091 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-04-18T14:43:51.091 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:50.380515+0000", 2024-04-18T14:43:51.091 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-04-18T14:43:51.091 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:51.091 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:51.091 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-04-18T14:43:51.092 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:50.380531+0000", 2024-04-18T14:43:51.092 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.6042999999999999e-05 2024-04-18T14:43:51.092 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:51.092 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:51.092 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-04-18T14:43:51.092 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:50.380541+0000", 2024-04-18T14:43:51.092 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.9650000000000003e-06 2024-04-18T14:43:51.092 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:51.092 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:51.092 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-04-18T14:43:51.092 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:50.380547+0000", 2024-04-18T14:43:51.092 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.7899999999999996e-06 2024-04-18T14:43:51.093 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:51.093 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:51.093 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-04-18T14:43:51.093 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:50.380585+0000", 2024-04-18T14:43:51.093 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.8009999999999997e-05 2024-04-18T14:43:51.093 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:51.093 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:51.093 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_started", 2024-04-18T14:43:51.093 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:50.380590+0000", 2024-04-18T14:43:51.094 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.4559999999999999e-06 2024-04-18T14:43:51.094 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:51.094 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:51.094 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_committed", 2024-04-18T14:43:51.094 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:50.382771+0000", 2024-04-18T14:43:51.094 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0021809709999999999 2024-04-18T14:43:51.094 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:51.094 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:51.094 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-04-18T14:43:51.094 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:50.382795+0000", 2024-04-18T14:43:51.094 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.3308000000000001e-05 2024-04-18T14:43:51.094 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:43:51.094 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-04-18T14:43:51.095 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:43:51.095 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:51.095 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:51.095 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "MOSDECSubOpWrite(3.as2 51/30 ECSubWrite(tid=39, reqid=client.4559.0:363, at_version=51'28, trim_to=0'0, roll_forward_to=44'25))", 2024-04-18T14:43:51.095 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-04-18T14:43:50.385424+0000", 2024-04-18T14:43:51.095 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 0.61465056699999998, 2024-04-18T14:43:51.095 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0028446729999999998, 2024-04-18T14:43:51.095 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-04-18T14:43:51.095 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "reached pg", 2024-04-18T14:43:51.095 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-04-18T14:43:51.095 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:51.096 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-04-18T14:43:51.096 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:50.385424+0000", 2024-04-18T14:43:51.096 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:43:51.096 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:51.096 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:51.096 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-04-18T14:43:51.096 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:50.385424+0000", 2024-04-18T14:43:51.096 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:43:51.096 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:51.096 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:51.096 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-04-18T14:43:51.096 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:50.385423+0000", 2024-04-18T14:43:51.096 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-04-18T14:43:51.096 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:51.097 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:51.097 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-04-18T14:43:51.097 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:50.385442+0000", 2024-04-18T14:43:51.097 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.8904999999999999e-05 2024-04-18T14:43:51.097 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:51.097 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:51.097 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-04-18T14:43:51.097 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:50.385456+0000", 2024-04-18T14:43:51.097 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.361e-05 2024-04-18T14:43:51.097 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:51.097 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:51.098 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-04-18T14:43:51.098 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:50.385466+0000", 2024-04-18T14:43:51.098 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.046e-05 2024-04-18T14:43:51.098 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:51.098 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:51.098 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-04-18T14:43:51.098 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:50.385530+0000", 2024-04-18T14:43:51.098 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.4332999999999995e-05 2024-04-18T14:43:51.098 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:51.098 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:51.099 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_started", 2024-04-18T14:43:51.099 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:50.385540+0000", 2024-04-18T14:43:51.099 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.815e-06 2024-04-18T14:43:51.099 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:51.099 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:51.099 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_committed", 2024-04-18T14:43:51.100 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:50.388252+0000", 2024-04-18T14:43:51.100 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0027118630000000001 2024-04-18T14:43:51.100 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:51.100 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:51.100 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-04-18T14:43:51.100 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:50.388269+0000", 2024-04-18T14:43:51.100 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.649e-05 2024-04-18T14:43:51.100 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:43:51.100 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-04-18T14:43:51.100 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:43:51.100 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:51.100 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:51.101 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "MOSDECSubOpWrite(3.cs3 51/30 ECSubWrite(tid=72, reqid=client.4559.0:380, at_version=51'32, trim_to=0'0, roll_forward_to=44'30))", 2024-04-18T14:43:51.101 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-04-18T14:43:50.417895+0000", 2024-04-18T14:43:51.101 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 0.58217977899999995, 2024-04-18T14:43:51.101 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0023725869999999998, 2024-04-18T14:43:51.101 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-04-18T14:43:51.101 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "reached pg", 2024-04-18T14:43:51.101 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-04-18T14:43:51.101 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:51.101 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-04-18T14:43:51.101 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:50.417895+0000", 2024-04-18T14:43:51.101 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:43:51.101 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:51.101 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:51.101 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-04-18T14:43:51.101 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:50.417895+0000", 2024-04-18T14:43:51.102 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:43:51.102 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:51.102 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:51.102 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-04-18T14:43:51.102 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:50.417894+0000", 2024-04-18T14:43:51.102 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-04-18T14:43:51.102 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:51.102 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:51.102 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-04-18T14:43:51.102 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:50.418353+0000", 2024-04-18T14:43:51.102 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00045900599999999998 2024-04-18T14:43:51.102 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:51.102 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:51.103 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-04-18T14:43:51.103 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:50.418371+0000", 2024-04-18T14:43:51.103 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.7819e-05 2024-04-18T14:43:51.103 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:51.103 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:51.103 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-04-18T14:43:51.103 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:50.418381+0000", 2024-04-18T14:43:51.103 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.8519999999999999e-06 2024-04-18T14:43:51.103 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:51.103 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:51.103 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-04-18T14:43:51.103 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:50.418468+0000", 2024-04-18T14:43:51.103 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.7372000000000003e-05 2024-04-18T14:43:51.103 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:51.103 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:51.104 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_started", 2024-04-18T14:43:51.104 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:50.418483+0000", 2024-04-18T14:43:51.104 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.4243000000000001e-05 2024-04-18T14:43:51.104 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:51.104 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:51.104 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_committed", 2024-04-18T14:43:51.104 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:50.420239+0000", 2024-04-18T14:43:51.104 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0017563909999999999 2024-04-18T14:43:51.104 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:43:51.104 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:43:51.104 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-04-18T14:43:51.104 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:50.420267+0000", 2024-04-18T14:43:51.104 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.8175999999999999e-05 2024-04-18T14:43:51.104 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:43:51.104 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-04-18T14:43:51.105 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:43:51.105 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:43:51.105 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-04-18T14:43:51.105 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-04-18T14:43:51.107 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-18T14:43:51.107 INFO:tasks.ceph.osd.2.smithi119.stderr:2024-04-18T14:43:51.110+0000 7fcbd30c0640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 24894) UID: 0 2024-04-18T14:43:51.207 INFO:tasks.ceph.osd.2.smithi119.stderr:2024-04-18T14:43:51.210+0000 7fcbd30c0640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 24894) UID: 0 2024-04-18T14:43:51.238 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2024-04-18T14:43:51.238 INFO:teuthology.orchestra.run.smithi096.stdout: "ops": [], 2024-04-18T14:43:51.238 INFO:teuthology.orchestra.run.smithi096.stdout: "num_ops": 0 2024-04-18T14:43:51.238 INFO:teuthology.orchestra.run.smithi096.stdout:} 2024-04-18T14:43:51.252 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-18T14:43:51.308 INFO:tasks.ceph.osd.6.smithi119.stderr:2024-04-18T14:43:51.310+0000 7fb7cb8bd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 24896) UID: 0 2024-04-18T14:43:51.373 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2024-04-18T14:43:51.373 INFO:teuthology.orchestra.run.smithi096.stdout: "ops": [], 2024-04-18T14:43:51.373 INFO:teuthology.orchestra.run.smithi096.stdout: "complaint_time": 30, 2024-04-18T14:43:51.374 INFO:teuthology.orchestra.run.smithi096.stdout: "num_blocked_ops": 0 2024-04-18T14:43:51.374 INFO:teuthology.orchestra.run.smithi096.stdout:} 2024-04-18T14:43:51.387 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-18T14:43:51.409 INFO:tasks.ceph.osd.15.smithi134.stderr:2024-04-18T14:43:51.412+0000 7f08e6a51640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 15 (PID: 25218) UID: 0 2024-04-18T14:43:51.411 INFO:teuthology.orchestra.run.smithi086.stderr:noscrub is set 2024-04-18T14:43:51.413 INFO:tasks.rados.rados.0.smithi134.stdout:148: done (7 left) 2024-04-18T14:43:51.413 INFO:tasks.rados.rados.0.smithi134.stdout:150: done (6 left) 2024-04-18T14:43:51.413 INFO:tasks.rados.rados.0.smithi134.stdout:152: done (5 left) 2024-04-18T14:43:51.413 INFO:tasks.rados.rados.0.smithi134.stdout:153: done (4 left) 2024-04-18T14:43:51.413 INFO:tasks.rados.rados.0.smithi134.stdout:154: done (3 left) 2024-04-18T14:43:51.413 INFO:tasks.rados.rados.0.smithi134.stdout:155: done (2 left) 2024-04-18T14:43:51.413 INFO:tasks.rados.rados.0.smithi134.stdout:156: done (1 left) 2024-04-18T14:43:51.413 INFO:tasks.rados.rados.0.smithi134.stdout:157: done (0 left) 2024-04-18T14:43:51.413 INFO:tasks.rados.rados.0.smithi134.stdout:158: snap_remove snap 5 2024-04-18T14:43:51.508 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2024-04-18T14:43:51.508 INFO:teuthology.orchestra.run.smithi096.stdout: "size": 20, 2024-04-18T14:43:51.508 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 600, 2024-04-18T14:43:51.508 INFO:teuthology.orchestra.run.smithi096.stdout: "ops": [] 2024-04-18T14:43:51.508 INFO:teuthology.orchestra.run.smithi096.stdout:} 2024-04-18T14:43:51.510 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-18T14:43:51.510 INFO:tasks.ceph.osd.11.smithi134.stderr:2024-04-18T14:43:51.512+0000 7f2d36f12640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 11 (PID: 25216) UID: 0 2024-04-18T14:43:51.522 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-04-18T14:43:51.611 INFO:tasks.ceph.osd.11.smithi134.stderr:2024-04-18T14:43:51.616+0000 7f2d36f12640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 11 (PID: 25216) UID: 0 2024-04-18T14:43:51.641 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2024-04-18T14:43:51.641 INFO:teuthology.orchestra.run.smithi096.stdout: "ops": [], 2024-04-18T14:43:51.641 INFO:teuthology.orchestra.run.smithi096.stdout: "num_ops": 0 2024-04-18T14:43:51.641 INFO:teuthology.orchestra.run.smithi096.stdout:} 2024-04-18T14:43:51.655 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-04-18T14:43:51.663 INFO:teuthology.orchestra.run.smithi086.stdout:osd.0: {} 2024-04-18T14:43:51.663 INFO:teuthology.orchestra.run.smithi086.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-18T14:43:51.683 INFO:teuthology.orchestra.run.smithi086.stdout:osd.1: {} 2024-04-18T14:43:51.683 INFO:teuthology.orchestra.run.smithi086.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-18T14:43:51.703 INFO:teuthology.orchestra.run.smithi086.stdout:osd.2: {} 2024-04-18T14:43:51.703 INFO:teuthology.orchestra.run.smithi086.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-18T14:43:51.711 INFO:tasks.ceph.osd.9.smithi096.stderr:2024-04-18T14:43:51.710+0000 7fa2c1cbf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 9 (PID: 24891) UID: 0 2024-04-18T14:43:51.724 INFO:teuthology.orchestra.run.smithi086.stdout:osd.3: {} 2024-04-18T14:43:51.724 INFO:teuthology.orchestra.run.smithi086.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-18T14:43:51.741 INFO:teuthology.orchestra.run.smithi086.stdout:osd.4: {} 2024-04-18T14:43:51.741 INFO:teuthology.orchestra.run.smithi086.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-18T14:43:51.761 INFO:teuthology.orchestra.run.smithi086.stdout:osd.5: {} 2024-04-18T14:43:51.762 INFO:teuthology.orchestra.run.smithi086.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-18T14:43:51.775 INFO:teuthology.orchestra.run.smithi096.stdout:ERROR: (22) Invalid argument 2024-04-18T14:43:51.775 INFO:teuthology.orchestra.run.smithi096.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T14:43:51.783 INFO:teuthology.orchestra.run.smithi086.stdout:osd.6: {} 2024-04-18T14:43:51.783 INFO:teuthology.orchestra.run.smithi086.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-18T14:43:51.789 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-04-18T14:43:51.805 INFO:teuthology.orchestra.run.smithi086.stdout:osd.7: {} 2024-04-18T14:43:51.806 INFO:teuthology.orchestra.run.smithi086.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-18T14:43:51.812 INFO:tasks.ceph.osd.0.smithi086.stderr:2024-04-18T14:43:51.811+0000 7f7cdfd78640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 24953) UID: 0 2024-04-18T14:43:51.827 INFO:teuthology.orchestra.run.smithi086.stdout:osd.8: {} 2024-04-18T14:43:51.827 INFO:teuthology.orchestra.run.smithi086.stderr:osd.8: osd_enable_op_tracker = '' 2024-04-18T14:43:51.845 INFO:teuthology.orchestra.run.smithi086.stdout:osd.9: {} 2024-04-18T14:43:51.845 INFO:teuthology.orchestra.run.smithi086.stderr:osd.9: osd_enable_op_tracker = '' 2024-04-18T14:43:51.868 INFO:teuthology.orchestra.run.smithi086.stdout:osd.10: {} 2024-04-18T14:43:51.868 INFO:teuthology.orchestra.run.smithi086.stderr:osd.10: osd_enable_op_tracker = '' 2024-04-18T14:43:51.889 INFO:teuthology.orchestra.run.smithi086.stdout:osd.11: {} 2024-04-18T14:43:51.890 INFO:teuthology.orchestra.run.smithi086.stderr:osd.11: osd_enable_op_tracker = '' 2024-04-18T14:43:51.908 INFO:teuthology.orchestra.run.smithi086.stdout:osd.12: {} 2024-04-18T14:43:51.909 INFO:teuthology.orchestra.run.smithi086.stderr:osd.12: osd_enable_op_tracker = '' 2024-04-18T14:43:51.914 INFO:tasks.ceph.osd.8.smithi086.stderr:2024-04-18T14:43:51.915+0000 7f29f7b9d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 8 (PID: 24958) UID: 0 2024-04-18T14:43:51.929 INFO:teuthology.orchestra.run.smithi086.stdout:osd.13: {} 2024-04-18T14:43:51.930 INFO:teuthology.orchestra.run.smithi086.stderr:osd.13: osd_enable_op_tracker = '' 2024-04-18T14:43:51.951 INFO:teuthology.orchestra.run.smithi086.stdout:osd.14: {} 2024-04-18T14:43:51.951 INFO:teuthology.orchestra.run.smithi086.stderr:osd.14: osd_enable_op_tracker = '' 2024-04-18T14:43:51.953 INFO:teuthology.orchestra.run.smithi096.stdout:ERROR: (22) Invalid argument 2024-04-18T14:43:51.953 INFO:teuthology.orchestra.run.smithi096.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T14:43:51.953 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-18T14:43:51.951+0000 7f310e95f640 0 -- 172.21.15.86:0/1175883898 >> [v2:172.21.15.134:6808/25223,v1:172.21.15.134:6812/25223] conn(0x7f310821e2d0 msgr2=0x7f31082206e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-04-18T14:43:51.966 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.9.asok dump_ops_in_flight 2024-04-18T14:43:52.016 INFO:tasks.ceph.osd.5.smithi096.stderr:2024-04-18T14:43:52.014+0000 7fc33f25b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 24889) UID: 0 2024-04-18T14:43:52.084 INFO:teuthology.orchestra.run.smithi096.stdout:ERROR: (22) Invalid argument 2024-04-18T14:43:52.085 INFO:teuthology.orchestra.run.smithi096.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T14:43:52.100 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.9.asok dump_blocked_ops 2024-04-18T14:43:52.117 INFO:tasks.ceph.osd.11.smithi134.stderr:2024-04-18T14:43:52.120+0000 7f2d36f12640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 11 (PID: 25216) UID: 0 2024-04-18T14:43:52.175 INFO:teuthology.orchestra.run.smithi086.stdout:osd.15: {} 2024-04-18T14:43:52.175 INFO:teuthology.orchestra.run.smithi086.stderr:osd.15: osd_enable_op_tracker = '' 2024-04-18T14:43:52.242 INFO:tasks.ceph.osd.0.smithi086.stderr:2024-04-18T14:43:52.243+0000 7f7cdfd78640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 24953) UID: 0 2024-04-18T14:43:52.265 INFO:teuthology.orchestra.run.smithi096.stdout:ERROR: (22) Invalid argument 2024-04-18T14:43:52.265 INFO:teuthology.orchestra.run.smithi096.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T14:43:52.279 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.9.asok dump_historic_ops 2024-04-18T14:43:52.317 INFO:tasks.ceph.osd.11.smithi134.stderr:2024-04-18T14:43:52.320+0000 7f2d36f12640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 11 (PID: 25216) UID: 0 2024-04-18T14:43:52.396 INFO:teuthology.orchestra.run.smithi096.stdout:ERROR: (22) Invalid argument 2024-04-18T14:43:52.397 INFO:teuthology.orchestra.run.smithi096.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T14:43:52.403 INFO:tasks.thrashosds.thrasher:in_osds: [0, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15] out_osds: [1] dead_osds: [] live_osds: [0, 4, 8, 12, 1, 5, 9, 13, 2, 6, 10, 14, 3, 7, 11, 15] 2024-04-18T14:43:52.403 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 0 1 2024-04-18T14:43:52.412 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.13.asok dump_ops_in_flight 2024-04-18T14:43:52.429 INFO:tasks.rados.rados.0.smithi134.stdout:158: done (0 left) 2024-04-18T14:43:52.429 INFO:tasks.rados.rados.0.smithi134.stdout:159: snap_create 2024-04-18T14:43:52.450 INFO:tasks.ceph.osd.4.smithi086.stderr:2024-04-18T14:43:52.451+0000 7f0c4c462640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 24956) UID: 0 2024-04-18T14:43:52.519 INFO:tasks.ceph.osd.13.smithi096.stderr:2024-04-18T14:43:52.518+0000 7f7e72fad640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 13 (PID: 24893) UID: 0 2024-04-18T14:43:52.539 INFO:teuthology.orchestra.run.smithi096.stdout:ERROR: (22) Invalid argument 2024-04-18T14:43:52.539 INFO:teuthology.orchestra.run.smithi096.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T14:43:52.553 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.13.asok dump_blocked_ops 2024-04-18T14:43:52.619 INFO:tasks.ceph.osd.8.smithi086.stderr:2024-04-18T14:43:52.619+0000 7f29f7b9d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 8 (PID: 24958) UID: 0 2024-04-18T14:43:52.715 INFO:teuthology.orchestra.run.smithi096.stdout:ERROR: (22) Invalid argument 2024-04-18T14:43:52.715 INFO:teuthology.orchestra.run.smithi096.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T14:43:52.720 INFO:tasks.ceph.osd.7.smithi134.stderr:2024-04-18T14:43:52.724+0000 7fd7de549640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25213) UID: 0 2024-04-18T14:43:52.731 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.13.asok dump_historic_ops 2024-04-18T14:43:52.821 INFO:tasks.ceph.osd.9.smithi096.stderr:2024-04-18T14:43:52.818+0000 7fa2c1cbf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 9 (PID: 24891) UID: 0 2024-04-18T14:43:52.848 INFO:teuthology.orchestra.run.smithi096.stdout:ERROR: (22) Invalid argument 2024-04-18T14:43:52.848 INFO:teuthology.orchestra.run.smithi096.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T14:43:52.862 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-18T14:43:52.922 INFO:tasks.ceph.osd.5.smithi096.stderr:2024-04-18T14:43:52.918+0000 7fc33f25b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 24889) UID: 0 2024-04-18T14:43:52.992 INFO:teuthology.orchestra.run.smithi119.stdout:ERROR: (22) Invalid argument 2024-04-18T14:43:52.993 INFO:teuthology.orchestra.run.smithi119.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T14:43:53.006 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-18T14:43:53.025 INFO:tasks.ceph.osd.13.smithi096.stderr:2024-04-18T14:43:53.026+0000 7f7e72fad640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 13 (PID: 24893) UID: 0 2024-04-18T14:43:53.125 INFO:teuthology.orchestra.run.smithi119.stdout:ERROR: (22) Invalid argument 2024-04-18T14:43:53.126 INFO:teuthology.orchestra.run.smithi119.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T14:43:53.128 INFO:tasks.ceph.osd.0.smithi086.stderr:2024-04-18T14:43:53.123+0000 7f7cdfd78640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 24953) UID: 0 2024-04-18T14:43:53.135 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-18T14:43:53.224 INFO:tasks.ceph.osd.10.smithi119.stderr:2024-04-18T14:43:53.226+0000 7f6f24c12640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 10 (PID: 24898) UID: 0 2024-04-18T14:43:53.270 INFO:teuthology.orchestra.run.smithi119.stdout:ERROR: (22) Invalid argument 2024-04-18T14:43:53.270 INFO:teuthology.orchestra.run.smithi119.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T14:43:53.284 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-04-18T14:43:53.330 INFO:tasks.ceph.osd.2.smithi119.stderr:2024-04-18T14:43:53.330+0000 7fcbd30c0640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 24894) UID: 0 2024-04-18T14:43:53.426 INFO:tasks.ceph.osd.9.smithi096.stderr:2024-04-18T14:43:53.426+0000 7fa2c1cbf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 9 (PID: 24891) UID: 0 2024-04-18T14:43:53.435 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-04-18T14:43:53.445 INFO:teuthology.orchestra.run.smithi086.stderr:reweighted osd.0 to 1 (10000) 2024-04-18T14:43:53.446 INFO:tasks.rados.rados.0.smithi134.stdout:159: done (0 left) 2024-04-18T14:43:53.446 INFO:tasks.rados.rados.0.smithi134.stdout:160: rollback oid 48 current snap is 15 2024-04-18T14:43:53.446 INFO:tasks.rados.rados.0.smithi134.stdout:rollback oid 48 to 7 2024-04-18T14:43:53.446 INFO:tasks.rados.rados.0.smithi134.stdout:append oid 5 current snap is 15 2024-04-18T14:43:53.446 INFO:tasks.rados.rados.0.smithi134.stdout:161: seq_num 74 ranges {1736704=475136,2211840=622592,2834432=147456} 2024-04-18T14:43:53.457 INFO:teuthology.orchestra.run.smithi119.stdout:ERROR: (22) Invalid argument 2024-04-18T14:43:53.457 INFO:teuthology.orchestra.run.smithi119.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T14:43:53.467 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 2 1 2024-04-18T14:43:53.471 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-04-18T14:43:53.482 INFO:tasks.rados.rados.0.smithi134.stdout:161: writing smithi13430248-5 from 1736704 to 2211840 tid 1 2024-04-18T14:43:53.492 INFO:tasks.rados.rados.0.smithi134.stdout:161: writing smithi13430248-5 from 2211840 to 2834432 tid 2 2024-04-18T14:43:53.495 INFO:tasks.rados.rados.0.smithi134.stdout:161: writing smithi13430248-5 from 2834432 to 2981888 tid 3 2024-04-18T14:43:53.495 INFO:tasks.rados.rados.0.smithi134.stdout:append oid 37 current snap is 15 2024-04-18T14:43:53.495 INFO:tasks.rados.rados.0.smithi134.stdout:160: finishing rollback tid 0 to smithi13430248-48 2024-04-18T14:43:53.495 INFO:tasks.rados.rados.0.smithi134.stdout:160: finishing rollback tid 1 to smithi13430248-48 2024-04-18T14:43:53.495 INFO:tasks.rados.rados.0.smithi134.stdout:160: finishing rollback tid 2 to smithi13430248-48 2024-04-18T14:43:53.495 INFO:tasks.rados.rados.0.smithi134.stdout:update_object_version oid 48 v 18 (ObjNum 47 snap 0 seq_num 47) dirty exists 2024-04-18T14:43:53.495 INFO:tasks.rados.rados.0.smithi134.stdout:162: seq_num 75 ranges {1490944=491520,1982464=770048} 2024-04-18T14:43:53.522 INFO:tasks.rados.rados.0.smithi134.stdout:162: writing smithi13430248-37 from 1490944 to 1982464 tid 1 2024-04-18T14:43:53.527 INFO:tasks.ceph.osd.10.smithi119.stderr:2024-04-18T14:43:53.526+0000 7f6f24c12640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 10 (PID: 24898) UID: 0 2024-04-18T14:43:53.533 INFO:tasks.rados.rados.0.smithi134.stdout:162: writing smithi13430248-37 from 1982464 to 2752512 tid 2 2024-04-18T14:43:53.534 INFO:tasks.rados.rados.0.smithi134.stdout:160: done (2 left) 2024-04-18T14:43:53.534 INFO:tasks.rados.rados.0.smithi134.stdout:append oid 28 current snap is 15 2024-04-18T14:43:53.534 INFO:tasks.rados.rados.0.smithi134.stdout:161: finishing write tid 1 to smithi13430248-5 2024-04-18T14:43:53.534 INFO:tasks.rados.rados.0.smithi134.stdout:161: finishing write tid 2 to smithi13430248-5 2024-04-18T14:43:53.534 INFO:tasks.rados.rados.0.smithi134.stdout:161: finishing write tid 3 to smithi13430248-5 2024-04-18T14:43:53.534 INFO:tasks.rados.rados.0.smithi134.stdout:161: finishing write tid 4 to smithi13430248-5 2024-04-18T14:43:53.534 INFO:tasks.rados.rados.0.smithi134.stdout:161: finishing write tid 5 to smithi13430248-5 2024-04-18T14:43:53.534 INFO:tasks.rados.rados.0.smithi134.stdout:161: oid 5 updating version 0 to 43 2024-04-18T14:43:53.534 INFO:tasks.rados.rados.0.smithi134.stdout:161: oid 5 updating version 43 to 44 2024-04-18T14:43:53.534 INFO:tasks.rados.rados.0.smithi134.stdout:161: oid 5 updating version 44 to 45 2024-04-18T14:43:53.534 INFO:tasks.rados.rados.0.smithi134.stdout:161: oid 5 version 45 is already newer than 42 2024-04-18T14:43:53.534 INFO:tasks.rados.rados.0.smithi134.stdout:update_object_version oid 5 v 45 (ObjNum 74 snap 15 seq_num 74) dirty exists 2024-04-18T14:43:53.534 INFO:tasks.rados.rados.0.smithi134.stdout:161: left oid 5 (ObjNum 74 snap 15 seq_num 74) 2024-04-18T14:43:53.535 INFO:tasks.rados.rados.0.smithi134.stdout:162: finishing write tid 1 to smithi13430248-37 2024-04-18T14:43:53.535 INFO:tasks.rados.rados.0.smithi134.stdout:163: seq_num 76 ranges {458752=507904,966656=507904,1474560=262144} 2024-04-18T14:43:53.544 INFO:tasks.rados.rados.0.smithi134.stdout:163: writing smithi13430248-28 from 458752 to 966656 tid 1 2024-04-18T14:43:53.550 INFO:tasks.rados.rados.0.smithi134.stdout:163: writing smithi13430248-28 from 966656 to 1474560 tid 2 2024-04-18T14:43:53.552 INFO:tasks.rados.rados.0.smithi134.stdout:163: writing smithi13430248-28 from 1474560 to 1736704 tid 3 2024-04-18T14:43:53.552 INFO:tasks.rados.rados.0.smithi134.stdout:161: done (2 left) 2024-04-18T14:43:53.552 INFO:tasks.rados.rados.0.smithi134.stdout:append oid 44 current snap is 15 2024-04-18T14:43:53.552 INFO:tasks.rados.rados.0.smithi134.stdout:162: finishing write tid 2 to smithi13430248-37 2024-04-18T14:43:53.552 INFO:tasks.rados.rados.0.smithi134.stdout:162: finishing write tid 3 to smithi13430248-37 2024-04-18T14:43:53.552 INFO:tasks.rados.rados.0.smithi134.stdout:162: finishing write tid 4 to smithi13430248-37 2024-04-18T14:43:53.552 INFO:tasks.rados.rados.0.smithi134.stdout:162: oid 37 updating version 0 to 31 2024-04-18T14:43:53.553 INFO:tasks.rados.rados.0.smithi134.stdout:162: oid 37 updating version 31 to 32 2024-04-18T14:43:53.553 INFO:tasks.rados.rados.0.smithi134.stdout:162: oid 37 version 32 is already newer than 30 2024-04-18T14:43:53.553 INFO:tasks.rados.rados.0.smithi134.stdout:update_object_version oid 37 v 32 (ObjNum 75 snap 15 seq_num 75) dirty exists 2024-04-18T14:43:53.553 INFO:tasks.rados.rados.0.smithi134.stdout:162: left oid 37 (ObjNum 75 snap 15 seq_num 75) 2024-04-18T14:43:53.553 INFO:tasks.rados.rados.0.smithi134.stdout:164: seq_num 77 ranges {1916928=524288,2441216=524288,2965504=245760} 2024-04-18T14:43:53.571 INFO:tasks.rados.rados.0.smithi134.stdout:164: writing smithi13430248-44 from 1916928 to 2441216 tid 1 2024-04-18T14:43:53.576 INFO:tasks.rados.rados.0.smithi134.stdout:164: writing smithi13430248-44 from 2441216 to 2965504 tid 2 2024-04-18T14:43:53.578 INFO:tasks.rados.rados.0.smithi134.stdout:164: writing smithi13430248-44 from 2965504 to 3211264 tid 3 2024-04-18T14:43:53.578 INFO:tasks.rados.rados.0.smithi134.stdout:162: done (2 left) 2024-04-18T14:43:53.578 INFO:tasks.rados.rados.0.smithi134.stdout:165: delete oid 1 current snap is 15 2024-04-18T14:43:53.578 INFO:tasks.rados.rados.0.smithi134.stdout:163: finishing write tid 1 to smithi13430248-28 2024-04-18T14:43:53.579 INFO:tasks.rados.rados.0.smithi134.stdout:163: finishing write tid 2 to smithi13430248-28 2024-04-18T14:43:53.579 INFO:tasks.rados.rados.0.smithi134.stdout:163: finishing write tid 3 to smithi13430248-28 2024-04-18T14:43:53.579 INFO:tasks.rados.rados.0.smithi134.stdout:163: finishing write tid 4 to smithi13430248-28 2024-04-18T14:43:53.579 INFO:tasks.rados.rados.0.smithi134.stdout:163: finishing write tid 5 to smithi13430248-28 2024-04-18T14:43:53.579 INFO:tasks.rados.rados.0.smithi134.stdout:163: oid 28 updating version 0 to 25 2024-04-18T14:43:53.579 INFO:tasks.rados.rados.0.smithi134.stdout:163: oid 28 version 25 is already newer than 23 2024-04-18T14:43:53.579 INFO:tasks.rados.rados.0.smithi134.stdout:163: oid 28 updating version 25 to 26 2024-04-18T14:43:53.579 INFO:tasks.rados.rados.0.smithi134.stdout:163: oid 28 version 26 is already newer than 24 2024-04-18T14:43:53.579 INFO:tasks.rados.rados.0.smithi134.stdout:update_object_version oid 28 v 26 (ObjNum 76 snap 15 seq_num 76) dirty exists 2024-04-18T14:43:53.579 INFO:tasks.rados.rados.0.smithi134.stdout:163: left oid 28 (ObjNum 76 snap 15 seq_num 76) 2024-04-18T14:43:53.587 INFO:tasks.rados.rados.0.smithi134.stdout:164: finishing write tid 1 to smithi13430248-44 2024-04-18T14:43:53.588 INFO:tasks.rados.rados.0.smithi134.stdout:164: finishing write tid 2 to smithi13430248-44 2024-04-18T14:43:53.588 INFO:tasks.rados.rados.0.smithi134.stdout:163: done (2 left) 2024-04-18T14:43:53.589 INFO:tasks.rados.rados.0.smithi134.stdout:165: done (1 left) 2024-04-18T14:43:53.589 INFO:tasks.rados.rados.0.smithi134.stdout:append oid 21 current snap is 15 2024-04-18T14:43:53.589 INFO:tasks.rados.rados.0.smithi134.stdout:166: seq_num 79 ranges {344064=573440,917504=425984,1343488=344064} 2024-04-18T14:43:53.597 INFO:tasks.rados.rados.0.smithi134.stdout:166: writing smithi13430248-21 from 344064 to 917504 tid 1 2024-04-18T14:43:53.600 INFO:tasks.rados.rados.0.smithi134.stdout:166: writing smithi13430248-21 from 917504 to 1343488 tid 2 2024-04-18T14:43:53.601 INFO:teuthology.orchestra.run.smithi119.stdout:ERROR: (22) Invalid argument 2024-04-18T14:43:53.601 INFO:teuthology.orchestra.run.smithi119.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T14:43:53.603 INFO:tasks.rados.rados.0.smithi134.stdout:166: writing smithi13430248-21 from 1343488 to 1687552 tid 3 2024-04-18T14:43:53.603 INFO:tasks.rados.rados.0.smithi134.stdout:167: copy_from oid 7 from oid 10 current snap is 15 2024-04-18T14:43:53.603 INFO:tasks.rados.rados.0.smithi134.stdout:164: finishing write tid 3 to smithi13430248-44 2024-04-18T14:43:53.603 INFO:tasks.rados.rados.0.smithi134.stdout:164: finishing write tid 4 to smithi13430248-44 2024-04-18T14:43:53.603 INFO:tasks.rados.rados.0.smithi134.stdout:164: finishing write tid 5 to smithi13430248-44 2024-04-18T14:43:53.603 INFO:tasks.rados.rados.0.smithi134.stdout:164: oid 44 updating version 0 to 17 2024-04-18T14:43:53.603 INFO:tasks.rados.rados.0.smithi134.stdout:164: oid 44 version 17 is already newer than 15 2024-04-18T14:43:53.603 INFO:tasks.rados.rados.0.smithi134.stdout:164: oid 44 version 17 is already newer than 16 2024-04-18T14:43:53.603 INFO:tasks.rados.rados.0.smithi134.stdout:164: oid 44 version 17 is already newer than 14 2024-04-18T14:43:53.604 INFO:tasks.rados.rados.0.smithi134.stdout:update_object_version oid 44 v 17 (ObjNum 77 snap 15 seq_num 77) dirty exists 2024-04-18T14:43:53.604 INFO:tasks.rados.rados.0.smithi134.stdout:164: left oid 44 (ObjNum 77 snap 15 seq_num 77) 2024-04-18T14:43:53.604 INFO:tasks.rados.rados.0.smithi134.stdout:164: done (2 left) 2024-04-18T14:43:53.604 INFO:tasks.rados.rados.0.smithi134.stdout:append oid 38 current snap is 15 2024-04-18T14:43:53.604 INFO:tasks.rados.rados.0.smithi134.stdout:168: seq_num 80 ranges {1638400=589824,2228224=573440,2801664=196608} 2024-04-18T14:43:53.618 INFO:tasks.rados.rados.0.smithi134.stdout:168: writing smithi13430248-38 from 1638400 to 2228224 tid 1 2024-04-18T14:43:53.619 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-04-18T14:43:53.622 INFO:tasks.rados.rados.0.smithi134.stdout:168: writing smithi13430248-38 from 2228224 to 2801664 tid 2 2024-04-18T14:43:53.623 INFO:tasks.rados.rados.0.smithi134.stdout:168: writing smithi13430248-38 from 2801664 to 2998272 tid 3 2024-04-18T14:43:53.623 INFO:tasks.rados.rados.0.smithi134.stdout:append oid 25 current snap is 15 2024-04-18T14:43:53.623 INFO:tasks.rados.rados.0.smithi134.stdout:166: finishing write tid 1 to smithi13430248-21 2024-04-18T14:43:53.623 INFO:tasks.rados.rados.0.smithi134.stdout:169: seq_num 81 ranges {0=606208,606208=720896,1327104=49152} 2024-04-18T14:43:53.627 INFO:tasks.rados.rados.0.smithi134.stdout:169: writing smithi13430248-25 from 0 to 606208 tid 1 2024-04-18T14:43:53.628 INFO:tasks.ceph.osd.1.smithi096.stderr:2024-04-18T14:43:53.626+0000 7f56a7a98640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 24887) UID: 0 2024-04-18T14:43:53.631 INFO:tasks.rados.rados.0.smithi134.stdout:169: writing smithi13430248-25 from 606208 to 1327104 tid 2 2024-04-18T14:43:53.633 INFO:tasks.rados.rados.0.smithi134.stdout:169: writing smithi13430248-25 from 1327104 to 1376256 tid 3 2024-04-18T14:43:53.633 INFO:tasks.rados.rados.0.smithi134.stdout:170: delete oid 2 current snap is 15 2024-04-18T14:43:53.633 INFO:tasks.rados.rados.0.smithi134.stdout:166: finishing write tid 2 to smithi13430248-21 2024-04-18T14:43:53.633 INFO:tasks.rados.rados.0.smithi134.stdout:166: finishing write tid 3 to smithi13430248-21 2024-04-18T14:43:53.633 INFO:tasks.rados.rados.0.smithi134.stdout:166: finishing write tid 4 to smithi13430248-21 2024-04-18T14:43:53.633 INFO:tasks.rados.rados.0.smithi134.stdout:167: finishing copy_from racing read to smithi13430248-7 2024-04-18T14:43:53.633 INFO:tasks.rados.rados.0.smithi134.stdout:166: finishing write tid 5 to smithi13430248-21 2024-04-18T14:43:53.633 INFO:tasks.rados.rados.0.smithi134.stdout:166: oid 21 updating version 0 to 40 2024-04-18T14:43:53.634 INFO:tasks.rados.rados.0.smithi134.stdout:166: oid 21 updating version 40 to 41 2024-04-18T14:43:53.634 INFO:tasks.rados.rados.0.smithi134.stdout:166: oid 21 version 41 is already newer than 39 2024-04-18T14:43:53.634 INFO:tasks.rados.rados.0.smithi134.stdout:166: oid 21 version 41 is already newer than 38 2024-04-18T14:43:53.634 INFO:tasks.rados.rados.0.smithi134.stdout:update_object_version oid 21 v 41 (ObjNum 79 snap 15 seq_num 79) dirty exists 2024-04-18T14:43:53.634 INFO:tasks.rados.rados.0.smithi134.stdout:166: left oid 21 (ObjNum 79 snap 15 seq_num 79) 2024-04-18T14:43:53.634 INFO:tasks.rados.rados.0.smithi134.stdout:167: finishing copy_from to smithi13430248-7 2024-04-18T14:43:53.634 INFO:tasks.rados.rados.0.smithi134.stdout:update_object_version oid 7 v 16 (ObjNum 58 snap 4 seq_num 58) dirty exists 2024-04-18T14:43:53.634 INFO:tasks.rados.rados.0.smithi134.stdout:168: finishing write tid 1 to smithi13430248-38 2024-04-18T14:43:53.634 INFO:tasks.rados.rados.0.smithi134.stdout:168: finishing write tid 2 to smithi13430248-38 2024-04-18T14:43:53.634 INFO:tasks.rados.rados.0.smithi134.stdout:168: finishing write tid 3 to smithi13430248-38 2024-04-18T14:43:53.634 INFO:tasks.rados.rados.0.smithi134.stdout:168: finishing write tid 4 to smithi13430248-38 2024-04-18T14:43:53.638 INFO:tasks.rados.rados.0.smithi134.stdout:166: done (4 left) 2024-04-18T14:43:53.638 INFO:tasks.rados.rados.0.smithi134.stdout:167: done (3 left) 2024-04-18T14:43:53.638 INFO:tasks.rados.rados.0.smithi134.stdout:170: done (2 left) 2024-04-18T14:43:53.638 INFO:tasks.rados.rados.0.smithi134.stdout:171: read oid 47 snap -1 2024-04-18T14:43:53.638 INFO:tasks.rados.rados.0.smithi134.stdout:171: expect (ObjNum 46 snap 0 seq_num 46) 2024-04-18T14:43:53.638 INFO:tasks.rados.rados.0.smithi134.stdout:172: copy_from oid 8 from oid 17 current snap is 15 2024-04-18T14:43:53.639 INFO:tasks.rados.rados.0.smithi134.stdout:173: rollback oid 34 current snap is 15 2024-04-18T14:43:53.639 INFO:tasks.rados.rados.0.smithi134.stdout:rollback oid 34 to 14 2024-04-18T14:43:53.639 INFO:tasks.rados.rados.0.smithi134.stdout:174: read oid 5 snap -1 2024-04-18T14:43:53.639 INFO:tasks.rados.rados.0.smithi134.stdout:174: expect (ObjNum 74 snap 15 seq_num 74) 2024-04-18T14:43:53.639 INFO:tasks.rados.rados.0.smithi134.stdout:append oid 44 current snap is 15 2024-04-18T14:43:53.639 INFO:tasks.rados.rados.0.smithi134.stdout:175: seq_num 83 ranges {3211264=638976,3850240=622592,4472832=147456} 2024-04-18T14:43:53.660 INFO:tasks.rados.rados.0.smithi134.stdout:175: writing smithi13430248-44 from 3211264 to 3850240 tid 1 2024-04-18T14:43:53.664 INFO:tasks.rados.rados.0.smithi134.stdout:175: writing smithi13430248-44 from 3850240 to 4472832 tid 2 2024-04-18T14:43:53.665 INFO:tasks.rados.rados.0.smithi134.stdout:175: writing smithi13430248-44 from 4472832 to 4620288 tid 3 2024-04-18T14:43:53.665 INFO:tasks.rados.rados.0.smithi134.stdout:append oid 20 current snap is 15 2024-04-18T14:43:53.665 INFO:tasks.rados.rados.0.smithi134.stdout:169: finishing write tid 1 to smithi13430248-25 2024-04-18T14:43:53.665 INFO:tasks.rados.rados.0.smithi134.stdout:176: seq_num 84 ranges {0=655360,655360=638976,1294336=131072} 2024-04-18T14:43:53.669 INFO:tasks.rados.rados.0.smithi134.stdout:176: writing smithi13430248-20 from 0 to 655360 tid 1 2024-04-18T14:43:53.673 INFO:tasks.rados.rados.0.smithi134.stdout:176: writing smithi13430248-20 from 655360 to 1294336 tid 2 2024-04-18T14:43:53.675 INFO:tasks.rados.rados.0.smithi134.stdout:176: writing smithi13430248-20 from 1294336 to 1425408 tid 3 2024-04-18T14:43:53.675 INFO:tasks.rados.rados.0.smithi134.stdout:append oid 3 current snap is 15 2024-04-18T14:43:53.675 INFO:tasks.rados.rados.0.smithi134.stdout:168: finishing write tid 5 to smithi13430248-38 2024-04-18T14:43:53.675 INFO:tasks.rados.rados.0.smithi134.stdout:168: oid 38 updating version 0 to 48 2024-04-18T14:43:53.675 INFO:tasks.rados.rados.0.smithi134.stdout:168: oid 38 updating version 48 to 51 2024-04-18T14:43:53.675 INFO:tasks.rados.rados.0.smithi134.stdout:168: oid 38 version 51 is already newer than 50 2024-04-18T14:43:53.675 INFO:tasks.rados.rados.0.smithi134.stdout:168: oid 38 version 51 is already newer than 49 2024-04-18T14:43:53.675 INFO:tasks.rados.rados.0.smithi134.stdout:update_object_version oid 38 v 51 (ObjNum 80 snap 15 seq_num 80) dirty exists 2024-04-18T14:43:53.675 INFO:tasks.rados.rados.0.smithi134.stdout:168: left oid 38 (ObjNum 80 snap 15 seq_num 80) 2024-04-18T14:43:53.675 INFO:tasks.rados.rados.0.smithi134.stdout:169: finishing write tid 2 to smithi13430248-25 2024-04-18T14:43:53.675 INFO:tasks.rados.rados.0.smithi134.stdout:173: finishing rollback tid 0 to smithi13430248-34 2024-04-18T14:43:53.675 INFO:tasks.rados.rados.0.smithi134.stdout:169: finishing write tid 3 to smithi13430248-25 2024-04-18T14:43:53.675 INFO:tasks.rados.rados.0.smithi134.stdout:169: finishing write tid 4 to smithi13430248-25 2024-04-18T14:43:53.675 INFO:tasks.rados.rados.0.smithi134.stdout:173: finishing rollback tid 1 to smithi13430248-34 2024-04-18T14:43:53.676 INFO:tasks.rados.rados.0.smithi134.stdout:173: finishing rollback tid 2 to smithi13430248-34 2024-04-18T14:43:53.676 INFO:tasks.rados.rados.0.smithi134.stdout:update_object_version oid 34 v 17 (ObjNum 33 snap 0 seq_num 33) dirty exists 2024-04-18T14:43:53.676 INFO:tasks.rados.rados.0.smithi134.stdout:171: expect (ObjNum 46 snap 0 seq_num 46) 2024-04-18T14:43:53.729 INFO:tasks.ceph.osd.1.smithi096.stderr:2024-04-18T14:43:53.726+0000 7f56a7a98640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 24887) UID: 0 2024-04-18T14:43:53.732 INFO:tasks.rados.rados.0.smithi134.stdout:169: finishing write tid 5 to smithi13430248-25 2024-04-18T14:43:53.732 INFO:tasks.rados.rados.0.smithi134.stdout:169: oid 25 updating version 0 to 52 2024-04-18T14:43:53.732 INFO:tasks.rados.rados.0.smithi134.stdout:169: oid 25 updating version 52 to 55 2024-04-18T14:43:53.732 INFO:tasks.rados.rados.0.smithi134.stdout:169: oid 25 version 55 is already newer than 53 2024-04-18T14:43:53.732 INFO:tasks.rados.rados.0.smithi134.stdout:169: oid 25 version 55 is already newer than 54 2024-04-18T14:43:53.733 INFO:tasks.rados.rados.0.smithi134.stdout:update_object_version oid 25 v 55 (ObjNum 81 snap 15 seq_num 81) dirty exists 2024-04-18T14:43:53.733 INFO:tasks.rados.rados.0.smithi134.stdout:169: left oid 25 (ObjNum 81 snap 15 seq_num 81) 2024-04-18T14:43:53.733 INFO:tasks.rados.rados.0.smithi134.stdout:172: finishing copy_from racing read to smithi13430248-8 2024-04-18T14:43:53.733 INFO:tasks.rados.rados.0.smithi134.stdout:172: finishing copy_from to smithi13430248-8 2024-04-18T14:43:53.733 INFO:tasks.rados.rados.0.smithi134.stdout:update_object_version oid 8 v 12 (ObjNum 37 snap 0 seq_num 37) dirty exists 2024-04-18T14:43:53.733 INFO:tasks.rados.rados.0.smithi134.stdout:174: expect (ObjNum 74 snap 15 seq_num 74) 2024-04-18T14:43:53.775 INFO:teuthology.orchestra.run.smithi119.stdout:ERROR: (22) Invalid argument 2024-04-18T14:43:53.775 INFO:teuthology.orchestra.run.smithi119.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T14:43:53.790 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.10.asok dump_ops_in_flight 2024-04-18T14:43:53.829 INFO:tasks.ceph.osd.13.smithi096.stderr:2024-04-18T14:43:53.826+0000 7f7e72fad640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 13 (PID: 24893) UID: 0 2024-04-18T14:43:53.857 INFO:tasks.rados.rados.0.smithi134.stdout:175: finishing write tid 1 to smithi13430248-44 2024-04-18T14:43:53.858 INFO:tasks.rados.rados.0.smithi134.stdout:175: finishing write tid 2 to smithi13430248-44 2024-04-18T14:43:53.858 INFO:tasks.rados.rados.0.smithi134.stdout:175: finishing write tid 3 to smithi13430248-44 2024-04-18T14:43:53.858 INFO:tasks.rados.rados.0.smithi134.stdout:175: finishing write tid 4 to smithi13430248-44 2024-04-18T14:43:53.858 INFO:tasks.rados.rados.0.smithi134.stdout:176: finishing write tid 1 to smithi13430248-20 2024-04-18T14:43:53.858 INFO:tasks.rados.rados.0.smithi134.stdout:176: finishing write tid 2 to smithi13430248-20 2024-04-18T14:43:53.858 INFO:tasks.rados.rados.0.smithi134.stdout:176: finishing write tid 3 to smithi13430248-20 2024-04-18T14:43:53.858 INFO:tasks.rados.rados.0.smithi134.stdout:176: finishing write tid 4 to smithi13430248-20 2024-04-18T14:43:53.858 INFO:tasks.rados.rados.0.smithi134.stdout:175: finishing write tid 5 to smithi13430248-44 2024-04-18T14:43:53.858 INFO:tasks.rados.rados.0.smithi134.stdout:175: oid 44 updating version 0 to 23 2024-04-18T14:43:53.858 INFO:tasks.rados.rados.0.smithi134.stdout:175: oid 44 version 23 is already newer than 21 2024-04-18T14:43:53.858 INFO:tasks.rados.rados.0.smithi134.stdout:175: oid 44 version 23 is already newer than 22 2024-04-18T14:43:53.858 INFO:tasks.rados.rados.0.smithi134.stdout:175: oid 44 version 23 is already newer than 20 2024-04-18T14:43:53.858 INFO:tasks.rados.rados.0.smithi134.stdout:update_object_version oid 44 v 23 (ObjNum 83 snap 15 seq_num 83) dirty exists 2024-04-18T14:43:53.858 INFO:tasks.rados.rados.0.smithi134.stdout:175: left oid 44 (ObjNum 83 snap 15 seq_num 83) 2024-04-18T14:43:53.859 INFO:tasks.rados.rados.0.smithi134.stdout:176: finishing write tid 5 to smithi13430248-20 2024-04-18T14:43:53.859 INFO:tasks.rados.rados.0.smithi134.stdout:176: oid 20 updating version 0 to 34 2024-04-18T14:43:53.859 INFO:tasks.rados.rados.0.smithi134.stdout:176: oid 20 updating version 34 to 35 2024-04-18T14:43:53.859 INFO:tasks.rados.rados.0.smithi134.stdout:176: oid 20 updating version 35 to 36 2024-04-18T14:43:53.859 INFO:tasks.rados.rados.0.smithi134.stdout:176: oid 20 version 36 is already newer than 33 2024-04-18T14:43:53.859 INFO:tasks.rados.rados.0.smithi134.stdout:update_object_version oid 20 v 36 (ObjNum 84 snap 15 seq_num 84) dirty exists 2024-04-18T14:43:53.859 INFO:tasks.rados.rados.0.smithi134.stdout:176: left oid 20 (ObjNum 84 snap 15 seq_num 84) 2024-04-18T14:43:53.859 INFO:tasks.rados.rados.0.smithi134.stdout:177: seq_num 85 ranges {49152=671744,720896=770048} 2024-04-18T14:43:53.862 INFO:tasks.rados.rados.0.smithi134.stdout:177: writing smithi13430248-3 from 49152 to 720896 tid 1 2024-04-18T14:43:53.867 INFO:tasks.rados.rados.0.smithi134.stdout:177: writing smithi13430248-3 from 720896 to 1490944 tid 2 2024-04-18T14:43:53.867 INFO:tasks.rados.rados.0.smithi134.stdout:168: done (8 left) 2024-04-18T14:43:53.867 INFO:tasks.rados.rados.0.smithi134.stdout:169: done (7 left) 2024-04-18T14:43:53.868 INFO:tasks.rados.rados.0.smithi134.stdout:171: done (6 left) 2024-04-18T14:43:53.868 INFO:tasks.rados.rados.0.smithi134.stdout:172: done (5 left) 2024-04-18T14:43:53.868 INFO:tasks.rados.rados.0.smithi134.stdout:173: done (4 left) 2024-04-18T14:43:53.868 INFO:tasks.rados.rados.0.smithi134.stdout:174: done (3 left) 2024-04-18T14:43:53.868 INFO:tasks.rados.rados.0.smithi134.stdout:175: done (2 left) 2024-04-18T14:43:53.868 INFO:tasks.rados.rados.0.smithi134.stdout:176: done (1 left) 2024-04-18T14:43:53.868 INFO:tasks.rados.rados.0.smithi134.stdout:178: delete oid 42 current snap is 15 2024-04-18T14:43:53.870 INFO:tasks.rados.rados.0.smithi134.stdout:178: done (1 left) 2024-04-18T14:43:53.870 INFO:tasks.rados.rados.0.smithi134.stdout:179: setattr oid 6 current snap is 15 2024-04-18T14:43:53.872 INFO:tasks.rados.rados.0.smithi134.stdout:180: read oid 39 snap 7 2024-04-18T14:43:53.873 INFO:tasks.rados.rados.0.smithi134.stdout:180: expect (ObjNum 38 snap 0 seq_num 38) 2024-04-18T14:43:53.873 INFO:tasks.rados.rados.0.smithi134.stdout:181: rollback oid 45 current snap is 15 2024-04-18T14:43:53.873 INFO:tasks.rados.rados.0.smithi134.stdout:rollback oid 45 to 4 2024-04-18T14:43:53.873 INFO:tasks.rados.rados.0.smithi134.stdout:182: rollback oid 15 current snap is 15 2024-04-18T14:43:53.873 INFO:tasks.rados.rados.0.smithi134.stdout:rollback oid 15 to 11 2024-04-18T14:43:53.873 INFO:tasks.rados.rados.0.smithi134.stdout:183: rollback oid 42 current snap is 15 2024-04-18T14:43:53.873 INFO:tasks.rados.rados.0.smithi134.stdout:rollback oid 42 to 9 2024-04-18T14:43:53.873 INFO:tasks.rados.rados.0.smithi134.stdout:184: snap_create 2024-04-18T14:43:53.873 INFO:tasks.rados.rados.0.smithi134.stdout:177: finishing write tid 1 to smithi13430248-3 2024-04-18T14:43:53.876 INFO:tasks.rados.rados.0.smithi134.stdout:183: finishing rollback tid 1 to smithi13430248-42 2024-04-18T14:43:53.877 INFO:tasks.rados.rados.0.smithi134.stdout:update_object_version oid 42 v 8 (ObjNum 161 snap 0 seq_num 2054018784) dirty dne 2024-04-18T14:43:53.879 INFO:tasks.rados.rados.0.smithi134.stdout:177: finishing write tid 2 to smithi13430248-3 2024-04-18T14:43:53.880 INFO:tasks.rados.rados.0.smithi134.stdout:177: finishing write tid 3 to smithi13430248-3 2024-04-18T14:43:53.881 INFO:tasks.rados.rados.0.smithi134.stdout:182: finishing rollback tid 0 to smithi13430248-15 2024-04-18T14:43:53.882 INFO:tasks.rados.rados.0.smithi134.stdout:177: finishing write tid 4 to smithi13430248-3 2024-04-18T14:43:53.882 INFO:tasks.rados.rados.0.smithi134.stdout:177: oid 3 updating version 0 to 30 2024-04-18T14:43:53.882 INFO:tasks.rados.rados.0.smithi134.stdout:177: oid 3 version 30 is already newer than 28 2024-04-18T14:43:53.882 INFO:tasks.rados.rados.0.smithi134.stdout:177: oid 3 version 30 is already newer than 29 2024-04-18T14:43:53.882 INFO:tasks.rados.rados.0.smithi134.stdout:update_object_version oid 3 v 30 (ObjNum 85 snap 15 seq_num 85) dirty exists 2024-04-18T14:43:53.882 INFO:tasks.rados.rados.0.smithi134.stdout:177: left oid 3 (ObjNum 85 snap 15 seq_num 85) 2024-04-18T14:43:53.883 INFO:tasks.rados.rados.0.smithi134.stdout:182: finishing rollback tid 1 to smithi13430248-15 2024-04-18T14:43:53.883 INFO:tasks.rados.rados.0.smithi134.stdout:update_object_version oid 6 v 32 (ObjNum 68 snap 9 seq_num 68) dirty exists 2024-04-18T14:43:53.883 INFO:tasks.rados.rados.0.smithi134.stdout:182: finishing rollback tid 2 to smithi13430248-15 2024-04-18T14:43:53.883 INFO:tasks.rados.rados.0.smithi134.stdout:update_object_version oid 15 v 22 (ObjNum 35 snap 0 seq_num 35) dirty exists 2024-04-18T14:43:53.886 INFO:tasks.rados.rados.0.smithi134.stdout:180: expect (ObjNum 38 snap 0 seq_num 38) 2024-04-18T14:43:53.903 INFO:tasks.rados.rados.0.smithi134.stdout:181: finishing rollback tid 0 to smithi13430248-45 2024-04-18T14:43:53.903 INFO:tasks.rados.rados.0.smithi134.stdout:181: finishing rollback tid 1 to smithi13430248-45 2024-04-18T14:43:53.903 INFO:tasks.rados.rados.0.smithi134.stdout:181: finishing rollback tid 2 to smithi13430248-45 2024-04-18T14:43:53.903 INFO:tasks.rados.rados.0.smithi134.stdout:update_object_version oid 45 v 48 (ObjNum 44 snap 0 seq_num 44) dirty exists 2024-04-18T14:43:53.917 INFO:teuthology.orchestra.run.smithi119.stdout:ERROR: (22) Invalid argument 2024-04-18T14:43:53.917 INFO:teuthology.orchestra.run.smithi119.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T14:43:53.930 INFO:tasks.ceph.osd.2.smithi119.stderr:2024-04-18T14:43:53.930+0000 7fcbd30c0640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 24894) UID: 0 2024-04-18T14:43:53.931 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.10.asok dump_blocked_ops 2024-04-18T14:43:54.030 INFO:tasks.ceph.osd.1.smithi096.stderr:2024-04-18T14:43:54.030+0000 7f56a7a98640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 24887) UID: 0 2024-04-18T14:43:54.094 INFO:teuthology.orchestra.run.smithi119.stdout:ERROR: (22) Invalid argument 2024-04-18T14:43:54.094 INFO:teuthology.orchestra.run.smithi119.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T14:43:54.108 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.10.asok dump_historic_ops 2024-04-18T14:43:54.156 INFO:tasks.ceph.osd.6.smithi119.stderr:2024-04-18T14:43:54.158+0000 7fb7cb8bd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 24896) UID: 0 2024-04-18T14:43:54.201 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-18T14:43:54.225 INFO:teuthology.orchestra.run.smithi119.stdout:ERROR: (22) Invalid argument 2024-04-18T14:43:54.225 INFO:teuthology.orchestra.run.smithi119.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T14:43:54.232 INFO:tasks.ceph.osd.1.smithi096.stderr:2024-04-18T14:43:54.230+0000 7f56a7a98640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 24887) UID: 0 2024-04-18T14:43:54.239 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.14.asok dump_ops_in_flight 2024-04-18T14:43:54.333 INFO:tasks.ceph.osd.3.smithi134.stderr:2024-04-18T14:43:54.336+0000 7fe7a4443640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25211) UID: 0 2024-04-18T14:43:54.358 INFO:teuthology.orchestra.run.smithi086.stdout:osd.0: {} 2024-04-18T14:43:54.358 INFO:teuthology.orchestra.run.smithi086.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-18T14:43:54.367 INFO:teuthology.orchestra.run.smithi086.stderr:nodeep-scrub is set 2024-04-18T14:43:54.369 INFO:teuthology.orchestra.run.smithi086.stderr:reweighted osd.2 to 1 (10000) 2024-04-18T14:43:54.372 INFO:tasks.rados.rados.0.smithi134.stdout:177: done (6 left) 2024-04-18T14:43:54.372 INFO:tasks.rados.rados.0.smithi134.stdout:179: done (5 left) 2024-04-18T14:43:54.372 INFO:tasks.rados.rados.0.smithi134.stdout:180: done (4 left) 2024-04-18T14:43:54.372 INFO:tasks.rados.rados.0.smithi134.stdout:181: done (3 left) 2024-04-18T14:43:54.372 INFO:tasks.rados.rados.0.smithi134.stdout:182: done (2 left) 2024-04-18T14:43:54.372 INFO:tasks.rados.rados.0.smithi134.stdout:183: done (1 left) 2024-04-18T14:43:54.372 INFO:tasks.rados.rados.0.smithi134.stdout:184: done (0 left) 2024-04-18T14:43:54.372 INFO:tasks.rados.rados.0.smithi134.stdout:185: rollback oid 16 current snap is 16 2024-04-18T14:43:54.372 INFO:tasks.rados.rados.0.smithi134.stdout:rollback oid 16 to 4 2024-04-18T14:43:54.372 INFO:tasks.rados.rados.0.smithi134.stdout:186: read oid 3 snap -1 2024-04-18T14:43:54.372 INFO:tasks.rados.rados.0.smithi134.stdout:186: expect (ObjNum 85 snap 15 seq_num 85) 2024-04-18T14:43:54.372 INFO:tasks.rados.rados.0.smithi134.stdout:187: snap_remove snap 15 2024-04-18T14:43:54.388 INFO:teuthology.orchestra.run.smithi086.stdout:osd.1: {} 2024-04-18T14:43:54.388 INFO:teuthology.orchestra.run.smithi086.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-18T14:43:54.397 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 3 1 2024-04-18T14:43:54.408 INFO:teuthology.orchestra.run.smithi086.stdout:osd.2: {} 2024-04-18T14:43:54.409 INFO:teuthology.orchestra.run.smithi086.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-18T14:43:54.410 INFO:teuthology.orchestra.run.smithi119.stdout:ERROR: (22) Invalid argument 2024-04-18T14:43:54.411 INFO:teuthology.orchestra.run.smithi119.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T14:43:54.425 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.14.asok dump_blocked_ops 2024-04-18T14:43:54.428 INFO:teuthology.orchestra.run.smithi086.stdout:osd.3: {} 2024-04-18T14:43:54.428 INFO:teuthology.orchestra.run.smithi086.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-18T14:43:54.434 INFO:tasks.ceph.osd.5.smithi096.stderr:2024-04-18T14:43:54.430+0000 7fc33f25b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 24889) UID: 0 2024-04-18T14:43:54.446 INFO:teuthology.orchestra.run.smithi086.stdout:osd.4: {} 2024-04-18T14:43:54.446 INFO:teuthology.orchestra.run.smithi086.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-18T14:43:54.466 INFO:teuthology.orchestra.run.smithi086.stdout:osd.5: {} 2024-04-18T14:43:54.466 INFO:teuthology.orchestra.run.smithi086.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-18T14:43:54.483 INFO:teuthology.orchestra.run.smithi086.stdout:osd.6: {} 2024-04-18T14:43:54.483 INFO:teuthology.orchestra.run.smithi086.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-18T14:43:54.502 INFO:teuthology.orchestra.run.smithi086.stdout:osd.7: {} 2024-04-18T14:43:54.502 INFO:teuthology.orchestra.run.smithi086.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-18T14:43:54.519 INFO:teuthology.orchestra.run.smithi086.stdout:osd.8: {} 2024-04-18T14:43:54.519 INFO:teuthology.orchestra.run.smithi086.stderr:osd.8: osd_enable_op_tracker = '' 2024-04-18T14:43:54.534 INFO:tasks.ceph.osd.7.smithi134.stderr:2024-04-18T14:43:54.536+0000 7fd7de549640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25213) UID: 0 2024-04-18T14:43:54.543 INFO:teuthology.orchestra.run.smithi086.stdout:osd.9: {} 2024-04-18T14:43:54.544 INFO:teuthology.orchestra.run.smithi086.stderr:osd.9: osd_enable_op_tracker = '' 2024-04-18T14:43:54.547 INFO:teuthology.orchestra.run.smithi119.stdout:ERROR: (22) Invalid argument 2024-04-18T14:43:54.547 INFO:teuthology.orchestra.run.smithi119.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T14:43:54.562 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.14.asok dump_historic_ops 2024-04-18T14:43:54.563 INFO:teuthology.orchestra.run.smithi086.stdout:osd.10: {} 2024-04-18T14:43:54.564 INFO:teuthology.orchestra.run.smithi086.stderr:osd.10: osd_enable_op_tracker = '' 2024-04-18T14:43:54.581 INFO:teuthology.orchestra.run.smithi086.stdout:osd.11: {} 2024-04-18T14:43:54.581 INFO:teuthology.orchestra.run.smithi086.stderr:osd.11: osd_enable_op_tracker = '' 2024-04-18T14:43:54.596 INFO:teuthology.orchestra.run.smithi086.stdout:osd.12: {} 2024-04-18T14:43:54.597 INFO:teuthology.orchestra.run.smithi086.stderr:osd.12: osd_enable_op_tracker = '' 2024-04-18T14:43:54.616 INFO:teuthology.orchestra.run.smithi086.stdout:osd.13: {} 2024-04-18T14:43:54.616 INFO:teuthology.orchestra.run.smithi086.stderr:osd.13: osd_enable_op_tracker = '' 2024-04-18T14:43:54.634 INFO:teuthology.orchestra.run.smithi086.stdout:osd.14: {} 2024-04-18T14:43:54.635 INFO:teuthology.orchestra.run.smithi086.stderr:osd.14: osd_enable_op_tracker = '' 2024-04-18T14:43:54.635 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-18T14:43:54.635+0000 7f9181beb640 0 -- 172.21.15.86:0/4283467823 >> [v2:172.21.15.134:6808/25223,v1:172.21.15.134:6812/25223] conn(0x7f917c21e470 msgr2=0x7f917c220880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-04-18T14:43:54.635 INFO:tasks.ceph.osd.5.smithi096.stderr:2024-04-18T14:43:54.634+0000 7fc33f25b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 24889) UID: 0 2024-04-18T14:43:54.689 INFO:teuthology.orchestra.run.smithi119.stdout:{ 2024-04-18T14:43:54.689 INFO:teuthology.orchestra.run.smithi119.stdout: "size": 20, 2024-04-18T14:43:54.689 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 600, 2024-04-18T14:43:54.689 INFO:teuthology.orchestra.run.smithi119.stdout: "ops": [ 2024-04-18T14:43:54.689 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:54.689 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(client.4559.0:183 3.7s0 3:e3a0e00d:::smithi13430248-30:head [copy-from ver 12] snapc 4=[4,2] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-18T14:43:54.689 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-04-18T14:43:36.725584+0000", 2024-04-18T14:43:54.689 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 17.966120902, 2024-04-18T14:43:54.689 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.032002501000000003, 2024-04-18T14:43:54.689 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-04-18T14:43:54.689 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T14:43:54.690 INFO:teuthology.orchestra.run.smithi119.stdout: "client_info": { 2024-04-18T14:43:54.690 INFO:teuthology.orchestra.run.smithi119.stdout: "client": "client.4559", 2024-04-18T14:43:54.690 INFO:teuthology.orchestra.run.smithi119.stdout: "client_addr": "172.21.15.134:0/3113589487", 2024-04-18T14:43:54.690 INFO:teuthology.orchestra.run.smithi119.stdout: "tid": 183 2024-04-18T14:43:54.690 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:54.690 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-04-18T14:43:54.690 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:54.690 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-04-18T14:43:54.690 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:36.725584+0000", 2024-04-18T14:43:54.690 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:43:54.690 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:54.691 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:54.691 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-04-18T14:43:54.691 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:36.725584+0000", 2024-04-18T14:43:54.691 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:43:54.691 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:54.691 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:54.691 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-04-18T14:43:54.691 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:36.725582+0000", 2024-04-18T14:43:54.691 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4294967295.9999976 2024-04-18T14:43:54.691 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:54.691 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:54.691 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-04-18T14:43:54.691 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:36.725595+0000", 2024-04-18T14:43:54.691 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.325e-05 2024-04-18T14:43:54.691 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:54.692 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:54.692 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-04-18T14:43:54.692 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:36.725618+0000", 2024-04-18T14:43:54.692 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.2574000000000001e-05 2024-04-18T14:43:54.692 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:54.692 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:54.692 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-04-18T14:43:54.692 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:36.725633+0000", 2024-04-18T14:43:54.692 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.5197e-05 2024-04-18T14:43:54.692 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:54.692 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:54.692 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-04-18T14:43:54.692 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:36.725764+0000", 2024-04-18T14:43:54.692 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00013052300000000001 2024-04-18T14:43:54.693 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:54.693 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:54.693 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "op must wait for map", 2024-04-18T14:43:54.693 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:36.725784+0000", 2024-04-18T14:43:54.693 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.0111000000000001e-05 2024-04-18T14:43:54.693 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:54.693 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:54.693 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-04-18T14:43:54.693 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:36.731424+0000", 2024-04-18T14:43:54.693 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0056403479999999999 2024-04-18T14:43:54.693 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:54.693 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:54.693 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-04-18T14:43:54.693 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:36.731754+0000", 2024-04-18T14:43:54.693 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00032950200000000002 2024-04-18T14:43:54.694 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:54.694 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:54.694 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_started", 2024-04-18T14:43:54.694 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:36.748259+0000", 2024-04-18T14:43:54.694 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.016505701000000001 2024-04-18T14:43:54.694 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:54.694 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:54.694 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_committed", 2024-04-18T14:43:54.694 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:36.751859+0000", 2024-04-18T14:43:54.694 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.003599671 2024-04-18T14:43:54.694 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:54.694 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:54.694 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-04-18T14:43:54.694 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:36.757474+0000", 2024-04-18T14:43:54.695 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0056144810000000002 2024-04-18T14:43:54.695 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:54.695 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:54.695 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-04-18T14:43:54.695 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:36.757587+0000", 2024-04-18T14:43:54.695 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000113393 2024-04-18T14:43:54.695 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:43:54.695 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-04-18T14:43:54.695 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:43:54.695 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:54.695 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:54.695 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(client.4559.0:184 3.7s0 3:e3a0e00d:::smithi13430248-30:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e37)", 2024-04-18T14:43:54.695 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-04-18T14:43:36.725653+0000", 2024-04-18T14:43:54.695 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 17.966052421000001, 2024-04-18T14:43:54.695 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.025569002, 2024-04-18T14:43:54.695 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-04-18T14:43:54.696 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "started", 2024-04-18T14:43:54.696 INFO:teuthology.orchestra.run.smithi119.stdout: "client_info": { 2024-04-18T14:43:54.696 INFO:teuthology.orchestra.run.smithi119.stdout: "client": "client.4559", 2024-04-18T14:43:54.696 INFO:teuthology.orchestra.run.smithi119.stdout: "client_addr": "172.21.15.134:0/3113589487", 2024-04-18T14:43:54.696 INFO:teuthology.orchestra.run.smithi119.stdout: "tid": 184 2024-04-18T14:43:54.696 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:54.696 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-04-18T14:43:54.696 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:54.696 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-04-18T14:43:54.696 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:36.725653+0000", 2024-04-18T14:43:54.696 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:43:54.696 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:54.696 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:54.696 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-04-18T14:43:54.696 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:36.725653+0000", 2024-04-18T14:43:54.696 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:43:54.697 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:54.697 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:54.697 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-04-18T14:43:54.697 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:36.725652+0000", 2024-04-18T14:43:54.697 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4294967295.999999 2024-04-18T14:43:54.697 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:54.697 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:54.697 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-04-18T14:43:54.697 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:36.725657+0000", 2024-04-18T14:43:54.697 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4.5170000000000001e-06 2024-04-18T14:43:54.697 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:54.697 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:54.697 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-04-18T14:43:54.697 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:36.725670+0000", 2024-04-18T14:43:54.697 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.3536999999999999e-05 2024-04-18T14:43:54.698 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:54.698 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:54.698 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-04-18T14:43:54.698 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:36.725678+0000", 2024-04-18T14:43:54.698 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 8.2099999999999993e-06 2024-04-18T14:43:54.698 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:54.698 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:54.698 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-04-18T14:43:54.698 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:36.725920+0000", 2024-04-18T14:43:54.698 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00024127299999999999 2024-04-18T14:43:54.698 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:54.698 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:54.698 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting_for_map not empty", 2024-04-18T14:43:54.698 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:36.725937+0000", 2024-04-18T14:43:54.698 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.7011e-05 2024-04-18T14:43:54.699 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:54.699 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:54.699 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-04-18T14:43:54.699 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:36.732196+0000", 2024-04-18T14:43:54.699 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0062595209999999997 2024-04-18T14:43:54.699 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:54.699 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:54.699 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for blocked object", 2024-04-18T14:43:54.699 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:36.732319+0000", 2024-04-18T14:43:54.699 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000122977 2024-04-18T14:43:54.699 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:54.699 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:54.699 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-04-18T14:43:54.699 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:36.750655+0000", 2024-04-18T14:43:54.700 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.018336431 2024-04-18T14:43:54.700 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:54.700 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:54.700 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-04-18T14:43:54.700 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:36.750956+0000", 2024-04-18T14:43:54.700 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00030036800000000002 2024-04-18T14:43:54.700 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:54.700 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:54.700 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-04-18T14:43:54.700 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:36.751222+0000", 2024-04-18T14:43:54.700 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00026612000000000001 2024-04-18T14:43:54.700 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:43:54.700 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-04-18T14:43:54.700 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:43:54.700 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:54.700 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:54.701 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(client.4559.0:206 3.6s0 3:67bcc71e:::smithi13430248-13:head [copy-from ver 8] snapc 4=[4,2] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-18T14:43:54.701 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-04-18T14:43:36.859061+0000", 2024-04-18T14:43:54.701 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 17.832643945000001, 2024-04-18T14:43:54.701 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.017010971, 2024-04-18T14:43:54.701 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-04-18T14:43:54.701 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T14:43:54.701 INFO:teuthology.orchestra.run.smithi119.stdout: "client_info": { 2024-04-18T14:43:54.701 INFO:teuthology.orchestra.run.smithi119.stdout: "client": "client.4559", 2024-04-18T14:43:54.701 INFO:teuthology.orchestra.run.smithi119.stdout: "client_addr": "172.21.15.134:0/3113589487", 2024-04-18T14:43:54.701 INFO:teuthology.orchestra.run.smithi119.stdout: "tid": 206 2024-04-18T14:43:54.701 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:54.701 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-04-18T14:43:54.701 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:54.701 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-04-18T14:43:54.701 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:36.859061+0000", 2024-04-18T14:43:54.701 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:43:54.702 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:54.702 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:54.702 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-04-18T14:43:54.702 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:36.859061+0000", 2024-04-18T14:43:54.702 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:43:54.702 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:54.702 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:54.702 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-04-18T14:43:54.702 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:36.859059+0000", 2024-04-18T14:43:54.702 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4294967295.9999976 2024-04-18T14:43:54.702 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:54.703 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:54.703 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-04-18T14:43:54.703 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:36.859073+0000", 2024-04-18T14:43:54.703 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.3920999999999999e-05 2024-04-18T14:43:54.703 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:54.703 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:54.703 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-04-18T14:43:54.703 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:36.859096+0000", 2024-04-18T14:43:54.703 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.3167e-05 2024-04-18T14:43:54.703 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:54.703 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:54.703 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-04-18T14:43:54.703 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:36.859109+0000", 2024-04-18T14:43:54.703 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.3334e-05 2024-04-18T14:43:54.703 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:54.704 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:54.704 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-04-18T14:43:54.704 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:36.859237+0000", 2024-04-18T14:43:54.704 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000127723 2024-04-18T14:43:54.704 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:54.704 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:54.704 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-04-18T14:43:54.704 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:36.859510+0000", 2024-04-18T14:43:54.704 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000272864 2024-04-18T14:43:54.704 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:54.704 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:54.704 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_started", 2024-04-18T14:43:54.704 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:36.869694+0000", 2024-04-18T14:43:54.704 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.010184321 2024-04-18T14:43:54.704 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:54.705 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:54.705 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_committed", 2024-04-18T14:43:54.705 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:36.875047+0000", 2024-04-18T14:43:54.705 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0053526040000000004 2024-04-18T14:43:54.705 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:54.705 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:54.705 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-04-18T14:43:54.705 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:36.875865+0000", 2024-04-18T14:43:54.705 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00081792099999999999 2024-04-18T14:43:54.705 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:54.705 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:54.705 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-04-18T14:43:54.705 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:36.876072+0000", 2024-04-18T14:43:54.705 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00020746600000000001 2024-04-18T14:43:54.705 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:43:54.705 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-04-18T14:43:54.706 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:43:54.706 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:54.706 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:54.706 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(client.4559.0:207 3.6s0 3:67bcc71e:::smithi13430248-13:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e37)", 2024-04-18T14:43:54.706 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-04-18T14:43:36.859140+0000", 2024-04-18T14:43:54.706 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 17.832564979000001, 2024-04-18T14:43:54.706 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.013950613000000001, 2024-04-18T14:43:54.706 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-04-18T14:43:54.706 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "started", 2024-04-18T14:43:54.706 INFO:teuthology.orchestra.run.smithi119.stdout: "client_info": { 2024-04-18T14:43:54.706 INFO:teuthology.orchestra.run.smithi119.stdout: "client": "client.4559", 2024-04-18T14:43:54.706 INFO:teuthology.orchestra.run.smithi119.stdout: "client_addr": "172.21.15.134:0/3113589487", 2024-04-18T14:43:54.706 INFO:teuthology.orchestra.run.smithi119.stdout: "tid": 207 2024-04-18T14:43:54.706 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:54.706 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-04-18T14:43:54.707 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:54.707 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-04-18T14:43:54.707 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:36.859140+0000", 2024-04-18T14:43:54.707 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:43:54.707 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:54.707 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:54.707 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-04-18T14:43:54.707 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:36.859140+0000", 2024-04-18T14:43:54.707 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:43:54.707 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:54.707 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:54.707 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-04-18T14:43:54.707 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:36.859139+0000", 2024-04-18T14:43:54.707 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4294967295.9999986 2024-04-18T14:43:54.707 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:54.708 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:54.708 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-04-18T14:43:54.708 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:36.859147+0000", 2024-04-18T14:43:54.708 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 7.8769999999999993e-06 2024-04-18T14:43:54.708 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:54.708 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:54.708 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-04-18T14:43:54.708 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:36.859167+0000", 2024-04-18T14:43:54.708 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.9553000000000001e-05 2024-04-18T14:43:54.708 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:54.708 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:54.708 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-04-18T14:43:54.708 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:36.859181+0000", 2024-04-18T14:43:54.708 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.4598e-05 2024-04-18T14:43:54.708 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:54.709 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:54.709 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-04-18T14:43:54.709 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:36.859932+0000", 2024-04-18T14:43:54.709 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00075075200000000004 2024-04-18T14:43:54.709 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:54.709 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:54.709 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for blocked object", 2024-04-18T14:43:54.709 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:36.860112+0000", 2024-04-18T14:43:54.709 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00017995899999999999 2024-04-18T14:43:54.709 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:54.709 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:54.709 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-04-18T14:43:54.709 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:36.872762+0000", 2024-04-18T14:43:54.709 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.012650366 2024-04-18T14:43:54.709 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:54.710 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:54.710 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-04-18T14:43:54.710 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:36.872907+0000", 2024-04-18T14:43:54.710 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000144253 2024-04-18T14:43:54.710 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:54.710 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:54.710 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-04-18T14:43:54.710 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:36.873091+0000", 2024-04-18T14:43:54.710 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000184465 2024-04-18T14:43:54.710 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:43:54.710 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-04-18T14:43:54.710 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:43:54.710 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:54.710 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:54.710 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(client.4559.0:208 3.7s0 3:ee42865b:::smithi13430248-46:head [copy-from ver 12] snapc 4=[4,2] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-18T14:43:54.711 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-04-18T14:43:36.859263+0000", 2024-04-18T14:43:54.711 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 17.832441872, 2024-04-18T14:43:54.711 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.020148866000000001, 2024-04-18T14:43:54.711 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-04-18T14:43:54.711 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T14:43:54.711 INFO:teuthology.orchestra.run.smithi119.stdout: "client_info": { 2024-04-18T14:43:54.711 INFO:teuthology.orchestra.run.smithi119.stdout: "client": "client.4559", 2024-04-18T14:43:54.711 INFO:teuthology.orchestra.run.smithi119.stdout: "client_addr": "172.21.15.134:0/3113589487", 2024-04-18T14:43:54.711 INFO:teuthology.orchestra.run.smithi119.stdout: "tid": 208 2024-04-18T14:43:54.711 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:54.711 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-04-18T14:43:54.711 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:54.711 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-04-18T14:43:54.711 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:36.859263+0000", 2024-04-18T14:43:54.711 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:43:54.712 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:54.712 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:54.712 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-04-18T14:43:54.712 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:36.859263+0000", 2024-04-18T14:43:54.712 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:43:54.712 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:54.712 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:54.712 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-04-18T14:43:54.712 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:36.859261+0000", 2024-04-18T14:43:54.712 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4294967295.9999976 2024-04-18T14:43:54.712 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:54.712 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:54.712 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-04-18T14:43:54.712 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:36.859276+0000", 2024-04-18T14:43:54.713 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.5252999999999999e-05 2024-04-18T14:43:54.713 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:54.713 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:54.713 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-04-18T14:43:54.713 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:36.859312+0000", 2024-04-18T14:43:54.713 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.5414999999999999e-05 2024-04-18T14:43:54.713 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:54.713 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:54.713 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-04-18T14:43:54.713 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:36.859335+0000", 2024-04-18T14:43:54.713 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.3767000000000001e-05 2024-04-18T14:43:54.713 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:54.713 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:54.713 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-04-18T14:43:54.713 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:36.859473+0000", 2024-04-18T14:43:54.714 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00013787000000000001 2024-04-18T14:43:54.714 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:54.714 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:54.714 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-04-18T14:43:54.714 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:36.859624+0000", 2024-04-18T14:43:54.714 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000151244 2024-04-18T14:43:54.714 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:54.714 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:54.714 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_started", 2024-04-18T14:43:54.714 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:36.875191+0000", 2024-04-18T14:43:54.714 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.015566722 2024-04-18T14:43:54.714 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:54.714 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:54.714 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_committed", 2024-04-18T14:43:54.714 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:36.878849+0000", 2024-04-18T14:43:54.714 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0036577939999999998 2024-04-18T14:43:54.715 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:54.715 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:54.715 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-04-18T14:43:54.715 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:36.879281+0000", 2024-04-18T14:43:54.715 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00043213799999999999 2024-04-18T14:43:54.715 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:54.715 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:54.715 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-04-18T14:43:54.715 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:36.879412+0000", 2024-04-18T14:43:54.715 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00013128 2024-04-18T14:43:54.715 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:43:54.715 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-04-18T14:43:54.715 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:43:54.715 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:54.715 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:54.716 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(client.4559.0:209 3.7s0 3:ee42865b:::smithi13430248-46:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e37)", 2024-04-18T14:43:54.716 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-04-18T14:43:36.859370+0000", 2024-04-18T14:43:54.716 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 17.83233538, 2024-04-18T14:43:54.716 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.018800118000000001, 2024-04-18T14:43:54.716 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-04-18T14:43:54.716 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "started", 2024-04-18T14:43:54.716 INFO:teuthology.orchestra.run.smithi119.stdout: "client_info": { 2024-04-18T14:43:54.716 INFO:teuthology.orchestra.run.smithi119.stdout: "client": "client.4559", 2024-04-18T14:43:54.716 INFO:teuthology.orchestra.run.smithi119.stdout: "client_addr": "172.21.15.134:0/3113589487", 2024-04-18T14:43:54.716 INFO:teuthology.orchestra.run.smithi119.stdout: "tid": 209 2024-04-18T14:43:54.716 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:54.716 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-04-18T14:43:54.716 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:54.716 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-04-18T14:43:54.716 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:36.859370+0000", 2024-04-18T14:43:54.716 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:43:54.717 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:54.717 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:54.717 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-04-18T14:43:54.717 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:36.859370+0000", 2024-04-18T14:43:54.717 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:43:54.717 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:54.717 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:54.717 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-04-18T14:43:54.717 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:36.859369+0000", 2024-04-18T14:43:54.717 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4294967295.9999986 2024-04-18T14:43:54.717 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:54.717 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:54.717 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-04-18T14:43:54.717 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:36.859377+0000", 2024-04-18T14:43:54.718 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 8.3110000000000006e-06 2024-04-18T14:43:54.718 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:54.718 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:54.718 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-04-18T14:43:54.718 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:36.859398+0000", 2024-04-18T14:43:54.718 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.0716e-05 2024-04-18T14:43:54.718 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:54.718 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:54.718 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-04-18T14:43:54.718 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:36.859414+0000", 2024-04-18T14:43:54.718 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.5988e-05 2024-04-18T14:43:54.718 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:54.718 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:54.718 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-04-18T14:43:54.718 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:36.859991+0000", 2024-04-18T14:43:54.719 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00057741499999999996 2024-04-18T14:43:54.719 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:54.719 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:54.719 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for blocked object", 2024-04-18T14:43:54.719 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:36.860117+0000", 2024-04-18T14:43:54.719 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000126026 2024-04-18T14:43:54.719 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:54.719 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:54.719 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-04-18T14:43:54.719 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:36.877677+0000", 2024-04-18T14:43:54.719 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.017559549000000001 2024-04-18T14:43:54.719 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:54.719 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:54.719 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-04-18T14:43:54.719 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:36.877914+0000", 2024-04-18T14:43:54.720 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00023726899999999999 2024-04-18T14:43:54.720 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:54.720 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:54.720 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-04-18T14:43:54.720 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:36.878170+0000", 2024-04-18T14:43:54.720 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00025624399999999998 2024-04-18T14:43:54.720 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:43:54.720 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-04-18T14:43:54.720 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:43:54.720 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:54.720 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:54.720 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(client.4559.0:242 3.7s0 3:e2767c91:::smithi13430248-5:head [copy-from ver 2] snapc 8=[8,7,4,2] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-04-18T14:43:54.720 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-04-18T14:43:40.759272+0000", 2024-04-18T14:43:54.720 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 13.932433355000001, 2024-04-18T14:43:54.720 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.031013309999999999, 2024-04-18T14:43:54.721 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-04-18T14:43:54.721 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T14:43:54.721 INFO:teuthology.orchestra.run.smithi119.stdout: "client_info": { 2024-04-18T14:43:54.721 INFO:teuthology.orchestra.run.smithi119.stdout: "client": "client.4559", 2024-04-18T14:43:54.721 INFO:teuthology.orchestra.run.smithi119.stdout: "client_addr": "172.21.15.134:0/3113589487", 2024-04-18T14:43:54.721 INFO:teuthology.orchestra.run.smithi119.stdout: "tid": 242 2024-04-18T14:43:54.721 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:54.721 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-04-18T14:43:54.721 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:54.721 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-04-18T14:43:54.721 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:40.759272+0000", 2024-04-18T14:43:54.721 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:43:54.721 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:54.721 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:54.721 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-04-18T14:43:54.722 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:40.759272+0000", 2024-04-18T14:43:54.722 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:43:54.722 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:54.722 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:54.722 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-04-18T14:43:54.722 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:40.759269+0000", 2024-04-18T14:43:54.722 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4294967295.9999971 2024-04-18T14:43:54.722 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:54.722 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:54.722 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-04-18T14:43:54.722 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:40.759294+0000", 2024-04-18T14:43:54.722 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.5335999999999999e-05 2024-04-18T14:43:54.722 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:54.722 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:54.722 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-04-18T14:43:54.722 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:40.759330+0000", 2024-04-18T14:43:54.723 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.5531000000000003e-05 2024-04-18T14:43:54.723 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:54.723 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:54.723 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-04-18T14:43:54.723 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:40.759353+0000", 2024-04-18T14:43:54.723 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.3441000000000001e-05 2024-04-18T14:43:54.723 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:54.723 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:54.723 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-04-18T14:43:54.723 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:40.760398+0000", 2024-04-18T14:43:54.723 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00104484 2024-04-18T14:43:54.723 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:54.723 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:54.723 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-04-18T14:43:54.724 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:40.760662+0000", 2024-04-18T14:43:54.724 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00026342599999999998 2024-04-18T14:43:54.724 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:54.724 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:54.724 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_started", 2024-04-18T14:43:54.724 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:40.783559+0000", 2024-04-18T14:43:54.724 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.022896989 2024-04-18T14:43:54.724 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:54.724 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:54.724 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_committed", 2024-04-18T14:43:54.724 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:40.789488+0000", 2024-04-18T14:43:54.724 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0059289260000000002 2024-04-18T14:43:54.724 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:54.724 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:54.724 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-04-18T14:43:54.725 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:40.790079+0000", 2024-04-18T14:43:54.725 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00059128299999999996 2024-04-18T14:43:54.725 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:54.725 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:54.725 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-04-18T14:43:54.725 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:40.790285+0000", 2024-04-18T14:43:54.725 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000206448 2024-04-18T14:43:54.725 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:43:54.725 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-04-18T14:43:54.725 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:43:54.725 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:54.725 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:54.725 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(client.4559.0:243 3.7s0 3:e2767c91:::smithi13430248-5:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e41)", 2024-04-18T14:43:54.725 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-04-18T14:43:40.759392+0000", 2024-04-18T14:43:54.725 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 13.932313130000001, 2024-04-18T14:43:54.725 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.032366368, 2024-04-18T14:43:54.726 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-04-18T14:43:54.726 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "started", 2024-04-18T14:43:54.726 INFO:teuthology.orchestra.run.smithi119.stdout: "client_info": { 2024-04-18T14:43:54.726 INFO:teuthology.orchestra.run.smithi119.stdout: "client": "client.4559", 2024-04-18T14:43:54.726 INFO:teuthology.orchestra.run.smithi119.stdout: "client_addr": "172.21.15.134:0/3113589487", 2024-04-18T14:43:54.726 INFO:teuthology.orchestra.run.smithi119.stdout: "tid": 243 2024-04-18T14:43:54.726 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:54.726 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-04-18T14:43:54.726 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:54.726 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-04-18T14:43:54.726 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:40.759392+0000", 2024-04-18T14:43:54.726 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:43:54.726 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:54.726 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:54.727 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-04-18T14:43:54.727 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:40.759392+0000", 2024-04-18T14:43:54.727 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:43:54.727 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:54.727 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:54.727 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-04-18T14:43:54.727 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:40.759391+0000", 2024-04-18T14:43:54.727 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4294967295.9999986 2024-04-18T14:43:54.727 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:54.727 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:54.727 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-04-18T14:43:54.727 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:40.759400+0000", 2024-04-18T14:43:54.727 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 8.9770000000000006e-06 2024-04-18T14:43:54.727 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:54.727 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:54.728 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-04-18T14:43:54.728 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:40.759421+0000", 2024-04-18T14:43:54.728 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.1557e-05 2024-04-18T14:43:54.728 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:54.728 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:54.728 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-04-18T14:43:54.728 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:40.759438+0000", 2024-04-18T14:43:54.728 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.6663999999999998e-05 2024-04-18T14:43:54.728 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:54.728 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:54.728 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-04-18T14:43:54.728 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:40.761106+0000", 2024-04-18T14:43:54.728 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.001668367 2024-04-18T14:43:54.728 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:54.728 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:54.729 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for blocked object", 2024-04-18T14:43:54.729 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:40.761224+0000", 2024-04-18T14:43:54.729 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000117376 2024-04-18T14:43:54.729 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:54.729 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:54.729 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-04-18T14:43:54.729 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:40.791296+0000", 2024-04-18T14:43:54.729 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.030072040000000001 2024-04-18T14:43:54.729 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:54.729 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:54.729 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-04-18T14:43:54.729 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:40.791484+0000", 2024-04-18T14:43:54.729 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000188717 2024-04-18T14:43:54.729 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:54.729 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:54.730 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-04-18T14:43:54.730 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:40.791759+0000", 2024-04-18T14:43:54.730 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00027425000000000003 2024-04-18T14:43:54.730 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:43:54.730 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-04-18T14:43:54.730 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:43:54.730 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:54.730 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:54.730 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(client.4559.0:310 3.6s0 3:6c5ba706:::smithi13430248-4:head [append 0~786432] snapc d=[d,b,a,8,7,2] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-18T14:43:54.730 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-04-18T14:43:44.535580+0000", 2024-04-18T14:43:54.730 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 10.156125748999999, 2024-04-18T14:43:54.730 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.011987813, 2024-04-18T14:43:54.730 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-04-18T14:43:54.730 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T14:43:54.731 INFO:teuthology.orchestra.run.smithi119.stdout: "client_info": { 2024-04-18T14:43:54.731 INFO:teuthology.orchestra.run.smithi119.stdout: "client": "client.4559", 2024-04-18T14:43:54.731 INFO:teuthology.orchestra.run.smithi119.stdout: "client_addr": "172.21.15.134:0/3113589487", 2024-04-18T14:43:54.731 INFO:teuthology.orchestra.run.smithi119.stdout: "tid": 310 2024-04-18T14:43:54.731 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:54.731 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-04-18T14:43:54.731 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:54.731 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-04-18T14:43:54.731 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:44.535580+0000", 2024-04-18T14:43:54.731 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:43:54.731 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:54.731 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:54.731 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-04-18T14:43:54.731 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:44.535580+0000", 2024-04-18T14:43:54.731 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:43:54.731 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:54.732 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:54.732 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-04-18T14:43:54.732 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:44.535577+0000", 2024-04-18T14:43:54.732 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4294967295.9999976 2024-04-18T14:43:54.732 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:54.732 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:54.732 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-04-18T14:43:54.732 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:44.537569+0000", 2024-04-18T14:43:54.732 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0019920239999999998 2024-04-18T14:43:54.732 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:54.732 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:54.732 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-04-18T14:43:54.732 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:44.537603+0000", 2024-04-18T14:43:54.732 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.4e-05 2024-04-18T14:43:54.732 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:54.733 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:54.733 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-04-18T14:43:54.733 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:44.537630+0000", 2024-04-18T14:43:54.733 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.7127999999999998e-05 2024-04-18T14:43:54.733 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:54.733 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:54.733 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-04-18T14:43:54.733 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:44.537792+0000", 2024-04-18T14:43:54.733 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00016162300000000001 2024-04-18T14:43:54.733 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:54.733 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:54.733 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-04-18T14:43:54.733 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:44.537974+0000", 2024-04-18T14:43:54.733 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000181876 2024-04-18T14:43:54.734 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:54.734 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:54.734 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_started", 2024-04-18T14:43:54.734 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:44.540053+0000", 2024-04-18T14:43:54.734 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0020789480000000002 2024-04-18T14:43:54.734 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:54.734 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:54.734 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_committed", 2024-04-18T14:43:54.734 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:44.546581+0000", 2024-04-18T14:43:54.734 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0065280360000000001 2024-04-18T14:43:54.734 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:54.734 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:54.734 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-04-18T14:43:54.734 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:44.547450+0000", 2024-04-18T14:43:54.735 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00086941299999999998 2024-04-18T14:43:54.735 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:54.735 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:54.735 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-04-18T14:43:54.735 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:44.547567+0000", 2024-04-18T14:43:54.735 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000117175 2024-04-18T14:43:54.735 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:43:54.735 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-04-18T14:43:54.735 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:43:54.735 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:54.735 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:54.735 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(client.4559.0:313 3.6s0 3:6c5ba706:::smithi13430248-4:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e45)", 2024-04-18T14:43:54.735 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-04-18T14:43:44.541997+0000", 2024-04-18T14:43:54.735 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 10.149708454000001, 2024-04-18T14:43:54.735 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.011915818, 2024-04-18T14:43:54.735 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-04-18T14:43:54.736 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "started", 2024-04-18T14:43:54.736 INFO:teuthology.orchestra.run.smithi119.stdout: "client_info": { 2024-04-18T14:43:54.736 INFO:teuthology.orchestra.run.smithi119.stdout: "client": "client.4559", 2024-04-18T14:43:54.736 INFO:teuthology.orchestra.run.smithi119.stdout: "client_addr": "172.21.15.134:0/3113589487", 2024-04-18T14:43:54.736 INFO:teuthology.orchestra.run.smithi119.stdout: "tid": 313 2024-04-18T14:43:54.736 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:54.736 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-04-18T14:43:54.736 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:54.736 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-04-18T14:43:54.736 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:44.541997+0000", 2024-04-18T14:43:54.736 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:43:54.736 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:54.736 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:54.736 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-04-18T14:43:54.736 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:44.541997+0000", 2024-04-18T14:43:54.737 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:43:54.737 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:54.737 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:54.737 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-04-18T14:43:54.737 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:44.541996+0000", 2024-04-18T14:43:54.737 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4294967295.999999 2024-04-18T14:43:54.737 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:54.737 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:54.737 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-04-18T14:43:54.737 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:44.542000+0000", 2024-04-18T14:43:54.737 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4.4039999999999997e-06 2024-04-18T14:43:54.737 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:54.737 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:54.737 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-04-18T14:43:54.738 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:44.542012+0000", 2024-04-18T14:43:54.738 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.1293e-05 2024-04-18T14:43:54.738 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:54.738 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:54.738 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-04-18T14:43:54.738 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:44.542020+0000", 2024-04-18T14:43:54.738 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 8.1370000000000002e-06 2024-04-18T14:43:54.738 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:54.738 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:54.738 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-04-18T14:43:54.738 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:44.549750+0000", 2024-04-18T14:43:54.738 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0077297850000000003 2024-04-18T14:43:54.738 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:54.738 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:54.738 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for rw locks", 2024-04-18T14:43:54.739 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:44.549915+0000", 2024-04-18T14:43:54.739 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00016506600000000001 2024-04-18T14:43:54.739 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:54.739 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:54.739 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-04-18T14:43:54.739 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:44.551494+0000", 2024-04-18T14:43:54.739 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0015796989999999999 2024-04-18T14:43:54.739 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:54.739 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:54.739 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-04-18T14:43:54.739 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:44.551679+0000", 2024-04-18T14:43:54.739 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00018440700000000001 2024-04-18T14:43:54.739 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:54.739 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:54.739 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-04-18T14:43:54.739 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:44.553913+0000", 2024-04-18T14:43:54.739 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0022339339999999999 2024-04-18T14:43:54.740 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:43:54.740 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-04-18T14:43:54.740 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:43:54.740 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:54.740 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:54.740 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(client.4559.0:359 3.6s0 3:67399b98:::smithi13430248-45:head [append 0~0] snapc 13=[13,11,f,b,a,8,7,2] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-04-18T14:43:54.740 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-04-18T14:43:50.375903+0000", 2024-04-18T14:43:54.740 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 4.315802132, 2024-04-18T14:43:54.740 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.012054103, 2024-04-18T14:43:54.740 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-04-18T14:43:54.740 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T14:43:54.740 INFO:teuthology.orchestra.run.smithi119.stdout: "client_info": { 2024-04-18T14:43:54.740 INFO:teuthology.orchestra.run.smithi119.stdout: "client": "client.4559", 2024-04-18T14:43:54.740 INFO:teuthology.orchestra.run.smithi119.stdout: "client_addr": "172.21.15.134:0/3113589487", 2024-04-18T14:43:54.740 INFO:teuthology.orchestra.run.smithi119.stdout: "tid": 359 2024-04-18T14:43:54.741 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:54.741 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-04-18T14:43:54.741 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:54.741 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-04-18T14:43:54.741 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:50.375903+0000", 2024-04-18T14:43:54.741 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:43:54.741 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:54.741 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:54.741 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-04-18T14:43:54.741 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:50.375903+0000", 2024-04-18T14:43:54.741 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:43:54.741 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:54.741 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:54.741 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-04-18T14:43:54.741 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:50.375901+0000", 2024-04-18T14:43:54.742 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4294967295.9999976 2024-04-18T14:43:54.742 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:54.742 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:54.742 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-04-18T14:43:54.742 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:50.375916+0000", 2024-04-18T14:43:54.742 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.5313999999999999e-05 2024-04-18T14:43:54.742 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:54.742 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:54.742 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-04-18T14:43:54.742 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:50.375944+0000", 2024-04-18T14:43:54.742 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.8050000000000001e-05 2024-04-18T14:43:54.742 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:54.742 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:54.742 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-04-18T14:43:54.743 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:50.375963+0000", 2024-04-18T14:43:54.743 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.8447000000000001e-05 2024-04-18T14:43:54.743 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:54.743 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:54.743 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-04-18T14:43:54.743 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:50.376093+0000", 2024-04-18T14:43:54.743 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000129851 2024-04-18T14:43:54.743 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:54.743 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:54.743 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-04-18T14:43:54.743 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:50.376256+0000", 2024-04-18T14:43:54.743 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00016376800000000001 2024-04-18T14:43:54.743 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:54.743 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:54.743 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_started", 2024-04-18T14:43:54.743 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:50.377617+0000", 2024-04-18T14:43:54.744 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0013611840000000001 2024-04-18T14:43:54.744 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:54.744 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:54.744 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_committed", 2024-04-18T14:43:54.744 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:50.381250+0000", 2024-04-18T14:43:54.744 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0036328630000000001 2024-04-18T14:43:54.744 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:54.744 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:54.744 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-04-18T14:43:54.744 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:50.387802+0000", 2024-04-18T14:43:54.744 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0065516489999999997 2024-04-18T14:43:54.744 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:54.744 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:54.744 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-04-18T14:43:54.744 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:50.387957+0000", 2024-04-18T14:43:54.744 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00015534699999999999 2024-04-18T14:43:54.745 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:43:54.745 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-04-18T14:43:54.745 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:43:54.745 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:54.745 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:54.745 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(client.4559.0:360 3.6s0 3:67399b98:::smithi13430248-45:head [rollback 13] snapc 13=[13,11,f,b,a,8,7,2] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-04-18T14:43:54.745 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-04-18T14:43:50.375980+0000", 2024-04-18T14:43:54.745 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 4.3157250710000001, 2024-04-18T14:43:54.745 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.012641348, 2024-04-18T14:43:54.745 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-04-18T14:43:54.745 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T14:43:54.745 INFO:teuthology.orchestra.run.smithi119.stdout: "client_info": { 2024-04-18T14:43:54.745 INFO:teuthology.orchestra.run.smithi119.stdout: "client": "client.4559", 2024-04-18T14:43:54.745 INFO:teuthology.orchestra.run.smithi119.stdout: "client_addr": "172.21.15.134:0/3113589487", 2024-04-18T14:43:54.746 INFO:teuthology.orchestra.run.smithi119.stdout: "tid": 360 2024-04-18T14:43:54.746 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:54.746 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-04-18T14:43:54.746 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:54.746 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-04-18T14:43:54.746 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:50.375980+0000", 2024-04-18T14:43:54.746 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:43:54.746 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:54.746 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:54.746 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-04-18T14:43:54.746 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:50.375980+0000", 2024-04-18T14:43:54.746 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:43:54.746 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:54.746 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:54.746 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-04-18T14:43:54.747 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:50.375979+0000", 2024-04-18T14:43:54.747 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4294967295.999999 2024-04-18T14:43:54.747 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:54.747 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:54.747 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-04-18T14:43:54.747 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:50.375984+0000", 2024-04-18T14:43:54.747 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4.6299999999999997e-06 2024-04-18T14:43:54.747 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:54.747 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:54.747 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-04-18T14:43:54.747 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:50.375994+0000", 2024-04-18T14:43:54.747 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 9.5599999999999999e-06 2024-04-18T14:43:54.747 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:54.747 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:54.747 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-04-18T14:43:54.748 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:50.376001+0000", 2024-04-18T14:43:54.748 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 7.3440000000000003e-06 2024-04-18T14:43:54.748 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:54.748 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:54.748 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-04-18T14:43:54.748 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:50.378936+0000", 2024-04-18T14:43:54.748 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0029354749999999999 2024-04-18T14:43:54.748 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:54.748 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:54.748 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-04-18T14:43:54.748 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:50.379160+0000", 2024-04-18T14:43:54.748 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00022311999999999999 2024-04-18T14:43:54.748 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:54.748 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:54.748 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_started", 2024-04-18T14:43:54.749 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:50.380390+0000", 2024-04-18T14:43:54.749 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.001230054 2024-04-18T14:43:54.749 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:54.749 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:54.749 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_committed", 2024-04-18T14:43:54.749 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:50.384959+0000", 2024-04-18T14:43:54.749 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0045697159999999997 2024-04-18T14:43:54.749 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:54.749 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:54.749 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-04-18T14:43:54.749 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:50.388404+0000", 2024-04-18T14:43:54.749 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0034444530000000001 2024-04-18T14:43:54.749 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:54.749 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:54.749 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-04-18T14:43:54.750 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:50.388622+0000", 2024-04-18T14:43:54.750 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00021787600000000001 2024-04-18T14:43:54.750 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:43:54.750 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-04-18T14:43:54.750 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:43:54.750 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:54.750 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:54.750 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(client.4559.0:361 3.6s0 3:67399b98:::smithi13430248-45:head [append 0~0] snapc 13=[13,11,f,b,a,8,7,2] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-04-18T14:43:54.750 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-04-18T14:43:50.376050+0000", 2024-04-18T14:43:54.750 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 4.3156550429999996, 2024-04-18T14:43:54.750 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.012963505, 2024-04-18T14:43:54.750 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-04-18T14:43:54.750 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T14:43:54.750 INFO:teuthology.orchestra.run.smithi119.stdout: "client_info": { 2024-04-18T14:43:54.750 INFO:teuthology.orchestra.run.smithi119.stdout: "client": "client.4559", 2024-04-18T14:43:54.751 INFO:teuthology.orchestra.run.smithi119.stdout: "client_addr": "172.21.15.134:0/3113589487", 2024-04-18T14:43:54.751 INFO:teuthology.orchestra.run.smithi119.stdout: "tid": 361 2024-04-18T14:43:54.751 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:54.751 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-04-18T14:43:54.751 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:54.751 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-04-18T14:43:54.751 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:50.376050+0000", 2024-04-18T14:43:54.751 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:43:54.751 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:54.751 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:54.751 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-04-18T14:43:54.751 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:50.376050+0000", 2024-04-18T14:43:54.751 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:43:54.751 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:54.751 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:54.752 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-04-18T14:43:54.752 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:50.376050+0000", 2024-04-18T14:43:54.752 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4294967295.999999 2024-04-18T14:43:54.752 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:54.752 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:54.752 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-04-18T14:43:54.752 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:50.376054+0000", 2024-04-18T14:43:54.752 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4.0300000000000004e-06 2024-04-18T14:43:54.752 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:54.752 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:54.752 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-04-18T14:43:54.752 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:50.376069+0000", 2024-04-18T14:43:54.752 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.5420000000000001e-05 2024-04-18T14:43:54.752 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:54.753 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:54.753 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-04-18T14:43:54.753 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:50.376076+0000", 2024-04-18T14:43:54.753 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 7.3329999999999999e-06 2024-04-18T14:43:54.753 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:54.753 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:54.753 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-04-18T14:43:54.753 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:50.381501+0000", 2024-04-18T14:43:54.753 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0054244039999999999 2024-04-18T14:43:54.753 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:54.753 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:54.753 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-04-18T14:43:54.753 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:50.381619+0000", 2024-04-18T14:43:54.753 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00011781300000000001 2024-04-18T14:43:54.753 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:54.754 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:54.754 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_started", 2024-04-18T14:43:54.754 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:50.382370+0000", 2024-04-18T14:43:54.754 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00075115000000000002 2024-04-18T14:43:54.754 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:54.754 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:54.754 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_committed", 2024-04-18T14:43:54.754 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:50.384962+0000", 2024-04-18T14:43:54.754 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.002592741 2024-04-18T14:43:54.754 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:54.754 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:54.754 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-04-18T14:43:54.754 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:50.388860+0000", 2024-04-18T14:43:54.754 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0038978699999999999 2024-04-18T14:43:54.755 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:54.755 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:54.755 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-04-18T14:43:54.755 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:50.389014+0000", 2024-04-18T14:43:54.755 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00015348400000000001 2024-04-18T14:43:54.755 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:43:54.755 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-04-18T14:43:54.755 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:43:54.755 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:54.755 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:54.755 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(client.4559.0:366 3.7s0 3:e01ea1e8:::smithi13430248-1:head [read 0~32768,checksum] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-04-18T14:43:54.755 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-04-18T14:43:50.376279+0000", 2024-04-18T14:43:54.755 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 4.3154266330000004, 2024-04-18T14:43:54.755 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.012562996999999999, 2024-04-18T14:43:54.756 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-04-18T14:43:54.756 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "started", 2024-04-18T14:43:54.756 INFO:teuthology.orchestra.run.smithi119.stdout: "client_info": { 2024-04-18T14:43:54.756 INFO:teuthology.orchestra.run.smithi119.stdout: "client": "client.4559", 2024-04-18T14:43:54.756 INFO:teuthology.orchestra.run.smithi119.stdout: "client_addr": "172.21.15.134:0/3113589487", 2024-04-18T14:43:54.756 INFO:teuthology.orchestra.run.smithi119.stdout: "tid": 366 2024-04-18T14:43:54.756 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:54.756 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-04-18T14:43:54.756 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:54.756 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-04-18T14:43:54.756 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:50.376279+0000", 2024-04-18T14:43:54.756 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:43:54.756 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:54.756 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:54.757 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-04-18T14:43:54.757 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:50.376279+0000", 2024-04-18T14:43:54.757 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:43:54.757 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:54.757 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:54.757 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-04-18T14:43:54.757 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:50.376278+0000", 2024-04-18T14:43:54.757 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4294967295.9999995 2024-04-18T14:43:54.757 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:54.757 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:54.757 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-04-18T14:43:54.757 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:50.376284+0000", 2024-04-18T14:43:54.757 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 6.0599999999999996e-06 2024-04-18T14:43:54.757 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:54.757 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:54.757 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-04-18T14:43:54.758 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:50.376301+0000", 2024-04-18T14:43:54.758 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.6710000000000001e-05 2024-04-18T14:43:54.758 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:54.758 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:54.758 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-04-18T14:43:54.758 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:50.376313+0000", 2024-04-18T14:43:54.758 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.2619999999999999e-05 2024-04-18T14:43:54.758 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:54.758 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:54.758 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-04-18T14:43:54.758 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:50.381989+0000", 2024-04-18T14:43:54.758 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0056759760000000001 2024-04-18T14:43:54.758 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:54.758 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:54.758 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-04-18T14:43:54.759 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:50.382235+0000", 2024-04-18T14:43:54.759 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000245417 2024-04-18T14:43:54.759 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:54.759 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:54.759 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-04-18T14:43:54.759 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:50.388842+0000", 2024-04-18T14:43:54.759 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0066068480000000002 2024-04-18T14:43:54.759 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:43:54.759 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-04-18T14:43:54.759 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:43:54.759 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:54.759 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:54.759 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(client.4559.0:367 3.7s0 3:ee42865b:::smithi13430248-46:head [read 0~622592,checksum,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-04-18T14:43:54.759 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-04-18T14:43:50.376327+0000", 2024-04-18T14:43:54.760 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 4.3153786900000002, 2024-04-18T14:43:54.760 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.014176032, 2024-04-18T14:43:54.760 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-04-18T14:43:54.760 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "started", 2024-04-18T14:43:54.760 INFO:teuthology.orchestra.run.smithi119.stdout: "client_info": { 2024-04-18T14:43:54.760 INFO:teuthology.orchestra.run.smithi119.stdout: "client": "client.4559", 2024-04-18T14:43:54.760 INFO:teuthology.orchestra.run.smithi119.stdout: "client_addr": "172.21.15.134:0/3113589487", 2024-04-18T14:43:54.760 INFO:teuthology.orchestra.run.smithi119.stdout: "tid": 367 2024-04-18T14:43:54.760 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:54.760 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-04-18T14:43:54.760 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:54.760 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-04-18T14:43:54.760 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:50.376327+0000", 2024-04-18T14:43:54.760 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:43:54.760 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:54.761 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:54.761 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-04-18T14:43:54.761 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:50.376327+0000", 2024-04-18T14:43:54.761 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:43:54.761 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:54.761 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:54.761 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-04-18T14:43:54.761 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:50.376326+0000", 2024-04-18T14:43:54.761 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4294967295.999999 2024-04-18T14:43:54.761 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:54.761 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:54.761 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-04-18T14:43:54.761 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:50.376334+0000", 2024-04-18T14:43:54.761 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 8.2640000000000008e-06 2024-04-18T14:43:54.761 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:54.761 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:54.762 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-04-18T14:43:54.762 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:50.376351+0000", 2024-04-18T14:43:54.762 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.7062999999999999e-05 2024-04-18T14:43:54.762 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:54.762 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:54.762 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-04-18T14:43:54.762 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:50.376363+0000", 2024-04-18T14:43:54.762 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.1994000000000001e-05 2024-04-18T14:43:54.762 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:54.762 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:54.762 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-04-18T14:43:54.762 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:50.383598+0000", 2024-04-18T14:43:54.762 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0072347160000000004 2024-04-18T14:43:54.762 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:54.763 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:54.763 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-04-18T14:43:54.763 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:50.383861+0000", 2024-04-18T14:43:54.763 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00026293699999999998 2024-04-18T14:43:54.763 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:54.763 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:54.763 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-04-18T14:43:54.763 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:50.390503+0000", 2024-04-18T14:43:54.763 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0066421680000000004 2024-04-18T14:43:54.763 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:43:54.763 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-04-18T14:43:54.763 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:43:54.763 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:54.764 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:54.764 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(client.4559.0:368 3.7s0 3:ee42865b:::smithi13430248-46:head [read 0~622592,checksum] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-04-18T14:43:54.764 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-04-18T14:43:50.376380+0000", 2024-04-18T14:43:54.764 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 4.3153255990000003, 2024-04-18T14:43:54.764 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.017487203, 2024-04-18T14:43:54.764 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-04-18T14:43:54.764 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "started", 2024-04-18T14:43:54.764 INFO:teuthology.orchestra.run.smithi119.stdout: "client_info": { 2024-04-18T14:43:54.764 INFO:teuthology.orchestra.run.smithi119.stdout: "client": "client.4559", 2024-04-18T14:43:54.764 INFO:teuthology.orchestra.run.smithi119.stdout: "client_addr": "172.21.15.134:0/3113589487", 2024-04-18T14:43:54.764 INFO:teuthology.orchestra.run.smithi119.stdout: "tid": 368 2024-04-18T14:43:54.764 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:54.764 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-04-18T14:43:54.764 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:54.765 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-04-18T14:43:54.765 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:50.376380+0000", 2024-04-18T14:43:54.765 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:43:54.765 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:54.765 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:54.765 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-04-18T14:43:54.765 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:50.376380+0000", 2024-04-18T14:43:54.765 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:43:54.765 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:54.765 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:54.765 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-04-18T14:43:54.765 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:50.376379+0000", 2024-04-18T14:43:54.765 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4294967295.999999 2024-04-18T14:43:54.765 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:54.765 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:54.766 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-04-18T14:43:54.766 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:50.376387+0000", 2024-04-18T14:43:54.766 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 8.0499999999999992e-06 2024-04-18T14:43:54.766 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:54.766 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:54.766 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-04-18T14:43:54.766 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:50.376404+0000", 2024-04-18T14:43:54.766 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.7623000000000001e-05 2024-04-18T14:43:54.766 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:54.766 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:54.766 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-04-18T14:43:54.766 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:50.376418+0000", 2024-04-18T14:43:54.766 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.3504e-05 2024-04-18T14:43:54.767 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:54.767 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:54.767 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-04-18T14:43:54.767 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:50.390653+0000", 2024-04-18T14:43:54.767 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.014235246 2024-04-18T14:43:54.767 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:54.767 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:54.767 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-04-18T14:43:54.767 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:50.390890+0000", 2024-04-18T14:43:54.767 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000236703 2024-04-18T14:43:54.767 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:54.767 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:54.767 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-04-18T14:43:54.767 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:50.393867+0000", 2024-04-18T14:43:54.767 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0029771569999999998 2024-04-18T14:43:54.768 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:43:54.768 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-04-18T14:43:54.768 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:43:54.768 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:54.768 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:54.768 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(client.4559.0:369 3.7s0 3:ee42865b:::smithi13430248-46:head [read 0~622592,checksum] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-04-18T14:43:54.768 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-04-18T14:43:50.376431+0000", 2024-04-18T14:43:54.768 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 4.3152740449999998, 2024-04-18T14:43:54.768 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.018598482, 2024-04-18T14:43:54.768 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-04-18T14:43:54.768 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "started", 2024-04-18T14:43:54.768 INFO:teuthology.orchestra.run.smithi119.stdout: "client_info": { 2024-04-18T14:43:54.768 INFO:teuthology.orchestra.run.smithi119.stdout: "client": "client.4559", 2024-04-18T14:43:54.768 INFO:teuthology.orchestra.run.smithi119.stdout: "client_addr": "172.21.15.134:0/3113589487", 2024-04-18T14:43:54.768 INFO:teuthology.orchestra.run.smithi119.stdout: "tid": 369 2024-04-18T14:43:54.768 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:54.769 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-04-18T14:43:54.769 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:54.769 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-04-18T14:43:54.769 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:50.376431+0000", 2024-04-18T14:43:54.769 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:43:54.769 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:54.769 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:54.769 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-04-18T14:43:54.769 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:50.376431+0000", 2024-04-18T14:43:54.769 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:43:54.769 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:54.769 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:54.769 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-04-18T14:43:54.769 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:50.376430+0000", 2024-04-18T14:43:54.769 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4294967295.9999986 2024-04-18T14:43:54.770 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:54.770 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:54.770 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-04-18T14:43:54.770 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:50.376437+0000", 2024-04-18T14:43:54.770 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 7.1570000000000003e-06 2024-04-18T14:43:54.770 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:54.770 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:54.770 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-04-18T14:43:54.770 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:50.376453+0000", 2024-04-18T14:43:54.770 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.6016999999999999e-05 2024-04-18T14:43:54.770 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:54.770 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:54.770 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-04-18T14:43:54.771 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:50.376469+0000", 2024-04-18T14:43:54.771 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.6296000000000001e-05 2024-04-18T14:43:54.771 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:54.771 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:54.771 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-04-18T14:43:54.771 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:50.391705+0000", 2024-04-18T14:43:54.771 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.015235626 2024-04-18T14:43:54.771 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:54.771 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:54.771 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-04-18T14:43:54.771 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:50.391819+0000", 2024-04-18T14:43:54.771 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000113688 2024-04-18T14:43:54.771 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:54.771 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:54.772 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-04-18T14:43:54.772 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:50.395030+0000", 2024-04-18T14:43:54.772 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0032112379999999999 2024-04-18T14:43:54.772 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:43:54.772 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-04-18T14:43:54.772 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:43:54.772 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:54.772 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:54.772 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(client.4559.0:375 3.7s0 3:e2767c91:::smithi13430248-5:head [append 0~458752] snapc 13=[13,11,f,b,a,8,7,2] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-04-18T14:43:54.772 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-04-18T14:43:50.399042+0000", 2024-04-18T14:43:54.772 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 4.2926637489999999, 2024-04-18T14:43:54.772 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.010977519, 2024-04-18T14:43:54.772 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-04-18T14:43:54.772 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T14:43:54.772 INFO:teuthology.orchestra.run.smithi119.stdout: "client_info": { 2024-04-18T14:43:54.773 INFO:teuthology.orchestra.run.smithi119.stdout: "client": "client.4559", 2024-04-18T14:43:54.773 INFO:teuthology.orchestra.run.smithi119.stdout: "client_addr": "172.21.15.134:0/3113589487", 2024-04-18T14:43:54.773 INFO:teuthology.orchestra.run.smithi119.stdout: "tid": 375 2024-04-18T14:43:54.773 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:54.773 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-04-18T14:43:54.773 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:54.773 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-04-18T14:43:54.773 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:50.399042+0000", 2024-04-18T14:43:54.773 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:43:54.773 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:54.773 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:54.773 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-04-18T14:43:54.773 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:50.399042+0000", 2024-04-18T14:43:54.773 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:43:54.773 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:54.774 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:54.774 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-04-18T14:43:54.774 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:50.399033+0000", 2024-04-18T14:43:54.774 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4294967295.9999919 2024-04-18T14:43:54.774 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:54.774 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:54.774 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-04-18T14:43:54.774 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:50.400496+0000", 2024-04-18T14:43:54.774 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.001462227 2024-04-18T14:43:54.774 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:54.774 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:54.774 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-04-18T14:43:54.774 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:50.400524+0000", 2024-04-18T14:43:54.774 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.8563000000000001e-05 2024-04-18T14:43:54.774 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:54.774 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:54.775 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-04-18T14:43:54.775 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:50.400538+0000", 2024-04-18T14:43:54.775 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.359e-05 2024-04-18T14:43:54.775 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:54.775 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:54.775 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-04-18T14:43:54.775 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:50.400615+0000", 2024-04-18T14:43:54.775 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 7.7305000000000006e-05 2024-04-18T14:43:54.775 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:54.775 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:54.775 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-04-18T14:43:54.775 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:50.400727+0000", 2024-04-18T14:43:54.775 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000111724 2024-04-18T14:43:54.775 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:54.775 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:54.776 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_started", 2024-04-18T14:43:54.776 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:50.401953+0000", 2024-04-18T14:43:54.776 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0012265240000000001 2024-04-18T14:43:54.776 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:54.776 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:54.776 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_committed", 2024-04-18T14:43:54.777 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:50.403939+0000", 2024-04-18T14:43:54.777 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0019858889999999998 2024-04-18T14:43:54.777 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:54.777 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:54.777 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-04-18T14:43:54.778 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:50.409872+0000", 2024-04-18T14:43:54.778 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0059330750000000003 2024-04-18T14:43:54.778 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:54.778 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:54.778 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-04-18T14:43:54.778 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:50.410019+0000", 2024-04-18T14:43:54.778 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000146959 2024-04-18T14:43:54.778 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:43:54.778 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-04-18T14:43:54.778 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:43:54.778 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:54.778 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:54.778 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(client.4559.0:378 3.7s0 3:e2767c91:::smithi13430248-5:head [setxattr _header (56) in=7b] snapc 13=[13,11,f,b,a,8,7,2] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-04-18T14:43:54.778 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-04-18T14:43:50.411145+0000", 2024-04-18T14:43:54.778 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 4.2805607520000004, 2024-04-18T14:43:54.779 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.010237942999999999, 2024-04-18T14:43:54.779 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-04-18T14:43:54.779 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T14:43:54.779 INFO:teuthology.orchestra.run.smithi119.stdout: "client_info": { 2024-04-18T14:43:54.779 INFO:teuthology.orchestra.run.smithi119.stdout: "client": "client.4559", 2024-04-18T14:43:54.779 INFO:teuthology.orchestra.run.smithi119.stdout: "client_addr": "172.21.15.134:0/3113589487", 2024-04-18T14:43:54.779 INFO:teuthology.orchestra.run.smithi119.stdout: "tid": 378 2024-04-18T14:43:54.779 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:54.779 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-04-18T14:43:54.779 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:54.779 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-04-18T14:43:54.779 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:50.411145+0000", 2024-04-18T14:43:54.779 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:43:54.779 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:54.779 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:54.780 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-04-18T14:43:54.780 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:50.411145+0000", 2024-04-18T14:43:54.780 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:43:54.780 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:54.780 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:54.780 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-04-18T14:43:54.780 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:50.411144+0000", 2024-04-18T14:43:54.780 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4294967295.999999 2024-04-18T14:43:54.780 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:54.780 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:54.780 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-04-18T14:43:54.780 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:50.411152+0000", 2024-04-18T14:43:54.780 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 8.4829999999999999e-06 2024-04-18T14:43:54.780 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:54.780 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:54.781 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-04-18T14:43:54.781 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:50.411161+0000", 2024-04-18T14:43:54.781 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 9.2739999999999996e-06 2024-04-18T14:43:54.781 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:54.781 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:54.781 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-04-18T14:43:54.781 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:50.411172+0000", 2024-04-18T14:43:54.781 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.0977e-05 2024-04-18T14:43:54.781 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:54.781 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:54.781 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-04-18T14:43:54.781 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:50.414521+0000", 2024-04-18T14:43:54.781 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0033486399999999999 2024-04-18T14:43:54.781 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:54.781 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:54.781 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-04-18T14:43:54.782 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:50.414834+0000", 2024-04-18T14:43:54.782 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00031256399999999998 2024-04-18T14:43:54.782 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:54.782 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:54.782 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_started", 2024-04-18T14:43:54.782 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:50.415843+0000", 2024-04-18T14:43:54.782 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.001009334 2024-04-18T14:43:54.782 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:54.782 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:54.782 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_committed", 2024-04-18T14:43:54.782 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:50.418786+0000", 2024-04-18T14:43:54.782 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0029427149999999998 2024-04-18T14:43:54.782 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:54.782 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:54.782 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-04-18T14:43:54.783 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:50.421150+0000", 2024-04-18T14:43:54.783 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0023640380000000002 2024-04-18T14:43:54.783 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:54.783 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:54.783 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-04-18T14:43:54.783 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:50.421383+0000", 2024-04-18T14:43:54.783 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00023280600000000001 2024-04-18T14:43:54.783 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:43:54.783 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-04-18T14:43:54.783 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:43:54.783 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:54.783 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:54.783 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(client.4559.0:379 3.7s0 3:e2767c91:::smithi13430248-5:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e51)", 2024-04-18T14:43:54.783 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-04-18T14:43:50.411222+0000", 2024-04-18T14:43:54.784 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 4.2804835309999998, 2024-04-18T14:43:54.784 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.014594958, 2024-04-18T14:43:54.784 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-04-18T14:43:54.784 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "started", 2024-04-18T14:43:54.784 INFO:teuthology.orchestra.run.smithi119.stdout: "client_info": { 2024-04-18T14:43:54.784 INFO:teuthology.orchestra.run.smithi119.stdout: "client": "client.4559", 2024-04-18T14:43:54.784 INFO:teuthology.orchestra.run.smithi119.stdout: "client_addr": "172.21.15.134:0/3113589487", 2024-04-18T14:43:54.784 INFO:teuthology.orchestra.run.smithi119.stdout: "tid": 379 2024-04-18T14:43:54.784 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:54.784 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-04-18T14:43:54.784 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:54.784 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-04-18T14:43:54.784 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:50.411222+0000", 2024-04-18T14:43:54.784 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:43:54.784 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:54.785 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:54.785 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-04-18T14:43:54.785 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:50.411222+0000", 2024-04-18T14:43:54.785 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:43:54.785 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:54.785 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:54.785 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-04-18T14:43:54.785 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:50.411221+0000", 2024-04-18T14:43:54.785 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4294967295.999999 2024-04-18T14:43:54.785 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:54.785 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:54.785 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-04-18T14:43:54.785 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:50.411227+0000", 2024-04-18T14:43:54.785 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 6.071e-06 2024-04-18T14:43:54.785 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:54.786 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:54.786 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-04-18T14:43:54.786 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:50.411242+0000", 2024-04-18T14:43:54.786 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.5695000000000001e-05 2024-04-18T14:43:54.786 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:54.786 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:54.786 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-04-18T14:43:54.786 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:50.411255+0000", 2024-04-18T14:43:54.786 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.2277e-05 2024-04-18T14:43:54.786 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:54.786 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:54.786 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-04-18T14:43:54.786 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:50.417122+0000", 2024-04-18T14:43:54.787 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0058675050000000003 2024-04-18T14:43:54.787 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:54.787 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:54.787 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for rw locks", 2024-04-18T14:43:54.787 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:50.417270+0000", 2024-04-18T14:43:54.787 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000148252 2024-04-18T14:43:54.787 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:54.787 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:54.787 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-04-18T14:43:54.787 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:50.422476+0000", 2024-04-18T14:43:54.787 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0052058290000000004 2024-04-18T14:43:54.787 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:54.787 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:54.787 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-04-18T14:43:54.787 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:50.422733+0000", 2024-04-18T14:43:54.788 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000257113 2024-04-18T14:43:54.788 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:43:54.788 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:43:54.788 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-04-18T14:43:54.788 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:50.425817+0000", 2024-04-18T14:43:54.788 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0030833639999999999 2024-04-18T14:43:54.788 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:43:54.788 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-04-18T14:43:54.788 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:43:54.788 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:43:54.788 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-04-18T14:43:54.788 INFO:teuthology.orchestra.run.smithi119.stdout:} 2024-04-18T14:43:54.790 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-04-18T14:43:54.791 INFO:tasks.ceph.osd.13.smithi096.stderr:2024-04-18T14:43:54.786+0000 7f7e72fad640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 13 (PID: 24893) UID: 0 2024-04-18T14:43:54.858 INFO:teuthology.orchestra.run.smithi086.stdout:osd.15: {} 2024-04-18T14:43:54.858 INFO:teuthology.orchestra.run.smithi086.stderr:osd.15: osd_enable_op_tracker = '' 2024-04-18T14:43:54.891 INFO:tasks.ceph.osd.13.smithi096.stderr:2024-04-18T14:43:54.890+0000 7f7e72fad640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 13 (PID: 24893) UID: 0 2024-04-18T14:43:54.921 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-04-18T14:43:54.921 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [], 2024-04-18T14:43:54.921 INFO:teuthology.orchestra.run.smithi134.stdout: "num_ops": 0 2024-04-18T14:43:54.921 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-04-18T14:43:54.936 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-04-18T14:43:54.991 INFO:tasks.ceph.osd.11.smithi134.stderr:2024-04-18T14:43:54.996+0000 7f2d36f12640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 11 (PID: 25216) UID: 0 2024-04-18T14:43:55.060 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-04-18T14:43:55.060 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [], 2024-04-18T14:43:55.060 INFO:teuthology.orchestra.run.smithi134.stdout: "complaint_time": 30, 2024-04-18T14:43:55.060 INFO:teuthology.orchestra.run.smithi134.stdout: "num_blocked_ops": 0 2024-04-18T14:43:55.060 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-04-18T14:43:55.074 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-04-18T14:43:55.092 INFO:tasks.ceph.osd.10.smithi119.stderr:2024-04-18T14:43:55.094+0000 7f6f24c12640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 10 (PID: 24898) UID: 0 2024-04-18T14:43:55.194 INFO:tasks.ceph.osd.10.smithi119.stderr:2024-04-18T14:43:55.198+0000 7f6f24c12640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 10 (PID: 24898) UID: 0 2024-04-18T14:43:55.242 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-04-18T14:43:55.242 INFO:teuthology.orchestra.run.smithi134.stdout: "size": 20, 2024-04-18T14:43:55.242 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 600, 2024-04-18T14:43:55.242 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [ 2024-04-18T14:43:55.243 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:55.243 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4559.0:176 3.as0 3:5dff433d:::smithi13430248-20:head [delete] snapc 3=[3,2] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e35)", 2024-04-18T14:43:55.243 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T14:43:34.715612+0000", 2024-04-18T14:43:55.243 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 20.529823497999999, 2024-04-18T14:43:55.243 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.011905134, 2024-04-18T14:43:55.243 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T14:43:55.243 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T14:43:55.243 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-18T14:43:55.243 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4559", 2024-04-18T14:43:55.243 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/3113589487", 2024-04-18T14:43:55.243 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 176 2024-04-18T14:43:55.243 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:55.243 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T14:43:55.243 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:55.243 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T14:43:55.244 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:34.715612+0000", 2024-04-18T14:43:55.244 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:43:55.244 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:55.244 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:55.244 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T14:43:55.244 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:34.715612+0000", 2024-04-18T14:43:55.244 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:43:55.244 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:55.244 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:55.244 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T14:43:55.244 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:34.715609+0000", 2024-04-18T14:43:55.244 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999971 2024-04-18T14:43:55.244 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:55.244 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:55.244 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T14:43:55.245 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:34.715623+0000", 2024-04-18T14:43:55.245 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.4578e-05 2024-04-18T14:43:55.245 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:55.245 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:55.245 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T14:43:55.245 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:34.715659+0000", 2024-04-18T14:43:55.245 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.5824000000000001e-05 2024-04-18T14:43:55.245 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:55.245 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:55.245 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T14:43:55.245 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:34.715676+0000", 2024-04-18T14:43:55.245 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6594000000000001e-05 2024-04-18T14:43:55.245 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:55.245 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:55.246 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T14:43:55.246 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:34.715794+0000", 2024-04-18T14:43:55.246 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000118744 2024-04-18T14:43:55.246 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:55.246 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:55.246 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op must wait for map", 2024-04-18T14:43:55.246 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:34.715807+0000", 2024-04-18T14:43:55.246 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2486e-05 2024-04-18T14:43:55.246 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:55.246 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:55.246 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T14:43:55.246 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:34.718556+0000", 2024-04-18T14:43:55.246 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.002749175 2024-04-18T14:43:55.246 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:55.246 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:55.246 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T14:43:55.247 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:34.718699+0000", 2024-04-18T14:43:55.247 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00014262000000000001 2024-04-18T14:43:55.247 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:55.247 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:55.247 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_started", 2024-04-18T14:43:55.247 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:34.720045+0000", 2024-04-18T14:43:55.247 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0013458400000000001 2024-04-18T14:43:55.247 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:55.247 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:55.247 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_committed", 2024-04-18T14:43:55.247 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:34.721856+0000", 2024-04-18T14:43:55.247 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.001811226 2024-04-18T14:43:55.247 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:55.247 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:55.247 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T14:43:55.248 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:34.727477+0000", 2024-04-18T14:43:55.248 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0056212290000000002 2024-04-18T14:43:55.248 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:55.248 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:55.248 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T14:43:55.248 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:34.727517+0000", 2024-04-18T14:43:55.248 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.9712000000000002e-05 2024-04-18T14:43:55.248 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:43:55.248 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T14:43:55.248 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:43:55.248 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:55.248 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:55.248 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4559.0:178 3.as0 3:504bbe78:::smithi13430248-37:head [append 0~507904] snapc 4=[4,3,2] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-04-18T14:43:55.248 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T14:43:35.731082+0000", 2024-04-18T14:43:55.248 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 19.514353194999998, 2024-04-18T14:43:55.249 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.015989092, 2024-04-18T14:43:55.249 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T14:43:55.249 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T14:43:55.249 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-18T14:43:55.249 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4559", 2024-04-18T14:43:55.249 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/3113589487", 2024-04-18T14:43:55.249 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 178 2024-04-18T14:43:55.249 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:55.249 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T14:43:55.249 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:55.249 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T14:43:55.249 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:35.731082+0000", 2024-04-18T14:43:55.249 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:43:55.250 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:55.250 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:55.250 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T14:43:55.250 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:35.731082+0000", 2024-04-18T14:43:55.250 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:43:55.250 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:55.250 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:55.250 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T14:43:55.250 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:35.731079+0000", 2024-04-18T14:43:55.250 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999971 2024-04-18T14:43:55.250 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:55.250 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:55.250 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T14:43:55.250 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:35.731663+0000", 2024-04-18T14:43:55.251 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00058377699999999995 2024-04-18T14:43:55.251 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:55.251 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:55.251 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T14:43:55.251 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:35.731697+0000", 2024-04-18T14:43:55.251 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.4578e-05 2024-04-18T14:43:55.251 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:55.251 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:55.251 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T14:43:55.251 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:35.731716+0000", 2024-04-18T14:43:55.251 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8413000000000001e-05 2024-04-18T14:43:55.251 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:55.251 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:55.251 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T14:43:55.252 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:35.731829+0000", 2024-04-18T14:43:55.252 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000113323 2024-04-18T14:43:55.252 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:55.252 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:55.252 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op must wait for map", 2024-04-18T14:43:55.252 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:35.731843+0000", 2024-04-18T14:43:55.252 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.4072e-05 2024-04-18T14:43:55.252 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:55.252 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:55.252 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T14:43:55.252 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:35.735773+0000", 2024-04-18T14:43:55.252 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0039293569999999996 2024-04-18T14:43:55.252 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:55.252 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:55.253 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T14:43:55.253 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:35.736021+0000", 2024-04-18T14:43:55.253 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00024879299999999997 2024-04-18T14:43:55.253 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:55.253 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:55.253 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_started", 2024-04-18T14:43:55.253 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:35.738679+0000", 2024-04-18T14:43:55.253 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0026578460000000002 2024-04-18T14:43:55.253 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:55.253 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:55.253 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_committed", 2024-04-18T14:43:55.253 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:35.745018+0000", 2024-04-18T14:43:55.253 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0063392070000000003 2024-04-18T14:43:55.254 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:55.254 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:55.254 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T14:43:55.254 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:35.746981+0000", 2024-04-18T14:43:55.254 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00196254 2024-04-18T14:43:55.254 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:55.254 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:55.254 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T14:43:55.254 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:35.747071+0000", 2024-04-18T14:43:55.254 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.0016e-05 2024-04-18T14:43:55.254 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:43:55.254 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T14:43:55.254 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:43:55.254 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:55.254 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:55.255 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4559.0:179 3.as0 3:504bbe78:::smithi13430248-37:head [append 0~376832] snapc 4=[4,3,2] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-04-18T14:43:55.255 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T14:43:35.735197+0000", 2024-04-18T14:43:55.255 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 19.510238378, 2024-04-18T14:43:55.255 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.013886849999999999, 2024-04-18T14:43:55.255 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T14:43:55.255 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T14:43:55.255 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-18T14:43:55.255 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4559", 2024-04-18T14:43:55.255 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/3113589487", 2024-04-18T14:43:55.255 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 179 2024-04-18T14:43:55.255 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:55.255 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T14:43:55.255 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:55.255 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T14:43:55.255 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:35.735197+0000", 2024-04-18T14:43:55.255 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:43:55.256 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:55.256 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:55.256 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T14:43:55.256 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:35.735197+0000", 2024-04-18T14:43:55.256 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:43:55.256 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:55.256 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:55.256 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T14:43:55.256 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:35.735193+0000", 2024-04-18T14:43:55.256 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999967 2024-04-18T14:43:55.256 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:55.256 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:55.257 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T14:43:55.257 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:35.735791+0000", 2024-04-18T14:43:55.257 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00059791 2024-04-18T14:43:55.257 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:55.257 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:55.257 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T14:43:55.257 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:35.735818+0000", 2024-04-18T14:43:55.257 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.6214e-05 2024-04-18T14:43:55.257 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:55.257 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:55.257 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T14:43:55.257 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:35.735834+0000", 2024-04-18T14:43:55.258 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6603999999999999e-05 2024-04-18T14:43:55.258 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:55.258 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:55.258 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T14:43:55.258 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:35.741060+0000", 2024-04-18T14:43:55.258 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0052256580000000002 2024-04-18T14:43:55.258 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:55.258 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:55.258 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T14:43:55.258 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:35.741402+0000", 2024-04-18T14:43:55.258 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00034264000000000001 2024-04-18T14:43:55.258 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:55.258 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:55.258 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_started", 2024-04-18T14:43:55.259 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:35.743027+0000", 2024-04-18T14:43:55.259 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0016244250000000001 2024-04-18T14:43:55.259 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:55.259 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:55.259 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_committed", 2024-04-18T14:43:55.259 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:35.746673+0000", 2024-04-18T14:43:55.259 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0036466189999999998 2024-04-18T14:43:55.259 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:55.259 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:55.259 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T14:43:55.259 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:35.749020+0000", 2024-04-18T14:43:55.259 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0023462439999999999 2024-04-18T14:43:55.259 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:55.259 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:55.260 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T14:43:55.260 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:35.749084+0000", 2024-04-18T14:43:55.260 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.3875999999999996e-05 2024-04-18T14:43:55.260 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:43:55.260 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T14:43:55.260 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:43:55.260 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:55.260 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:55.260 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4559.0:180 3.as0 3:504bbe78:::smithi13430248-37:head [setxattr _header (56) in=7b] snapc 4=[4,3,2] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-04-18T14:43:55.260 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T14:43:35.735855+0000", 2024-04-18T14:43:55.260 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 19.509580276000001, 2024-04-18T14:43:55.260 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.013531458999999999, 2024-04-18T14:43:55.260 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T14:43:55.261 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T14:43:55.261 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-18T14:43:55.261 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4559", 2024-04-18T14:43:55.261 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/3113589487", 2024-04-18T14:43:55.261 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 180 2024-04-18T14:43:55.261 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:55.261 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T14:43:55.261 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:55.261 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T14:43:55.261 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:35.735855+0000", 2024-04-18T14:43:55.261 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:43:55.261 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:55.261 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:55.262 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T14:43:55.262 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:35.735855+0000", 2024-04-18T14:43:55.262 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:43:55.262 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:55.262 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:55.262 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T14:43:55.262 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:35.735853+0000", 2024-04-18T14:43:55.262 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999986 2024-04-18T14:43:55.262 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:55.262 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:55.262 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T14:43:55.262 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:35.735860+0000", 2024-04-18T14:43:55.262 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.024e-06 2024-04-18T14:43:55.262 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:55.262 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:55.263 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T14:43:55.263 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:35.735871+0000", 2024-04-18T14:43:55.263 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.076e-05 2024-04-18T14:43:55.263 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:55.263 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:55.263 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T14:43:55.263 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:35.735895+0000", 2024-04-18T14:43:55.263 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.3623999999999999e-05 2024-04-18T14:43:55.263 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:55.263 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:55.263 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T14:43:55.263 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:35.745199+0000", 2024-04-18T14:43:55.264 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0093043380000000005 2024-04-18T14:43:55.264 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:55.264 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:55.264 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T14:43:55.264 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:35.745372+0000", 2024-04-18T14:43:55.264 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00017296100000000001 2024-04-18T14:43:55.264 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:55.264 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:55.264 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_started", 2024-04-18T14:43:55.264 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:35.746162+0000", 2024-04-18T14:43:55.264 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00078974600000000002 2024-04-18T14:43:55.264 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:55.264 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:55.265 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_committed", 2024-04-18T14:43:55.265 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:35.748150+0000", 2024-04-18T14:43:55.265 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0019877649999999998 2024-04-18T14:43:55.265 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:55.265 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:55.265 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T14:43:55.265 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:35.749316+0000", 2024-04-18T14:43:55.265 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0011658949999999999 2024-04-18T14:43:55.265 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:55.265 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:55.266 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T14:43:55.266 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:35.749386+0000", 2024-04-18T14:43:55.266 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.0729999999999995e-05 2024-04-18T14:43:55.266 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:43:55.266 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T14:43:55.266 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:43:55.266 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:55.266 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:55.266 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4559.0:181 3.as0 3:504bbe78:::smithi13430248-37:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e36)", 2024-04-18T14:43:55.266 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T14:43:35.735904+0000", 2024-04-18T14:43:55.266 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 19.509531390999999, 2024-04-18T14:43:55.266 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.015807422000000002, 2024-04-18T14:43:55.267 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T14:43:55.267 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-04-18T14:43:55.267 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-18T14:43:55.267 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4559", 2024-04-18T14:43:55.267 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/3113589487", 2024-04-18T14:43:55.267 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 181 2024-04-18T14:43:55.267 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:55.267 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T14:43:55.267 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:55.267 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T14:43:55.267 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:35.735904+0000", 2024-04-18T14:43:55.267 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:43:55.267 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:55.267 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:55.267 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T14:43:55.268 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:35.735904+0000", 2024-04-18T14:43:55.268 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:43:55.268 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:55.268 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:55.268 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T14:43:55.268 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:35.735903+0000", 2024-04-18T14:43:55.268 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-18T14:43:55.268 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:55.268 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:55.268 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T14:43:55.268 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:35.735907+0000", 2024-04-18T14:43:55.268 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.1899999999999997e-06 2024-04-18T14:43:55.268 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:55.268 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:55.268 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T14:43:55.269 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:35.735920+0000", 2024-04-18T14:43:55.269 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2857000000000001e-05 2024-04-18T14:43:55.269 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:55.269 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:55.269 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T14:43:55.269 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:35.735927+0000", 2024-04-18T14:43:55.269 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.447e-06 2024-04-18T14:43:55.269 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:55.269 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:55.269 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T14:43:55.269 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:35.746529+0000", 2024-04-18T14:43:55.269 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.010601348 2024-04-18T14:43:55.269 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:55.269 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:55.270 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for rw locks", 2024-04-18T14:43:55.270 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:35.746655+0000", 2024-04-18T14:43:55.270 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000125823 2024-04-18T14:43:55.270 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:55.270 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:55.270 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T14:43:55.270 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:35.749858+0000", 2024-04-18T14:43:55.270 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0032038209999999999 2024-04-18T14:43:55.270 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:55.270 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:55.270 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T14:43:55.270 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:35.750001+0000", 2024-04-18T14:43:55.270 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000142602 2024-04-18T14:43:55.271 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:55.271 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:55.271 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T14:43:55.271 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:35.751711+0000", 2024-04-18T14:43:55.271 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0017101709999999999 2024-04-18T14:43:55.271 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:43:55.271 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T14:43:55.271 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:43:55.271 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:55.271 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:55.271 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4559.0:190 3.as0 3:5474a36d:::smithi13430248-11:head [delete] snapc 4=[4,2] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e37)", 2024-04-18T14:43:55.271 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T14:43:36.761006+0000", 2024-04-18T14:43:55.272 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 18.484429579, 2024-04-18T14:43:55.272 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.014529398000000001, 2024-04-18T14:43:55.272 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T14:43:55.272 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T14:43:55.272 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-18T14:43:55.272 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4559", 2024-04-18T14:43:55.272 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/3113589487", 2024-04-18T14:43:55.272 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 190 2024-04-18T14:43:55.272 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:55.272 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T14:43:55.273 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:55.273 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T14:43:55.273 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.761006+0000", 2024-04-18T14:43:55.273 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:43:55.273 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:55.273 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:55.273 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T14:43:55.273 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.761006+0000", 2024-04-18T14:43:55.273 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:43:55.273 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:55.273 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:55.273 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T14:43:55.273 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.761002+0000", 2024-04-18T14:43:55.274 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999967 2024-04-18T14:43:55.274 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:55.274 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:55.274 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T14:43:55.274 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.761018+0000", 2024-04-18T14:43:55.274 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5339999999999999e-05 2024-04-18T14:43:55.274 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:55.274 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:55.274 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T14:43:55.274 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.761058+0000", 2024-04-18T14:43:55.274 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.0197999999999997e-05 2024-04-18T14:43:55.274 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:55.274 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:55.275 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T14:43:55.275 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.761074+0000", 2024-04-18T14:43:55.275 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6646999999999998e-05 2024-04-18T14:43:55.275 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:55.275 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:55.275 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T14:43:55.275 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.761215+0000", 2024-04-18T14:43:55.275 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00014079399999999999 2024-04-18T14:43:55.275 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:55.275 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:55.275 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op must wait for map", 2024-04-18T14:43:55.275 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.761236+0000", 2024-04-18T14:43:55.275 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.105e-05 2024-04-18T14:43:55.275 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:55.275 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:55.275 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T14:43:55.276 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.765644+0000", 2024-04-18T14:43:55.276 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.004408159 2024-04-18T14:43:55.276 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:55.276 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:55.276 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T14:43:55.276 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.765818+0000", 2024-04-18T14:43:55.276 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00017385799999999999 2024-04-18T14:43:55.276 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:55.276 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:55.276 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_started", 2024-04-18T14:43:55.276 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.767388+0000", 2024-04-18T14:43:55.276 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0015693980000000001 2024-04-18T14:43:55.276 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:55.277 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:55.277 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_committed", 2024-04-18T14:43:55.277 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.774151+0000", 2024-04-18T14:43:55.277 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0067634050000000001 2024-04-18T14:43:55.277 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:55.277 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:55.277 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T14:43:55.277 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.775409+0000", 2024-04-18T14:43:55.277 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00125745 2024-04-18T14:43:55.277 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:55.277 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:55.277 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T14:43:55.277 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.775535+0000", 2024-04-18T14:43:55.277 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000126379 2024-04-18T14:43:55.278 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:43:55.278 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T14:43:55.278 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:43:55.278 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:55.278 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:55.278 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "MOSDECSubOpWriteReply(3.as0 37/30 ECSubWriteReply(tid=23, last_complete=37'16, committed=1, applied=1))", 2024-04-18T14:43:55.278 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T14:43:36.768128+0000", 2024-04-18T14:43:55.278 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 18.477306815999999, 2024-04-18T14:43:55.278 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0069581299999999999, 2024-04-18T14:43:55.278 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T14:43:55.278 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-04-18T14:43:55.278 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T14:43:55.278 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:55.279 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T14:43:55.279 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.768128+0000", 2024-04-18T14:43:55.279 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:43:55.279 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:55.279 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:55.279 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T14:43:55.279 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.768128+0000", 2024-04-18T14:43:55.279 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:43:55.279 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:55.279 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:55.279 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T14:43:55.279 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.768126+0000", 2024-04-18T14:43:55.279 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999981 2024-04-18T14:43:55.280 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:55.280 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:55.280 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T14:43:55.280 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.768139+0000", 2024-04-18T14:43:55.280 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2493e-05 2024-04-18T14:43:55.280 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:55.280 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:55.280 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T14:43:55.280 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.768169+0000", 2024-04-18T14:43:55.280 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.0463999999999998e-05 2024-04-18T14:43:55.280 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:55.280 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:55.280 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T14:43:55.280 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.768190+0000", 2024-04-18T14:43:55.280 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.1070999999999999e-05 2024-04-18T14:43:55.281 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:55.281 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:55.281 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T14:43:55.281 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.774008+0000", 2024-04-18T14:43:55.281 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0058170929999999997 2024-04-18T14:43:55.281 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:55.281 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:55.281 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T14:43:55.281 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.775086+0000", 2024-04-18T14:43:55.281 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.001078905 2024-04-18T14:43:55.281 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:43:55.281 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T14:43:55.281 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:43:55.281 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:55.282 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:55.282 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4559.0:244 3.as0 3:577932fb:::smithi13430248-41:head [read 0~688128,checksum,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-04-18T14:43:55.282 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T14:43:40.759326+0000", 2024-04-18T14:43:55.282 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 14.486108679999999, 2024-04-18T14:43:55.282 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.017168499, 2024-04-18T14:43:55.282 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T14:43:55.282 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-04-18T14:43:55.282 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-18T14:43:55.282 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4559", 2024-04-18T14:43:55.282 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/3113589487", 2024-04-18T14:43:55.282 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 244 2024-04-18T14:43:55.282 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:55.282 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T14:43:55.282 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:55.283 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T14:43:55.283 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:40.759326+0000", 2024-04-18T14:43:55.283 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:43:55.283 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:55.283 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:55.283 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T14:43:55.283 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:40.759326+0000", 2024-04-18T14:43:55.283 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:43:55.283 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:55.283 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:55.283 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T14:43:55.283 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:40.759323+0000", 2024-04-18T14:43:55.283 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999971 2024-04-18T14:43:55.283 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:55.283 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:55.284 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T14:43:55.284 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:40.759340+0000", 2024-04-18T14:43:55.284 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6344000000000001e-05 2024-04-18T14:43:55.284 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:55.284 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:55.284 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T14:43:55.284 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:40.759375+0000", 2024-04-18T14:43:55.284 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.5043999999999999e-05 2024-04-18T14:43:55.284 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:55.284 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:55.284 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T14:43:55.284 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:40.759392+0000", 2024-04-18T14:43:55.285 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6801000000000001e-05 2024-04-18T14:43:55.285 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:55.285 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:55.285 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T14:43:55.285 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:40.759518+0000", 2024-04-18T14:43:55.285 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00012620200000000001 2024-04-18T14:43:55.285 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:55.285 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:55.285 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op must wait for map", 2024-04-18T14:43:55.285 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:40.759537+0000", 2024-04-18T14:43:55.285 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.9670999999999999e-05 2024-04-18T14:43:55.285 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:55.285 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:55.286 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T14:43:55.286 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:40.764645+0000", 2024-04-18T14:43:55.286 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0051078240000000004 2024-04-18T14:43:55.286 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:55.286 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:55.286 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T14:43:55.286 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:40.764872+0000", 2024-04-18T14:43:55.286 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00022684499999999999 2024-04-18T14:43:55.286 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:55.286 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:55.286 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T14:43:55.286 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:40.776495+0000", 2024-04-18T14:43:55.286 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.011622791 2024-04-18T14:43:55.286 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:43:55.287 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T14:43:55.287 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:43:55.287 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:55.287 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:55.287 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4559.0:245 3.as0 3:577932fb:::smithi13430248-41:head [read 0~688128,checksum] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-04-18T14:43:55.287 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T14:43:40.759413+0000", 2024-04-18T14:43:55.287 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 14.486021967999999, 2024-04-18T14:43:55.287 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.017883375999999999, 2024-04-18T14:43:55.287 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T14:43:55.287 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-04-18T14:43:55.287 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-18T14:43:55.287 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4559", 2024-04-18T14:43:55.287 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/3113589487", 2024-04-18T14:43:55.287 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 245 2024-04-18T14:43:55.287 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:55.288 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T14:43:55.288 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:55.288 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T14:43:55.288 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:40.759413+0000", 2024-04-18T14:43:55.288 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:43:55.288 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:55.288 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:55.288 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T14:43:55.288 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:40.759413+0000", 2024-04-18T14:43:55.288 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:43:55.288 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:55.288 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:55.288 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T14:43:55.288 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:40.759412+0000", 2024-04-18T14:43:55.288 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999986 2024-04-18T14:43:55.289 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:55.289 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:55.289 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T14:43:55.289 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:40.759421+0000", 2024-04-18T14:43:55.289 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.3409999999999992e-06 2024-04-18T14:43:55.289 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:55.289 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:55.289 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T14:43:55.289 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:40.759440+0000", 2024-04-18T14:43:55.289 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8467000000000001e-05 2024-04-18T14:43:55.289 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:55.289 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:55.289 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T14:43:55.289 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:40.759454+0000", 2024-04-18T14:43:55.289 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.4113e-05 2024-04-18T14:43:55.290 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:55.290 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:55.290 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T14:43:55.290 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:40.759694+0000", 2024-04-18T14:43:55.290 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00023988199999999999 2024-04-18T14:43:55.290 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:55.290 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:55.290 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting_for_map not empty", 2024-04-18T14:43:55.290 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:40.759711+0000", 2024-04-18T14:43:55.290 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6988000000000001e-05 2024-04-18T14:43:55.290 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:55.290 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:55.290 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T14:43:55.290 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:40.766045+0000", 2024-04-18T14:43:55.291 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0063342169999999996 2024-04-18T14:43:55.291 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:55.291 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:55.291 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T14:43:55.291 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:40.766299+0000", 2024-04-18T14:43:55.291 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00025419199999999998 2024-04-18T14:43:55.291 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:55.291 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:55.291 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T14:43:55.291 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:40.777297+0000", 2024-04-18T14:43:55.291 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.010997536 2024-04-18T14:43:55.291 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:43:55.291 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T14:43:55.291 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:43:55.291 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:55.292 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:55.292 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4559.0:246 3.as0 3:577932fb:::smithi13430248-41:head [read 0~688128,checksum] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-04-18T14:43:55.292 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T14:43:40.759528+0000", 2024-04-18T14:43:55.292 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 14.485906791, 2024-04-18T14:43:55.292 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.019049244, 2024-04-18T14:43:55.292 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T14:43:55.292 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-04-18T14:43:55.292 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-18T14:43:55.292 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4559", 2024-04-18T14:43:55.292 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/3113589487", 2024-04-18T14:43:55.292 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 246 2024-04-18T14:43:55.292 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:55.292 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T14:43:55.293 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:55.293 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T14:43:55.293 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:40.759528+0000", 2024-04-18T14:43:55.293 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:43:55.293 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:55.293 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:55.293 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T14:43:55.293 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:40.759528+0000", 2024-04-18T14:43:55.293 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:43:55.293 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:55.293 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:55.293 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T14:43:55.293 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:40.759527+0000", 2024-04-18T14:43:55.294 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999986 2024-04-18T14:43:55.294 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:55.294 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:55.294 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T14:43:55.294 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:40.759536+0000", 2024-04-18T14:43:55.294 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.1540000000000008e-06 2024-04-18T14:43:55.294 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:55.294 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:55.294 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T14:43:55.294 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:40.759555+0000", 2024-04-18T14:43:55.294 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.9133000000000001e-05 2024-04-18T14:43:55.294 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:55.294 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:55.294 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T14:43:55.295 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:40.759570+0000", 2024-04-18T14:43:55.295 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5017999999999999e-05 2024-04-18T14:43:55.295 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:55.295 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:55.295 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T14:43:55.295 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:40.759776+0000", 2024-04-18T14:43:55.295 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000205577 2024-04-18T14:43:55.295 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:55.295 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:55.295 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting_for_map not empty", 2024-04-18T14:43:55.295 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:40.759792+0000", 2024-04-18T14:43:55.295 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6381000000000001e-05 2024-04-18T14:43:55.295 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:55.295 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:55.296 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T14:43:55.296 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:40.767014+0000", 2024-04-18T14:43:55.296 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0072223299999999999 2024-04-18T14:43:55.296 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:55.296 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:55.296 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T14:43:55.296 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:40.767254+0000", 2024-04-18T14:43:55.296 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00023931899999999999 2024-04-18T14:43:55.296 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:55.296 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:55.296 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T14:43:55.296 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:40.778578+0000", 2024-04-18T14:43:55.296 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.011323796000000001 2024-04-18T14:43:55.296 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:43:55.296 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T14:43:55.297 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:43:55.297 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:55.297 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:55.297 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "MOSDECSubOpRead(3.as0 41/30 ECSubRead(tid=27, to_read={3:577932fb:::smithi13430248-41:head=0,172032,0}, subchunks={3:577932fb:::smithi13430248-41:head=[0,1]}, attrs_to_read=))", 2024-04-18T14:43:55.297 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T14:43:40.765612+0000", 2024-04-18T14:43:55.297 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 14.479822963, 2024-04-18T14:43:55.297 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0055773339999999998, 2024-04-18T14:43:55.297 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T14:43:55.297 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-04-18T14:43:55.297 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T14:43:55.297 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:55.297 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T14:43:55.297 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:40.765612+0000", 2024-04-18T14:43:55.297 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:43:55.297 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:55.297 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:55.298 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T14:43:55.298 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:40.765612+0000", 2024-04-18T14:43:55.298 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:43:55.298 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:55.298 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:55.298 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T14:43:55.298 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:40.765612+0000", 2024-04-18T14:43:55.298 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:43:55.298 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:55.298 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:55.298 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T14:43:55.298 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:40.765612+0000", 2024-04-18T14:43:55.298 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:43:55.299 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:55.299 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:55.299 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T14:43:55.299 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:40.766004+0000", 2024-04-18T14:43:55.299 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00039217199999999999 2024-04-18T14:43:55.299 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:55.299 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:55.299 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T14:43:55.299 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:40.766054+0000", 2024-04-18T14:43:55.299 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.9224999999999997e-05 2024-04-18T14:43:55.299 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:55.299 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:55.299 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T14:43:55.299 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:40.768146+0000", 2024-04-18T14:43:55.300 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.002092216 2024-04-18T14:43:55.300 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:55.300 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:55.300 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T14:43:55.300 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:40.771190+0000", 2024-04-18T14:43:55.300 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0030437210000000001 2024-04-18T14:43:55.300 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:43:55.300 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T14:43:55.300 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:43:55.300 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:55.300 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:55.300 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "MOSDECSubOpReadReply(3.as0 41/30 ECSubReadReply(tid=27, attrs_read=0))", 2024-04-18T14:43:55.300 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T14:43:40.768641+0000", 2024-04-18T14:43:55.300 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 14.476793979, 2024-04-18T14:43:55.300 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0068345070000000001, 2024-04-18T14:43:55.301 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T14:43:55.301 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-04-18T14:43:55.301 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T14:43:55.301 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:55.301 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T14:43:55.301 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:40.768641+0000", 2024-04-18T14:43:55.301 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:43:55.301 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:55.301 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:55.301 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T14:43:55.302 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:40.768641+0000", 2024-04-18T14:43:55.302 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:43:55.302 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:55.302 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:55.302 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T14:43:55.302 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:40.768639+0000", 2024-04-18T14:43:55.302 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999976 2024-04-18T14:43:55.302 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:55.302 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:55.302 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T14:43:55.302 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:40.770039+0000", 2024-04-18T14:43:55.302 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.001400479 2024-04-18T14:43:55.302 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:55.302 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:55.303 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T14:43:55.303 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:40.770052+0000", 2024-04-18T14:43:55.303 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2913e-05 2024-04-18T14:43:55.303 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:55.303 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:55.303 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T14:43:55.303 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:40.770059+0000", 2024-04-18T14:43:55.303 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.4300000000000003e-06 2024-04-18T14:43:55.303 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:55.303 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:55.303 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T14:43:55.303 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:40.775428+0000", 2024-04-18T14:43:55.303 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0053696079999999997 2024-04-18T14:43:55.303 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:55.303 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:55.304 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T14:43:55.304 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:40.775476+0000", 2024-04-18T14:43:55.304 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.7327000000000003e-05 2024-04-18T14:43:55.304 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:43:55.304 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T14:43:55.304 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:43:55.304 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:55.304 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:55.304 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "MOSDECSubOpReadReply(3.as0 41/30 ECSubReadReply(tid=29, attrs_read=0))", 2024-04-18T14:43:55.304 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T14:43:40.769626+0000", 2024-04-18T14:43:55.304 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 14.475808878, 2024-04-18T14:43:55.304 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0057718960000000003, 2024-04-18T14:43:55.304 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T14:43:55.304 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-04-18T14:43:55.304 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T14:43:55.305 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:55.305 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T14:43:55.305 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:40.769626+0000", 2024-04-18T14:43:55.305 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:43:55.305 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:55.305 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:55.305 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T14:43:55.305 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:40.769626+0000", 2024-04-18T14:43:55.305 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:43:55.305 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:55.305 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:55.305 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T14:43:55.305 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:40.769626+0000", 2024-04-18T14:43:55.306 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-04-18T14:43:55.306 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:55.306 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:55.306 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T14:43:55.306 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:40.769771+0000", 2024-04-18T14:43:55.306 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000145356 2024-04-18T14:43:55.306 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:55.306 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:55.306 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T14:43:55.306 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:40.769782+0000", 2024-04-18T14:43:55.306 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1253999999999999e-05 2024-04-18T14:43:55.306 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:55.306 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:55.306 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T14:43:55.307 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:40.769789+0000", 2024-04-18T14:43:55.307 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.6529999999999997e-06 2024-04-18T14:43:55.307 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:55.307 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:55.307 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T14:43:55.307 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:40.772303+0000", 2024-04-18T14:43:55.307 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.002513721 2024-04-18T14:43:55.307 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:55.307 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:55.307 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T14:43:55.307 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:40.775398+0000", 2024-04-18T14:43:55.307 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0030953249999999999 2024-04-18T14:43:55.307 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:43:55.308 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T14:43:55.308 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:43:55.308 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:55.308 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:55.308 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "MOSDECSubOpReadReply(3.as0 41/30 ECSubReadReply(tid=28, attrs_read=0))", 2024-04-18T14:43:55.308 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T14:43:40.770067+0000", 2024-04-18T14:43:55.308 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 14.475368473, 2024-04-18T14:43:55.308 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0054705989999999996, 2024-04-18T14:43:55.308 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T14:43:55.308 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-04-18T14:43:55.308 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T14:43:55.308 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:55.308 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T14:43:55.309 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:40.770067+0000", 2024-04-18T14:43:55.309 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:43:55.309 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:55.309 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:55.309 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T14:43:55.309 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:40.770067+0000", 2024-04-18T14:43:55.309 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:43:55.309 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:55.309 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:55.309 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T14:43:55.309 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:40.770066+0000", 2024-04-18T14:43:55.309 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-04-18T14:43:55.309 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:55.310 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:55.310 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T14:43:55.310 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:40.770223+0000", 2024-04-18T14:43:55.310 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000156883 2024-04-18T14:43:55.310 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:55.310 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:55.310 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T14:43:55.310 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:40.770232+0000", 2024-04-18T14:43:55.310 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.9819999999999997e-06 2024-04-18T14:43:55.310 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:55.310 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:55.310 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T14:43:55.310 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:40.770238+0000", 2024-04-18T14:43:55.311 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.6729999999999997e-06 2024-04-18T14:43:55.311 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:55.311 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:55.311 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T14:43:55.311 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:40.775500+0000", 2024-04-18T14:43:55.311 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0052624780000000001 2024-04-18T14:43:55.311 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:55.311 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:55.311 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T14:43:55.311 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:40.775537+0000", 2024-04-18T14:43:55.311 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.7014000000000002e-05 2024-04-18T14:43:55.311 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:43:55.312 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T14:43:55.312 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:43:55.312 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:55.312 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:55.312 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "MOSDECSubOpWrite(3.es6 45/30 ECSubWrite(tid=21, reqid=client.4559.0:306, at_version=45'13, trim_to=0'0, roll_forward_to=44'11))", 2024-04-18T14:43:55.312 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T14:43:44.508424+0000", 2024-04-18T14:43:55.312 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 10.737011527, 2024-04-18T14:43:55.312 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0084897640000000003, 2024-04-18T14:43:55.312 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T14:43:55.312 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-04-18T14:43:55.312 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T14:43:55.313 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:55.313 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T14:43:55.313 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:44.508424+0000", 2024-04-18T14:43:55.313 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:43:55.313 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:55.313 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:55.313 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T14:43:55.313 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:44.508424+0000", 2024-04-18T14:43:55.313 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:43:55.313 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:55.313 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:55.313 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T14:43:55.313 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:44.508423+0000", 2024-04-18T14:43:55.314 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-04-18T14:43:55.314 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:55.314 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:55.314 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T14:43:55.314 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:44.508991+0000", 2024-04-18T14:43:55.314 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00056772400000000003 2024-04-18T14:43:55.314 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:55.314 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:55.314 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T14:43:55.314 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:44.509028+0000", 2024-04-18T14:43:55.314 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.7718e-05 2024-04-18T14:43:55.314 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:55.315 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:55.315 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T14:43:55.315 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:44.509055+0000", 2024-04-18T14:43:55.315 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.6489999999999999e-05 2024-04-18T14:43:55.315 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:55.315 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:55.315 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T14:43:55.315 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:44.509231+0000", 2024-04-18T14:43:55.315 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000175787 2024-04-18T14:43:55.315 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:55.315 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:55.315 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_started", 2024-04-18T14:43:55.315 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:44.509264+0000", 2024-04-18T14:43:55.315 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.2777000000000001e-05 2024-04-18T14:43:55.316 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:55.316 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:55.316 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_committed", 2024-04-18T14:43:55.316 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:44.516873+0000", 2024-04-18T14:43:55.316 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0076094739999999998 2024-04-18T14:43:55.316 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:55.316 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:55.316 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T14:43:55.316 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:44.516913+0000", 2024-04-18T14:43:55.316 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.0357e-05 2024-04-18T14:43:55.316 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:43:55.316 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T14:43:55.316 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:43:55.316 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:55.317 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:55.317 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "MOSDECSubOpWrite(3.2s2 46/30 ECSubWrite(tid=190, reqid=osd.13.0:190, at_version=46'10, trim_to=0'0, roll_forward_to=45'8))", 2024-04-18T14:43:55.317 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T14:43:45.385429+0000", 2024-04-18T14:43:55.317 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 9.8600061100000005, 2024-04-18T14:43:55.317 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0074861670000000002, 2024-04-18T14:43:55.317 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T14:43:55.317 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-04-18T14:43:55.317 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T14:43:55.317 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:55.317 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T14:43:55.317 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:45.385429+0000", 2024-04-18T14:43:55.317 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:43:55.317 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:55.318 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:55.318 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T14:43:55.318 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:45.385429+0000", 2024-04-18T14:43:55.318 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:43:55.318 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:55.318 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:55.318 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T14:43:55.318 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:45.385428+0000", 2024-04-18T14:43:55.318 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-18T14:43:55.318 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:55.318 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:55.318 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T14:43:55.318 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:45.385487+0000", 2024-04-18T14:43:55.319 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.8451e-05 2024-04-18T14:43:55.319 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:55.319 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:55.319 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T14:43:55.319 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:45.385517+0000", 2024-04-18T14:43:55.319 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.0354000000000001e-05 2024-04-18T14:43:55.319 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:55.319 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:55.319 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T14:43:55.319 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:45.385546+0000", 2024-04-18T14:43:55.319 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.8594000000000001e-05 2024-04-18T14:43:55.319 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:55.319 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:55.319 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T14:43:55.319 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:45.385684+0000", 2024-04-18T14:43:55.320 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000138856 2024-04-18T14:43:55.320 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:55.320 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:55.320 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_started", 2024-04-18T14:43:55.320 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:45.385716+0000", 2024-04-18T14:43:55.320 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.1306999999999997e-05 2024-04-18T14:43:55.320 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:55.320 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:55.320 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_committed", 2024-04-18T14:43:55.320 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:45.392850+0000", 2024-04-18T14:43:55.320 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.007134367 2024-04-18T14:43:55.320 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:55.320 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:55.320 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T14:43:55.321 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:45.392915+0000", 2024-04-18T14:43:55.321 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.5110999999999994e-05 2024-04-18T14:43:55.321 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:43:55.321 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T14:43:55.321 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:43:55.321 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:55.321 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:55.321 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "MOSDECSubOpWrite(3.es6 46/30 ECSubWrite(tid=26, reqid=osd.8.0:26, at_version=46'17, trim_to=0'0, roll_forward_to=45'15))", 2024-04-18T14:43:55.321 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T14:43:45.389687+0000", 2024-04-18T14:43:55.321 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 9.8557481849999995, 2024-04-18T14:43:55.321 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0056600269999999998, 2024-04-18T14:43:55.321 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T14:43:55.322 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-04-18T14:43:55.322 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T14:43:55.322 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:55.322 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T14:43:55.322 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:45.389687+0000", 2024-04-18T14:43:55.322 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:43:55.322 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:55.322 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:55.322 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T14:43:55.322 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:45.389687+0000", 2024-04-18T14:43:55.322 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:43:55.322 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:55.322 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:55.322 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T14:43:55.323 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:45.389686+0000", 2024-04-18T14:43:55.323 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-04-18T14:43:55.323 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:55.323 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:55.323 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T14:43:55.323 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:45.389725+0000", 2024-04-18T14:43:55.323 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.8300999999999998e-05 2024-04-18T14:43:55.323 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:55.323 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:55.323 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T14:43:55.323 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:45.389745+0000", 2024-04-18T14:43:55.323 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0746000000000001e-05 2024-04-18T14:43:55.323 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:55.323 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:55.324 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T14:43:55.324 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:45.389783+0000", 2024-04-18T14:43:55.324 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.7153000000000002e-05 2024-04-18T14:43:55.324 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:55.324 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:55.324 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T14:43:55.324 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:45.390021+0000", 2024-04-18T14:43:55.324 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00023869599999999999 2024-04-18T14:43:55.324 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:55.324 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:55.324 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_started", 2024-04-18T14:43:55.324 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:45.390048+0000", 2024-04-18T14:43:55.324 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.6474000000000001e-05 2024-04-18T14:43:55.324 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:55.324 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:55.325 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_committed", 2024-04-18T14:43:55.325 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:45.395293+0000", 2024-04-18T14:43:55.325 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0052450700000000001 2024-04-18T14:43:55.325 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:55.325 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:55.325 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T14:43:55.325 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:45.395347+0000", 2024-04-18T14:43:55.325 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.4156999999999997e-05 2024-04-18T14:43:55.325 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:43:55.325 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T14:43:55.325 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:43:55.325 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:55.325 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:55.325 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "MOSDECSubOpWrite(3.ds1 50/30 ECSubWrite(tid=12, reqid=osd.7.0:12, at_version=50'11, trim_to=0'0, roll_forward_to=49'9))", 2024-04-18T14:43:55.325 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T14:43:49.406464+0000", 2024-04-18T14:43:55.326 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 5.8389713649999999, 2024-04-18T14:43:55.326 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.010390701, 2024-04-18T14:43:55.326 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T14:43:55.326 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-04-18T14:43:55.326 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T14:43:55.326 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:55.326 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T14:43:55.326 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:49.406464+0000", 2024-04-18T14:43:55.326 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:43:55.326 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:55.326 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:55.326 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T14:43:55.326 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:49.406464+0000", 2024-04-18T14:43:55.327 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:43:55.327 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:55.327 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:55.327 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T14:43:55.327 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:49.406463+0000", 2024-04-18T14:43:55.327 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-18T14:43:55.327 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:55.327 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:55.327 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T14:43:55.327 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:49.406539+0000", 2024-04-18T14:43:55.327 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.6114999999999999e-05 2024-04-18T14:43:55.327 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:55.327 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:55.327 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T14:43:55.328 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:49.406577+0000", 2024-04-18T14:43:55.328 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.7806999999999999e-05 2024-04-18T14:43:55.328 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:55.328 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:55.328 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T14:43:55.328 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:49.406601+0000", 2024-04-18T14:43:55.328 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.4090000000000001e-05 2024-04-18T14:43:55.328 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:55.328 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:55.328 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T14:43:55.328 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:49.409363+0000", 2024-04-18T14:43:55.328 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0027624640000000001 2024-04-18T14:43:55.328 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:55.328 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:55.329 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_started", 2024-04-18T14:43:55.329 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:49.409399+0000", 2024-04-18T14:43:55.329 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.5830000000000001e-05 2024-04-18T14:43:55.329 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:55.329 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:55.329 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_committed", 2024-04-18T14:43:55.329 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:49.416792+0000", 2024-04-18T14:43:55.329 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0073926620000000004 2024-04-18T14:43:55.329 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:55.329 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:55.329 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T14:43:55.329 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:49.416854+0000", 2024-04-18T14:43:55.329 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.2527000000000006e-05 2024-04-18T14:43:55.329 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:43:55.330 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T14:43:55.330 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:43:55.330 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:55.330 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:55.330 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4559.0:362 3.as0 3:5474a36d:::smithi13430248-11:head [append 0~0] snapc 13=[13,11,f,b,a,8,7,2] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-04-18T14:43:55.330 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T14:43:50.376205+0000", 2024-04-18T14:43:55.330 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 4.8692301389999999, 2024-04-18T14:43:55.330 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.013968441, 2024-04-18T14:43:55.330 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T14:43:55.330 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T14:43:55.330 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-18T14:43:55.330 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4559", 2024-04-18T14:43:55.330 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/3113589487", 2024-04-18T14:43:55.330 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 362 2024-04-18T14:43:55.331 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:55.331 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T14:43:55.331 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:55.331 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T14:43:55.331 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:50.376205+0000", 2024-04-18T14:43:55.331 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:43:55.331 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:55.331 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:55.331 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T14:43:55.331 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:50.376205+0000", 2024-04-18T14:43:55.331 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:43:55.331 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:55.331 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:55.331 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T14:43:55.332 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:50.376202+0000", 2024-04-18T14:43:55.332 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999971 2024-04-18T14:43:55.332 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:55.332 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:55.332 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T14:43:55.332 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:50.376220+0000", 2024-04-18T14:43:55.332 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.7876999999999998e-05 2024-04-18T14:43:55.332 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:55.332 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:55.332 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T14:43:55.332 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:50.376256+0000", 2024-04-18T14:43:55.332 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.6384000000000003e-05 2024-04-18T14:43:55.332 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:55.332 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:55.333 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T14:43:55.333 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:50.376274+0000", 2024-04-18T14:43:55.333 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.7727000000000002e-05 2024-04-18T14:43:55.333 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:55.333 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:55.333 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T14:43:55.333 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:50.376445+0000", 2024-04-18T14:43:55.333 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000171046 2024-04-18T14:43:55.333 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:55.333 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:55.333 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op must wait for map", 2024-04-18T14:43:55.333 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:50.376460+0000", 2024-04-18T14:43:55.333 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.4620000000000001e-05 2024-04-18T14:43:55.333 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:55.334 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:55.334 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T14:43:55.334 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:50.381860+0000", 2024-04-18T14:43:55.334 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0054002199999999998 2024-04-18T14:43:55.334 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:55.334 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:55.334 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T14:43:55.334 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:50.382042+0000", 2024-04-18T14:43:55.334 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00018185900000000001 2024-04-18T14:43:55.334 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:55.334 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:55.334 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_started", 2024-04-18T14:43:55.334 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:50.383954+0000", 2024-04-18T14:43:55.334 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0019126530000000001 2024-04-18T14:43:55.335 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:55.335 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:55.335 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_committed", 2024-04-18T14:43:55.335 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:50.389758+0000", 2024-04-18T14:43:55.335 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.005803702 2024-04-18T14:43:55.335 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:55.335 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:55.335 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T14:43:55.335 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:50.390098+0000", 2024-04-18T14:43:55.335 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00033984400000000001 2024-04-18T14:43:55.335 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:55.335 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:55.335 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T14:43:55.336 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:50.390173+0000", 2024-04-18T14:43:55.336 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.5581999999999996e-05 2024-04-18T14:43:55.336 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:43:55.336 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T14:43:55.336 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:43:55.336 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:55.336 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:55.336 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4559.0:363 3.as0 3:5474a36d:::smithi13430248-11:head [rollback 7] snapc 13=[13,11,f,b,a,8,7,2] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-04-18T14:43:55.336 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T14:43:50.376296+0000", 2024-04-18T14:43:55.336 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 4.8691392369999997, 2024-04-18T14:43:55.336 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.015443114000000001, 2024-04-18T14:43:55.336 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T14:43:55.336 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T14:43:55.336 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-18T14:43:55.336 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4559", 2024-04-18T14:43:55.336 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/3113589487", 2024-04-18T14:43:55.336 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 363 2024-04-18T14:43:55.337 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:55.337 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T14:43:55.337 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:55.337 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T14:43:55.337 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:50.376296+0000", 2024-04-18T14:43:55.337 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:43:55.337 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:55.337 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:55.337 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T14:43:55.337 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:50.376296+0000", 2024-04-18T14:43:55.337 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:43:55.337 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:55.337 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:55.337 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T14:43:55.338 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:50.376295+0000", 2024-04-18T14:43:55.338 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-18T14:43:55.338 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:55.338 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:55.338 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T14:43:55.338 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:50.376300+0000", 2024-04-18T14:43:55.338 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.7199999999999997e-06 2024-04-18T14:43:55.338 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:55.338 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:55.338 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T14:43:55.338 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:50.376333+0000", 2024-04-18T14:43:55.338 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.3315999999999997e-05 2024-04-18T14:43:55.338 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:55.339 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:55.339 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T14:43:55.339 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:50.376343+0000", 2024-04-18T14:43:55.339 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0346999999999999e-05 2024-04-18T14:43:55.339 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:55.339 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:55.339 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T14:43:55.339 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:50.376596+0000", 2024-04-18T14:43:55.339 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00025260099999999998 2024-04-18T14:43:55.339 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:55.339 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:55.339 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting_for_map not empty", 2024-04-18T14:43:55.339 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:50.376611+0000", 2024-04-18T14:43:55.339 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5594e-05 2024-04-18T14:43:55.340 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:55.340 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:55.340 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T14:43:55.340 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:50.385330+0000", 2024-04-18T14:43:55.340 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0087181299999999993 2024-04-18T14:43:55.340 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:55.340 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:55.340 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T14:43:55.340 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:50.385574+0000", 2024-04-18T14:43:55.340 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00024469699999999999 2024-04-18T14:43:55.340 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:55.340 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:55.340 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_started", 2024-04-18T14:43:55.340 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:50.386969+0000", 2024-04-18T14:43:55.341 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0013943639999999999 2024-04-18T14:43:55.341 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:55.341 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:55.341 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_committed", 2024-04-18T14:43:55.341 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:50.389892+0000", 2024-04-18T14:43:55.341 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0029229059999999999 2024-04-18T14:43:55.341 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:55.341 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:55.341 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T14:43:55.341 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:50.391671+0000", 2024-04-18T14:43:55.341 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0017797080000000001 2024-04-18T14:43:55.341 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:55.341 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:55.341 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T14:43:55.341 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:50.391739+0000", 2024-04-18T14:43:55.342 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.7756999999999995e-05 2024-04-18T14:43:55.342 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:43:55.342 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T14:43:55.342 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:43:55.342 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:43:55.342 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T14:43:55.342 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-04-18T14:43:55.343 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-04-18T14:43:55.344 INFO:tasks.ceph.osd.9.smithi096.stderr:2024-04-18T14:43:55.342+0000 7fa2c1cbf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 9 (PID: 24891) UID: 0 2024-04-18T14:43:55.374 INFO:teuthology.orchestra.run.smithi086.stderr:reweighted osd.3 to 1 (10000) 2024-04-18T14:43:55.376 INFO:tasks.rados.rados.0.smithi134.stdout:187: done (2 left) 2024-04-18T14:43:55.376 INFO:tasks.rados.rados.0.smithi134.stdout:188: snap_create 2024-04-18T14:43:55.376 INFO:tasks.rados.rados.0.smithi134.stdout:185: finishing rollback tid 0 to smithi13430248-16 2024-04-18T14:43:55.376 INFO:tasks.rados.rados.0.smithi134.stdout:185: finishing rollback tid 1 to smithi13430248-16 2024-04-18T14:43:55.376 INFO:tasks.rados.rados.0.smithi134.stdout:185: finishing rollback tid 2 to smithi13430248-16 2024-04-18T14:43:55.376 INFO:tasks.rados.rados.0.smithi134.stdout:update_object_version oid 16 v 59 (ObjNum 15 snap 0 seq_num 15) dirty exists 2024-04-18T14:43:55.376 INFO:tasks.rados.rados.0.smithi134.stdout:186: expect (ObjNum 85 snap 15 seq_num 85) 2024-04-18T14:43:55.398 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 4 1 2024-04-18T14:43:55.444 INFO:tasks.ceph.osd.8.smithi086.stderr:2024-04-18T14:43:55.443+0000 7f29f7b9d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 8 (PID: 24958) UID: 0 2024-04-18T14:43:55.474 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-04-18T14:43:55.475 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [], 2024-04-18T14:43:55.475 INFO:teuthology.orchestra.run.smithi134.stdout: "num_ops": 0 2024-04-18T14:43:55.475 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-04-18T14:43:55.489 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-04-18T14:43:55.575 INFO:tasks.ceph.osd.7.smithi134.stderr:2024-04-18T14:43:55.580+0000 7fd7de549640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25213) UID: 0 2024-04-18T14:43:55.646 INFO:tasks.ceph.osd.11.smithi134.stderr:2024-04-18T14:43:55.648+0000 7f2d36f12640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 11 (PID: 25216) UID: 0 2024-04-18T14:43:55.653 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-04-18T14:43:55.653 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [], 2024-04-18T14:43:55.653 INFO:teuthology.orchestra.run.smithi134.stdout: "complaint_time": 30, 2024-04-18T14:43:55.653 INFO:teuthology.orchestra.run.smithi134.stdout: "num_blocked_ops": 0 2024-04-18T14:43:55.653 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-04-18T14:43:55.667 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-04-18T14:43:55.748 INFO:tasks.ceph.osd.0.smithi086.stderr:2024-04-18T14:43:55.747+0000 7f7cdfd78640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 24953) UID: 0 2024-04-18T14:43:55.838 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-04-18T14:43:55.838 INFO:teuthology.orchestra.run.smithi134.stdout: "size": 20, 2024-04-18T14:43:55.838 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 600, 2024-04-18T14:43:55.838 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [ 2024-04-18T14:43:55.838 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:55.838 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "MOSDECSubOpWrite(3.as1 35/30 ECSubWrite(tid=16, reqid=client.4559.0:176, at_version=35'10, trim_to=0'0, roll_forward_to=33'8))", 2024-04-18T14:43:55.838 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T14:43:34.719973+0000", 2024-04-18T14:43:55.839 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 21.119755473000001, 2024-04-18T14:43:55.839 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0071817529999999999, 2024-04-18T14:43:55.839 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T14:43:55.839 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-04-18T14:43:55.839 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T14:43:55.839 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:55.839 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T14:43:55.839 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:34.719973+0000", 2024-04-18T14:43:55.839 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:43:55.839 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:55.839 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:55.839 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T14:43:55.839 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:34.719973+0000", 2024-04-18T14:43:55.840 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:43:55.840 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:55.840 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:55.840 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T14:43:55.840 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:34.719973+0000", 2024-04-18T14:43:55.840 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-04-18T14:43:55.840 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:55.840 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:55.840 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T14:43:55.840 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:34.720054+0000", 2024-04-18T14:43:55.840 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.0933000000000006e-05 2024-04-18T14:43:55.840 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:55.840 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:55.840 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T14:43:55.840 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:34.720091+0000", 2024-04-18T14:43:55.841 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.7611000000000003e-05 2024-04-18T14:43:55.841 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:55.841 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:55.841 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T14:43:55.841 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:34.725072+0000", 2024-04-18T14:43:55.841 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0049810920000000003 2024-04-18T14:43:55.841 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:55.841 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:55.841 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T14:43:55.841 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:34.725204+0000", 2024-04-18T14:43:55.841 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00013195700000000001 2024-04-18T14:43:55.841 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:55.841 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:55.841 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_started", 2024-04-18T14:43:55.842 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:34.725235+0000", 2024-04-18T14:43:55.842 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.0314000000000001e-05 2024-04-18T14:43:55.842 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:55.842 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:55.842 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_committed", 2024-04-18T14:43:55.842 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:34.727109+0000", 2024-04-18T14:43:55.842 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.001874625 2024-04-18T14:43:55.842 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:55.842 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:55.842 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T14:43:55.842 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:34.727155+0000", 2024-04-18T14:43:55.842 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.5748000000000003e-05 2024-04-18T14:43:55.842 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:43:55.843 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T14:43:55.843 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:43:55.843 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:55.843 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:55.843 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "MOSDECSubOpRead(3.as1 41/30 ECSubRead(tid=27, to_read={3:577932fb:::smithi13430248-41:head=0,172032,0}, subchunks={3:577932fb:::smithi13430248-41:head=[0,1]}, attrs_to_read=))", 2024-04-18T14:43:55.843 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T14:43:40.766524+0000", 2024-04-18T14:43:55.843 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 15.073205081999999, 2024-04-18T14:43:55.843 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0050926499999999998, 2024-04-18T14:43:55.843 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T14:43:55.843 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-04-18T14:43:55.843 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T14:43:55.843 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:55.843 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T14:43:55.843 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:40.766524+0000", 2024-04-18T14:43:55.843 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:43:55.844 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:55.844 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:55.844 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T14:43:55.844 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:40.766524+0000", 2024-04-18T14:43:55.844 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:43:55.844 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:55.844 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:55.844 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T14:43:55.844 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:40.766523+0000", 2024-04-18T14:43:55.844 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-04-18T14:43:55.844 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:55.844 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:55.844 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T14:43:55.844 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:40.766545+0000", 2024-04-18T14:43:55.844 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2164e-05 2024-04-18T14:43:55.845 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:55.845 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:55.845 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T14:43:55.845 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:40.766592+0000", 2024-04-18T14:43:55.845 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.6953999999999998e-05 2024-04-18T14:43:55.845 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:55.845 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:55.845 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T14:43:55.845 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:40.766620+0000", 2024-04-18T14:43:55.845 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.7937e-05 2024-04-18T14:43:55.845 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:55.845 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:55.845 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T14:43:55.845 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:40.766833+0000", 2024-04-18T14:43:55.845 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000213122 2024-04-18T14:43:55.846 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:55.846 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:55.846 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T14:43:55.846 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:40.771616+0000", 2024-04-18T14:43:55.846 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0047831530000000001 2024-04-18T14:43:55.846 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:43:55.846 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T14:43:55.846 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:43:55.846 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:55.846 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:55.846 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "MOSDECSubOpRead(3.as1 41/30 ECSubRead(tid=28, to_read={3:577932fb:::smithi13430248-41:head=0,172032,0}, subchunks={3:577932fb:::smithi13430248-41:head=[0,1]}, attrs_to_read=))", 2024-04-18T14:43:55.846 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T14:43:40.767264+0000", 2024-04-18T14:43:55.846 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 15.072464392000001, 2024-04-18T14:43:55.846 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0045755769999999999, 2024-04-18T14:43:55.847 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T14:43:55.847 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-04-18T14:43:55.847 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T14:43:55.847 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:55.847 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T14:43:55.847 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:40.767264+0000", 2024-04-18T14:43:55.847 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:43:55.847 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:55.847 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:55.847 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T14:43:55.847 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:40.767264+0000", 2024-04-18T14:43:55.847 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:43:55.847 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:55.847 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:55.848 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T14:43:55.848 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:40.767263+0000", 2024-04-18T14:43:55.848 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999986 2024-04-18T14:43:55.848 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:55.848 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:55.848 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T14:43:55.848 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:40.767278+0000", 2024-04-18T14:43:55.848 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.502e-05 2024-04-18T14:43:55.848 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:55.848 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:55.848 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T14:43:55.848 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:40.767305+0000", 2024-04-18T14:43:55.848 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.7007000000000001e-05 2024-04-18T14:43:55.848 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:55.848 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:55.848 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T14:43:55.849 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:40.767362+0000", 2024-04-18T14:43:55.849 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.7485000000000003e-05 2024-04-18T14:43:55.849 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:55.849 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:55.849 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T14:43:55.849 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:40.771714+0000", 2024-04-18T14:43:55.849 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0043512430000000003 2024-04-18T14:43:55.849 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:55.849 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:55.849 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T14:43:55.849 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:40.771840+0000", 2024-04-18T14:43:55.849 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000126222 2024-04-18T14:43:55.849 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:43:55.849 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T14:43:55.849 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:43:55.850 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:55.850 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:55.850 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "MOSDECSubOpRead(3.as1 41/30 ECSubRead(tid=29, to_read={3:577932fb:::smithi13430248-41:head=0,172032,0}, subchunks={3:577932fb:::smithi13430248-41:head=[0,1]}, attrs_to_read=))", 2024-04-18T14:43:55.850 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T14:43:40.768034+0000", 2024-04-18T14:43:55.850 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 15.071694922000001, 2024-04-18T14:43:55.850 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00419484, 2024-04-18T14:43:55.850 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T14:43:55.850 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-04-18T14:43:55.850 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T14:43:55.850 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:55.850 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T14:43:55.850 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:40.768034+0000", 2024-04-18T14:43:55.850 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:43:55.850 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:55.850 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:55.850 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T14:43:55.851 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:40.768034+0000", 2024-04-18T14:43:55.851 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:43:55.851 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:55.851 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:55.851 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T14:43:55.851 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:40.768032+0000", 2024-04-18T14:43:55.851 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999981 2024-04-18T14:43:55.851 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:55.851 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:55.851 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T14:43:55.851 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:40.768052+0000", 2024-04-18T14:43:55.851 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.9636999999999999e-05 2024-04-18T14:43:55.852 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:55.852 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:55.852 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T14:43:55.852 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:40.768108+0000", 2024-04-18T14:43:55.852 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.5961999999999997e-05 2024-04-18T14:43:55.852 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:55.852 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:55.852 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T14:43:55.852 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:40.768135+0000", 2024-04-18T14:43:55.852 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.707e-05 2024-04-18T14:43:55.852 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:55.852 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:55.852 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T14:43:55.852 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:40.771923+0000", 2024-04-18T14:43:55.852 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0037877980000000002 2024-04-18T14:43:55.853 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:55.853 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:55.853 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T14:43:55.853 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:40.772229+0000", 2024-04-18T14:43:55.853 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00030612 2024-04-18T14:43:55.853 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:43:55.853 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T14:43:55.853 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:43:55.853 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:55.853 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:55.853 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "MOSDECSubOpWrite(3.6s5 45/30 ECSubWrite(tid=62, reqid=client.4559.0:310, at_version=45'19, trim_to=0'0, roll_forward_to=44'17))", 2024-04-18T14:43:55.853 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T14:43:44.540683+0000", 2024-04-18T14:43:55.853 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 11.299045754, 2024-04-18T14:43:55.853 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0059607940000000002, 2024-04-18T14:43:55.854 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T14:43:55.854 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-04-18T14:43:55.854 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T14:43:55.854 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:55.854 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T14:43:55.854 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:44.540683+0000", 2024-04-18T14:43:55.854 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:43:55.854 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:55.854 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:55.854 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T14:43:55.854 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:44.540683+0000", 2024-04-18T14:43:55.855 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:43:55.855 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:55.855 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:55.855 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T14:43:55.855 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:44.540682+0000", 2024-04-18T14:43:55.855 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-18T14:43:55.855 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:55.855 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:55.855 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T14:43:55.855 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:44.541332+0000", 2024-04-18T14:43:55.855 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000650222 2024-04-18T14:43:55.855 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:55.855 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:55.855 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T14:43:55.856 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:44.541363+0000", 2024-04-18T14:43:55.856 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.0341e-05 2024-04-18T14:43:55.856 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:55.856 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:55.856 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T14:43:55.856 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:44.541378+0000", 2024-04-18T14:43:55.856 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.577e-05 2024-04-18T14:43:55.856 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:55.856 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:55.856 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T14:43:55.856 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:44.541490+0000", 2024-04-18T14:43:55.856 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000111512 2024-04-18T14:43:55.856 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:55.856 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:55.856 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_started", 2024-04-18T14:43:55.857 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:44.541514+0000", 2024-04-18T14:43:55.857 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.3898000000000001e-05 2024-04-18T14:43:55.857 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:55.857 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:55.857 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_committed", 2024-04-18T14:43:55.857 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:44.546604+0000", 2024-04-18T14:43:55.857 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0050903770000000001 2024-04-18T14:43:55.857 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:55.857 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:55.857 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T14:43:55.857 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:44.546644+0000", 2024-04-18T14:43:55.857 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.9594000000000001e-05 2024-04-18T14:43:55.857 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:43:55.857 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T14:43:55.857 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:43:55.858 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:55.858 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:55.858 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "MOSDECSubOpWrite(3.2s5 45/30 ECSubWrite(tid=185, reqid=client.4559.0:314, at_version=45'6, trim_to=0'0, roll_forward_to=33'4))", 2024-04-18T14:43:55.858 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T14:43:44.562152+0000", 2024-04-18T14:43:55.858 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 11.277576741000001, 2024-04-18T14:43:55.858 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0041942710000000003, 2024-04-18T14:43:55.858 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T14:43:55.858 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-04-18T14:43:55.858 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T14:43:55.858 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:55.858 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T14:43:55.858 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:44.562152+0000", 2024-04-18T14:43:55.858 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:43:55.858 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:55.859 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:55.859 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T14:43:55.859 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:44.562152+0000", 2024-04-18T14:43:55.859 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:43:55.859 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:55.859 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:55.859 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T14:43:55.859 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:44.562151+0000", 2024-04-18T14:43:55.859 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-04-18T14:43:55.859 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:55.859 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:55.859 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T14:43:55.859 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:44.562653+0000", 2024-04-18T14:43:55.859 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00050174599999999996 2024-04-18T14:43:55.860 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:55.860 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:55.860 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T14:43:55.860 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:44.562693+0000", 2024-04-18T14:43:55.860 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.9496999999999998e-05 2024-04-18T14:43:55.860 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:55.860 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:55.860 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T14:43:55.860 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:44.562718+0000", 2024-04-18T14:43:55.860 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.5358e-05 2024-04-18T14:43:55.860 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:55.860 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:55.860 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T14:43:55.860 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:44.562881+0000", 2024-04-18T14:43:55.860 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00016273899999999999 2024-04-18T14:43:55.861 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:55.861 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:55.861 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_started", 2024-04-18T14:43:55.861 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:44.562908+0000", 2024-04-18T14:43:55.861 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.6747999999999999e-05 2024-04-18T14:43:55.861 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:55.861 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:55.861 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_committed", 2024-04-18T14:43:55.861 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:44.566279+0000", 2024-04-18T14:43:55.861 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.003371499 2024-04-18T14:43:55.861 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:55.861 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:55.861 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T14:43:55.861 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:44.566346+0000", 2024-04-18T14:43:55.861 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.724e-05 2024-04-18T14:43:55.861 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:43:55.862 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T14:43:55.862 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:43:55.862 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:55.862 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:55.862 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "MOSDECSubOpWrite(3.2s5 46/30 ECSubWrite(tid=190, reqid=osd.13.0:190, at_version=46'10, trim_to=0'0, roll_forward_to=45'8))", 2024-04-18T14:43:55.862 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T14:43:45.385116+0000", 2024-04-18T14:43:55.862 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 10.454613224999999, 2024-04-18T14:43:55.862 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0044629780000000003, 2024-04-18T14:43:55.862 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T14:43:55.862 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-04-18T14:43:55.862 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T14:43:55.862 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:55.862 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T14:43:55.862 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:45.385116+0000", 2024-04-18T14:43:55.863 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:43:55.863 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:55.863 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:55.863 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T14:43:55.863 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:45.385116+0000", 2024-04-18T14:43:55.863 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:43:55.863 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:55.863 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:55.863 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T14:43:55.863 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:45.385115+0000", 2024-04-18T14:43:55.863 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-18T14:43:55.863 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:55.863 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:55.863 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T14:43:55.863 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:45.385187+0000", 2024-04-18T14:43:55.863 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.1934999999999995e-05 2024-04-18T14:43:55.864 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:55.864 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:55.864 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T14:43:55.864 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:45.385217+0000", 2024-04-18T14:43:55.864 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.0774e-05 2024-04-18T14:43:55.864 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:55.864 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:55.864 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T14:43:55.864 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:45.385239+0000", 2024-04-18T14:43:55.864 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.1967000000000002e-05 2024-04-18T14:43:55.864 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:55.864 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:55.864 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T14:43:55.864 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:45.385392+0000", 2024-04-18T14:43:55.864 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00015229999999999999 2024-04-18T14:43:55.865 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:55.865 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:55.865 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_started", 2024-04-18T14:43:55.865 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:45.385422+0000", 2024-04-18T14:43:55.865 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.029e-05 2024-04-18T14:43:55.865 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:55.865 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:55.865 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_committed", 2024-04-18T14:43:55.865 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:45.389516+0000", 2024-04-18T14:43:55.865 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0040940849999999999 2024-04-18T14:43:55.865 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:55.865 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:55.865 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T14:43:55.865 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:45.389579+0000", 2024-04-18T14:43:55.866 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.2414000000000002e-05 2024-04-18T14:43:55.866 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:43:55.866 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T14:43:55.866 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:43:55.866 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:55.866 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:55.866 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "MOSDECSubOpWrite(3.5s4 46/30 ECSubWrite(tid=14, reqid=osd.15.0:13, at_version=0'0, trim_to=0'0, roll_forward_to=46'12))", 2024-04-18T14:43:55.866 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T14:43:45.391429+0000", 2024-04-18T14:43:55.866 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 10.448299603000001, 2024-04-18T14:43:55.866 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.010693606, 2024-04-18T14:43:55.866 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T14:43:55.866 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-04-18T14:43:55.866 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T14:43:55.866 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:55.866 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T14:43:55.867 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:45.391429+0000", 2024-04-18T14:43:55.867 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:43:55.867 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:55.867 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:55.867 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T14:43:55.867 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:45.391429+0000", 2024-04-18T14:43:55.867 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:43:55.867 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:55.867 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:55.867 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T14:43:55.867 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:45.391427+0000", 2024-04-18T14:43:55.867 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999981 2024-04-18T14:43:55.867 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:55.867 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:55.867 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T14:43:55.868 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:45.391458+0000", 2024-04-18T14:43:55.868 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.04e-05 2024-04-18T14:43:55.868 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:55.868 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:55.868 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T14:43:55.868 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:45.391489+0000", 2024-04-18T14:43:55.868 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.1424000000000003e-05 2024-04-18T14:43:55.868 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:55.868 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:55.868 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T14:43:55.868 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:45.391514+0000", 2024-04-18T14:43:55.868 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.4740999999999999e-05 2024-04-18T14:43:55.868 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:55.868 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:55.868 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T14:43:55.869 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:45.392451+0000", 2024-04-18T14:43:55.869 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000937227 2024-04-18T14:43:55.869 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:55.869 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:55.869 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_started", 2024-04-18T14:43:55.869 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:45.392476+0000", 2024-04-18T14:43:55.869 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.4797e-05 2024-04-18T14:43:55.869 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:55.869 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:55.869 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_committed", 2024-04-18T14:43:55.869 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:45.402059+0000", 2024-04-18T14:43:55.869 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0095835150000000008 2024-04-18T14:43:55.870 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:55.870 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:55.870 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T14:43:55.870 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:45.402123+0000", 2024-04-18T14:43:55.870 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.3307999999999998e-05 2024-04-18T14:43:55.870 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:43:55.870 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T14:43:55.870 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:43:55.870 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:55.870 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:55.870 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "MOSDECSubOpWrite(3.2s5 46/30 ECSubWrite(tid=191, reqid=osd.13.0:190, at_version=0'0, trim_to=0'0, roll_forward_to=46'10))", 2024-04-18T14:43:55.870 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T14:43:45.395046+0000", 2024-04-18T14:43:55.870 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 10.44468236, 2024-04-18T14:43:55.870 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0074998809999999999, 2024-04-18T14:43:55.870 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T14:43:55.871 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-04-18T14:43:55.871 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T14:43:55.871 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:55.871 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T14:43:55.871 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:45.395046+0000", 2024-04-18T14:43:55.871 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:43:55.871 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:55.871 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:55.871 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T14:43:55.871 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:45.395046+0000", 2024-04-18T14:43:55.871 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:43:55.871 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:55.871 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:55.871 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T14:43:55.871 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:45.395044+0000", 2024-04-18T14:43:55.871 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999981 2024-04-18T14:43:55.872 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:55.872 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:55.872 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T14:43:55.872 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:45.395075+0000", 2024-04-18T14:43:55.872 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.0158000000000002e-05 2024-04-18T14:43:55.872 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:55.872 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:55.872 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T14:43:55.872 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:45.395107+0000", 2024-04-18T14:43:55.872 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.2465999999999997e-05 2024-04-18T14:43:55.872 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:55.872 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:55.872 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T14:43:55.872 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:45.395130+0000", 2024-04-18T14:43:55.872 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2591000000000001e-05 2024-04-18T14:43:55.873 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:55.873 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:55.873 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T14:43:55.873 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:45.395859+0000", 2024-04-18T14:43:55.873 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00072886700000000001 2024-04-18T14:43:55.873 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:55.873 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:55.873 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_started", 2024-04-18T14:43:55.873 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:45.395882+0000", 2024-04-18T14:43:55.873 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.3836999999999999e-05 2024-04-18T14:43:55.873 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:55.873 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:55.873 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_committed", 2024-04-18T14:43:55.873 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:45.402479+0000", 2024-04-18T14:43:55.873 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0065963469999999998 2024-04-18T14:43:55.873 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:55.874 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:55.874 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T14:43:55.874 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:45.402546+0000", 2024-04-18T14:43:55.874 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.7534999999999996e-05 2024-04-18T14:43:55.874 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:43:55.874 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T14:43:55.874 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:43:55.874 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:55.874 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:55.874 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "MOSDECSubOpWrite(3.6s5 46/30 ECSubWrite(tid=68, reqid=osd.14.0:67, at_version=0'0, trim_to=0'0, roll_forward_to=46'23))", 2024-04-18T14:43:55.874 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T14:43:45.398025+0000", 2024-04-18T14:43:55.874 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 10.441704095, 2024-04-18T14:43:55.874 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0040533790000000002, 2024-04-18T14:43:55.874 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T14:43:55.874 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-04-18T14:43:55.875 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T14:43:55.875 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:55.875 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T14:43:55.875 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:45.398025+0000", 2024-04-18T14:43:55.875 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:43:55.875 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:55.875 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:55.875 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T14:43:55.875 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:45.398025+0000", 2024-04-18T14:43:55.875 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:43:55.875 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:55.875 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:55.875 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T14:43:55.876 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:45.398023+0000", 2024-04-18T14:43:55.876 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999986 2024-04-18T14:43:55.876 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:55.876 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:55.876 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T14:43:55.876 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:45.398052+0000", 2024-04-18T14:43:55.876 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.8503000000000001e-05 2024-04-18T14:43:55.876 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:55.876 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:55.876 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T14:43:55.876 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:45.398082+0000", 2024-04-18T14:43:55.876 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.0207999999999999e-05 2024-04-18T14:43:55.876 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:55.876 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:55.876 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T14:43:55.877 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:45.398103+0000", 2024-04-18T14:43:55.877 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.1163e-05 2024-04-18T14:43:55.877 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:55.877 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:55.877 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T14:43:55.877 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:45.398223+0000", 2024-04-18T14:43:55.877 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00011999500000000001 2024-04-18T14:43:55.877 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:55.877 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:55.877 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_started", 2024-04-18T14:43:55.877 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:45.398248+0000", 2024-04-18T14:43:55.877 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.5514999999999999e-05 2024-04-18T14:43:55.878 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:55.878 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:55.878 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_committed", 2024-04-18T14:43:55.878 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:45.402021+0000", 2024-04-18T14:43:55.878 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0037725240000000002 2024-04-18T14:43:55.878 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:55.878 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:55.878 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T14:43:55.878 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:45.402078+0000", 2024-04-18T14:43:55.878 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.7093999999999999e-05 2024-04-18T14:43:55.878 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:43:55.878 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T14:43:55.878 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:43:55.879 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:55.879 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:55.879 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "MOSDECSubOpWrite(3.5s4 47/30 ECSubWrite(tid=15, reqid=client.4559.0:326, at_version=47'13, trim_to=0'0, roll_forward_to=46'12))", 2024-04-18T14:43:55.879 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T14:43:46.394760+0000", 2024-04-18T14:43:55.879 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 9.4449689970000001, 2024-04-18T14:43:55.879 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0041671479999999999, 2024-04-18T14:43:55.879 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T14:43:55.879 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-04-18T14:43:55.879 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T14:43:55.879 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:55.879 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T14:43:55.879 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:46.394760+0000", 2024-04-18T14:43:55.879 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:43:55.879 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:55.880 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:55.880 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T14:43:55.880 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:46.394760+0000", 2024-04-18T14:43:55.880 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:43:55.880 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:55.880 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:55.880 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T14:43:55.880 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:46.394759+0000", 2024-04-18T14:43:55.880 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-18T14:43:55.880 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:55.880 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:55.880 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T14:43:55.880 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:46.395682+0000", 2024-04-18T14:43:55.880 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00092362300000000004 2024-04-18T14:43:55.880 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:55.881 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:55.881 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T14:43:55.881 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:46.395730+0000", 2024-04-18T14:43:55.881 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.7181000000000001e-05 2024-04-18T14:43:55.881 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:55.881 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:55.881 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T14:43:55.881 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:46.395761+0000", 2024-04-18T14:43:55.881 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.0932999999999997e-05 2024-04-18T14:43:55.881 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:55.881 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:55.881 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T14:43:55.881 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:46.395926+0000", 2024-04-18T14:43:55.881 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00016588799999999999 2024-04-18T14:43:55.881 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:55.882 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:55.882 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_started", 2024-04-18T14:43:55.882 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:46.395950+0000", 2024-04-18T14:43:55.882 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.3920000000000001e-05 2024-04-18T14:43:55.882 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:55.882 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:55.882 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_committed", 2024-04-18T14:43:55.882 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:46.398877+0000", 2024-04-18T14:43:55.882 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0029264989999999999 2024-04-18T14:43:55.882 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:55.882 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:55.882 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T14:43:55.882 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:46.398927+0000", 2024-04-18T14:43:55.882 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.0008e-05 2024-04-18T14:43:55.883 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:43:55.883 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T14:43:55.883 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:43:55.883 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:55.883 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:55.883 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "MOSDECSubOpWrite(3.6s5 50/30 ECSubWrite(tid=83, reqid=osd.14.0:83, at_version=50'34, trim_to=0'0, roll_forward_to=49'30))", 2024-04-18T14:43:55.883 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T14:43:49.400376+0000", 2024-04-18T14:43:55.883 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 6.4393524319999997, 2024-04-18T14:43:55.883 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0069812629999999997, 2024-04-18T14:43:55.883 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T14:43:55.883 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-04-18T14:43:55.883 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T14:43:55.883 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:55.883 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T14:43:55.884 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:49.400376+0000", 2024-04-18T14:43:55.884 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:43:55.884 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:55.884 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:55.884 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T14:43:55.884 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:49.400376+0000", 2024-04-18T14:43:55.884 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:43:55.884 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:55.884 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:55.884 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T14:43:55.884 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:49.400374+0000", 2024-04-18T14:43:55.884 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999981 2024-04-18T14:43:55.884 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:55.884 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:55.884 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T14:43:55.885 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:49.400448+0000", 2024-04-18T14:43:55.885 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.3311000000000003e-05 2024-04-18T14:43:55.885 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:55.885 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:55.885 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T14:43:55.885 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:49.400492+0000", 2024-04-18T14:43:55.885 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.3955000000000002e-05 2024-04-18T14:43:55.885 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:55.885 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:55.885 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T14:43:55.885 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:49.400513+0000", 2024-04-18T14:43:55.885 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.1895999999999998e-05 2024-04-18T14:43:55.885 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:55.886 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:55.886 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T14:43:55.886 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:49.400642+0000", 2024-04-18T14:43:55.886 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00012908599999999999 2024-04-18T14:43:55.886 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:55.886 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:55.886 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_started", 2024-04-18T14:43:55.886 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:49.400668+0000", 2024-04-18T14:43:55.886 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.5389999999999999e-05 2024-04-18T14:43:55.886 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:55.886 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:55.886 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_committed", 2024-04-18T14:43:55.886 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:49.407304+0000", 2024-04-18T14:43:55.886 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0066362349999999999 2024-04-18T14:43:55.887 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:55.887 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:55.887 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T14:43:55.887 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:49.407358+0000", 2024-04-18T14:43:55.887 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.3486999999999998e-05 2024-04-18T14:43:55.887 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:43:55.887 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T14:43:55.887 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:43:55.887 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:55.887 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:55.887 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "MOSDECSubOpWrite(3.6s5 50/30 ECSubWrite(tid=85, reqid=osd.14.0:83, at_version=0'0, trim_to=0'0, roll_forward_to=50'34))", 2024-04-18T14:43:55.887 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T14:43:49.416039+0000", 2024-04-18T14:43:55.887 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 6.423690218, 2024-04-18T14:43:55.887 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0039255430000000001, 2024-04-18T14:43:55.887 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T14:43:55.887 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-04-18T14:43:55.888 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T14:43:55.888 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:55.888 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T14:43:55.888 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:49.416039+0000", 2024-04-18T14:43:55.888 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:43:55.888 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:55.888 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:55.888 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T14:43:55.888 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:49.416039+0000", 2024-04-18T14:43:55.888 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:43:55.888 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:55.888 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:55.888 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T14:43:55.888 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:49.416037+0000", 2024-04-18T14:43:55.888 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999981 2024-04-18T14:43:55.889 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:55.889 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:55.889 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T14:43:55.889 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:49.416068+0000", 2024-04-18T14:43:55.889 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.1059999999999997e-05 2024-04-18T14:43:55.889 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:55.889 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:55.889 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T14:43:55.889 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:49.416102+0000", 2024-04-18T14:43:55.889 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.4100999999999998e-05 2024-04-18T14:43:55.889 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:55.889 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:55.889 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T14:43:55.889 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:49.416125+0000", 2024-04-18T14:43:55.889 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2897000000000001e-05 2024-04-18T14:43:55.889 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:55.890 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:55.890 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T14:43:55.890 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:49.416669+0000", 2024-04-18T14:43:55.890 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000543835 2024-04-18T14:43:55.890 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:55.890 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:55.890 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_started", 2024-04-18T14:43:55.890 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:49.416693+0000", 2024-04-18T14:43:55.890 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.476e-05 2024-04-18T14:43:55.890 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:55.890 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:55.890 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_committed", 2024-04-18T14:43:55.890 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:49.419889+0000", 2024-04-18T14:43:55.890 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0031951390000000001 2024-04-18T14:43:55.890 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:55.891 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:55.891 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T14:43:55.891 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:49.419964+0000", 2024-04-18T14:43:55.891 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.5578e-05 2024-04-18T14:43:55.891 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:43:55.891 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T14:43:55.891 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:43:55.891 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:55.891 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:55.891 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "MOSDECSubOpWrite(3.6s5 51/30 ECSubWrite(tid=86, reqid=client.4559.0:359, at_version=51'36, trim_to=0'0, roll_forward_to=50'34))", 2024-04-18T14:43:55.891 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T14:43:50.377763+0000", 2024-04-18T14:43:55.891 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 5.4619652780000001, 2024-04-18T14:43:55.891 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0075355739999999997, 2024-04-18T14:43:55.891 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T14:43:55.891 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-04-18T14:43:55.892 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T14:43:55.892 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:55.892 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T14:43:55.892 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:50.377763+0000", 2024-04-18T14:43:55.892 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:43:55.892 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:55.892 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:55.892 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T14:43:55.892 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:50.377763+0000", 2024-04-18T14:43:55.892 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:43:55.892 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:55.892 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:55.892 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T14:43:55.892 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:50.377763+0000", 2024-04-18T14:43:55.892 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-04-18T14:43:55.892 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:55.893 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:55.893 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T14:43:55.893 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:50.377875+0000", 2024-04-18T14:43:55.893 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000112095 2024-04-18T14:43:55.893 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:55.893 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:55.893 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T14:43:55.893 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:50.377907+0000", 2024-04-18T14:43:55.893 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.1720999999999997e-05 2024-04-18T14:43:55.893 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:55.893 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:55.893 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T14:43:55.893 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:50.377932+0000", 2024-04-18T14:43:55.893 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.5182999999999999e-05 2024-04-18T14:43:55.894 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:55.894 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:55.894 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T14:43:55.894 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:50.378089+0000", 2024-04-18T14:43:55.894 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00015708200000000001 2024-04-18T14:43:55.894 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:55.894 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:55.894 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_started", 2024-04-18T14:43:55.894 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:50.378122+0000", 2024-04-18T14:43:55.894 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.3090999999999999e-05 2024-04-18T14:43:55.894 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:55.894 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:55.894 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_committed", 2024-04-18T14:43:55.894 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:50.385267+0000", 2024-04-18T14:43:55.895 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0071449829999999997 2024-04-18T14:43:55.895 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:55.895 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:55.895 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T14:43:55.895 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:50.385299+0000", 2024-04-18T14:43:55.895 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.1924999999999997e-05 2024-04-18T14:43:55.895 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:43:55.895 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T14:43:55.895 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:43:55.895 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:55.895 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:55.895 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "MOSDECSubOpWrite(3.6s5 51/30 ECSubWrite(tid=89, reqid=client.4559.0:360, at_version=51'37, trim_to=0'0, roll_forward_to=50'34))", 2024-04-18T14:43:55.895 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T14:43:50.380897+0000", 2024-04-18T14:43:55.895 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 5.4588313460000002, 2024-04-18T14:43:55.895 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0057415909999999999, 2024-04-18T14:43:55.895 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T14:43:55.896 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-04-18T14:43:55.896 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T14:43:55.896 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:55.896 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T14:43:55.896 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:50.380897+0000", 2024-04-18T14:43:55.896 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:43:55.896 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:55.896 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:55.896 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T14:43:55.896 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:50.380897+0000", 2024-04-18T14:43:55.896 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:43:55.896 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:55.896 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:55.896 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T14:43:55.896 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:50.380896+0000", 2024-04-18T14:43:55.897 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999981 2024-04-18T14:43:55.897 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:55.897 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:55.897 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T14:43:55.897 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:50.380949+0000", 2024-04-18T14:43:55.897 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.3701e-05 2024-04-18T14:43:55.897 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:55.897 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:55.897 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T14:43:55.897 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:50.380991+0000", 2024-04-18T14:43:55.897 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.1597999999999997e-05 2024-04-18T14:43:55.897 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:55.897 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:55.897 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T14:43:55.897 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:50.381009+0000", 2024-04-18T14:43:55.897 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8063e-05 2024-04-18T14:43:55.898 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:55.898 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:55.898 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T14:43:55.898 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:50.381126+0000", 2024-04-18T14:43:55.898 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000116852 2024-04-18T14:43:55.898 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:55.898 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:55.898 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_started", 2024-04-18T14:43:55.898 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:50.381158+0000", 2024-04-18T14:43:55.898 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.1829999999999998e-05 2024-04-18T14:43:55.898 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:55.898 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:55.898 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_committed", 2024-04-18T14:43:55.898 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:50.386613+0000", 2024-04-18T14:43:55.898 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.005455512 2024-04-18T14:43:55.899 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:55.899 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:55.899 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T14:43:55.899 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:50.386639+0000", 2024-04-18T14:43:55.899 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.5931999999999998e-05 2024-04-18T14:43:55.899 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:43:55.899 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T14:43:55.899 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:43:55.899 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:55.899 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:55.899 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "MOSDECSubOpWrite(3.6s5 51/30 ECSubWrite(tid=90, reqid=client.4559.0:361, at_version=51'38, trim_to=0'0, roll_forward_to=50'34))", 2024-04-18T14:43:55.899 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T14:43:50.382341+0000", 2024-04-18T14:43:55.899 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 5.4573875479999998, 2024-04-18T14:43:55.899 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0043116270000000002, 2024-04-18T14:43:55.899 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T14:43:55.899 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-04-18T14:43:55.900 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T14:43:55.900 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:55.900 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T14:43:55.900 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:50.382341+0000", 2024-04-18T14:43:55.900 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:43:55.900 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:55.900 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:55.900 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T14:43:55.900 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:50.382341+0000", 2024-04-18T14:43:55.900 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:43:55.900 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:55.900 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:55.900 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T14:43:55.900 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:50.382339+0000", 2024-04-18T14:43:55.900 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999981 2024-04-18T14:43:55.901 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:55.901 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:55.901 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T14:43:55.901 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:50.382387+0000", 2024-04-18T14:43:55.901 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.7200999999999998e-05 2024-04-18T14:43:55.901 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:55.901 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:55.901 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T14:43:55.901 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:50.382425+0000", 2024-04-18T14:43:55.901 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.82e-05 2024-04-18T14:43:55.901 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:55.901 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:55.901 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T14:43:55.901 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:50.382447+0000", 2024-04-18T14:43:55.901 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2161e-05 2024-04-18T14:43:55.901 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:55.902 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:55.902 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T14:43:55.902 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:50.384658+0000", 2024-04-18T14:43:55.902 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0022114119999999998 2024-04-18T14:43:55.902 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:55.902 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:55.902 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_started", 2024-04-18T14:43:55.902 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:50.384668+0000", 2024-04-18T14:43:55.902 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.2390000000000008e-06 2024-04-18T14:43:55.902 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:55.902 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:55.902 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_committed", 2024-04-18T14:43:55.902 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:50.386642+0000", 2024-04-18T14:43:55.902 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0019748470000000001 2024-04-18T14:43:55.902 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:55.903 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:55.903 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T14:43:55.903 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:50.386653+0000", 2024-04-18T14:43:55.903 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0433e-05 2024-04-18T14:43:55.903 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:43:55.903 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T14:43:55.903 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:43:55.903 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:55.903 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:55.903 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "MOSDECSubOpWrite(3.as1 51/30 ECSubWrite(tid=38, reqid=client.4559.0:362, at_version=51'27, trim_to=0'0, roll_forward_to=44'25))", 2024-04-18T14:43:55.903 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T14:43:50.385272+0000", 2024-04-18T14:43:55.903 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 5.4544571140000002, 2024-04-18T14:43:55.903 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0038791899999999998, 2024-04-18T14:43:55.903 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T14:43:55.903 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-04-18T14:43:55.903 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T14:43:55.904 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:55.904 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T14:43:55.904 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:50.385272+0000", 2024-04-18T14:43:55.904 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:43:55.904 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:55.904 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:55.904 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T14:43:55.904 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:50.385272+0000", 2024-04-18T14:43:55.904 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:43:55.904 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:55.904 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:55.904 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T14:43:55.904 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:50.385271+0000", 2024-04-18T14:43:55.904 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-04-18T14:43:55.904 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:55.904 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:55.905 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T14:43:55.905 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:50.385299+0000", 2024-04-18T14:43:55.905 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.7671e-05 2024-04-18T14:43:55.905 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:55.905 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:55.905 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T14:43:55.905 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:50.385330+0000", 2024-04-18T14:43:55.905 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.1591000000000003e-05 2024-04-18T14:43:55.905 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:55.905 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:55.905 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T14:43:55.905 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:50.385339+0000", 2024-04-18T14:43:55.905 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.6230000000000003e-06 2024-04-18T14:43:55.905 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:55.905 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:55.906 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T14:43:55.906 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:50.385409+0000", 2024-04-18T14:43:55.906 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.9684999999999994e-05 2024-04-18T14:43:55.906 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:55.906 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:55.906 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_started", 2024-04-18T14:43:55.906 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:50.385419+0000", 2024-04-18T14:43:55.906 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0083e-05 2024-04-18T14:43:55.906 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:55.906 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:55.906 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_committed", 2024-04-18T14:43:55.906 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:50.389118+0000", 2024-04-18T14:43:55.906 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0036994229999999999 2024-04-18T14:43:55.906 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:55.907 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:55.907 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T14:43:55.907 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:50.389151+0000", 2024-04-18T14:43:55.907 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.2543000000000003e-05 2024-04-18T14:43:55.907 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:43:55.907 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T14:43:55.907 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:43:55.907 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:55.907 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:55.907 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "MOSDECSubOpWrite(3.as1 51/30 ECSubWrite(tid=39, reqid=client.4559.0:363, at_version=51'28, trim_to=0'0, roll_forward_to=44'25))", 2024-04-18T14:43:55.907 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T14:43:50.386926+0000", 2024-04-18T14:43:55.907 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 5.4528030210000002, 2024-04-18T14:43:55.907 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0044158579999999999, 2024-04-18T14:43:55.907 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T14:43:55.907 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-04-18T14:43:55.907 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T14:43:55.908 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:55.908 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T14:43:55.908 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:50.386926+0000", 2024-04-18T14:43:55.908 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:43:55.908 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:55.908 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:55.908 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T14:43:55.908 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:50.386926+0000", 2024-04-18T14:43:55.908 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:43:55.908 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:55.908 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:55.908 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T14:43:55.908 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:50.386924+0000", 2024-04-18T14:43:55.908 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999981 2024-04-18T14:43:55.908 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:55.909 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:55.909 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T14:43:55.909 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:50.386978+0000", 2024-04-18T14:43:55.909 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.4187000000000001e-05 2024-04-18T14:43:55.909 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:55.909 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:55.909 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T14:43:55.909 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:50.387011+0000", 2024-04-18T14:43:55.909 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.3145000000000002e-05 2024-04-18T14:43:55.909 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:55.909 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:55.909 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T14:43:55.909 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:50.387034+0000", 2024-04-18T14:43:55.909 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.3292999999999999e-05 2024-04-18T14:43:55.909 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:55.909 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:55.910 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T14:43:55.910 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:50.387099+0000", 2024-04-18T14:43:55.910 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.4641000000000007e-05 2024-04-18T14:43:55.910 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:55.910 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:55.910 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_started", 2024-04-18T14:43:55.910 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:50.387108+0000", 2024-04-18T14:43:55.910 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.2569999999999996e-06 2024-04-18T14:43:55.910 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:55.910 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:55.910 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_committed", 2024-04-18T14:43:55.911 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:50.391281+0000", 2024-04-18T14:43:55.911 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0041728169999999997 2024-04-18T14:43:55.911 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:55.911 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:55.911 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T14:43:55.911 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:50.391342+0000", 2024-04-18T14:43:55.911 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.0661000000000001e-05 2024-04-18T14:43:55.911 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:43:55.911 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T14:43:55.911 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:43:55.911 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:55.912 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:55.912 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "MOSDECSubOpWrite(3.6s5 51/30 ECSubWrite(tid=93, reqid=client.4559.0:361, at_version=0'0, trim_to=0'0, roll_forward_to=51'38))", 2024-04-18T14:43:55.912 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T14:43:50.389576+0000", 2024-04-18T14:43:55.912 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 5.4501527369999998, 2024-04-18T14:43:55.912 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0046882080000000001, 2024-04-18T14:43:55.912 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T14:43:55.912 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-04-18T14:43:55.912 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T14:43:55.912 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:55.913 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T14:43:55.913 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:50.389576+0000", 2024-04-18T14:43:55.913 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:43:55.913 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:55.913 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:55.913 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T14:43:55.913 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:50.389576+0000", 2024-04-18T14:43:55.913 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:43:55.913 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:55.913 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:55.913 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T14:43:55.915 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:50.389575+0000", 2024-04-18T14:43:55.915 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-18T14:43:55.915 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:55.915 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:55.915 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T14:43:55.915 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:50.389604+0000", 2024-04-18T14:43:55.915 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.9082999999999999e-05 2024-04-18T14:43:55.915 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:55.916 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:55.916 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T14:43:55.916 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:50.389621+0000", 2024-04-18T14:43:55.916 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.7439999999999999e-05 2024-04-18T14:43:55.916 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:55.916 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:55.916 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T14:43:55.916 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:50.389631+0000", 2024-04-18T14:43:55.916 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.4399999999999994e-06 2024-04-18T14:43:55.916 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:55.916 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:55.916 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T14:43:55.916 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:50.389778+0000", 2024-04-18T14:43:55.916 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000147384 2024-04-18T14:43:55.916 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:55.916 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:55.917 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_started", 2024-04-18T14:43:55.917 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:50.389811+0000", 2024-04-18T14:43:55.917 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.3154000000000001e-05 2024-04-18T14:43:55.917 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:55.917 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:55.917 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_committed", 2024-04-18T14:43:55.917 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:50.394218+0000", 2024-04-18T14:43:55.917 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0044069280000000001 2024-04-18T14:43:55.917 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:55.917 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:55.917 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T14:43:55.917 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:50.394264+0000", 2024-04-18T14:43:55.917 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.5893000000000003e-05 2024-04-18T14:43:55.917 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:43:55.917 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T14:43:55.918 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:43:55.918 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:55.918 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:55.918 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "MOSDECSubOpWrite(3.as1 51/30 ECSubWrite(tid=40, reqid=client.4559.0:363, at_version=0'0, trim_to=0'0, roll_forward_to=51'28))", 2024-04-18T14:43:55.918 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T14:43:50.391883+0000", 2024-04-18T14:43:55.918 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 5.4478461180000002, 2024-04-18T14:43:55.918 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0050354600000000003, 2024-04-18T14:43:55.918 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T14:43:55.918 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-04-18T14:43:55.918 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T14:43:55.918 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:55.918 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T14:43:55.918 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:50.391883+0000", 2024-04-18T14:43:55.918 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:43:55.918 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:55.920 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:55.920 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T14:43:55.920 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:50.391883+0000", 2024-04-18T14:43:55.920 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:43:55.920 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:55.920 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:55.920 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T14:43:55.920 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:50.391880+0000", 2024-04-18T14:43:55.920 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999976 2024-04-18T14:43:55.920 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:55.920 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:55.920 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T14:43:55.920 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:50.391917+0000", 2024-04-18T14:43:55.921 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.6066999999999999e-05 2024-04-18T14:43:55.921 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:55.921 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:55.921 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T14:43:55.921 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:50.391962+0000", 2024-04-18T14:43:55.921 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.5914000000000001e-05 2024-04-18T14:43:55.921 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:55.921 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:55.921 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T14:43:55.921 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:50.391987+0000", 2024-04-18T14:43:55.921 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.4164000000000001e-05 2024-04-18T14:43:55.921 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:55.921 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:55.922 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T14:43:55.922 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:50.392124+0000", 2024-04-18T14:43:55.922 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000137665 2024-04-18T14:43:55.922 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:55.922 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:55.922 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_started", 2024-04-18T14:43:55.922 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:50.392150+0000", 2024-04-18T14:43:55.922 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.5947000000000001e-05 2024-04-18T14:43:55.922 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:55.922 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:55.922 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_committed", 2024-04-18T14:43:55.922 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:50.396889+0000", 2024-04-18T14:43:55.922 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0047389219999999996 2024-04-18T14:43:55.922 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:55.922 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:55.923 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T14:43:55.923 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:50.396918+0000", 2024-04-18T14:43:55.923 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.8968000000000001e-05 2024-04-18T14:43:55.923 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:43:55.923 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T14:43:55.923 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:43:55.923 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:43:55.923 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T14:43:55.923 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-04-18T14:43:55.925 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.11.asok dump_ops_in_flight 2024-04-18T14:43:55.925 INFO:tasks.ceph.osd.6.smithi119.stderr:2024-04-18T14:43:55.926+0000 7fb7cb8bd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 24896) UID: 0 2024-04-18T14:43:56.026 INFO:tasks.ceph.osd.7.smithi134.stderr:2024-04-18T14:43:56.028+0000 7fd7de549640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25213) UID: 0 2024-04-18T14:43:56.049 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-04-18T14:43:56.049 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [], 2024-04-18T14:43:56.049 INFO:teuthology.orchestra.run.smithi134.stdout: "num_ops": 0 2024-04-18T14:43:56.049 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-04-18T14:43:56.063 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.11.asok dump_blocked_ops 2024-04-18T14:43:56.126 INFO:tasks.ceph.osd.2.smithi119.stderr:2024-04-18T14:43:56.126+0000 7fcbd30c0640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 24894) UID: 0 2024-04-18T14:43:56.228 INFO:tasks.ceph.osd.14.smithi119.stderr:2024-04-18T14:43:56.230+0000 7f180f599640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 14 (PID: 24900) UID: 0 2024-04-18T14:43:56.231 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-04-18T14:43:56.232 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [], 2024-04-18T14:43:56.232 INFO:teuthology.orchestra.run.smithi134.stdout: "complaint_time": 30, 2024-04-18T14:43:56.232 INFO:teuthology.orchestra.run.smithi134.stdout: "num_blocked_ops": 0 2024-04-18T14:43:56.232 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-04-18T14:43:56.246 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.11.asok dump_historic_ops 2024-04-18T14:43:56.329 INFO:tasks.ceph.osd.2.smithi119.stderr:2024-04-18T14:43:56.330+0000 7fcbd30c0640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 24894) UID: 0 2024-04-18T14:43:56.368 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-04-18T14:43:56.369 INFO:teuthology.orchestra.run.smithi134.stdout: "size": 20, 2024-04-18T14:43:56.369 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 600, 2024-04-18T14:43:56.369 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [ 2024-04-18T14:43:56.369 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:56.369 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "MOSDECSubOpWrite(3.7s6 37/30 ECSubWrite(tid=35, reqid=client.4559.0:183, at_version=37'11, trim_to=0'0, roll_forward_to=33'9))", 2024-04-18T14:43:56.369 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T14:43:36.748783+0000", 2024-04-18T14:43:56.369 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 19.621501528, 2024-04-18T14:43:56.369 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0082955609999999999, 2024-04-18T14:43:56.369 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T14:43:56.369 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-04-18T14:43:56.369 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T14:43:56.369 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:56.369 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T14:43:56.370 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.748783+0000", 2024-04-18T14:43:56.370 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:43:56.370 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:56.370 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:56.370 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T14:43:56.370 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.748783+0000", 2024-04-18T14:43:56.370 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:43:56.370 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:56.370 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:56.370 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T14:43:56.371 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.748782+0000", 2024-04-18T14:43:56.371 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-04-18T14:43:56.371 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:56.371 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:56.371 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T14:43:56.371 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.749402+0000", 2024-04-18T14:43:56.371 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00062010899999999998 2024-04-18T14:43:56.371 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:56.371 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:56.371 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T14:43:56.372 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.749431+0000", 2024-04-18T14:43:56.372 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.8858000000000001e-05 2024-04-18T14:43:56.372 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:56.372 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:56.372 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T14:43:56.372 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.749451+0000", 2024-04-18T14:43:56.372 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.9916999999999999e-05 2024-04-18T14:43:56.372 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:56.372 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:56.372 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T14:43:56.372 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.749600+0000", 2024-04-18T14:43:56.372 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00014919 2024-04-18T14:43:56.372 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:56.372 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:56.372 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_started", 2024-04-18T14:43:56.373 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.749628+0000", 2024-04-18T14:43:56.373 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.7260999999999999e-05 2024-04-18T14:43:56.373 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:56.373 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:56.373 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_committed", 2024-04-18T14:43:56.373 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.757022+0000", 2024-04-18T14:43:56.373 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.007394622 2024-04-18T14:43:56.373 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:56.373 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:56.373 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T14:43:56.373 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.757078+0000", 2024-04-18T14:43:56.373 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.5943999999999998e-05 2024-04-18T14:43:56.373 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:43:56.373 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T14:43:56.373 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:43:56.374 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:56.374 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:56.374 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "MOSDECSubOpWrite(3.1s1 37/30 ECSubWrite(tid=19, reqid=client.4559.0:187, at_version=37'13, trim_to=0'0, roll_forward_to=33'10))", 2024-04-18T14:43:56.374 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T14:43:36.764114+0000", 2024-04-18T14:43:56.374 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 19.606170554999999, 2024-04-18T14:43:56.374 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0099389679999999994, 2024-04-18T14:43:56.374 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T14:43:56.374 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-04-18T14:43:56.375 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T14:43:56.375 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:56.375 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T14:43:56.375 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.764114+0000", 2024-04-18T14:43:56.375 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:43:56.375 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:56.375 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:56.375 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T14:43:56.375 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.764114+0000", 2024-04-18T14:43:56.375 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:43:56.375 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:56.375 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:56.375 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T14:43:56.376 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.764112+0000", 2024-04-18T14:43:56.376 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999986 2024-04-18T14:43:56.376 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:56.376 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:56.376 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T14:43:56.376 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.764282+0000", 2024-04-18T14:43:56.376 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00016998499999999999 2024-04-18T14:43:56.376 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:56.376 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:56.376 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T14:43:56.376 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.764331+0000", 2024-04-18T14:43:56.376 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.8730999999999998e-05 2024-04-18T14:43:56.376 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:56.376 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:56.376 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T14:43:56.377 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.764355+0000", 2024-04-18T14:43:56.377 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.3986999999999999e-05 2024-04-18T14:43:56.377 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:56.377 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:56.377 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T14:43:56.377 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.764467+0000", 2024-04-18T14:43:56.377 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00011267700000000001 2024-04-18T14:43:56.377 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:56.377 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:56.377 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_started", 2024-04-18T14:43:56.377 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.764492+0000", 2024-04-18T14:43:56.378 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.4530000000000001e-05 2024-04-18T14:43:56.378 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:56.378 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:56.378 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_committed", 2024-04-18T14:43:56.378 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.773984+0000", 2024-04-18T14:43:56.378 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0094917830000000002 2024-04-18T14:43:56.378 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:56.378 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:56.378 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T14:43:56.378 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.774053+0000", 2024-04-18T14:43:56.378 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.8938999999999998e-05 2024-04-18T14:43:56.378 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:43:56.379 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T14:43:56.379 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:43:56.379 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:56.379 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:56.379 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "MOSDECSubOpWrite(3.1s1 37/30 ECSubWrite(tid=20, reqid=client.4559.0:188, at_version=37'14, trim_to=0'0, roll_forward_to=33'10))", 2024-04-18T14:43:56.379 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T14:43:36.765784+0000", 2024-04-18T14:43:56.379 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 19.604499862000001, 2024-04-18T14:43:56.379 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0083259800000000002, 2024-04-18T14:43:56.379 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T14:43:56.379 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-04-18T14:43:56.379 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T14:43:56.379 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:56.379 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T14:43:56.379 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.765784+0000", 2024-04-18T14:43:56.379 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:43:56.380 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:56.380 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:56.380 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T14:43:56.380 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.765784+0000", 2024-04-18T14:43:56.380 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:43:56.380 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:56.380 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:56.380 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T14:43:56.380 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.765783+0000", 2024-04-18T14:43:56.380 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999986 2024-04-18T14:43:56.380 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:56.380 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:56.380 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T14:43:56.380 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.765840+0000", 2024-04-18T14:43:56.380 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.7258e-05 2024-04-18T14:43:56.380 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:56.381 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:56.381 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T14:43:56.381 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.765868+0000", 2024-04-18T14:43:56.381 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.8260999999999999e-05 2024-04-18T14:43:56.381 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:56.381 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:56.381 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T14:43:56.381 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.765883+0000", 2024-04-18T14:43:56.382 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.4327e-05 2024-04-18T14:43:56.382 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:56.382 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:56.382 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T14:43:56.382 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.765989+0000", 2024-04-18T14:43:56.382 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00010590300000000001 2024-04-18T14:43:56.382 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:56.382 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:56.382 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_started", 2024-04-18T14:43:56.382 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.766013+0000", 2024-04-18T14:43:56.382 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.4454e-05 2024-04-18T14:43:56.382 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:56.382 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:56.382 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_committed", 2024-04-18T14:43:56.382 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.774076+0000", 2024-04-18T14:43:56.383 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0080626659999999996 2024-04-18T14:43:56.383 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:56.383 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:56.383 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T14:43:56.383 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.774110+0000", 2024-04-18T14:43:56.383 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.4684000000000002e-05 2024-04-18T14:43:56.383 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:43:56.383 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T14:43:56.383 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:43:56.383 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:56.383 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:56.383 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "MOSDECSubOpWrite(3.as6 37/30 ECSubWrite(tid=23, reqid=client.4559.0:190, at_version=37'16, trim_to=0'0, roll_forward_to=36'14))", 2024-04-18T14:43:56.383 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T14:43:36.767447+0000", 2024-04-18T14:43:56.383 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 19.602837118, 2024-04-18T14:43:56.383 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0070728500000000003, 2024-04-18T14:43:56.384 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T14:43:56.384 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-04-18T14:43:56.384 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T14:43:56.384 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:56.384 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T14:43:56.384 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.767447+0000", 2024-04-18T14:43:56.384 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:43:56.384 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:56.384 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:56.384 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T14:43:56.385 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.767447+0000", 2024-04-18T14:43:56.385 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:43:56.385 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:56.385 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:56.385 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T14:43:56.385 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.767446+0000", 2024-04-18T14:43:56.385 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-04-18T14:43:56.385 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:56.385 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:56.385 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T14:43:56.385 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.767499+0000", 2024-04-18T14:43:56.385 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.2370999999999997e-05 2024-04-18T14:43:56.386 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:56.386 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:56.386 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T14:43:56.386 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.767530+0000", 2024-04-18T14:43:56.386 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.1204000000000001e-05 2024-04-18T14:43:56.386 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:56.386 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:56.386 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T14:43:56.386 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.767551+0000", 2024-04-18T14:43:56.386 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.1311e-05 2024-04-18T14:43:56.386 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:56.386 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:56.386 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T14:43:56.386 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.767710+0000", 2024-04-18T14:43:56.386 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00015860099999999999 2024-04-18T14:43:56.387 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:56.387 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:56.387 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_started", 2024-04-18T14:43:56.387 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.767734+0000", 2024-04-18T14:43:56.387 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.4003999999999999e-05 2024-04-18T14:43:56.387 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:56.387 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:56.387 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_committed", 2024-04-18T14:43:56.387 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.774463+0000", 2024-04-18T14:43:56.388 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0067288740000000001 2024-04-18T14:43:56.388 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:56.388 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:56.388 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T14:43:56.388 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.774520+0000", 2024-04-18T14:43:56.388 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.7138000000000001e-05 2024-04-18T14:43:56.388 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:43:56.388 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T14:43:56.388 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:43:56.388 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:56.388 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:56.388 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4559.0:191 3.cs0 3:3c6f96a8:::smithi13430248-14:4 [read 0~229376,checksum,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37)", 2024-04-18T14:43:56.389 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T14:43:36.775946+0000", 2024-04-18T14:43:56.389 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 19.594337976999999, 2024-04-18T14:43:56.389 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0085641539999999992, 2024-04-18T14:43:56.389 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T14:43:56.389 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-04-18T14:43:56.389 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-18T14:43:56.389 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4559", 2024-04-18T14:43:56.389 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/3113589487", 2024-04-18T14:43:56.389 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 191 2024-04-18T14:43:56.389 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:56.389 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T14:43:56.389 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:56.389 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T14:43:56.389 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.775946+0000", 2024-04-18T14:43:56.389 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:43:56.390 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:56.390 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:56.390 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T14:43:56.390 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.775946+0000", 2024-04-18T14:43:56.390 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:43:56.390 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:56.390 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:56.390 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T14:43:56.390 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.775943+0000", 2024-04-18T14:43:56.390 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999962 2024-04-18T14:43:56.390 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:56.391 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:56.391 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T14:43:56.391 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.775962+0000", 2024-04-18T14:43:56.391 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.9510000000000001e-05 2024-04-18T14:43:56.391 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:56.391 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:56.391 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T14:43:56.391 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.775996+0000", 2024-04-18T14:43:56.391 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.4097999999999998e-05 2024-04-18T14:43:56.391 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:56.392 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:56.392 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T14:43:56.392 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.776019+0000", 2024-04-18T14:43:56.392 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2887999999999998e-05 2024-04-18T14:43:56.392 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:56.392 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:56.392 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T14:43:56.392 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.776181+0000", 2024-04-18T14:43:56.392 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00016150999999999999 2024-04-18T14:43:56.392 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:56.392 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:56.392 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T14:43:56.392 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.776515+0000", 2024-04-18T14:43:56.392 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00033390600000000002 2024-04-18T14:43:56.392 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:56.393 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:56.393 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T14:43:56.393 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.784510+0000", 2024-04-18T14:43:56.393 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0079958560000000008 2024-04-18T14:43:56.393 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:43:56.393 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T14:43:56.393 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:43:56.393 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:56.393 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:56.393 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4559.0:192 3.cs0 3:3c6f96a8:::smithi13430248-14:4 [read 0~229376,checksum] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37)", 2024-04-18T14:43:56.393 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T14:43:36.776089+0000", 2024-04-18T14:43:56.393 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 19.594195657, 2024-04-18T14:43:56.393 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0095438139999999994, 2024-04-18T14:43:56.393 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T14:43:56.393 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-04-18T14:43:56.394 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-18T14:43:56.394 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4559", 2024-04-18T14:43:56.394 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/3113589487", 2024-04-18T14:43:56.394 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 192 2024-04-18T14:43:56.394 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:56.394 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T14:43:56.394 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:56.394 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T14:43:56.394 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.776089+0000", 2024-04-18T14:43:56.394 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:43:56.394 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:56.394 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:56.394 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T14:43:56.394 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.776089+0000", 2024-04-18T14:43:56.394 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:43:56.395 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:56.395 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:56.395 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T14:43:56.395 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.776087+0000", 2024-04-18T14:43:56.396 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999981 2024-04-18T14:43:56.396 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:56.396 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:56.396 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T14:43:56.396 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.776099+0000", 2024-04-18T14:43:56.396 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2624e-05 2024-04-18T14:43:56.396 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:56.396 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:56.396 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T14:43:56.396 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.776121+0000", 2024-04-18T14:43:56.396 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.1489999999999999e-05 2024-04-18T14:43:56.396 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:56.396 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:56.396 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T14:43:56.397 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.776137+0000", 2024-04-18T14:43:56.397 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5794000000000002e-05 2024-04-18T14:43:56.397 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:56.397 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:56.397 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T14:43:56.397 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.779276+0000", 2024-04-18T14:43:56.397 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0031389320000000001 2024-04-18T14:43:56.397 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:56.397 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:56.397 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T14:43:56.397 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.779529+0000", 2024-04-18T14:43:56.397 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000253467 2024-04-18T14:43:56.397 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:56.397 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:56.397 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T14:43:56.398 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.785632+0000", 2024-04-18T14:43:56.398 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0061031940000000002 2024-04-18T14:43:56.398 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:43:56.398 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T14:43:56.398 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:43:56.398 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:56.398 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:56.398 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4559.0:193 3.cs0 3:3c6f96a8:::smithi13430248-14:4 [read 0~229376,checksum] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37)", 2024-04-18T14:43:56.398 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T14:43:36.776151+0000", 2024-04-18T14:43:56.398 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 19.594133689, 2024-04-18T14:43:56.398 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.010393866, 2024-04-18T14:43:56.398 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T14:43:56.398 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-04-18T14:43:56.398 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-18T14:43:56.398 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4559", 2024-04-18T14:43:56.399 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/3113589487", 2024-04-18T14:43:56.399 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 193 2024-04-18T14:43:56.399 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:56.399 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T14:43:56.399 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:56.399 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T14:43:56.399 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.776151+0000", 2024-04-18T14:43:56.399 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:43:56.399 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:56.399 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:56.399 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T14:43:56.399 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.776151+0000", 2024-04-18T14:43:56.399 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:43:56.399 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:56.400 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:56.400 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T14:43:56.400 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.776149+0000", 2024-04-18T14:43:56.400 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999986 2024-04-18T14:43:56.400 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:56.400 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:56.400 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T14:43:56.400 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.776159+0000", 2024-04-18T14:43:56.400 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.3959999999999995e-06 2024-04-18T14:43:56.400 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:56.400 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:56.400 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T14:43:56.400 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.776177+0000", 2024-04-18T14:43:56.400 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8411e-05 2024-04-18T14:43:56.400 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:56.400 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:56.401 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T14:43:56.401 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.776191+0000", 2024-04-18T14:43:56.401 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3827e-05 2024-04-18T14:43:56.401 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:56.401 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:56.401 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T14:43:56.401 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.780347+0000", 2024-04-18T14:43:56.401 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0041559190000000001 2024-04-18T14:43:56.401 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:56.401 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:56.401 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T14:43:56.401 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.780607+0000", 2024-04-18T14:43:56.401 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00025981000000000002 2024-04-18T14:43:56.401 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:56.401 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:56.401 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T14:43:56.402 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.786544+0000", 2024-04-18T14:43:56.402 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0059377060000000001 2024-04-18T14:43:56.402 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:43:56.402 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T14:43:56.402 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:43:56.402 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:56.402 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:56.402 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4559.0:248 3.fs0 3:f85be22b:::smithi13430248-15:head [copy-from ver 10] snapc 8=[8,7,4,2] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-04-18T14:43:56.403 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T14:43:40.759371+0000", 2024-04-18T14:43:56.403 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 15.61091296, 2024-04-18T14:43:56.403 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.032405762999999997, 2024-04-18T14:43:56.403 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T14:43:56.403 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T14:43:56.403 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-18T14:43:56.403 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4559", 2024-04-18T14:43:56.403 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/3113589487", 2024-04-18T14:43:56.403 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 248 2024-04-18T14:43:56.403 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:56.403 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T14:43:56.403 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:56.403 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T14:43:56.403 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:40.759371+0000", 2024-04-18T14:43:56.403 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:43:56.404 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:56.404 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:56.404 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T14:43:56.404 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:40.759371+0000", 2024-04-18T14:43:56.404 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:43:56.404 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:56.404 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:56.404 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T14:43:56.404 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:40.759369+0000", 2024-04-18T14:43:56.404 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999971 2024-04-18T14:43:56.404 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:56.404 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:56.404 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T14:43:56.404 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:40.759383+0000", 2024-04-18T14:43:56.404 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.4307e-05 2024-04-18T14:43:56.404 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:56.405 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:56.405 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T14:43:56.405 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:40.759418+0000", 2024-04-18T14:43:56.405 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.5154000000000003e-05 2024-04-18T14:43:56.405 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:56.405 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:56.405 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T14:43:56.405 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:40.759440+0000", 2024-04-18T14:43:56.405 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2056999999999999e-05 2024-04-18T14:43:56.405 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:56.406 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:56.406 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T14:43:56.406 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:40.759512+0000", 2024-04-18T14:43:56.406 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.2267000000000005e-05 2024-04-18T14:43:56.406 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:56.406 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:56.406 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op must wait for map", 2024-04-18T14:43:56.406 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:40.759521+0000", 2024-04-18T14:43:56.406 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.6370000000000005e-06 2024-04-18T14:43:56.406 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:56.406 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:56.406 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T14:43:56.406 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:40.764362+0000", 2024-04-18T14:43:56.406 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0048409990000000003 2024-04-18T14:43:56.406 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:56.407 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:56.407 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T14:43:56.407 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:40.764642+0000", 2024-04-18T14:43:56.407 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00028021600000000002 2024-04-18T14:43:56.407 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:56.407 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:56.407 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_started", 2024-04-18T14:43:56.407 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:40.785675+0000", 2024-04-18T14:43:56.407 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.021032894999999999 2024-04-18T14:43:56.407 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:56.407 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:56.407 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_committed", 2024-04-18T14:43:56.407 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:40.789679+0000", 2024-04-18T14:43:56.407 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0040040939999999997 2024-04-18T14:43:56.407 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:56.407 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:56.408 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T14:43:56.408 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:40.791620+0000", 2024-04-18T14:43:56.408 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0019413430000000001 2024-04-18T14:43:56.408 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:56.408 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:56.408 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T14:43:56.408 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:40.791777+0000", 2024-04-18T14:43:56.408 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00015652999999999999 2024-04-18T14:43:56.408 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:43:56.408 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T14:43:56.408 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:43:56.408 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:56.408 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:56.408 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4559.0:249 3.fs0 3:f85be22b:::smithi13430248-15:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e41)", 2024-04-18T14:43:56.408 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T14:43:40.759469+0000", 2024-04-18T14:43:56.408 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 15.610814833999999, 2024-04-18T14:43:56.409 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.028934334999999999, 2024-04-18T14:43:56.409 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T14:43:56.409 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-04-18T14:43:56.409 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-18T14:43:56.409 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4559", 2024-04-18T14:43:56.409 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/3113589487", 2024-04-18T14:43:56.409 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 249 2024-04-18T14:43:56.409 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:56.409 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T14:43:56.409 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:56.409 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T14:43:56.409 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:40.759469+0000", 2024-04-18T14:43:56.409 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:43:56.409 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:56.409 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:56.409 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T14:43:56.410 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:40.759469+0000", 2024-04-18T14:43:56.410 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:43:56.410 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:56.410 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:56.410 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T14:43:56.410 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:40.759468+0000", 2024-04-18T14:43:56.410 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999981 2024-04-18T14:43:56.410 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:56.410 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:56.410 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T14:43:56.410 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:40.759476+0000", 2024-04-18T14:43:56.410 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.0069999999999997e-06 2024-04-18T14:43:56.410 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:56.410 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:56.410 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T14:43:56.411 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:40.759496+0000", 2024-04-18T14:43:56.411 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0287000000000001e-05 2024-04-18T14:43:56.411 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:56.411 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:56.411 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T14:43:56.411 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:40.759512+0000", 2024-04-18T14:43:56.411 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5843999999999999e-05 2024-04-18T14:43:56.411 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:56.411 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:56.411 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T14:43:56.411 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:40.759627+0000", 2024-04-18T14:43:56.411 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000115699 2024-04-18T14:43:56.411 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:56.411 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:56.411 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting_for_map not empty", 2024-04-18T14:43:56.411 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:40.759645+0000", 2024-04-18T14:43:56.411 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8063999999999998e-05 2024-04-18T14:43:56.412 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:56.412 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:56.412 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T14:43:56.412 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:40.765114+0000", 2024-04-18T14:43:56.412 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0054689079999999998 2024-04-18T14:43:56.412 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:56.412 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:56.412 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for blocked object", 2024-04-18T14:43:56.412 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:40.765242+0000", 2024-04-18T14:43:56.412 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00012731999999999999 2024-04-18T14:43:56.412 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:56.412 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:56.412 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T14:43:56.412 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:40.788026+0000", 2024-04-18T14:43:56.412 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.022784764999999998 2024-04-18T14:43:56.413 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:56.413 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:56.413 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T14:43:56.413 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:40.788178+0000", 2024-04-18T14:43:56.413 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000151819 2024-04-18T14:43:56.413 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:56.413 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:56.413 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T14:43:56.413 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:40.788404+0000", 2024-04-18T14:43:56.413 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000225479 2024-04-18T14:43:56.413 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:43:56.413 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T14:43:56.413 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:43:56.413 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:56.413 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:56.414 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "MOSDECSubOpWrite(3.2s6 45/30 ECSubWrite(tid=185, reqid=client.4559.0:314, at_version=45'6, trim_to=0'0, roll_forward_to=33'4))", 2024-04-18T14:43:56.414 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T14:43:44.562120+0000", 2024-04-18T14:43:56.414 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 11.808163806, 2024-04-18T14:43:56.414 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0069911089999999997, 2024-04-18T14:43:56.414 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T14:43:56.414 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-04-18T14:43:56.414 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T14:43:56.414 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:56.414 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T14:43:56.414 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:44.562120+0000", 2024-04-18T14:43:56.414 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:43:56.414 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:56.414 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:56.414 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T14:43:56.414 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:44.562120+0000", 2024-04-18T14:43:56.415 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:43:56.415 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:56.415 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:56.415 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T14:43:56.415 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:44.562118+0000", 2024-04-18T14:43:56.415 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999976 2024-04-18T14:43:56.415 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:56.415 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:56.415 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T14:43:56.415 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:44.562760+0000", 2024-04-18T14:43:56.415 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00064183199999999995 2024-04-18T14:43:56.415 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:56.415 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:56.415 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T14:43:56.415 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:44.562799+0000", 2024-04-18T14:43:56.415 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.8670000000000001e-05 2024-04-18T14:43:56.416 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:56.416 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:56.416 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T14:43:56.416 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:44.562816+0000", 2024-04-18T14:43:56.416 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.7808e-05 2024-04-18T14:43:56.416 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:56.416 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:56.416 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T14:43:56.416 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:44.562951+0000", 2024-04-18T14:43:56.416 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00013449999999999999 2024-04-18T14:43:56.416 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:56.416 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:56.416 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_started", 2024-04-18T14:43:56.416 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:44.562979+0000", 2024-04-18T14:43:56.416 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.8257000000000001e-05 2024-04-18T14:43:56.416 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:56.417 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:56.417 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_committed", 2024-04-18T14:43:56.417 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:44.569058+0000", 2024-04-18T14:43:56.417 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0060786649999999996 2024-04-18T14:43:56.417 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:56.417 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:56.417 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T14:43:56.417 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:44.569112+0000", 2024-04-18T14:43:56.417 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.3761000000000002e-05 2024-04-18T14:43:56.417 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:43:56.417 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T14:43:56.417 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:43:56.417 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:56.417 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:56.417 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "MOSDECSubOpWrite(3.4s5 46/30 ECSubWrite(tid=28, reqid=client.4559.0:323, at_version=46'5, trim_to=0'0, roll_forward_to=33'2))", 2024-04-18T14:43:56.417 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T14:43:45.381646+0000", 2024-04-18T14:43:56.418 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 10.988638065, 2024-04-18T14:43:56.418 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0060607229999999996, 2024-04-18T14:43:56.418 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T14:43:56.418 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-04-18T14:43:56.418 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T14:43:56.421 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:56.422 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T14:43:56.422 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:45.381646+0000", 2024-04-18T14:43:56.422 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:43:56.422 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:56.422 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:56.422 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T14:43:56.422 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:45.381646+0000", 2024-04-18T14:43:56.422 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:43:56.422 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:56.422 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:56.422 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T14:43:56.422 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:45.381645+0000", 2024-04-18T14:43:56.422 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999986 2024-04-18T14:43:56.422 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:56.423 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:56.423 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T14:43:56.423 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:45.381679+0000", 2024-04-18T14:43:56.423 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.4071e-05 2024-04-18T14:43:56.423 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:56.423 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:56.423 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T14:43:56.423 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:45.381699+0000", 2024-04-18T14:43:56.423 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0462000000000002e-05 2024-04-18T14:43:56.423 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:56.423 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:56.423 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T14:43:56.423 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:45.381713+0000", 2024-04-18T14:43:56.423 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3920000000000001e-05 2024-04-18T14:43:56.423 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:56.424 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:56.424 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T14:43:56.424 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:45.382579+0000", 2024-04-18T14:43:56.424 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00086600000000000002 2024-04-18T14:43:56.424 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:56.424 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:56.424 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_started", 2024-04-18T14:43:56.424 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:45.382604+0000", 2024-04-18T14:43:56.424 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.4660000000000001e-05 2024-04-18T14:43:56.424 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:56.424 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:56.424 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_committed", 2024-04-18T14:43:56.424 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:45.387618+0000", 2024-04-18T14:43:56.424 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0050141719999999999 2024-04-18T14:43:56.424 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:56.424 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:56.425 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T14:43:56.425 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:45.387707+0000", 2024-04-18T14:43:56.425 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.8654999999999997e-05 2024-04-18T14:43:56.425 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:43:56.425 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T14:43:56.425 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:43:56.425 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:56.425 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:56.425 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "MOSDECSubOpWrite(3.2s6 46/30 ECSubWrite(tid=190, reqid=osd.13.0:190, at_version=46'10, trim_to=0'0, roll_forward_to=45'8))", 2024-04-18T14:43:56.425 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T14:43:45.385168+0000", 2024-04-18T14:43:56.425 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 10.985116289, 2024-04-18T14:43:56.425 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0060368139999999997, 2024-04-18T14:43:56.425 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T14:43:56.425 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-04-18T14:43:56.425 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T14:43:56.425 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:56.426 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T14:43:56.426 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:45.385168+0000", 2024-04-18T14:43:56.426 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:43:56.426 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:56.426 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:56.426 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T14:43:56.426 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:45.385168+0000", 2024-04-18T14:43:56.426 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:43:56.426 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:56.426 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:56.426 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T14:43:56.426 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:45.385167+0000", 2024-04-18T14:43:56.426 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-04-18T14:43:56.426 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:56.426 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:56.426 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T14:43:56.427 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:45.385210+0000", 2024-04-18T14:43:56.427 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.2373000000000002e-05 2024-04-18T14:43:56.427 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:56.427 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:56.427 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T14:43:56.427 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:45.385225+0000", 2024-04-18T14:43:56.427 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.499e-05 2024-04-18T14:43:56.427 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:56.427 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:56.427 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T14:43:56.427 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:45.385234+0000", 2024-04-18T14:43:56.427 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.7399999999999993e-06 2024-04-18T14:43:56.427 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:56.427 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:56.427 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T14:43:56.427 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:45.385309+0000", 2024-04-18T14:43:56.428 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.5668999999999997e-05 2024-04-18T14:43:56.428 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:56.428 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:56.428 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_started", 2024-04-18T14:43:56.428 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:45.385319+0000", 2024-04-18T14:43:56.428 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.3950000000000007e-06 2024-04-18T14:43:56.428 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:56.428 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:56.428 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_committed", 2024-04-18T14:43:56.428 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:45.391130+0000", 2024-04-18T14:43:56.428 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0058118969999999999 2024-04-18T14:43:56.428 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:56.428 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:56.428 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T14:43:56.428 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:45.391205+0000", 2024-04-18T14:43:56.428 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.4253999999999998e-05 2024-04-18T14:43:56.429 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:43:56.429 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T14:43:56.429 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:43:56.429 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:56.429 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:56.429 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "MOSDECSubOpWrite(3.1s1 46/30 ECSubWrite(tid=32, reqid=osd.6.0:32, at_version=46'22, trim_to=0'0, roll_forward_to=45'20))", 2024-04-18T14:43:56.429 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T14:43:45.385958+0000", 2024-04-18T14:43:56.429 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 10.984326017000001, 2024-04-18T14:43:56.429 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0092049739999999994, 2024-04-18T14:43:56.429 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T14:43:56.429 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-04-18T14:43:56.429 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T14:43:56.429 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:56.429 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T14:43:56.429 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:45.385958+0000", 2024-04-18T14:43:56.430 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:43:56.430 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:56.430 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:56.430 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T14:43:56.430 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:45.385958+0000", 2024-04-18T14:43:56.430 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:43:56.430 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:56.430 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:56.430 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T14:43:56.430 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:45.385957+0000", 2024-04-18T14:43:56.430 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999986 2024-04-18T14:43:56.431 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:56.431 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:56.431 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T14:43:56.431 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:45.386012+0000", 2024-04-18T14:43:56.431 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.5345e-05 2024-04-18T14:43:56.431 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:56.431 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:56.431 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T14:43:56.431 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:45.386048+0000", 2024-04-18T14:43:56.431 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.5460000000000003e-05 2024-04-18T14:43:56.431 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:56.431 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:56.431 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T14:43:56.431 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:45.386070+0000", 2024-04-18T14:43:56.431 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.1940999999999999e-05 2024-04-18T14:43:56.431 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:56.432 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:56.432 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T14:43:56.432 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:45.386193+0000", 2024-04-18T14:43:56.432 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000123008 2024-04-18T14:43:56.432 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:56.432 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:56.432 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_started", 2024-04-18T14:43:56.432 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:45.386207+0000", 2024-04-18T14:43:56.432 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3920999999999999e-05 2024-04-18T14:43:56.433 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:56.433 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:56.433 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_committed", 2024-04-18T14:43:56.433 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:45.395097+0000", 2024-04-18T14:43:56.433 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0088900690000000004 2024-04-18T14:43:56.433 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:56.433 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:56.433 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T14:43:56.433 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:45.395163+0000", 2024-04-18T14:43:56.434 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.6444000000000003e-05 2024-04-18T14:43:56.434 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:43:56.434 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T14:43:56.434 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:43:56.434 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:56.435 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:56.435 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "MOSDECSubOpWrite(3.es3 46/30 ECSubWrite(tid=26, reqid=osd.8.0:26, at_version=46'17, trim_to=0'0, roll_forward_to=45'15))", 2024-04-18T14:43:56.435 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T14:43:45.389689+0000", 2024-04-18T14:43:56.435 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 10.980595609, 2024-04-18T14:43:56.435 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.011234726, 2024-04-18T14:43:56.435 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T14:43:56.435 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-04-18T14:43:56.435 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T14:43:56.435 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:56.435 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T14:43:56.435 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:45.389689+0000", 2024-04-18T14:43:56.435 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:43:56.436 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:56.436 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:56.436 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T14:43:56.436 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:45.389689+0000", 2024-04-18T14:43:56.436 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:43:56.436 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:56.436 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:56.436 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T14:43:56.436 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:45.389688+0000", 2024-04-18T14:43:56.436 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-18T14:43:56.436 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:56.436 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:56.436 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T14:43:56.436 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:45.389748+0000", 2024-04-18T14:43:56.436 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.0194e-05 2024-04-18T14:43:56.437 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:56.437 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:56.437 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T14:43:56.437 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:45.389782+0000", 2024-04-18T14:43:56.437 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.3741000000000001e-05 2024-04-18T14:43:56.437 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:56.437 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:56.437 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T14:43:56.437 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:45.389810+0000", 2024-04-18T14:43:56.437 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.7966999999999998e-05 2024-04-18T14:43:56.437 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:56.438 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:56.438 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T14:43:56.438 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:45.389994+0000", 2024-04-18T14:43:56.438 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000183821 2024-04-18T14:43:56.438 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:56.438 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:56.438 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_started", 2024-04-18T14:43:56.438 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:45.390021+0000", 2024-04-18T14:43:56.438 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.728e-05 2024-04-18T14:43:56.438 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:56.438 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:56.438 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_committed", 2024-04-18T14:43:56.438 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:45.400846+0000", 2024-04-18T14:43:56.438 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.010825404 2024-04-18T14:43:56.438 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:56.438 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:56.439 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T14:43:56.439 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:45.400923+0000", 2024-04-18T14:43:56.439 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.7065999999999997e-05 2024-04-18T14:43:56.439 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:43:56.439 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T14:43:56.439 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:43:56.439 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:56.439 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:56.439 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "MOSDECSubOpWrite(3.4s5 46/30 ECSubWrite(tid=30, reqid=client.4559.0:324, at_version=0'0, trim_to=0'0, roll_forward_to=46'6))", 2024-04-18T14:43:56.439 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T14:43:45.393324+0000", 2024-04-18T14:43:56.439 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 10.976960576, 2024-04-18T14:43:56.439 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0074599159999999996, 2024-04-18T14:43:56.439 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T14:43:56.439 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-04-18T14:43:56.439 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T14:43:56.440 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:56.440 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T14:43:56.440 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:45.393324+0000", 2024-04-18T14:43:56.440 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:43:56.440 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:56.440 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:56.440 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T14:43:56.440 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:45.393324+0000", 2024-04-18T14:43:56.440 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:43:56.440 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:56.440 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:56.440 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T14:43:56.440 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:45.393322+0000", 2024-04-18T14:43:56.440 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999981 2024-04-18T14:43:56.440 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:56.440 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:56.441 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T14:43:56.441 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:45.393352+0000", 2024-04-18T14:43:56.441 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.0567000000000001e-05 2024-04-18T14:43:56.441 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:56.441 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:56.441 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T14:43:56.441 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:45.393389+0000", 2024-04-18T14:43:56.441 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.7120999999999999e-05 2024-04-18T14:43:56.441 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:56.441 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:56.441 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T14:43:56.441 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:45.393413+0000", 2024-04-18T14:43:56.441 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.3283000000000001e-05 2024-04-18T14:43:56.441 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:56.441 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:56.442 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T14:43:56.442 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:45.393555+0000", 2024-04-18T14:43:56.442 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000142263 2024-04-18T14:43:56.442 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:56.442 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:56.442 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_started", 2024-04-18T14:43:56.442 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:45.393580+0000", 2024-04-18T14:43:56.442 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.5454000000000001e-05 2024-04-18T14:43:56.442 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:56.442 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:56.442 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_committed", 2024-04-18T14:43:56.442 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:45.400722+0000", 2024-04-18T14:43:56.442 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0071421610000000002 2024-04-18T14:43:56.443 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:56.443 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:56.443 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T14:43:56.443 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:45.400784+0000", 2024-04-18T14:43:56.443 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.1106999999999996e-05 2024-04-18T14:43:56.443 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:43:56.443 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T14:43:56.443 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:43:56.443 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:56.443 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:56.443 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "MOSDECSubOpWrite(3.5s5 47/30 ECSubWrite(tid=15, reqid=client.4559.0:326, at_version=47'13, trim_to=0'0, roll_forward_to=46'12))", 2024-04-18T14:43:56.443 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T14:43:46.394997+0000", 2024-04-18T14:43:56.443 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 9.9752867910000003, 2024-04-18T14:43:56.443 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0060394630000000001, 2024-04-18T14:43:56.443 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T14:43:56.444 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-04-18T14:43:56.444 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T14:43:56.444 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:56.444 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T14:43:56.444 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:46.394997+0000", 2024-04-18T14:43:56.444 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:43:56.444 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:56.444 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:56.444 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T14:43:56.444 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:46.394997+0000", 2024-04-18T14:43:56.444 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:43:56.444 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:56.444 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:56.444 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T14:43:56.444 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:46.394997+0000", 2024-04-18T14:43:56.445 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-04-18T14:43:56.445 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:56.445 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:56.445 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T14:43:56.445 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:46.395634+0000", 2024-04-18T14:43:56.445 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000636974 2024-04-18T14:43:56.445 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:56.445 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:56.445 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T14:43:56.445 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:46.395682+0000", 2024-04-18T14:43:56.445 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.8177999999999998e-05 2024-04-18T14:43:56.445 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:56.445 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:56.445 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T14:43:56.445 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:46.395709+0000", 2024-04-18T14:43:56.446 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.7022999999999999e-05 2024-04-18T14:43:56.446 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:56.446 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:56.446 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T14:43:56.446 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:46.396234+0000", 2024-04-18T14:43:56.446 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00052546600000000004 2024-04-18T14:43:56.446 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:56.446 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:56.446 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_started", 2024-04-18T14:43:56.446 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:46.396263+0000", 2024-04-18T14:43:56.446 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.8773999999999999e-05 2024-04-18T14:43:56.446 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:56.446 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:56.446 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_committed", 2024-04-18T14:43:56.446 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:46.401001+0000", 2024-04-18T14:43:56.447 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0047376930000000003 2024-04-18T14:43:56.447 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:56.447 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:56.447 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T14:43:56.447 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:46.401037+0000", 2024-04-18T14:43:56.447 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.6052e-05 2024-04-18T14:43:56.447 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:43:56.447 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T14:43:56.447 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:43:56.447 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:56.447 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:56.447 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4559.0:370 3.cs0 3:328b7efa:::smithi13430248-27:head [copy-from ver 0] snapc 13=[13,11,f,b,a,8,7,2] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-04-18T14:43:56.447 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T14:43:50.376273+0000", 2024-04-18T14:43:56.447 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 5.994011188, 2024-04-18T14:43:56.447 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.013655448000000001, 2024-04-18T14:43:56.448 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T14:43:56.448 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-04-18T14:43:56.448 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-18T14:43:56.448 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4559", 2024-04-18T14:43:56.448 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/3113589487", 2024-04-18T14:43:56.448 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 370 2024-04-18T14:43:56.448 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:56.448 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T14:43:56.448 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:56.448 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T14:43:56.448 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:50.376273+0000", 2024-04-18T14:43:56.449 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:43:56.449 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:56.449 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:56.449 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T14:43:56.449 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:50.376273+0000", 2024-04-18T14:43:56.449 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:43:56.449 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:56.449 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:56.449 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T14:43:56.449 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:50.376270+0000", 2024-04-18T14:43:56.449 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999967 2024-04-18T14:43:56.449 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:56.449 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:56.449 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T14:43:56.449 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:50.376330+0000", 2024-04-18T14:43:56.449 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.0875000000000002e-05 2024-04-18T14:43:56.450 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:56.450 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:56.450 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T14:43:56.450 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:50.376373+0000", 2024-04-18T14:43:56.450 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.2734000000000001e-05 2024-04-18T14:43:56.450 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:56.450 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:56.450 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T14:43:56.450 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:50.376395+0000", 2024-04-18T14:43:56.450 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2076999999999999e-05 2024-04-18T14:43:56.450 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:56.450 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:56.450 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T14:43:56.450 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:50.376555+0000", 2024-04-18T14:43:56.450 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00015939900000000001 2024-04-18T14:43:56.451 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:56.451 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:56.451 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op must wait for map", 2024-04-18T14:43:56.451 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:50.376581+0000", 2024-04-18T14:43:56.451 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.6037000000000002e-05 2024-04-18T14:43:56.451 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:56.451 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:56.451 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T14:43:56.451 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:50.382650+0000", 2024-04-18T14:43:56.451 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0060690400000000004 2024-04-18T14:43:56.451 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:56.451 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:56.451 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T14:43:56.451 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:50.382881+0000", 2024-04-18T14:43:56.451 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00023159999999999999 2024-04-18T14:43:56.451 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:56.452 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:56.452 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T14:43:56.452 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:50.389928+0000", 2024-04-18T14:43:56.452 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0070471270000000003 2024-04-18T14:43:56.452 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:43:56.452 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T14:43:56.452 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:43:56.452 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:56.452 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:56.452 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4559.0:371 3.cs0 3:328b7efa:::smithi13430248-27:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e51)", 2024-04-18T14:43:56.452 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T14:43:50.376423+0000", 2024-04-18T14:43:56.452 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 5.9938615720000001, 2024-04-18T14:43:56.452 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.014299084, 2024-04-18T14:43:56.452 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T14:43:56.452 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-04-18T14:43:56.452 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-18T14:43:56.453 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4559", 2024-04-18T14:43:56.453 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/3113589487", 2024-04-18T14:43:56.453 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 371 2024-04-18T14:43:56.453 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:56.453 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T14:43:56.453 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:56.453 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T14:43:56.453 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:50.376423+0000", 2024-04-18T14:43:56.453 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:43:56.453 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:56.453 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:56.453 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T14:43:56.453 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:50.376423+0000", 2024-04-18T14:43:56.453 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:43:56.453 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:56.454 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:56.454 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T14:43:56.454 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:50.376422+0000", 2024-04-18T14:43:56.454 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-18T14:43:56.454 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:56.454 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:56.454 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T14:43:56.454 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:50.376483+0000", 2024-04-18T14:43:56.454 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.1489999999999996e-05 2024-04-18T14:43:56.454 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:56.454 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:56.454 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T14:43:56.454 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:50.376501+0000", 2024-04-18T14:43:56.454 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8184000000000001e-05 2024-04-18T14:43:56.455 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:56.455 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:56.455 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T14:43:56.455 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:50.376515+0000", 2024-04-18T14:43:56.455 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3703000000000001e-05 2024-04-18T14:43:56.455 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:56.455 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:56.455 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T14:43:56.455 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:50.376706+0000", 2024-04-18T14:43:56.455 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00019086 2024-04-18T14:43:56.455 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:56.455 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:56.455 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting_for_map not empty", 2024-04-18T14:43:56.455 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:50.376718+0000", 2024-04-18T14:43:56.455 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.185e-05 2024-04-18T14:43:56.455 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:56.456 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:56.456 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T14:43:56.456 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:50.383293+0000", 2024-04-18T14:43:56.456 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0065750180000000002 2024-04-18T14:43:56.456 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:56.456 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:56.456 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for blocked object", 2024-04-18T14:43:56.456 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:50.383426+0000", 2024-04-18T14:43:56.456 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000132908 2024-04-18T14:43:56.456 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:56.456 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:56.456 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T14:43:56.456 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:50.390163+0000", 2024-04-18T14:43:56.456 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0067374269999999998 2024-04-18T14:43:56.456 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:56.456 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:56.457 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T14:43:56.457 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:50.390421+0000", 2024-04-18T14:43:56.457 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00025773700000000002 2024-04-18T14:43:56.457 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:56.457 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:56.457 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T14:43:56.457 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:50.390722+0000", 2024-04-18T14:43:56.457 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00030097700000000002 2024-04-18T14:43:56.457 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:43:56.457 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T14:43:56.457 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:43:56.457 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:56.457 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:56.457 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4559.0:380 3.cs0 3:32b15d13:::smithi13430248-43:head [copy-from ver 12] snapc 13=[13,11,f,b,a,8,7,2] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-04-18T14:43:56.458 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T14:43:50.410989+0000", 2024-04-18T14:43:56.458 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 5.9592952590000001, 2024-04-18T14:43:56.458 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.01842353, 2024-04-18T14:43:56.458 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T14:43:56.458 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T14:43:56.458 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-18T14:43:56.458 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4559", 2024-04-18T14:43:56.458 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/3113589487", 2024-04-18T14:43:56.458 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 380 2024-04-18T14:43:56.458 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:56.458 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T14:43:56.458 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:56.458 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T14:43:56.458 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:50.410989+0000", 2024-04-18T14:43:56.458 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:43:56.459 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:56.459 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:56.459 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T14:43:56.459 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:50.410989+0000", 2024-04-18T14:43:56.459 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:43:56.459 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:56.459 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:56.459 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T14:43:56.459 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:50.410987+0000", 2024-04-18T14:43:56.459 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999976 2024-04-18T14:43:56.459 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:56.459 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:56.459 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T14:43:56.459 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:50.410996+0000", 2024-04-18T14:43:56.459 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.4539999999999996e-06 2024-04-18T14:43:56.460 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:56.460 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:56.460 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T14:43:56.460 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:50.411013+0000", 2024-04-18T14:43:56.460 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6728999999999999e-05 2024-04-18T14:43:56.460 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:56.460 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:56.460 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T14:43:56.460 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:50.411022+0000", 2024-04-18T14:43:56.460 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.7770000000000008e-06 2024-04-18T14:43:56.460 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:56.460 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:56.460 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T14:43:56.460 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:50.411171+0000", 2024-04-18T14:43:56.460 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00014944900000000001 2024-04-18T14:43:56.460 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:56.461 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:56.461 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T14:43:56.461 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:50.411369+0000", 2024-04-18T14:43:56.461 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00019749000000000001 2024-04-18T14:43:56.461 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:56.461 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:56.461 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_started", 2024-04-18T14:43:56.461 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:50.419400+0000", 2024-04-18T14:43:56.461 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0080313759999999998 2024-04-18T14:43:56.461 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:56.461 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:56.461 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_committed", 2024-04-18T14:43:56.461 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:50.423023+0000", 2024-04-18T14:43:56.461 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.003622905 2024-04-18T14:43:56.461 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:56.461 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:56.462 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T14:43:56.462 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:50.429197+0000", 2024-04-18T14:43:56.462 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0061737709999999998 2024-04-18T14:43:56.462 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:56.462 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:56.462 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T14:43:56.462 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:50.429412+0000", 2024-04-18T14:43:56.462 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000215727 2024-04-18T14:43:56.462 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:43:56.462 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T14:43:56.462 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:43:56.462 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:56.462 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:56.462 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4559.0:381 3.cs0 3:32b15d13:::smithi13430248-43:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e51)", 2024-04-18T14:43:56.462 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T14:43:50.411056+0000", 2024-04-18T14:43:56.463 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 5.9592283479999999, 2024-04-18T14:43:56.463 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.011201411999999999, 2024-04-18T14:43:56.463 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T14:43:56.463 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-04-18T14:43:56.463 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-18T14:43:56.463 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4559", 2024-04-18T14:43:56.463 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/3113589487", 2024-04-18T14:43:56.463 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 381 2024-04-18T14:43:56.463 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:56.463 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T14:43:56.463 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:56.463 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T14:43:56.463 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:50.411056+0000", 2024-04-18T14:43:56.463 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:43:56.463 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:56.464 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:56.464 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T14:43:56.464 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:50.411056+0000", 2024-04-18T14:43:56.464 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:43:56.464 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:56.464 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:56.464 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T14:43:56.464 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:50.411055+0000", 2024-04-18T14:43:56.464 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-04-18T14:43:56.464 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:56.464 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:56.464 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T14:43:56.464 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:50.411059+0000", 2024-04-18T14:43:56.464 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.5480000000000002e-06 2024-04-18T14:43:56.464 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:56.464 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:56.465 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T14:43:56.465 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:50.411069+0000", 2024-04-18T14:43:56.465 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.781e-06 2024-04-18T14:43:56.465 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:56.465 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:56.465 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T14:43:56.465 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:50.411074+0000", 2024-04-18T14:43:56.465 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.784e-06 2024-04-18T14:43:56.465 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:56.465 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:56.465 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T14:43:56.465 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:50.411713+0000", 2024-04-18T14:43:56.465 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00063852400000000001 2024-04-18T14:43:56.465 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:56.465 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:56.465 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for blocked object", 2024-04-18T14:43:56.466 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:50.411854+0000", 2024-04-18T14:43:56.466 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00014133599999999999 2024-04-18T14:43:56.466 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:56.466 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:56.466 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T14:43:56.466 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:50.421902+0000", 2024-04-18T14:43:56.466 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.01004728 2024-04-18T14:43:56.466 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:56.466 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:56.466 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T14:43:56.466 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:50.422057+0000", 2024-04-18T14:43:56.466 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000155072 2024-04-18T14:43:56.468 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:56.468 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:56.469 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T14:43:56.470 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:50.422257+0000", 2024-04-18T14:43:56.470 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00020067300000000001 2024-04-18T14:43:56.471 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:43:56.471 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T14:43:56.471 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:43:56.471 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:43:56.471 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T14:43:56.471 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-04-18T14:43:56.472 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-04-18T14:43:56.473 INFO:tasks.rados.rados.0.smithi134.stdout:185: done (2 left) 2024-04-18T14:43:56.473 INFO:tasks.rados.rados.0.smithi134.stdout:186: done (1 left) 2024-04-18T14:43:56.474 INFO:tasks.rados.rados.0.smithi134.stdout:188: done (0 left) 2024-04-18T14:43:56.474 INFO:tasks.rados.rados.0.smithi134.stdout:append oid 30 current snap is 17 2024-04-18T14:43:56.474 INFO:tasks.rados.rados.0.smithi134.stdout:189: seq_num 87 ranges {622592=704512,1327104=688128,2015232=81920} 2024-04-18T14:43:56.474 INFO:teuthology.orchestra.run.smithi086.stderr:reweighted osd.4 to 1 (10000) 2024-04-18T14:43:56.475 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 5 1 2024-04-18T14:43:56.476 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.15.asok dump_ops_in_flight 2024-04-18T14:43:56.477 INFO:tasks.rados.rados.0.smithi134.stdout:189: writing smithi13430248-30 from 622592 to 1327104 tid 1 2024-04-18T14:43:56.477 INFO:tasks.rados.rados.0.smithi134.stdout:189: writing smithi13430248-30 from 1327104 to 2015232 tid 2 2024-04-18T14:43:56.477 INFO:tasks.rados.rados.0.smithi134.stdout:189: writing smithi13430248-30 from 2015232 to 2097152 tid 3 2024-04-18T14:43:56.478 INFO:tasks.rados.rados.0.smithi134.stdout:190: read oid 45 snap -1 2024-04-18T14:43:56.478 INFO:tasks.rados.rados.0.smithi134.stdout:190: expect (ObjNum 44 snap 0 seq_num 44) 2024-04-18T14:43:56.478 INFO:tasks.rados.rados.0.smithi134.stdout:191: read oid 21 snap -1 2024-04-18T14:43:56.478 INFO:tasks.rados.rados.0.smithi134.stdout:191: expect (ObjNum 79 snap 15 seq_num 79) 2024-04-18T14:43:56.478 INFO:tasks.rados.rados.0.smithi134.stdout:append oid 38 current snap is 17 2024-04-18T14:43:56.478 INFO:tasks.rados.rados.0.smithi134.stdout:192: seq_num 88 ranges {2998272=720896,3719168=442368,4161536=327680} 2024-04-18T14:43:56.478 INFO:tasks.rados.rados.0.smithi134.stdout:192: writing smithi13430248-38 from 2998272 to 3719168 tid 1 2024-04-18T14:43:56.478 INFO:tasks.rados.rados.0.smithi134.stdout:192: writing smithi13430248-38 from 3719168 to 4161536 tid 2 2024-04-18T14:43:56.478 INFO:tasks.rados.rados.0.smithi134.stdout:192: writing smithi13430248-38 from 4161536 to 4489216 tid 3 2024-04-18T14:43:56.478 INFO:tasks.rados.rados.0.smithi134.stdout:193: delete oid 6 current snap is 17 2024-04-18T14:43:56.478 INFO:tasks.rados.rados.0.smithi134.stdout:189: finishing write tid 1 to smithi13430248-30 2024-04-18T14:43:56.478 INFO:tasks.rados.rados.0.smithi134.stdout:189: finishing write tid 2 to smithi13430248-30 2024-04-18T14:43:56.478 INFO:tasks.rados.rados.0.smithi134.stdout:191: expect (ObjNum 79 snap 15 seq_num 79) 2024-04-18T14:43:56.479 INFO:tasks.ceph.osd.7.smithi134.stderr:2024-04-18T14:43:56.476+0000 7fd7de549640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25213) UID: 0 2024-04-18T14:43:56.516 INFO:tasks.rados.rados.0.smithi134.stdout:189: finishing write tid 3 to smithi13430248-30 2024-04-18T14:43:56.516 INFO:tasks.rados.rados.0.smithi134.stdout:190: expect (ObjNum 44 snap 0 seq_num 44) 2024-04-18T14:43:56.537 INFO:tasks.rados.rados.0.smithi134.stdout:189: finishing write tid 4 to smithi13430248-30 2024-04-18T14:43:56.538 INFO:tasks.rados.rados.0.smithi134.stdout:190: done (4 left) 2024-04-18T14:43:56.538 INFO:tasks.rados.rados.0.smithi134.stdout:191: done (3 left) 2024-04-18T14:43:56.538 INFO:tasks.rados.rados.0.smithi134.stdout:193: done (2 left) 2024-04-18T14:43:56.538 INFO:tasks.rados.rados.0.smithi134.stdout:194: read oid 46 snap -1 2024-04-18T14:43:56.538 INFO:tasks.rados.rados.0.smithi134.stdout:194: expect (ObjNum 37 snap 0 seq_num 37) 2024-04-18T14:43:56.538 INFO:tasks.rados.rados.0.smithi134.stdout:195: copy_from oid 50 from oid 45 current snap is 17 2024-04-18T14:43:56.538 INFO:tasks.rados.rados.0.smithi134.stdout:189: finishing write tid 5 to smithi13430248-30 2024-04-18T14:43:56.538 INFO:tasks.rados.rados.0.smithi134.stdout:189: oid 30 updating version 0 to 49 2024-04-18T14:43:56.538 INFO:tasks.rados.rados.0.smithi134.stdout:189: oid 30 updating version 49 to 50 2024-04-18T14:43:56.538 INFO:tasks.rados.rados.0.smithi134.stdout:189: oid 30 updating version 50 to 52 2024-04-18T14:43:56.538 INFO:tasks.rados.rados.0.smithi134.stdout:189: oid 30 version 52 is already newer than 51 2024-04-18T14:43:56.539 INFO:tasks.rados.rados.0.smithi134.stdout:update_object_version oid 30 v 52 (ObjNum 87 snap 17 seq_num 87) dirty exists 2024-04-18T14:43:56.539 INFO:tasks.rados.rados.0.smithi134.stdout:189: left oid 30 (ObjNum 87 snap 17 seq_num 87) 2024-04-18T14:43:56.539 INFO:tasks.rados.rados.0.smithi134.stdout:192: finishing write tid 1 to smithi13430248-38 2024-04-18T14:43:56.539 INFO:tasks.rados.rados.0.smithi134.stdout:192: finishing write tid 2 to smithi13430248-38 2024-04-18T14:43:56.539 INFO:tasks.rados.rados.0.smithi134.stdout:192: finishing write tid 3 to smithi13430248-38 2024-04-18T14:43:56.539 INFO:tasks.rados.rados.0.smithi134.stdout:192: finishing write tid 4 to smithi13430248-38 2024-04-18T14:43:56.539 INFO:tasks.rados.rados.0.smithi134.stdout:192: finishing write tid 5 to smithi13430248-38 2024-04-18T14:43:56.539 INFO:tasks.rados.rados.0.smithi134.stdout:192: oid 38 updating version 0 to 64 2024-04-18T14:43:56.539 INFO:tasks.rados.rados.0.smithi134.stdout:192: oid 38 updating version 64 to 66 2024-04-18T14:43:56.539 INFO:tasks.rados.rados.0.smithi134.stdout:192: oid 38 version 66 is already newer than 63 2024-04-18T14:43:56.539 INFO:tasks.rados.rados.0.smithi134.stdout:192: oid 38 version 66 is already newer than 65 2024-04-18T14:43:56.539 INFO:tasks.rados.rados.0.smithi134.stdout:update_object_version oid 38 v 66 (ObjNum 88 snap 17 seq_num 88) dirty exists 2024-04-18T14:43:56.539 INFO:tasks.rados.rados.0.smithi134.stdout:192: left oid 38 (ObjNum 88 snap 17 seq_num 88) 2024-04-18T14:43:56.539 INFO:tasks.rados.rados.0.smithi134.stdout:189: done (3 left) 2024-04-18T14:43:56.539 INFO:tasks.rados.rados.0.smithi134.stdout:192: done (2 left) 2024-04-18T14:43:56.540 INFO:tasks.rados.rados.0.smithi134.stdout:196: delete oid 26 current snap is 17 2024-04-18T14:43:56.543 INFO:tasks.rados.rados.0.smithi134.stdout:196: done (2 left) 2024-04-18T14:43:56.543 INFO:tasks.rados.rados.0.smithi134.stdout:197: rollback oid 11 current snap is 17 2024-04-18T14:43:56.544 INFO:tasks.rados.rados.0.smithi134.stdout:rollback oid 11 to 0 2024-04-18T14:43:56.544 INFO:tasks.rados.rados.0.smithi134.stdout:198: copy_from oid 18 from oid 23 current snap is 17 2024-04-18T14:43:56.544 INFO:tasks.rados.rados.0.smithi134.stdout:199: rollback oid 38 current snap is 17 2024-04-18T14:43:56.544 INFO:tasks.rados.rados.0.smithi134.stdout:rollback oid 38 to 7 2024-04-18T14:43:56.544 INFO:tasks.rados.rados.0.smithi134.stdout:200: delete oid 4 current snap is 17 2024-04-18T14:43:56.549 INFO:tasks.rados.rados.0.smithi134.stdout:195: finishing copy_from racing read to smithi13430248-50 2024-04-18T14:43:56.550 INFO:tasks.rados.rados.0.smithi134.stdout:197: finishing rollback tid 1 to smithi13430248-11 2024-04-18T14:43:56.550 INFO:tasks.rados.rados.0.smithi134.stdout:197: finishing rollback tid 2 to smithi13430248-11 2024-04-18T14:43:56.550 INFO:tasks.rados.rados.0.smithi134.stdout:update_object_version oid 11 v 38 (ObjNum 10 snap 0 seq_num 10) dirty exists 2024-04-18T14:43:56.552 INFO:tasks.rados.rados.0.smithi134.stdout:194: expect (ObjNum 37 snap 0 seq_num 37) 2024-04-18T14:43:56.570 INFO:tasks.rados.rados.0.smithi134.stdout:199: finishing rollback tid 0 to smithi13430248-38 2024-04-18T14:43:56.570 INFO:tasks.rados.rados.0.smithi134.stdout:199: finishing rollback tid 1 to smithi13430248-38 2024-04-18T14:43:56.571 INFO:tasks.rados.rados.0.smithi134.stdout:194: done (5 left) 2024-04-18T14:43:56.571 INFO:tasks.rados.rados.0.smithi134.stdout:197: done (4 left) 2024-04-18T14:43:56.571 INFO:tasks.rados.rados.0.smithi134.stdout:200: done (3 left) 2024-04-18T14:43:56.571 INFO:tasks.rados.rados.0.smithi134.stdout:201: rmattr oid 2 current snap is 17 2024-04-18T14:43:56.571 INFO:tasks.rados.rados.0.smithi134.stdout:201: done (3 left) 2024-04-18T14:43:56.571 INFO:tasks.rados.rados.0.smithi134.stdout:202: rmattr oid 42 current snap is 17 2024-04-18T14:43:56.571 INFO:tasks.rados.rados.0.smithi134.stdout:202: done (3 left) 2024-04-18T14:43:56.572 INFO:tasks.rados.rados.0.smithi134.stdout:203: setattr oid 42 current snap is 17 2024-04-18T14:43:56.572 INFO:tasks.rados.rados.0.smithi134.stdout:195: finishing copy_from to smithi13430248-50 2024-04-18T14:43:56.572 INFO:tasks.rados.rados.0.smithi134.stdout:update_object_version oid 50 v 48 (ObjNum 44 snap 0 seq_num 44) dirty exists 2024-04-18T14:43:56.572 INFO:tasks.rados.rados.0.smithi134.stdout:199: finishing rollback tid 2 to smithi13430248-38 2024-04-18T14:43:56.572 INFO:tasks.rados.rados.0.smithi134.stdout:update_object_version oid 38 v 69 (ObjNum 60 snap 4 seq_num 60) dirty exists 2024-04-18T14:43:56.572 INFO:tasks.rados.rados.0.smithi134.stdout:198: finishing copy_from racing read to smithi13430248-18 2024-04-18T14:43:56.573 INFO:tasks.rados.rados.0.smithi134.stdout:195: done (3 left) 2024-04-18T14:43:56.573 INFO:tasks.rados.rados.0.smithi134.stdout:199: done (2 left) 2024-04-18T14:43:56.573 INFO:tasks.rados.rados.0.smithi134.stdout:204: copy_from oid 16 from oid 50 current snap is 17 2024-04-18T14:43:56.573 INFO:tasks.rados.rados.0.smithi134.stdout:205: rollback oid 36 current snap is 17 2024-04-18T14:43:56.573 INFO:tasks.rados.rados.0.smithi134.stdout:rollback oid 36 to 14 2024-04-18T14:43:56.573 INFO:tasks.rados.rados.0.smithi134.stdout:206: copy_from oid 24 from oid 22 current snap is 17 2024-04-18T14:43:56.573 INFO:tasks.rados.rados.0.smithi134.stdout:207: copy_from oid 3 from oid 25 current snap is 17 2024-04-18T14:43:56.573 INFO:tasks.rados.rados.0.smithi134.stdout:208: snap_create 2024-04-18T14:43:56.573 INFO:tasks.rados.rados.0.smithi134.stdout:198: finishing copy_from to smithi13430248-18 2024-04-18T14:43:56.573 INFO:tasks.rados.rados.0.smithi134.stdout:update_object_version oid 18 v 46 (ObjNum 44 snap 0 seq_num 44) dirty exists 2024-04-18T14:43:56.575 INFO:tasks.ceph.osd.2.smithi119.stderr:2024-04-18T14:43:56.574+0000 7fcbd30c0640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 24894) UID: 0 2024-04-18T14:43:56.582 INFO:tasks.rados.rados.0.smithi134.stdout:update_object_version oid 42 v 47 (ObjNum 273 snap 0 seq_num 0) dirty exists 2024-04-18T14:43:56.582 INFO:tasks.rados.rados.0.smithi134.stdout:205: finishing rollback tid 0 to smithi13430248-36 2024-04-18T14:43:56.584 INFO:tasks.rados.rados.0.smithi134.stdout:205: finishing rollback tid 1 to smithi13430248-36 2024-04-18T14:43:56.585 INFO:tasks.rados.rados.0.smithi134.stdout:207: finishing copy_from racing read to smithi13430248-3 2024-04-18T14:43:56.586 INFO:tasks.rados.rados.0.smithi134.stdout:206: finishing copy_from racing read to smithi13430248-24 2024-04-18T14:43:56.587 INFO:tasks.rados.rados.0.smithi134.stdout:204: finishing copy_from racing read to smithi13430248-16 2024-04-18T14:43:56.589 INFO:tasks.rados.rados.0.smithi134.stdout:205: finishing rollback tid 2 to smithi13430248-36 2024-04-18T14:43:56.589 INFO:tasks.rados.rados.0.smithi134.stdout:update_object_version oid 36 v 64 (ObjNum 35 snap 0 seq_num 35) dirty exists 2024-04-18T14:43:56.593 INFO:tasks.rados.rados.0.smithi134.stdout:204: finishing copy_from to smithi13430248-16 2024-04-18T14:43:56.593 INFO:tasks.rados.rados.0.smithi134.stdout:update_object_version oid 16 v 48 (ObjNum 44 snap 0 seq_num 44) dirty exists 2024-04-18T14:43:56.593 INFO:tasks.rados.rados.0.smithi134.stdout:207: finishing copy_from to smithi13430248-3 2024-04-18T14:43:56.594 INFO:tasks.rados.rados.0.smithi134.stdout:update_object_version oid 3 v 55 (ObjNum 81 snap 15 seq_num 81) dirty exists 2024-04-18T14:43:56.594 INFO:tasks.rados.rados.0.smithi134.stdout:206: finishing copy_from to smithi13430248-24 2024-04-18T14:43:56.594 INFO:tasks.rados.rados.0.smithi134.stdout:update_object_version oid 24 v 13 (ObjNum 21 snap 0 seq_num 21) dirty exists 2024-04-18T14:43:56.649 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-04-18T14:43:56.649 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [], 2024-04-18T14:43:56.649 INFO:teuthology.orchestra.run.smithi134.stdout: "num_ops": 0 2024-04-18T14:43:56.649 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-04-18T14:43:56.664 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.15.asok dump_blocked_ops 2024-04-18T14:43:56.707 INFO:tasks.ceph.osd.11.smithi134.stderr:2024-04-18T14:43:56.712+0000 7f2d36f12640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 11 (PID: 25216) UID: 0 2024-04-18T14:43:56.776 INFO:tasks.ceph.osd.12.smithi086.stderr:2024-04-18T14:43:56.775+0000 7f6904968640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 12 (PID: 24960) UID: 0 2024-04-18T14:43:56.831 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-04-18T14:43:56.831 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [], 2024-04-18T14:43:56.831 INFO:teuthology.orchestra.run.smithi134.stdout: "complaint_time": 30, 2024-04-18T14:43:56.831 INFO:teuthology.orchestra.run.smithi134.stdout: "num_blocked_ops": 0 2024-04-18T14:43:56.831 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-04-18T14:43:56.844 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.15.asok dump_historic_ops 2024-04-18T14:43:56.877 INFO:tasks.ceph.osd.12.smithi086.stderr:2024-04-18T14:43:56.874+0000 7f6904968640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 12 (PID: 24960) UID: 0 2024-04-18T14:43:56.883 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-18T14:43:56.969 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-04-18T14:43:56.969 INFO:teuthology.orchestra.run.smithi134.stdout: "size": 20, 2024-04-18T14:43:56.969 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 600, 2024-04-18T14:43:56.969 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [ 2024-04-18T14:43:56.969 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:56.969 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "MOSDECSubOpWrite(3.as5 36/30 ECSubWrite(tid=18, reqid=client.4559.0:178, at_version=36'12, trim_to=0'0, roll_forward_to=35'10))", 2024-04-18T14:43:56.970 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T14:43:35.738927+0000", 2024-04-18T14:43:56.970 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 21.232356187000001, 2024-04-18T14:43:56.970 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0070694529999999998, 2024-04-18T14:43:56.970 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T14:43:56.970 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-04-18T14:43:56.970 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T14:43:56.970 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:56.970 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T14:43:56.970 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:35.738927+0000", 2024-04-18T14:43:56.970 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:43:56.970 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:56.970 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:56.970 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T14:43:56.970 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:35.738927+0000", 2024-04-18T14:43:56.970 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:43:56.971 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:56.971 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:56.971 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T14:43:56.971 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:35.738927+0000", 2024-04-18T14:43:56.971 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-04-18T14:43:56.971 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:56.971 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:56.971 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T14:43:56.971 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:35.739134+0000", 2024-04-18T14:43:56.971 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00020758699999999999 2024-04-18T14:43:56.971 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:56.971 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:56.971 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T14:43:56.971 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:35.739157+0000", 2024-04-18T14:43:56.971 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2577000000000001e-05 2024-04-18T14:43:56.972 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:56.972 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:56.972 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T14:43:56.972 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:35.739187+0000", 2024-04-18T14:43:56.972 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.0329e-05 2024-04-18T14:43:56.972 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:56.972 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:56.972 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T14:43:56.972 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:35.739334+0000", 2024-04-18T14:43:56.972 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000146883 2024-04-18T14:43:56.972 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:56.972 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:56.972 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_started", 2024-04-18T14:43:56.972 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:35.739360+0000", 2024-04-18T14:43:56.972 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.6451000000000001e-05 2024-04-18T14:43:56.973 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:56.973 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:56.973 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_committed", 2024-04-18T14:43:56.973 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:35.745931+0000", 2024-04-18T14:43:56.973 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0065700660000000003 2024-04-18T14:43:56.973 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:56.973 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:56.973 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T14:43:56.973 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:35.745997+0000", 2024-04-18T14:43:56.973 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.6192000000000006e-05 2024-04-18T14:43:56.973 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:43:56.973 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T14:43:56.973 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:43:56.973 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:56.973 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:56.973 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "MOSDECSubOpWrite(3.8s5 41/30 ECSubWrite(tid=35, reqid=client.4559.0:250, at_version=41'18, trim_to=0'0, roll_forward_to=38'16))", 2024-04-18T14:43:56.974 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T14:43:40.766176+0000", 2024-04-18T14:43:56.974 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 16.205107344999998, 2024-04-18T14:43:56.974 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0050703090000000003, 2024-04-18T14:43:56.974 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T14:43:56.974 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-04-18T14:43:56.974 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T14:43:56.974 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:56.974 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T14:43:56.974 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:40.766176+0000", 2024-04-18T14:43:56.974 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:43:56.974 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:56.974 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:56.974 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T14:43:56.974 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:40.766176+0000", 2024-04-18T14:43:56.974 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:43:56.975 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:56.975 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:56.975 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T14:43:56.975 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:40.766175+0000", 2024-04-18T14:43:56.975 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-04-18T14:43:56.975 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:56.975 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:56.975 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T14:43:56.975 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:40.766245+0000", 2024-04-18T14:43:56.975 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.9363999999999995e-05 2024-04-18T14:43:56.975 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:56.975 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:56.975 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T14:43:56.975 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:40.766278+0000", 2024-04-18T14:43:56.975 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.2713999999999999e-05 2024-04-18T14:43:56.976 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:56.976 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:56.976 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T14:43:56.976 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:40.766300+0000", 2024-04-18T14:43:56.976 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2164e-05 2024-04-18T14:43:56.976 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:56.976 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:56.976 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T14:43:56.976 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:40.766368+0000", 2024-04-18T14:43:56.976 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.8492999999999996e-05 2024-04-18T14:43:56.976 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:56.976 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:56.976 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_started", 2024-04-18T14:43:56.976 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:40.766379+0000", 2024-04-18T14:43:56.976 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0957e-05 2024-04-18T14:43:56.976 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:56.977 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:56.977 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_committed", 2024-04-18T14:43:56.977 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:40.771183+0000", 2024-04-18T14:43:56.977 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0048041550000000001 2024-04-18T14:43:56.977 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:56.977 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:56.977 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T14:43:56.977 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:40.771246+0000", 2024-04-18T14:43:56.977 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.3151999999999994e-05 2024-04-18T14:43:56.977 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:43:56.977 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T14:43:56.977 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:43:56.977 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:56.977 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:56.977 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "pg_update_log_missing(3.9s4 epoch 41/30 rep_tid 40 entries 41'25 (0'0) error 3:936e42fd:::smithi13430248-33:head by client.4559.0:247 0.000000 0 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 38'23)", 2024-04-18T14:43:56.978 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T14:43:40.767532+0000", 2024-04-18T14:43:56.978 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 16.203751492999999, 2024-04-18T14:43:56.978 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0052167969999999996, 2024-04-18T14:43:56.978 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T14:43:56.978 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-04-18T14:43:56.978 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T14:43:56.978 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:56.978 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T14:43:56.978 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:40.767532+0000", 2024-04-18T14:43:56.978 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:43:56.978 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:56.978 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:56.978 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T14:43:56.978 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:40.767532+0000", 2024-04-18T14:43:56.978 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:43:56.979 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:56.979 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:56.979 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T14:43:56.979 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:40.767532+0000", 2024-04-18T14:43:56.979 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-04-18T14:43:56.979 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:56.979 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:56.979 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T14:43:56.979 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:40.767547+0000", 2024-04-18T14:43:56.979 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5007e-05 2024-04-18T14:43:56.979 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:56.979 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:56.979 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T14:43:56.979 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:40.767560+0000", 2024-04-18T14:43:56.979 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3550000000000001e-05 2024-04-18T14:43:56.980 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:56.980 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:56.980 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T14:43:56.980 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:40.767572+0000", 2024-04-18T14:43:56.980 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1507e-05 2024-04-18T14:43:56.980 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:56.980 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:56.980 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T14:43:56.980 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:40.767739+0000", 2024-04-18T14:43:56.980 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000166997 2024-04-18T14:43:56.980 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:56.980 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:56.980 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T14:43:56.980 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:40.772749+0000", 2024-04-18T14:43:56.980 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0050099749999999998 2024-04-18T14:43:56.980 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:43:56.981 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T14:43:56.981 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:43:56.981 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:56.981 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:56.981 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "MOSDECSubOpWrite(3.9s4 41/30 ECSubWrite(tid=42, reqid=osd.12.0:41, at_version=0'0, trim_to=0'0, roll_forward_to=41'27))", 2024-04-18T14:43:56.981 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T14:43:40.779760+0000", 2024-04-18T14:43:56.981 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 16.19152369, 2024-04-18T14:43:56.981 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.004685959, 2024-04-18T14:43:56.981 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T14:43:56.981 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-04-18T14:43:56.981 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T14:43:56.981 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:56.981 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T14:43:56.981 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:40.779760+0000", 2024-04-18T14:43:56.981 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:43:56.982 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:56.982 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:56.982 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T14:43:56.982 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:40.779760+0000", 2024-04-18T14:43:56.982 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:43:56.982 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:56.982 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:56.982 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T14:43:56.982 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:40.779758+0000", 2024-04-18T14:43:56.982 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999986 2024-04-18T14:43:56.982 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:56.982 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:56.982 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T14:43:56.982 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:40.779785+0000", 2024-04-18T14:43:56.983 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.6480999999999999e-05 2024-04-18T14:43:56.983 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:56.983 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:56.983 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T14:43:56.983 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:40.779812+0000", 2024-04-18T14:43:56.983 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.7093e-05 2024-04-18T14:43:56.983 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:56.983 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:56.983 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T14:43:56.983 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:40.779835+0000", 2024-04-18T14:43:56.983 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2915e-05 2024-04-18T14:43:56.983 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:56.983 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:56.983 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T14:43:56.983 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:40.779901+0000", 2024-04-18T14:43:56.983 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.5668999999999998e-05 2024-04-18T14:43:56.984 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:56.984 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:56.984 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_started", 2024-04-18T14:43:56.984 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:40.779912+0000", 2024-04-18T14:43:56.984 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1620000000000001e-05 2024-04-18T14:43:56.984 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:56.984 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:56.984 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_committed", 2024-04-18T14:43:56.984 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:40.784381+0000", 2024-04-18T14:43:56.984 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0044684420000000004 2024-04-18T14:43:56.984 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:56.984 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:56.984 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T14:43:56.984 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:40.784446+0000", 2024-04-18T14:43:56.984 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.5139000000000001e-05 2024-04-18T14:43:56.985 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:43:56.985 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T14:43:56.985 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:43:56.985 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:56.985 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:56.985 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "MOSDECSubOpWrite(3.8s5 41/30 ECSubWrite(tid=38, reqid=osd.5.0:36, at_version=0'0, trim_to=0'0, roll_forward_to=41'20))", 2024-04-18T14:43:56.985 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T14:43:40.780111+0000", 2024-04-18T14:43:56.985 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 16.191172379000001, 2024-04-18T14:43:56.985 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0064127400000000001, 2024-04-18T14:43:56.985 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T14:43:56.985 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-04-18T14:43:56.985 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T14:43:56.985 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:56.985 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T14:43:56.985 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:40.780111+0000", 2024-04-18T14:43:56.986 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:43:56.986 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:56.986 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:56.986 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T14:43:56.986 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:40.780111+0000", 2024-04-18T14:43:56.986 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:43:56.986 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:56.986 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:56.986 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T14:43:56.986 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:40.780109+0000", 2024-04-18T14:43:56.986 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999986 2024-04-18T14:43:56.986 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:56.986 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:56.987 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T14:43:56.987 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:40.780138+0000", 2024-04-18T14:43:56.987 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.9023999999999999e-05 2024-04-18T14:43:56.987 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:56.987 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:56.987 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T14:43:56.987 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:40.780168+0000", 2024-04-18T14:43:56.987 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.9420999999999998e-05 2024-04-18T14:43:56.987 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:56.987 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:56.987 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T14:43:56.987 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:40.780194+0000", 2024-04-18T14:43:56.988 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.5667e-05 2024-04-18T14:43:56.988 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:56.988 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:56.988 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T14:43:56.988 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:40.780358+0000", 2024-04-18T14:43:56.988 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00016448999999999999 2024-04-18T14:43:56.988 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:56.988 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:56.988 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_started", 2024-04-18T14:43:56.988 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:40.780382+0000", 2024-04-18T14:43:56.988 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.3971000000000001e-05 2024-04-18T14:43:56.988 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:56.988 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:56.988 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_committed", 2024-04-18T14:43:56.988 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:40.786461+0000", 2024-04-18T14:43:56.989 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0060789770000000002 2024-04-18T14:43:56.989 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:56.989 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:56.989 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T14:43:56.989 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:40.786524+0000", 2024-04-18T14:43:56.989 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.2849999999999996e-05 2024-04-18T14:43:56.989 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:43:56.989 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T14:43:56.989 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:43:56.989 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:56.989 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:56.989 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "MOSDECSubOpWrite(3.6s3 45/30 ECSubWrite(tid=62, reqid=client.4559.0:310, at_version=45'19, trim_to=0'0, roll_forward_to=44'17))", 2024-04-18T14:43:56.989 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T14:43:44.540402+0000", 2024-04-18T14:43:56.989 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 12.430881025, 2024-04-18T14:43:56.989 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0052114240000000001, 2024-04-18T14:43:56.990 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T14:43:56.990 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-04-18T14:43:56.990 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T14:43:56.990 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:56.990 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T14:43:56.990 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:44.540402+0000", 2024-04-18T14:43:56.990 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:43:56.990 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:56.990 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:56.990 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T14:43:56.990 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:44.540402+0000", 2024-04-18T14:43:56.990 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:43:56.990 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:56.990 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:56.990 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T14:43:56.991 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:44.540400+0000", 2024-04-18T14:43:56.991 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999976 2024-04-18T14:43:56.991 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:56.991 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:56.991 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T14:43:56.991 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:44.541015+0000", 2024-04-18T14:43:56.991 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00061501500000000001 2024-04-18T14:43:56.991 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:56.991 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:56.991 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T14:43:56.991 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:44.541057+0000", 2024-04-18T14:43:56.991 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.2160999999999998e-05 2024-04-18T14:43:56.991 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:56.991 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:56.991 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T14:43:56.991 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:44.541083+0000", 2024-04-18T14:43:56.992 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.5627e-05 2024-04-18T14:43:56.992 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:56.992 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:56.992 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T14:43:56.992 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:44.541233+0000", 2024-04-18T14:43:56.992 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000150369 2024-04-18T14:43:56.992 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:56.992 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:56.992 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_started", 2024-04-18T14:43:56.992 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:44.541253+0000", 2024-04-18T14:43:56.992 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.9916999999999999e-05 2024-04-18T14:43:56.992 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:56.992 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:56.992 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_committed", 2024-04-18T14:43:56.992 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:44.545557+0000", 2024-04-18T14:43:56.993 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0043033300000000002 2024-04-18T14:43:56.993 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:56.993 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:56.993 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T14:43:56.993 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:44.545614+0000", 2024-04-18T14:43:56.993 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.7364999999999997e-05 2024-04-18T14:43:56.993 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:43:56.993 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T14:43:56.993 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:43:56.993 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:56.993 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:56.993 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "MOSDECSubOpWrite(3.2s4 45/30 ECSubWrite(tid=185, reqid=client.4559.0:314, at_version=45'6, trim_to=0'0, roll_forward_to=33'4))", 2024-04-18T14:43:56.993 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T14:43:44.562601+0000", 2024-04-18T14:43:56.993 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 12.408682871, 2024-04-18T14:43:56.993 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0049608990000000004, 2024-04-18T14:43:56.993 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T14:43:56.994 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-04-18T14:43:56.994 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T14:43:56.994 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:56.994 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T14:43:56.994 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:44.562601+0000", 2024-04-18T14:43:56.994 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:43:56.994 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:56.994 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:56.994 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T14:43:56.994 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:44.562601+0000", 2024-04-18T14:43:56.994 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:43:56.994 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:56.994 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:56.994 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T14:43:56.994 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:44.562599+0000", 2024-04-18T14:43:56.995 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999981 2024-04-18T14:43:56.995 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:56.995 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:56.995 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T14:43:56.995 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:44.563609+0000", 2024-04-18T14:43:56.995 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.001009872 2024-04-18T14:43:56.995 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:56.995 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:56.995 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T14:43:56.995 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:44.563649+0000", 2024-04-18T14:43:56.995 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.9878e-05 2024-04-18T14:43:56.995 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:56.995 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:56.995 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T14:43:56.996 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:44.563674+0000", 2024-04-18T14:43:56.996 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.5914e-05 2024-04-18T14:43:56.996 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:56.996 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:56.996 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T14:43:56.996 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:44.563831+0000", 2024-04-18T14:43:56.996 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000156195 2024-04-18T14:43:56.996 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:56.996 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:56.996 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_started", 2024-04-18T14:43:56.996 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:44.563846+0000", 2024-04-18T14:43:56.996 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5108e-05 2024-04-18T14:43:56.996 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:56.996 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:56.996 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_committed", 2024-04-18T14:43:56.997 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:44.567508+0000", 2024-04-18T14:43:56.997 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.003662261 2024-04-18T14:43:56.997 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:56.997 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:56.997 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T14:43:56.997 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:44.567561+0000", 2024-04-18T14:43:56.997 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.3454e-05 2024-04-18T14:43:56.997 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:43:56.997 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T14:43:56.997 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:43:56.997 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:56.998 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:56.998 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "MOSDECSubOpWrite(3.2s4 45/30 ECSubWrite(tid=186, reqid=client.4559.0:315, at_version=45'7, trim_to=0'0, roll_forward_to=33'4))", 2024-04-18T14:43:56.998 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T14:43:44.564886+0000", 2024-04-18T14:43:56.998 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 12.406397632999999, 2024-04-18T14:43:56.998 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0044925269999999996, 2024-04-18T14:43:56.998 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T14:43:56.998 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-04-18T14:43:56.998 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T14:43:56.998 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:56.998 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T14:43:56.998 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:44.564886+0000", 2024-04-18T14:43:56.998 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:43:56.998 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:56.998 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:56.999 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T14:43:56.999 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:44.564886+0000", 2024-04-18T14:43:56.999 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:43:56.999 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:56.999 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:56.999 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T14:43:56.999 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:44.564880+0000", 2024-04-18T14:43:56.999 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999938 2024-04-18T14:43:56.999 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:56.999 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:56.999 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T14:43:56.999 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:44.565031+0000", 2024-04-18T14:43:56.999 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00015119299999999999 2024-04-18T14:43:56.999 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:56.999 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:57.000 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T14:43:57.000 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:44.565063+0000", 2024-04-18T14:43:57.000 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.2653000000000001e-05 2024-04-18T14:43:57.000 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:57.000 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:57.000 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T14:43:57.000 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:44.565083+0000", 2024-04-18T14:43:57.000 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.9585e-05 2024-04-18T14:43:57.000 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:57.000 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:57.000 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T14:43:57.000 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:44.565292+0000", 2024-04-18T14:43:57.000 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00020939 2024-04-18T14:43:57.000 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:57.000 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:57.001 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_started", 2024-04-18T14:43:57.001 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:44.565318+0000", 2024-04-18T14:43:57.001 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.5644e-05 2024-04-18T14:43:57.001 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:57.001 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:57.001 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_committed", 2024-04-18T14:43:57.001 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:44.569349+0000", 2024-04-18T14:43:57.001 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0040305360000000004 2024-04-18T14:43:57.001 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:57.001 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:57.001 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T14:43:57.001 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:44.569378+0000", 2024-04-18T14:43:57.001 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.9733000000000001e-05 2024-04-18T14:43:57.001 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:43:57.001 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T14:43:57.002 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:43:57.002 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:57.002 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:57.002 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "MOSDECSubOpWrite(3.2s4 46/30 ECSubWrite(tid=190, reqid=osd.13.0:190, at_version=46'10, trim_to=0'0, roll_forward_to=45'8))", 2024-04-18T14:43:57.002 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T14:43:45.385369+0000", 2024-04-18T14:43:57.002 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 11.585914256000001, 2024-04-18T14:43:57.002 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0048552969999999997, 2024-04-18T14:43:57.002 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T14:43:57.002 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-04-18T14:43:57.002 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T14:43:57.002 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:57.002 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T14:43:57.002 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:45.385369+0000", 2024-04-18T14:43:57.002 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:43:57.002 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:57.003 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:57.003 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T14:43:57.003 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:45.385369+0000", 2024-04-18T14:43:57.003 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:43:57.003 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:57.003 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:57.003 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T14:43:57.003 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:45.385368+0000", 2024-04-18T14:43:57.003 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-18T14:43:57.003 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:57.003 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:57.003 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T14:43:57.003 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:45.385402+0000", 2024-04-18T14:43:57.003 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.3714999999999998e-05 2024-04-18T14:43:57.003 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:57.004 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:57.004 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T14:43:57.004 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:45.385420+0000", 2024-04-18T14:43:57.004 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8227999999999999e-05 2024-04-18T14:43:57.004 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:57.004 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:57.004 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T14:43:57.004 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:45.386245+0000", 2024-04-18T14:43:57.004 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00082529299999999995 2024-04-18T14:43:57.004 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:57.004 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:57.004 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T14:43:57.004 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:45.386332+0000", 2024-04-18T14:43:57.004 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.6428000000000007e-05 2024-04-18T14:43:57.005 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:57.005 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:57.005 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_started", 2024-04-18T14:43:57.005 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:45.386347+0000", 2024-04-18T14:43:57.005 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5092000000000001e-05 2024-04-18T14:43:57.005 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:57.005 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:57.005 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_committed", 2024-04-18T14:43:57.005 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:45.390189+0000", 2024-04-18T14:43:57.005 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0038416819999999999 2024-04-18T14:43:57.005 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:57.005 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:57.005 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T14:43:57.005 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:45.390225+0000", 2024-04-18T14:43:57.006 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.5896000000000003e-05 2024-04-18T14:43:57.006 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:43:57.006 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T14:43:57.006 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:43:57.006 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:57.006 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:57.006 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "MOSDECSubOpWrite(3.6s3 46/30 ECSubWrite(tid=67, reqid=osd.14.0:67, at_version=46'23, trim_to=0'0, roll_forward_to=45'21))", 2024-04-18T14:43:57.006 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T14:43:45.386856+0000", 2024-04-18T14:43:57.006 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 11.584427173, 2024-04-18T14:43:57.006 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0044209549999999999, 2024-04-18T14:43:57.006 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T14:43:57.006 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-04-18T14:43:57.006 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T14:43:57.006 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:57.007 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T14:43:57.007 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:45.386856+0000", 2024-04-18T14:43:57.007 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:43:57.007 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:57.007 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:57.007 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T14:43:57.007 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:45.386856+0000", 2024-04-18T14:43:57.007 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:43:57.007 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:57.007 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:57.007 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T14:43:57.007 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:45.386855+0000", 2024-04-18T14:43:57.007 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999986 2024-04-18T14:43:57.007 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:57.007 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:57.008 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T14:43:57.008 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:45.386888+0000", 2024-04-18T14:43:57.008 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.3191999999999997e-05 2024-04-18T14:43:57.008 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:57.008 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:57.008 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T14:43:57.008 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:45.386915+0000", 2024-04-18T14:43:57.008 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.6585999999999999e-05 2024-04-18T14:43:57.008 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:57.008 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:57.008 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T14:43:57.008 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:45.386928+0000", 2024-04-18T14:43:57.008 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3593e-05 2024-04-18T14:43:57.008 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:57.008 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:57.008 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T14:43:57.009 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:45.387013+0000", 2024-04-18T14:43:57.009 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.4421999999999999e-05 2024-04-18T14:43:57.009 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:57.009 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:57.009 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_started", 2024-04-18T14:43:57.009 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:45.387028+0000", 2024-04-18T14:43:57.009 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.4987000000000001e-05 2024-04-18T14:43:57.009 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:57.009 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:57.009 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_committed", 2024-04-18T14:43:57.009 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:45.391216+0000", 2024-04-18T14:43:57.009 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.004188537 2024-04-18T14:43:57.009 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:57.009 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:57.010 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T14:43:57.010 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:45.391277+0000", 2024-04-18T14:43:57.010 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.1204000000000006e-05 2024-04-18T14:43:57.010 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:43:57.010 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T14:43:57.010 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:43:57.010 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:57.010 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:57.010 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "MOSDECSubOpWrite(3.9s4 46/30 ECSubWrite(tid=58, reqid=osd.12.0:58, at_version=46'44, trim_to=0'0, roll_forward_to=45'42))", 2024-04-18T14:43:57.010 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T14:43:45.386883+0000", 2024-04-18T14:43:57.010 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 11.584400258000001, 2024-04-18T14:43:57.010 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0043507759999999998, 2024-04-18T14:43:57.010 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T14:43:57.010 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-04-18T14:43:57.010 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T14:43:57.011 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:57.011 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T14:43:57.011 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:45.386883+0000", 2024-04-18T14:43:57.011 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:43:57.011 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:57.011 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:57.011 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T14:43:57.011 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:45.386883+0000", 2024-04-18T14:43:57.011 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:43:57.011 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:57.011 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:57.011 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T14:43:57.011 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:45.386882+0000", 2024-04-18T14:43:57.011 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-18T14:43:57.011 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:57.012 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:57.012 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T14:43:57.012 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:45.386933+0000", 2024-04-18T14:43:57.012 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.0890999999999998e-05 2024-04-18T14:43:57.012 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:57.012 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:57.012 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T14:43:57.012 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:45.386965+0000", 2024-04-18T14:43:57.012 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.2217e-05 2024-04-18T14:43:57.012 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:57.012 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:57.012 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T14:43:57.012 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:45.386988+0000", 2024-04-18T14:43:57.012 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2484e-05 2024-04-18T14:43:57.013 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:57.013 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:57.013 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T14:43:57.013 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:45.387135+0000", 2024-04-18T14:43:57.013 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000147412 2024-04-18T14:43:57.013 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:57.013 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:57.013 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_started", 2024-04-18T14:43:57.013 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:45.387161+0000", 2024-04-18T14:43:57.013 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.5414000000000001e-05 2024-04-18T14:43:57.013 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:57.013 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:57.013 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_committed", 2024-04-18T14:43:57.013 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:45.391162+0000", 2024-04-18T14:43:57.013 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00400177 2024-04-18T14:43:57.014 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:57.014 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:57.014 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T14:43:57.014 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:45.391234+0000", 2024-04-18T14:43:57.014 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.1598000000000001e-05 2024-04-18T14:43:57.014 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:43:57.014 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T14:43:57.014 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:43:57.014 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:57.014 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:57.014 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "MOSDECSubOpWrite(3.8s5 46/30 ECSubWrite(tid=60, reqid=osd.5.0:59, at_version=0'0, trim_to=0'0, roll_forward_to=46'44))", 2024-04-18T14:43:57.014 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T14:43:45.387113+0000", 2024-04-18T14:43:57.014 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 11.584170594, 2024-04-18T14:43:57.014 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0047249730000000004, 2024-04-18T14:43:57.014 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T14:43:57.015 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-04-18T14:43:57.015 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T14:43:57.015 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:57.015 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T14:43:57.015 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:45.387113+0000", 2024-04-18T14:43:57.015 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:43:57.015 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:57.015 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:57.015 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T14:43:57.015 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:45.387113+0000", 2024-04-18T14:43:57.015 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:43:57.015 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:57.015 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:57.015 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T14:43:57.015 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:45.387111+0000", 2024-04-18T14:43:57.016 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999981 2024-04-18T14:43:57.016 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:57.016 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:57.016 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T14:43:57.016 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:45.387142+0000", 2024-04-18T14:43:57.016 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.1327e-05 2024-04-18T14:43:57.016 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:57.016 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:57.016 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T14:43:57.016 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:45.387172+0000", 2024-04-18T14:43:57.016 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.9774e-05 2024-04-18T14:43:57.016 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:57.016 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:57.016 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T14:43:57.016 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:45.387193+0000", 2024-04-18T14:43:57.017 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.1284000000000002e-05 2024-04-18T14:43:57.017 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:57.017 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:57.017 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T14:43:57.017 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:45.387267+0000", 2024-04-18T14:43:57.017 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.3269000000000006e-05 2024-04-18T14:43:57.017 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:57.017 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:57.017 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_started", 2024-04-18T14:43:57.017 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:45.387274+0000", 2024-04-18T14:43:57.017 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.6149999999999999e-06 2024-04-18T14:43:57.017 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:57.017 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:57.017 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_committed", 2024-04-18T14:43:57.017 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:45.391666+0000", 2024-04-18T14:43:57.017 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0043920340000000004 2024-04-18T14:43:57.018 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:57.018 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:57.018 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T14:43:57.018 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:45.391838+0000", 2024-04-18T14:43:57.018 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00017148 2024-04-18T14:43:57.018 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:43:57.018 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T14:43:57.018 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:43:57.018 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:57.018 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:57.018 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4559.0:326 3.5s0 3:ae89639c:::smithi13430248-39:head [copy-from ver 42] snapc f=[f,b,a,8,7,2] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-04-18T14:43:57.018 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T14:43:46.376277+0000", 2024-04-18T14:43:57.018 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 10.595006035000001, 2024-04-18T14:43:57.018 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.025187043999999999, 2024-04-18T14:43:57.018 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T14:43:57.019 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T14:43:57.019 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-18T14:43:57.019 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4559", 2024-04-18T14:43:57.019 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/3113589487", 2024-04-18T14:43:57.019 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 326 2024-04-18T14:43:57.019 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:57.019 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T14:43:57.019 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:57.019 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T14:43:57.019 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:46.376277+0000", 2024-04-18T14:43:57.019 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:43:57.019 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:57.019 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:57.019 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T14:43:57.019 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:46.376277+0000", 2024-04-18T14:43:57.020 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:43:57.020 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:57.020 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:57.020 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T14:43:57.020 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:46.376274+0000", 2024-04-18T14:43:57.020 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999967 2024-04-18T14:43:57.020 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:57.020 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:57.020 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T14:43:57.020 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:46.376290+0000", 2024-04-18T14:43:57.020 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5639999999999999e-05 2024-04-18T14:43:57.020 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:57.020 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:57.020 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T14:43:57.020 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:46.376350+0000", 2024-04-18T14:43:57.020 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.0446999999999999e-05 2024-04-18T14:43:57.021 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:57.021 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:57.021 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T14:43:57.021 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:46.376368+0000", 2024-04-18T14:43:57.021 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.7677e-05 2024-04-18T14:43:57.021 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:57.021 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:57.021 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T14:43:57.021 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:46.376519+0000", 2024-04-18T14:43:57.021 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00015141300000000001 2024-04-18T14:43:57.021 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:57.021 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:57.021 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op must wait for map", 2024-04-18T14:43:57.021 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:46.376542+0000", 2024-04-18T14:43:57.021 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2833999999999999e-05 2024-04-18T14:43:57.022 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:57.022 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:57.022 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T14:43:57.022 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:46.380859+0000", 2024-04-18T14:43:57.022 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0043166309999999996 2024-04-18T14:43:57.022 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:57.022 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:57.022 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T14:43:57.022 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:46.381129+0000", 2024-04-18T14:43:57.022 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00027035200000000002 2024-04-18T14:43:57.022 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:57.022 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:57.022 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_started", 2024-04-18T14:43:57.022 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:46.394910+0000", 2024-04-18T14:43:57.023 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.013780621 2024-04-18T14:43:57.023 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:57.023 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:57.023 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_committed", 2024-04-18T14:43:57.023 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:46.398694+0000", 2024-04-18T14:43:57.023 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0037836419999999998 2024-04-18T14:43:57.023 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:57.023 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:57.023 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T14:43:57.023 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:46.401340+0000", 2024-04-18T14:43:57.023 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0026460899999999998 2024-04-18T14:43:57.023 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:57.023 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:57.023 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T14:43:57.023 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:46.401464+0000", 2024-04-18T14:43:57.024 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000124867 2024-04-18T14:43:57.024 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:43:57.024 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T14:43:57.024 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:43:57.024 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:57.024 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:57.024 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4559.0:327 3.5s0 3:ae89639c:::smithi13430248-39:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e47)", 2024-04-18T14:43:57.024 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T14:43:46.376390+0000", 2024-04-18T14:43:57.024 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 10.594893297, 2024-04-18T14:43:57.024 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.022295908999999999, 2024-04-18T14:43:57.024 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T14:43:57.024 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-04-18T14:43:57.024 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-18T14:43:57.024 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4559", 2024-04-18T14:43:57.024 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/3113589487", 2024-04-18T14:43:57.025 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 327 2024-04-18T14:43:57.025 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:57.025 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T14:43:57.025 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:57.025 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T14:43:57.025 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:46.376390+0000", 2024-04-18T14:43:57.025 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:43:57.025 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:57.025 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:57.025 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T14:43:57.025 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:46.376390+0000", 2024-04-18T14:43:57.025 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:43:57.025 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:57.025 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:57.025 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T14:43:57.025 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:46.376389+0000", 2024-04-18T14:43:57.026 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-18T14:43:57.026 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:57.026 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:57.026 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T14:43:57.026 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:46.376394+0000", 2024-04-18T14:43:57.026 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.3639999999999998e-06 2024-04-18T14:43:57.026 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:57.026 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:57.026 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T14:43:57.026 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:46.376406+0000", 2024-04-18T14:43:57.026 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2055999999999999e-05 2024-04-18T14:43:57.026 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:57.026 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:57.026 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T14:43:57.026 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:46.376417+0000", 2024-04-18T14:43:57.027 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0847e-05 2024-04-18T14:43:57.027 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:57.027 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:57.027 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T14:43:57.027 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:46.376676+0000", 2024-04-18T14:43:57.027 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00025870199999999998 2024-04-18T14:43:57.027 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:57.027 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:57.027 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting_for_map not empty", 2024-04-18T14:43:57.027 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:46.376688+0000", 2024-04-18T14:43:57.027 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1783000000000001e-05 2024-04-18T14:43:57.027 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:57.027 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:57.027 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T14:43:57.027 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:46.381511+0000", 2024-04-18T14:43:57.028 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0048235259999999999 2024-04-18T14:43:57.028 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:57.028 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:57.028 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for blocked object", 2024-04-18T14:43:57.028 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:46.381560+0000", 2024-04-18T14:43:57.028 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.9070999999999998e-05 2024-04-18T14:43:57.028 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:57.028 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:57.028 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T14:43:57.028 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:46.397940+0000", 2024-04-18T14:43:57.028 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.016379946999999999 2024-04-18T14:43:57.028 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:57.028 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:57.028 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T14:43:57.028 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:46.398249+0000", 2024-04-18T14:43:57.028 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00030838799999999999 2024-04-18T14:43:57.029 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:57.029 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:57.029 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T14:43:57.029 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:46.398686+0000", 2024-04-18T14:43:57.029 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00043738499999999999 2024-04-18T14:43:57.029 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:43:57.029 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T14:43:57.029 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:43:57.029 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:57.029 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:57.029 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "MOSDECSubOpWrite(3.6s3 51/30 ECSubWrite(tid=86, reqid=client.4559.0:359, at_version=51'36, trim_to=0'0, roll_forward_to=50'34))", 2024-04-18T14:43:57.029 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T14:43:50.378480+0000", 2024-04-18T14:43:57.029 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 6.5928036389999995, 2024-04-18T14:43:57.029 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0085450260000000007, 2024-04-18T14:43:57.029 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T14:43:57.030 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-04-18T14:43:57.030 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T14:43:57.030 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:57.030 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T14:43:57.030 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:50.378480+0000", 2024-04-18T14:43:57.030 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:43:57.030 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:57.030 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:57.030 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T14:43:57.030 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:50.378480+0000", 2024-04-18T14:43:57.030 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:43:57.030 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:57.030 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:57.030 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T14:43:57.031 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:50.378479+0000", 2024-04-18T14:43:57.031 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-04-18T14:43:57.031 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:57.031 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:57.031 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T14:43:57.033 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:50.378586+0000", 2024-04-18T14:43:57.034 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00010688600000000001 2024-04-18T14:43:57.034 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:57.034 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:57.034 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T14:43:57.034 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:50.378616+0000", 2024-04-18T14:43:57.034 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.0239999999999998e-05 2024-04-18T14:43:57.034 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:57.034 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:57.034 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T14:43:57.034 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:50.378638+0000", 2024-04-18T14:43:57.034 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.1654e-05 2024-04-18T14:43:57.034 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:57.034 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:57.035 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T14:43:57.035 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:50.378822+0000", 2024-04-18T14:43:57.035 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00018378900000000001 2024-04-18T14:43:57.035 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:57.035 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:57.035 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_started", 2024-04-18T14:43:57.035 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:50.378846+0000", 2024-04-18T14:43:57.035 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.3680999999999999e-05 2024-04-18T14:43:57.035 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:57.035 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:57.035 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_committed", 2024-04-18T14:43:57.035 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:50.386988+0000", 2024-04-18T14:43:57.035 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0081421459999999994 2024-04-18T14:43:57.036 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:57.036 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:57.036 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T14:43:57.036 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:50.387025+0000", 2024-04-18T14:43:57.036 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.7137e-05 2024-04-18T14:43:57.036 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:43:57.036 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T14:43:57.036 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:43:57.036 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:57.036 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:57.036 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "MOSDECSubOpWrite(3.6s3 51/30 ECSubWrite(tid=89, reqid=client.4559.0:360, at_version=51'37, trim_to=0'0, roll_forward_to=50'34))", 2024-04-18T14:43:57.036 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T14:43:50.382332+0000", 2024-04-18T14:43:57.036 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 6.588951647, 2024-04-18T14:43:57.036 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0047118769999999997, 2024-04-18T14:43:57.036 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T14:43:57.037 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-04-18T14:43:57.037 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T14:43:57.037 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:57.037 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T14:43:57.037 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:50.382332+0000", 2024-04-18T14:43:57.037 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:43:57.037 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:57.037 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:57.037 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T14:43:57.037 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:50.382332+0000", 2024-04-18T14:43:57.037 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:43:57.037 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:57.037 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:57.037 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T14:43:57.038 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:50.382330+0000", 2024-04-18T14:43:57.038 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999981 2024-04-18T14:43:57.038 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:57.038 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:57.038 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T14:43:57.038 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:50.382385+0000", 2024-04-18T14:43:57.038 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.5387999999999999e-05 2024-04-18T14:43:57.038 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:57.038 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:57.038 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T14:43:57.038 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:50.382418+0000", 2024-04-18T14:43:57.038 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.2892999999999998e-05 2024-04-18T14:43:57.038 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:57.039 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:57.039 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T14:43:57.039 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:50.382439+0000", 2024-04-18T14:43:57.039 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.1308e-05 2024-04-18T14:43:57.039 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:57.039 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:57.039 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T14:43:57.039 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:50.382751+0000", 2024-04-18T14:43:57.039 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00031188400000000001 2024-04-18T14:43:57.039 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:57.039 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:57.039 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_started", 2024-04-18T14:43:57.039 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:50.382778+0000", 2024-04-18T14:43:57.039 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.6474000000000001e-05 2024-04-18T14:43:57.040 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:57.040 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:57.040 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_committed", 2024-04-18T14:43:57.040 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:50.387031+0000", 2024-04-18T14:43:57.040 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0042533459999999999 2024-04-18T14:43:57.040 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:57.040 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:57.040 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T14:43:57.040 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:50.387044+0000", 2024-04-18T14:43:57.040 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2677000000000001e-05 2024-04-18T14:43:57.040 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:43:57.040 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T14:43:57.040 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:43:57.040 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:57.040 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:57.041 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "MOSDECSubOpWrite(3.6s3 51/30 ECSubWrite(tid=90, reqid=client.4559.0:361, at_version=51'38, trim_to=0'0, roll_forward_to=50'34))", 2024-04-18T14:43:57.041 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T14:43:50.382492+0000", 2024-04-18T14:43:57.041 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 6.5887910539999996, 2024-04-18T14:43:57.041 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0045602840000000004, 2024-04-18T14:43:57.041 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T14:43:57.041 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-04-18T14:43:57.041 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T14:43:57.041 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:57.041 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T14:43:57.041 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:50.382492+0000", 2024-04-18T14:43:57.041 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:43:57.041 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:57.041 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:57.041 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T14:43:57.041 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:50.382492+0000", 2024-04-18T14:43:57.042 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:43:57.042 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:57.042 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:57.042 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T14:43:57.042 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:50.382491+0000", 2024-04-18T14:43:57.042 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-18T14:43:57.042 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:57.042 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:57.042 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T14:43:57.042 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:50.382536+0000", 2024-04-18T14:43:57.042 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.4257e-05 2024-04-18T14:43:57.042 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:57.042 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:57.042 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T14:43:57.043 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:50.382559+0000", 2024-04-18T14:43:57.043 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.3611000000000001e-05 2024-04-18T14:43:57.043 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:57.043 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:57.043 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T14:43:57.043 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:50.382578+0000", 2024-04-18T14:43:57.043 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.9089999999999998e-05 2024-04-18T14:43:57.043 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:57.043 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:57.043 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T14:43:57.043 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:50.383585+0000", 2024-04-18T14:43:57.043 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0010065250000000001 2024-04-18T14:43:57.043 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:57.043 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:57.043 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_started", 2024-04-18T14:43:57.044 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:50.383610+0000", 2024-04-18T14:43:57.044 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.5364e-05 2024-04-18T14:43:57.044 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:57.044 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:57.044 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_committed", 2024-04-18T14:43:57.044 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:50.387046+0000", 2024-04-18T14:43:57.044 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0034356970000000001 2024-04-18T14:43:57.044 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:57.044 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:57.044 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T14:43:57.044 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:50.387053+0000", 2024-04-18T14:43:57.044 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.8900000000000001e-06 2024-04-18T14:43:57.044 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:43:57.044 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T14:43:57.044 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:43:57.045 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:57.045 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:57.045 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "MOSDECSubOpWrite(3.as5 51/30 ECSubWrite(tid=39, reqid=client.4559.0:363, at_version=51'28, trim_to=0'0, roll_forward_to=44'25))", 2024-04-18T14:43:57.045 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T14:43:50.387163+0000", 2024-04-18T14:43:57.045 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 6.5841201910000002, 2024-04-18T14:43:57.045 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0042395360000000003, 2024-04-18T14:43:57.045 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T14:43:57.045 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-04-18T14:43:57.045 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T14:43:57.045 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:57.045 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T14:43:57.045 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:50.387163+0000", 2024-04-18T14:43:57.045 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:43:57.045 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:57.045 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:57.045 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T14:43:57.046 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:50.387163+0000", 2024-04-18T14:43:57.046 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:43:57.046 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:57.046 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:57.046 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T14:43:57.046 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:50.387162+0000", 2024-04-18T14:43:57.046 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-18T14:43:57.046 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:57.046 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:57.047 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T14:43:57.047 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:50.387184+0000", 2024-04-18T14:43:57.047 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.1812999999999999e-05 2024-04-18T14:43:57.047 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:57.047 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:57.047 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T14:43:57.047 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:50.387202+0000", 2024-04-18T14:43:57.047 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.7448999999999998e-05 2024-04-18T14:43:57.047 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:57.047 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:57.047 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T14:43:57.047 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:50.387211+0000", 2024-04-18T14:43:57.047 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.2590000000000006e-06 2024-04-18T14:43:57.047 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:57.047 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:57.048 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T14:43:57.048 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:50.387334+0000", 2024-04-18T14:43:57.048 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000123113 2024-04-18T14:43:57.048 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:57.048 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:57.048 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_started", 2024-04-18T14:43:57.048 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:50.387387+0000", 2024-04-18T14:43:57.048 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.3294000000000002e-05 2024-04-18T14:43:57.048 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:57.048 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:57.048 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_committed", 2024-04-18T14:43:57.048 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:50.391340+0000", 2024-04-18T14:43:57.048 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0039526099999999996 2024-04-18T14:43:57.048 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:57.048 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:57.049 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T14:43:57.049 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:50.391403+0000", 2024-04-18T14:43:57.049 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.2914000000000001e-05 2024-04-18T14:43:57.049 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:43:57.049 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T14:43:57.049 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:43:57.049 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:57.049 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:57.049 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "MOSDECSubOpWrite(3.6s3 51/30 ECSubWrite(tid=93, reqid=client.4559.0:361, at_version=0'0, trim_to=0'0, roll_forward_to=51'38))", 2024-04-18T14:43:57.049 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T14:43:50.389430+0000", 2024-04-18T14:43:57.049 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 6.5818534849999999, 2024-04-18T14:43:57.049 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0046555279999999999, 2024-04-18T14:43:57.049 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T14:43:57.049 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-04-18T14:43:57.049 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T14:43:57.050 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:57.050 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T14:43:57.050 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:50.389430+0000", 2024-04-18T14:43:57.050 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:43:57.050 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:57.050 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:57.050 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T14:43:57.050 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:50.389430+0000", 2024-04-18T14:43:57.050 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:43:57.050 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:57.050 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:57.050 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T14:43:57.050 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:50.389429+0000", 2024-04-18T14:43:57.050 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-18T14:43:57.051 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:57.051 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:57.051 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T14:43:57.051 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:50.389443+0000", 2024-04-18T14:43:57.051 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.4163e-05 2024-04-18T14:43:57.051 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:57.051 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:57.051 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T14:43:57.051 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:50.389461+0000", 2024-04-18T14:43:57.051 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.7638999999999998e-05 2024-04-18T14:43:57.051 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:57.051 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:57.051 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T14:43:57.051 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:50.389472+0000", 2024-04-18T14:43:57.052 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0902e-05 2024-04-18T14:43:57.052 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:57.052 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:57.052 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T14:43:57.052 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:50.389521+0000", 2024-04-18T14:43:57.052 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.9217e-05 2024-04-18T14:43:57.052 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:57.052 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:57.052 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_started", 2024-04-18T14:43:57.052 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:50.389528+0000", 2024-04-18T14:43:57.052 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.1189999999999999e-06 2024-04-18T14:43:57.052 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:57.052 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:57.052 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_committed", 2024-04-18T14:43:57.052 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:50.394057+0000", 2024-04-18T14:43:57.053 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0045288400000000001 2024-04-18T14:43:57.053 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:57.053 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:57.053 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T14:43:57.053 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:50.394086+0000", 2024-04-18T14:43:57.053 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.8631000000000001e-05 2024-04-18T14:43:57.053 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:43:57.053 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T14:43:57.053 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:43:57.053 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:57.053 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:57.054 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "MOSDECSubOpWrite(3.as5 51/30 ECSubWrite(tid=40, reqid=client.4559.0:363, at_version=0'0, trim_to=0'0, roll_forward_to=51'28))", 2024-04-18T14:43:57.054 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T14:43:50.392134+0000", 2024-04-18T14:43:57.054 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 6.5791499629999999, 2024-04-18T14:43:57.054 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.005210994, 2024-04-18T14:43:57.054 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T14:43:57.054 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-04-18T14:43:57.054 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T14:43:57.054 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:57.054 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T14:43:57.054 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:50.392134+0000", 2024-04-18T14:43:57.054 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:43:57.054 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:57.054 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:57.054 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T14:43:57.055 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:50.392134+0000", 2024-04-18T14:43:57.055 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:43:57.055 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:57.055 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:57.055 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T14:43:57.055 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:50.392132+0000", 2024-04-18T14:43:57.055 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999981 2024-04-18T14:43:57.055 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:57.055 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:57.055 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T14:43:57.055 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:50.396340+0000", 2024-04-18T14:43:57.055 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0042086110000000001 2024-04-18T14:43:57.055 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:57.055 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:57.055 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T14:43:57.056 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:50.396354+0000", 2024-04-18T14:43:57.056 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3898e-05 2024-04-18T14:43:57.056 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:57.056 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:57.056 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T14:43:57.056 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:50.396365+0000", 2024-04-18T14:43:57.056 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.118e-05 2024-04-18T14:43:57.056 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:57.056 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:57.056 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T14:43:57.056 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:50.396501+0000", 2024-04-18T14:43:57.056 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000135978 2024-04-18T14:43:57.056 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:57.056 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:57.056 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_started", 2024-04-18T14:43:57.057 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:50.396528+0000", 2024-04-18T14:43:57.057 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.6954e-05 2024-04-18T14:43:57.057 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:57.057 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:57.057 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_committed", 2024-04-18T14:43:57.057 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:50.397312+0000", 2024-04-18T14:43:57.057 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00078421000000000003 2024-04-18T14:43:57.057 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:43:57.057 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:43:57.057 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T14:43:57.057 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:50.397344+0000", 2024-04-18T14:43:57.057 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.2076999999999998e-05 2024-04-18T14:43:57.057 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:43:57.057 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T14:43:57.057 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:43:57.058 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:43:57.058 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T14:43:57.058 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-04-18T14:43:57.059 INFO:teuthology.orchestra.run.smithi086.stdout:osd.0: {} 2024-04-18T14:43:57.059 INFO:teuthology.orchestra.run.smithi086.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-18T14:43:57.060 INFO:teuthology.orchestra.run.smithi086.stdout:osd.1: {} 2024-04-18T14:43:57.060 INFO:teuthology.orchestra.run.smithi086.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-18T14:43:57.060 INFO:tasks.ceph.osd.3.smithi134.stderr:2024-04-18T14:43:57.064+0000 7fe7a4443640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25211) UID: 0 2024-04-18T14:43:57.061 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-18T14:43:57.065 INFO:teuthology.orchestra.run.smithi086.stdout:osd.2: {} 2024-04-18T14:43:57.065 INFO:teuthology.orchestra.run.smithi086.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-18T14:43:57.084 INFO:teuthology.orchestra.run.smithi086.stdout:osd.3: {} 2024-04-18T14:43:57.084 INFO:teuthology.orchestra.run.smithi086.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-18T14:43:57.100 INFO:teuthology.orchestra.run.smithi086.stdout:osd.4: {} 2024-04-18T14:43:57.101 INFO:teuthology.orchestra.run.smithi086.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-18T14:43:57.121 INFO:teuthology.orchestra.run.smithi086.stdout:osd.5: {} 2024-04-18T14:43:57.121 INFO:teuthology.orchestra.run.smithi086.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-18T14:43:57.142 INFO:teuthology.orchestra.run.smithi086.stdout:osd.6: {} 2024-04-18T14:43:57.142 INFO:teuthology.orchestra.run.smithi086.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-18T14:43:57.160 INFO:tasks.ceph.osd.15.smithi134.stderr:2024-04-18T14:43:57.164+0000 7f08e6a51640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 15 (PID: 25218) UID: 0 2024-04-18T14:43:57.163 INFO:teuthology.orchestra.run.smithi086.stdout:osd.7: {} 2024-04-18T14:43:57.164 INFO:teuthology.orchestra.run.smithi086.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-18T14:43:57.181 INFO:teuthology.orchestra.run.smithi086.stdout:osd.8: {} 2024-04-18T14:43:57.181 INFO:teuthology.orchestra.run.smithi086.stderr:osd.8: osd_enable_op_tracker = '' 2024-04-18T14:43:57.185 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-04-18T14:43:57.185 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T14:43:57.199 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-18T14:43:57.201 INFO:teuthology.orchestra.run.smithi086.stdout:osd.9: {} 2024-04-18T14:43:57.201 INFO:teuthology.orchestra.run.smithi086.stderr:osd.9: osd_enable_op_tracker = '' 2024-04-18T14:43:57.222 INFO:teuthology.orchestra.run.smithi086.stdout:osd.10: {} 2024-04-18T14:43:57.222 INFO:teuthology.orchestra.run.smithi086.stderr:osd.10: osd_enable_op_tracker = '' 2024-04-18T14:43:57.256 INFO:teuthology.orchestra.run.smithi086.stdout:osd.11: {} 2024-04-18T14:43:57.256 INFO:teuthology.orchestra.run.smithi086.stderr:osd.11: osd_enable_op_tracker = '' 2024-04-18T14:43:57.261 INFO:tasks.ceph.osd.9.smithi096.stderr:2024-04-18T14:43:57.258+0000 7fa2c1cbf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 9 (PID: 24891) UID: 0 2024-04-18T14:43:57.286 INFO:teuthology.orchestra.run.smithi086.stdout:osd.12: {} 2024-04-18T14:43:57.286 INFO:teuthology.orchestra.run.smithi086.stderr:osd.12: osd_enable_op_tracker = '' 2024-04-18T14:43:57.306 INFO:teuthology.orchestra.run.smithi086.stdout:osd.13: {} 2024-04-18T14:43:57.306 INFO:teuthology.orchestra.run.smithi086.stderr:osd.13: osd_enable_op_tracker = '' 2024-04-18T14:43:57.326 INFO:teuthology.orchestra.run.smithi086.stdout:osd.14: {} 2024-04-18T14:43:57.326 INFO:teuthology.orchestra.run.smithi086.stderr:osd.14: osd_enable_op_tracker = '' 2024-04-18T14:43:57.336 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-04-18T14:43:57.336 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T14:43:57.346 INFO:teuthology.orchestra.run.smithi086.stdout:osd.15: {} 2024-04-18T14:43:57.346 INFO:teuthology.orchestra.run.smithi086.stderr:osd.15: osd_enable_op_tracker = '' 2024-04-18T14:43:57.351 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-18T14:43:57.361 INFO:tasks.ceph.osd.15.smithi134.stderr:2024-04-18T14:43:57.364+0000 7f08e6a51640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 15 (PID: 25218) UID: 0 2024-04-18T14:43:57.462 INFO:tasks.ceph.osd.4.smithi086.stderr:2024-04-18T14:43:57.462+0000 7f0c4c462640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 24956) UID: 0 2024-04-18T14:43:57.468 INFO:teuthology.orchestra.run.smithi086.stderr:noscrub is unset 2024-04-18T14:43:57.468 INFO:teuthology.orchestra.run.smithi086.stderr:reweighted osd.5 to 1 (10000) 2024-04-18T14:43:57.471 INFO:tasks.rados.rados.0.smithi134.stdout:198: done (6 left) 2024-04-18T14:43:57.471 INFO:tasks.rados.rados.0.smithi134.stdout:203: done (5 left) 2024-04-18T14:43:57.471 INFO:tasks.rados.rados.0.smithi134.stdout:204: done (4 left) 2024-04-18T14:43:57.472 INFO:tasks.rados.rados.0.smithi134.stdout:205: done (3 left) 2024-04-18T14:43:57.472 INFO:tasks.rados.rados.0.smithi134.stdout:206: done (2 left) 2024-04-18T14:43:57.472 INFO:tasks.rados.rados.0.smithi134.stdout:207: done (1 left) 2024-04-18T14:43:57.472 INFO:tasks.rados.rados.0.smithi134.stdout:208: done (0 left) 2024-04-18T14:43:57.472 INFO:tasks.rados.rados.0.smithi134.stdout:209: read oid 22 snap -1 2024-04-18T14:43:57.472 INFO:tasks.rados.rados.0.smithi134.stdout:209: expect (ObjNum 21 snap 0 seq_num 21) 2024-04-18T14:43:57.472 INFO:tasks.rados.rados.0.smithi134.stdout:append oid 9 current snap is 18 2024-04-18T14:43:57.472 INFO:tasks.rados.rados.0.smithi134.stdout:210: seq_num 92 ranges {1409024=786432,2195456=491520,2686976=278528} 2024-04-18T14:43:57.492 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 6 1 2024-04-18T14:43:57.508 INFO:tasks.rados.rados.0.smithi134.stdout:210: writing smithi13430248-9 from 1409024 to 2195456 tid 1 2024-04-18T14:43:57.516 INFO:tasks.rados.rados.0.smithi134.stdout:210: writing smithi13430248-9 from 2195456 to 2686976 tid 2 2024-04-18T14:43:57.521 INFO:tasks.rados.rados.0.smithi134.stdout:210: writing smithi13430248-9 from 2686976 to 2965504 tid 3 2024-04-18T14:43:57.521 INFO:tasks.rados.rados.0.smithi134.stdout:211: snap_remove snap 9 2024-04-18T14:43:57.526 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-04-18T14:43:57.526 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T14:43:57.542 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-04-18T14:43:57.590 INFO:tasks.ceph.osd.8.smithi086.stderr:2024-04-18T14:43:57.590+0000 7f29f7b9d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 8 (PID: 24958) UID: 0 2024-04-18T14:43:57.665 INFO:tasks.ceph.osd.6.smithi119.stderr:2024-04-18T14:43:57.666+0000 7fb7cb8bd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 24896) UID: 0 2024-04-18T14:43:57.706 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-04-18T14:43:57.706 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T14:43:57.720 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-04-18T14:43:57.765 INFO:tasks.ceph.osd.2.smithi119.stderr:2024-04-18T14:43:57.766+0000 7fcbd30c0640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 24894) UID: 0 2024-04-18T14:43:57.843 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-04-18T14:43:57.843 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T14:43:57.859 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-04-18T14:43:57.866 INFO:tasks.ceph.osd.2.smithi119.stderr:2024-04-18T14:43:57.866+0000 7fcbd30c0640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 24894) UID: 0 2024-04-18T14:43:57.967 INFO:tasks.ceph.osd.14.smithi119.stderr:2024-04-18T14:43:57.966+0000 7f180f599640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 14 (PID: 24900) UID: 0 2024-04-18T14:43:57.977 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-04-18T14:43:57.977 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T14:43:57.992 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.8.asok dump_ops_in_flight 2024-04-18T14:43:58.068 INFO:tasks.ceph.osd.1.smithi096.stderr:2024-04-18T14:43:58.070+0000 7f56a7a98640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 24887) UID: 0 2024-04-18T14:43:58.108 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-04-18T14:43:58.108 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T14:43:58.121 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.8.asok dump_blocked_ops 2024-04-18T14:43:58.169 INFO:tasks.ceph.osd.7.smithi134.stderr:2024-04-18T14:43:58.172+0000 7fd7de549640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25213) UID: 0 2024-04-18T14:43:58.239 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-04-18T14:43:58.239 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T14:43:58.253 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.8.asok dump_historic_ops 2024-04-18T14:43:58.272 INFO:tasks.ceph.osd.5.smithi096.stderr:2024-04-18T14:43:58.270+0000 7fc33f25b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 24889) UID: 0 2024-04-18T14:43:58.372 INFO:tasks.ceph.osd.4.smithi086.stderr:2024-04-18T14:43:58.370+0000 7f0c4c462640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 24956) UID: 0 2024-04-18T14:43:58.377 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-04-18T14:43:58.377 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T14:43:58.391 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.12.asok dump_ops_in_flight 2024-04-18T14:43:58.475 INFO:tasks.ceph.osd.7.smithi134.stderr:2024-04-18T14:43:58.480+0000 7fd7de549640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25213) UID: 0 2024-04-18T14:43:58.476 INFO:teuthology.orchestra.run.smithi086.stderr:reweighted osd.6 to 1 (10000) 2024-04-18T14:43:58.479 INFO:tasks.rados.rados.0.smithi134.stdout:209: expect (ObjNum 21 snap 0 seq_num 21) 2024-04-18T14:43:58.508 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 7 1 2024-04-18T14:43:58.513 INFO:tasks.rados.rados.0.smithi134.stdout:209: done (2 left) 2024-04-18T14:43:58.513 INFO:tasks.rados.rados.0.smithi134.stdout:211: done (1 left) 2024-04-18T14:43:58.513 INFO:tasks.rados.rados.0.smithi134.stdout:212: copy_from oid 48 from oid 47 current snap is 18 2024-04-18T14:43:58.513 INFO:tasks.rados.rados.0.smithi134.stdout:213: read oid 49 snap -1 2024-04-18T14:43:58.513 INFO:tasks.rados.rados.0.smithi134.stdout:213: expect (ObjNum 48 snap 0 seq_num 48) 2024-04-18T14:43:58.513 INFO:tasks.rados.rados.0.smithi134.stdout:append oid 25 current snap is 18 2024-04-18T14:43:58.513 INFO:tasks.rados.rados.0.smithi134.stdout:214: seq_num 93 ranges {1376256=802816,2179072=638976,2818048=131072} 2024-04-18T14:43:58.537 INFO:tasks.rados.rados.0.smithi134.stdout:214: writing smithi13430248-25 from 1376256 to 2179072 tid 1 2024-04-18T14:43:58.543 INFO:tasks.rados.rados.0.smithi134.stdout:214: writing smithi13430248-25 from 2179072 to 2818048 tid 2 2024-04-18T14:43:58.545 INFO:tasks.rados.rados.0.smithi134.stdout:214: writing smithi13430248-25 from 2818048 to 2949120 tid 3 2024-04-18T14:43:58.545 INFO:tasks.rados.rados.0.smithi134.stdout:215: read oid 17 snap -1 2024-04-18T14:43:58.545 INFO:tasks.rados.rados.0.smithi134.stdout:215: expect (ObjNum 37 snap 0 seq_num 37) 2024-04-18T14:43:58.545 INFO:tasks.rados.rados.0.smithi134.stdout:216: rmattr oid 18 current snap is 18 2024-04-18T14:43:58.545 INFO:tasks.rados.rados.0.smithi134.stdout:210: finishing write tid 1 to smithi13430248-9 2024-04-18T14:43:58.545 INFO:tasks.rados.rados.0.smithi134.stdout:210: finishing write tid 2 to smithi13430248-9 2024-04-18T14:43:58.545 INFO:tasks.rados.rados.0.smithi134.stdout:210: finishing write tid 3 to smithi13430248-9 2024-04-18T14:43:58.545 INFO:tasks.rados.rados.0.smithi134.stdout:210: finishing write tid 4 to smithi13430248-9 2024-04-18T14:43:58.545 INFO:tasks.rados.rados.0.smithi134.stdout:210: finishing write tid 5 to smithi13430248-9 2024-04-18T14:43:58.546 INFO:tasks.rados.rados.0.smithi134.stdout:210: oid 9 updating version 0 to 29 2024-04-18T14:43:58.546 INFO:tasks.rados.rados.0.smithi134.stdout:210: oid 9 updating version 29 to 31 2024-04-18T14:43:58.546 INFO:tasks.rados.rados.0.smithi134.stdout:210: oid 9 version 31 is already newer than 30 2024-04-18T14:43:58.546 INFO:tasks.rados.rados.0.smithi134.stdout:210: oid 9 version 31 is already newer than 28 2024-04-18T14:43:58.546 INFO:tasks.rados.rados.0.smithi134.stdout:update_object_version oid 9 v 31 (ObjNum 92 snap 18 seq_num 92) dirty exists 2024-04-18T14:43:58.546 INFO:tasks.rados.rados.0.smithi134.stdout:210: left oid 9 (ObjNum 92 snap 18 seq_num 92) 2024-04-18T14:43:58.546 INFO:tasks.rados.rados.0.smithi134.stdout:212: finishing copy_from racing read to smithi13430248-48 2024-04-18T14:43:58.546 INFO:tasks.rados.rados.0.smithi134.stdout:213: expect (ObjNum 48 snap 0 seq_num 48) 2024-04-18T14:43:58.577 INFO:tasks.ceph.osd.13.smithi096.stderr:2024-04-18T14:43:58.574+0000 7f7e72fad640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 13 (PID: 24893) UID: 0 2024-04-18T14:43:58.581 INFO:tasks.rados.rados.0.smithi134.stdout:212: finishing copy_from to smithi13430248-48 2024-04-18T14:43:58.582 INFO:tasks.rados.rados.0.smithi134.stdout:update_object_version oid 48 v 12 (ObjNum 46 snap 0 seq_num 46) dirty exists 2024-04-18T14:43:58.582 INFO:tasks.rados.rados.0.smithi134.stdout:214: finishing write tid 1 to smithi13430248-25 2024-04-18T14:43:58.582 INFO:tasks.rados.rados.0.smithi134.stdout:214: finishing write tid 2 to smithi13430248-25 2024-04-18T14:43:58.582 INFO:tasks.rados.rados.0.smithi134.stdout:update_object_version oid 18 v 48 (ObjNum 44 snap 0 seq_num 44) dirty exists 2024-04-18T14:43:58.582 INFO:tasks.rados.rados.0.smithi134.stdout:215: expect (ObjNum 37 snap 0 seq_num 37) 2024-04-18T14:43:58.582 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-04-18T14:43:58.582 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T14:43:58.597 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.12.asok dump_blocked_ops 2024-04-18T14:43:58.601 INFO:tasks.rados.rados.0.smithi134.stdout:214: finishing write tid 3 to smithi13430248-25 2024-04-18T14:43:58.601 INFO:tasks.rados.rados.0.smithi134.stdout:214: finishing write tid 4 to smithi13430248-25 2024-04-18T14:43:58.601 INFO:tasks.rados.rados.0.smithi134.stdout:214: finishing write tid 5 to smithi13430248-25 2024-04-18T14:43:58.601 INFO:tasks.rados.rados.0.smithi134.stdout:214: oid 25 updating version 0 to 78 2024-04-18T14:43:58.601 INFO:tasks.rados.rados.0.smithi134.stdout:214: oid 25 version 78 is already newer than 77 2024-04-18T14:43:58.601 INFO:tasks.rados.rados.0.smithi134.stdout:214: oid 25 updating version 78 to 79 2024-04-18T14:43:58.601 INFO:tasks.rados.rados.0.smithi134.stdout:214: oid 25 updating version 79 to 80 2024-04-18T14:43:58.601 INFO:tasks.rados.rados.0.smithi134.stdout:update_object_version oid 25 v 80 (ObjNum 93 snap 18 seq_num 93) dirty exists 2024-04-18T14:43:58.601 INFO:tasks.rados.rados.0.smithi134.stdout:214: left oid 25 (ObjNum 93 snap 18 seq_num 93) 2024-04-18T14:43:58.601 INFO:tasks.rados.rados.0.smithi134.stdout:210: done (5 left) 2024-04-18T14:43:58.601 INFO:tasks.rados.rados.0.smithi134.stdout:212: done (4 left) 2024-04-18T14:43:58.601 INFO:tasks.rados.rados.0.smithi134.stdout:213: done (3 left) 2024-04-18T14:43:58.601 INFO:tasks.rados.rados.0.smithi134.stdout:214: done (2 left) 2024-04-18T14:43:58.601 INFO:tasks.rados.rados.0.smithi134.stdout:215: done (1 left) 2024-04-18T14:43:58.602 INFO:tasks.rados.rados.0.smithi134.stdout:216: done (0 left) 2024-04-18T14:43:58.602 INFO:tasks.rados.rados.0.smithi134.stdout:217: snap_create 2024-04-18T14:43:58.690 INFO:tasks.ceph.osd.8.smithi086.stderr:2024-04-18T14:43:58.690+0000 7f29f7b9d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 8 (PID: 24958) UID: 0 2024-04-18T14:43:58.761 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-04-18T14:43:58.761 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T14:43:58.775 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.12.asok dump_historic_ops 2024-04-18T14:43:58.780 INFO:tasks.ceph.osd.1.smithi096.stderr:2024-04-18T14:43:58.778+0000 7f56a7a98640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 24887) UID: 0 2024-04-18T14:43:58.881 INFO:tasks.ceph.osd.7.smithi134.stderr:2024-04-18T14:43:58.884+0000 7fd7de549640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25213) UID: 0 2024-04-18T14:43:58.939 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-04-18T14:43:58.939 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T14:43:58.953 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-18T14:43:58.982 INFO:tasks.ceph.osd.4.smithi086.stderr:2024-04-18T14:43:58.982+0000 7f0c4c462640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 24956) UID: 0 2024-04-18T14:43:59.082 INFO:teuthology.orchestra.run.smithi096.stdout:ERROR: (22) Invalid argument 2024-04-18T14:43:59.082 INFO:teuthology.orchestra.run.smithi096.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T14:43:59.083 INFO:tasks.ceph.osd.12.smithi086.stderr:2024-04-18T14:43:59.082+0000 7f6904968640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 12 (PID: 24960) UID: 0 2024-04-18T14:43:59.096 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-18T14:43:59.184 INFO:tasks.ceph.osd.14.smithi119.stderr:2024-04-18T14:43:59.186+0000 7f180f599640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 14 (PID: 24900) UID: 0 2024-04-18T14:43:59.217 INFO:teuthology.orchestra.run.smithi096.stdout:ERROR: (22) Invalid argument 2024-04-18T14:43:59.217 INFO:teuthology.orchestra.run.smithi096.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T14:43:59.235 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-18T14:43:59.284 INFO:tasks.ceph.osd.1.smithi096.stderr:2024-04-18T14:43:59.282+0000 7f56a7a98640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 24887) UID: 0 2024-04-18T14:43:59.357 INFO:teuthology.orchestra.run.smithi096.stdout:ERROR: (22) Invalid argument 2024-04-18T14:43:59.358 INFO:teuthology.orchestra.run.smithi096.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T14:43:59.364 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-18T14:43:59.371 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-04-18T14:43:59.372 INFO:teuthology.orchestra.run.smithi086.stderr:reweighted osd.7 to 1 (10000) 2024-04-18T14:43:59.376 INFO:tasks.rados.rados.0.smithi134.stdout:217: done (0 left) 2024-04-18T14:43:59.376 INFO:tasks.rados.rados.0.smithi134.stdout:218: rollback oid 43 current snap is 19 2024-04-18T14:43:59.376 INFO:tasks.rados.rados.0.smithi134.stdout:rollback oid 43 to 11 2024-04-18T14:43:59.376 INFO:tasks.rados.rados.0.smithi134.stdout:219: read oid 14 snap -1 2024-04-18T14:43:59.376 INFO:tasks.rados.rados.0.smithi134.stdout:219: expect (ObjNum 13 snap 0 seq_num 13) 2024-04-18T14:43:59.376 INFO:tasks.rados.rados.0.smithi134.stdout:220: read oid 35 snap 16 2024-04-18T14:43:59.376 INFO:tasks.rados.rados.0.smithi134.stdout:220: expect (ObjNum 34 snap 0 seq_num 34) 2024-04-18T14:43:59.376 INFO:tasks.rados.rados.0.smithi134.stdout:append oid 46 current snap is 19 2024-04-18T14:43:59.376 INFO:tasks.rados.rados.0.smithi134.stdout:221: seq_num 94 ranges {622592=425984,1048576=786432,1835008=376832} 2024-04-18T14:43:59.385 INFO:tasks.ceph.osd.11.smithi134.stderr:2024-04-18T14:43:59.388+0000 7f2d36f12640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 11 (PID: 25216) UID: 0 2024-04-18T14:43:59.394 INFO:tasks.rados.rados.0.smithi134.stdout:221: writing smithi13430248-46 from 622592 to 1048576 tid 1 2024-04-18T14:43:59.401 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 8 1 2024-04-18T14:43:59.408 INFO:tasks.rados.rados.0.smithi134.stdout:221: writing smithi13430248-46 from 1048576 to 1835008 tid 2 2024-04-18T14:43:59.415 INFO:tasks.rados.rados.0.smithi134.stdout:221: writing smithi13430248-46 from 1835008 to 2211840 tid 3 2024-04-18T14:43:59.415 INFO:tasks.rados.rados.0.smithi134.stdout:222: delete oid 1 current snap is 19 2024-04-18T14:43:59.415 INFO:tasks.rados.rados.0.smithi134.stdout:220: expect (ObjNum 34 snap 0 seq_num 34) 2024-04-18T14:43:59.438 INFO:tasks.rados.rados.0.smithi134.stdout:218: finishing rollback tid 0 to smithi13430248-43 2024-04-18T14:43:59.438 INFO:tasks.rados.rados.0.smithi134.stdout:219: expect (ObjNum 13 snap 0 seq_num 13) 2024-04-18T14:43:59.447 INFO:tasks.rados.rados.0.smithi134.stdout:218: finishing rollback tid 1 to smithi13430248-43 2024-04-18T14:43:59.448 INFO:tasks.rados.rados.0.smithi134.stdout:218: finishing rollback tid 2 to smithi13430248-43 2024-04-18T14:43:59.448 INFO:tasks.rados.rados.0.smithi134.stdout:update_object_version oid 43 v 53 (ObjNum 61 snap 5 seq_num 61) dirty exists 2024-04-18T14:43:59.448 INFO:tasks.rados.rados.0.smithi134.stdout:221: finishing write tid 1 to smithi13430248-46 2024-04-18T14:43:59.448 INFO:tasks.rados.rados.0.smithi134.stdout:221: finishing write tid 2 to smithi13430248-46 2024-04-18T14:43:59.448 INFO:tasks.rados.rados.0.smithi134.stdout:221: finishing write tid 3 to smithi13430248-46 2024-04-18T14:43:59.448 INFO:tasks.rados.rados.0.smithi134.stdout:221: finishing write tid 4 to smithi13430248-46 2024-04-18T14:43:59.448 INFO:tasks.rados.rados.0.smithi134.stdout:221: finishing write tid 5 to smithi13430248-46 2024-04-18T14:43:59.448 INFO:tasks.rados.rados.0.smithi134.stdout:221: oid 46 updating version 0 to 62 2024-04-18T14:43:59.448 INFO:tasks.rados.rados.0.smithi134.stdout:221: oid 46 updating version 62 to 64 2024-04-18T14:43:59.448 INFO:tasks.rados.rados.0.smithi134.stdout:221: oid 46 version 64 is already newer than 63 2024-04-18T14:43:59.448 INFO:tasks.rados.rados.0.smithi134.stdout:221: oid 46 updating version 64 to 65 2024-04-18T14:43:59.448 INFO:tasks.rados.rados.0.smithi134.stdout:update_object_version oid 46 v 65 (ObjNum 94 snap 19 seq_num 94) dirty exists 2024-04-18T14:43:59.448 INFO:tasks.rados.rados.0.smithi134.stdout:221: left oid 46 (ObjNum 94 snap 19 seq_num 94) 2024-04-18T14:43:59.450 INFO:tasks.rados.rados.0.smithi134.stdout:218: done (4 left) 2024-04-18T14:43:59.451 INFO:tasks.rados.rados.0.smithi134.stdout:219: done (3 left) 2024-04-18T14:43:59.451 INFO:tasks.rados.rados.0.smithi134.stdout:220: done (2 left) 2024-04-18T14:43:59.451 INFO:tasks.rados.rados.0.smithi134.stdout:221: done (1 left) 2024-04-18T14:43:59.451 INFO:tasks.rados.rados.0.smithi134.stdout:222: done (0 left) 2024-04-18T14:43:59.451 INFO:tasks.rados.rados.0.smithi134.stdout:223: rollback oid 14 current snap is 19 2024-04-18T14:43:59.451 INFO:tasks.rados.rados.0.smithi134.stdout:rollback oid 14 to 12 2024-04-18T14:43:59.451 INFO:tasks.rados.rados.0.smithi134.stdout:224: snap_create 2024-04-18T14:43:59.457 INFO:tasks.rados.rados.0.smithi134.stdout:223: finishing rollback tid 0 to smithi13430248-14 2024-04-18T14:43:59.458 INFO:tasks.rados.rados.0.smithi134.stdout:223: finishing rollback tid 1 to smithi13430248-14 2024-04-18T14:43:59.458 INFO:tasks.rados.rados.0.smithi134.stdout:223: finishing rollback tid 2 to smithi13430248-14 2024-04-18T14:43:59.459 INFO:tasks.rados.rados.0.smithi134.stdout:update_object_version oid 14 v 57 (ObjNum 13 snap 0 seq_num 13) dirty exists 2024-04-18T14:43:59.486 INFO:tasks.ceph.osd.15.smithi134.stderr:2024-04-18T14:43:59.488+0000 7f08e6a51640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 15 (PID: 25218) UID: 0 2024-04-18T14:43:59.494 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-04-18T14:43:59.519 INFO:teuthology.orchestra.run.smithi086.stdout:osd.0: {} 2024-04-18T14:43:59.519 INFO:teuthology.orchestra.run.smithi086.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-18T14:43:59.535 INFO:teuthology.orchestra.run.smithi096.stdout:ERROR: (22) Invalid argument 2024-04-18T14:43:59.535 INFO:teuthology.orchestra.run.smithi096.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T14:43:59.539 INFO:teuthology.orchestra.run.smithi086.stdout:osd.1: {} 2024-04-18T14:43:59.539 INFO:teuthology.orchestra.run.smithi086.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-18T14:43:59.549 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-04-18T14:43:59.559 INFO:teuthology.orchestra.run.smithi086.stdout:osd.2: {} 2024-04-18T14:43:59.559 INFO:teuthology.orchestra.run.smithi086.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-18T14:43:59.586 INFO:teuthology.orchestra.run.smithi086.stdout:osd.3: {} 2024-04-18T14:43:59.587 INFO:teuthology.orchestra.run.smithi086.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-18T14:43:59.587 INFO:tasks.ceph.osd.2.smithi119.stderr:2024-04-18T14:43:59.586+0000 7fcbd30c0640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 24894) UID: 0 2024-04-18T14:43:59.603 INFO:teuthology.orchestra.run.smithi086.stdout:osd.4: {} 2024-04-18T14:43:59.603 INFO:teuthology.orchestra.run.smithi086.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-18T14:43:59.624 INFO:teuthology.orchestra.run.smithi086.stdout:osd.5: {} 2024-04-18T14:43:59.624 INFO:teuthology.orchestra.run.smithi086.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-18T14:43:59.644 INFO:teuthology.orchestra.run.smithi086.stdout:osd.6: {} 2024-04-18T14:43:59.644 INFO:teuthology.orchestra.run.smithi086.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-18T14:43:59.664 INFO:teuthology.orchestra.run.smithi086.stdout:osd.7: {} 2024-04-18T14:43:59.664 INFO:teuthology.orchestra.run.smithi086.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-18T14:43:59.670 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2024-04-18T14:43:59.670 INFO:teuthology.orchestra.run.smithi096.stdout: "ops": [], 2024-04-18T14:43:59.670 INFO:teuthology.orchestra.run.smithi096.stdout: "complaint_time": 30, 2024-04-18T14:43:59.670 INFO:teuthology.orchestra.run.smithi096.stdout: "num_blocked_ops": 0 2024-04-18T14:43:59.670 INFO:teuthology.orchestra.run.smithi096.stdout:} 2024-04-18T14:43:59.680 INFO:teuthology.orchestra.run.smithi086.stdout:osd.8: {} 2024-04-18T14:43:59.680 INFO:teuthology.orchestra.run.smithi086.stderr:osd.8: osd_enable_op_tracker = '' 2024-04-18T14:43:59.684 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-04-18T14:43:59.687 INFO:tasks.ceph.osd.10.smithi119.stderr:2024-04-18T14:43:59.686+0000 7f6f24c12640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 10 (PID: 24898) UID: 0 2024-04-18T14:43:59.698 INFO:teuthology.orchestra.run.smithi086.stdout:osd.9: {} 2024-04-18T14:43:59.698 INFO:teuthology.orchestra.run.smithi086.stderr:osd.9: osd_enable_op_tracker = '' 2024-04-18T14:43:59.718 INFO:teuthology.orchestra.run.smithi086.stdout:osd.10: {} 2024-04-18T14:43:59.718 INFO:teuthology.orchestra.run.smithi086.stderr:osd.10: osd_enable_op_tracker = '' 2024-04-18T14:43:59.737 INFO:teuthology.orchestra.run.smithi086.stdout:osd.11: {} 2024-04-18T14:43:59.737 INFO:teuthology.orchestra.run.smithi086.stderr:osd.11: osd_enable_op_tracker = '' 2024-04-18T14:43:59.754 INFO:teuthology.orchestra.run.smithi086.stdout:osd.12: {} 2024-04-18T14:43:59.754 INFO:teuthology.orchestra.run.smithi086.stderr:osd.12: osd_enable_op_tracker = '' 2024-04-18T14:43:59.773 INFO:teuthology.orchestra.run.smithi086.stdout:osd.13: {} 2024-04-18T14:43:59.773 INFO:teuthology.orchestra.run.smithi086.stderr:osd.13: osd_enable_op_tracker = '' 2024-04-18T14:43:59.789 INFO:tasks.ceph.osd.6.smithi119.stderr:2024-04-18T14:43:59.790+0000 7fb7cb8bd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 24896) UID: 0 2024-04-18T14:43:59.792 INFO:teuthology.orchestra.run.smithi086.stdout:osd.14: {} 2024-04-18T14:43:59.792 INFO:teuthology.orchestra.run.smithi086.stderr:osd.14: osd_enable_op_tracker = '' 2024-04-18T14:43:59.793 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-18T14:43:59.790+0000 7f40f484f640 0 -- 172.21.15.86:0/3921788717 >> [v2:172.21.15.134:6808/25223,v1:172.21.15.134:6812/25223] conn(0x7f40f0223880 msgr2=0x7f40f0225c90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-04-18T14:43:59.810 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2024-04-18T14:43:59.810 INFO:teuthology.orchestra.run.smithi096.stdout: "size": 20, 2024-04-18T14:43:59.810 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 600, 2024-04-18T14:43:59.810 INFO:teuthology.orchestra.run.smithi096.stdout: "ops": [ 2024-04-18T14:43:59.810 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:59.810 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4559.0:196 3.8s0 3:1d392465:::smithi13430248-23:head [read 0~376832,checksum] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37)", 2024-04-18T14:43:59.811 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-04-18T14:43:36.775483+0000", 2024-04-18T14:43:59.811 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 23.033733443999999, 2024-04-18T14:43:59.811 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0059509589999999996, 2024-04-18T14:43:59.811 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-04-18T14:43:59.811 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "started", 2024-04-18T14:43:59.811 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-04-18T14:43:59.811 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4559", 2024-04-18T14:43:59.811 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "172.21.15.134:0/3113589487", 2024-04-18T14:43:59.811 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 196 2024-04-18T14:43:59.811 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:59.811 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-04-18T14:43:59.811 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:59.811 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-04-18T14:43:59.811 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:36.775483+0000", 2024-04-18T14:43:59.811 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:43:59.812 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:59.812 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:59.812 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-04-18T14:43:59.812 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:36.775483+0000", 2024-04-18T14:43:59.812 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:43:59.812 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:59.812 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:59.812 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-04-18T14:43:59.812 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:36.775483+0000", 2024-04-18T14:43:59.812 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 4294967295.9999995 2024-04-18T14:43:59.812 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:59.812 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:59.812 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-04-18T14:43:59.812 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:36.775485+0000", 2024-04-18T14:43:59.812 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.8159999999999998e-06 2024-04-18T14:43:59.813 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:59.813 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:59.813 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-04-18T14:43:59.813 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:36.775490+0000", 2024-04-18T14:43:59.813 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 5.0610000000000003e-06 2024-04-18T14:43:59.813 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:59.813 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:59.813 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-04-18T14:43:59.813 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:36.775494+0000", 2024-04-18T14:43:59.813 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.7239999999999998e-06 2024-04-18T14:43:59.813 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:59.813 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:59.813 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-04-18T14:43:59.813 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:36.776885+0000", 2024-04-18T14:43:59.813 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0013908 2024-04-18T14:43:59.813 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:59.814 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:59.814 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-04-18T14:43:59.814 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:36.776985+0000", 2024-04-18T14:43:59.814 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 9.9611999999999994e-05 2024-04-18T14:43:59.814 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:59.814 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:59.814 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-04-18T14:43:59.814 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:36.781434+0000", 2024-04-18T14:43:59.814 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0044493370000000003 2024-04-18T14:43:59.814 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:43:59.814 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T14:43:59.814 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:43:59.814 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:59.814 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:59.814 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4559.0:250 3.8s0 3:1aa3fae8:::smithi13430248-32:head [delete] snapc 8=[8,7,4,2] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e41)", 2024-04-18T14:43:59.815 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-04-18T14:43:40.758415+0000", 2024-04-18T14:43:59.815 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 19.050800900999999, 2024-04-18T14:43:59.815 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.019264455999999999, 2024-04-18T14:43:59.815 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-04-18T14:43:59.815 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T14:43:59.815 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-04-18T14:43:59.815 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4559", 2024-04-18T14:43:59.815 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "172.21.15.134:0/3113589487", 2024-04-18T14:43:59.815 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 250 2024-04-18T14:43:59.815 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:59.815 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-04-18T14:43:59.815 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:59.815 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-04-18T14:43:59.815 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:40.758415+0000", 2024-04-18T14:43:59.815 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:43:59.816 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:59.816 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:59.816 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-04-18T14:43:59.816 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:40.758415+0000", 2024-04-18T14:43:59.816 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:43:59.816 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:59.816 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:59.816 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-04-18T14:43:59.816 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:40.758413+0000", 2024-04-18T14:43:59.816 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 4294967295.9999971 2024-04-18T14:43:59.816 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:59.817 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:59.817 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-04-18T14:43:59.817 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:40.758426+0000", 2024-04-18T14:43:59.817 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.3286e-05 2024-04-18T14:43:59.817 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:59.817 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:59.817 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-04-18T14:43:59.817 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:40.758452+0000", 2024-04-18T14:43:59.817 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.6016e-05 2024-04-18T14:43:59.817 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:59.817 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:59.817 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-04-18T14:43:59.817 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:40.758470+0000", 2024-04-18T14:43:59.817 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.8465999999999999e-05 2024-04-18T14:43:59.817 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:59.818 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:59.818 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-04-18T14:43:59.818 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:40.758631+0000", 2024-04-18T14:43:59.818 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000160929 2024-04-18T14:43:59.818 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:59.818 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:59.818 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op must wait for map", 2024-04-18T14:43:59.818 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:40.758652+0000", 2024-04-18T14:43:59.818 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.0494999999999999e-05 2024-04-18T14:43:59.818 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:59.818 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:59.818 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-04-18T14:43:59.818 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:40.762268+0000", 2024-04-18T14:43:59.818 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.003616265 2024-04-18T14:43:59.819 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:59.819 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:59.819 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-04-18T14:43:59.819 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:40.762418+0000", 2024-04-18T14:43:59.819 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00014972 2024-04-18T14:43:59.819 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:59.819 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:59.819 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_started", 2024-04-18T14:43:59.819 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:40.764042+0000", 2024-04-18T14:43:59.819 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.001624611 2024-04-18T14:43:59.819 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:59.819 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:59.819 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_committed", 2024-04-18T14:43:59.819 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:40.769066+0000", 2024-04-18T14:43:59.819 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0050236009999999999 2024-04-18T14:43:59.820 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:59.820 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:59.820 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-04-18T14:43:59.820 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:40.777434+0000", 2024-04-18T14:43:59.820 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0083685059999999995 2024-04-18T14:43:59.820 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:59.820 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:59.820 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-04-18T14:43:59.820 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:40.777680+0000", 2024-04-18T14:43:59.820 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00024547499999999999 2024-04-18T14:43:59.820 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:43:59.820 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T14:43:59.820 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:43:59.820 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:59.820 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:59.821 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "pg_update_log_missing(3.9s1 epoch 41/30 rep_tid 40 entries 41'25 (0'0) error 3:936e42fd:::smithi13430248-33:head by client.4559.0:247 0.000000 0 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 38'23)", 2024-04-18T14:43:59.821 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-04-18T14:43:40.766408+0000", 2024-04-18T14:43:59.821 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 19.042808478000001, 2024-04-18T14:43:59.821 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0064430119999999997, 2024-04-18T14:43:59.821 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-04-18T14:43:59.821 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "reached pg", 2024-04-18T14:43:59.821 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-04-18T14:43:59.821 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:59.821 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-04-18T14:43:59.821 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:40.766408+0000", 2024-04-18T14:43:59.821 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:43:59.821 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:59.821 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:59.821 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-04-18T14:43:59.821 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:40.766408+0000", 2024-04-18T14:43:59.822 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:43:59.822 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:59.822 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:59.822 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-04-18T14:43:59.822 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:40.766407+0000", 2024-04-18T14:43:59.822 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 4294967295.9999995 2024-04-18T14:43:59.822 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:59.822 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:59.822 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-04-18T14:43:59.822 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:40.766423+0000", 2024-04-18T14:43:59.822 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.5769000000000001e-05 2024-04-18T14:43:59.822 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:59.822 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:59.822 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-04-18T14:43:59.822 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:40.766469+0000", 2024-04-18T14:43:59.823 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 4.6283999999999999e-05 2024-04-18T14:43:59.823 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:59.823 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:59.823 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-04-18T14:43:59.823 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:40.766501+0000", 2024-04-18T14:43:59.823 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.1566000000000002e-05 2024-04-18T14:43:59.823 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:59.823 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:59.823 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-04-18T14:43:59.823 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:40.767020+0000", 2024-04-18T14:43:59.823 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00051944600000000001 2024-04-18T14:43:59.823 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:59.823 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:59.823 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-04-18T14:43:59.823 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:40.772851+0000", 2024-04-18T14:43:59.824 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0058306069999999998 2024-04-18T14:43:59.824 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:43:59.824 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T14:43:59.824 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:43:59.824 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:59.824 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:59.824 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(osd.11.22:1 3.8s0 3:1890b7c2:::smithi13430248-36:head [assert-version v10,copy-get max 8388608] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-04-18T14:43:59.824 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-04-18T14:43:40.767377+0000", 2024-04-18T14:43:59.824 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 19.041839846999999, 2024-04-18T14:43:59.824 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0095615930000000002, 2024-04-18T14:43:59.824 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-04-18T14:43:59.824 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "started", 2024-04-18T14:43:59.824 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-04-18T14:43:59.824 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:59.825 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-04-18T14:43:59.825 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:40.767377+0000", 2024-04-18T14:43:59.825 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:43:59.825 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:59.825 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:59.825 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-04-18T14:43:59.825 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:40.767377+0000", 2024-04-18T14:43:59.825 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:43:59.825 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:59.825 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:59.825 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-04-18T14:43:59.825 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:40.767375+0000", 2024-04-18T14:43:59.825 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 4294967295.9999981 2024-04-18T14:43:59.825 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:59.825 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:59.826 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-04-18T14:43:59.826 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:40.767387+0000", 2024-04-18T14:43:59.826 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.235e-05 2024-04-18T14:43:59.826 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:59.826 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:59.826 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-04-18T14:43:59.826 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:40.767407+0000", 2024-04-18T14:43:59.826 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.0455e-05 2024-04-18T14:43:59.826 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:59.826 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:59.826 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-04-18T14:43:59.826 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:40.767420+0000", 2024-04-18T14:43:59.826 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.2627e-05 2024-04-18T14:43:59.826 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:59.826 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:59.827 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-04-18T14:43:59.827 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:40.769163+0000", 2024-04-18T14:43:59.827 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0017425380000000001 2024-04-18T14:43:59.827 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:59.827 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:59.827 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-04-18T14:43:59.827 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:40.769417+0000", 2024-04-18T14:43:59.827 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00025450499999999998 2024-04-18T14:43:59.827 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:59.827 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:59.827 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-04-18T14:43:59.827 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:40.776938+0000", 2024-04-18T14:43:59.827 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0075210279999999999 2024-04-18T14:43:59.827 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:43:59.827 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T14:43:59.828 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:43:59.828 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:59.828 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:59.828 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4559.0:296 3.8s0 3:17e457c8:::smithi13430248-35:head [append 0~0] snapc d=[d,b,a,8,7,2] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-18T14:43:59.828 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-04-18T14:43:44.424341+0000", 2024-04-18T14:43:59.828 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 15.384875063999999, 2024-04-18T14:43:59.828 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0071583829999999999, 2024-04-18T14:43:59.828 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-04-18T14:43:59.828 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T14:43:59.828 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-04-18T14:43:59.828 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4559", 2024-04-18T14:43:59.828 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "172.21.15.134:0/3113589487", 2024-04-18T14:43:59.828 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 296 2024-04-18T14:43:59.828 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:59.828 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-04-18T14:43:59.828 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:59.829 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-04-18T14:43:59.829 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:44.424341+0000", 2024-04-18T14:43:59.829 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:43:59.829 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:59.829 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:59.829 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-04-18T14:43:59.829 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:44.424341+0000", 2024-04-18T14:43:59.829 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:43:59.829 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:59.829 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:59.829 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-04-18T14:43:59.829 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:44.424339+0000", 2024-04-18T14:43:59.829 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 4294967295.9999976 2024-04-18T14:43:59.829 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:59.829 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:59.830 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-04-18T14:43:59.830 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:44.424353+0000", 2024-04-18T14:43:59.830 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.3885e-05 2024-04-18T14:43:59.830 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:59.830 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:59.830 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-04-18T14:43:59.830 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:44.424379+0000", 2024-04-18T14:43:59.830 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.5834e-05 2024-04-18T14:43:59.830 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:59.830 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:59.830 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-04-18T14:43:59.830 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:44.424392+0000", 2024-04-18T14:43:59.830 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.3286e-05 2024-04-18T14:43:59.830 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:59.830 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:59.831 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-04-18T14:43:59.831 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:44.424474+0000", 2024-04-18T14:43:59.831 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 8.1955999999999999e-05 2024-04-18T14:43:59.831 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:59.831 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:59.831 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-04-18T14:43:59.831 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:44.424619+0000", 2024-04-18T14:43:59.831 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00014511799999999999 2024-04-18T14:43:59.831 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:59.831 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:59.831 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_started", 2024-04-18T14:43:59.831 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:44.425695+0000", 2024-04-18T14:43:59.831 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0010762440000000001 2024-04-18T14:43:59.831 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:59.831 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:59.831 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_committed", 2024-04-18T14:43:59.832 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:44.429612+0000", 2024-04-18T14:43:59.832 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0039172790000000001 2024-04-18T14:43:59.832 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:59.832 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:59.832 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-04-18T14:43:59.832 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:44.431392+0000", 2024-04-18T14:43:59.832 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.001779114 2024-04-18T14:43:59.832 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:59.832 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:59.832 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-04-18T14:43:59.832 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:44.431500+0000", 2024-04-18T14:43:59.832 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00010816500000000001 2024-04-18T14:43:59.832 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:43:59.832 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T14:43:59.832 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:43:59.833 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:59.833 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:59.833 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4559.0:297 3.8s0 3:17e457c8:::smithi13430248-35:head [rollback a] snapc d=[d,b,a,8,7,2] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-18T14:43:59.833 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-04-18T14:43:44.424409+0000", 2024-04-18T14:43:59.833 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 15.384807122, 2024-04-18T14:43:59.833 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.008847466, 2024-04-18T14:43:59.833 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-04-18T14:43:59.833 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T14:43:59.833 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-04-18T14:43:59.833 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4559", 2024-04-18T14:43:59.833 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "172.21.15.134:0/3113589487", 2024-04-18T14:43:59.833 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 297 2024-04-18T14:43:59.833 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:59.833 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-04-18T14:43:59.834 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:59.834 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-04-18T14:43:59.834 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:44.424409+0000", 2024-04-18T14:43:59.834 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:43:59.834 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:59.834 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:59.834 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-04-18T14:43:59.834 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:44.424409+0000", 2024-04-18T14:43:59.834 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:43:59.834 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:59.834 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:59.834 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-04-18T14:43:59.834 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:44.424409+0000", 2024-04-18T14:43:59.834 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 4294967295.9999995 2024-04-18T14:43:59.834 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:59.835 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:59.835 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-04-18T14:43:59.835 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:44.424412+0000", 2024-04-18T14:43:59.835 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.4860000000000002e-06 2024-04-18T14:43:59.835 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:59.835 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:59.835 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-04-18T14:43:59.835 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:44.424420+0000", 2024-04-18T14:43:59.835 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 8.1640000000000001e-06 2024-04-18T14:43:59.835 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:59.835 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:59.835 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-04-18T14:43:59.835 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:44.424426+0000", 2024-04-18T14:43:59.835 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 5.4870000000000002e-06 2024-04-18T14:43:59.835 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:59.836 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:59.836 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-04-18T14:43:59.836 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:44.426506+0000", 2024-04-18T14:43:59.836 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0020800889999999998 2024-04-18T14:43:59.836 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:59.836 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:59.836 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-04-18T14:43:59.836 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:44.426777+0000", 2024-04-18T14:43:59.836 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00027088900000000001 2024-04-18T14:43:59.836 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:59.836 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:59.836 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_started", 2024-04-18T14:43:59.836 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:44.427998+0000", 2024-04-18T14:43:59.836 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0012216659999999999 2024-04-18T14:43:59.837 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:59.837 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:59.837 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_committed", 2024-04-18T14:43:59.837 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:44.429614+0000", 2024-04-18T14:43:59.837 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0016153039999999999 2024-04-18T14:43:59.837 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:59.837 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:59.837 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-04-18T14:43:59.837 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:44.433173+0000", 2024-04-18T14:43:59.837 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0035592670000000001 2024-04-18T14:43:59.837 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:59.837 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:59.837 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-04-18T14:43:59.837 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:44.433257+0000", 2024-04-18T14:43:59.837 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 8.3707000000000003e-05 2024-04-18T14:43:59.838 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:43:59.838 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T14:43:59.838 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:43:59.838 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:59.838 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:59.838 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4559.0:298 3.8s0 3:17e457c8:::smithi13430248-35:head [append 0~0] snapc d=[d,b,a,8,7,2] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-18T14:43:59.838 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-04-18T14:43:44.424471+0000", 2024-04-18T14:43:59.838 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 15.384745278, 2024-04-18T14:43:59.838 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0090639050000000006, 2024-04-18T14:43:59.838 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-04-18T14:43:59.838 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T14:43:59.838 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-04-18T14:43:59.838 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4559", 2024-04-18T14:43:59.838 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "172.21.15.134:0/3113589487", 2024-04-18T14:43:59.838 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 298 2024-04-18T14:43:59.838 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:59.839 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-04-18T14:43:59.839 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:59.839 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-04-18T14:43:59.839 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:44.424471+0000", 2024-04-18T14:43:59.839 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:43:59.839 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:59.839 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:59.839 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-04-18T14:43:59.839 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:44.424471+0000", 2024-04-18T14:43:59.839 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:43:59.839 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:59.839 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:59.839 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-04-18T14:43:59.839 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:44.424470+0000", 2024-04-18T14:43:59.839 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 4294967295.9999995 2024-04-18T14:43:59.840 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:59.840 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:59.840 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-04-18T14:43:59.840 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:44.424474+0000", 2024-04-18T14:43:59.840 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.676e-06 2024-04-18T14:43:59.840 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:59.840 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:59.840 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-04-18T14:43:59.840 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:44.424483+0000", 2024-04-18T14:43:59.840 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 8.3629999999999994e-06 2024-04-18T14:43:59.840 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:59.840 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:59.840 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-04-18T14:43:59.840 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:44.424488+0000", 2024-04-18T14:43:59.840 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 5.541e-06 2024-04-18T14:43:59.841 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:59.841 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:59.841 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-04-18T14:43:59.841 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:44.428867+0000", 2024-04-18T14:43:59.841 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0043784760000000001 2024-04-18T14:43:59.841 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:59.841 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:59.841 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-04-18T14:43:59.841 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:44.428973+0000", 2024-04-18T14:43:59.841 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000106053 2024-04-18T14:43:59.841 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:59.841 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:59.841 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_started", 2024-04-18T14:43:59.841 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:44.429349+0000", 2024-04-18T14:43:59.841 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00037653699999999998 2024-04-18T14:43:59.841 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:59.842 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:59.842 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_committed", 2024-04-18T14:43:59.842 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:44.430138+0000", 2024-04-18T14:43:59.842 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00078843000000000001 2024-04-18T14:43:59.842 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:59.842 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:59.842 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-04-18T14:43:59.842 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:44.433439+0000", 2024-04-18T14:43:59.842 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0033013579999999999 2024-04-18T14:43:59.842 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:59.842 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:59.842 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-04-18T14:43:59.842 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:44.433535+0000", 2024-04-18T14:43:59.842 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 9.6076000000000006e-05 2024-04-18T14:43:59.842 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:43:59.843 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T14:43:59.843 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:43:59.843 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:59.843 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:59.843 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4559.0:303 3.8s0 3:1890b7c2:::smithi13430248-36:head [append 0~0] snapc d=[d,b,a,8,7,2] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-18T14:43:59.843 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-04-18T14:43:44.469024+0000", 2024-04-18T14:43:59.843 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 15.340192646, 2024-04-18T14:43:59.843 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0063077230000000003, 2024-04-18T14:43:59.843 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-04-18T14:43:59.843 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T14:43:59.843 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-04-18T14:43:59.843 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4559", 2024-04-18T14:43:59.843 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "172.21.15.134:0/3113589487", 2024-04-18T14:43:59.843 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 303 2024-04-18T14:43:59.843 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:59.843 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-04-18T14:43:59.844 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:59.844 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-04-18T14:43:59.844 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:44.469024+0000", 2024-04-18T14:43:59.844 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:43:59.844 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:59.844 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:59.844 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-04-18T14:43:59.844 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:44.469024+0000", 2024-04-18T14:43:59.844 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:43:59.844 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:59.844 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:59.844 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-04-18T14:43:59.844 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:44.469021+0000", 2024-04-18T14:43:59.844 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 4294967295.9999976 2024-04-18T14:43:59.844 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:59.844 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:59.845 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-04-18T14:43:59.845 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:44.469035+0000", 2024-04-18T14:43:59.845 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.4286e-05 2024-04-18T14:43:59.845 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:59.845 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:59.845 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-04-18T14:43:59.845 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:44.469071+0000", 2024-04-18T14:43:59.845 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.5709e-05 2024-04-18T14:43:59.845 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:59.845 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:59.845 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-04-18T14:43:59.845 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:44.469088+0000", 2024-04-18T14:43:59.845 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.7359000000000001e-05 2024-04-18T14:43:59.845 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:59.845 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:59.845 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-04-18T14:43:59.846 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:44.469164+0000", 2024-04-18T14:43:59.846 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 7.5927999999999995e-05 2024-04-18T14:43:59.846 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:59.846 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:59.846 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-04-18T14:43:59.846 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:44.469288+0000", 2024-04-18T14:43:59.846 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000123783 2024-04-18T14:43:59.846 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:59.846 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:59.846 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_started", 2024-04-18T14:43:59.846 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:44.470045+0000", 2024-04-18T14:43:59.846 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00075715199999999998 2024-04-18T14:43:59.846 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:59.846 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:59.846 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_committed", 2024-04-18T14:43:59.847 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:44.474988+0000", 2024-04-18T14:43:59.847 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0049426139999999997 2024-04-18T14:43:59.847 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:59.847 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:59.847 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-04-18T14:43:59.847 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:44.475167+0000", 2024-04-18T14:43:59.847 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000179123 2024-04-18T14:43:59.847 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:59.847 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:59.847 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-04-18T14:43:59.847 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:44.475331+0000", 2024-04-18T14:43:59.847 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00016438600000000001 2024-04-18T14:43:59.847 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:43:59.847 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T14:43:59.847 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:43:59.848 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:59.848 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:59.848 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4559.0:304 3.8s0 3:1890b7c2:::smithi13430248-36:head [rollback 8] snapc d=[d,b,a,8,7,2] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-18T14:43:59.848 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-04-18T14:43:44.469108+0000", 2024-04-18T14:43:59.848 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 15.340107890000001, 2024-04-18T14:43:59.848 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0066242740000000003, 2024-04-18T14:43:59.848 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-04-18T14:43:59.848 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T14:43:59.848 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-04-18T14:43:59.848 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4559", 2024-04-18T14:43:59.848 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "172.21.15.134:0/3113589487", 2024-04-18T14:43:59.848 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 304 2024-04-18T14:43:59.848 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:59.848 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-04-18T14:43:59.848 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:59.849 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-04-18T14:43:59.849 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:44.469108+0000", 2024-04-18T14:43:59.849 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:43:59.849 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:59.849 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:59.849 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-04-18T14:43:59.849 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:44.469108+0000", 2024-04-18T14:43:59.849 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:43:59.849 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:59.849 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:59.849 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-04-18T14:43:59.849 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:44.469108+0000", 2024-04-18T14:43:59.849 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 4294967295.999999 2024-04-18T14:43:59.849 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:59.849 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:59.849 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-04-18T14:43:59.850 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:44.469114+0000", 2024-04-18T14:43:59.850 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 6.4130000000000003e-06 2024-04-18T14:43:59.850 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:59.850 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:59.850 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-04-18T14:43:59.850 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:44.469129+0000", 2024-04-18T14:43:59.850 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.4653e-05 2024-04-18T14:43:59.850 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:59.850 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:59.850 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-04-18T14:43:59.850 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:44.469137+0000", 2024-04-18T14:43:59.850 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 8.4319999999999999e-06 2024-04-18T14:43:59.850 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:59.850 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:59.850 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-04-18T14:43:59.851 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:44.470725+0000", 2024-04-18T14:43:59.851 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0015880709999999999 2024-04-18T14:43:59.851 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:59.851 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:59.851 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-04-18T14:43:59.851 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:44.470999+0000", 2024-04-18T14:43:59.851 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000274152 2024-04-18T14:43:59.851 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:59.851 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:59.851 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_started", 2024-04-18T14:43:59.851 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:44.472374+0000", 2024-04-18T14:43:59.851 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.001374402 2024-04-18T14:43:59.851 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:59.851 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:59.851 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_committed", 2024-04-18T14:43:59.851 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:44.475541+0000", 2024-04-18T14:43:59.852 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0031671249999999998 2024-04-18T14:43:59.852 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:59.852 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:59.852 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-04-18T14:43:59.852 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:44.475638+0000", 2024-04-18T14:43:59.852 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 9.7286000000000003e-05 2024-04-18T14:43:59.852 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:59.852 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:59.852 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-04-18T14:43:59.852 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:44.475733+0000", 2024-04-18T14:43:59.852 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 9.4512999999999994e-05 2024-04-18T14:43:59.852 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:43:59.852 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T14:43:59.852 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:43:59.852 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:59.853 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:59.853 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4559.0:305 3.8s0 3:1890b7c2:::smithi13430248-36:head [append 0~0] snapc d=[d,b,a,8,7,2] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-18T14:43:59.853 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-04-18T14:43:44.469182+0000", 2024-04-18T14:43:59.853 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 15.340034116, 2024-04-18T14:43:59.853 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0088683770000000002, 2024-04-18T14:43:59.853 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-04-18T14:43:59.853 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T14:43:59.853 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-04-18T14:43:59.853 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4559", 2024-04-18T14:43:59.853 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "172.21.15.134:0/3113589487", 2024-04-18T14:43:59.853 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 305 2024-04-18T14:43:59.853 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:59.853 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-04-18T14:43:59.853 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:59.853 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-04-18T14:43:59.854 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:44.469182+0000", 2024-04-18T14:43:59.854 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:43:59.854 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:59.854 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:59.854 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-04-18T14:43:59.854 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:44.469182+0000", 2024-04-18T14:43:59.854 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:43:59.854 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:59.854 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:59.854 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-04-18T14:43:59.854 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:44.469181+0000", 2024-04-18T14:43:59.854 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 4294967295.999999 2024-04-18T14:43:59.854 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:59.854 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:59.854 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-04-18T14:43:59.855 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:44.469187+0000", 2024-04-18T14:43:59.855 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 5.1259999999999997e-06 2024-04-18T14:43:59.855 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:59.855 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:59.855 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-04-18T14:43:59.855 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:44.469198+0000", 2024-04-18T14:43:59.855 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.1250000000000001e-05 2024-04-18T14:43:59.855 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:59.855 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:59.855 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-04-18T14:43:59.855 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:44.469206+0000", 2024-04-18T14:43:59.855 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 8.4100000000000008e-06 2024-04-18T14:43:59.855 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:59.855 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:59.855 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-04-18T14:43:59.855 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:44.473247+0000", 2024-04-18T14:43:59.856 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0040405559999999998 2024-04-18T14:43:59.856 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:59.856 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:59.856 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-04-18T14:43:59.856 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:44.473342+0000", 2024-04-18T14:43:59.856 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 9.5245e-05 2024-04-18T14:43:59.856 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:59.856 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:59.856 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_started", 2024-04-18T14:43:59.856 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:44.473779+0000", 2024-04-18T14:43:59.856 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00043703200000000001 2024-04-18T14:43:59.856 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:59.856 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:59.856 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_committed", 2024-04-18T14:43:59.856 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:44.475738+0000", 2024-04-18T14:43:59.856 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0019593140000000002 2024-04-18T14:43:59.857 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:59.857 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:59.857 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-04-18T14:43:59.857 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:44.477917+0000", 2024-04-18T14:43:59.857 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0021783589999999999 2024-04-18T14:43:59.857 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:59.857 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:59.857 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-04-18T14:43:59.857 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:44.478051+0000", 2024-04-18T14:43:59.857 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00013393199999999999 2024-04-18T14:43:59.857 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:43:59.857 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T14:43:59.857 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:43:59.857 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:59.857 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:59.858 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "MOSDECSubOpWrite(3.9s1 46/30 ECSubWrite(tid=58, reqid=osd.12.0:58, at_version=46'44, trim_to=0'0, roll_forward_to=45'42))", 2024-04-18T14:43:59.858 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-04-18T14:43:45.385347+0000", 2024-04-18T14:43:59.858 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 14.423869349, 2024-04-18T14:43:59.858 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0072784470000000004, 2024-04-18T14:43:59.858 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-04-18T14:43:59.858 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "reached pg", 2024-04-18T14:43:59.858 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-04-18T14:43:59.858 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:59.858 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-04-18T14:43:59.858 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:45.385347+0000", 2024-04-18T14:43:59.858 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:43:59.858 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:59.858 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:59.858 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-04-18T14:43:59.858 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:45.385347+0000", 2024-04-18T14:43:59.859 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:43:59.859 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:59.859 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:59.859 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-04-18T14:43:59.859 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:45.385347+0000", 2024-04-18T14:43:59.859 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 4294967295.9999995 2024-04-18T14:43:59.859 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:59.859 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:59.859 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-04-18T14:43:59.859 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:45.385395+0000", 2024-04-18T14:43:59.859 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 4.8242000000000003e-05 2024-04-18T14:43:59.859 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:59.859 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:59.859 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-04-18T14:43:59.859 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:45.385426+0000", 2024-04-18T14:43:59.860 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.1717999999999997e-05 2024-04-18T14:43:59.860 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:59.860 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:59.860 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-04-18T14:43:59.860 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:45.385451+0000", 2024-04-18T14:43:59.860 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.4703e-05 2024-04-18T14:43:59.860 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:59.860 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:59.860 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-04-18T14:43:59.860 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:45.385618+0000", 2024-04-18T14:43:59.860 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000166916 2024-04-18T14:43:59.860 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:59.860 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:59.860 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_started", 2024-04-18T14:43:59.860 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:45.385665+0000", 2024-04-18T14:43:59.860 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 4.6554999999999997e-05 2024-04-18T14:43:59.861 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:59.861 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:59.861 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_committed", 2024-04-18T14:43:59.861 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:45.392568+0000", 2024-04-18T14:43:59.861 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0069036790000000002 2024-04-18T14:43:59.861 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:59.861 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:59.861 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-04-18T14:43:59.861 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:45.392625+0000", 2024-04-18T14:43:59.861 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 5.7144e-05 2024-04-18T14:43:59.861 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:43:59.861 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T14:43:59.861 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:43:59.861 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:59.861 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:59.862 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4559.0:382 3.8s0 3:106507f9:::smithi13430248-8:head [read 0~2228224,checksum,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-04-18T14:43:59.862 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-04-18T14:43:50.413916+0000", 2024-04-18T14:43:59.862 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 9.3953008120000003, 2024-04-18T14:43:59.862 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0103661, 2024-04-18T14:43:59.862 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-04-18T14:43:59.862 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "started", 2024-04-18T14:43:59.862 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-04-18T14:43:59.862 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4559", 2024-04-18T14:43:59.862 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "172.21.15.134:0/3113589487", 2024-04-18T14:43:59.862 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 382 2024-04-18T14:43:59.862 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:59.862 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-04-18T14:43:59.862 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:59.862 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-04-18T14:43:59.862 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:50.413916+0000", 2024-04-18T14:43:59.863 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:43:59.863 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:59.863 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:59.863 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-04-18T14:43:59.863 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:50.413916+0000", 2024-04-18T14:43:59.863 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:43:59.863 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:59.863 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:59.863 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-04-18T14:43:59.863 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:50.413913+0000", 2024-04-18T14:43:59.863 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 4294967295.9999971 2024-04-18T14:43:59.863 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:59.863 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:59.864 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-04-18T14:43:59.864 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:50.413931+0000", 2024-04-18T14:43:59.864 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.8281999999999999e-05 2024-04-18T14:43:59.864 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:59.864 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:59.864 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-04-18T14:43:59.864 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:50.413964+0000", 2024-04-18T14:43:59.864 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.2999e-05 2024-04-18T14:43:59.864 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:59.864 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:59.864 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-04-18T14:43:59.864 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:50.413984+0000", 2024-04-18T14:43:59.864 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.9715999999999999e-05 2024-04-18T14:43:59.864 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:59.865 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:59.865 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-04-18T14:43:59.865 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:50.414439+0000", 2024-04-18T14:43:59.865 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00045599699999999998 2024-04-18T14:43:59.865 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:59.865 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:59.865 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-04-18T14:43:59.865 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:50.414645+0000", 2024-04-18T14:43:59.865 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00020505600000000001 2024-04-18T14:43:59.865 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:59.865 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:59.865 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-04-18T14:43:59.865 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:50.424282+0000", 2024-04-18T14:43:59.865 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0096371129999999992 2024-04-18T14:43:59.865 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:43:59.866 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T14:43:59.866 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:43:59.866 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:59.866 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:59.866 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4559.0:383 3.8s0 3:106507f9:::smithi13430248-8:head [read 0~2228224,checksum] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-04-18T14:43:59.866 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-04-18T14:43:50.414024+0000", 2024-04-18T14:43:59.866 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 9.3951922529999994, 2024-04-18T14:43:59.866 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.012465149, 2024-04-18T14:43:59.866 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-04-18T14:43:59.866 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "started", 2024-04-18T14:43:59.866 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-04-18T14:43:59.866 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4559", 2024-04-18T14:43:59.866 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "172.21.15.134:0/3113589487", 2024-04-18T14:43:59.866 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 383 2024-04-18T14:43:59.866 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:59.867 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-04-18T14:43:59.867 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:59.867 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-04-18T14:43:59.867 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:50.414024+0000", 2024-04-18T14:43:59.867 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:43:59.867 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:59.867 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:59.867 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-04-18T14:43:59.867 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:50.414024+0000", 2024-04-18T14:43:59.867 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:43:59.867 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:59.867 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:59.867 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-04-18T14:43:59.867 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:50.414023+0000", 2024-04-18T14:43:59.867 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 4294967295.9999986 2024-04-18T14:43:59.868 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:59.868 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:59.868 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-04-18T14:43:59.868 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:50.414032+0000", 2024-04-18T14:43:59.868 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 9.6600000000000007e-06 2024-04-18T14:43:59.868 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:59.868 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:59.868 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-04-18T14:43:59.868 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:50.414057+0000", 2024-04-18T14:43:59.868 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.4615000000000001e-05 2024-04-18T14:43:59.868 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:59.868 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:59.868 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-04-18T14:43:59.868 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:50.414073+0000", 2024-04-18T14:43:59.868 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.5943e-05 2024-04-18T14:43:59.869 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:59.869 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:59.869 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-04-18T14:43:59.869 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:50.415758+0000", 2024-04-18T14:43:59.869 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00168538 2024-04-18T14:43:59.869 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:59.869 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:59.869 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-04-18T14:43:59.869 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:50.416024+0000", 2024-04-18T14:43:59.869 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00026525099999999999 2024-04-18T14:43:59.869 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:59.869 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:59.869 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-04-18T14:43:59.869 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:50.426489+0000", 2024-04-18T14:43:59.870 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.010465746 2024-04-18T14:43:59.870 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:43:59.870 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T14:43:59.870 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:43:59.870 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:59.870 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:59.870 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4559.0:384 3.8s0 3:106507f9:::smithi13430248-8:head [read 0~2228224,checksum] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-04-18T14:43:59.870 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-04-18T14:43:50.414088+0000", 2024-04-18T14:43:59.870 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 9.3951283910000001, 2024-04-18T14:43:59.870 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.014292908999999999, 2024-04-18T14:43:59.870 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-04-18T14:43:59.870 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "started", 2024-04-18T14:43:59.870 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-04-18T14:43:59.870 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4559", 2024-04-18T14:43:59.870 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "172.21.15.134:0/3113589487", 2024-04-18T14:43:59.871 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 384 2024-04-18T14:43:59.871 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:59.871 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-04-18T14:43:59.871 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:59.871 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-04-18T14:43:59.871 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:50.414088+0000", 2024-04-18T14:43:59.871 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:43:59.871 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:59.871 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:59.871 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-04-18T14:43:59.871 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:50.414088+0000", 2024-04-18T14:43:59.871 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:43:59.871 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:59.871 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:59.871 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-04-18T14:43:59.871 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:50.414087+0000", 2024-04-18T14:43:59.872 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 4294967295.999999 2024-04-18T14:43:59.872 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:59.872 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:59.872 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-04-18T14:43:59.872 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:50.414094+0000", 2024-04-18T14:43:59.872 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 7.4229999999999999e-06 2024-04-18T14:43:59.872 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:59.872 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:59.872 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-04-18T14:43:59.872 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:50.414116+0000", 2024-04-18T14:43:59.872 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.1699999999999999e-05 2024-04-18T14:43:59.872 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:59.872 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:59.872 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-04-18T14:43:59.872 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:50.414134+0000", 2024-04-18T14:43:59.872 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.7662000000000001e-05 2024-04-18T14:43:59.873 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:59.873 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:59.873 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-04-18T14:43:59.873 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:50.420027+0000", 2024-04-18T14:43:59.873 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0058936429999999996 2024-04-18T14:43:59.873 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:59.873 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:59.873 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-04-18T14:43:59.873 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:50.420289+0000", 2024-04-18T14:43:59.873 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00026191700000000002 2024-04-18T14:43:59.873 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:59.873 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:59.873 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-04-18T14:43:59.873 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:50.428381+0000", 2024-04-18T14:43:59.873 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0080917279999999994 2024-04-18T14:43:59.874 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:43:59.874 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T14:43:59.874 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:43:59.874 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:59.874 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:59.874 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "MOSDECSubOpReadReply(3.8s0 50/30 ECSubReadReply(tid=65, attrs_read=0))", 2024-04-18T14:43:59.874 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-04-18T14:43:50.418678+0000", 2024-04-18T14:43:59.874 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 9.3905382549999992, 2024-04-18T14:43:59.874 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0057536139999999998, 2024-04-18T14:43:59.874 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-04-18T14:43:59.874 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "reached pg", 2024-04-18T14:43:59.874 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-04-18T14:43:59.874 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:59.874 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-04-18T14:43:59.875 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:50.418678+0000", 2024-04-18T14:43:59.875 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:43:59.875 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:59.875 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:59.875 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-04-18T14:43:59.875 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:50.418678+0000", 2024-04-18T14:43:59.875 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:43:59.875 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:59.875 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:59.875 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-04-18T14:43:59.875 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:50.418677+0000", 2024-04-18T14:43:59.875 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 4294967295.9999986 2024-04-18T14:43:59.875 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:59.875 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:59.875 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-04-18T14:43:59.876 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:50.421089+0000", 2024-04-18T14:43:59.876 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.002412314 2024-04-18T14:43:59.876 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:59.876 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:59.876 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-04-18T14:43:59.876 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:50.421119+0000", 2024-04-18T14:43:59.876 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.9595999999999999e-05 2024-04-18T14:43:59.876 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:59.876 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:59.876 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-04-18T14:43:59.876 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:50.421139+0000", 2024-04-18T14:43:59.876 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.0219000000000001e-05 2024-04-18T14:43:59.876 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:59.876 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:59.876 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-04-18T14:43:59.876 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:50.422075+0000", 2024-04-18T14:43:59.877 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00093577600000000003 2024-04-18T14:43:59.877 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:59.877 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:59.877 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-04-18T14:43:59.877 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:50.424432+0000", 2024-04-18T14:43:59.877 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0023571529999999999 2024-04-18T14:43:59.877 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:43:59.877 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T14:43:59.877 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:43:59.877 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:59.877 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:59.877 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "MOSDECSubOpReadReply(3.8s0 50/30 ECSubReadReply(tid=66, attrs_read=0))", 2024-04-18T14:43:59.877 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-04-18T14:43:50.421164+0000", 2024-04-18T14:43:59.877 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 9.3880524409999992, 2024-04-18T14:43:59.877 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0053864270000000001, 2024-04-18T14:43:59.877 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-04-18T14:43:59.878 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "reached pg", 2024-04-18T14:43:59.878 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-04-18T14:43:59.878 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:59.878 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-04-18T14:43:59.878 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:50.421164+0000", 2024-04-18T14:43:59.878 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:43:59.878 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:59.878 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:59.878 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-04-18T14:43:59.878 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:50.421164+0000", 2024-04-18T14:43:59.878 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:43:59.878 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:59.878 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:59.878 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-04-18T14:43:59.878 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:50.421163+0000", 2024-04-18T14:43:59.879 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 4294967295.999999 2024-04-18T14:43:59.879 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:59.879 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:59.879 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-04-18T14:43:59.879 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:50.423141+0000", 2024-04-18T14:43:59.879 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.001977969 2024-04-18T14:43:59.879 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:59.879 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:59.879 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-04-18T14:43:59.879 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:50.423162+0000", 2024-04-18T14:43:59.879 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.1256000000000001e-05 2024-04-18T14:43:59.879 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:59.879 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:59.879 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-04-18T14:43:59.879 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:50.423172+0000", 2024-04-18T14:43:59.880 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.0243e-05 2024-04-18T14:43:59.880 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:59.880 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:59.880 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-04-18T14:43:59.880 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:50.424776+0000", 2024-04-18T14:43:59.880 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.001604 2024-04-18T14:43:59.880 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:59.880 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:59.880 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-04-18T14:43:59.880 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:50.426550+0000", 2024-04-18T14:43:59.880 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.001774039 2024-04-18T14:43:59.880 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:43:59.880 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T14:43:59.880 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:43:59.880 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:59.880 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:59.881 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4559.0:509 3.8s0 3:1890b7c2:::smithi13430248-36:head [append 0~0] snapc 19=[19,16,14,13,11,f,b,a,7,2] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-18T14:43:59.881 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-04-18T14:43:56.576299+0000", 2024-04-18T14:43:59.881 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 3.2329175299999999, 2024-04-18T14:43:59.881 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0095686120000000006, 2024-04-18T14:43:59.881 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-04-18T14:43:59.881 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T14:43:59.881 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-04-18T14:43:59.881 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4559", 2024-04-18T14:43:59.881 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "172.21.15.134:0/3113589487", 2024-04-18T14:43:59.881 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 509 2024-04-18T14:43:59.881 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:59.881 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-04-18T14:43:59.881 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:59.882 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-04-18T14:43:59.882 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:56.576299+0000", 2024-04-18T14:43:59.882 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:43:59.882 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:59.882 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:59.882 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-04-18T14:43:59.882 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:56.576299+0000", 2024-04-18T14:43:59.882 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:43:59.882 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:59.882 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:59.882 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-04-18T14:43:59.882 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:56.576296+0000", 2024-04-18T14:43:59.882 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 4294967295.9999971 2024-04-18T14:43:59.882 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:59.882 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:59.883 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-04-18T14:43:59.883 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:56.576330+0000", 2024-04-18T14:43:59.883 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.4276000000000002e-05 2024-04-18T14:43:59.883 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:59.883 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:59.883 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-04-18T14:43:59.883 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:56.576362+0000", 2024-04-18T14:43:59.883 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.2109e-05 2024-04-18T14:43:59.883 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:59.883 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:59.883 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-04-18T14:43:59.883 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:56.576387+0000", 2024-04-18T14:43:59.883 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.4261999999999999e-05 2024-04-18T14:43:59.883 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:59.883 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:59.884 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-04-18T14:43:59.884 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:56.576540+0000", 2024-04-18T14:43:59.884 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000153719 2024-04-18T14:43:59.884 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:59.884 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:59.884 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-04-18T14:43:59.884 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:56.576831+0000", 2024-04-18T14:43:59.884 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00029044100000000001 2024-04-18T14:43:59.884 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:59.884 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:59.884 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_started", 2024-04-18T14:43:59.884 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:56.578693+0000", 2024-04-18T14:43:59.884 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0018623019999999999 2024-04-18T14:43:59.884 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:59.884 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:59.884 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_committed", 2024-04-18T14:43:59.885 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:56.584910+0000", 2024-04-18T14:43:59.885 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0062171689999999998 2024-04-18T14:43:59.885 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:59.885 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:59.885 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-04-18T14:43:59.885 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:56.585713+0000", 2024-04-18T14:43:59.885 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00080255300000000001 2024-04-18T14:43:59.885 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:59.885 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:59.885 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-04-18T14:43:59.885 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:56.585867+0000", 2024-04-18T14:43:59.885 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00015468799999999999 2024-04-18T14:43:59.885 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:43:59.885 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T14:43:59.885 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:43:59.885 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:59.886 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:59.886 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4559.0:510 3.8s0 3:1890b7c2:::smithi13430248-36:head [rollback 16] snapc 19=[19,16,14,13,11,f,b,a,7,2] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-18T14:43:59.886 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-04-18T14:43:56.576406+0000", 2024-04-18T14:43:59.886 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 3.2328106399999998, 2024-04-18T14:43:59.886 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.011603123, 2024-04-18T14:43:59.886 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-04-18T14:43:59.886 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T14:43:59.886 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-04-18T14:43:59.886 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4559", 2024-04-18T14:43:59.886 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "172.21.15.134:0/3113589487", 2024-04-18T14:43:59.886 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 510 2024-04-18T14:43:59.886 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:59.886 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-04-18T14:43:59.886 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:59.886 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-04-18T14:43:59.887 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:56.576406+0000", 2024-04-18T14:43:59.887 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:43:59.887 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:59.887 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:59.887 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-04-18T14:43:59.887 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:56.576406+0000", 2024-04-18T14:43:59.887 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:43:59.887 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:59.887 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:59.887 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-04-18T14:43:59.887 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:56.576405+0000", 2024-04-18T14:43:59.887 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 4294967295.999999 2024-04-18T14:43:59.887 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:59.887 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:59.888 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-04-18T14:43:59.888 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:56.576410+0000", 2024-04-18T14:43:59.888 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 4.7589999999999997e-06 2024-04-18T14:43:59.888 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:59.888 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:59.888 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-04-18T14:43:59.888 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:56.576421+0000", 2024-04-18T14:43:59.888 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.1433e-05 2024-04-18T14:43:59.888 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:59.888 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:59.888 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-04-18T14:43:59.888 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:56.576429+0000", 2024-04-18T14:43:59.888 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 8.0430000000000008e-06 2024-04-18T14:43:59.888 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:59.888 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:59.889 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-04-18T14:43:59.889 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:56.580050+0000", 2024-04-18T14:43:59.889 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0036211519999999999 2024-04-18T14:43:59.889 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:59.889 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:59.889 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-04-18T14:43:59.889 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:56.580408+0000", 2024-04-18T14:43:59.889 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00035796599999999998 2024-04-18T14:43:59.889 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:59.889 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:59.889 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_started", 2024-04-18T14:43:59.889 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:56.581945+0000", 2024-04-18T14:43:59.889 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.001537219 2024-04-18T14:43:59.889 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:59.889 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:59.890 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_committed", 2024-04-18T14:43:59.890 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:56.585026+0000", 2024-04-18T14:43:59.890 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0030803290000000001 2024-04-18T14:43:59.890 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:59.890 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:59.890 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-04-18T14:43:59.890 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:56.587820+0000", 2024-04-18T14:43:59.890 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0027939810000000001 2024-04-18T14:43:59.890 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:59.890 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:59.890 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-04-18T14:43:59.890 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:56.588009+0000", 2024-04-18T14:43:59.890 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00018922399999999999 2024-04-18T14:43:59.890 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:43:59.890 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T14:43:59.891 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:43:59.891 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:59.891 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:59.891 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4559.0:511 3.8s0 3:1890b7c2:::smithi13430248-36:head [append 0~0] snapc 19=[19,16,14,13,11,f,b,a,7,2] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-18T14:43:59.891 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-04-18T14:43:56.576521+0000", 2024-04-18T14:43:59.891 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 3.2326950769999998, 2024-04-18T14:43:59.891 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.015922446999999999, 2024-04-18T14:43:59.891 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-04-18T14:43:59.891 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T14:43:59.891 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-04-18T14:43:59.891 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4559", 2024-04-18T14:43:59.891 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "172.21.15.134:0/3113589487", 2024-04-18T14:43:59.891 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 511 2024-04-18T14:43:59.891 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:59.891 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-04-18T14:43:59.892 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:59.892 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-04-18T14:43:59.892 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:56.576521+0000", 2024-04-18T14:43:59.892 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:43:59.892 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:59.892 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:59.892 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-04-18T14:43:59.892 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:56.576521+0000", 2024-04-18T14:43:59.892 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:43:59.892 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:59.892 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:59.892 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-04-18T14:43:59.892 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:56.576520+0000", 2024-04-18T14:43:59.892 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 4294967295.999999 2024-04-18T14:43:59.892 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:59.893 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:59.893 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-04-18T14:43:59.893 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:56.576526+0000", 2024-04-18T14:43:59.893 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 5.4e-06 2024-04-18T14:43:59.893 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:59.893 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:59.893 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-04-18T14:43:59.893 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:56.576537+0000", 2024-04-18T14:43:59.893 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.092e-05 2024-04-18T14:43:59.893 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:59.893 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:59.893 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-04-18T14:43:59.893 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:56.576545+0000", 2024-04-18T14:43:59.893 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 8.1359999999999997e-06 2024-04-18T14:43:59.893 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:59.893 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:59.894 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-04-18T14:43:59.894 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:56.582916+0000", 2024-04-18T14:43:59.894 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0063709309999999998 2024-04-18T14:43:59.894 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:59.894 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:59.894 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-04-18T14:43:59.894 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:56.583218+0000", 2024-04-18T14:43:59.894 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00030191700000000002 2024-04-18T14:43:59.894 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:59.894 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:59.894 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_started", 2024-04-18T14:43:59.894 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:56.584150+0000", 2024-04-18T14:43:59.894 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00093191499999999996 2024-04-18T14:43:59.894 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:59.894 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:59.895 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_committed", 2024-04-18T14:43:59.895 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:56.585463+0000", 2024-04-18T14:43:59.895 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.001313423 2024-04-18T14:43:59.895 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:59.895 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:59.895 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-04-18T14:43:59.895 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:56.592328+0000", 2024-04-18T14:43:59.895 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0068650860000000003 2024-04-18T14:43:59.895 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:59.895 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:59.895 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-04-18T14:43:59.895 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:56.592444+0000", 2024-04-18T14:43:59.895 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000115526 2024-04-18T14:43:59.895 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:43:59.895 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T14:43:59.895 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:43:59.896 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:59.896 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:59.896 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "MOSDECSubOpWrite(3.1s3 57/30 ECSubWrite(tid=39, reqid=client.4559.0:512, at_version=57'26, trim_to=0'0, roll_forward_to=53'24))", 2024-04-18T14:43:59.896 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-04-18T14:43:56.585727+0000", 2024-04-18T14:43:59.896 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 3.2234890370000002, 2024-04-18T14:43:59.896 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0058309709999999999, 2024-04-18T14:43:59.896 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-04-18T14:43:59.896 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "reached pg", 2024-04-18T14:43:59.896 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-04-18T14:43:59.896 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:59.896 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-04-18T14:43:59.896 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:56.585727+0000", 2024-04-18T14:43:59.896 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:43:59.896 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:59.896 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:59.897 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-04-18T14:43:59.897 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:56.585727+0000", 2024-04-18T14:43:59.897 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:43:59.897 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:59.897 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:59.897 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-04-18T14:43:59.897 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:56.585725+0000", 2024-04-18T14:43:59.897 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 4294967295.9999981 2024-04-18T14:43:59.897 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:59.897 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:59.897 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-04-18T14:43:59.897 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:56.586242+0000", 2024-04-18T14:43:59.897 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00051689800000000001 2024-04-18T14:43:59.897 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:59.897 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:59.898 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-04-18T14:43:59.898 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:56.586269+0000", 2024-04-18T14:43:59.898 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.6582999999999999e-05 2024-04-18T14:43:59.898 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:59.898 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:59.898 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-04-18T14:43:59.898 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:56.586288+0000", 2024-04-18T14:43:59.898 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.8938999999999999e-05 2024-04-18T14:43:59.898 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:59.898 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:59.898 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-04-18T14:43:59.898 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:56.586444+0000", 2024-04-18T14:43:59.898 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000155878 2024-04-18T14:43:59.898 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:59.898 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:59.899 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_started", 2024-04-18T14:43:59.899 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:56.586467+0000", 2024-04-18T14:43:59.899 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.3240000000000001e-05 2024-04-18T14:43:59.899 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:59.899 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:59.899 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_committed", 2024-04-18T14:43:59.899 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:56.591515+0000", 2024-04-18T14:43:59.899 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.005047958 2024-04-18T14:43:59.899 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:43:59.899 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:43:59.899 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-04-18T14:43:59.899 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:56.591558+0000", 2024-04-18T14:43:59.899 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 4.3522000000000001e-05 2024-04-18T14:43:59.899 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:43:59.899 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T14:43:59.900 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:43:59.900 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:43:59.900 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T14:43:59.900 INFO:teuthology.orchestra.run.smithi096.stdout:} 2024-04-18T14:43:59.901 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.9.asok dump_ops_in_flight 2024-04-18T14:43:59.902 INFO:tasks.ceph.osd.10.smithi119.stderr:2024-04-18T14:43:59.902+0000 7f6f24c12640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 10 (PID: 24898) UID: 0 2024-04-18T14:44:00.002 INFO:tasks.ceph.osd.9.smithi096.stderr:2024-04-18T14:43:59.998+0000 7fa2c1cbf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 9 (PID: 24891) UID: 0 2024-04-18T14:44:00.019 INFO:teuthology.orchestra.run.smithi086.stdout:osd.15: {} 2024-04-18T14:44:00.019 INFO:teuthology.orchestra.run.smithi086.stderr:osd.15: osd_enable_op_tracker = '' 2024-04-18T14:44:00.031 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2024-04-18T14:44:00.031 INFO:teuthology.orchestra.run.smithi096.stdout: "ops": [], 2024-04-18T14:44:00.031 INFO:teuthology.orchestra.run.smithi096.stdout: "num_ops": 0 2024-04-18T14:44:00.031 INFO:teuthology.orchestra.run.smithi096.stdout:} 2024-04-18T14:44:00.046 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.9.asok dump_blocked_ops 2024-04-18T14:44:00.103 INFO:tasks.ceph.osd.8.smithi086.stderr:2024-04-18T14:44:00.102+0000 7f29f7b9d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 8 (PID: 24958) UID: 0 2024-04-18T14:44:00.204 INFO:tasks.ceph.osd.5.smithi096.stderr:2024-04-18T14:44:00.202+0000 7fc33f25b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 24889) UID: 0 2024-04-18T14:44:00.210 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2024-04-18T14:44:00.210 INFO:teuthology.orchestra.run.smithi096.stdout: "ops": [], 2024-04-18T14:44:00.210 INFO:teuthology.orchestra.run.smithi096.stdout: "complaint_time": 30, 2024-04-18T14:44:00.210 INFO:teuthology.orchestra.run.smithi096.stdout: "num_blocked_ops": 0 2024-04-18T14:44:00.210 INFO:teuthology.orchestra.run.smithi096.stdout:} 2024-04-18T14:44:00.225 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.9.asok dump_historic_ops 2024-04-18T14:44:00.305 INFO:tasks.ceph.osd.11.smithi134.stderr:2024-04-18T14:44:00.308+0000 7f2d36f12640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 11 (PID: 25216) UID: 0 2024-04-18T14:44:00.376 INFO:teuthology.orchestra.run.smithi086.stderr:reweighted osd.8 to 1 (10000) 2024-04-18T14:44:00.376 INFO:teuthology.orchestra.run.smithi086.stderr:nodeep-scrub is unset 2024-04-18T14:44:00.377 INFO:tasks.rados.rados.0.smithi134.stdout:223: done (1 left) 2024-04-18T14:44:00.377 INFO:tasks.rados.rados.0.smithi134.stdout:224: done (0 left) 2024-04-18T14:44:00.377 INFO:tasks.rados.rados.0.smithi134.stdout:225: copy_from oid 26 from oid 18 current snap is 20 2024-04-18T14:44:00.377 INFO:tasks.rados.rados.0.smithi134.stdout:226: read oid 35 snap -1 2024-04-18T14:44:00.377 INFO:tasks.rados.rados.0.smithi134.stdout:226: expect (ObjNum 34 snap 0 seq_num 34) 2024-04-18T14:44:00.378 INFO:tasks.rados.rados.0.smithi134.stdout:227: rmattr oid 10 current snap is 20 2024-04-18T14:44:00.378 INFO:tasks.rados.rados.0.smithi134.stdout:227: done (2 left) 2024-04-18T14:44:00.378 INFO:tasks.rados.rados.0.smithi134.stdout:228: snap_create 2024-04-18T14:44:00.388 INFO:tasks.rados.rados.0.smithi134.stdout:226: expect (ObjNum 34 snap 0 seq_num 34) 2024-04-18T14:44:00.394 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2024-04-18T14:44:00.394 INFO:teuthology.orchestra.run.smithi096.stdout: "size": 20, 2024-04-18T14:44:00.394 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 600, 2024-04-18T14:44:00.394 INFO:teuthology.orchestra.run.smithi096.stdout: "ops": [ 2024-04-18T14:44:00.394 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:00.394 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "MOSDECSubOpWrite(3.es1 45/30 ECSubWrite(tid=21, reqid=client.4559.0:306, at_version=45'13, trim_to=0'0, roll_forward_to=44'11))", 2024-04-18T14:44:00.394 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-04-18T14:43:44.507234+0000", 2024-04-18T14:44:00.394 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 15.887827046, 2024-04-18T14:44:00.394 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0040415399999999997, 2024-04-18T14:44:00.394 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-04-18T14:44:00.395 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "reached pg", 2024-04-18T14:44:00.395 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-04-18T14:44:00.395 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:00.395 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-04-18T14:44:00.395 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:44.507234+0000", 2024-04-18T14:44:00.395 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:44:00.395 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:00.395 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:00.395 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-04-18T14:44:00.395 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:44.507234+0000", 2024-04-18T14:44:00.395 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:44:00.395 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:00.395 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:00.396 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-04-18T14:44:00.396 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:44.507234+0000", 2024-04-18T14:44:00.396 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 4294967295.9999995 2024-04-18T14:44:00.396 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:00.396 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:00.396 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-04-18T14:44:00.396 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:44.507591+0000", 2024-04-18T14:44:00.396 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00035761899999999999 2024-04-18T14:44:00.396 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:00.396 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:00.396 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-04-18T14:44:00.396 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:44.507620+0000", 2024-04-18T14:44:00.396 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.8789000000000002e-05 2024-04-18T14:44:00.396 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:00.396 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:00.397 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-04-18T14:44:00.397 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:44.507637+0000", 2024-04-18T14:44:00.397 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.6818999999999999e-05 2024-04-18T14:44:00.397 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:00.397 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:00.397 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-04-18T14:44:00.397 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:44.507824+0000", 2024-04-18T14:44:00.397 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00018728500000000001 2024-04-18T14:44:00.397 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:00.397 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:00.397 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_started", 2024-04-18T14:44:00.397 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:44.507844+0000", 2024-04-18T14:44:00.397 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.9326000000000001e-05 2024-04-18T14:44:00.397 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:00.398 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:00.398 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_committed", 2024-04-18T14:44:00.398 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:44.511238+0000", 2024-04-18T14:44:00.398 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.003394621 2024-04-18T14:44:00.398 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:00.398 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:00.398 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-04-18T14:44:00.398 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:44.511276+0000", 2024-04-18T14:44:00.398 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.7558000000000002e-05 2024-04-18T14:44:00.398 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:44:00.398 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T14:44:00.398 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:44:00.398 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:00.398 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:00.399 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "MOSDECSubOpWrite(3.1s2 45/30 ECSubWrite(tid=30, reqid=client.4559.0:320, at_version=45'20, trim_to=0'0, roll_forward_to=44'16))", 2024-04-18T14:44:00.399 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-04-18T14:43:44.567521+0000", 2024-04-18T14:44:00.399 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 15.827539931, 2024-04-18T14:44:00.399 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0041120009999999997, 2024-04-18T14:44:00.399 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-04-18T14:44:00.399 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "reached pg", 2024-04-18T14:44:00.399 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-04-18T14:44:00.399 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:00.399 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-04-18T14:44:00.399 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:44.567521+0000", 2024-04-18T14:44:00.399 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:44:00.399 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:00.399 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:00.399 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-04-18T14:44:00.400 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:44.567521+0000", 2024-04-18T14:44:00.400 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:44:00.400 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:00.400 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:00.400 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-04-18T14:44:00.400 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:44.567520+0000", 2024-04-18T14:44:00.400 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 4294967295.999999 2024-04-18T14:44:00.400 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:00.400 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:00.400 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-04-18T14:44:00.400 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:44.567542+0000", 2024-04-18T14:44:00.400 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.1639000000000001e-05 2024-04-18T14:44:00.400 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:00.400 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:00.401 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-04-18T14:44:00.401 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:44.567559+0000", 2024-04-18T14:44:00.401 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.6725999999999999e-05 2024-04-18T14:44:00.401 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:00.401 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:00.401 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-04-18T14:44:00.401 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:44.567567+0000", 2024-04-18T14:44:00.401 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 7.9540000000000004e-06 2024-04-18T14:44:00.401 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:00.401 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:00.401 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-04-18T14:44:00.401 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:44.567639+0000", 2024-04-18T14:44:00.401 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 7.2065999999999997e-05 2024-04-18T14:44:00.401 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:00.401 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:00.402 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_started", 2024-04-18T14:44:00.402 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:44.567652+0000", 2024-04-18T14:44:00.402 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.2802e-05 2024-04-18T14:44:00.402 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:00.402 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:00.402 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_committed", 2024-04-18T14:44:00.402 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:44.571599+0000", 2024-04-18T14:44:00.402 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0039469329999999997 2024-04-18T14:44:00.402 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:00.402 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:00.402 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-04-18T14:44:00.402 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:44.571633+0000", 2024-04-18T14:44:00.402 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.4702000000000001e-05 2024-04-18T14:44:00.402 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:44:00.403 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T14:44:00.403 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:44:00.403 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:00.403 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:00.403 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "MOSDECSubOpWrite(3.4s3 46/30 ECSubWrite(tid=27, reqid=client.4559.0:322, at_version=46'4, trim_to=0'0, roll_forward_to=33'2))", 2024-04-18T14:44:00.403 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-04-18T14:43:45.379347+0000", 2024-04-18T14:44:00.403 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 15.015714320000001, 2024-04-18T14:44:00.403 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0046847390000000003, 2024-04-18T14:44:00.403 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-04-18T14:44:00.403 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "reached pg", 2024-04-18T14:44:00.403 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-04-18T14:44:00.403 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:00.403 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-04-18T14:44:00.404 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:45.379347+0000", 2024-04-18T14:44:00.404 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:44:00.404 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:00.404 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:00.404 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-04-18T14:44:00.404 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:45.379347+0000", 2024-04-18T14:44:00.404 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:44:00.404 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:00.404 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:00.404 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-04-18T14:44:00.404 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:45.379346+0000", 2024-04-18T14:44:00.404 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 4294967295.999999 2024-04-18T14:44:00.404 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:00.404 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:00.404 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-04-18T14:44:00.405 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:45.379404+0000", 2024-04-18T14:44:00.405 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 5.8561999999999999e-05 2024-04-18T14:44:00.405 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:00.405 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:00.405 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-04-18T14:44:00.405 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:45.379436+0000", 2024-04-18T14:44:00.405 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.1485000000000001e-05 2024-04-18T14:44:00.405 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:00.405 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:00.405 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-04-18T14:44:00.405 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:45.379461+0000", 2024-04-18T14:44:00.405 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.5205999999999999e-05 2024-04-18T14:44:00.405 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:00.405 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:00.406 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-04-18T14:44:00.406 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:45.379595+0000", 2024-04-18T14:44:00.406 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00013433400000000001 2024-04-18T14:44:00.406 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:00.406 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:00.406 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_started", 2024-04-18T14:44:00.406 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:45.379621+0000", 2024-04-18T14:44:00.406 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.5296e-05 2024-04-18T14:44:00.406 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:00.406 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:00.406 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_committed", 2024-04-18T14:44:00.406 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:45.383917+0000", 2024-04-18T14:44:00.406 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0042966209999999996 2024-04-18T14:44:00.406 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:00.407 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:00.407 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-04-18T14:44:00.407 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:45.384032+0000", 2024-04-18T14:44:00.407 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000114289 2024-04-18T14:44:00.407 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:44:00.407 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T14:44:00.407 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:44:00.407 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:00.407 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:00.407 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "MOSDECSubOpWrite(3.4s3 46/30 ECSubWrite(tid=28, reqid=client.4559.0:323, at_version=46'5, trim_to=0'0, roll_forward_to=33'2))", 2024-04-18T14:44:00.407 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-04-18T14:43:45.380885+0000", 2024-04-18T14:44:00.407 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 15.014176143, 2024-04-18T14:44:00.407 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0058591219999999996, 2024-04-18T14:44:00.407 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-04-18T14:44:00.408 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "reached pg", 2024-04-18T14:44:00.408 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-04-18T14:44:00.408 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:00.408 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-04-18T14:44:00.408 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:45.380885+0000", 2024-04-18T14:44:00.408 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:44:00.408 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:00.408 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:00.408 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-04-18T14:44:00.408 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:45.380885+0000", 2024-04-18T14:44:00.408 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:44:00.408 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:00.408 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:00.408 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-04-18T14:44:00.409 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:45.380883+0000", 2024-04-18T14:44:00.409 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 4294967295.9999981 2024-04-18T14:44:00.409 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:00.409 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:00.409 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-04-18T14:44:00.409 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:45.380934+0000", 2024-04-18T14:44:00.409 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 5.0426999999999997e-05 2024-04-18T14:44:00.409 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:00.409 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:00.409 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-04-18T14:44:00.409 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:45.380966+0000", 2024-04-18T14:44:00.409 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.2431999999999997e-05 2024-04-18T14:44:00.409 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:00.410 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:00.410 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-04-18T14:44:00.410 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:45.380988+0000", 2024-04-18T14:44:00.410 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.1645999999999999e-05 2024-04-18T14:44:00.410 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:00.410 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:00.410 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-04-18T14:44:00.410 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:45.381323+0000", 2024-04-18T14:44:00.410 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00033546999999999998 2024-04-18T14:44:00.410 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:00.410 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:00.410 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_started", 2024-04-18T14:44:00.410 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:45.381349+0000", 2024-04-18T14:44:00.411 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.5539000000000001e-05 2024-04-18T14:44:00.411 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:00.411 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:00.411 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_committed", 2024-04-18T14:44:00.411 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:45.386680+0000", 2024-04-18T14:44:00.411 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0053314729999999998 2024-04-18T14:44:00.411 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:00.411 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:00.411 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-04-18T14:44:00.411 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:45.386744+0000", 2024-04-18T14:44:00.411 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 6.4014000000000001e-05 2024-04-18T14:44:00.411 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:44:00.411 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T14:44:00.412 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:44:00.412 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:00.412 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:00.412 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "MOSDECSubOpWrite(3.4s3 46/30 ECSubWrite(tid=29, reqid=client.4559.0:324, at_version=46'6, trim_to=0'0, roll_forward_to=33'2))", 2024-04-18T14:44:00.412 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-04-18T14:43:45.381244+0000", 2024-04-18T14:44:00.412 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 15.013816910999999, 2024-04-18T14:44:00.412 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0055443180000000003, 2024-04-18T14:44:00.412 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-04-18T14:44:00.412 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "reached pg", 2024-04-18T14:44:00.412 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-04-18T14:44:00.412 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:00.412 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-04-18T14:44:00.412 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:45.381244+0000", 2024-04-18T14:44:00.412 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:44:00.413 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:00.413 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:00.413 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-04-18T14:44:00.413 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:45.381244+0000", 2024-04-18T14:44:00.413 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:44:00.413 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:00.413 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:00.413 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-04-18T14:44:00.413 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:45.381243+0000", 2024-04-18T14:44:00.413 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 4294967295.999999 2024-04-18T14:44:00.413 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:00.413 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:00.413 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-04-18T14:44:00.413 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:45.381285+0000", 2024-04-18T14:44:00.413 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 4.1878000000000001e-05 2024-04-18T14:44:00.414 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:00.414 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:00.414 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-04-18T14:44:00.414 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:45.381315+0000", 2024-04-18T14:44:00.414 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.9949000000000001e-05 2024-04-18T14:44:00.414 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:00.414 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:00.414 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-04-18T14:44:00.414 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:45.381341+0000", 2024-04-18T14:44:00.414 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.5995000000000001e-05 2024-04-18T14:44:00.414 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:00.414 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:00.414 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-04-18T14:44:00.415 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:45.382666+0000", 2024-04-18T14:44:00.415 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00132537 2024-04-18T14:44:00.415 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:00.415 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:00.415 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_started", 2024-04-18T14:44:00.415 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:45.382694+0000", 2024-04-18T14:44:00.415 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.7838999999999999e-05 2024-04-18T14:44:00.415 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:00.415 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:00.415 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_committed", 2024-04-18T14:44:00.415 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:45.386755+0000", 2024-04-18T14:44:00.415 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0040607439999999998 2024-04-18T14:44:00.415 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:00.415 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:00.415 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-04-18T14:44:00.416 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:45.386789+0000", 2024-04-18T14:44:00.416 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.3668999999999999e-05 2024-04-18T14:44:00.416 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:44:00.416 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T14:44:00.416 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:44:00.416 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:00.416 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:00.416 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "MOSDECSubOpWrite(3.1s2 46/30 ECSubWrite(tid=32, reqid=osd.6.0:32, at_version=46'22, trim_to=0'0, roll_forward_to=45'20))", 2024-04-18T14:44:00.416 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-04-18T14:43:45.384399+0000", 2024-04-18T14:44:00.416 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 15.010662189, 2024-04-18T14:44:00.416 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0035176000000000001, 2024-04-18T14:44:00.416 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-04-18T14:44:00.417 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "reached pg", 2024-04-18T14:44:00.417 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-04-18T14:44:00.417 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:00.417 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-04-18T14:44:00.417 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:45.384399+0000", 2024-04-18T14:44:00.417 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:44:00.417 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:00.417 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:00.417 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-04-18T14:44:00.417 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:45.384399+0000", 2024-04-18T14:44:00.417 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:44:00.417 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:00.417 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:00.417 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-04-18T14:44:00.418 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:45.384398+0000", 2024-04-18T14:44:00.418 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 4294967295.9999995 2024-04-18T14:44:00.418 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:00.418 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:00.418 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-04-18T14:44:00.418 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:45.384459+0000", 2024-04-18T14:44:00.418 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 6.0781e-05 2024-04-18T14:44:00.418 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:00.418 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:00.418 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-04-18T14:44:00.418 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:45.384490+0000", 2024-04-18T14:44:00.418 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.1035999999999999e-05 2024-04-18T14:44:00.419 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:00.419 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:00.419 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-04-18T14:44:00.419 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:45.384513+0000", 2024-04-18T14:44:00.419 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.2325000000000001e-05 2024-04-18T14:44:00.419 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:00.419 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:00.419 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-04-18T14:44:00.419 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:45.384630+0000", 2024-04-18T14:44:00.419 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000117872 2024-04-18T14:44:00.419 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:00.419 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:00.419 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_started", 2024-04-18T14:44:00.419 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:45.384665+0000", 2024-04-18T14:44:00.420 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.4712000000000002e-05 2024-04-18T14:44:00.420 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:00.420 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:00.420 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_committed", 2024-04-18T14:44:00.420 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:45.387858+0000", 2024-04-18T14:44:00.420 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0031924000000000002 2024-04-18T14:44:00.420 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:00.420 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:00.420 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-04-18T14:44:00.420 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:45.387917+0000", 2024-04-18T14:44:00.420 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 5.9120999999999999e-05 2024-04-18T14:44:00.420 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:44:00.420 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T14:44:00.420 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:44:00.421 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:00.421 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:00.421 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "MOSDECSubOpWrite(3.6s6 46/30 ECSubWrite(tid=67, reqid=osd.14.0:67, at_version=46'23, trim_to=0'0, roll_forward_to=45'21))", 2024-04-18T14:44:00.421 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-04-18T14:43:45.385486+0000", 2024-04-18T14:44:00.421 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 15.009575094000001, 2024-04-18T14:44:00.421 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0065151990000000002, 2024-04-18T14:44:00.421 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-04-18T14:44:00.421 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "reached pg", 2024-04-18T14:44:00.421 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-04-18T14:44:00.421 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:00.421 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-04-18T14:44:00.421 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:45.385486+0000", 2024-04-18T14:44:00.421 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:44:00.421 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:00.422 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:00.422 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-04-18T14:44:00.422 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:45.385486+0000", 2024-04-18T14:44:00.422 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:44:00.422 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:00.422 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:00.422 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-04-18T14:44:00.422 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:45.385486+0000", 2024-04-18T14:44:00.422 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 4294967295.9999995 2024-04-18T14:44:00.422 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:00.422 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:00.422 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-04-18T14:44:00.422 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:45.385539+0000", 2024-04-18T14:44:00.422 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 5.3910999999999999e-05 2024-04-18T14:44:00.423 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:00.423 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:00.423 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-04-18T14:44:00.423 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:45.385567+0000", 2024-04-18T14:44:00.423 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.7285999999999999e-05 2024-04-18T14:44:00.423 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:00.423 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:00.423 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-04-18T14:44:00.423 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:45.385587+0000", 2024-04-18T14:44:00.423 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.0378999999999999e-05 2024-04-18T14:44:00.423 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:00.423 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:00.423 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-04-18T14:44:00.423 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:45.385746+0000", 2024-04-18T14:44:00.423 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000158834 2024-04-18T14:44:00.424 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:00.424 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:00.424 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_started", 2024-04-18T14:44:00.424 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:45.385771+0000", 2024-04-18T14:44:00.424 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.4695e-05 2024-04-18T14:44:00.424 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:00.424 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:00.424 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_committed", 2024-04-18T14:44:00.424 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:45.391957+0000", 2024-04-18T14:44:00.424 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0061861349999999997 2024-04-18T14:44:00.424 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:00.424 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:00.424 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-04-18T14:44:00.424 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:45.392001+0000", 2024-04-18T14:44:00.425 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 4.4561999999999998e-05 2024-04-18T14:44:00.425 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:44:00.425 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T14:44:00.425 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:44:00.425 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:00.425 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:00.425 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "MOSDECSubOpWrite(3.es1 46/30 ECSubWrite(tid=26, reqid=osd.8.0:26, at_version=46'17, trim_to=0'0, roll_forward_to=45'15))", 2024-04-18T14:44:00.425 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-04-18T14:43:45.388207+0000", 2024-04-18T14:44:00.425 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 15.006853885, 2024-04-18T14:44:00.425 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.007465396, 2024-04-18T14:44:00.425 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-04-18T14:44:00.425 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "reached pg", 2024-04-18T14:44:00.425 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-04-18T14:44:00.426 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:00.426 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-04-18T14:44:00.426 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:45.388207+0000", 2024-04-18T14:44:00.426 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:44:00.426 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:00.426 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:00.426 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-04-18T14:44:00.426 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:45.388207+0000", 2024-04-18T14:44:00.426 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:44:00.426 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:00.426 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:00.426 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-04-18T14:44:00.426 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:45.388206+0000", 2024-04-18T14:44:00.426 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 4294967295.9999986 2024-04-18T14:44:00.427 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:00.427 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:00.427 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-04-18T14:44:00.427 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:45.388263+0000", 2024-04-18T14:44:00.427 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 5.7234999999999997e-05 2024-04-18T14:44:00.427 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:00.427 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:00.427 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-04-18T14:44:00.427 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:45.388288+0000", 2024-04-18T14:44:00.427 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.5079000000000002e-05 2024-04-18T14:44:00.427 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:00.427 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:00.427 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-04-18T14:44:00.428 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:45.388310+0000", 2024-04-18T14:44:00.428 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.1155e-05 2024-04-18T14:44:00.428 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:00.428 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:00.428 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-04-18T14:44:00.428 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:45.388425+0000", 2024-04-18T14:44:00.428 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000115562 2024-04-18T14:44:00.428 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:00.428 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:00.428 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_started", 2024-04-18T14:44:00.428 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:45.388451+0000", 2024-04-18T14:44:00.428 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.5619e-05 2024-04-18T14:44:00.428 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:00.428 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:00.428 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_committed", 2024-04-18T14:44:00.429 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:45.395613+0000", 2024-04-18T14:44:00.429 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0071626850000000002 2024-04-18T14:44:00.429 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:00.429 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:00.429 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-04-18T14:44:00.429 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:45.395673+0000", 2024-04-18T14:44:00.429 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 5.9274000000000002e-05 2024-04-18T14:44:00.429 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:44:00.429 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T14:44:00.429 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:44:00.429 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:00.429 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:00.429 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "MOSDECSubOpWrite(3.4s3 46/30 ECSubWrite(tid=30, reqid=client.4559.0:324, at_version=0'0, trim_to=0'0, roll_forward_to=46'6))", 2024-04-18T14:44:00.429 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-04-18T14:43:45.391558+0000", 2024-04-18T14:44:00.429 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 15.003502814000001, 2024-04-18T14:44:00.430 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0052885939999999998, 2024-04-18T14:44:00.430 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-04-18T14:44:00.430 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "reached pg", 2024-04-18T14:44:00.430 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-04-18T14:44:00.430 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:00.430 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-04-18T14:44:00.430 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:45.391558+0000", 2024-04-18T14:44:00.430 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:44:00.430 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:00.430 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:00.430 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-04-18T14:44:00.430 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:45.391558+0000", 2024-04-18T14:44:00.430 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:44:00.430 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:00.431 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:00.431 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-04-18T14:44:00.431 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:45.391557+0000", 2024-04-18T14:44:00.431 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 4294967295.9999981 2024-04-18T14:44:00.431 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:00.431 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:00.431 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-04-18T14:44:00.431 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:45.391581+0000", 2024-04-18T14:44:00.431 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.4652999999999999e-05 2024-04-18T14:44:00.431 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:00.431 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:00.431 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-04-18T14:44:00.431 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:45.391613+0000", 2024-04-18T14:44:00.431 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.1241999999999997e-05 2024-04-18T14:44:00.432 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:00.432 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:00.432 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-04-18T14:44:00.432 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:45.391634+0000", 2024-04-18T14:44:00.432 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.1399e-05 2024-04-18T14:44:00.432 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:00.432 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:00.432 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-04-18T14:44:00.432 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:45.391804+0000", 2024-04-18T14:44:00.432 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000170316 2024-04-18T14:44:00.432 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:00.432 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:00.432 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_started", 2024-04-18T14:44:00.432 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:45.391836+0000", 2024-04-18T14:44:00.433 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.1294999999999998e-05 2024-04-18T14:44:00.433 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:00.433 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:00.433 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_committed", 2024-04-18T14:44:00.433 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:45.396796+0000", 2024-04-18T14:44:00.433 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0049600479999999999 2024-04-18T14:44:00.433 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:00.433 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:00.433 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-04-18T14:44:00.433 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:45.396847+0000", 2024-04-18T14:44:00.433 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 5.1388000000000003e-05 2024-04-18T14:44:00.433 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:44:00.433 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T14:44:00.433 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:44:00.433 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:00.433 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:00.434 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "MOSDECSubOpWrite(3.6s6 50/30 ECSubWrite(tid=83, reqid=osd.14.0:83, at_version=50'34, trim_to=0'0, roll_forward_to=49'30))", 2024-04-18T14:44:00.434 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-04-18T14:43:49.398555+0000", 2024-04-18T14:44:00.434 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 10.996506431, 2024-04-18T14:44:00.434 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00502499, 2024-04-18T14:44:00.434 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-04-18T14:44:00.434 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "reached pg", 2024-04-18T14:44:00.434 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-04-18T14:44:00.434 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:00.434 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-04-18T14:44:00.435 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:49.398555+0000", 2024-04-18T14:44:00.435 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:44:00.435 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:00.435 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:00.435 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-04-18T14:44:00.435 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:49.398555+0000", 2024-04-18T14:44:00.435 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:44:00.435 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:00.435 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:00.435 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-04-18T14:44:00.435 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:49.398553+0000", 2024-04-18T14:44:00.435 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 4294967295.9999986 2024-04-18T14:44:00.435 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:00.436 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:00.436 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-04-18T14:44:00.436 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:49.398605+0000", 2024-04-18T14:44:00.436 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 5.2027999999999997e-05 2024-04-18T14:44:00.436 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:00.436 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:00.436 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-04-18T14:44:00.436 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:49.398631+0000", 2024-04-18T14:44:00.436 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.5531999999999999e-05 2024-04-18T14:44:00.436 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:00.436 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:00.436 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-04-18T14:44:00.436 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:49.398652+0000", 2024-04-18T14:44:00.437 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.1106000000000001e-05 2024-04-18T14:44:00.437 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:00.437 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:00.437 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-04-18T14:44:00.437 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:49.400040+0000", 2024-04-18T14:44:00.437 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.001387971 2024-04-18T14:44:00.437 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:00.437 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:00.437 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_started", 2024-04-18T14:44:00.437 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:49.400068+0000", 2024-04-18T14:44:00.437 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.7919000000000002e-05 2024-04-18T14:44:00.437 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:00.437 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:00.437 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_committed", 2024-04-18T14:44:00.437 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:49.403474+0000", 2024-04-18T14:44:00.438 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0034065850000000002 2024-04-18T14:44:00.438 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:00.438 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:00.438 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-04-18T14:44:00.438 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:49.403580+0000", 2024-04-18T14:44:00.438 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00010532899999999999 2024-04-18T14:44:00.438 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:44:00.438 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T14:44:00.438 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:44:00.438 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:00.438 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:00.438 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "MOSDECSubOpWrite(3.6s6 50/30 ECSubWrite(tid=85, reqid=osd.14.0:83, at_version=0'0, trim_to=0'0, roll_forward_to=50'34))", 2024-04-18T14:44:00.438 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-04-18T14:43:49.413876+0000", 2024-04-18T14:44:00.438 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 10.981184798999999, 2024-04-18T14:44:00.439 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0035759149999999998, 2024-04-18T14:44:00.439 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-04-18T14:44:00.439 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "reached pg", 2024-04-18T14:44:00.439 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-04-18T14:44:00.439 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:00.439 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-04-18T14:44:00.439 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:49.413876+0000", 2024-04-18T14:44:00.439 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:44:00.439 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:00.439 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:00.439 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-04-18T14:44:00.439 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:49.413876+0000", 2024-04-18T14:44:00.439 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:44:00.439 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:00.440 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:00.440 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-04-18T14:44:00.440 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:49.413875+0000", 2024-04-18T14:44:00.440 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 4294967295.9999986 2024-04-18T14:44:00.440 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:00.440 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:00.440 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-04-18T14:44:00.440 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:49.413903+0000", 2024-04-18T14:44:00.440 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.7744999999999999e-05 2024-04-18T14:44:00.440 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:00.440 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:00.440 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-04-18T14:44:00.440 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:49.413931+0000", 2024-04-18T14:44:00.440 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.8013000000000001e-05 2024-04-18T14:44:00.440 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:00.441 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:00.441 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-04-18T14:44:00.441 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:49.413953+0000", 2024-04-18T14:44:00.441 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.1909e-05 2024-04-18T14:44:00.441 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:00.441 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:00.441 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-04-18T14:44:00.441 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:49.414102+0000", 2024-04-18T14:44:00.441 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00014918099999999999 2024-04-18T14:44:00.441 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:00.441 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:00.441 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_started", 2024-04-18T14:44:00.441 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:49.414131+0000", 2024-04-18T14:44:00.441 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.9641999999999998e-05 2024-04-18T14:44:00.442 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:00.442 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:00.442 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_committed", 2024-04-18T14:44:00.442 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:49.417397+0000", 2024-04-18T14:44:00.442 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0032651999999999998 2024-04-18T14:44:00.442 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:00.442 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:00.442 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-04-18T14:44:00.442 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:49.417452+0000", 2024-04-18T14:44:00.442 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 5.5668000000000003e-05 2024-04-18T14:44:00.442 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:44:00.442 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T14:44:00.442 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:44:00.442 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:00.443 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:00.443 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "MOSDECSubOpWrite(3.4s3 50/30 ECSubWrite(tid=33, reqid=osd.10.0:33, at_version=50'10, trim_to=0'0, roll_forward_to=48'8))", 2024-04-18T14:44:00.443 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-04-18T14:43:49.415669+0000", 2024-04-18T14:44:00.443 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 10.979392224, 2024-04-18T14:44:00.443 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0037844279999999998, 2024-04-18T14:44:00.443 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-04-18T14:44:00.443 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "reached pg", 2024-04-18T14:44:00.443 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-04-18T14:44:00.443 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:00.443 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-04-18T14:44:00.443 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:49.415669+0000", 2024-04-18T14:44:00.443 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:44:00.443 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:00.444 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:00.444 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-04-18T14:44:00.444 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:49.415669+0000", 2024-04-18T14:44:00.444 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:44:00.444 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:00.444 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:00.444 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-04-18T14:44:00.444 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:49.415669+0000", 2024-04-18T14:44:00.444 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 4294967295.9999995 2024-04-18T14:44:00.444 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:00.444 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:00.444 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-04-18T14:44:00.444 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:49.415713+0000", 2024-04-18T14:44:00.444 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 4.4601999999999997e-05 2024-04-18T14:44:00.445 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:00.445 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:00.445 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-04-18T14:44:00.445 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:49.415742+0000", 2024-04-18T14:44:00.445 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.8345000000000001e-05 2024-04-18T14:44:00.445 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:00.445 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:00.445 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-04-18T14:44:00.445 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:49.415763+0000", 2024-04-18T14:44:00.445 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.1075999999999999e-05 2024-04-18T14:44:00.445 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:00.445 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:00.445 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-04-18T14:44:00.446 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:49.415874+0000", 2024-04-18T14:44:00.446 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000111433 2024-04-18T14:44:00.446 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:00.446 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:00.446 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_started", 2024-04-18T14:44:00.446 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:49.415906+0000", 2024-04-18T14:44:00.446 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.1415000000000003e-05 2024-04-18T14:44:00.446 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:00.446 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:00.446 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_committed", 2024-04-18T14:44:00.446 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:49.419395+0000", 2024-04-18T14:44:00.446 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0034892090000000001 2024-04-18T14:44:00.446 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:00.447 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:00.447 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-04-18T14:44:00.447 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:49.419453+0000", 2024-04-18T14:44:00.447 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 5.8684000000000003e-05 2024-04-18T14:44:00.447 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:44:00.447 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T14:44:00.447 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:44:00.447 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:00.447 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:00.447 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "MOSDECSubOpWrite(3.7s2 51/30 ECSubWrite(tid=96, reqid=client.4559.0:375, at_version=51'33, trim_to=0'0, roll_forward_to=50'31))", 2024-04-18T14:44:00.447 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-04-18T14:43:50.400494+0000", 2024-04-18T14:44:00.447 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 9.9945668689999998, 2024-04-18T14:44:00.447 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0047749769999999997, 2024-04-18T14:44:00.447 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-04-18T14:44:00.447 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "reached pg", 2024-04-18T14:44:00.447 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-04-18T14:44:00.448 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:00.448 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-04-18T14:44:00.448 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:50.400494+0000", 2024-04-18T14:44:00.448 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:44:00.448 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:00.448 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:00.448 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-04-18T14:44:00.448 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:50.400494+0000", 2024-04-18T14:44:00.448 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:44:00.448 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:00.448 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:00.448 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-04-18T14:44:00.448 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:50.400493+0000", 2024-04-18T14:44:00.449 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 4294967295.9999986 2024-04-18T14:44:00.449 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:00.449 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:00.449 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-04-18T14:44:00.449 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:50.401080+0000", 2024-04-18T14:44:00.449 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00058721299999999995 2024-04-18T14:44:00.449 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:00.449 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:00.449 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-04-18T14:44:00.449 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:50.401119+0000", 2024-04-18T14:44:00.449 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.8438e-05 2024-04-18T14:44:00.449 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:00.449 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:00.449 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-04-18T14:44:00.449 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:50.401141+0000", 2024-04-18T14:44:00.450 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.2938999999999998e-05 2024-04-18T14:44:00.450 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:00.450 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:00.450 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-04-18T14:44:00.450 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:50.401213+0000", 2024-04-18T14:44:00.450 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 7.1068000000000005e-05 2024-04-18T14:44:00.450 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:00.450 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:00.450 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_started", 2024-04-18T14:44:00.450 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:50.401222+0000", 2024-04-18T14:44:00.450 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 9.4159999999999993e-06 2024-04-18T14:44:00.450 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:00.450 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:00.450 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_committed", 2024-04-18T14:44:00.451 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:50.405243+0000", 2024-04-18T14:44:00.451 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0040215049999999999 2024-04-18T14:44:00.451 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:00.451 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:00.451 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-04-18T14:44:00.451 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:50.405269+0000", 2024-04-18T14:44:00.451 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.5918000000000002e-05 2024-04-18T14:44:00.451 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:44:00.451 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T14:44:00.451 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:44:00.451 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:00.451 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:00.451 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "MOSDECSubOpWrite(3.7s2 57/30 ECSubWrite(tid=126, reqid=client.4559.0:475, at_version=57'49, trim_to=0'0, roll_forward_to=54'47))", 2024-04-18T14:44:00.452 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-04-18T14:43:56.402657+0000", 2024-04-18T14:44:00.452 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 3.9924037500000003, 2024-04-18T14:44:00.452 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0046301179999999999, 2024-04-18T14:44:00.452 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-04-18T14:44:00.452 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "reached pg", 2024-04-18T14:44:00.452 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-04-18T14:44:00.452 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:00.452 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-04-18T14:44:00.452 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:56.402657+0000", 2024-04-18T14:44:00.452 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:44:00.452 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:00.452 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:00.452 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-04-18T14:44:00.452 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:56.402657+0000", 2024-04-18T14:44:00.453 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:44:00.453 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:00.453 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:00.453 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-04-18T14:44:00.453 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:56.402656+0000", 2024-04-18T14:44:00.453 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 4294967295.999999 2024-04-18T14:44:00.453 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:00.453 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:00.453 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-04-18T14:44:00.453 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:56.403534+0000", 2024-04-18T14:44:00.453 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00087792299999999996 2024-04-18T14:44:00.453 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:00.453 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:00.454 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-04-18T14:44:00.454 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:56.403576+0000", 2024-04-18T14:44:00.454 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 4.1242999999999998e-05 2024-04-18T14:44:00.454 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:00.454 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:00.454 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-04-18T14:44:00.454 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:56.403601+0000", 2024-04-18T14:44:00.454 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.4995e-05 2024-04-18T14:44:00.454 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:00.454 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:00.454 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-04-18T14:44:00.454 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:56.403746+0000", 2024-04-18T14:44:00.454 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000145 2024-04-18T14:44:00.454 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:00.455 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:00.455 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_started", 2024-04-18T14:44:00.455 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:56.403775+0000", 2024-04-18T14:44:00.455 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.9875000000000001e-05 2024-04-18T14:44:00.455 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:00.455 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:00.455 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_committed", 2024-04-18T14:44:00.455 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:56.407241+0000", 2024-04-18T14:44:00.455 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0034654 2024-04-18T14:44:00.455 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:00.455 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:00.455 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-04-18T14:44:00.455 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:56.407288+0000", 2024-04-18T14:44:00.456 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 4.6761999999999997e-05 2024-04-18T14:44:00.456 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:44:00.456 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T14:44:00.456 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:44:00.456 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:00.456 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:00.456 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "MOSDECSubOpWrite(3.7s2 57/30 ECSubWrite(tid=127, reqid=client.4559.0:476, at_version=57'50, trim_to=0'0, roll_forward_to=54'47))", 2024-04-18T14:44:00.456 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-04-18T14:43:56.412119+0000", 2024-04-18T14:44:00.456 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 3.9829424200000001, 2024-04-18T14:44:00.456 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0039383220000000002, 2024-04-18T14:44:00.456 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-04-18T14:44:00.456 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "reached pg", 2024-04-18T14:44:00.456 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-04-18T14:44:00.456 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:00.456 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-04-18T14:44:00.457 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:56.412119+0000", 2024-04-18T14:44:00.457 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:44:00.457 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:00.457 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:00.457 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-04-18T14:44:00.457 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:56.412119+0000", 2024-04-18T14:44:00.457 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:44:00.457 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:00.457 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:00.457 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-04-18T14:44:00.457 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:56.412117+0000", 2024-04-18T14:44:00.457 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 4294967295.9999976 2024-04-18T14:44:00.457 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:00.457 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:00.458 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-04-18T14:44:00.458 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:56.412876+0000", 2024-04-18T14:44:00.458 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00075911900000000005 2024-04-18T14:44:00.458 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:00.458 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:00.458 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-04-18T14:44:00.458 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:56.412923+0000", 2024-04-18T14:44:00.458 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 4.7363e-05 2024-04-18T14:44:00.458 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:00.458 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:00.458 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-04-18T14:44:00.458 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:56.412946+0000", 2024-04-18T14:44:00.459 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.3221999999999999e-05 2024-04-18T14:44:00.459 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:00.459 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:00.459 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-04-18T14:44:00.459 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:56.413092+0000", 2024-04-18T14:44:00.459 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00014557900000000001 2024-04-18T14:44:00.459 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:00.459 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:00.459 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_started", 2024-04-18T14:44:00.459 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:56.413118+0000", 2024-04-18T14:44:00.459 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.6228999999999999e-05 2024-04-18T14:44:00.459 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:00.459 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:00.459 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_committed", 2024-04-18T14:44:00.460 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:56.416018+0000", 2024-04-18T14:44:00.460 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0029002680000000001 2024-04-18T14:44:00.460 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:00.460 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:00.460 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-04-18T14:44:00.460 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:56.416057+0000", 2024-04-18T14:44:00.460 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.8775000000000001e-05 2024-04-18T14:44:00.460 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:44:00.460 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T14:44:00.460 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:44:00.460 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:00.460 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:00.460 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "MOSDECSubOpWrite(3.es1 57/30 ECSubWrite(tid=46, reqid=client.4559.0:491, at_version=57'34, trim_to=0'0, roll_forward_to=54'32))", 2024-04-18T14:44:00.460 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-04-18T14:43:56.456476+0000", 2024-04-18T14:44:00.460 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 3.9385850389999999, 2024-04-18T14:44:00.461 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00434075, 2024-04-18T14:44:00.461 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-04-18T14:44:00.461 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "reached pg", 2024-04-18T14:44:00.461 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-04-18T14:44:00.461 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:00.461 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-04-18T14:44:00.461 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:56.456476+0000", 2024-04-18T14:44:00.461 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:44:00.461 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:00.461 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:00.461 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-04-18T14:44:00.461 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:56.456476+0000", 2024-04-18T14:44:00.461 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:44:00.461 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:00.462 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:00.462 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-04-18T14:44:00.462 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:56.456476+0000", 2024-04-18T14:44:00.462 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 4294967295.9999995 2024-04-18T14:44:00.462 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:00.462 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:00.462 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-04-18T14:44:00.462 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:56.456548+0000", 2024-04-18T14:44:00.462 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 7.2343999999999997e-05 2024-04-18T14:44:00.462 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:00.462 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:00.462 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-04-18T14:44:00.463 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:56.456588+0000", 2024-04-18T14:44:00.463 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.9965000000000001e-05 2024-04-18T14:44:00.463 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:00.463 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:00.463 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-04-18T14:44:00.463 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:56.456611+0000", 2024-04-18T14:44:00.463 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.3343e-05 2024-04-18T14:44:00.463 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:00.463 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:00.463 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-04-18T14:44:00.463 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:56.456722+0000", 2024-04-18T14:44:00.463 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00011068 2024-04-18T14:44:00.464 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:00.464 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:00.464 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_started", 2024-04-18T14:44:00.464 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:56.456738+0000", 2024-04-18T14:44:00.464 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.5892999999999998e-05 2024-04-18T14:44:00.464 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:00.464 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:00.464 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_committed", 2024-04-18T14:44:00.464 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:56.460773+0000", 2024-04-18T14:44:00.464 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0040355060000000003 2024-04-18T14:44:00.464 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:00.464 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:00.464 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-04-18T14:44:00.465 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:56.460817+0000", 2024-04-18T14:44:00.465 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 4.3625000000000003e-05 2024-04-18T14:44:00.465 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:44:00.465 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T14:44:00.465 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:44:00.465 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:00.465 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:00.465 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "MOSDECSubOpWrite(3.6s6 57/30 ECSubWrite(tid=139, reqid=client.4559.0:505, at_version=57'50, trim_to=0'0, roll_forward_to=54'48))", 2024-04-18T14:44:00.465 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-04-18T14:43:56.552057+0000", 2024-04-18T14:44:00.465 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 3.843004348, 2024-04-18T14:44:00.465 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0060446579999999996, 2024-04-18T14:44:00.465 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-04-18T14:44:00.466 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "reached pg", 2024-04-18T14:44:00.466 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-04-18T14:44:00.466 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:00.466 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-04-18T14:44:00.466 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:56.552057+0000", 2024-04-18T14:44:00.466 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:44:00.466 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:00.466 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:00.466 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-04-18T14:44:00.466 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:56.552057+0000", 2024-04-18T14:44:00.466 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:44:00.466 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:00.466 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:00.466 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-04-18T14:44:00.467 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:56.552055+0000", 2024-04-18T14:44:00.467 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 4294967295.9999986 2024-04-18T14:44:00.467 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:00.467 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:00.467 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-04-18T14:44:00.467 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:56.552099+0000", 2024-04-18T14:44:00.467 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 4.3812e-05 2024-04-18T14:44:00.467 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:00.467 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:00.467 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-04-18T14:44:00.467 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:56.552122+0000", 2024-04-18T14:44:00.467 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.3195999999999999e-05 2024-04-18T14:44:00.467 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:00.467 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:00.468 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-04-18T14:44:00.468 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:56.552136+0000", 2024-04-18T14:44:00.468 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.396e-05 2024-04-18T14:44:00.468 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:00.468 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:00.468 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-04-18T14:44:00.468 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:56.552261+0000", 2024-04-18T14:44:00.468 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00012490600000000001 2024-04-18T14:44:00.468 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:00.468 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:00.468 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_started", 2024-04-18T14:44:00.468 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:56.552288+0000", 2024-04-18T14:44:00.468 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.6418999999999999e-05 2024-04-18T14:44:00.469 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:00.469 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:00.469 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_committed", 2024-04-18T14:44:00.469 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:56.558043+0000", 2024-04-18T14:44:00.469 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00575495 2024-04-18T14:44:00.469 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:00.469 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:00.469 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-04-18T14:44:00.469 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:56.558102+0000", 2024-04-18T14:44:00.469 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 5.9052000000000003e-05 2024-04-18T14:44:00.469 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:44:00.469 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T14:44:00.469 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:44:00.469 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:00.470 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:00.470 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "MOSDECSubOpWrite(3.bs3 57/30 ECSubWrite(tid=39, reqid=client.4559.0:500, at_version=57'15, trim_to=0'0, roll_forward_to=54'12))", 2024-04-18T14:44:00.470 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-04-18T14:43:56.569907+0000", 2024-04-18T14:44:00.470 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 3.8251539929999998, 2024-04-18T14:44:00.470 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0037366280000000001, 2024-04-18T14:44:00.470 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-04-18T14:44:00.470 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "reached pg", 2024-04-18T14:44:00.470 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-04-18T14:44:00.470 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:00.470 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-04-18T14:44:00.470 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:56.569907+0000", 2024-04-18T14:44:00.470 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:44:00.470 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:00.471 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:00.471 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-04-18T14:44:00.471 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:56.569907+0000", 2024-04-18T14:44:00.471 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:44:00.471 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:00.471 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:00.471 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-04-18T14:44:00.471 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:56.569907+0000", 2024-04-18T14:44:00.471 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 4294967295.9999995 2024-04-18T14:44:00.471 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:00.471 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:00.471 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-04-18T14:44:00.471 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:56.570691+0000", 2024-04-18T14:44:00.471 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00078397899999999997 2024-04-18T14:44:00.471 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:00.472 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:00.472 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-04-18T14:44:00.472 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:56.570720+0000", 2024-04-18T14:44:00.472 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.9192000000000001e-05 2024-04-18T14:44:00.472 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:00.472 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:00.472 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-04-18T14:44:00.472 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:56.570734+0000", 2024-04-18T14:44:00.472 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.4387e-05 2024-04-18T14:44:00.472 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:00.472 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:00.472 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-04-18T14:44:00.472 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:56.570857+0000", 2024-04-18T14:44:00.472 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000122803 2024-04-18T14:44:00.473 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:00.473 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:00.473 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_started", 2024-04-18T14:44:00.473 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:56.570875+0000", 2024-04-18T14:44:00.473 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.8033000000000002e-05 2024-04-18T14:44:00.473 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:00.473 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:00.473 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_committed", 2024-04-18T14:44:00.473 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:56.573563+0000", 2024-04-18T14:44:00.473 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0026877770000000001 2024-04-18T14:44:00.473 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:00.473 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:00.473 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-04-18T14:44:00.473 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:56.573644+0000", 2024-04-18T14:44:00.474 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 8.0996999999999997e-05 2024-04-18T14:44:00.474 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:44:00.474 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T14:44:00.474 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:44:00.474 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:00.474 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:00.474 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "MOSDECSubOpWrite(3.1s2 57/30 ECSubWrite(tid=39, reqid=client.4559.0:512, at_version=57'26, trim_to=0'0, roll_forward_to=53'24))", 2024-04-18T14:44:00.474 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-04-18T14:43:56.586184+0000", 2024-04-18T14:44:00.474 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 3.8088768499999999, 2024-04-18T14:44:00.474 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0042581559999999999, 2024-04-18T14:44:00.474 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-04-18T14:44:00.474 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "reached pg", 2024-04-18T14:44:00.474 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-04-18T14:44:00.474 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:00.475 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-04-18T14:44:00.475 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:56.586184+0000", 2024-04-18T14:44:00.475 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:44:00.475 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:00.475 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:00.475 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-04-18T14:44:00.475 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:56.586184+0000", 2024-04-18T14:44:00.475 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:44:00.475 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:00.475 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:00.475 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-04-18T14:44:00.475 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:56.586182+0000", 2024-04-18T14:44:00.475 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 4294967295.9999981 2024-04-18T14:44:00.476 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:00.476 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:00.476 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-04-18T14:44:00.476 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:56.586839+0000", 2024-04-18T14:44:00.476 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00065665600000000004 2024-04-18T14:44:00.476 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:00.476 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:00.476 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-04-18T14:44:00.476 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:56.586873+0000", 2024-04-18T14:44:00.476 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.4003e-05 2024-04-18T14:44:00.476 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:00.476 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:00.476 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-04-18T14:44:00.476 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:56.586896+0000", 2024-04-18T14:44:00.476 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.2614999999999999e-05 2024-04-18T14:44:00.477 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:00.477 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:00.477 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-04-18T14:44:00.477 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:56.587240+0000", 2024-04-18T14:44:00.477 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00034386399999999999 2024-04-18T14:44:00.477 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:00.477 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:00.477 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_started", 2024-04-18T14:44:00.477 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:56.587268+0000", 2024-04-18T14:44:00.477 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.8569e-05 2024-04-18T14:44:00.477 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:00.477 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:00.477 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_committed", 2024-04-18T14:44:00.477 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:56.590390+0000", 2024-04-18T14:44:00.477 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.003122054 2024-04-18T14:44:00.477 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:00.478 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:00.478 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-04-18T14:44:00.478 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:56.590443+0000", 2024-04-18T14:44:00.478 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 5.2298e-05 2024-04-18T14:44:00.478 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:44:00.478 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T14:44:00.478 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:44:00.478 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:00.478 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:00.478 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "MOSDECSubOpWrite(3.es1 57/30 ECSubWrite(tid=48, reqid=client.4559.0:514, at_version=57'36, trim_to=0'0, roll_forward_to=57'34))", 2024-04-18T14:44:00.478 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-04-18T14:43:56.586506+0000", 2024-04-18T14:44:00.478 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 3.8085556899999999, 2024-04-18T14:44:00.478 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0052921649999999997, 2024-04-18T14:44:00.478 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-04-18T14:44:00.479 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "reached pg", 2024-04-18T14:44:00.479 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-04-18T14:44:00.479 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:00.479 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-04-18T14:44:00.479 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:56.586506+0000", 2024-04-18T14:44:00.479 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:44:00.479 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:00.479 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:00.479 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-04-18T14:44:00.479 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:56.586506+0000", 2024-04-18T14:44:00.479 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:44:00.479 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:00.479 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:00.479 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-04-18T14:44:00.479 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:56.586498+0000", 2024-04-18T14:44:00.480 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 4294967295.9999928 2024-04-18T14:44:00.480 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:00.480 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:00.480 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-04-18T14:44:00.480 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:56.587838+0000", 2024-04-18T14:44:00.480 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0013397649999999999 2024-04-18T14:44:00.480 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:00.480 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:00.480 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-04-18T14:44:00.480 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:56.587868+0000", 2024-04-18T14:44:00.480 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.9748999999999999e-05 2024-04-18T14:44:00.480 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:00.480 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:00.480 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-04-18T14:44:00.481 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:56.587888+0000", 2024-04-18T14:44:00.481 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.0193000000000001e-05 2024-04-18T14:44:00.481 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:00.481 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:00.481 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-04-18T14:44:00.481 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:56.588015+0000", 2024-04-18T14:44:00.481 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000127556 2024-04-18T14:44:00.481 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:00.481 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:00.481 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_started", 2024-04-18T14:44:00.481 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:56.588042+0000", 2024-04-18T14:44:00.481 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.6928999999999999e-05 2024-04-18T14:44:00.481 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:00.481 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:00.481 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_committed", 2024-04-18T14:44:00.482 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:56.591744+0000", 2024-04-18T14:44:00.482 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0037020429999999999 2024-04-18T14:44:00.482 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:00.482 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:00.482 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-04-18T14:44:00.482 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:56.591798+0000", 2024-04-18T14:44:00.482 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 5.3276000000000003e-05 2024-04-18T14:44:00.482 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:44:00.482 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T14:44:00.482 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:44:00.482 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:44:00.482 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T14:44:00.482 INFO:teuthology.orchestra.run.smithi096.stdout:} 2024-04-18T14:44:00.483 INFO:tasks.rados.rados.0.smithi134.stdout:225: finishing copy_from racing read to smithi13430248-26 2024-04-18T14:44:00.483 INFO:tasks.rados.rados.0.smithi134.stdout:225: finishing copy_from to smithi13430248-26 2024-04-18T14:44:00.484 INFO:tasks.rados.rados.0.smithi134.stdout:update_object_version oid 26 v 48 (ObjNum 44 snap 0 seq_num 44) dirty exists 2024-04-18T14:44:00.485 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.13.asok dump_ops_in_flight 2024-04-18T14:44:00.486 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 9 1 2024-04-18T14:44:00.487 INFO:tasks.ceph.osd.15.smithi134.stderr:2024-04-18T14:44:00.488+0000 7f08e6a51640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 15 (PID: 25218) UID: 0 2024-04-18T14:44:00.585 INFO:tasks.ceph.osd.2.smithi119.stderr:2024-04-18T14:44:00.586+0000 7fcbd30c0640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 24894) UID: 0 2024-04-18T14:44:00.611 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2024-04-18T14:44:00.612 INFO:teuthology.orchestra.run.smithi096.stdout: "ops": [], 2024-04-18T14:44:00.612 INFO:teuthology.orchestra.run.smithi096.stdout: "num_ops": 0 2024-04-18T14:44:00.612 INFO:teuthology.orchestra.run.smithi096.stdout:} 2024-04-18T14:44:00.625 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.13.asok dump_blocked_ops 2024-04-18T14:44:00.685 INFO:tasks.ceph.osd.4.smithi086.stderr:2024-04-18T14:44:00.682+0000 7f0c4c462640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 24956) UID: 0 2024-04-18T14:44:00.746 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2024-04-18T14:44:00.746 INFO:teuthology.orchestra.run.smithi096.stdout: "ops": [], 2024-04-18T14:44:00.747 INFO:teuthology.orchestra.run.smithi096.stdout: "complaint_time": 30, 2024-04-18T14:44:00.747 INFO:teuthology.orchestra.run.smithi096.stdout: "num_blocked_ops": 0 2024-04-18T14:44:00.747 INFO:teuthology.orchestra.run.smithi096.stdout:} 2024-04-18T14:44:00.761 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.13.asok dump_historic_ops 2024-04-18T14:44:00.787 INFO:tasks.ceph.osd.0.smithi086.stderr:2024-04-18T14:44:00.786+0000 7f7cdfd78640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 24953) UID: 0 2024-04-18T14:44:00.880 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2024-04-18T14:44:00.881 INFO:teuthology.orchestra.run.smithi096.stdout: "size": 20, 2024-04-18T14:44:00.881 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 600, 2024-04-18T14:44:00.881 INFO:teuthology.orchestra.run.smithi096.stdout: "ops": [ 2024-04-18T14:44:00.881 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:00.881 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4212.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-18T14:44:00.881 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-04-18T14:43:19.321281+0000", 2024-04-18T14:44:00.881 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 41.557887135000001, 2024-04-18T14:44:00.881 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.0074994820000001, 2024-04-18T14:44:00.881 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-04-18T14:44:00.881 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T14:44:00.882 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-04-18T14:44:00.882 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4212", 2024-04-18T14:44:00.882 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "172.21.15.134:0/3325451476", 2024-04-18T14:44:00.882 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 1 2024-04-18T14:44:00.882 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:00.882 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-04-18T14:44:00.882 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:00.882 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-04-18T14:44:00.882 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:19.321281+0000", 2024-04-18T14:44:00.882 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:44:00.882 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:00.882 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:00.882 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-04-18T14:44:00.883 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:19.321281+0000", 2024-04-18T14:44:00.883 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:44:00.883 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:00.883 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:00.883 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-04-18T14:44:00.883 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:19.321279+0000", 2024-04-18T14:44:00.883 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 4294967295.9999971 2024-04-18T14:44:00.883 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:00.883 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:00.883 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-04-18T14:44:00.883 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:19.321299+0000", 2024-04-18T14:44:00.883 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.0098e-05 2024-04-18T14:44:00.883 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:00.883 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:00.883 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-04-18T14:44:00.884 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:19.321342+0000", 2024-04-18T14:44:00.884 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 4.3146000000000003e-05 2024-04-18T14:44:00.884 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:00.884 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:00.884 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-04-18T14:44:00.884 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:19.321367+0000", 2024-04-18T14:44:00.884 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.5318000000000001e-05 2024-04-18T14:44:00.884 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:00.884 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:00.884 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-04-18T14:44:00.884 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:19.321511+0000", 2024-04-18T14:44:00.884 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000143981 2024-04-18T14:44:00.884 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:00.885 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:00.885 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for peered", 2024-04-18T14:44:00.885 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:19.321560+0000", 2024-04-18T14:44:00.885 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 4.8279999999999999e-05 2024-04-18T14:44:00.885 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:00.885 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:00.885 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-04-18T14:44:00.885 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.324154+0000", 2024-04-18T14:44:00.885 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.0025947829999999 2024-04-18T14:44:00.885 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:00.885 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:00.885 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-04-18T14:44:00.885 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.324558+0000", 2024-04-18T14:44:00.885 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00040310999999999998 2024-04-18T14:44:00.885 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:00.886 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:00.886 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for subops from 0", 2024-04-18T14:44:00.886 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.325049+0000", 2024-04-18T14:44:00.886 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00049149000000000003 2024-04-18T14:44:00.886 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:00.886 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:00.886 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_commit_rec", 2024-04-18T14:44:00.886 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.326473+0000", 2024-04-18T14:44:00.886 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.001423517 2024-04-18T14:44:00.886 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:00.886 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:00.886 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-04-18T14:44:00.886 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.328533+0000", 2024-04-18T14:44:00.887 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0020606779999999998 2024-04-18T14:44:00.887 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:00.887 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:00.887 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-04-18T14:44:00.887 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.328679+0000", 2024-04-18T14:44:00.887 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00014585800000000001 2024-04-18T14:44:00.887 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:00.887 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:00.887 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-04-18T14:44:00.887 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.328781+0000", 2024-04-18T14:44:00.887 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000101872 2024-04-18T14:44:00.887 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:44:00.887 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T14:44:00.887 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:44:00.888 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:00.888 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:00.888 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4212.0:110 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-04-18T14:44:00.888 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-04-18T14:43:20.700822+0000", 2024-04-18T14:44:00.888 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 40.178346341000001, 2024-04-18T14:44:00.888 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.021022381999999999, 2024-04-18T14:44:00.888 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-04-18T14:44:00.888 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T14:44:00.888 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-04-18T14:44:00.888 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4212", 2024-04-18T14:44:00.888 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "172.21.15.134:0/3325451476", 2024-04-18T14:44:00.888 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 110 2024-04-18T14:44:00.888 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:00.888 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-04-18T14:44:00.888 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:00.889 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-04-18T14:44:00.889 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.700822+0000", 2024-04-18T14:44:00.889 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:44:00.889 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:00.889 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:00.889 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-04-18T14:44:00.889 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.700822+0000", 2024-04-18T14:44:00.889 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:44:00.889 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:00.889 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:00.889 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-04-18T14:44:00.889 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.700821+0000", 2024-04-18T14:44:00.889 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 4294967295.999999 2024-04-18T14:44:00.890 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:00.890 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:00.890 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-04-18T14:44:00.890 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.700828+0000", 2024-04-18T14:44:00.890 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 6.9269999999999999e-06 2024-04-18T14:44:00.890 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:00.890 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:00.890 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-04-18T14:44:00.890 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.700839+0000", 2024-04-18T14:44:00.890 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.0702e-05 2024-04-18T14:44:00.890 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:00.890 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:00.890 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-04-18T14:44:00.891 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.700847+0000", 2024-04-18T14:44:00.891 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 7.6020000000000002e-06 2024-04-18T14:44:00.891 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:00.891 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:00.891 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-04-18T14:44:00.891 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.709488+0000", 2024-04-18T14:44:00.891 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0086410080000000004 2024-04-18T14:44:00.891 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:00.891 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:00.891 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-04-18T14:44:00.891 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.709751+0000", 2024-04-18T14:44:00.891 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000263272 2024-04-18T14:44:00.891 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:00.891 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:00.892 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for subops from 0", 2024-04-18T14:44:00.892 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.710106+0000", 2024-04-18T14:44:00.892 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000355037 2024-04-18T14:44:00.892 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:00.892 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:00.892 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-04-18T14:44:00.892 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.714026+0000", 2024-04-18T14:44:00.892 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0039202860000000003 2024-04-18T14:44:00.892 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:00.892 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:00.892 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_commit_rec", 2024-04-18T14:44:00.892 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.721600+0000", 2024-04-18T14:44:00.893 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0075740879999999997 2024-04-18T14:44:00.893 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:00.893 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:00.893 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-04-18T14:44:00.893 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.721740+0000", 2024-04-18T14:44:00.893 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00013932500000000001 2024-04-18T14:44:00.894 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:00.894 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:00.894 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-04-18T14:44:00.894 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.721845+0000", 2024-04-18T14:44:00.894 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000104992 2024-04-18T14:44:00.894 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:44:00.894 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T14:44:00.894 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:44:00.894 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:00.894 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:00.894 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4212.0:111 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-04-18T14:44:00.894 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-04-18T14:43:20.700855+0000", 2024-04-18T14:44:00.895 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 40.178313457000002, 2024-04-18T14:44:00.895 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.021347998, 2024-04-18T14:44:00.895 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-04-18T14:44:00.895 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T14:44:00.895 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-04-18T14:44:00.895 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4212", 2024-04-18T14:44:00.895 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "172.21.15.134:0/3325451476", 2024-04-18T14:44:00.895 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 111 2024-04-18T14:44:00.895 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:00.895 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-04-18T14:44:00.896 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:00.896 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-04-18T14:44:00.896 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.700855+0000", 2024-04-18T14:44:00.896 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:44:00.896 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:00.896 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:00.896 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-04-18T14:44:00.896 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.700855+0000", 2024-04-18T14:44:00.896 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:44:00.896 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:00.896 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:00.896 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-04-18T14:44:00.897 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.700854+0000", 2024-04-18T14:44:00.897 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 4294967295.999999 2024-04-18T14:44:00.897 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:00.897 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:00.897 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-04-18T14:44:00.897 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.700860+0000", 2024-04-18T14:44:00.897 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 5.7189999999999998e-06 2024-04-18T14:44:00.897 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:00.897 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:00.897 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-04-18T14:44:00.897 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.700869+0000", 2024-04-18T14:44:00.897 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 8.9889999999999998e-06 2024-04-18T14:44:00.897 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:00.898 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:00.898 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-04-18T14:44:00.898 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.700876+0000", 2024-04-18T14:44:00.898 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 7.0430000000000002e-06 2024-04-18T14:44:00.898 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:00.898 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:00.898 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-04-18T14:44:00.898 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.711224+0000", 2024-04-18T14:44:00.898 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.010347897 2024-04-18T14:44:00.898 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:00.898 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:00.899 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-04-18T14:44:00.899 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.711463+0000", 2024-04-18T14:44:00.899 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00023920699999999999 2024-04-18T14:44:00.899 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:00.899 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:00.899 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for subops from 0", 2024-04-18T14:44:00.899 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.711805+0000", 2024-04-18T14:44:00.899 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00034209600000000001 2024-04-18T14:44:00.899 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:00.899 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:00.899 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-04-18T14:44:00.899 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.715645+0000", 2024-04-18T14:44:00.900 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.003839309 2024-04-18T14:44:00.900 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:00.900 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:00.900 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_commit_rec", 2024-04-18T14:44:00.900 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.721971+0000", 2024-04-18T14:44:00.900 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0063267729999999999 2024-04-18T14:44:00.900 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:00.900 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:00.900 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-04-18T14:44:00.900 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.722107+0000", 2024-04-18T14:44:00.900 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00013514500000000001 2024-04-18T14:44:00.900 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:00.900 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:00.901 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-04-18T14:44:00.901 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.722203+0000", 2024-04-18T14:44:00.901 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 9.6545999999999993e-05 2024-04-18T14:44:00.901 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:44:00.901 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T14:44:00.901 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:44:00.901 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:00.901 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:00.901 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4212.0:112 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-04-18T14:44:00.901 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-04-18T14:43:20.700902+0000", 2024-04-18T14:44:00.901 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 40.178266313999998, 2024-04-18T14:44:00.901 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.021658816000000001, 2024-04-18T14:44:00.901 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-04-18T14:44:00.902 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T14:44:00.902 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-04-18T14:44:00.902 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4212", 2024-04-18T14:44:00.902 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "172.21.15.134:0/3325451476", 2024-04-18T14:44:00.902 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 112 2024-04-18T14:44:00.902 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:00.902 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-04-18T14:44:00.902 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:00.902 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-04-18T14:44:00.902 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.700902+0000", 2024-04-18T14:44:00.902 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:44:00.902 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:00.902 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:00.903 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-04-18T14:44:00.903 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.700902+0000", 2024-04-18T14:44:00.903 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:44:00.903 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:00.903 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:00.903 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-04-18T14:44:00.903 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.700901+0000", 2024-04-18T14:44:00.903 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 4294967295.999999 2024-04-18T14:44:00.903 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:00.903 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:00.903 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-04-18T14:44:00.903 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.701003+0000", 2024-04-18T14:44:00.903 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000102205 2024-04-18T14:44:00.904 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:00.904 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:00.904 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-04-18T14:44:00.904 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.701016+0000", 2024-04-18T14:44:00.904 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.2908000000000001e-05 2024-04-18T14:44:00.904 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:00.904 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:00.904 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-04-18T14:44:00.904 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.701025+0000", 2024-04-18T14:44:00.904 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 8.7229999999999993e-06 2024-04-18T14:44:00.904 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:00.904 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:00.904 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-04-18T14:44:00.905 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.712558+0000", 2024-04-18T14:44:00.905 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.011533181 2024-04-18T14:44:00.905 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:00.905 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:00.905 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-04-18T14:44:00.905 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.712690+0000", 2024-04-18T14:44:00.905 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00013159200000000001 2024-04-18T14:44:00.905 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:00.905 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:00.905 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for subops from 0", 2024-04-18T14:44:00.905 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.712895+0000", 2024-04-18T14:44:00.905 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000205126 2024-04-18T14:44:00.905 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:00.906 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:00.906 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-04-18T14:44:00.906 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.721499+0000", 2024-04-18T14:44:00.906 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0086041469999999995 2024-04-18T14:44:00.906 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:00.906 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:00.906 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_commit_rec", 2024-04-18T14:44:00.906 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.722336+0000", 2024-04-18T14:44:00.906 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00083725200000000003 2024-04-18T14:44:00.906 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:00.906 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:00.906 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-04-18T14:44:00.906 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.722461+0000", 2024-04-18T14:44:00.907 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00012457899999999999 2024-04-18T14:44:00.907 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:00.907 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:00.907 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-04-18T14:44:00.907 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.722561+0000", 2024-04-18T14:44:00.907 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000100066 2024-04-18T14:44:00.907 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:44:00.907 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T14:44:00.907 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:44:00.907 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:00.907 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:00.907 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4212.0:113 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-04-18T14:44:00.908 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-04-18T14:43:20.701035+0000", 2024-04-18T14:44:00.908 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 40.178133127999999, 2024-04-18T14:44:00.908 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.021756507000000001, 2024-04-18T14:44:00.908 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-04-18T14:44:00.908 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T14:44:00.908 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-04-18T14:44:00.908 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4212", 2024-04-18T14:44:00.908 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "172.21.15.134:0/3325451476", 2024-04-18T14:44:00.908 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 113 2024-04-18T14:44:00.908 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:00.908 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-04-18T14:44:00.908 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:00.908 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-04-18T14:44:00.909 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.701035+0000", 2024-04-18T14:44:00.909 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:44:00.909 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:00.909 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:00.909 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-04-18T14:44:00.909 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.701035+0000", 2024-04-18T14:44:00.909 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:44:00.909 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:00.909 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:00.909 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-04-18T14:44:00.909 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.701035+0000", 2024-04-18T14:44:00.909 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 4294967295.999999 2024-04-18T14:44:00.910 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:00.910 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:00.910 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-04-18T14:44:00.910 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.701041+0000", 2024-04-18T14:44:00.910 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 6.0290000000000002e-06 2024-04-18T14:44:00.910 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:00.910 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:00.910 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-04-18T14:44:00.910 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.701050+0000", 2024-04-18T14:44:00.910 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 9.0299999999999999e-06 2024-04-18T14:44:00.910 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:00.910 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:00.910 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-04-18T14:44:00.911 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.701057+0000", 2024-04-18T14:44:00.911 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 6.9550000000000003e-06 2024-04-18T14:44:00.911 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:00.911 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:00.911 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-04-18T14:44:00.911 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.714308+0000", 2024-04-18T14:44:00.911 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.013251281 2024-04-18T14:44:00.911 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:00.911 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:00.911 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-04-18T14:44:00.911 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.714542+0000", 2024-04-18T14:44:00.911 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00023440000000000001 2024-04-18T14:44:00.912 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:00.912 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:00.912 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for subops from 0", 2024-04-18T14:44:00.912 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.714898+0000", 2024-04-18T14:44:00.912 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00035589500000000001 2024-04-18T14:44:00.912 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:00.912 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:00.912 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-04-18T14:44:00.912 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.721874+0000", 2024-04-18T14:44:00.912 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0069761620000000002 2024-04-18T14:44:00.912 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:00.912 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:00.913 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_commit_rec", 2024-04-18T14:44:00.913 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.722665+0000", 2024-04-18T14:44:00.913 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00079023299999999999 2024-04-18T14:44:00.913 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:00.913 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:00.913 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-04-18T14:44:00.913 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.722737+0000", 2024-04-18T14:44:00.913 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 7.2156999999999994e-05 2024-04-18T14:44:00.913 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:00.913 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:00.913 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-04-18T14:44:00.913 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.722792+0000", 2024-04-18T14:44:00.914 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 5.5095e-05 2024-04-18T14:44:00.914 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:44:00.914 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T14:44:00.914 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:44:00.914 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:00.914 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:00.914 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4212.0:114 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-04-18T14:44:00.914 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-04-18T14:43:20.701065+0000", 2024-04-18T14:44:00.914 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 40.178103467, 2024-04-18T14:44:00.914 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.022072597999999999, 2024-04-18T14:44:00.914 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-04-18T14:44:00.914 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T14:44:00.915 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-04-18T14:44:00.915 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4212", 2024-04-18T14:44:00.915 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "172.21.15.134:0/3325451476", 2024-04-18T14:44:00.915 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 114 2024-04-18T14:44:00.915 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:00.915 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-04-18T14:44:00.915 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:00.915 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-04-18T14:44:00.915 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.701065+0000", 2024-04-18T14:44:00.915 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:44:00.915 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:00.915 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:00.916 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-04-18T14:44:00.916 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.701065+0000", 2024-04-18T14:44:00.916 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:44:00.916 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:00.916 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:00.916 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-04-18T14:44:00.916 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.701064+0000", 2024-04-18T14:44:00.916 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 4294967295.9999995 2024-04-18T14:44:00.916 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:00.916 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:00.916 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-04-18T14:44:00.916 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.701070+0000", 2024-04-18T14:44:00.917 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 5.6400000000000002e-06 2024-04-18T14:44:00.917 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:00.917 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:00.917 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-04-18T14:44:00.917 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.701079+0000", 2024-04-18T14:44:00.917 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 8.9590000000000001e-06 2024-04-18T14:44:00.917 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:00.917 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:00.917 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-04-18T14:44:00.917 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.701086+0000", 2024-04-18T14:44:00.917 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 6.8499999999999996e-06 2024-04-18T14:44:00.917 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:00.918 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:00.918 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-04-18T14:44:00.918 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.715764+0000", 2024-04-18T14:44:00.918 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.01467833 2024-04-18T14:44:00.919 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:00.919 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:00.919 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-04-18T14:44:00.919 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.715902+0000", 2024-04-18T14:44:00.919 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00013763499999999999 2024-04-18T14:44:00.919 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:00.919 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:00.919 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for subops from 0", 2024-04-18T14:44:00.919 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.716201+0000", 2024-04-18T14:44:00.919 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00029946200000000001 2024-04-18T14:44:00.919 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:00.919 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:00.919 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-04-18T14:44:00.920 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.721892+0000", 2024-04-18T14:44:00.920 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0056902680000000001 2024-04-18T14:44:00.920 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:00.920 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:00.920 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_commit_rec", 2024-04-18T14:44:00.920 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.722918+0000", 2024-04-18T14:44:00.920 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0010263130000000001 2024-04-18T14:44:00.920 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:00.920 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:00.920 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-04-18T14:44:00.920 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.723034+0000", 2024-04-18T14:44:00.920 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000116481 2024-04-18T14:44:00.921 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:00.921 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:00.921 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-04-18T14:44:00.921 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.723138+0000", 2024-04-18T14:44:00.921 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000103274 2024-04-18T14:44:00.921 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:44:00.921 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T14:44:00.921 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:44:00.921 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:00.921 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:00.921 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4212.0:115 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-04-18T14:44:00.921 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-04-18T14:43:20.701238+0000", 2024-04-18T14:44:00.922 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 40.177930072000002, 2024-04-18T14:44:00.922 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.02214089, 2024-04-18T14:44:00.922 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-04-18T14:44:00.922 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T14:44:00.922 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-04-18T14:44:00.922 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4212", 2024-04-18T14:44:00.922 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "172.21.15.134:0/3325451476", 2024-04-18T14:44:00.922 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 115 2024-04-18T14:44:00.922 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:00.922 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-04-18T14:44:00.922 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:00.923 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-04-18T14:44:00.923 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.701238+0000", 2024-04-18T14:44:00.923 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:44:00.923 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:00.923 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:00.923 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-04-18T14:44:00.923 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.701238+0000", 2024-04-18T14:44:00.923 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:44:00.923 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:00.923 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:00.923 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-04-18T14:44:00.923 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.701237+0000", 2024-04-18T14:44:00.923 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 4294967295.9999986 2024-04-18T14:44:00.924 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:00.924 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:00.924 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-04-18T14:44:00.924 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.701377+0000", 2024-04-18T14:44:00.924 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000139849 2024-04-18T14:44:00.924 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:00.924 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:00.924 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-04-18T14:44:00.924 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.701392+0000", 2024-04-18T14:44:00.924 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.5322e-05 2024-04-18T14:44:00.924 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:00.924 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:00.924 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-04-18T14:44:00.924 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.701401+0000", 2024-04-18T14:44:00.925 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 8.9430000000000006e-06 2024-04-18T14:44:00.925 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:00.925 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:00.925 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-04-18T14:44:00.925 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.719830+0000", 2024-04-18T14:44:00.925 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.018429009999999999 2024-04-18T14:44:00.925 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:00.925 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:00.925 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-04-18T14:44:00.925 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.720057+0000", 2024-04-18T14:44:00.925 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00022700500000000001 2024-04-18T14:44:00.925 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:00.926 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:00.926 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for subops from 0", 2024-04-18T14:44:00.926 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.720408+0000", 2024-04-18T14:44:00.926 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00035086399999999999 2024-04-18T14:44:00.926 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:00.926 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:00.926 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-04-18T14:44:00.926 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.723171+0000", 2024-04-18T14:44:00.926 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.002762708 2024-04-18T14:44:00.926 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:00.926 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:00.926 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_commit_rec", 2024-04-18T14:44:00.926 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.723264+0000", 2024-04-18T14:44:00.927 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 9.2888999999999998e-05 2024-04-18T14:44:00.927 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:00.927 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:00.927 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-04-18T14:44:00.927 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.723329+0000", 2024-04-18T14:44:00.927 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 6.5394000000000004e-05 2024-04-18T14:44:00.927 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:00.927 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:00.927 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-04-18T14:44:00.927 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.723379+0000", 2024-04-18T14:44:00.927 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 5.0126000000000001e-05 2024-04-18T14:44:00.927 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:44:00.928 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T14:44:00.928 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:44:00.928 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:00.928 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:00.928 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4212.0:116 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-04-18T14:44:00.928 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-04-18T14:43:20.701416+0000", 2024-04-18T14:44:00.928 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 40.177752796, 2024-04-18T14:44:00.928 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.024681692000000002, 2024-04-18T14:44:00.928 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-04-18T14:44:00.928 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T14:44:00.928 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-04-18T14:44:00.928 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4212", 2024-04-18T14:44:00.928 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "172.21.15.134:0/3325451476", 2024-04-18T14:44:00.928 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 116 2024-04-18T14:44:00.929 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:00.929 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-04-18T14:44:00.929 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:00.929 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-04-18T14:44:00.929 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.701416+0000", 2024-04-18T14:44:00.929 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:44:00.929 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:00.929 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:00.929 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-04-18T14:44:00.929 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.701416+0000", 2024-04-18T14:44:00.929 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:44:00.929 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:00.929 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:00.930 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-04-18T14:44:00.930 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.701415+0000", 2024-04-18T14:44:00.930 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 4294967295.999999 2024-04-18T14:44:00.930 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:00.930 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:00.930 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-04-18T14:44:00.930 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.701434+0000", 2024-04-18T14:44:00.930 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.9258000000000001e-05 2024-04-18T14:44:00.930 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:00.930 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:00.930 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-04-18T14:44:00.930 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.701445+0000", 2024-04-18T14:44:00.930 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.0485999999999999e-05 2024-04-18T14:44:00.930 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:00.931 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:00.931 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-04-18T14:44:00.931 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.701452+0000", 2024-04-18T14:44:00.931 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 7.9060000000000002e-06 2024-04-18T14:44:00.931 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:00.931 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:00.931 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-04-18T14:44:00.931 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.723471+0000", 2024-04-18T14:44:00.931 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.022019047 2024-04-18T14:44:00.931 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:00.931 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:00.931 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-04-18T14:44:00.931 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.723697+0000", 2024-04-18T14:44:00.932 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000225634 2024-04-18T14:44:00.932 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:00.932 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:00.932 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for subops from 0", 2024-04-18T14:44:00.932 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.724053+0000", 2024-04-18T14:44:00.932 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000355798 2024-04-18T14:44:00.932 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:00.932 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:00.932 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_commit_rec", 2024-04-18T14:44:00.932 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.725675+0000", 2024-04-18T14:44:00.932 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.001622264 2024-04-18T14:44:00.932 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:00.933 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:00.933 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-04-18T14:44:00.933 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.725879+0000", 2024-04-18T14:44:00.933 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00020390299999999999 2024-04-18T14:44:00.933 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:00.933 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:00.933 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-04-18T14:44:00.933 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.725994+0000", 2024-04-18T14:44:00.933 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000115158 2024-04-18T14:44:00.933 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:00.933 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:00.933 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-04-18T14:44:00.933 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.726097+0000", 2024-04-18T14:44:00.933 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000103231 2024-04-18T14:44:00.934 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:44:00.934 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T14:44:00.934 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:44:00.934 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:00.934 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:00.934 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4212.0:117 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-04-18T14:44:00.934 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-04-18T14:43:20.701462+0000", 2024-04-18T14:44:00.934 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 40.177706962999999, 2024-04-18T14:44:00.934 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.025118439999999999, 2024-04-18T14:44:00.934 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-04-18T14:44:00.935 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T14:44:00.935 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-04-18T14:44:00.935 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4212", 2024-04-18T14:44:00.935 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "172.21.15.134:0/3325451476", 2024-04-18T14:44:00.935 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 117 2024-04-18T14:44:00.935 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:00.935 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-04-18T14:44:00.935 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:00.935 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-04-18T14:44:00.935 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.701462+0000", 2024-04-18T14:44:00.935 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:44:00.935 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:00.935 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:00.935 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-04-18T14:44:00.935 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.701462+0000", 2024-04-18T14:44:00.936 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:44:00.936 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:00.936 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:00.936 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-04-18T14:44:00.936 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.701461+0000", 2024-04-18T14:44:00.936 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 4294967295.9999995 2024-04-18T14:44:00.936 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:00.936 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:00.936 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-04-18T14:44:00.936 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.701468+0000", 2024-04-18T14:44:00.936 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 6.6630000000000004e-06 2024-04-18T14:44:00.936 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:00.936 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:00.936 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-04-18T14:44:00.936 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.701478+0000", 2024-04-18T14:44:00.937 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.0796e-05 2024-04-18T14:44:00.937 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:00.937 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:00.937 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-04-18T14:44:00.937 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.701486+0000", 2024-04-18T14:44:00.937 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 7.3490000000000003e-06 2024-04-18T14:44:00.937 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:00.937 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:00.938 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-04-18T14:44:00.938 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.724772+0000", 2024-04-18T14:44:00.938 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.023286554000000001 2024-04-18T14:44:00.938 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:00.938 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:00.938 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-04-18T14:44:00.938 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.724901+0000", 2024-04-18T14:44:00.938 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00012827499999999999 2024-04-18T14:44:00.938 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:00.938 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:00.938 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for subops from 0", 2024-04-18T14:44:00.938 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.725102+0000", 2024-04-18T14:44:00.938 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000201471 2024-04-18T14:44:00.939 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:00.939 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:00.939 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_commit_rec", 2024-04-18T14:44:00.939 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.726349+0000", 2024-04-18T14:44:00.939 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.001247061 2024-04-18T14:44:00.939 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:00.939 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:00.939 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-04-18T14:44:00.939 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.726373+0000", 2024-04-18T14:44:00.939 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.4207999999999999e-05 2024-04-18T14:44:00.939 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:00.939 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:00.939 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-04-18T14:44:00.939 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.726488+0000", 2024-04-18T14:44:00.940 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000115118 2024-04-18T14:44:00.940 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:00.940 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:00.940 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-04-18T14:44:00.940 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.726580+0000", 2024-04-18T14:44:00.940 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 9.1612000000000003e-05 2024-04-18T14:44:00.940 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:44:00.940 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T14:44:00.940 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:44:00.940 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:00.940 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:00.940 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4212.0:163 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-04-18T14:44:00.940 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-04-18T14:43:21.039657+0000", 2024-04-18T14:44:00.940 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 39.839511162999997, 2024-04-18T14:44:00.941 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.019955601999999999, 2024-04-18T14:44:00.941 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-04-18T14:44:00.941 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T14:44:00.941 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-04-18T14:44:00.941 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4212", 2024-04-18T14:44:00.941 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "172.21.15.134:0/3325451476", 2024-04-18T14:44:00.941 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 163 2024-04-18T14:44:00.941 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:00.941 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-04-18T14:44:00.941 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:00.941 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-04-18T14:44:00.941 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:21.039657+0000", 2024-04-18T14:44:00.941 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:44:00.941 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:00.942 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:00.942 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-04-18T14:44:00.942 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:21.039657+0000", 2024-04-18T14:44:00.942 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:44:00.942 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:00.942 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:00.942 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-04-18T14:44:00.942 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:21.039657+0000", 2024-04-18T14:44:00.942 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 4294967295.999999 2024-04-18T14:44:00.942 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:00.942 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:00.942 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-04-18T14:44:00.942 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:21.039663+0000", 2024-04-18T14:44:00.942 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 6.4300000000000003e-06 2024-04-18T14:44:00.943 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:00.943 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:00.943 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-04-18T14:44:00.943 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:21.039673+0000", 2024-04-18T14:44:00.943 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.0105999999999999e-05 2024-04-18T14:44:00.943 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:00.943 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:00.943 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-04-18T14:44:00.943 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:21.039681+0000", 2024-04-18T14:44:00.943 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 7.5560000000000002e-06 2024-04-18T14:44:00.943 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:00.943 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:00.943 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-04-18T14:44:00.944 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:21.054744+0000", 2024-04-18T14:44:00.944 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.015062766 2024-04-18T14:44:00.944 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:00.944 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:00.944 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-04-18T14:44:00.944 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:21.054971+0000", 2024-04-18T14:44:00.944 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00022734200000000001 2024-04-18T14:44:00.944 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:00.944 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:00.944 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for subops from 0", 2024-04-18T14:44:00.944 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:21.055343+0000", 2024-04-18T14:44:00.944 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000372004 2024-04-18T14:44:00.945 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:00.945 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:00.945 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-04-18T14:44:00.945 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:21.059373+0000", 2024-04-18T14:44:00.945 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0040298080000000002 2024-04-18T14:44:00.945 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:00.945 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:00.945 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_commit_rec", 2024-04-18T14:44:00.945 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:21.059468+0000", 2024-04-18T14:44:00.945 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 9.5753000000000003e-05 2024-04-18T14:44:00.945 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:00.945 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:00.945 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-04-18T14:44:00.946 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:21.059553+0000", 2024-04-18T14:44:00.946 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 8.4538999999999998e-05 2024-04-18T14:44:00.946 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:00.946 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:00.946 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-04-18T14:44:00.946 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:21.059613+0000", 2024-04-18T14:44:00.946 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 6.0055e-05 2024-04-18T14:44:00.946 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:44:00.946 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T14:44:00.946 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:44:00.946 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:00.946 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:00.947 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4212.0:164 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-04-18T14:44:00.947 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-04-18T14:43:21.039689+0000", 2024-04-18T14:44:00.947 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 39.839479292, 2024-04-18T14:44:00.947 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.020243589999999999, 2024-04-18T14:44:00.947 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-04-18T14:44:00.947 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T14:44:00.947 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-04-18T14:44:00.947 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4212", 2024-04-18T14:44:00.947 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "172.21.15.134:0/3325451476", 2024-04-18T14:44:00.947 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 164 2024-04-18T14:44:00.947 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:00.947 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-04-18T14:44:00.947 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:00.947 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-04-18T14:44:00.948 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:21.039689+0000", 2024-04-18T14:44:00.948 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:44:00.948 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:00.948 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:00.948 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-04-18T14:44:00.948 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:21.039689+0000", 2024-04-18T14:44:00.948 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:44:00.948 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:00.948 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:00.948 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-04-18T14:44:00.948 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:21.039689+0000", 2024-04-18T14:44:00.948 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 4294967295.9999995 2024-04-18T14:44:00.948 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:00.948 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:00.948 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-04-18T14:44:00.949 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:21.039773+0000", 2024-04-18T14:44:00.949 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 8.4040000000000002e-05 2024-04-18T14:44:00.949 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:00.949 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:00.949 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-04-18T14:44:00.949 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:21.039783+0000", 2024-04-18T14:44:00.949 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.0786e-05 2024-04-18T14:44:00.949 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:00.949 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:00.949 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-04-18T14:44:00.949 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:21.039791+0000", 2024-04-18T14:44:00.949 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 7.8320000000000006e-06 2024-04-18T14:44:00.949 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:00.950 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:00.950 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-04-18T14:44:00.950 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:21.056266+0000", 2024-04-18T14:44:00.950 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.016474586999999999 2024-04-18T14:44:00.950 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:00.950 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:00.950 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-04-18T14:44:00.950 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:21.056394+0000", 2024-04-18T14:44:00.950 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00012773299999999999 2024-04-18T14:44:00.950 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:00.950 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:00.950 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for subops from 0", 2024-04-18T14:44:00.951 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:21.056584+0000", 2024-04-18T14:44:00.951 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00019052500000000001 2024-04-18T14:44:00.951 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:00.951 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:00.951 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_commit_rec", 2024-04-18T14:44:00.951 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:21.059718+0000", 2024-04-18T14:44:00.951 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0031340999999999999 2024-04-18T14:44:00.951 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:00.951 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:00.951 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-04-18T14:44:00.951 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:21.059746+0000", 2024-04-18T14:44:00.951 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.7447999999999999e-05 2024-04-18T14:44:00.951 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:00.951 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:00.952 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-04-18T14:44:00.952 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:21.059876+0000", 2024-04-18T14:44:00.952 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00013080599999999999 2024-04-18T14:44:00.952 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:00.952 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:00.952 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-04-18T14:44:00.952 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:21.059933+0000", 2024-04-18T14:44:00.952 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 5.6372999999999997e-05 2024-04-18T14:44:00.952 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:44:00.952 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T14:44:00.952 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:44:00.952 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:00.952 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:00.952 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4212.0:165 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-04-18T14:44:00.953 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-04-18T14:43:21.039800+0000", 2024-04-18T14:44:00.953 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 39.839368090999997, 2024-04-18T14:44:00.953 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.022777954, 2024-04-18T14:44:00.953 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-04-18T14:44:00.953 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T14:44:00.953 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-04-18T14:44:00.953 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4212", 2024-04-18T14:44:00.953 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "172.21.15.134:0/3325451476", 2024-04-18T14:44:00.953 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 165 2024-04-18T14:44:00.953 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:00.953 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-04-18T14:44:00.953 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:00.953 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-04-18T14:44:00.954 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:21.039800+0000", 2024-04-18T14:44:00.954 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:44:00.954 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:00.954 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:00.954 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-04-18T14:44:00.954 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:21.039800+0000", 2024-04-18T14:44:00.954 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:44:00.954 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:00.954 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:00.954 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-04-18T14:44:00.954 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:21.039800+0000", 2024-04-18T14:44:00.954 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 4294967295.999999 2024-04-18T14:44:00.954 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:00.954 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:00.954 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-04-18T14:44:00.955 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:21.039806+0000", 2024-04-18T14:44:00.955 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 6.263e-06 2024-04-18T14:44:00.955 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:00.955 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:00.955 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-04-18T14:44:00.955 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:21.039815+0000", 2024-04-18T14:44:00.955 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 9.0790000000000007e-06 2024-04-18T14:44:00.955 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:00.955 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:00.955 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-04-18T14:44:00.955 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:21.039822+0000", 2024-04-18T14:44:00.955 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 6.9929999999999998e-06 2024-04-18T14:44:00.955 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:00.955 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:00.956 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-04-18T14:44:00.956 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:21.058092+0000", 2024-04-18T14:44:00.956 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.018269884 2024-04-18T14:44:00.956 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:00.956 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:00.956 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-04-18T14:44:00.956 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:21.058307+0000", 2024-04-18T14:44:00.956 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00021547600000000001 2024-04-18T14:44:00.956 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:00.956 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:00.956 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for subops from 0", 2024-04-18T14:44:00.956 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:21.058667+0000", 2024-04-18T14:44:00.957 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00035945500000000001 2024-04-18T14:44:00.957 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:00.957 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:00.957 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_commit_rec", 2024-04-18T14:44:00.957 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:21.060393+0000", 2024-04-18T14:44:00.957 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0017262619999999999 2024-04-18T14:44:00.957 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:00.957 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:00.957 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-04-18T14:44:00.957 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:21.062336+0000", 2024-04-18T14:44:00.957 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.001943078 2024-04-18T14:44:00.957 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:00.957 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:00.957 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-04-18T14:44:00.957 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:21.062471+0000", 2024-04-18T14:44:00.958 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00013455300000000001 2024-04-18T14:44:00.958 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:00.958 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:00.958 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-04-18T14:44:00.958 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:21.062578+0000", 2024-04-18T14:44:00.958 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00010770800000000001 2024-04-18T14:44:00.958 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:44:00.958 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T14:44:00.958 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:44:00.958 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:00.958 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:00.958 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4212.0:184 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-04-18T14:44:00.959 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-04-18T14:43:21.211009+0000", 2024-04-18T14:44:00.959 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 39.668159391000003, 2024-04-18T14:44:00.959 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.018995425999999999, 2024-04-18T14:44:00.959 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-04-18T14:44:00.959 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T14:44:00.959 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-04-18T14:44:00.959 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4212", 2024-04-18T14:44:00.959 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "172.21.15.134:0/3325451476", 2024-04-18T14:44:00.959 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 184 2024-04-18T14:44:00.959 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:00.959 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-04-18T14:44:00.959 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:00.959 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-04-18T14:44:00.959 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:21.211009+0000", 2024-04-18T14:44:00.960 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:44:00.960 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:00.960 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:00.960 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-04-18T14:44:00.960 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:21.211009+0000", 2024-04-18T14:44:00.960 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:44:00.960 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:00.960 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:00.960 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-04-18T14:44:00.960 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:21.211009+0000", 2024-04-18T14:44:00.960 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 4294967295.9999995 2024-04-18T14:44:00.960 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:00.960 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:00.961 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-04-18T14:44:00.961 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:21.211014+0000", 2024-04-18T14:44:00.961 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 5.5339999999999999e-06 2024-04-18T14:44:00.961 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:00.961 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:00.961 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-04-18T14:44:00.961 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:21.211023+0000", 2024-04-18T14:44:00.961 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 9.0319999999999992e-06 2024-04-18T14:44:00.961 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:00.961 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:00.961 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-04-18T14:44:00.961 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:21.211035+0000", 2024-04-18T14:44:00.961 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.1875999999999999e-05 2024-04-18T14:44:00.962 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:00.962 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:00.962 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-04-18T14:44:00.962 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:21.222820+0000", 2024-04-18T14:44:00.962 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.011784901 2024-04-18T14:44:00.962 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:00.962 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:00.962 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-04-18T14:44:00.962 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:21.222958+0000", 2024-04-18T14:44:00.962 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00013764199999999999 2024-04-18T14:44:00.962 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:00.962 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:00.962 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for subops from 0", 2024-04-18T14:44:00.962 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:21.223154+0000", 2024-04-18T14:44:00.963 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000196701 2024-04-18T14:44:00.963 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:00.963 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:00.963 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_commit_rec", 2024-04-18T14:44:00.963 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:21.229521+0000", 2024-04-18T14:44:00.963 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0063666130000000001 2024-04-18T14:44:00.963 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:00.963 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:00.963 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-04-18T14:44:00.963 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:21.229803+0000", 2024-04-18T14:44:00.963 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00028222700000000002 2024-04-18T14:44:00.964 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:00.964 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:00.964 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-04-18T14:44:00.964 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:21.229913+0000", 2024-04-18T14:44:00.964 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000109441 2024-04-18T14:44:00.964 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:00.964 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:00.964 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-04-18T14:44:00.964 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:21.230005+0000", 2024-04-18T14:44:00.964 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 9.2078999999999997e-05 2024-04-18T14:44:00.964 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:44:00.964 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T14:44:00.964 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:44:00.965 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:00.965 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:00.965 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4212.0:185 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-04-18T14:44:00.965 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-04-18T14:43:21.211070+0000", 2024-04-18T14:44:00.965 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 39.668098579000002, 2024-04-18T14:44:00.965 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.019187958000000001, 2024-04-18T14:44:00.965 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-04-18T14:44:00.965 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T14:44:00.965 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-04-18T14:44:00.965 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4212", 2024-04-18T14:44:00.965 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "172.21.15.134:0/3325451476", 2024-04-18T14:44:00.965 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 185 2024-04-18T14:44:00.965 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:00.965 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-04-18T14:44:00.965 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:00.966 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-04-18T14:44:00.966 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:21.211070+0000", 2024-04-18T14:44:00.966 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:44:00.966 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:00.966 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:00.966 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-04-18T14:44:00.966 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:21.211070+0000", 2024-04-18T14:44:00.966 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:44:00.966 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:00.966 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:00.966 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-04-18T14:44:00.966 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:21.211069+0000", 2024-04-18T14:44:00.966 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 4294967295.9999986 2024-04-18T14:44:00.967 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:00.967 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:00.967 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-04-18T14:44:00.967 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:21.211194+0000", 2024-04-18T14:44:00.967 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00012547599999999999 2024-04-18T14:44:00.967 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:00.967 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:00.967 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-04-18T14:44:00.967 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:21.211233+0000", 2024-04-18T14:44:00.967 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.8556999999999997e-05 2024-04-18T14:44:00.967 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:00.967 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:00.967 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-04-18T14:44:00.968 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:21.211242+0000", 2024-04-18T14:44:00.968 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 9.5929999999999995e-06 2024-04-18T14:44:00.968 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:00.968 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:00.968 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-04-18T14:44:00.968 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:21.223832+0000", 2024-04-18T14:44:00.968 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.01258977 2024-04-18T14:44:00.968 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:00.968 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:00.968 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-04-18T14:44:00.968 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:21.224067+0000", 2024-04-18T14:44:00.968 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00023518399999999999 2024-04-18T14:44:00.968 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:00.968 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:00.969 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for subops from 0", 2024-04-18T14:44:00.969 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:21.224435+0000", 2024-04-18T14:44:00.969 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00036764399999999998 2024-04-18T14:44:00.969 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:00.969 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:00.969 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-04-18T14:44:00.969 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:21.230024+0000", 2024-04-18T14:44:00.969 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0055886479999999999 2024-04-18T14:44:00.969 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:00.969 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:00.969 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_commit_rec", 2024-04-18T14:44:00.969 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:21.230124+0000", 2024-04-18T14:44:00.970 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00010045899999999999 2024-04-18T14:44:00.970 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:00.970 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:00.970 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-04-18T14:44:00.970 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:21.230201+0000", 2024-04-18T14:44:00.970 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 7.6509999999999998e-05 2024-04-18T14:44:00.970 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:00.970 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:00.970 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-04-18T14:44:00.970 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:21.230258+0000", 2024-04-18T14:44:00.970 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 5.7395999999999997e-05 2024-04-18T14:44:00.970 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:44:00.971 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T14:44:00.971 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:44:00.971 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:00.971 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:00.971 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4212.0:186 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-04-18T14:44:00.971 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-04-18T14:43:21.211255+0000", 2024-04-18T14:44:00.971 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 39.667913970000001, 2024-04-18T14:44:00.971 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.019388148000000001, 2024-04-18T14:44:00.971 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-04-18T14:44:00.971 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T14:44:00.971 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-04-18T14:44:00.971 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4212", 2024-04-18T14:44:00.972 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "172.21.15.134:0/3325451476", 2024-04-18T14:44:00.972 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 186 2024-04-18T14:44:00.972 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:00.972 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-04-18T14:44:00.972 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:00.972 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-04-18T14:44:00.972 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:21.211255+0000", 2024-04-18T14:44:00.972 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:44:00.972 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:00.972 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:00.972 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-04-18T14:44:00.972 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:21.211255+0000", 2024-04-18T14:44:00.972 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:44:00.972 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:00.973 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:00.973 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-04-18T14:44:00.973 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:21.211254+0000", 2024-04-18T14:44:00.973 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 4294967295.999999 2024-04-18T14:44:00.973 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:00.973 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:00.973 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-04-18T14:44:00.973 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:21.211261+0000", 2024-04-18T14:44:00.973 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 7.0190000000000001e-06 2024-04-18T14:44:00.973 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:00.973 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:00.973 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-04-18T14:44:00.974 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:21.211270+0000", 2024-04-18T14:44:00.974 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 9.5189999999999998e-06 2024-04-18T14:44:00.974 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:00.974 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:00.974 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-04-18T14:44:00.974 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:21.211277+0000", 2024-04-18T14:44:00.974 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 7.1400000000000002e-06 2024-04-18T14:44:00.974 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:00.974 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:00.974 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-04-18T14:44:00.974 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:21.226501+0000", 2024-04-18T14:44:00.974 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.015224115999999999 2024-04-18T14:44:00.974 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:00.975 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:00.975 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-04-18T14:44:00.975 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:21.226767+0000", 2024-04-18T14:44:00.975 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00026582199999999998 2024-04-18T14:44:00.975 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:00.975 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:00.975 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for subops from 0", 2024-04-18T14:44:00.975 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:21.227160+0000", 2024-04-18T14:44:00.975 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000392803 2024-04-18T14:44:00.975 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:00.975 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:00.975 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_commit_rec", 2024-04-18T14:44:00.976 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:21.230391+0000", 2024-04-18T14:44:00.976 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.003231182 2024-04-18T14:44:00.976 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:00.976 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:00.976 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-04-18T14:44:00.976 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:21.230414+0000", 2024-04-18T14:44:00.976 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.3045e-05 2024-04-18T14:44:00.976 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:00.976 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:00.976 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-04-18T14:44:00.976 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:21.230543+0000", 2024-04-18T14:44:00.976 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00012871900000000001 2024-04-18T14:44:00.976 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:00.976 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:00.977 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-04-18T14:44:00.977 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:21.230643+0000", 2024-04-18T14:44:00.977 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 9.9766000000000007e-05 2024-04-18T14:44:00.977 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:44:00.977 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T14:44:00.977 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:44:00.977 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:00.977 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:00.977 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4212.0:187 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-04-18T14:44:00.977 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-04-18T14:43:21.211285+0000", 2024-04-18T14:44:00.977 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 39.667883158999999, 2024-04-18T14:44:00.977 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.022261811999999999, 2024-04-18T14:44:00.977 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-04-18T14:44:00.978 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T14:44:00.978 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-04-18T14:44:00.978 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4212", 2024-04-18T14:44:00.978 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "172.21.15.134:0/3325451476", 2024-04-18T14:44:00.978 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 187 2024-04-18T14:44:00.978 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:00.978 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-04-18T14:44:00.978 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:00.978 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-04-18T14:44:00.978 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:21.211285+0000", 2024-04-18T14:44:00.978 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:44:00.978 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:00.978 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:00.978 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-04-18T14:44:00.979 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:21.211285+0000", 2024-04-18T14:44:00.979 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:44:00.979 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:00.979 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:00.979 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-04-18T14:44:00.979 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:21.211285+0000", 2024-04-18T14:44:00.979 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 4294967295.9999995 2024-04-18T14:44:00.979 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:00.979 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:00.979 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-04-18T14:44:00.979 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:21.211290+0000", 2024-04-18T14:44:00.979 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 5.6999999999999996e-06 2024-04-18T14:44:00.979 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:00.979 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:00.980 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-04-18T14:44:00.980 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:21.211300+0000", 2024-04-18T14:44:00.980 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 9.0890000000000006e-06 2024-04-18T14:44:00.980 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:00.980 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:00.980 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-04-18T14:44:00.980 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:21.211306+0000", 2024-04-18T14:44:00.980 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 6.8029999999999999e-06 2024-04-18T14:44:00.980 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:00.980 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:00.980 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-04-18T14:44:00.980 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:21.228301+0000", 2024-04-18T14:44:00.980 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.016994598999999999 2024-04-18T14:44:00.981 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:00.981 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:00.981 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-04-18T14:44:00.981 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:21.228558+0000", 2024-04-18T14:44:00.981 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00025666600000000001 2024-04-18T14:44:00.981 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:00.981 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:00.981 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for subops from 0", 2024-04-18T14:44:00.981 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:21.228844+0000", 2024-04-18T14:44:00.981 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00028685700000000001 2024-04-18T14:44:00.981 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:00.981 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:00.981 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-04-18T14:44:00.982 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:21.233311+0000", 2024-04-18T14:44:00.982 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0044661400000000004 2024-04-18T14:44:00.982 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:00.982 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:00.982 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_commit_rec", 2024-04-18T14:44:00.982 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:21.233386+0000", 2024-04-18T14:44:00.982 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 7.5184000000000004e-05 2024-04-18T14:44:00.982 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:00.982 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:00.982 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-04-18T14:44:00.982 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:21.233457+0000", 2024-04-18T14:44:00.982 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 7.0914999999999994e-05 2024-04-18T14:44:00.982 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:00.982 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:00.983 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-04-18T14:44:00.983 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:21.233547+0000", 2024-04-18T14:44:00.983 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 9.0486000000000001e-05 2024-04-18T14:44:00.983 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:44:00.983 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T14:44:00.983 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:44:00.983 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:00.983 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:00.983 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4212.0:188 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-04-18T14:44:00.983 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-04-18T14:43:21.211314+0000", 2024-04-18T14:44:00.983 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 39.667854411, 2024-04-18T14:44:00.983 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.022928674999999999, 2024-04-18T14:44:00.983 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-04-18T14:44:00.984 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T14:44:00.984 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-04-18T14:44:00.984 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4212", 2024-04-18T14:44:00.984 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "172.21.15.134:0/3325451476", 2024-04-18T14:44:00.984 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 188 2024-04-18T14:44:00.984 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:00.984 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-04-18T14:44:00.984 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:00.984 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-04-18T14:44:00.984 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:21.211314+0000", 2024-04-18T14:44:00.984 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:44:00.984 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:00.984 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:00.984 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-04-18T14:44:00.985 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:21.211314+0000", 2024-04-18T14:44:00.985 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:44:00.985 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:00.985 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:00.985 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-04-18T14:44:00.985 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:21.211314+0000", 2024-04-18T14:44:00.985 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 4294967295.9999995 2024-04-18T14:44:00.985 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:00.985 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:00.985 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-04-18T14:44:00.985 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:21.211413+0000", 2024-04-18T14:44:00.985 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 9.9754999999999996e-05 2024-04-18T14:44:00.985 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:00.986 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:00.986 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-04-18T14:44:00.986 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:21.211425+0000", 2024-04-18T14:44:00.986 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.1259e-05 2024-04-18T14:44:00.986 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:00.986 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:00.986 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-04-18T14:44:00.986 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:21.211435+0000", 2024-04-18T14:44:00.986 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 9.9990000000000003e-06 2024-04-18T14:44:00.986 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:00.986 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:00.986 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-04-18T14:44:00.986 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:21.230726+0000", 2024-04-18T14:44:00.987 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.019291490000000001 2024-04-18T14:44:00.987 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:00.987 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:00.987 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-04-18T14:44:00.987 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:21.230855+0000", 2024-04-18T14:44:00.987 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000129102 2024-04-18T14:44:00.987 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:00.987 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:00.987 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for subops from 0", 2024-04-18T14:44:00.987 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:21.231049+0000", 2024-04-18T14:44:00.987 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00019388900000000001 2024-04-18T14:44:00.987 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:00.988 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:00.988 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-04-18T14:44:00.988 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:21.233333+0000", 2024-04-18T14:44:00.988 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0022836309999999999 2024-04-18T14:44:00.988 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:00.988 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:00.988 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_commit_rec", 2024-04-18T14:44:00.988 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:21.234118+0000", 2024-04-18T14:44:00.988 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00078523999999999998 2024-04-18T14:44:00.988 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:00.988 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:00.988 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-04-18T14:44:00.988 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:21.234191+0000", 2024-04-18T14:44:00.988 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 7.3028000000000006e-05 2024-04-18T14:44:00.989 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:00.989 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:00.989 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-04-18T14:44:00.989 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:21.234243+0000", 2024-04-18T14:44:00.989 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 5.1898999999999999e-05 2024-04-18T14:44:00.989 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:44:00.989 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T14:44:00.989 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:44:00.989 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:00.989 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:00.989 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4212.0:189 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-04-18T14:44:00.989 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-04-18T14:43:21.211444+0000", 2024-04-18T14:44:00.989 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 39.667724468000003, 2024-04-18T14:44:00.989 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.023955757000000001, 2024-04-18T14:44:00.990 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-04-18T14:44:00.990 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T14:44:00.990 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-04-18T14:44:00.990 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4212", 2024-04-18T14:44:00.990 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "172.21.15.134:0/3325451476", 2024-04-18T14:44:00.990 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 189 2024-04-18T14:44:00.990 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:00.990 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-04-18T14:44:00.990 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:00.990 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-04-18T14:44:00.990 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:21.211444+0000", 2024-04-18T14:44:00.990 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:44:00.990 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:00.990 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:00.991 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-04-18T14:44:00.991 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:21.211444+0000", 2024-04-18T14:44:00.991 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:44:00.991 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:00.991 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:00.991 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-04-18T14:44:00.991 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:21.211443+0000", 2024-04-18T14:44:00.991 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 4294967295.999999 2024-04-18T14:44:00.991 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:00.991 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:00.991 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-04-18T14:44:00.991 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:21.211450+0000", 2024-04-18T14:44:00.991 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 6.28e-06 2024-04-18T14:44:00.992 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:00.992 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:00.992 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-04-18T14:44:00.992 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:21.211459+0000", 2024-04-18T14:44:00.992 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 9.132e-06 2024-04-18T14:44:00.992 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:00.992 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:00.992 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-04-18T14:44:00.992 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:21.211466+0000", 2024-04-18T14:44:00.992 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 6.8530000000000003e-06 2024-04-18T14:44:00.992 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:00.992 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:00.992 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-04-18T14:44:00.993 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:21.231986+0000", 2024-04-18T14:44:00.993 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.020520218 2024-04-18T14:44:00.993 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:00.993 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:00.993 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-04-18T14:44:00.993 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:21.232208+0000", 2024-04-18T14:44:00.993 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000222208 2024-04-18T14:44:00.993 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:00.993 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:00.993 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for subops from 0", 2024-04-18T14:44:00.993 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:21.232551+0000", 2024-04-18T14:44:00.993 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00034289999999999999 2024-04-18T14:44:00.993 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:00.993 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:00.994 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-04-18T14:44:00.994 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:21.233981+0000", 2024-04-18T14:44:00.994 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0014303390000000001 2024-04-18T14:44:00.994 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:00.994 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:00.994 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_commit_rec", 2024-04-18T14:44:00.994 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:21.235295+0000", 2024-04-18T14:44:00.994 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0013134189999999999 2024-04-18T14:44:00.994 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:00.994 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:00.995 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-04-18T14:44:00.995 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:21.235354+0000", 2024-04-18T14:44:00.995 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 5.8928000000000002e-05 2024-04-18T14:44:00.995 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:00.995 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:00.995 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-04-18T14:44:00.995 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:21.235400+0000", 2024-04-18T14:44:00.995 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 4.6273999999999998e-05 2024-04-18T14:44:00.995 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:44:00.995 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T14:44:00.995 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:44:00.995 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:00.996 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:00.996 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4559.0:560 3.3s0 3:c95aa19c:::smithi13430248-26:head [copy-from ver 48] snapc 1d=[1d,1c,1a,19,16,14,13,11,b,a,7,2] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2024-04-18T14:44:00.996 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-04-18T14:44:00.380761+0000", 2024-04-18T14:44:00.996 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 0.49840764700000001, 2024-04-18T14:44:00.996 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.023909372000000002, 2024-04-18T14:44:00.996 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-04-18T14:44:00.996 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T14:44:00.996 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-04-18T14:44:00.996 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4559", 2024-04-18T14:44:00.996 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "172.21.15.134:0/3113589487", 2024-04-18T14:44:00.996 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 560 2024-04-18T14:44:00.996 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:00.996 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-04-18T14:44:00.997 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:00.997 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-04-18T14:44:00.997 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:00.380761+0000", 2024-04-18T14:44:00.997 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:44:00.997 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:00.997 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:00.997 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-04-18T14:44:00.997 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:00.380761+0000", 2024-04-18T14:44:00.997 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:44:00.997 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:00.997 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:00.997 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-04-18T14:44:00.997 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:00.380756+0000", 2024-04-18T14:44:00.997 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 4294967295.9999957 2024-04-18T14:44:00.998 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:00.998 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:00.998 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-04-18T14:44:00.998 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:00.380778+0000", 2024-04-18T14:44:00.998 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.1319999999999999e-05 2024-04-18T14:44:00.998 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:00.998 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:00.998 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-04-18T14:44:00.998 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:00.380813+0000", 2024-04-18T14:44:00.998 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.5648999999999997e-05 2024-04-18T14:44:00.998 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:00.998 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:00.999 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-04-18T14:44:00.999 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:00.380841+0000", 2024-04-18T14:44:00.999 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.7189999999999999e-05 2024-04-18T14:44:00.999 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:00.999 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:00.999 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-04-18T14:44:00.999 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:00.380990+0000", 2024-04-18T14:44:00.999 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00014950799999999999 2024-04-18T14:44:00.999 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:00.999 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:00.999 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op must wait for map", 2024-04-18T14:44:00.999 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:00.381015+0000", 2024-04-18T14:44:00.999 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.4760999999999999e-05 2024-04-18T14:44:00.999 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:00.999 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:01.000 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-04-18T14:44:01.000 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:00.384807+0000", 2024-04-18T14:44:01.000 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0037916069999999998 2024-04-18T14:44:01.000 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:01.000 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:01.000 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-04-18T14:44:01.000 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:00.385079+0000", 2024-04-18T14:44:01.000 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000272296 2024-04-18T14:44:01.000 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:01.000 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:01.000 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_started", 2024-04-18T14:44:01.000 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:00.398546+0000", 2024-04-18T14:44:01.000 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.013467451 2024-04-18T14:44:01.000 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:01.001 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:01.001 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_committed", 2024-04-18T14:44:01.001 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:00.401693+0000", 2024-04-18T14:44:01.001 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0031470199999999999 2024-04-18T14:44:01.001 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:01.001 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:01.001 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-04-18T14:44:01.001 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:00.404555+0000", 2024-04-18T14:44:01.001 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0028617030000000002 2024-04-18T14:44:01.001 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:01.001 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:01.001 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-04-18T14:44:01.001 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:00.404670+0000", 2024-04-18T14:44:01.002 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000115312 2024-04-18T14:44:01.002 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:44:01.002 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T14:44:01.002 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:44:01.002 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:01.002 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:01.002 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4559.0:561 3.3s0 3:c95aa19c:::smithi13430248-26:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e61)", 2024-04-18T14:44:01.002 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-04-18T14:44:00.380871+0000", 2024-04-18T14:44:01.002 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 0.49829739000000001, 2024-04-18T14:44:01.002 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.019901861, 2024-04-18T14:44:01.002 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-04-18T14:44:01.002 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "started", 2024-04-18T14:44:01.002 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-04-18T14:44:01.003 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4559", 2024-04-18T14:44:01.003 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "172.21.15.134:0/3113589487", 2024-04-18T14:44:01.003 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 561 2024-04-18T14:44:01.003 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:01.003 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-04-18T14:44:01.003 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:01.003 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-04-18T14:44:01.003 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:00.380871+0000", 2024-04-18T14:44:01.003 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:44:01.003 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:01.003 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:01.003 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-04-18T14:44:01.003 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:00.380871+0000", 2024-04-18T14:44:01.003 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:44:01.003 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:01.004 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:01.004 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-04-18T14:44:01.004 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:00.380870+0000", 2024-04-18T14:44:01.004 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 4294967295.9999986 2024-04-18T14:44:01.004 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:01.004 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:01.004 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-04-18T14:44:01.004 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:00.380879+0000", 2024-04-18T14:44:01.004 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 9.5589999999999994e-06 2024-04-18T14:44:01.004 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:01.004 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:01.004 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-04-18T14:44:01.004 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:00.380901+0000", 2024-04-18T14:44:01.004 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.1929999999999998e-05 2024-04-18T14:44:01.005 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:01.005 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:01.005 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-04-18T14:44:01.005 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:00.380917+0000", 2024-04-18T14:44:01.005 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.5962000000000001e-05 2024-04-18T14:44:01.005 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:01.005 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:01.005 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-04-18T14:44:01.005 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:00.381168+0000", 2024-04-18T14:44:01.005 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00025072199999999999 2024-04-18T14:44:01.005 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:01.005 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:01.006 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting_for_map not empty", 2024-04-18T14:44:01.006 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:00.381189+0000", 2024-04-18T14:44:01.006 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.1263999999999998e-05 2024-04-18T14:44:01.006 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:01.006 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:01.006 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-04-18T14:44:01.006 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:00.385492+0000", 2024-04-18T14:44:01.006 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0043025110000000002 2024-04-18T14:44:01.006 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:01.006 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:01.006 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for blocked object", 2024-04-18T14:44:01.006 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:00.385613+0000", 2024-04-18T14:44:01.007 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000121545 2024-04-18T14:44:01.007 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:01.007 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:01.007 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-04-18T14:44:01.007 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:00.400564+0000", 2024-04-18T14:44:01.007 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.014950908000000001 2024-04-18T14:44:01.007 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:01.007 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:01.007 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-04-18T14:44:01.007 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:00.400671+0000", 2024-04-18T14:44:01.007 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000107055 2024-04-18T14:44:01.007 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:01.007 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:01.007 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-04-18T14:44:01.007 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:00.400773+0000", 2024-04-18T14:44:01.008 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000101878 2024-04-18T14:44:01.008 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:44:01.008 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T14:44:01.008 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:44:01.008 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:44:01.008 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T14:44:01.008 INFO:teuthology.orchestra.run.smithi096.stdout:} 2024-04-18T14:44:01.010 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-18T14:44:01.010 INFO:tasks.ceph.osd.6.smithi119.stderr:2024-04-18T14:44:01.010+0000 7fb7cb8bd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 24896) UID: 0 2024-04-18T14:44:01.111 INFO:tasks.ceph.osd.0.smithi086.stderr:2024-04-18T14:44:01.110+0000 7f7cdfd78640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 24953) UID: 0 2024-04-18T14:44:01.142 INFO:teuthology.orchestra.run.smithi119.stdout:{ 2024-04-18T14:44:01.142 INFO:teuthology.orchestra.run.smithi119.stdout: "ops": [], 2024-04-18T14:44:01.142 INFO:teuthology.orchestra.run.smithi119.stdout: "num_ops": 0 2024-04-18T14:44:01.142 INFO:teuthology.orchestra.run.smithi119.stdout:} 2024-04-18T14:44:01.154 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-18T14:44:01.211 INFO:tasks.ceph.osd.2.smithi119.stderr:2024-04-18T14:44:01.214+0000 7fcbd30c0640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 24894) UID: 0 2024-04-18T14:44:01.276 INFO:teuthology.orchestra.run.smithi119.stdout:{ 2024-04-18T14:44:01.276 INFO:teuthology.orchestra.run.smithi119.stdout: "ops": [], 2024-04-18T14:44:01.276 INFO:teuthology.orchestra.run.smithi119.stdout: "complaint_time": 30, 2024-04-18T14:44:01.276 INFO:teuthology.orchestra.run.smithi119.stdout: "num_blocked_ops": 0 2024-04-18T14:44:01.276 INFO:teuthology.orchestra.run.smithi119.stdout:} 2024-04-18T14:44:01.290 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-18T14:44:01.312 INFO:tasks.ceph.osd.0.smithi086.stderr:2024-04-18T14:44:01.310+0000 7f7cdfd78640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 24953) UID: 0 2024-04-18T14:44:01.378 INFO:teuthology.orchestra.run.smithi086.stderr:reweighted osd.9 to 1 (10000) 2024-04-18T14:44:01.379 INFO:tasks.rados.rados.0.smithi134.stdout:225: done (2 left) 2024-04-18T14:44:01.380 INFO:tasks.rados.rados.0.smithi134.stdout:226: done (1 left) 2024-04-18T14:44:01.380 INFO:tasks.rados.rados.0.smithi134.stdout:228: done (0 left) 2024-04-18T14:44:01.380 INFO:tasks.rados.rados.0.smithi134.stdout:229: delete oid 50 current snap is 21 2024-04-18T14:44:01.389 INFO:tasks.rados.rados.0.smithi134.stdout:229: done (0 left) 2024-04-18T14:44:01.389 INFO:tasks.rados.rados.0.smithi134.stdout:230: rollback oid 32 current snap is 21 2024-04-18T14:44:01.390 INFO:tasks.rados.rados.0.smithi134.stdout:rollback oid 32 to 11 2024-04-18T14:44:01.390 INFO:tasks.rados.rados.0.smithi134.stdout:231: read oid 9 snap -1 2024-04-18T14:44:01.390 INFO:tasks.rados.rados.0.smithi134.stdout:231: expect (ObjNum 92 snap 18 seq_num 92) 2024-04-18T14:44:01.390 INFO:tasks.rados.rados.0.smithi134.stdout:232: delete oid 10 current snap is 21 2024-04-18T14:44:01.398 INFO:tasks.rados.rados.0.smithi134.stdout:230: finishing rollback tid 1 to smithi13430248-32 2024-04-18T14:44:01.398 INFO:tasks.rados.rados.0.smithi134.stdout:update_object_version oid 32 v 18 (ObjNum 65 snap 0 seq_num 2054462800) dirty dne 2024-04-18T14:44:01.404 INFO:tasks.rados.rados.0.smithi134.stdout:230: done (2 left) 2024-04-18T14:44:01.404 INFO:tasks.rados.rados.0.smithi134.stdout:232: done (1 left) 2024-04-18T14:44:01.404 INFO:tasks.rados.rados.0.smithi134.stdout:233: rollback oid 43 current snap is 21 2024-04-18T14:44:01.404 INFO:tasks.rados.rados.0.smithi134.stdout:rollback oid 43 to 13 2024-04-18T14:44:01.404 INFO:tasks.rados.rados.0.smithi134.stdout:append oid 16 current snap is 21 2024-04-18T14:44:01.404 INFO:tasks.rados.rados.0.smithi134.stdout:234: seq_num 98 ranges {753664=491520,1245184=589824,1835008=557056,2392064=16384} 2024-04-18T14:44:01.406 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 10 1 2024-04-18T14:44:01.414 INFO:tasks.ceph.osd.11.smithi134.stderr:2024-04-18T14:44:01.416+0000 7f2d36f12640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 11 (PID: 25216) UID: 0 2024-04-18T14:44:01.424 INFO:tasks.rados.rados.0.smithi134.stdout:234: writing smithi13430248-16 from 753664 to 1245184 tid 1 2024-04-18T14:44:01.433 INFO:tasks.rados.rados.0.smithi134.stdout:234: writing smithi13430248-16 from 1245184 to 1835008 tid 2 2024-04-18T14:44:01.442 INFO:tasks.rados.rados.0.smithi134.stdout:234: writing smithi13430248-16 from 1835008 to 2392064 tid 3 2024-04-18T14:44:01.442 INFO:tasks.rados.rados.0.smithi134.stdout:234: writing smithi13430248-16 from 2392064 to 2408448 tid 4 2024-04-18T14:44:01.442 INFO:tasks.rados.rados.0.smithi134.stdout:235: snap_remove snap 16 2024-04-18T14:44:01.474 INFO:teuthology.orchestra.run.smithi119.stdout:{ 2024-04-18T14:44:01.474 INFO:teuthology.orchestra.run.smithi119.stdout: "size": 20, 2024-04-18T14:44:01.474 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 600, 2024-04-18T14:44:01.475 INFO:teuthology.orchestra.run.smithi119.stdout: "ops": [ 2024-04-18T14:44:01.475 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:01.475 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "MOSDECSubOpWrite(3.7s4 37/30 ECSubWrite(tid=35, reqid=client.4559.0:183, at_version=37'11, trim_to=0'0, roll_forward_to=33'9))", 2024-04-18T14:44:01.475 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-04-18T14:43:36.748125+0000", 2024-04-18T14:44:01.475 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 24.728150733, 2024-04-18T14:44:01.475 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0044053160000000003, 2024-04-18T14:44:01.475 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-04-18T14:44:01.475 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "reached pg", 2024-04-18T14:44:01.475 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-04-18T14:44:01.475 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:01.475 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-04-18T14:44:01.475 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:36.748125+0000", 2024-04-18T14:44:01.475 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:44:01.475 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:01.476 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:01.476 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-04-18T14:44:01.476 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:36.748125+0000", 2024-04-18T14:44:01.476 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:44:01.476 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:01.476 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:01.476 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-04-18T14:44:01.476 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:36.748124+0000", 2024-04-18T14:44:01.476 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4294967295.999999 2024-04-18T14:44:01.476 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:01.476 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:01.476 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-04-18T14:44:01.476 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:36.748453+0000", 2024-04-18T14:44:01.476 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00032812199999999997 2024-04-18T14:44:01.477 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:01.477 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:01.477 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-04-18T14:44:01.477 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:36.748496+0000", 2024-04-18T14:44:01.477 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4.3631000000000003e-05 2024-04-18T14:44:01.477 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:01.477 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:01.477 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-04-18T14:44:01.477 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:36.748524+0000", 2024-04-18T14:44:01.477 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.7900999999999999e-05 2024-04-18T14:44:01.477 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:01.477 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:01.477 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-04-18T14:44:01.477 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:36.748680+0000", 2024-04-18T14:44:01.477 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00015593399999999999 2024-04-18T14:44:01.478 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:01.478 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:01.478 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_started", 2024-04-18T14:44:01.478 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:36.748711+0000", 2024-04-18T14:44:01.478 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.1117e-05 2024-04-18T14:44:01.478 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:01.478 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:01.478 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_committed", 2024-04-18T14:44:01.478 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:36.752490+0000", 2024-04-18T14:44:01.478 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.003778726 2024-04-18T14:44:01.478 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:01.478 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:01.478 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-04-18T14:44:01.478 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:36.752531+0000", 2024-04-18T14:44:01.478 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4.0967999999999998e-05 2024-04-18T14:44:01.479 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:44:01.479 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-04-18T14:44:01.479 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:44:01.479 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:01.479 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:01.479 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "MOSDECSubOpWrite(3.7s4 41/30 ECSubWrite(tid=50, reqid=osd.14.0:49, at_version=0'0, trim_to=0'0, roll_forward_to=41'17))", 2024-04-18T14:44:01.479 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-04-18T14:43:40.764162+0000", 2024-04-18T14:44:01.479 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 20.712114292999999, 2024-04-18T14:44:01.479 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0095130979999999993, 2024-04-18T14:44:01.479 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-04-18T14:44:01.479 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "reached pg", 2024-04-18T14:44:01.479 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-04-18T14:44:01.479 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:01.479 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-04-18T14:44:01.479 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:40.764162+0000", 2024-04-18T14:44:01.480 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:44:01.480 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:01.480 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:01.480 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-04-18T14:44:01.480 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:40.764162+0000", 2024-04-18T14:44:01.480 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:44:01.480 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:01.480 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:01.480 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-04-18T14:44:01.480 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:40.764160+0000", 2024-04-18T14:44:01.480 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4294967295.9999981 2024-04-18T14:44:01.480 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:01.480 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:01.480 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-04-18T14:44:01.480 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:40.764189+0000", 2024-04-18T14:44:01.481 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.9257000000000001e-05 2024-04-18T14:44:01.481 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:01.481 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:01.481 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-04-18T14:44:01.481 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:40.764249+0000", 2024-04-18T14:44:01.481 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 5.9945000000000003e-05 2024-04-18T14:44:01.481 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:01.481 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:01.481 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-04-18T14:44:01.481 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:40.764272+0000", 2024-04-18T14:44:01.481 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.3091e-05 2024-04-18T14:44:01.481 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:01.481 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:01.481 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-04-18T14:44:01.481 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:40.764476+0000", 2024-04-18T14:44:01.481 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00020318100000000001 2024-04-18T14:44:01.482 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:01.482 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:01.482 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_started", 2024-04-18T14:44:01.482 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:40.764490+0000", 2024-04-18T14:44:01.482 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.4634000000000001e-05 2024-04-18T14:44:01.482 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:01.482 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:01.482 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_committed", 2024-04-18T14:44:01.482 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:40.773620+0000", 2024-04-18T14:44:01.482 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0091299390000000001 2024-04-18T14:44:01.482 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:01.482 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:01.482 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-04-18T14:44:01.482 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:40.773675+0000", 2024-04-18T14:44:01.482 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 5.4948000000000003e-05 2024-04-18T14:44:01.483 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:44:01.483 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-04-18T14:44:01.483 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:44:01.483 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:01.483 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:01.483 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "MOSDECSubOpWrite(3.cs5 41/30 ECSubWrite(tid=45, reqid=osd.11.0:45, at_version=41'22, trim_to=0'0, roll_forward_to=39'20))", 2024-04-18T14:44:01.483 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-04-18T14:43:40.764595+0000", 2024-04-18T14:44:01.483 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 20.711680919999999, 2024-04-18T14:44:01.483 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.010712411999999999, 2024-04-18T14:44:01.483 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-04-18T14:44:01.483 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "reached pg", 2024-04-18T14:44:01.483 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-04-18T14:44:01.483 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:01.483 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-04-18T14:44:01.483 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:40.764595+0000", 2024-04-18T14:44:01.484 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:44:01.484 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:01.484 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:01.484 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-04-18T14:44:01.484 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:40.764595+0000", 2024-04-18T14:44:01.484 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:44:01.484 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:01.484 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:01.484 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-04-18T14:44:01.484 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:40.764594+0000", 2024-04-18T14:44:01.484 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4294967295.999999 2024-04-18T14:44:01.484 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:01.484 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:01.484 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-04-18T14:44:01.484 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:40.764660+0000", 2024-04-18T14:44:01.484 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 6.5122000000000004e-05 2024-04-18T14:44:01.485 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:01.485 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:01.485 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-04-18T14:44:01.485 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:40.764693+0000", 2024-04-18T14:44:01.485 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.3213999999999997e-05 2024-04-18T14:44:01.485 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:01.485 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:01.485 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-04-18T14:44:01.485 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:40.764715+0000", 2024-04-18T14:44:01.485 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.2580000000000001e-05 2024-04-18T14:44:01.485 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:01.485 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:01.485 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-04-18T14:44:01.485 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:40.764838+0000", 2024-04-18T14:44:01.486 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00012281299999999999 2024-04-18T14:44:01.486 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:01.486 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:01.486 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_started", 2024-04-18T14:44:01.486 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:40.764853+0000", 2024-04-18T14:44:01.486 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.5237e-05 2024-04-18T14:44:01.486 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:01.486 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:01.486 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_committed", 2024-04-18T14:44:01.486 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:40.775242+0000", 2024-04-18T14:44:01.486 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.010388807999999999 2024-04-18T14:44:01.486 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:01.486 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:01.486 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-04-18T14:44:01.486 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:40.775308+0000", 2024-04-18T14:44:01.487 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 6.5494999999999995e-05 2024-04-18T14:44:01.487 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:44:01.487 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-04-18T14:44:01.487 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:44:01.487 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:01.487 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:01.487 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "MOSDECSubOpWrite(3.cs5 41/30 ECSubWrite(tid=46, reqid=osd.11.0:46, at_version=41'24, trim_to=0'0, roll_forward_to=39'20))", 2024-04-18T14:44:01.487 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-04-18T14:43:40.765803+0000", 2024-04-18T14:44:01.487 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 20.71047317, 2024-04-18T14:44:01.487 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.010134018999999999, 2024-04-18T14:44:01.487 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-04-18T14:44:01.487 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "reached pg", 2024-04-18T14:44:01.487 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-04-18T14:44:01.487 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:01.488 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-04-18T14:44:01.488 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:40.765803+0000", 2024-04-18T14:44:01.488 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:44:01.488 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:01.488 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:01.488 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-04-18T14:44:01.488 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:40.765803+0000", 2024-04-18T14:44:01.488 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:44:01.488 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:01.488 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:01.488 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-04-18T14:44:01.488 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:40.765801+0000", 2024-04-18T14:44:01.488 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4294967295.9999981 2024-04-18T14:44:01.488 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:01.488 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:01.489 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-04-18T14:44:01.489 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:40.765857+0000", 2024-04-18T14:44:01.489 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 5.6385000000000003e-05 2024-04-18T14:44:01.489 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:01.489 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:01.489 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-04-18T14:44:01.489 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:40.765888+0000", 2024-04-18T14:44:01.489 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.0886999999999998e-05 2024-04-18T14:44:01.489 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:01.489 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:01.489 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-04-18T14:44:01.489 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:40.765910+0000", 2024-04-18T14:44:01.489 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.2084000000000001e-05 2024-04-18T14:44:01.489 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:01.489 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:01.490 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-04-18T14:44:01.490 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:40.767603+0000", 2024-04-18T14:44:01.490 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0016922409999999999 2024-04-18T14:44:01.490 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:01.490 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:01.490 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_started", 2024-04-18T14:44:01.490 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:40.767627+0000", 2024-04-18T14:44:01.490 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.4204000000000001e-05 2024-04-18T14:44:01.490 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:01.490 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:01.490 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_committed", 2024-04-18T14:44:01.490 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:40.775885+0000", 2024-04-18T14:44:01.490 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0082576769999999997 2024-04-18T14:44:01.490 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:01.490 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:01.491 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-04-18T14:44:01.491 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:40.775937+0000", 2024-04-18T14:44:01.491 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 5.2537999999999997e-05 2024-04-18T14:44:01.491 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:44:01.491 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-04-18T14:44:01.491 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:44:01.491 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:01.491 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:01.491 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "MOSDECSubOpWrite(3.7s4 41/30 ECSubWrite(tid=51, reqid=client.4559.0:242, at_version=41'19, trim_to=0'0, roll_forward_to=41'17))", 2024-04-18T14:44:01.491 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-04-18T14:43:40.783711+0000", 2024-04-18T14:44:01.491 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 20.692565188, 2024-04-18T14:44:01.491 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0046884939999999996, 2024-04-18T14:44:01.491 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-04-18T14:44:01.491 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "reached pg", 2024-04-18T14:44:01.491 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-04-18T14:44:01.491 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:01.492 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-04-18T14:44:01.492 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:40.783711+0000", 2024-04-18T14:44:01.492 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:44:01.492 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:01.492 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:01.492 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-04-18T14:44:01.492 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:40.783711+0000", 2024-04-18T14:44:01.492 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:44:01.492 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:01.492 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:01.492 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-04-18T14:44:01.492 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:40.783677+0000", 2024-04-18T14:44:01.492 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4294967295.9999657 2024-04-18T14:44:01.492 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:01.492 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:01.492 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-04-18T14:44:01.493 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:40.784033+0000", 2024-04-18T14:44:01.493 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00035661200000000002 2024-04-18T14:44:01.493 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:01.493 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:01.493 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-04-18T14:44:01.493 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:40.784064+0000", 2024-04-18T14:44:01.493 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.0480999999999998e-05 2024-04-18T14:44:01.493 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:01.493 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:01.493 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-04-18T14:44:01.493 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:40.784088+0000", 2024-04-18T14:44:01.493 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.4335999999999999e-05 2024-04-18T14:44:01.493 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:01.493 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:01.493 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-04-18T14:44:01.494 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:40.784212+0000", 2024-04-18T14:44:01.494 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00012333999999999999 2024-04-18T14:44:01.494 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:01.494 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:01.494 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_started", 2024-04-18T14:44:01.494 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:40.784236+0000", 2024-04-18T14:44:01.494 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.4657000000000001e-05 2024-04-18T14:44:01.494 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:01.494 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:01.494 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_committed", 2024-04-18T14:44:01.494 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:40.788326+0000", 2024-04-18T14:44:01.494 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0040892350000000001 2024-04-18T14:44:01.494 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:01.494 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:01.494 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-04-18T14:44:01.494 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:40.788400+0000", 2024-04-18T14:44:01.495 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 7.3993999999999997e-05 2024-04-18T14:44:01.495 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:44:01.495 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-04-18T14:44:01.495 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:44:01.495 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:01.495 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:01.495 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "MOSDECSubOpWrite(3.fs6 41/30 ECSubWrite(tid=48, reqid=client.4559.0:248, at_version=41'6, trim_to=0'0, roll_forward_to=33'4))", 2024-04-18T14:44:01.495 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-04-18T14:43:40.785695+0000", 2024-04-18T14:44:01.495 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 20.690580990000001, 2024-04-18T14:44:01.495 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0039156299999999998, 2024-04-18T14:44:01.495 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-04-18T14:44:01.495 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "reached pg", 2024-04-18T14:44:01.495 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-04-18T14:44:01.495 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:01.495 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-04-18T14:44:01.495 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:40.785695+0000", 2024-04-18T14:44:01.496 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:44:01.496 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:01.496 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:01.496 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-04-18T14:44:01.496 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:40.785695+0000", 2024-04-18T14:44:01.496 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:44:01.496 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:01.496 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:01.496 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-04-18T14:44:01.496 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:40.785694+0000", 2024-04-18T14:44:01.496 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4294967295.9999986 2024-04-18T14:44:01.496 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:01.496 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:01.496 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-04-18T14:44:01.496 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:40.786396+0000", 2024-04-18T14:44:01.497 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000701949 2024-04-18T14:44:01.497 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:01.497 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:01.497 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-04-18T14:44:01.497 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:40.786428+0000", 2024-04-18T14:44:01.497 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.2036999999999998e-05 2024-04-18T14:44:01.497 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:01.497 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:01.497 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-04-18T14:44:01.497 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:40.786449+0000", 2024-04-18T14:44:01.497 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.1447999999999999e-05 2024-04-18T14:44:01.497 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:01.497 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:01.497 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-04-18T14:44:01.497 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:40.786573+0000", 2024-04-18T14:44:01.497 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000123616 2024-04-18T14:44:01.498 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:01.498 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:01.498 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_started", 2024-04-18T14:44:01.498 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:40.786598+0000", 2024-04-18T14:44:01.498 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.5133000000000001e-05 2024-04-18T14:44:01.498 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:01.498 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:01.498 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_committed", 2024-04-18T14:44:01.498 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:40.789548+0000", 2024-04-18T14:44:01.498 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0029500759999999998 2024-04-18T14:44:01.498 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:01.498 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:01.498 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-04-18T14:44:01.498 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:40.789611+0000", 2024-04-18T14:44:01.498 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 6.2978000000000006e-05 2024-04-18T14:44:01.498 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:44:01.499 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-04-18T14:44:01.499 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:44:01.499 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:01.499 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:01.499 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "MOSDECSubOpWrite(3.fs6 45/30 ECSubWrite(tid=57, reqid=client.4559.0:282, at_version=45'10, trim_to=0'0, roll_forward_to=44'8))", 2024-04-18T14:44:01.499 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-04-18T14:43:44.379194+0000", 2024-04-18T14:44:01.499 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 17.097082387, 2024-04-18T14:44:01.499 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0039029809999999998, 2024-04-18T14:44:01.499 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-04-18T14:44:01.499 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "reached pg", 2024-04-18T14:44:01.499 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-04-18T14:44:01.499 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:01.499 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-04-18T14:44:01.499 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:44.379194+0000", 2024-04-18T14:44:01.499 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:44:01.499 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:01.500 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:01.500 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-04-18T14:44:01.500 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:44.379194+0000", 2024-04-18T14:44:01.500 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:44:01.500 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:01.500 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:01.500 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-04-18T14:44:01.500 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:44.379193+0000", 2024-04-18T14:44:01.500 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4294967295.9999995 2024-04-18T14:44:01.500 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:01.500 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:01.500 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-04-18T14:44:01.500 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:44.379232+0000", 2024-04-18T14:44:01.500 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.8568000000000001e-05 2024-04-18T14:44:01.500 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:01.501 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:01.501 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-04-18T14:44:01.501 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:44.379260+0000", 2024-04-18T14:44:01.501 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.832e-05 2024-04-18T14:44:01.501 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:01.501 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:01.501 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-04-18T14:44:01.501 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:44.379275+0000", 2024-04-18T14:44:01.501 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.5358000000000001e-05 2024-04-18T14:44:01.501 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:01.501 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:01.501 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-04-18T14:44:01.501 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:44.379420+0000", 2024-04-18T14:44:01.501 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00014484200000000001 2024-04-18T14:44:01.501 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:01.502 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:01.502 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_started", 2024-04-18T14:44:01.502 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:44.379447+0000", 2024-04-18T14:44:01.502 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.6276999999999999e-05 2024-04-18T14:44:01.502 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:01.502 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:01.502 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_committed", 2024-04-18T14:44:01.502 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:44.383036+0000", 2024-04-18T14:44:01.502 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.003589769 2024-04-18T14:44:01.502 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:01.502 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:01.502 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-04-18T14:44:01.502 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:44.383097+0000", 2024-04-18T14:44:01.502 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 6.0430999999999998e-05 2024-04-18T14:44:01.502 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:44:01.503 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-04-18T14:44:01.503 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:44:01.503 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:01.503 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:01.503 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "MOSDECSubOpWrite(3.es4 45/30 ECSubWrite(tid=21, reqid=client.4559.0:306, at_version=45'13, trim_to=0'0, roll_forward_to=44'11))", 2024-04-18T14:44:01.503 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-04-18T14:43:44.508291+0000", 2024-04-18T14:44:01.503 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 16.967984993999998, 2024-04-18T14:44:01.503 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0067478729999999997, 2024-04-18T14:44:01.503 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-04-18T14:44:01.503 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "reached pg", 2024-04-18T14:44:01.503 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-04-18T14:44:01.503 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:01.503 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-04-18T14:44:01.503 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:44.508291+0000", 2024-04-18T14:44:01.503 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:44:01.503 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:01.504 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:01.504 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-04-18T14:44:01.504 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:44.508291+0000", 2024-04-18T14:44:01.504 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:44:01.504 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:01.504 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:01.504 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-04-18T14:44:01.504 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:44.508291+0000", 2024-04-18T14:44:01.504 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4294967295.9999995 2024-04-18T14:44:01.504 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:01.504 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:01.504 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-04-18T14:44:01.504 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:44.508827+0000", 2024-04-18T14:44:01.504 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00053615599999999998 2024-04-18T14:44:01.504 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:01.505 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:01.505 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-04-18T14:44:01.505 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:44.508857+0000", 2024-04-18T14:44:01.505 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.04e-05 2024-04-18T14:44:01.505 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:01.505 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:01.505 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-04-18T14:44:01.505 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:44.508880+0000", 2024-04-18T14:44:01.505 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.2895e-05 2024-04-18T14:44:01.505 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:01.505 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:01.505 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-04-18T14:44:01.505 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:44.508988+0000", 2024-04-18T14:44:01.505 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000107252 2024-04-18T14:44:01.505 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:01.506 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:01.506 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_started", 2024-04-18T14:44:01.506 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:44.509007+0000", 2024-04-18T14:44:01.506 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.9585999999999998e-05 2024-04-18T14:44:01.506 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:01.506 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:01.506 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_committed", 2024-04-18T14:44:01.506 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:44.514973+0000", 2024-04-18T14:44:01.506 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0059656190000000001 2024-04-18T14:44:01.506 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:01.506 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:01.506 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-04-18T14:44:01.506 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:44.515039+0000", 2024-04-18T14:44:01.506 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 6.6328000000000006e-05 2024-04-18T14:44:01.506 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:44:01.507 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-04-18T14:44:01.507 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:44:01.507 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:01.507 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:01.507 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "MOSDECSubOpWrite(3.es4 45/30 ECSubWrite(tid=22, reqid=client.4559.0:307, at_version=45'14, trim_to=0'0, roll_forward_to=44'11))", 2024-04-18T14:44:01.507 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-04-18T14:43:44.513888+0000", 2024-04-18T14:44:01.507 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 16.962388444999998, 2024-04-18T14:44:01.507 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0039862389999999999, 2024-04-18T14:44:01.507 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-04-18T14:44:01.507 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "reached pg", 2024-04-18T14:44:01.507 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-04-18T14:44:01.507 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:01.507 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-04-18T14:44:01.507 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:44.513888+0000", 2024-04-18T14:44:01.508 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:44:01.508 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:01.508 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:01.508 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-04-18T14:44:01.508 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:44.513888+0000", 2024-04-18T14:44:01.508 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:44:01.508 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:01.508 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:01.508 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-04-18T14:44:01.508 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:44.513886+0000", 2024-04-18T14:44:01.508 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4294967295.9999981 2024-04-18T14:44:01.508 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:01.508 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:01.508 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-04-18T14:44:01.509 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:44.514000+0000", 2024-04-18T14:44:01.509 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00011363599999999999 2024-04-18T14:44:01.509 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:01.509 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:01.509 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-04-18T14:44:01.509 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:44.514030+0000", 2024-04-18T14:44:01.509 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.0817e-05 2024-04-18T14:44:01.509 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:01.509 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:01.509 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-04-18T14:44:01.509 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:44.514055+0000", 2024-04-18T14:44:01.509 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.4491e-05 2024-04-18T14:44:01.509 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:01.509 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:01.510 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-04-18T14:44:01.510 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:44.514145+0000", 2024-04-18T14:44:01.510 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 8.9901000000000005e-05 2024-04-18T14:44:01.510 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:01.510 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:01.510 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_started", 2024-04-18T14:44:01.510 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:44.514161+0000", 2024-04-18T14:44:01.510 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.6350000000000001e-05 2024-04-18T14:44:01.510 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:01.510 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:01.510 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_committed", 2024-04-18T14:44:01.510 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:44.517801+0000", 2024-04-18T14:44:01.510 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0036396369999999998 2024-04-18T14:44:01.510 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:01.510 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:01.511 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-04-18T14:44:01.511 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:44.517874+0000", 2024-04-18T14:44:01.511 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 7.3140999999999996e-05 2024-04-18T14:44:01.511 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:44:01.511 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-04-18T14:44:01.511 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:44:01.511 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:01.511 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:01.511 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "MOSDECSubOpWrite(3.7s4 51/30 ECSubWrite(tid=96, reqid=client.4559.0:375, at_version=51'33, trim_to=0'0, roll_forward_to=50'31))", 2024-04-18T14:44:01.511 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-04-18T14:43:50.401924+0000", 2024-04-18T14:44:01.511 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 11.074352555999999, 2024-04-18T14:44:01.511 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0064658420000000003, 2024-04-18T14:44:01.511 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-04-18T14:44:01.511 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "reached pg", 2024-04-18T14:44:01.511 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-04-18T14:44:01.512 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:01.512 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-04-18T14:44:01.512 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:50.401924+0000", 2024-04-18T14:44:01.512 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:44:01.512 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:01.512 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:01.512 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-04-18T14:44:01.512 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:50.401924+0000", 2024-04-18T14:44:01.512 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:44:01.512 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:01.512 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:01.512 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-04-18T14:44:01.512 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:50.401922+0000", 2024-04-18T14:44:01.512 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4294967295.999999 2024-04-18T14:44:01.512 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:01.513 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:01.513 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-04-18T14:44:01.513 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:50.402154+0000", 2024-04-18T14:44:01.513 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00023180299999999999 2024-04-18T14:44:01.513 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:01.513 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:01.513 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-04-18T14:44:01.513 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:50.402196+0000", 2024-04-18T14:44:01.513 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4.1326999999999999e-05 2024-04-18T14:44:01.513 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:01.513 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:01.513 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-04-18T14:44:01.513 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:50.402221+0000", 2024-04-18T14:44:01.513 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.5131e-05 2024-04-18T14:44:01.513 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:01.514 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:01.514 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-04-18T14:44:01.514 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:50.402506+0000", 2024-04-18T14:44:01.514 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00028558300000000001 2024-04-18T14:44:01.514 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:01.514 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:01.514 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_started", 2024-04-18T14:44:01.514 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:50.402536+0000", 2024-04-18T14:44:01.514 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.9841000000000001e-05 2024-04-18T14:44:01.514 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:01.514 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:01.514 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_committed", 2024-04-18T14:44:01.514 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:50.408338+0000", 2024-04-18T14:44:01.514 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00580227 2024-04-18T14:44:01.514 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:01.515 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:01.515 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-04-18T14:44:01.515 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:50.408390+0000", 2024-04-18T14:44:01.515 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 5.1070999999999999e-05 2024-04-18T14:44:01.515 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:44:01.515 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-04-18T14:44:01.515 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:44:01.515 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:01.515 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:01.515 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "MOSDECSubOpWrite(3.7s4 51/30 ECSubWrite(tid=99, reqid=client.4559.0:377, at_version=51'35, trim_to=0'0, roll_forward_to=51'34))", 2024-04-18T14:44:01.515 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-04-18T14:43:50.413530+0000", 2024-04-18T14:44:01.515 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 11.062745912, 2024-04-18T14:44:01.515 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0058742380000000004, 2024-04-18T14:44:01.515 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-04-18T14:44:01.515 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "reached pg", 2024-04-18T14:44:01.515 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-04-18T14:44:01.515 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:01.516 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-04-18T14:44:01.516 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:50.413530+0000", 2024-04-18T14:44:01.516 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:44:01.516 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:01.516 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:01.516 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-04-18T14:44:01.516 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:50.413530+0000", 2024-04-18T14:44:01.516 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:44:01.516 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:01.516 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:01.516 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-04-18T14:44:01.516 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:50.413528+0000", 2024-04-18T14:44:01.516 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4294967295.9999981 2024-04-18T14:44:01.516 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:01.516 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:01.517 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-04-18T14:44:01.517 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:50.413700+0000", 2024-04-18T14:44:01.517 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000171755 2024-04-18T14:44:01.517 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:01.517 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:01.517 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-04-18T14:44:01.517 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:50.413728+0000", 2024-04-18T14:44:01.517 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.7900999999999999e-05 2024-04-18T14:44:01.517 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:01.517 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:01.517 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-04-18T14:44:01.517 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:50.413753+0000", 2024-04-18T14:44:01.517 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.5333999999999998e-05 2024-04-18T14:44:01.517 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:01.517 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:01.518 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-04-18T14:44:01.518 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:50.413874+0000", 2024-04-18T14:44:01.518 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00012102799999999999 2024-04-18T14:44:01.518 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:01.518 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:01.518 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_started", 2024-04-18T14:44:01.518 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:50.413904+0000", 2024-04-18T14:44:01.518 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.9757e-05 2024-04-18T14:44:01.518 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:01.518 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:01.518 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_committed", 2024-04-18T14:44:01.518 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:50.419301+0000", 2024-04-18T14:44:01.518 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0053969150000000004 2024-04-18T14:44:01.518 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:01.518 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:01.518 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-04-18T14:44:01.519 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:50.419405+0000", 2024-04-18T14:44:01.519 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000103625 2024-04-18T14:44:01.519 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:44:01.519 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-04-18T14:44:01.519 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:44:01.519 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:01.519 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:01.519 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "MOSDECSubOpWrite(3.cs5 51/30 ECSubWrite(tid=72, reqid=client.4559.0:380, at_version=51'32, trim_to=0'0, roll_forward_to=44'30))", 2024-04-18T14:44:01.519 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-04-18T14:43:50.419384+0000", 2024-04-18T14:44:01.519 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 11.056892206000001, 2024-04-18T14:44:01.519 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0085771019999999996, 2024-04-18T14:44:01.519 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-04-18T14:44:01.519 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "reached pg", 2024-04-18T14:44:01.519 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-04-18T14:44:01.519 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:01.519 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-04-18T14:44:01.520 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:50.419384+0000", 2024-04-18T14:44:01.520 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:44:01.520 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:01.520 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:01.520 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-04-18T14:44:01.520 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:50.419384+0000", 2024-04-18T14:44:01.520 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:44:01.520 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:01.520 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:01.520 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-04-18T14:44:01.520 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:50.419383+0000", 2024-04-18T14:44:01.520 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4294967295.9999986 2024-04-18T14:44:01.520 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:01.520 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:01.521 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-04-18T14:44:01.521 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:50.420012+0000", 2024-04-18T14:44:01.521 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00062942300000000005 2024-04-18T14:44:01.521 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:01.521 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:01.521 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-04-18T14:44:01.521 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:50.420042+0000", 2024-04-18T14:44:01.521 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.9779999999999999e-05 2024-04-18T14:44:01.521 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:01.521 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:01.521 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-04-18T14:44:01.521 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:50.420085+0000", 2024-04-18T14:44:01.521 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4.3590000000000001e-05 2024-04-18T14:44:01.521 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:01.521 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:01.522 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-04-18T14:44:01.522 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:50.420314+0000", 2024-04-18T14:44:01.522 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000228583 2024-04-18T14:44:01.522 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:01.522 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:01.522 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_started", 2024-04-18T14:44:01.522 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:50.420334+0000", 2024-04-18T14:44:01.522 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.9802000000000001e-05 2024-04-18T14:44:01.522 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:01.522 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:01.522 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_committed", 2024-04-18T14:44:01.522 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:50.427910+0000", 2024-04-18T14:44:01.522 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0075759310000000002 2024-04-18T14:44:01.522 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:01.523 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:01.523 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-04-18T14:44:01.523 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:50.427961+0000", 2024-04-18T14:44:01.523 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 5.1399e-05 2024-04-18T14:44:01.523 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:44:01.523 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-04-18T14:44:01.523 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:44:01.523 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:01.523 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:01.523 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "MOSDECSubOpWrite(3.7s4 51/30 ECSubWrite(tid=101, reqid=client.4559.0:378, at_version=0'0, trim_to=0'0, roll_forward_to=51'36))", 2024-04-18T14:44:01.523 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-04-18T14:43:50.421713+0000", 2024-04-18T14:44:01.523 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 11.054563474, 2024-04-18T14:44:01.523 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0069515690000000003, 2024-04-18T14:44:01.523 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-04-18T14:44:01.523 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "reached pg", 2024-04-18T14:44:01.523 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-04-18T14:44:01.523 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:01.524 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-04-18T14:44:01.524 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:50.421713+0000", 2024-04-18T14:44:01.524 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:44:01.524 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:01.524 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:01.524 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-04-18T14:44:01.524 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:50.421713+0000", 2024-04-18T14:44:01.524 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:44:01.524 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:01.524 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:01.524 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-04-18T14:44:01.524 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:50.421712+0000", 2024-04-18T14:44:01.524 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4294967295.9999986 2024-04-18T14:44:01.524 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:01.524 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:01.524 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-04-18T14:44:01.525 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:50.421734+0000", 2024-04-18T14:44:01.525 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.2478000000000001e-05 2024-04-18T14:44:01.525 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:01.525 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:01.525 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-04-18T14:44:01.525 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:50.421760+0000", 2024-04-18T14:44:01.525 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.5622e-05 2024-04-18T14:44:01.525 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:01.525 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:01.525 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-04-18T14:44:01.525 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:50.421778+0000", 2024-04-18T14:44:01.525 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.8287e-05 2024-04-18T14:44:01.525 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:01.525 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:01.525 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-04-18T14:44:01.525 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:50.421912+0000", 2024-04-18T14:44:01.526 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00013369 2024-04-18T14:44:01.526 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:01.526 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:01.526 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_started", 2024-04-18T14:44:01.526 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:50.421933+0000", 2024-04-18T14:44:01.526 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.1044e-05 2024-04-18T14:44:01.526 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:01.526 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:01.526 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_committed", 2024-04-18T14:44:01.526 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:50.428577+0000", 2024-04-18T14:44:01.526 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0066442879999999999 2024-04-18T14:44:01.526 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:01.526 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:01.526 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-04-18T14:44:01.527 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:50.428664+0000", 2024-04-18T14:44:01.527 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 8.7377e-05 2024-04-18T14:44:01.527 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:44:01.527 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-04-18T14:44:01.527 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:44:01.527 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:01.527 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:01.527 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "MOSDECSubOpWrite(3.7s4 57/30 ECSubWrite(tid=126, reqid=client.4559.0:475, at_version=57'49, trim_to=0'0, roll_forward_to=54'47))", 2024-04-18T14:44:01.527 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-04-18T14:43:56.403717+0000", 2024-04-18T14:44:01.527 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 5.072558999, 2024-04-18T14:44:01.527 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0069574019999999997, 2024-04-18T14:44:01.527 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-04-18T14:44:01.527 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "reached pg", 2024-04-18T14:44:01.527 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-04-18T14:44:01.527 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:01.528 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-04-18T14:44:01.528 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:56.403717+0000", 2024-04-18T14:44:01.528 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:44:01.528 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:01.528 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:01.528 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-04-18T14:44:01.528 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:56.403717+0000", 2024-04-18T14:44:01.528 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:44:01.528 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:01.528 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:01.528 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-04-18T14:44:01.528 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:56.403717+0000", 2024-04-18T14:44:01.528 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4294967295.9999995 2024-04-18T14:44:01.528 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:01.528 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:01.529 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-04-18T14:44:01.529 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:56.404086+0000", 2024-04-18T14:44:01.529 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00036927100000000001 2024-04-18T14:44:01.529 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:01.529 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:01.529 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-04-18T14:44:01.529 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:56.404122+0000", 2024-04-18T14:44:01.529 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.5793000000000001e-05 2024-04-18T14:44:01.529 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:01.529 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:01.529 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-04-18T14:44:01.529 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:56.404145+0000", 2024-04-18T14:44:01.529 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.2784000000000001e-05 2024-04-18T14:44:01.529 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:01.529 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:01.530 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-04-18T14:44:01.530 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:56.404431+0000", 2024-04-18T14:44:01.530 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00028595299999999998 2024-04-18T14:44:01.530 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:01.530 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:01.530 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_started", 2024-04-18T14:44:01.530 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:56.404521+0000", 2024-04-18T14:44:01.530 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 9.0390999999999996e-05 2024-04-18T14:44:01.530 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:01.530 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:01.530 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_committed", 2024-04-18T14:44:01.530 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:56.410607+0000", 2024-04-18T14:44:01.530 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0060860100000000002 2024-04-18T14:44:01.530 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:01.530 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:01.531 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-04-18T14:44:01.531 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:56.410675+0000", 2024-04-18T14:44:01.531 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 6.7713999999999996e-05 2024-04-18T14:44:01.531 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:44:01.531 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-04-18T14:44:01.531 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:44:01.531 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:01.531 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:01.531 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "MOSDECSubOpWrite(3.7s4 57/30 ECSubWrite(tid=131, reqid=client.4559.0:477, at_version=57'51, trim_to=0'0, roll_forward_to=54'47))", 2024-04-18T14:44:01.531 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-04-18T14:43:56.417023+0000", 2024-04-18T14:44:01.531 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 5.0592532989999999, 2024-04-18T14:44:01.531 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0047488060000000004, 2024-04-18T14:44:01.531 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-04-18T14:44:01.532 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "reached pg", 2024-04-18T14:44:01.532 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-04-18T14:44:01.532 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:01.532 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-04-18T14:44:01.532 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:56.417023+0000", 2024-04-18T14:44:01.532 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:44:01.532 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:01.532 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:01.532 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-04-18T14:44:01.532 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:56.417023+0000", 2024-04-18T14:44:01.532 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:44:01.532 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:01.532 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:01.532 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-04-18T14:44:01.532 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:56.417021+0000", 2024-04-18T14:44:01.532 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4294967295.9999981 2024-04-18T14:44:01.532 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:01.533 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:01.533 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-04-18T14:44:01.533 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:56.417090+0000", 2024-04-18T14:44:01.533 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 6.9203999999999997e-05 2024-04-18T14:44:01.533 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:01.533 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:01.533 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-04-18T14:44:01.533 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:56.417124+0000", 2024-04-18T14:44:01.533 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.3277e-05 2024-04-18T14:44:01.533 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:01.533 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:01.533 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-04-18T14:44:01.533 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:56.417148+0000", 2024-04-18T14:44:01.533 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.4244e-05 2024-04-18T14:44:01.533 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:01.534 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:01.534 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-04-18T14:44:01.534 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:56.417299+0000", 2024-04-18T14:44:01.534 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00015090500000000001 2024-04-18T14:44:01.534 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:01.534 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:01.534 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_started", 2024-04-18T14:44:01.534 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:56.417330+0000", 2024-04-18T14:44:01.534 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.1216000000000001e-05 2024-04-18T14:44:01.534 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:01.534 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:01.534 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_committed", 2024-04-18T14:44:01.534 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:56.421704+0000", 2024-04-18T14:44:01.534 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.004374129 2024-04-18T14:44:01.535 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:01.535 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:01.535 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-04-18T14:44:01.535 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:56.421772+0000", 2024-04-18T14:44:01.535 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 6.7570999999999994e-05 2024-04-18T14:44:01.535 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:44:01.535 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-04-18T14:44:01.535 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:44:01.535 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:01.535 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:01.535 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "MOSDECSubOpWrite(3.es4 57/30 ECSubWrite(tid=46, reqid=client.4559.0:491, at_version=57'34, trim_to=0'0, roll_forward_to=54'32))", 2024-04-18T14:44:01.535 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-04-18T14:43:56.457634+0000", 2024-04-18T14:44:01.535 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 5.0186425110000004, 2024-04-18T14:44:01.535 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.004806589, 2024-04-18T14:44:01.535 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-04-18T14:44:01.535 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "reached pg", 2024-04-18T14:44:01.535 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-04-18T14:44:01.536 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:01.536 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-04-18T14:44:01.536 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:56.457634+0000", 2024-04-18T14:44:01.536 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:44:01.536 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:01.536 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:01.536 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-04-18T14:44:01.536 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:56.457634+0000", 2024-04-18T14:44:01.536 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:44:01.536 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:01.536 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:01.536 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-04-18T14:44:01.536 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:56.457633+0000", 2024-04-18T14:44:01.536 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4294967295.999999 2024-04-18T14:44:01.536 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:01.536 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:01.537 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-04-18T14:44:01.537 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:56.457686+0000", 2024-04-18T14:44:01.537 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 5.3560999999999998e-05 2024-04-18T14:44:01.537 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:01.537 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:01.537 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-04-18T14:44:01.537 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:56.457732+0000", 2024-04-18T14:44:01.537 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4.5457000000000002e-05 2024-04-18T14:44:01.537 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:01.537 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:01.537 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-04-18T14:44:01.537 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:56.457757+0000", 2024-04-18T14:44:01.537 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.4757e-05 2024-04-18T14:44:01.537 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:01.537 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:01.538 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-04-18T14:44:01.538 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:56.457961+0000", 2024-04-18T14:44:01.538 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000204312 2024-04-18T14:44:01.538 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:01.538 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:01.538 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_started", 2024-04-18T14:44:01.538 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:56.457993+0000", 2024-04-18T14:44:01.538 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.2533000000000002e-05 2024-04-18T14:44:01.538 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:01.538 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:01.538 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_committed", 2024-04-18T14:44:01.538 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:56.462379+0000", 2024-04-18T14:44:01.538 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0043851519999999998 2024-04-18T14:44:01.538 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:01.538 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:01.539 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-04-18T14:44:01.539 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:56.462440+0000", 2024-04-18T14:44:01.539 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 6.1674000000000006e-05 2024-04-18T14:44:01.539 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:44:01.539 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-04-18T14:44:01.539 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:44:01.539 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:01.539 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:01.539 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "MOSDECSubOpWrite(3.3s2 57/30 ECSubWrite(tid=219, reqid=client.4559.0:497, at_version=57'20, trim_to=0'0, roll_forward_to=54'18))", 2024-04-18T14:44:01.539 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-04-18T14:43:56.543541+0000", 2024-04-18T14:44:01.539 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 4.9327351579999998, 2024-04-18T14:44:01.539 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0042901340000000001, 2024-04-18T14:44:01.539 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-04-18T14:44:01.539 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "reached pg", 2024-04-18T14:44:01.540 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-04-18T14:44:01.540 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:01.540 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-04-18T14:44:01.540 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:56.543541+0000", 2024-04-18T14:44:01.540 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:44:01.540 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:01.540 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:01.540 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-04-18T14:44:01.540 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:56.543541+0000", 2024-04-18T14:44:01.540 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:44:01.540 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:01.540 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:01.540 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-04-18T14:44:01.540 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:56.543540+0000", 2024-04-18T14:44:01.540 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4294967295.999999 2024-04-18T14:44:01.541 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:01.541 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:01.541 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-04-18T14:44:01.541 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:56.543608+0000", 2024-04-18T14:44:01.541 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 6.7639999999999996e-05 2024-04-18T14:44:01.541 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:01.541 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:01.541 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-04-18T14:44:01.541 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:56.543644+0000", 2024-04-18T14:44:01.541 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.6273999999999999e-05 2024-04-18T14:44:01.541 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:01.541 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:01.541 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-04-18T14:44:01.541 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:56.543668+0000", 2024-04-18T14:44:01.541 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.3949999999999999e-05 2024-04-18T14:44:01.541 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:01.542 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:01.542 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-04-18T14:44:01.542 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:56.543830+0000", 2024-04-18T14:44:01.542 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00016188899999999999 2024-04-18T14:44:01.542 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:01.542 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:01.542 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_started", 2024-04-18T14:44:01.542 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:56.543863+0000", 2024-04-18T14:44:01.542 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.2870000000000002e-05 2024-04-18T14:44:01.542 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:01.542 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:01.542 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_committed", 2024-04-18T14:44:01.542 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:56.547764+0000", 2024-04-18T14:44:01.542 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0039011229999999998 2024-04-18T14:44:01.542 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:01.543 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:01.543 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-04-18T14:44:01.543 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:56.547831+0000", 2024-04-18T14:44:01.543 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 6.7230999999999994e-05 2024-04-18T14:44:01.543 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:44:01.543 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-04-18T14:44:01.543 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:44:01.543 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:01.543 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:01.543 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "MOSDECSubOpWrite(3.ds5 57/30 ECSubWrite(tid=20, reqid=client.4559.0:495, at_version=57'19, trim_to=0'0, roll_forward_to=54'17))", 2024-04-18T14:44:01.543 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-04-18T14:43:56.552216+0000", 2024-04-18T14:44:01.543 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 4.9240605950000003, 2024-04-18T14:44:01.543 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0068852399999999999, 2024-04-18T14:44:01.543 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-04-18T14:44:01.543 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "reached pg", 2024-04-18T14:44:01.544 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-04-18T14:44:01.544 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:01.544 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-04-18T14:44:01.544 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:56.552216+0000", 2024-04-18T14:44:01.544 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:44:01.544 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:01.544 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:01.544 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-04-18T14:44:01.544 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:56.552216+0000", 2024-04-18T14:44:01.544 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:44:01.544 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:01.544 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:01.544 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-04-18T14:44:01.544 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:56.552215+0000", 2024-04-18T14:44:01.545 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4294967295.999999 2024-04-18T14:44:01.545 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:01.545 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:01.545 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-04-18T14:44:01.545 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:56.552745+0000", 2024-04-18T14:44:01.545 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00053064900000000001 2024-04-18T14:44:01.545 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:01.545 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:01.545 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-04-18T14:44:01.545 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:56.552788+0000", 2024-04-18T14:44:01.545 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4.2593999999999999e-05 2024-04-18T14:44:01.545 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:01.545 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:01.545 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-04-18T14:44:01.545 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:56.552812+0000", 2024-04-18T14:44:01.546 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.3697e-05 2024-04-18T14:44:01.546 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:01.546 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:01.546 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-04-18T14:44:01.546 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:56.553116+0000", 2024-04-18T14:44:01.546 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00030458299999999998 2024-04-18T14:44:01.546 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:01.546 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:01.546 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_started", 2024-04-18T14:44:01.546 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:56.553232+0000", 2024-04-18T14:44:01.546 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00011555700000000001 2024-04-18T14:44:01.546 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:01.546 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:01.546 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_committed", 2024-04-18T14:44:01.546 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:56.559045+0000", 2024-04-18T14:44:01.547 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0058135169999999998 2024-04-18T14:44:01.547 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:01.547 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:01.547 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-04-18T14:44:01.547 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:56.559101+0000", 2024-04-18T14:44:01.547 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 5.5473000000000002e-05 2024-04-18T14:44:01.547 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:44:01.547 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-04-18T14:44:01.547 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:44:01.547 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:01.547 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:01.547 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "MOSDECSubOpWrite(3.ds5 57/30 ECSubWrite(tid=21, reqid=client.4559.0:495, at_version=0'0, trim_to=0'0, roll_forward_to=57'19))", 2024-04-18T14:44:01.547 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-04-18T14:43:56.562169+0000", 2024-04-18T14:44:01.547 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 4.9141069289999999, 2024-04-18T14:44:01.547 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0043234240000000002, 2024-04-18T14:44:01.547 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-04-18T14:44:01.548 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "reached pg", 2024-04-18T14:44:01.548 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-04-18T14:44:01.548 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:01.548 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-04-18T14:44:01.548 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:56.562169+0000", 2024-04-18T14:44:01.548 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:44:01.548 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:01.548 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:01.548 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-04-18T14:44:01.548 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:56.562169+0000", 2024-04-18T14:44:01.548 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:44:01.550 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:01.550 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:01.550 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-04-18T14:44:01.550 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:56.562167+0000", 2024-04-18T14:44:01.550 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4294967295.9999981 2024-04-18T14:44:01.550 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:01.550 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:01.550 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-04-18T14:44:01.550 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:56.562209+0000", 2024-04-18T14:44:01.550 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4.1794e-05 2024-04-18T14:44:01.550 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:01.550 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:01.550 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-04-18T14:44:01.550 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:56.562241+0000", 2024-04-18T14:44:01.551 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.1553000000000001e-05 2024-04-18T14:44:01.551 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:01.551 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:01.551 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-04-18T14:44:01.551 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:56.562257+0000", 2024-04-18T14:44:01.551 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.6524e-05 2024-04-18T14:44:01.551 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:01.551 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:01.551 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-04-18T14:44:01.551 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:56.562403+0000", 2024-04-18T14:44:01.551 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000145301 2024-04-18T14:44:01.551 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:01.551 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:01.551 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_started", 2024-04-18T14:44:01.551 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:56.562435+0000", 2024-04-18T14:44:01.551 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.2521000000000003e-05 2024-04-18T14:44:01.552 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:01.552 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:01.552 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_committed", 2024-04-18T14:44:01.552 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:56.566417+0000", 2024-04-18T14:44:01.552 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0039820369999999999 2024-04-18T14:44:01.552 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:01.552 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:01.552 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-04-18T14:44:01.552 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:56.566493+0000", 2024-04-18T14:44:01.552 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 7.5507999999999996e-05 2024-04-18T14:44:01.552 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:44:01.552 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-04-18T14:44:01.552 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:44:01.553 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:01.553 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:01.553 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "MOSDECSubOpWrite(3.es4 57/30 ECSubWrite(tid=48, reqid=client.4559.0:514, at_version=57'36, trim_to=0'0, roll_forward_to=57'34))", 2024-04-18T14:44:01.553 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-04-18T14:43:56.588756+0000", 2024-04-18T14:44:01.553 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 4.8875207060000001, 2024-04-18T14:44:01.553 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.005500029, 2024-04-18T14:44:01.553 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-04-18T14:44:01.553 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "reached pg", 2024-04-18T14:44:01.553 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-04-18T14:44:01.553 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:01.553 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-04-18T14:44:01.553 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:56.588756+0000", 2024-04-18T14:44:01.553 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:44:01.553 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:01.554 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:01.554 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-04-18T14:44:01.554 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:56.588756+0000", 2024-04-18T14:44:01.554 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:44:01.554 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:01.554 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:01.554 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-04-18T14:44:01.554 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:56.588753+0000", 2024-04-18T14:44:01.554 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4294967295.9999971 2024-04-18T14:44:01.554 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:01.554 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:01.554 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-04-18T14:44:01.554 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:56.589126+0000", 2024-04-18T14:44:01.554 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00037351099999999998 2024-04-18T14:44:01.554 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:01.555 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:01.555 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-04-18T14:44:01.555 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:56.589171+0000", 2024-04-18T14:44:01.555 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4.5107e-05 2024-04-18T14:44:01.555 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:01.555 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:01.555 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-04-18T14:44:01.555 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:56.589197+0000", 2024-04-18T14:44:01.555 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.5973999999999999e-05 2024-04-18T14:44:01.555 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:01.555 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:01.555 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-04-18T14:44:01.555 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:56.589425+0000", 2024-04-18T14:44:01.555 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00022799499999999999 2024-04-18T14:44:01.555 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:01.555 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:01.556 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_started", 2024-04-18T14:44:01.556 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:56.589454+0000", 2024-04-18T14:44:01.556 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.8442999999999999e-05 2024-04-18T14:44:01.556 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:01.556 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:01.556 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_committed", 2024-04-18T14:44:01.556 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:56.594187+0000", 2024-04-18T14:44:01.556 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0047333430000000001 2024-04-18T14:44:01.556 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:01.556 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:01.556 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-04-18T14:44:01.556 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:56.594256+0000", 2024-04-18T14:44:01.556 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 6.8533000000000003e-05 2024-04-18T14:44:01.556 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:44:01.556 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-04-18T14:44:01.557 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:44:01.557 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:44:01.557 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-04-18T14:44:01.557 INFO:teuthology.orchestra.run.smithi119.stdout:} 2024-04-18T14:44:01.558 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-04-18T14:44:01.559 INFO:tasks.ceph.osd.14.smithi119.stderr:2024-04-18T14:44:01.558+0000 7f180f599640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 14 (PID: 24900) UID: 0 2024-04-18T14:44:01.659 INFO:tasks.ceph.osd.9.smithi096.stderr:2024-04-18T14:44:01.658+0000 7fa2c1cbf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 9 (PID: 24891) UID: 0 2024-04-18T14:44:01.729 INFO:teuthology.orchestra.run.smithi119.stdout:{ 2024-04-18T14:44:01.730 INFO:teuthology.orchestra.run.smithi119.stdout: "ops": [], 2024-04-18T14:44:01.730 INFO:teuthology.orchestra.run.smithi119.stdout: "num_ops": 0 2024-04-18T14:44:01.730 INFO:teuthology.orchestra.run.smithi119.stdout:} 2024-04-18T14:44:01.745 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-04-18T14:44:01.760 INFO:tasks.ceph.osd.0.smithi086.stderr:2024-04-18T14:44:01.758+0000 7f7cdfd78640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 24953) UID: 0 2024-04-18T14:44:01.861 INFO:tasks.ceph.osd.5.smithi096.stderr:2024-04-18T14:44:01.858+0000 7fc33f25b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 24889) UID: 0 2024-04-18T14:44:01.865 INFO:teuthology.orchestra.run.smithi119.stdout:{ 2024-04-18T14:44:01.865 INFO:teuthology.orchestra.run.smithi119.stdout: "ops": [], 2024-04-18T14:44:01.865 INFO:teuthology.orchestra.run.smithi119.stdout: "complaint_time": 30, 2024-04-18T14:44:01.865 INFO:teuthology.orchestra.run.smithi119.stdout: "num_blocked_ops": 0 2024-04-18T14:44:01.865 INFO:teuthology.orchestra.run.smithi119.stdout:} 2024-04-18T14:44:01.880 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-04-18T14:44:01.961 INFO:tasks.ceph.osd.1.smithi096.stderr:2024-04-18T14:44:01.962+0000 7f56a7a98640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 24887) UID: 0 2024-04-18T14:44:01.998 INFO:teuthology.orchestra.run.smithi119.stdout:{ 2024-04-18T14:44:01.998 INFO:teuthology.orchestra.run.smithi119.stdout: "size": 20, 2024-04-18T14:44:01.998 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 600, 2024-04-18T14:44:01.998 INFO:teuthology.orchestra.run.smithi119.stdout: "ops": [ 2024-04-18T14:44:01.999 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:01.999 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(client.4559.0:186 3.1s0 3:8de3c091:::smithi13430248-9:head [append 0~540672] snapc 4=[4,2] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-18T14:44:01.999 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-04-18T14:43:36.754855+0000", 2024-04-18T14:44:01.999 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 25.246930160000002, 2024-04-18T14:44:01.999 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.011816834, 2024-04-18T14:44:01.999 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-04-18T14:44:01.999 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T14:44:01.999 INFO:teuthology.orchestra.run.smithi119.stdout: "client_info": { 2024-04-18T14:44:01.999 INFO:teuthology.orchestra.run.smithi119.stdout: "client": "client.4559", 2024-04-18T14:44:01.999 INFO:teuthology.orchestra.run.smithi119.stdout: "client_addr": "172.21.15.134:0/3113589487", 2024-04-18T14:44:01.999 INFO:teuthology.orchestra.run.smithi119.stdout: "tid": 186 2024-04-18T14:44:01.999 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:01.999 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-04-18T14:44:01.999 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:02.000 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-04-18T14:44:02.000 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:36.754855+0000", 2024-04-18T14:44:02.000 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:44:02.000 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:02.000 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:02.000 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-04-18T14:44:02.000 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:36.754855+0000", 2024-04-18T14:44:02.000 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:44:02.000 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:02.000 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:02.000 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-04-18T14:44:02.000 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:36.754850+0000", 2024-04-18T14:44:02.000 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4294967295.9999952 2024-04-18T14:44:02.001 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:02.001 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:02.001 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-04-18T14:44:02.001 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:36.756415+0000", 2024-04-18T14:44:02.001 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0015650550000000001 2024-04-18T14:44:02.001 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:02.001 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:02.001 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-04-18T14:44:02.001 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:36.756448+0000", 2024-04-18T14:44:02.001 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.2657000000000003e-05 2024-04-18T14:44:02.001 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:02.001 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:02.001 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-04-18T14:44:02.001 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:36.756464+0000", 2024-04-18T14:44:02.002 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.6044000000000001e-05 2024-04-18T14:44:02.002 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:02.002 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:02.002 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-04-18T14:44:02.002 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:36.756562+0000", 2024-04-18T14:44:02.002 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 9.8208999999999994e-05 2024-04-18T14:44:02.002 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:02.002 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:02.002 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-04-18T14:44:02.002 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:36.756733+0000", 2024-04-18T14:44:02.002 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00017070799999999999 2024-04-18T14:44:02.002 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:02.002 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:02.002 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_started", 2024-04-18T14:44:02.003 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:36.758906+0000", 2024-04-18T14:44:02.003 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0021729869999999999 2024-04-18T14:44:02.003 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:02.003 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:02.003 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_committed", 2024-04-18T14:44:02.003 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:36.766167+0000", 2024-04-18T14:44:02.003 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0072611739999999996 2024-04-18T14:44:02.003 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:02.003 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:02.003 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-04-18T14:44:02.003 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:36.766546+0000", 2024-04-18T14:44:02.003 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00037840699999999998 2024-04-18T14:44:02.004 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:02.004 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:02.004 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-04-18T14:44:02.004 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:36.766672+0000", 2024-04-18T14:44:02.004 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00012634300000000001 2024-04-18T14:44:02.004 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:44:02.004 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-04-18T14:44:02.004 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:44:02.004 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:02.004 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:02.004 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(client.4559.0:187 3.1s0 3:8de3c091:::smithi13430248-9:head [append 0~376832] snapc 4=[4,2] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-18T14:44:02.004 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-04-18T14:43:36.761169+0000", 2024-04-18T14:44:02.004 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 25.24061579, 2024-04-18T14:44:02.004 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.013441859, 2024-04-18T14:44:02.005 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-04-18T14:44:02.005 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T14:44:02.005 INFO:teuthology.orchestra.run.smithi119.stdout: "client_info": { 2024-04-18T14:44:02.005 INFO:teuthology.orchestra.run.smithi119.stdout: "client": "client.4559", 2024-04-18T14:44:02.005 INFO:teuthology.orchestra.run.smithi119.stdout: "client_addr": "172.21.15.134:0/3113589487", 2024-04-18T14:44:02.005 INFO:teuthology.orchestra.run.smithi119.stdout: "tid": 187 2024-04-18T14:44:02.005 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:02.005 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-04-18T14:44:02.005 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:02.005 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-04-18T14:44:02.005 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:36.761169+0000", 2024-04-18T14:44:02.005 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:44:02.005 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:02.005 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:02.006 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-04-18T14:44:02.006 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:36.761169+0000", 2024-04-18T14:44:02.006 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:44:02.006 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:02.006 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:02.006 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-04-18T14:44:02.006 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:36.761167+0000", 2024-04-18T14:44:02.006 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4294967295.9999976 2024-04-18T14:44:02.006 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:02.006 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:02.006 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-04-18T14:44:02.006 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:36.761787+0000", 2024-04-18T14:44:02.006 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00062004300000000003 2024-04-18T14:44:02.006 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:02.006 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:02.007 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-04-18T14:44:02.007 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:36.761816+0000", 2024-04-18T14:44:02.007 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.8527e-05 2024-04-18T14:44:02.007 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:02.007 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:02.007 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-04-18T14:44:02.007 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:36.761831+0000", 2024-04-18T14:44:02.007 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.5654e-05 2024-04-18T14:44:02.007 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:02.007 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:02.007 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-04-18T14:44:02.007 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:36.762166+0000", 2024-04-18T14:44:02.007 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00033494200000000002 2024-04-18T14:44:02.007 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:02.008 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:02.008 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-04-18T14:44:02.008 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:36.762326+0000", 2024-04-18T14:44:02.008 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00015945799999999999 2024-04-18T14:44:02.008 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:02.008 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:02.008 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_started", 2024-04-18T14:44:02.008 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:36.763464+0000", 2024-04-18T14:44:02.008 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00113849 2024-04-18T14:44:02.008 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:02.008 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:02.008 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_committed", 2024-04-18T14:44:02.008 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:36.766311+0000", 2024-04-18T14:44:02.008 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0028469379999999998 2024-04-18T14:44:02.008 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:02.009 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:02.009 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-04-18T14:44:02.009 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:36.774508+0000", 2024-04-18T14:44:02.009 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0081971209999999999 2024-04-18T14:44:02.009 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:02.009 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:02.009 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-04-18T14:44:02.009 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:36.774611+0000", 2024-04-18T14:44:02.009 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000103063 2024-04-18T14:44:02.009 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:44:02.009 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-04-18T14:44:02.009 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:44:02.009 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:02.009 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:02.009 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(client.4559.0:188 3.1s0 3:8de3c091:::smithi13430248-9:head [setxattr _header (55) in=7b] snapc 4=[4,2] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-18T14:44:02.010 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-04-18T14:43:36.761844+0000", 2024-04-18T14:44:02.010 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 25.239940925999999, 2024-04-18T14:44:02.010 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.013080046999999999, 2024-04-18T14:44:02.010 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-04-18T14:44:02.010 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T14:44:02.010 INFO:teuthology.orchestra.run.smithi119.stdout: "client_info": { 2024-04-18T14:44:02.010 INFO:teuthology.orchestra.run.smithi119.stdout: "client": "client.4559", 2024-04-18T14:44:02.010 INFO:teuthology.orchestra.run.smithi119.stdout: "client_addr": "172.21.15.134:0/3113589487", 2024-04-18T14:44:02.010 INFO:teuthology.orchestra.run.smithi119.stdout: "tid": 188 2024-04-18T14:44:02.010 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:02.010 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-04-18T14:44:02.010 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:02.010 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-04-18T14:44:02.010 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:36.761844+0000", 2024-04-18T14:44:02.010 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:44:02.011 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:02.011 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:02.011 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-04-18T14:44:02.011 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:36.761844+0000", 2024-04-18T14:44:02.011 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:44:02.011 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:02.011 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:02.011 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-04-18T14:44:02.011 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:36.761843+0000", 2024-04-18T14:44:02.011 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4294967295.999999 2024-04-18T14:44:02.011 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:02.011 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:02.011 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-04-18T14:44:02.012 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:36.761850+0000", 2024-04-18T14:44:02.012 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 6.7900000000000002e-06 2024-04-18T14:44:02.012 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:02.012 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:02.012 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-04-18T14:44:02.012 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:36.761863+0000", 2024-04-18T14:44:02.012 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.2554e-05 2024-04-18T14:44:02.012 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:02.012 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:02.012 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-04-18T14:44:02.012 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:36.761873+0000", 2024-04-18T14:44:02.012 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.0854e-05 2024-04-18T14:44:02.012 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:02.012 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:02.012 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-04-18T14:44:02.013 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:36.764403+0000", 2024-04-18T14:44:02.013 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0025291459999999999 2024-04-18T14:44:02.013 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:02.013 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:02.013 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-04-18T14:44:02.013 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:36.764592+0000", 2024-04-18T14:44:02.013 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00018972800000000001 2024-04-18T14:44:02.013 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:02.013 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:02.013 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_started", 2024-04-18T14:44:02.013 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:36.765646+0000", 2024-04-18T14:44:02.013 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.001053944 2024-04-18T14:44:02.013 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:02.013 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:02.014 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_committed", 2024-04-18T14:44:02.014 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:36.767122+0000", 2024-04-18T14:44:02.014 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0014754150000000001 2024-04-18T14:44:02.014 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:02.014 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:02.014 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-04-18T14:44:02.014 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:36.774806+0000", 2024-04-18T14:44:02.014 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0076844890000000001 2024-04-18T14:44:02.014 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:02.014 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:02.014 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-04-18T14:44:02.014 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:36.774924+0000", 2024-04-18T14:44:02.014 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00011815 2024-04-18T14:44:02.014 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:44:02.015 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-04-18T14:44:02.015 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:44:02.015 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:02.015 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:02.015 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(client.4559.0:189 3.1s0 3:8de3c091:::smithi13430248-9:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e37)", 2024-04-18T14:44:02.015 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-04-18T14:43:36.761939+0000", 2024-04-18T14:44:02.015 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 25.23984604, 2024-04-18T14:44:02.015 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.018164527, 2024-04-18T14:44:02.015 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-04-18T14:44:02.015 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "started", 2024-04-18T14:44:02.015 INFO:teuthology.orchestra.run.smithi119.stdout: "client_info": { 2024-04-18T14:44:02.015 INFO:teuthology.orchestra.run.smithi119.stdout: "client": "client.4559", 2024-04-18T14:44:02.015 INFO:teuthology.orchestra.run.smithi119.stdout: "client_addr": "172.21.15.134:0/3113589487", 2024-04-18T14:44:02.015 INFO:teuthology.orchestra.run.smithi119.stdout: "tid": 189 2024-04-18T14:44:02.015 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:02.015 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-04-18T14:44:02.016 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:02.016 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-04-18T14:44:02.016 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:36.761939+0000", 2024-04-18T14:44:02.016 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:44:02.016 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:02.016 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:02.016 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-04-18T14:44:02.016 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:36.761939+0000", 2024-04-18T14:44:02.016 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:44:02.016 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:02.016 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:02.016 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-04-18T14:44:02.016 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:36.761938+0000", 2024-04-18T14:44:02.016 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4294967295.9999986 2024-04-18T14:44:02.017 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:02.017 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:02.017 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-04-18T14:44:02.017 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:36.761947+0000", 2024-04-18T14:44:02.017 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 9.2399999999999996e-06 2024-04-18T14:44:02.017 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:02.017 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:02.017 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-04-18T14:44:02.017 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:36.761967+0000", 2024-04-18T14:44:02.017 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.9956999999999999e-05 2024-04-18T14:44:02.017 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:02.017 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:02.017 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-04-18T14:44:02.017 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:36.761988+0000", 2024-04-18T14:44:02.018 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.1115e-05 2024-04-18T14:44:02.018 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:02.018 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:02.018 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-04-18T14:44:02.018 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:36.767166+0000", 2024-04-18T14:44:02.018 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0051778420000000002 2024-04-18T14:44:02.018 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:02.018 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:02.018 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for rw locks", 2024-04-18T14:44:02.018 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:36.767335+0000", 2024-04-18T14:44:02.018 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00016923099999999999 2024-04-18T14:44:02.018 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:02.018 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:02.018 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-04-18T14:44:02.019 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:36.775552+0000", 2024-04-18T14:44:02.019 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0082173460000000004 2024-04-18T14:44:02.019 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:02.019 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:02.019 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-04-18T14:44:02.019 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:36.775682+0000", 2024-04-18T14:44:02.019 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000129803 2024-04-18T14:44:02.019 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:02.019 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:02.019 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-04-18T14:44:02.019 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:36.780104+0000", 2024-04-18T14:44:02.019 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0044214129999999999 2024-04-18T14:44:02.019 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:44:02.019 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-04-18T14:44:02.019 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:44:02.020 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:02.020 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:02.020 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "MOSDECSubOpWrite(3.cs6 41/30 ECSubWrite(tid=46, reqid=osd.11.0:46, at_version=41'24, trim_to=0'0, roll_forward_to=39'20))", 2024-04-18T14:44:02.020 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-04-18T14:43:40.766310+0000", 2024-04-18T14:44:02.020 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 21.235475116, 2024-04-18T14:44:02.020 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0085406670000000001, 2024-04-18T14:44:02.020 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-04-18T14:44:02.020 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "reached pg", 2024-04-18T14:44:02.020 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-04-18T14:44:02.020 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:02.020 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-04-18T14:44:02.020 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:40.766310+0000", 2024-04-18T14:44:02.020 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:44:02.020 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:02.020 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:02.021 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-04-18T14:44:02.021 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:40.766310+0000", 2024-04-18T14:44:02.021 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:44:02.021 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:02.021 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:02.021 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-04-18T14:44:02.021 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:40.766309+0000", 2024-04-18T14:44:02.021 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4294967295.999999 2024-04-18T14:44:02.021 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:02.021 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:02.021 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-04-18T14:44:02.021 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:40.766357+0000", 2024-04-18T14:44:02.021 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4.7984e-05 2024-04-18T14:44:02.021 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:02.021 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:02.022 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-04-18T14:44:02.022 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:40.766384+0000", 2024-04-18T14:44:02.022 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.6656999999999999e-05 2024-04-18T14:44:02.022 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:02.022 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:02.022 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-04-18T14:44:02.022 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:40.766403+0000", 2024-04-18T14:44:02.022 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.8947999999999999e-05 2024-04-18T14:44:02.022 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:02.022 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:02.022 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-04-18T14:44:02.022 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:40.768792+0000", 2024-04-18T14:44:02.022 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0023896299999999998 2024-04-18T14:44:02.022 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:02.023 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:02.023 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_started", 2024-04-18T14:44:02.023 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:40.768817+0000", 2024-04-18T14:44:02.023 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.4263000000000001e-05 2024-04-18T14:44:02.023 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:02.023 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:02.023 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_committed", 2024-04-18T14:44:02.023 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:40.774817+0000", 2024-04-18T14:44:02.023 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0060000440000000004 2024-04-18T14:44:02.023 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:02.023 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:02.023 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-04-18T14:44:02.023 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:40.774851+0000", 2024-04-18T14:44:02.023 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.4037e-05 2024-04-18T14:44:02.023 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:44:02.024 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-04-18T14:44:02.024 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:44:02.024 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:02.024 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:02.024 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(client.4559.0:285 3.1s0 3:891e68bf:::smithi13430248-19:2 [read 0~311296,checksum,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-04-18T14:44:02.024 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-04-18T14:43:44.372864+0000", 2024-04-18T14:44:02.024 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 17.628920857000001, 2024-04-18T14:44:02.024 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.010186044, 2024-04-18T14:44:02.024 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-04-18T14:44:02.024 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "started", 2024-04-18T14:44:02.024 INFO:teuthology.orchestra.run.smithi119.stdout: "client_info": { 2024-04-18T14:44:02.024 INFO:teuthology.orchestra.run.smithi119.stdout: "client": "client.4559", 2024-04-18T14:44:02.024 INFO:teuthology.orchestra.run.smithi119.stdout: "client_addr": "172.21.15.134:0/3113589487", 2024-04-18T14:44:02.024 INFO:teuthology.orchestra.run.smithi119.stdout: "tid": 285 2024-04-18T14:44:02.024 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:02.024 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-04-18T14:44:02.025 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:02.025 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-04-18T14:44:02.025 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:44.372864+0000", 2024-04-18T14:44:02.025 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:44:02.025 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:02.025 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:02.025 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-04-18T14:44:02.025 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:44.372864+0000", 2024-04-18T14:44:02.025 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:44:02.025 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:02.025 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:02.025 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-04-18T14:44:02.025 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:44.372862+0000", 2024-04-18T14:44:02.025 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4294967295.9999971 2024-04-18T14:44:02.026 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:02.026 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:02.026 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-04-18T14:44:02.026 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:44.372880+0000", 2024-04-18T14:44:02.026 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.8688000000000001e-05 2024-04-18T14:44:02.026 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:02.026 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:02.026 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-04-18T14:44:02.026 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:44.372914+0000", 2024-04-18T14:44:02.026 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.3837000000000001e-05 2024-04-18T14:44:02.026 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:02.026 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:02.026 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-04-18T14:44:02.026 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:44.372950+0000", 2024-04-18T14:44:02.026 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.5604e-05 2024-04-18T14:44:02.027 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:02.027 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:02.027 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-04-18T14:44:02.027 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:44.373068+0000", 2024-04-18T14:44:02.027 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000118385 2024-04-18T14:44:02.027 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:02.027 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:02.027 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "op must wait for map", 2024-04-18T14:44:02.027 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:44.373082+0000", 2024-04-18T14:44:02.027 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.4087000000000001e-05 2024-04-18T14:44:02.027 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:02.027 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:02.027 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-04-18T14:44:02.027 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:44.377259+0000", 2024-04-18T14:44:02.027 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0041765300000000003 2024-04-18T14:44:02.027 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:02.028 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:02.028 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-04-18T14:44:02.028 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:44.377542+0000", 2024-04-18T14:44:02.028 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00028300500000000002 2024-04-18T14:44:02.028 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:02.028 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:02.028 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-04-18T14:44:02.028 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:44.383050+0000", 2024-04-18T14:44:02.028 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0055085749999999999 2024-04-18T14:44:02.028 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:44:02.028 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-04-18T14:44:02.028 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:44:02.028 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:02.028 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:02.028 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(client.4559.0:286 3.1s0 3:891e68bf:::smithi13430248-19:2 [read 0~311296,checksum] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-04-18T14:44:02.029 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-04-18T14:43:44.372973+0000", 2024-04-18T14:44:02.029 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 17.628811947999999, 2024-04-18T14:44:02.029 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.011021772000000001, 2024-04-18T14:44:02.029 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-04-18T14:44:02.029 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "started", 2024-04-18T14:44:02.029 INFO:teuthology.orchestra.run.smithi119.stdout: "client_info": { 2024-04-18T14:44:02.029 INFO:teuthology.orchestra.run.smithi119.stdout: "client": "client.4559", 2024-04-18T14:44:02.029 INFO:teuthology.orchestra.run.smithi119.stdout: "client_addr": "172.21.15.134:0/3113589487", 2024-04-18T14:44:02.029 INFO:teuthology.orchestra.run.smithi119.stdout: "tid": 286 2024-04-18T14:44:02.029 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:02.029 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-04-18T14:44:02.029 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:02.029 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-04-18T14:44:02.029 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:44.372973+0000", 2024-04-18T14:44:02.029 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:44:02.030 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:02.030 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:02.030 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-04-18T14:44:02.030 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:44.372973+0000", 2024-04-18T14:44:02.030 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:44:02.030 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:02.030 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:02.030 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-04-18T14:44:02.030 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:44.372972+0000", 2024-04-18T14:44:02.030 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4294967295.999999 2024-04-18T14:44:02.030 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:02.030 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:02.030 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-04-18T14:44:02.030 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:44.372979+0000", 2024-04-18T14:44:02.030 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 7.0509999999999999e-06 2024-04-18T14:44:02.031 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:02.031 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:02.031 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-04-18T14:44:02.031 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:44.373015+0000", 2024-04-18T14:44:02.031 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.5583999999999997e-05 2024-04-18T14:44:02.031 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:02.031 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:02.031 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-04-18T14:44:02.031 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:44.373026+0000", 2024-04-18T14:44:02.031 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.1586000000000001e-05 2024-04-18T14:44:02.031 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:02.031 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:02.031 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-04-18T14:44:02.031 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:44.373222+0000", 2024-04-18T14:44:02.031 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000195391 2024-04-18T14:44:02.032 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:02.032 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:02.032 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting_for_map not empty", 2024-04-18T14:44:02.032 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:44.373233+0000", 2024-04-18T14:44:02.032 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.1586999999999999e-05 2024-04-18T14:44:02.032 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:02.032 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:02.032 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-04-18T14:44:02.032 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:44.379041+0000", 2024-04-18T14:44:02.032 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0058081030000000002 2024-04-18T14:44:02.032 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:02.032 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:02.032 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-04-18T14:44:02.032 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:44.379196+0000", 2024-04-18T14:44:02.032 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00015440199999999999 2024-04-18T14:44:02.032 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:02.033 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:02.033 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-04-18T14:44:02.033 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:44.383995+0000", 2024-04-18T14:44:02.033 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0047992419999999996 2024-04-18T14:44:02.033 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:44:02.033 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-04-18T14:44:02.033 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:44:02.033 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:02.033 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:02.033 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(client.4559.0:287 3.1s0 3:891e68bf:::smithi13430248-19:2 [read 0~311296,checksum] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-04-18T14:44:02.033 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-04-18T14:43:44.373037+0000", 2024-04-18T14:44:02.033 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 17.628747857, 2024-04-18T14:44:02.033 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.015018301, 2024-04-18T14:44:02.033 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-04-18T14:44:02.033 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "started", 2024-04-18T14:44:02.034 INFO:teuthology.orchestra.run.smithi119.stdout: "client_info": { 2024-04-18T14:44:02.034 INFO:teuthology.orchestra.run.smithi119.stdout: "client": "client.4559", 2024-04-18T14:44:02.034 INFO:teuthology.orchestra.run.smithi119.stdout: "client_addr": "172.21.15.134:0/3113589487", 2024-04-18T14:44:02.034 INFO:teuthology.orchestra.run.smithi119.stdout: "tid": 287 2024-04-18T14:44:02.034 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:02.034 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-04-18T14:44:02.034 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:02.034 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-04-18T14:44:02.034 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:44.373037+0000", 2024-04-18T14:44:02.034 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:44:02.034 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:02.034 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:02.034 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-04-18T14:44:02.034 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:44.373037+0000", 2024-04-18T14:44:02.034 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:44:02.034 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:02.035 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:02.035 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-04-18T14:44:02.035 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:44.373036+0000", 2024-04-18T14:44:02.035 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4294967295.999999 2024-04-18T14:44:02.035 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:02.035 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:02.035 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-04-18T14:44:02.035 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:44.373042+0000", 2024-04-18T14:44:02.035 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 5.8370000000000002e-06 2024-04-18T14:44:02.035 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:02.035 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:02.035 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-04-18T14:44:02.035 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:44.373052+0000", 2024-04-18T14:44:02.035 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 9.9869999999999994e-06 2024-04-18T14:44:02.035 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:02.036 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:02.036 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-04-18T14:44:02.036 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:44.373060+0000", 2024-04-18T14:44:02.036 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 7.34e-06 2024-04-18T14:44:02.036 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:02.036 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:02.036 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-04-18T14:44:02.036 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:44.373308+0000", 2024-04-18T14:44:02.036 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00024842100000000003 2024-04-18T14:44:02.036 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:02.036 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:02.036 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting_for_map not empty", 2024-04-18T14:44:02.036 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:44.373327+0000", 2024-04-18T14:44:02.036 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.9417000000000001e-05 2024-04-18T14:44:02.036 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:02.036 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:02.037 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-04-18T14:44:02.037 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:44.384088+0000", 2024-04-18T14:44:02.037 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.010760357 2024-04-18T14:44:02.037 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:02.037 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:02.037 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-04-18T14:44:02.037 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:44.384388+0000", 2024-04-18T14:44:02.037 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00029992499999999999 2024-04-18T14:44:02.037 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:02.037 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:02.037 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-04-18T14:44:02.037 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:44.388056+0000", 2024-04-18T14:44:02.037 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0036678499999999998 2024-04-18T14:44:02.037 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:44:02.038 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-04-18T14:44:02.038 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:44:02.038 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:02.038 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:02.038 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(client.4559.0:319 3.1s0 3:86043532:::smithi13430248-49:head [rollback 2] snapc d=[d,b,a,8,7,2] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-18T14:44:02.038 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-04-18T14:43:44.563613+0000", 2024-04-18T14:44:02.038 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 17.438172296000001, 2024-04-18T14:44:02.038 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.010064484, 2024-04-18T14:44:02.038 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-04-18T14:44:02.038 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T14:44:02.038 INFO:teuthology.orchestra.run.smithi119.stdout: "client_info": { 2024-04-18T14:44:02.038 INFO:teuthology.orchestra.run.smithi119.stdout: "client": "client.4559", 2024-04-18T14:44:02.038 INFO:teuthology.orchestra.run.smithi119.stdout: "client_addr": "172.21.15.134:0/3113589487", 2024-04-18T14:44:02.038 INFO:teuthology.orchestra.run.smithi119.stdout: "tid": 319 2024-04-18T14:44:02.038 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:02.039 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-04-18T14:44:02.039 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:02.039 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-04-18T14:44:02.039 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:44.563613+0000", 2024-04-18T14:44:02.039 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:44:02.039 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:02.039 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:02.039 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-04-18T14:44:02.039 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:44.563613+0000", 2024-04-18T14:44:02.039 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:44:02.039 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:02.039 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:02.039 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-04-18T14:44:02.039 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:44.563612+0000", 2024-04-18T14:44:02.039 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4294967295.999999 2024-04-18T14:44:02.040 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:02.040 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:02.040 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-04-18T14:44:02.040 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:44.563618+0000", 2024-04-18T14:44:02.040 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 6.4829999999999996e-06 2024-04-18T14:44:02.040 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:02.040 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:02.040 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-04-18T14:44:02.040 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:44.563631+0000", 2024-04-18T14:44:02.040 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.2594e-05 2024-04-18T14:44:02.040 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:02.040 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:02.040 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-04-18T14:44:02.040 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:44.563639+0000", 2024-04-18T14:44:02.040 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 8.1969999999999996e-06 2024-04-18T14:44:02.040 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:02.041 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:02.041 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-04-18T14:44:02.041 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:44.566084+0000", 2024-04-18T14:44:02.041 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0024452609999999998 2024-04-18T14:44:02.041 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:02.041 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:02.041 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-04-18T14:44:02.041 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:44.566366+0000", 2024-04-18T14:44:02.041 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00028144200000000002 2024-04-18T14:44:02.041 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:02.041 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:02.041 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_started", 2024-04-18T14:44:02.041 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:44.567405+0000", 2024-04-18T14:44:02.041 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0010387319999999999 2024-04-18T14:44:02.041 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:02.042 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:02.042 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_committed", 2024-04-18T14:44:02.042 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:44.569681+0000", 2024-04-18T14:44:02.042 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0022766420000000002 2024-04-18T14:44:02.042 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:02.042 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:02.042 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-04-18T14:44:02.042 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:44.573577+0000", 2024-04-18T14:44:02.042 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0038952349999999999 2024-04-18T14:44:02.042 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:02.042 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:02.042 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-04-18T14:44:02.042 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:44.573677+0000", 2024-04-18T14:44:02.042 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00010084799999999999 2024-04-18T14:44:02.043 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:44:02.043 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-04-18T14:44:02.043 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:44:02.043 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:02.043 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:02.043 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(client.4559.0:320 3.1s0 3:86043532:::smithi13430248-49:head [append 0~0] snapc d=[d,b,a,8,7,2] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-18T14:44:02.043 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-04-18T14:43:44.563733+0000", 2024-04-18T14:44:02.043 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 17.438052021000001, 2024-04-18T14:44:02.043 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.010280269, 2024-04-18T14:44:02.043 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-04-18T14:44:02.043 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T14:44:02.043 INFO:teuthology.orchestra.run.smithi119.stdout: "client_info": { 2024-04-18T14:44:02.043 INFO:teuthology.orchestra.run.smithi119.stdout: "client": "client.4559", 2024-04-18T14:44:02.043 INFO:teuthology.orchestra.run.smithi119.stdout: "client_addr": "172.21.15.134:0/3113589487", 2024-04-18T14:44:02.043 INFO:teuthology.orchestra.run.smithi119.stdout: "tid": 320 2024-04-18T14:44:02.044 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:02.044 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-04-18T14:44:02.044 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:02.044 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-04-18T14:44:02.044 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:44.563733+0000", 2024-04-18T14:44:02.044 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:44:02.044 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:02.044 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:02.044 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-04-18T14:44:02.044 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:44.563733+0000", 2024-04-18T14:44:02.044 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:44:02.044 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:02.044 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:02.044 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-04-18T14:44:02.044 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:44.563731+0000", 2024-04-18T14:44:02.044 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4294967295.9999976 2024-04-18T14:44:02.045 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:02.045 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:02.045 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-04-18T14:44:02.045 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:44.563744+0000", 2024-04-18T14:44:02.045 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.311e-05 2024-04-18T14:44:02.045 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:02.045 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:02.045 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-04-18T14:44:02.045 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:44.563777+0000", 2024-04-18T14:44:02.045 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.2984000000000001e-05 2024-04-18T14:44:02.045 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:02.045 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:02.045 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-04-18T14:44:02.045 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:44.563812+0000", 2024-04-18T14:44:02.045 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.4793999999999999e-05 2024-04-18T14:44:02.046 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:02.046 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:02.046 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-04-18T14:44:02.046 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:44.568010+0000", 2024-04-18T14:44:02.046 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0041978069999999996 2024-04-18T14:44:02.046 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:02.046 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:02.046 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-04-18T14:44:02.046 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:44.568172+0000", 2024-04-18T14:44:02.046 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00016264599999999999 2024-04-18T14:44:02.046 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:02.046 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:02.046 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_started", 2024-04-18T14:44:02.046 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:44.568987+0000", 2024-04-18T14:44:02.046 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00081480500000000004 2024-04-18T14:44:02.047 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:02.047 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:02.047 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_committed", 2024-04-18T14:44:02.047 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:44.570293+0000", 2024-04-18T14:44:02.047 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0013059499999999999 2024-04-18T14:44:02.047 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:02.047 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:02.047 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-04-18T14:44:02.047 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:44.573919+0000", 2024-04-18T14:44:02.047 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0036257400000000001 2024-04-18T14:44:02.047 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:02.047 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:02.047 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-04-18T14:44:02.047 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:44.574013+0000", 2024-04-18T14:44:02.047 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 9.4769e-05 2024-04-18T14:44:02.048 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:44:02.048 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-04-18T14:44:02.048 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:44:02.048 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:02.048 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:02.048 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "MOSDECSubOpWrite(3.ds6 50/30 ECSubWrite(tid=12, reqid=osd.7.0:12, at_version=50'11, trim_to=0'0, roll_forward_to=49'9))", 2024-04-18T14:44:02.048 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-04-18T14:43:49.405729+0000", 2024-04-18T14:44:02.048 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 12.59605595, 2024-04-18T14:44:02.048 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.007442387, 2024-04-18T14:44:02.048 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-04-18T14:44:02.048 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "reached pg", 2024-04-18T14:44:02.048 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-04-18T14:44:02.048 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:02.048 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-04-18T14:44:02.048 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:49.405729+0000", 2024-04-18T14:44:02.049 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:44:02.049 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:02.049 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:02.049 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-04-18T14:44:02.049 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:49.405729+0000", 2024-04-18T14:44:02.049 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:44:02.049 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:02.049 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:02.049 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-04-18T14:44:02.049 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:49.405728+0000", 2024-04-18T14:44:02.049 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4294967295.999999 2024-04-18T14:44:02.049 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:02.049 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:02.049 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-04-18T14:44:02.049 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:49.405780+0000", 2024-04-18T14:44:02.050 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 5.1487999999999999e-05 2024-04-18T14:44:02.050 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:02.050 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:02.050 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-04-18T14:44:02.050 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:49.405809+0000", 2024-04-18T14:44:02.050 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.9597000000000001e-05 2024-04-18T14:44:02.050 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:02.050 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:02.050 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-04-18T14:44:02.050 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:49.405837+0000", 2024-04-18T14:44:02.050 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.7287000000000001e-05 2024-04-18T14:44:02.050 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:02.050 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:02.050 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-04-18T14:44:02.050 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:49.406009+0000", 2024-04-18T14:44:02.050 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00017212600000000001 2024-04-18T14:44:02.051 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:02.051 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:02.051 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_started", 2024-04-18T14:44:02.051 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:49.406033+0000", 2024-04-18T14:44:02.051 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.3663999999999999e-05 2024-04-18T14:44:02.051 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:02.051 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:02.051 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_committed", 2024-04-18T14:44:02.051 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:49.413073+0000", 2024-04-18T14:44:02.051 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0070408509999999999 2024-04-18T14:44:02.051 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:02.051 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:02.051 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-04-18T14:44:02.051 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:49.413172+0000", 2024-04-18T14:44:02.052 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 9.8201000000000004e-05 2024-04-18T14:44:02.052 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:44:02.052 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-04-18T14:44:02.052 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:44:02.052 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:02.052 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:02.052 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(client.4559.0:372 3.1s0 3:8de3c091:::smithi13430248-9:head [read 0~1409024,checksum,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-04-18T14:44:02.052 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-04-18T14:43:50.376227+0000", 2024-04-18T14:44:02.052 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 11.625558321, 2024-04-18T14:44:02.052 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.014725912000000001, 2024-04-18T14:44:02.052 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-04-18T14:44:02.052 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "started", 2024-04-18T14:44:02.052 INFO:teuthology.orchestra.run.smithi119.stdout: "client_info": { 2024-04-18T14:44:02.052 INFO:teuthology.orchestra.run.smithi119.stdout: "client": "client.4559", 2024-04-18T14:44:02.052 INFO:teuthology.orchestra.run.smithi119.stdout: "client_addr": "172.21.15.134:0/3113589487", 2024-04-18T14:44:02.053 INFO:teuthology.orchestra.run.smithi119.stdout: "tid": 372 2024-04-18T14:44:02.053 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:02.053 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-04-18T14:44:02.053 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:02.053 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-04-18T14:44:02.053 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:50.376227+0000", 2024-04-18T14:44:02.053 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:44:02.053 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:02.053 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:02.053 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-04-18T14:44:02.053 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:50.376227+0000", 2024-04-18T14:44:02.053 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:44:02.053 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:02.053 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:02.053 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-04-18T14:44:02.053 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:50.376224+0000", 2024-04-18T14:44:02.054 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4294967295.9999971 2024-04-18T14:44:02.054 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:02.054 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:02.054 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-04-18T14:44:02.054 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:50.376241+0000", 2024-04-18T14:44:02.054 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.6393999999999999e-05 2024-04-18T14:44:02.054 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:02.054 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:02.054 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-04-18T14:44:02.054 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:50.376283+0000", 2024-04-18T14:44:02.054 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4.2234000000000003e-05 2024-04-18T14:44:02.054 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:02.054 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:02.054 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-04-18T14:44:02.054 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:50.376306+0000", 2024-04-18T14:44:02.055 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.2917000000000001e-05 2024-04-18T14:44:02.055 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:02.055 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:02.055 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-04-18T14:44:02.055 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:50.376438+0000", 2024-04-18T14:44:02.055 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000132695 2024-04-18T14:44:02.055 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:02.055 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:02.055 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "op must wait for map", 2024-04-18T14:44:02.055 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:50.376461+0000", 2024-04-18T14:44:02.055 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.243e-05 2024-04-18T14:44:02.055 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:02.055 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:02.055 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-04-18T14:44:02.055 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:50.381413+0000", 2024-04-18T14:44:02.055 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0049522860000000002 2024-04-18T14:44:02.056 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:02.056 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:02.056 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-04-18T14:44:02.056 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:50.381644+0000", 2024-04-18T14:44:02.056 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000230416 2024-04-18T14:44:02.056 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:02.056 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:02.056 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-04-18T14:44:02.056 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:50.390953+0000", 2024-04-18T14:44:02.056 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0093092069999999999 2024-04-18T14:44:02.056 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:44:02.056 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-04-18T14:44:02.056 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:44:02.056 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:02.056 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:02.057 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(client.4559.0:373 3.1s0 3:8de3c091:::smithi13430248-9:head [read 0~1409024,checksum] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-04-18T14:44:02.057 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-04-18T14:43:50.376336+0000", 2024-04-18T14:44:02.057 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 11.62544937, 2024-04-18T14:44:02.057 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.017062416, 2024-04-18T14:44:02.057 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-04-18T14:44:02.057 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "started", 2024-04-18T14:44:02.057 INFO:teuthology.orchestra.run.smithi119.stdout: "client_info": { 2024-04-18T14:44:02.057 INFO:teuthology.orchestra.run.smithi119.stdout: "client": "client.4559", 2024-04-18T14:44:02.057 INFO:teuthology.orchestra.run.smithi119.stdout: "client_addr": "172.21.15.134:0/3113589487", 2024-04-18T14:44:02.057 INFO:teuthology.orchestra.run.smithi119.stdout: "tid": 373 2024-04-18T14:44:02.057 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:02.057 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-04-18T14:44:02.057 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:02.057 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-04-18T14:44:02.057 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:50.376336+0000", 2024-04-18T14:44:02.058 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:44:02.058 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:02.058 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:02.058 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-04-18T14:44:02.058 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:50.376336+0000", 2024-04-18T14:44:02.058 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:44:02.058 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:02.058 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:02.058 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-04-18T14:44:02.058 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:50.376334+0000", 2024-04-18T14:44:02.058 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4294967295.9999986 2024-04-18T14:44:02.058 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:02.058 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:02.058 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-04-18T14:44:02.058 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:50.376344+0000", 2024-04-18T14:44:02.059 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 9.9939999999999995e-06 2024-04-18T14:44:02.059 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:02.059 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:02.059 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-04-18T14:44:02.059 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:50.376363+0000", 2024-04-18T14:44:02.059 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.9063e-05 2024-04-18T14:44:02.059 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:02.059 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:02.059 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-04-18T14:44:02.059 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:50.376379+0000", 2024-04-18T14:44:02.059 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.5153999999999999e-05 2024-04-18T14:44:02.059 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:02.059 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:02.059 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-04-18T14:44:02.059 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:50.376635+0000", 2024-04-18T14:44:02.060 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00025632600000000003 2024-04-18T14:44:02.060 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:02.060 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:02.060 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting_for_map not empty", 2024-04-18T14:44:02.060 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:50.376657+0000", 2024-04-18T14:44:02.060 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.1693999999999999e-05 2024-04-18T14:44:02.060 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:02.060 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:02.060 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-04-18T14:44:02.060 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:50.383261+0000", 2024-04-18T14:44:02.060 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0066047579999999996 2024-04-18T14:44:02.060 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:02.060 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:02.060 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-04-18T14:44:02.060 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:50.383496+0000", 2024-04-18T14:44:02.061 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00023489299999999999 2024-04-18T14:44:02.061 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:02.061 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:02.061 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-04-18T14:44:02.061 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:50.393398+0000", 2024-04-18T14:44:02.061 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0099019269999999996 2024-04-18T14:44:02.061 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:44:02.061 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-04-18T14:44:02.061 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:44:02.061 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:02.061 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:02.061 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(client.4559.0:374 3.1s0 3:8de3c091:::smithi13430248-9:head [read 0~1409024,checksum] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-04-18T14:44:02.061 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-04-18T14:43:50.376424+0000", 2024-04-18T14:44:02.061 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 11.625361652, 2024-04-18T14:44:02.062 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.018965715000000001, 2024-04-18T14:44:02.062 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-04-18T14:44:02.062 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "started", 2024-04-18T14:44:02.062 INFO:teuthology.orchestra.run.smithi119.stdout: "client_info": { 2024-04-18T14:44:02.062 INFO:teuthology.orchestra.run.smithi119.stdout: "client": "client.4559", 2024-04-18T14:44:02.062 INFO:teuthology.orchestra.run.smithi119.stdout: "client_addr": "172.21.15.134:0/3113589487", 2024-04-18T14:44:02.062 INFO:teuthology.orchestra.run.smithi119.stdout: "tid": 374 2024-04-18T14:44:02.062 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:02.062 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-04-18T14:44:02.062 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:02.062 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-04-18T14:44:02.062 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:50.376424+0000", 2024-04-18T14:44:02.062 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:44:02.062 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:02.062 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:02.062 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-04-18T14:44:02.063 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:50.376424+0000", 2024-04-18T14:44:02.063 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:44:02.063 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:02.063 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:02.063 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-04-18T14:44:02.063 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:50.376422+0000", 2024-04-18T14:44:02.063 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4294967295.9999986 2024-04-18T14:44:02.063 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:02.063 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:02.063 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-04-18T14:44:02.063 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:50.376430+0000", 2024-04-18T14:44:02.063 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 7.7610000000000007e-06 2024-04-18T14:44:02.063 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:02.063 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:02.063 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-04-18T14:44:02.064 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:50.376447+0000", 2024-04-18T14:44:02.064 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.734e-05 2024-04-18T14:44:02.064 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:02.064 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:02.064 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-04-18T14:44:02.064 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:50.376462+0000", 2024-04-18T14:44:02.064 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.4286e-05 2024-04-18T14:44:02.064 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:02.064 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:02.064 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-04-18T14:44:02.064 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:50.376723+0000", 2024-04-18T14:44:02.064 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000260914 2024-04-18T14:44:02.064 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:02.064 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:02.064 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting_for_map not empty", 2024-04-18T14:44:02.065 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:50.376743+0000", 2024-04-18T14:44:02.065 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.031e-05 2024-04-18T14:44:02.065 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:02.065 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:02.065 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-04-18T14:44:02.065 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:50.387572+0000", 2024-04-18T14:44:02.065 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.010829544 2024-04-18T14:44:02.065 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:02.065 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:02.065 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-04-18T14:44:02.065 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:50.387758+0000", 2024-04-18T14:44:02.065 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000185849 2024-04-18T14:44:02.065 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:02.065 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:02.066 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-04-18T14:44:02.066 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:50.395389+0000", 2024-04-18T14:44:02.066 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0076309810000000002 2024-04-18T14:44:02.066 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:44:02.066 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-04-18T14:44:02.066 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:44:02.066 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:02.066 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:02.066 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "MOSDECSubOpWrite(3.ds6 57/30 ECSubWrite(tid=20, reqid=client.4559.0:495, at_version=57'19, trim_to=0'0, roll_forward_to=54'17))", 2024-04-18T14:44:02.066 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-04-18T14:43:56.552436+0000", 2024-04-18T14:44:02.066 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 5.4493494699999996, 2024-04-18T14:44:02.066 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0092140309999999993, 2024-04-18T14:44:02.066 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-04-18T14:44:02.066 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "reached pg", 2024-04-18T14:44:02.067 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-04-18T14:44:02.067 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:02.067 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-04-18T14:44:02.067 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:56.552436+0000", 2024-04-18T14:44:02.067 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:44:02.067 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:02.067 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:02.067 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-04-18T14:44:02.067 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:56.552436+0000", 2024-04-18T14:44:02.067 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:44:02.067 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:02.067 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:02.067 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-04-18T14:44:02.067 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:56.552434+0000", 2024-04-18T14:44:02.067 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4294967295.9999981 2024-04-18T14:44:02.068 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:02.068 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:02.068 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-04-18T14:44:02.068 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:56.553692+0000", 2024-04-18T14:44:02.068 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0012579690000000001 2024-04-18T14:44:02.068 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:02.068 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:02.068 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-04-18T14:44:02.068 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:56.553719+0000", 2024-04-18T14:44:02.068 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.7076999999999998e-05 2024-04-18T14:44:02.068 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:02.068 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:02.068 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-04-18T14:44:02.068 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:56.553740+0000", 2024-04-18T14:44:02.069 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.1420000000000002e-05 2024-04-18T14:44:02.069 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:02.069 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:02.069 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-04-18T14:44:02.069 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:56.553888+0000", 2024-04-18T14:44:02.069 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000147732 2024-04-18T14:44:02.069 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:02.069 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:02.069 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_started", 2024-04-18T14:44:02.069 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:56.553914+0000", 2024-04-18T14:44:02.069 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.5950000000000001e-05 2024-04-18T14:44:02.069 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:02.069 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:02.069 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_committed", 2024-04-18T14:44:02.070 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:56.561590+0000", 2024-04-18T14:44:02.070 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0076763059999999999 2024-04-18T14:44:02.070 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:02.070 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:02.070 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-04-18T14:44:02.070 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:56.561650+0000", 2024-04-18T14:44:02.070 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 5.9413000000000002e-05 2024-04-18T14:44:02.070 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:44:02.070 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-04-18T14:44:02.070 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:44:02.070 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:02.070 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:02.070 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(client.4559.0:512 3.1s0 3:8edef92b:::smithi13430248-24:head [copy-from ver 13] snapc 19=[19,16,14,13,11,f,b,a,7,2] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-18T14:44:02.070 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-04-18T14:43:56.578477+0000", 2024-04-18T14:44:02.070 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 5.423307876, 2024-04-18T14:44:02.070 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.021126664, 2024-04-18T14:44:02.071 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-04-18T14:44:02.071 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T14:44:02.071 INFO:teuthology.orchestra.run.smithi119.stdout: "client_info": { 2024-04-18T14:44:02.071 INFO:teuthology.orchestra.run.smithi119.stdout: "client": "client.4559", 2024-04-18T14:44:02.071 INFO:teuthology.orchestra.run.smithi119.stdout: "client_addr": "172.21.15.134:0/3113589487", 2024-04-18T14:44:02.071 INFO:teuthology.orchestra.run.smithi119.stdout: "tid": 512 2024-04-18T14:44:02.071 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:02.071 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-04-18T14:44:02.071 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:02.071 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-04-18T14:44:02.071 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:56.578477+0000", 2024-04-18T14:44:02.071 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:44:02.071 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:02.071 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:02.072 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-04-18T14:44:02.072 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:56.578477+0000", 2024-04-18T14:44:02.072 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:44:02.072 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:02.072 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:02.072 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-04-18T14:44:02.072 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:56.578473+0000", 2024-04-18T14:44:02.072 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4294967295.9999962 2024-04-18T14:44:02.072 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:02.072 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:02.072 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-04-18T14:44:02.072 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:56.578491+0000", 2024-04-18T14:44:02.072 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.7784000000000001e-05 2024-04-18T14:44:02.072 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:02.072 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:02.072 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-04-18T14:44:02.073 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:56.578576+0000", 2024-04-18T14:44:02.073 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 8.5117000000000005e-05 2024-04-18T14:44:02.073 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:02.073 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:02.073 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-04-18T14:44:02.073 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:56.578601+0000", 2024-04-18T14:44:02.073 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.4581000000000001e-05 2024-04-18T14:44:02.073 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:02.073 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:02.073 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-04-18T14:44:02.073 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:56.578739+0000", 2024-04-18T14:44:02.073 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000138271 2024-04-18T14:44:02.073 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:02.073 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:02.073 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-04-18T14:44:02.074 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:56.578932+0000", 2024-04-18T14:44:02.074 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000192649 2024-04-18T14:44:02.074 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:02.074 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:02.074 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_started", 2024-04-18T14:44:02.074 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:56.587757+0000", 2024-04-18T14:44:02.074 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0088247970000000005 2024-04-18T14:44:02.074 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:02.074 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:02.074 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_committed", 2024-04-18T14:44:02.074 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:56.591615+0000", 2024-04-18T14:44:02.074 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.003858336 2024-04-18T14:44:02.074 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:02.074 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:02.074 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-04-18T14:44:02.074 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:56.599453+0000", 2024-04-18T14:44:02.075 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0078382509999999992 2024-04-18T14:44:02.075 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:02.075 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:02.075 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-04-18T14:44:02.075 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:56.599604+0000", 2024-04-18T14:44:02.075 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000150688 2024-04-18T14:44:02.075 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:44:02.075 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-04-18T14:44:02.075 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:44:02.075 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:02.075 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:02.075 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(client.4559.0:513 3.1s0 3:8edef92b:::smithi13430248-24:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e57)", 2024-04-18T14:44:02.075 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-04-18T14:43:56.578631+0000", 2024-04-18T14:44:02.075 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 5.4231537369999998, 2024-04-18T14:44:02.075 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.012977336000000001, 2024-04-18T14:44:02.076 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-04-18T14:44:02.076 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "started", 2024-04-18T14:44:02.076 INFO:teuthology.orchestra.run.smithi119.stdout: "client_info": { 2024-04-18T14:44:02.076 INFO:teuthology.orchestra.run.smithi119.stdout: "client": "client.4559", 2024-04-18T14:44:02.076 INFO:teuthology.orchestra.run.smithi119.stdout: "client_addr": "172.21.15.134:0/3113589487", 2024-04-18T14:44:02.076 INFO:teuthology.orchestra.run.smithi119.stdout: "tid": 513 2024-04-18T14:44:02.076 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:02.076 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-04-18T14:44:02.076 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:02.076 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-04-18T14:44:02.076 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:56.578631+0000", 2024-04-18T14:44:02.076 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:44:02.076 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:02.076 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:02.076 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-04-18T14:44:02.076 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:56.578631+0000", 2024-04-18T14:44:02.077 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:44:02.077 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:02.077 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:02.077 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-04-18T14:44:02.077 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:56.578630+0000", 2024-04-18T14:44:02.077 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4294967295.9999981 2024-04-18T14:44:02.077 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:02.077 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:02.077 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-04-18T14:44:02.077 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:56.578640+0000", 2024-04-18T14:44:02.077 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.0074e-05 2024-04-18T14:44:02.077 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:02.077 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:02.077 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-04-18T14:44:02.077 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:56.578663+0000", 2024-04-18T14:44:02.078 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.3343e-05 2024-04-18T14:44:02.078 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:02.078 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:02.078 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-04-18T14:44:02.078 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:56.578679+0000", 2024-04-18T14:44:02.078 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.6016999999999999e-05 2024-04-18T14:44:02.078 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:02.078 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:02.078 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-04-18T14:44:02.078 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:56.579396+0000", 2024-04-18T14:44:02.078 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00071690800000000004 2024-04-18T14:44:02.078 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:02.078 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:02.078 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for blocked object", 2024-04-18T14:44:02.078 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:56.579516+0000", 2024-04-18T14:44:02.079 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000120227 2024-04-18T14:44:02.079 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:02.079 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:02.079 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-04-18T14:44:02.079 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:56.591181+0000", 2024-04-18T14:44:02.079 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.011664496999999999 2024-04-18T14:44:02.079 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:02.079 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:02.079 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-04-18T14:44:02.079 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:56.591457+0000", 2024-04-18T14:44:02.079 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00027621299999999998 2024-04-18T14:44:02.079 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:02.079 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:02.079 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-04-18T14:44:02.079 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:56.591609+0000", 2024-04-18T14:44:02.080 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000151731 2024-04-18T14:44:02.080 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:44:02.080 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-04-18T14:44:02.080 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:44:02.080 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:02.080 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:02.080 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(client.4559.0:568 3.1s0 3:8de3c091:::smithi13430248-9:head [read 0~2965504,checksum,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-04-18T14:44:02.080 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-04-18T14:44:01.395531+0000", 2024-04-18T14:44:02.080 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 0.60625445099999997, 2024-04-18T14:44:02.080 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.012097393999999999, 2024-04-18T14:44:02.080 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-04-18T14:44:02.080 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "started", 2024-04-18T14:44:02.080 INFO:teuthology.orchestra.run.smithi119.stdout: "client_info": { 2024-04-18T14:44:02.080 INFO:teuthology.orchestra.run.smithi119.stdout: "client": "client.4559", 2024-04-18T14:44:02.080 INFO:teuthology.orchestra.run.smithi119.stdout: "client_addr": "172.21.15.134:0/3113589487", 2024-04-18T14:44:02.081 INFO:teuthology.orchestra.run.smithi119.stdout: "tid": 568 2024-04-18T14:44:02.081 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:02.081 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-04-18T14:44:02.081 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:02.081 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-04-18T14:44:02.081 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:01.395531+0000", 2024-04-18T14:44:02.081 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:44:02.081 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:02.081 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:02.081 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-04-18T14:44:02.081 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:01.395531+0000", 2024-04-18T14:44:02.081 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:44:02.081 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:02.081 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:02.081 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-04-18T14:44:02.082 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:01.395528+0000", 2024-04-18T14:44:02.082 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4294967295.9999976 2024-04-18T14:44:02.082 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:02.082 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:02.082 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-04-18T14:44:02.082 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:01.395545+0000", 2024-04-18T14:44:02.082 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.7306e-05 2024-04-18T14:44:02.082 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:02.082 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:02.082 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-04-18T14:44:02.082 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:01.395573+0000", 2024-04-18T14:44:02.082 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.7120000000000001e-05 2024-04-18T14:44:02.082 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:02.082 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:02.082 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-04-18T14:44:02.083 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:01.395591+0000", 2024-04-18T14:44:02.083 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.8393000000000002e-05 2024-04-18T14:44:02.083 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:02.083 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:02.083 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-04-18T14:44:02.083 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:01.396457+0000", 2024-04-18T14:44:02.083 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00086618999999999997 2024-04-18T14:44:02.083 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:02.083 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:02.083 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-04-18T14:44:02.083 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:01.396723+0000", 2024-04-18T14:44:02.083 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00026560499999999998 2024-04-18T14:44:02.083 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:02.083 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:02.084 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-04-18T14:44:02.084 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:01.407628+0000", 2024-04-18T14:44:02.084 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.010905339999999999 2024-04-18T14:44:02.084 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:44:02.084 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-04-18T14:44:02.084 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:44:02.084 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:02.084 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:02.084 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(client.4559.0:569 3.1s0 3:8de3c091:::smithi13430248-9:head [read 0~2965504,checksum] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-04-18T14:44:02.084 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-04-18T14:44:01.395633+0000", 2024-04-18T14:44:02.084 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 0.606152582, 2024-04-18T14:44:02.084 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.013434883999999999, 2024-04-18T14:44:02.084 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-04-18T14:44:02.084 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "started", 2024-04-18T14:44:02.084 INFO:teuthology.orchestra.run.smithi119.stdout: "client_info": { 2024-04-18T14:44:02.085 INFO:teuthology.orchestra.run.smithi119.stdout: "client": "client.4559", 2024-04-18T14:44:02.085 INFO:teuthology.orchestra.run.smithi119.stdout: "client_addr": "172.21.15.134:0/3113589487", 2024-04-18T14:44:02.085 INFO:teuthology.orchestra.run.smithi119.stdout: "tid": 569 2024-04-18T14:44:02.085 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:02.085 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-04-18T14:44:02.085 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:02.085 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-04-18T14:44:02.085 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:01.395633+0000", 2024-04-18T14:44:02.085 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:44:02.085 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:02.085 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:02.085 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-04-18T14:44:02.085 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:01.395633+0000", 2024-04-18T14:44:02.085 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:44:02.085 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:02.086 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:02.086 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-04-18T14:44:02.086 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:01.395631+0000", 2024-04-18T14:44:02.086 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4294967295.9999986 2024-04-18T14:44:02.086 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:02.086 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:02.086 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-04-18T14:44:02.086 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:01.395640+0000", 2024-04-18T14:44:02.086 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 8.8440000000000004e-06 2024-04-18T14:44:02.086 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:02.086 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:02.086 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-04-18T14:44:02.086 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:01.395658+0000", 2024-04-18T14:44:02.086 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.8436000000000001e-05 2024-04-18T14:44:02.086 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:02.087 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:02.087 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-04-18T14:44:02.087 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:01.395672+0000", 2024-04-18T14:44:02.087 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.359e-05 2024-04-18T14:44:02.087 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:02.087 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:02.087 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-04-18T14:44:02.087 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:01.397951+0000", 2024-04-18T14:44:02.087 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0022788109999999999 2024-04-18T14:44:02.087 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:02.087 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:02.087 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-04-18T14:44:02.087 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:01.398063+0000", 2024-04-18T14:44:02.087 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00011175000000000001 2024-04-18T14:44:02.087 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:02.088 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:02.088 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-04-18T14:44:02.088 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:01.409067+0000", 2024-04-18T14:44:02.088 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.011004923 2024-04-18T14:44:02.088 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:44:02.088 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-04-18T14:44:02.088 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:44:02.088 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:02.088 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:02.088 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(client.4559.0:570 3.1s0 3:8de3c091:::smithi13430248-9:head [read 0~2965504,checksum] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-04-18T14:44:02.088 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-04-18T14:44:01.395684+0000", 2024-04-18T14:44:02.088 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 0.60610166899999995, 2024-04-18T14:44:02.088 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.015163787, 2024-04-18T14:44:02.088 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-04-18T14:44:02.089 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "started", 2024-04-18T14:44:02.089 INFO:teuthology.orchestra.run.smithi119.stdout: "client_info": { 2024-04-18T14:44:02.089 INFO:teuthology.orchestra.run.smithi119.stdout: "client": "client.4559", 2024-04-18T14:44:02.089 INFO:teuthology.orchestra.run.smithi119.stdout: "client_addr": "172.21.15.134:0/3113589487", 2024-04-18T14:44:02.089 INFO:teuthology.orchestra.run.smithi119.stdout: "tid": 570 2024-04-18T14:44:02.089 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:02.089 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-04-18T14:44:02.089 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:02.089 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-04-18T14:44:02.089 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:01.395684+0000", 2024-04-18T14:44:02.089 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:44:02.089 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:02.089 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:02.089 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-04-18T14:44:02.089 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:01.395684+0000", 2024-04-18T14:44:02.090 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:44:02.090 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:02.090 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:02.090 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-04-18T14:44:02.090 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:01.395683+0000", 2024-04-18T14:44:02.090 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4294967295.999999 2024-04-18T14:44:02.090 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:02.090 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:02.090 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-04-18T14:44:02.090 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:01.395691+0000", 2024-04-18T14:44:02.090 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 8.7029999999999995e-06 2024-04-18T14:44:02.090 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:02.090 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:02.090 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-04-18T14:44:02.091 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:01.395708+0000", 2024-04-18T14:44:02.091 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.6554000000000001e-05 2024-04-18T14:44:02.091 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:02.091 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:02.091 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-04-18T14:44:02.091 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:01.395722+0000", 2024-04-18T14:44:02.091 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.468e-05 2024-04-18T14:44:02.091 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:02.091 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:02.091 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-04-18T14:44:02.091 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:01.401454+0000", 2024-04-18T14:44:02.091 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.005731346 2024-04-18T14:44:02.091 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:02.091 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:02.091 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-04-18T14:44:02.092 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:01.401588+0000", 2024-04-18T14:44:02.092 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000133974 2024-04-18T14:44:02.092 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:02.092 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:02.092 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-04-18T14:44:02.092 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:01.410847+0000", 2024-04-18T14:44:02.092 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.009259527 2024-04-18T14:44:02.092 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:44:02.092 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-04-18T14:44:02.092 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:44:02.092 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:44:02.092 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-04-18T14:44:02.092 INFO:teuthology.orchestra.run.smithi119.stdout:} 2024-04-18T14:44:02.093 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-18T14:44:02.095 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.10.asok dump_ops_in_flight 2024-04-18T14:44:02.095 INFO:tasks.ceph.osd.13.smithi096.stderr:2024-04-18T14:44:02.094+0000 7f7e72fad640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 13 (PID: 24893) UID: 0 2024-04-18T14:44:02.195 INFO:tasks.ceph.osd.4.smithi086.stderr:2024-04-18T14:44:02.194+0000 7f0c4c462640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 24956) UID: 0 2024-04-18T14:44:02.220 INFO:teuthology.orchestra.run.smithi119.stdout:{ 2024-04-18T14:44:02.220 INFO:teuthology.orchestra.run.smithi119.stdout: "ops": [], 2024-04-18T14:44:02.220 INFO:teuthology.orchestra.run.smithi119.stdout: "num_ops": 0 2024-04-18T14:44:02.220 INFO:teuthology.orchestra.run.smithi119.stdout:} 2024-04-18T14:44:02.234 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.10.asok dump_blocked_ops 2024-04-18T14:44:02.246 INFO:teuthology.orchestra.run.smithi086.stdout:osd.0: {} 2024-04-18T14:44:02.247 INFO:teuthology.orchestra.run.smithi086.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-18T14:44:02.266 INFO:teuthology.orchestra.run.smithi086.stdout:osd.1: {} 2024-04-18T14:44:02.266 INFO:teuthology.orchestra.run.smithi086.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-18T14:44:02.283 INFO:teuthology.orchestra.run.smithi086.stdout:osd.2: {} 2024-04-18T14:44:02.283 INFO:teuthology.orchestra.run.smithi086.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-18T14:44:02.295 INFO:tasks.ceph.osd.8.smithi086.stderr:2024-04-18T14:44:02.294+0000 7f29f7b9d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 8 (PID: 24958) UID: 0 2024-04-18T14:44:02.304 INFO:teuthology.orchestra.run.smithi086.stdout:osd.3: {} 2024-04-18T14:44:02.304 INFO:teuthology.orchestra.run.smithi086.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-18T14:44:02.321 INFO:teuthology.orchestra.run.smithi086.stdout:osd.4: {} 2024-04-18T14:44:02.321 INFO:teuthology.orchestra.run.smithi086.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-18T14:44:02.341 INFO:teuthology.orchestra.run.smithi086.stdout:osd.5: {} 2024-04-18T14:44:02.341 INFO:teuthology.orchestra.run.smithi086.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-18T14:44:02.350 INFO:teuthology.orchestra.run.smithi119.stdout:{ 2024-04-18T14:44:02.350 INFO:teuthology.orchestra.run.smithi119.stdout: "ops": [], 2024-04-18T14:44:02.350 INFO:teuthology.orchestra.run.smithi119.stdout: "complaint_time": 30, 2024-04-18T14:44:02.350 INFO:teuthology.orchestra.run.smithi119.stdout: "num_blocked_ops": 0 2024-04-18T14:44:02.350 INFO:teuthology.orchestra.run.smithi119.stdout:} 2024-04-18T14:44:02.362 INFO:teuthology.orchestra.run.smithi086.stdout:osd.6: {} 2024-04-18T14:44:02.363 INFO:teuthology.orchestra.run.smithi086.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-18T14:44:02.364 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.10.asok dump_historic_ops 2024-04-18T14:44:02.378 INFO:teuthology.orchestra.run.smithi086.stderr:reweighted osd.10 to 1 (10000) 2024-04-18T14:44:02.380 INFO:tasks.rados.rados.0.smithi134.stdout:235: done (3 left) 2024-04-18T14:44:02.380 INFO:tasks.rados.rados.0.smithi134.stdout:236: delete oid 45 current snap is 21 2024-04-18T14:44:02.380 INFO:tasks.rados.rados.0.smithi134.stdout:233: finishing rollback tid 0 to smithi13430248-43 2024-04-18T14:44:02.380 INFO:tasks.rados.rados.0.smithi134.stdout:233: finishing rollback tid 1 to smithi13430248-43 2024-04-18T14:44:02.380 INFO:tasks.rados.rados.0.smithi134.stdout:231: expect (ObjNum 92 snap 18 seq_num 92) 2024-04-18T14:44:02.389 INFO:teuthology.orchestra.run.smithi086.stdout:osd.7: {} 2024-04-18T14:44:02.389 INFO:teuthology.orchestra.run.smithi086.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-18T14:44:02.406 INFO:tasks.ceph.osd.11.smithi134.stderr:2024-04-18T14:44:02.400+0000 7f2d36f12640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 11 (PID: 25216) UID: 0 2024-04-18T14:44:02.410 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 11 1 2024-04-18T14:44:02.413 INFO:teuthology.orchestra.run.smithi086.stdout:osd.8: {} 2024-04-18T14:44:02.413 INFO:teuthology.orchestra.run.smithi086.stderr:osd.8: osd_enable_op_tracker = '' 2024-04-18T14:44:02.435 INFO:teuthology.orchestra.run.smithi086.stdout:osd.9: {} 2024-04-18T14:44:02.435 INFO:teuthology.orchestra.run.smithi086.stderr:osd.9: osd_enable_op_tracker = '' 2024-04-18T14:44:02.451 INFO:teuthology.orchestra.run.smithi086.stdout:osd.10: {} 2024-04-18T14:44:02.452 INFO:teuthology.orchestra.run.smithi086.stderr:osd.10: osd_enable_op_tracker = '' 2024-04-18T14:44:02.471 INFO:teuthology.orchestra.run.smithi086.stdout:osd.11: {} 2024-04-18T14:44:02.472 INFO:teuthology.orchestra.run.smithi086.stderr:osd.11: osd_enable_op_tracker = '' 2024-04-18T14:44:02.487 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-04-18T14:44:02.489 INFO:teuthology.orchestra.run.smithi086.stdout:osd.12: {} 2024-04-18T14:44:02.489 INFO:teuthology.orchestra.run.smithi086.stderr:osd.12: osd_enable_op_tracker = '' 2024-04-18T14:44:02.498 INFO:tasks.ceph.osd.6.smithi119.stderr:2024-04-18T14:44:02.498+0000 7fb7cb8bd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 24896) UID: 0 2024-04-18T14:44:02.498 INFO:teuthology.orchestra.run.smithi119.stdout:ERROR: (22) Invalid argument 2024-04-18T14:44:02.498 INFO:teuthology.orchestra.run.smithi119.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T14:44:02.509 INFO:teuthology.orchestra.run.smithi086.stdout:osd.13: {} 2024-04-18T14:44:02.510 INFO:teuthology.orchestra.run.smithi086.stderr:osd.13: osd_enable_op_tracker = '' 2024-04-18T14:44:02.512 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.14.asok dump_ops_in_flight 2024-04-18T14:44:02.530 INFO:teuthology.orchestra.run.smithi086.stdout:osd.14: {} 2024-04-18T14:44:02.530 INFO:teuthology.orchestra.run.smithi086.stderr:osd.14: osd_enable_op_tracker = '' 2024-04-18T14:44:02.547 INFO:tasks.rados.rados.0.smithi134.stdout:233: finishing rollback tid 2 to smithi13430248-43 2024-04-18T14:44:02.547 INFO:tasks.rados.rados.0.smithi134.stdout:update_object_version oid 43 v 63 (ObjNum 5 snap 0 seq_num 5) dirty exists 2024-04-18T14:44:02.547 INFO:tasks.rados.rados.0.smithi134.stdout:234: finishing write tid 1 to smithi13430248-16 2024-04-18T14:44:02.548 INFO:tasks.rados.rados.0.smithi134.stdout:234: finishing write tid 2 to smithi13430248-16 2024-04-18T14:44:02.548 INFO:tasks.rados.rados.0.smithi134.stdout:234: finishing write tid 3 to smithi13430248-16 2024-04-18T14:44:02.548 INFO:tasks.rados.rados.0.smithi134.stdout:234: finishing write tid 4 to smithi13430248-16 2024-04-18T14:44:02.548 INFO:tasks.rados.rados.0.smithi134.stdout:234: finishing write tid 5 to smithi13430248-16 2024-04-18T14:44:02.548 INFO:tasks.rados.rados.0.smithi134.stdout:234: finishing write tid 6 to smithi13430248-16 2024-04-18T14:44:02.548 INFO:tasks.rados.rados.0.smithi134.stdout:234: oid 16 updating version 0 to 84 2024-04-18T14:44:02.548 INFO:tasks.rados.rados.0.smithi134.stdout:234: oid 16 updating version 84 to 86 2024-04-18T14:44:02.548 INFO:tasks.rados.rados.0.smithi134.stdout:234: oid 16 version 86 is already newer than 83 2024-04-18T14:44:02.548 INFO:tasks.rados.rados.0.smithi134.stdout:234: oid 16 version 86 is already newer than 82 2024-04-18T14:44:02.548 INFO:tasks.rados.rados.0.smithi134.stdout:234: oid 16 version 86 is already newer than 85 2024-04-18T14:44:02.548 INFO:tasks.rados.rados.0.smithi134.stdout:update_object_version oid 16 v 86 (ObjNum 98 snap 21 seq_num 98) dirty exists 2024-04-18T14:44:02.548 INFO:tasks.rados.rados.0.smithi134.stdout:234: left oid 16 (ObjNum 98 snap 21 seq_num 98) 2024-04-18T14:44:02.548 INFO:tasks.rados.rados.0.smithi134.stdout:231: done (3 left) 2024-04-18T14:44:02.548 INFO:tasks.rados.rados.0.smithi134.stdout:233: done (2 left) 2024-04-18T14:44:02.548 INFO:tasks.rados.rados.0.smithi134.stdout:234: done (1 left) 2024-04-18T14:44:02.548 INFO:tasks.rados.rados.0.smithi134.stdout:236: done (0 left) 2024-04-18T14:44:02.549 INFO:tasks.rados.rados.0.smithi134.stdout:237: snap_remove snap 7 2024-04-18T14:44:02.550 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-18T14:44:02.550+0000 7f370d212640 0 -- 172.21.15.86:0/1645609290 >> [v2:172.21.15.134:6808/25223,v1:172.21.15.134:6812/25223] conn(0x7f370821e410 msgr2=0x7f3708220800 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-04-18T14:44:02.551 INFO:teuthology.orchestra.run.smithi086.stdout:osd.15: {} 2024-04-18T14:44:02.551 INFO:teuthology.orchestra.run.smithi086.stderr:osd.15: osd_enable_op_tracker = '' 2024-04-18T14:44:02.598 INFO:tasks.ceph.osd.1.smithi096.stderr:2024-04-18T14:44:02.598+0000 7f56a7a98640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 24887) UID: 0 2024-04-18T14:44:02.677 INFO:teuthology.orchestra.run.smithi119.stdout:ERROR: (22) Invalid argument 2024-04-18T14:44:02.678 INFO:teuthology.orchestra.run.smithi119.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T14:44:02.692 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.14.asok dump_blocked_ops 2024-04-18T14:44:02.699 INFO:tasks.ceph.osd.3.smithi134.stderr:2024-04-18T14:44:02.704+0000 7fe7a4443640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25211) UID: 0 2024-04-18T14:44:02.800 INFO:tasks.ceph.osd.13.smithi096.stderr:2024-04-18T14:44:02.798+0000 7f7e72fad640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 13 (PID: 24893) UID: 0 2024-04-18T14:44:02.814 INFO:teuthology.orchestra.run.smithi119.stdout:ERROR: (22) Invalid argument 2024-04-18T14:44:02.814 INFO:teuthology.orchestra.run.smithi119.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T14:44:02.828 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.14.asok dump_historic_ops 2024-04-18T14:44:02.901 INFO:tasks.ceph.osd.2.smithi119.stderr:2024-04-18T14:44:02.902+0000 7fcbd30c0640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 24894) UID: 0 2024-04-18T14:44:02.945 INFO:teuthology.orchestra.run.smithi119.stdout:ERROR: (22) Invalid argument 2024-04-18T14:44:02.945 INFO:teuthology.orchestra.run.smithi119.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T14:44:02.959 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-04-18T14:44:03.002 INFO:tasks.ceph.osd.4.smithi086.stderr:2024-04-18T14:44:03.002+0000 7f0c4c462640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 24956) UID: 0 2024-04-18T14:44:03.088 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-04-18T14:44:03.089 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T14:44:03.102 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-04-18T14:44:03.104 INFO:tasks.ceph.osd.13.smithi096.stderr:2024-04-18T14:44:03.106+0000 7f7e72fad640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 13 (PID: 24893) UID: 0 2024-04-18T14:44:03.205 INFO:tasks.ceph.osd.10.smithi119.stderr:2024-04-18T14:44:03.206+0000 7f6f24c12640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 10 (PID: 24898) UID: 0 2024-04-18T14:44:03.218 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-04-18T14:44:03.218 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T14:44:03.232 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-04-18T14:44:03.305 INFO:tasks.ceph.osd.3.smithi134.stderr:2024-04-18T14:44:03.308+0000 7fe7a4443640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25211) UID: 0 2024-04-18T14:44:03.357 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-04-18T14:44:03.357 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T14:44:03.371 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-04-18T14:44:03.407 INFO:tasks.ceph.osd.4.smithi086.stderr:2024-04-18T14:44:03.406+0000 7f0c4c462640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 24956) UID: 0 2024-04-18T14:44:03.505 INFO:teuthology.orchestra.run.smithi086.stderr:noscrub is set 2024-04-18T14:44:03.506 INFO:teuthology.orchestra.run.smithi086.stderr:reweighted osd.11 to 1 (10000) 2024-04-18T14:44:03.508 INFO:tasks.ceph.osd.9.smithi096.stderr:2024-04-18T14:44:03.506+0000 7fa2c1cbf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 9 (PID: 24891) UID: 0 2024-04-18T14:44:03.514 INFO:tasks.rados.rados.0.smithi134.stdout:237: done (0 left) 2024-04-18T14:44:03.515 INFO:tasks.rados.rados.0.smithi134.stdout:238: read oid 4 snap -1 2024-04-18T14:44:03.515 INFO:tasks.rados.rados.0.smithi134.stdout:238: expect deleted 2024-04-18T14:44:03.515 INFO:tasks.rados.rados.0.smithi134.stdout:append oid 36 current snap is 21 2024-04-18T14:44:03.515 INFO:tasks.rados.rados.0.smithi134.stdout:239: seq_num 100 ranges {589824=524288,1114112=753664,1867776=409600} 2024-04-18T14:44:03.522 INFO:tasks.rados.rados.0.smithi134.stdout:239: writing smithi13430248-36 from 589824 to 1114112 tid 1 2024-04-18T14:44:03.526 INFO:tasks.rados.rados.0.smithi134.stdout:239: writing smithi13430248-36 from 1114112 to 1867776 tid 2 2024-04-18T14:44:03.530 INFO:tasks.rados.rados.0.smithi134.stdout:239: writing smithi13430248-36 from 1867776 to 2277376 tid 3 2024-04-18T14:44:03.530 INFO:tasks.rados.rados.0.smithi134.stdout:240: copy_from oid 40 from oid 6 current snap is 21 2024-04-18T14:44:03.530 INFO:tasks.rados.rados.0.smithi134.stdout:append oid 39 current snap is 21 2024-04-18T14:44:03.530 INFO:tasks.rados.rados.0.smithi134.stdout:241: seq_num 101 ranges {1310720=540672,1851392=507904,2359296=622592,2981888=32768} 2024-04-18T14:44:03.543 INFO:tasks.rados.rados.0.smithi134.stdout:241: writing smithi13430248-39 from 1310720 to 1851392 tid 1 2024-04-18T14:44:03.546 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 12 1 2024-04-18T14:44:03.547 INFO:tasks.rados.rados.0.smithi134.stdout:241: writing smithi13430248-39 from 1851392 to 2359296 tid 2 2024-04-18T14:44:03.551 INFO:tasks.rados.rados.0.smithi134.stdout:241: writing smithi13430248-39 from 2359296 to 2981888 tid 3 2024-04-18T14:44:03.552 INFO:tasks.rados.rados.0.smithi134.stdout:241: writing smithi13430248-39 from 2981888 to 3014656 tid 4 2024-04-18T14:44:03.552 INFO:tasks.rados.rados.0.smithi134.stdout:242: rmattr oid 47 current snap is 21 2024-04-18T14:44:03.552 INFO:tasks.rados.rados.0.smithi134.stdout:242: done (4 left) 2024-04-18T14:44:03.552 INFO:tasks.rados.rados.0.smithi134.stdout:243: delete oid 3 current snap is 21 2024-04-18T14:44:03.552 INFO:tasks.rados.rados.0.smithi134.stdout:240: finishing copy_from to smithi13430248-40 2024-04-18T14:44:03.552 INFO:tasks.rados.rados.0.smithi134.stdout:240: got expected ENOENT (src dne) 2024-04-18T14:44:03.553 INFO:tasks.rados.rados.0.smithi134.stdout:240: finishing copy_from racing read to smithi13430248-40 2024-04-18T14:44:03.555 INFO:tasks.rados.rados.0.smithi134.stdout:239: finishing write tid 1 to smithi13430248-36 2024-04-18T14:44:03.560 INFO:tasks.rados.rados.0.smithi134.stdout:238: done (4 left) 2024-04-18T14:44:03.561 INFO:tasks.rados.rados.0.smithi134.stdout:240: done (3 left) 2024-04-18T14:44:03.561 INFO:tasks.rados.rados.0.smithi134.stdout:243: done (2 left) 2024-04-18T14:44:03.561 INFO:tasks.rados.rados.0.smithi134.stdout:244: rmattr oid 20 current snap is 21 2024-04-18T14:44:03.561 INFO:tasks.rados.rados.0.smithi134.stdout:244: done (2 left) 2024-04-18T14:44:03.561 INFO:tasks.rados.rados.0.smithi134.stdout:append oid 41 current snap is 21 2024-04-18T14:44:03.561 INFO:tasks.rados.rados.0.smithi134.stdout:245: seq_num 103 ranges {688128=573440,1261568=786432,2048000=376832} 2024-04-18T14:44:03.568 INFO:tasks.rados.rados.0.smithi134.stdout:245: writing smithi13430248-41 from 688128 to 1261568 tid 1 2024-04-18T14:44:03.569 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-04-18T14:44:03.569 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T14:44:03.574 INFO:tasks.rados.rados.0.smithi134.stdout:245: writing smithi13430248-41 from 1261568 to 2048000 tid 2 2024-04-18T14:44:03.576 INFO:tasks.rados.rados.0.smithi134.stdout:245: writing smithi13430248-41 from 2048000 to 2424832 tid 3 2024-04-18T14:44:03.577 INFO:tasks.rados.rados.0.smithi134.stdout:246: rollback oid 3 current snap is 21 2024-04-18T14:44:03.577 INFO:tasks.rados.rados.0.smithi134.stdout:rollback oid 3 to 14 2024-04-18T14:44:03.577 INFO:tasks.rados.rados.0.smithi134.stdout:247: snap_remove snap 4 2024-04-18T14:44:03.592 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-04-18T14:44:03.643 INFO:tasks.ceph.osd.11.smithi134.stderr:2024-04-18T14:44:03.648+0000 7f2d36f12640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 11 (PID: 25216) UID: 0 2024-04-18T14:44:03.705 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-04-18T14:44:03.705 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T14:44:03.709 INFO:tasks.ceph.osd.2.smithi119.stderr:2024-04-18T14:44:03.710+0000 7fcbd30c0640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 24894) UID: 0 2024-04-18T14:44:03.719 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-04-18T14:44:03.810 INFO:tasks.ceph.osd.7.smithi134.stderr:2024-04-18T14:44:03.812+0000 7fd7de549640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25213) UID: 0 2024-04-18T14:44:03.887 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-04-18T14:44:03.887 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T14:44:03.901 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.11.asok dump_ops_in_flight 2024-04-18T14:44:03.947 INFO:tasks.ceph.osd.7.smithi134.stderr:2024-04-18T14:44:03.952+0000 7fd7de549640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25213) UID: 0 2024-04-18T14:44:04.012 INFO:tasks.ceph.osd.4.smithi086.stderr:2024-04-18T14:44:04.014+0000 7f0c4c462640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 24956) UID: 0 2024-04-18T14:44:04.070 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-04-18T14:44:04.071 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T14:44:04.085 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.11.asok dump_blocked_ops 2024-04-18T14:44:04.131 INFO:tasks.ceph.osd.7.smithi134.stderr:2024-04-18T14:44:04.136+0000 7fd7de549640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25213) UID: 0 2024-04-18T14:44:04.209 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-04-18T14:44:04.209 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T14:44:04.215 INFO:tasks.ceph.osd.12.smithi086.stderr:2024-04-18T14:44:04.214+0000 7f6904968640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 12 (PID: 24960) UID: 0 2024-04-18T14:44:04.223 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.11.asok dump_historic_ops 2024-04-18T14:44:04.316 INFO:tasks.ceph.osd.15.smithi134.stderr:2024-04-18T14:44:04.320+0000 7f08e6a51640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 15 (PID: 25218) UID: 0 2024-04-18T14:44:04.375 INFO:teuthology.orchestra.run.smithi086.stderr:reweighted osd.12 to 1 (10000) 2024-04-18T14:44:04.377 INFO:tasks.rados.rados.0.smithi134.stdout:247: done (4 left) 2024-04-18T14:44:04.377 INFO:tasks.rados.rados.0.smithi134.stdout:248: read oid 15 snap -1 2024-04-18T14:44:04.377 INFO:tasks.rados.rados.0.smithi134.stdout:248: expect (ObjNum 35 snap 0 seq_num 35) 2024-04-18T14:44:04.377 INFO:tasks.rados.rados.0.smithi134.stdout:249: read oid 35 snap -1 2024-04-18T14:44:04.377 INFO:tasks.rados.rados.0.smithi134.stdout:249: expect (ObjNum 34 snap 0 seq_num 34) 2024-04-18T14:44:04.377 INFO:tasks.rados.rados.0.smithi134.stdout:250: read oid 26 snap 18 2024-04-18T14:44:04.377 INFO:tasks.rados.rados.0.smithi134.stdout:250: expect deleted 2024-04-18T14:44:04.377 INFO:tasks.rados.rados.0.smithi134.stdout:251: snap_create 2024-04-18T14:44:04.377 INFO:tasks.rados.rados.0.smithi134.stdout:241: finishing write tid 1 to smithi13430248-39 2024-04-18T14:44:04.377 INFO:tasks.rados.rados.0.smithi134.stdout:241: finishing write tid 2 to smithi13430248-39 2024-04-18T14:44:04.377 INFO:tasks.rados.rados.0.smithi134.stdout:239: finishing write tid 2 to smithi13430248-36 2024-04-18T14:44:04.377 INFO:tasks.rados.rados.0.smithi134.stdout:239: finishing write tid 3 to smithi13430248-36 2024-04-18T14:44:04.377 INFO:tasks.rados.rados.0.smithi134.stdout:239: finishing write tid 4 to smithi13430248-36 2024-04-18T14:44:04.377 INFO:tasks.rados.rados.0.smithi134.stdout:241: finishing write tid 3 to smithi13430248-39 2024-04-18T14:44:04.378 INFO:tasks.rados.rados.0.smithi134.stdout:241: finishing write tid 4 to smithi13430248-39 2024-04-18T14:44:04.378 INFO:tasks.rados.rados.0.smithi134.stdout:241: finishing write tid 5 to smithi13430248-39 2024-04-18T14:44:04.378 INFO:tasks.rados.rados.0.smithi134.stdout:239: finishing write tid 5 to smithi13430248-36 2024-04-18T14:44:04.378 INFO:tasks.rados.rados.0.smithi134.stdout:239: oid 36 updating version 0 to 79 2024-04-18T14:44:04.378 INFO:tasks.rados.rados.0.smithi134.stdout:239: oid 36 updating version 79 to 85 2024-04-18T14:44:04.378 INFO:tasks.rados.rados.0.smithi134.stdout:239: oid 36 updating version 85 to 86 2024-04-18T14:44:04.378 INFO:tasks.rados.rados.0.smithi134.stdout:239: oid 36 version 86 is already newer than 84 2024-04-18T14:44:04.378 INFO:tasks.rados.rados.0.smithi134.stdout:update_object_version oid 36 v 86 (ObjNum 100 snap 21 seq_num 100) dirty exists 2024-04-18T14:44:04.378 INFO:tasks.rados.rados.0.smithi134.stdout:239: left oid 36 (ObjNum 100 snap 21 seq_num 100) 2024-04-18T14:44:04.378 INFO:tasks.rados.rados.0.smithi134.stdout:241: finishing write tid 6 to smithi13430248-39 2024-04-18T14:44:04.378 INFO:tasks.rados.rados.0.smithi134.stdout:241: oid 39 updating version 0 to 43 2024-04-18T14:44:04.378 INFO:tasks.rados.rados.0.smithi134.stdout:241: oid 39 updating version 43 to 44 2024-04-18T14:44:04.378 INFO:tasks.rados.rados.0.smithi134.stdout:241: oid 39 updating version 44 to 46 2024-04-18T14:44:04.378 INFO:tasks.rados.rados.0.smithi134.stdout:241: oid 39 updating version 46 to 47 2024-04-18T14:44:04.379 INFO:tasks.rados.rados.0.smithi134.stdout:241: oid 39 version 47 is already newer than 45 2024-04-18T14:44:04.379 INFO:tasks.rados.rados.0.smithi134.stdout:update_object_version oid 39 v 47 (ObjNum 101 snap 21 seq_num 101) dirty exists 2024-04-18T14:44:04.379 INFO:tasks.rados.rados.0.smithi134.stdout:241: left oid 39 (ObjNum 101 snap 21 seq_num 101) 2024-04-18T14:44:04.379 INFO:tasks.rados.rados.0.smithi134.stdout:245: finishing write tid 1 to smithi13430248-41 2024-04-18T14:44:04.379 INFO:tasks.rados.rados.0.smithi134.stdout:246: finishing rollback tid 1 to smithi13430248-3 2024-04-18T14:44:04.379 INFO:tasks.rados.rados.0.smithi134.stdout:246: finishing rollback tid 2 to smithi13430248-3 2024-04-18T14:44:04.379 INFO:tasks.rados.rados.0.smithi134.stdout:update_object_version oid 3 v 58 (ObjNum 2 snap 0 seq_num 2) dirty exists 2024-04-18T14:44:04.379 INFO:tasks.rados.rados.0.smithi134.stdout:245: finishing write tid 2 to smithi13430248-41 2024-04-18T14:44:04.379 INFO:tasks.rados.rados.0.smithi134.stdout:245: finishing write tid 3 to smithi13430248-41 2024-04-18T14:44:04.379 INFO:tasks.rados.rados.0.smithi134.stdout:245: finishing write tid 4 to smithi13430248-41 2024-04-18T14:44:04.379 INFO:tasks.rados.rados.0.smithi134.stdout:245: finishing write tid 5 to smithi13430248-41 2024-04-18T14:44:04.379 INFO:tasks.rados.rados.0.smithi134.stdout:245: oid 41 updating version 0 to 49 2024-04-18T14:44:04.379 INFO:tasks.rados.rados.0.smithi134.stdout:245: oid 41 version 49 is already newer than 48 2024-04-18T14:44:04.379 INFO:tasks.rados.rados.0.smithi134.stdout:245: oid 41 version 49 is already newer than 46 2024-04-18T14:44:04.379 INFO:tasks.rados.rados.0.smithi134.stdout:245: oid 41 version 49 is already newer than 47 2024-04-18T14:44:04.379 INFO:tasks.rados.rados.0.smithi134.stdout:update_object_version oid 41 v 49 (ObjNum 103 snap 21 seq_num 103) dirty exists 2024-04-18T14:44:04.380 INFO:tasks.rados.rados.0.smithi134.stdout:245: left oid 41 (ObjNum 103 snap 21 seq_num 103) 2024-04-18T14:44:04.389 INFO:tasks.rados.rados.0.smithi134.stdout:249: expect (ObjNum 34 snap 0 seq_num 34) 2024-04-18T14:44:04.399 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-04-18T14:44:04.399 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T14:44:04.407 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 13 1 2024-04-18T14:44:04.425 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.15.asok dump_ops_in_flight 2024-04-18T14:44:04.450 INFO:tasks.ceph.osd.8.smithi086.stderr:2024-04-18T14:44:04.450+0000 7f29f7b9d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 8 (PID: 24958) UID: 0 2024-04-18T14:44:04.457 INFO:tasks.rados.rados.0.smithi134.stdout:248: expect (ObjNum 35 snap 0 seq_num 35) 2024-04-18T14:44:04.518 INFO:tasks.ceph.osd.2.smithi119.stderr:2024-04-18T14:44:04.518+0000 7fcbd30c0640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 24894) UID: 0 2024-04-18T14:44:04.570 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-18T14:44:04.575 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-04-18T14:44:04.575 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T14:44:04.590 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.15.asok dump_blocked_ops 2024-04-18T14:44:04.619 INFO:tasks.ceph.osd.10.smithi119.stderr:2024-04-18T14:44:04.622+0000 7f6f24c12640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 10 (PID: 24898) UID: 0 2024-04-18T14:44:04.705 INFO:teuthology.orchestra.run.smithi086.stdout:osd.0: {} 2024-04-18T14:44:04.706 INFO:teuthology.orchestra.run.smithi086.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-18T14:44:04.711 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-04-18T14:44:04.711 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T14:44:04.720 INFO:tasks.ceph.osd.13.smithi096.stderr:2024-04-18T14:44:04.717+0000 7f7e72fad640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 13 (PID: 24893) UID: 0 2024-04-18T14:44:04.725 INFO:teuthology.orchestra.run.smithi086.stdout:osd.1: {} 2024-04-18T14:44:04.725 INFO:teuthology.orchestra.run.smithi086.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-18T14:44:04.726 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.15.asok dump_historic_ops 2024-04-18T14:44:04.745 INFO:teuthology.orchestra.run.smithi086.stdout:osd.2: {} 2024-04-18T14:44:04.745 INFO:teuthology.orchestra.run.smithi086.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-18T14:44:04.762 INFO:teuthology.orchestra.run.smithi086.stdout:osd.3: {} 2024-04-18T14:44:04.762 INFO:teuthology.orchestra.run.smithi086.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-18T14:44:04.778 INFO:teuthology.orchestra.run.smithi086.stdout:osd.4: {} 2024-04-18T14:44:04.778 INFO:teuthology.orchestra.run.smithi086.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-18T14:44:04.798 INFO:teuthology.orchestra.run.smithi086.stdout:osd.5: {} 2024-04-18T14:44:04.798 INFO:teuthology.orchestra.run.smithi086.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-18T14:44:04.818 INFO:teuthology.orchestra.run.smithi086.stdout:osd.6: {} 2024-04-18T14:44:04.818 INFO:teuthology.orchestra.run.smithi086.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-18T14:44:04.822 INFO:tasks.ceph.osd.11.smithi134.stderr:2024-04-18T14:44:04.824+0000 7f2d36f12640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 11 (PID: 25216) UID: 0 2024-04-18T14:44:04.838 INFO:teuthology.orchestra.run.smithi086.stdout:osd.7: {} 2024-04-18T14:44:04.838 INFO:teuthology.orchestra.run.smithi086.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-18T14:44:04.848 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-04-18T14:44:04.848 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T14:44:04.854 INFO:teuthology.orchestra.run.smithi086.stdout:osd.8: {} 2024-04-18T14:44:04.854 INFO:teuthology.orchestra.run.smithi086.stderr:osd.8: osd_enable_op_tracker = '' 2024-04-18T14:44:04.862 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-18T14:44:04.875 INFO:teuthology.orchestra.run.smithi086.stdout:osd.9: {} 2024-04-18T14:44:04.875 INFO:teuthology.orchestra.run.smithi086.stderr:osd.9: osd_enable_op_tracker = '' 2024-04-18T14:44:04.895 INFO:teuthology.orchestra.run.smithi086.stdout:osd.10: {} 2024-04-18T14:44:04.895 INFO:teuthology.orchestra.run.smithi086.stderr:osd.10: osd_enable_op_tracker = '' 2024-04-18T14:44:04.914 INFO:teuthology.orchestra.run.smithi086.stdout:osd.11: {} 2024-04-18T14:44:04.914 INFO:teuthology.orchestra.run.smithi086.stderr:osd.11: osd_enable_op_tracker = '' 2024-04-18T14:44:04.922 INFO:tasks.ceph.osd.9.smithi096.stderr:2024-04-18T14:44:04.921+0000 7fa2c1cbf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 9 (PID: 24891) UID: 0 2024-04-18T14:44:04.930 INFO:teuthology.orchestra.run.smithi086.stdout:osd.12: {} 2024-04-18T14:44:04.930 INFO:teuthology.orchestra.run.smithi086.stderr:osd.12: osd_enable_op_tracker = '' 2024-04-18T14:44:04.950 INFO:teuthology.orchestra.run.smithi086.stdout:osd.13: {} 2024-04-18T14:44:04.950 INFO:teuthology.orchestra.run.smithi086.stderr:osd.13: osd_enable_op_tracker = '' 2024-04-18T14:44:04.970 INFO:teuthology.orchestra.run.smithi086.stdout:osd.14: {} 2024-04-18T14:44:04.970 INFO:teuthology.orchestra.run.smithi086.stderr:osd.14: osd_enable_op_tracker = '' 2024-04-18T14:44:04.971 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-18T14:44:04.970+0000 7f9cec8f3640 0 -- 172.21.15.86:0/1597961459 >> [v2:172.21.15.134:6808/25223,v1:172.21.15.134:6812/25223] conn(0x7f9ce82234f0 msgr2=0x7f9ce8225900 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-04-18T14:44:04.984 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-04-18T14:44:04.984 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [], 2024-04-18T14:44:04.984 INFO:teuthology.orchestra.run.smithi086.stdout: "num_ops": 0 2024-04-18T14:44:04.984 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-04-18T14:44:04.990 INFO:teuthology.orchestra.run.smithi086.stdout:osd.15: {} 2024-04-18T14:44:04.990 INFO:teuthology.orchestra.run.smithi086.stderr:osd.15: osd_enable_op_tracker = '' 2024-04-18T14:44:04.999 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-18T14:44:05.023 INFO:tasks.ceph.osd.3.smithi134.stderr:2024-04-18T14:44:05.028+0000 7fe7a4443640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25211) UID: 0 2024-04-18T14:44:05.123 INFO:tasks.ceph.osd.13.smithi096.stderr:2024-04-18T14:44:05.121+0000 7f7e72fad640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 13 (PID: 24893) UID: 0 2024-04-18T14:44:05.170 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-04-18T14:44:05.170 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [], 2024-04-18T14:44:05.170 INFO:teuthology.orchestra.run.smithi086.stdout: "complaint_time": 30, 2024-04-18T14:44:05.170 INFO:teuthology.orchestra.run.smithi086.stdout: "num_blocked_ops": 0 2024-04-18T14:44:05.170 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-04-18T14:44:05.183 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-18T14:44:05.234 INFO:tasks.ceph.osd.12.smithi086.stderr:2024-04-18T14:44:05.230+0000 7f6904968640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 12 (PID: 24960) UID: 0 2024-04-18T14:44:05.308 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-04-18T14:44:05.309 INFO:teuthology.orchestra.run.smithi086.stdout: "size": 20, 2024-04-18T14:44:05.309 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 600, 2024-04-18T14:44:05.309 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [ 2024-04-18T14:44:05.309 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:05.309 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(client.4212.0:108 1.0 e25/24 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 25'70, mlcod=25'65)", 2024-04-18T14:44:05.309 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-04-18T14:43:20.706300+0000", 2024-04-18T14:44:05.309 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 44.601833788, 2024-04-18T14:44:05.309 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0044871939999999999, 2024-04-18T14:44:05.309 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-04-18T14:44:05.309 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T14:44:05.309 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-04-18T14:44:05.309 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:05.310 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-04-18T14:44:05.310 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:20.706300+0000", 2024-04-18T14:44:05.310 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:44:05.310 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:05.310 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:05.310 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-04-18T14:44:05.310 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:20.706300+0000", 2024-04-18T14:44:05.310 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:44:05.310 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:05.310 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:05.310 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-04-18T14:44:05.310 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:20.706298+0000", 2024-04-18T14:44:05.310 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999986 2024-04-18T14:44:05.310 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:05.311 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:05.311 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-04-18T14:44:05.311 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:20.706321+0000", 2024-04-18T14:44:05.311 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.2935999999999999e-05 2024-04-18T14:44:05.311 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:05.311 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:05.311 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-04-18T14:44:05.311 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:20.706347+0000", 2024-04-18T14:44:05.311 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.6461e-05 2024-04-18T14:44:05.311 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:05.311 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:05.311 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-04-18T14:44:05.311 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:20.706375+0000", 2024-04-18T14:44:05.311 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.7334999999999998e-05 2024-04-18T14:44:05.311 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:05.312 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:05.312 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-04-18T14:44:05.312 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:20.706411+0000", 2024-04-18T14:44:05.312 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.6083e-05 2024-04-18T14:44:05.312 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:05.312 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:05.312 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-04-18T14:44:05.312 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:20.706424+0000", 2024-04-18T14:44:05.312 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.2814e-05 2024-04-18T14:44:05.312 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:05.312 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:05.312 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-04-18T14:44:05.312 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:20.710754+0000", 2024-04-18T14:44:05.312 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0043298529999999998 2024-04-18T14:44:05.313 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:05.313 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:05.313 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-04-18T14:44:05.313 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:20.710787+0000", 2024-04-18T14:44:05.313 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.3334999999999998e-05 2024-04-18T14:44:05.313 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:44:05.313 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-04-18T14:44:05.313 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:44:05.313 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:05.313 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:05.313 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(client.4212.0:110 1.0 e25/24 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 25'72, mlcod=25'67)", 2024-04-18T14:44:05.313 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-04-18T14:43:20.710157+0000", 2024-04-18T14:44:05.313 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 44.597976125999999, 2024-04-18T14:44:05.313 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0054967820000000004, 2024-04-18T14:44:05.314 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-04-18T14:44:05.314 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T14:44:05.314 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-04-18T14:44:05.314 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:05.314 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-04-18T14:44:05.314 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:20.710157+0000", 2024-04-18T14:44:05.314 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:44:05.314 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:05.314 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:05.314 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-04-18T14:44:05.314 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:20.710157+0000", 2024-04-18T14:44:05.314 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:44:05.314 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:05.315 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:05.315 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-04-18T14:44:05.315 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:20.710155+0000", 2024-04-18T14:44:05.315 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999976 2024-04-18T14:44:05.315 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:05.315 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:05.315 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-04-18T14:44:05.315 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:20.710177+0000", 2024-04-18T14:44:05.315 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.2002999999999999e-05 2024-04-18T14:44:05.315 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:05.315 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:05.315 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-04-18T14:44:05.315 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:20.710200+0000", 2024-04-18T14:44:05.315 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.2833999999999999e-05 2024-04-18T14:44:05.315 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:05.315 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:05.316 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-04-18T14:44:05.316 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:20.710221+0000", 2024-04-18T14:44:05.316 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.1576000000000001e-05 2024-04-18T14:44:05.316 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:05.316 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:05.316 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-04-18T14:44:05.316 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:20.710313+0000", 2024-04-18T14:44:05.316 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.2102999999999996e-05 2024-04-18T14:44:05.316 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:05.316 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:05.316 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-04-18T14:44:05.316 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:20.710349+0000", 2024-04-18T14:44:05.316 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.5488000000000003e-05 2024-04-18T14:44:05.317 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:05.317 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:05.317 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-04-18T14:44:05.317 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:20.715618+0000", 2024-04-18T14:44:05.317 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.005269625 2024-04-18T14:44:05.317 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:05.317 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:05.317 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-04-18T14:44:05.317 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:20.715654+0000", 2024-04-18T14:44:05.317 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.5722999999999997e-05 2024-04-18T14:44:05.317 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:44:05.317 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-04-18T14:44:05.317 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:44:05.317 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:05.317 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:05.318 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(client.4212.0:112 1.0 e25/24 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 25'74, mlcod=25'68)", 2024-04-18T14:44:05.318 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-04-18T14:43:20.712903+0000", 2024-04-18T14:44:05.318 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 44.595230113, 2024-04-18T14:44:05.318 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0055161020000000002, 2024-04-18T14:44:05.318 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-04-18T14:44:05.318 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T14:44:05.318 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-04-18T14:44:05.318 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:05.318 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-04-18T14:44:05.318 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:20.712903+0000", 2024-04-18T14:44:05.318 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:44:05.318 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:05.318 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:05.319 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-04-18T14:44:05.319 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:20.712903+0000", 2024-04-18T14:44:05.319 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:44:05.319 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:05.319 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:05.319 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-04-18T14:44:05.319 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:20.712902+0000", 2024-04-18T14:44:05.319 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-04-18T14:44:05.319 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:05.319 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:05.319 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-04-18T14:44:05.319 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:20.712992+0000", 2024-04-18T14:44:05.319 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.0004000000000001e-05 2024-04-18T14:44:05.319 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:05.319 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:05.320 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-04-18T14:44:05.320 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:20.713009+0000", 2024-04-18T14:44:05.320 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.6722e-05 2024-04-18T14:44:05.320 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:05.320 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:05.320 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-04-18T14:44:05.320 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:20.713019+0000", 2024-04-18T14:44:05.320 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.5359999999999998e-06 2024-04-18T14:44:05.320 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:05.320 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:05.320 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-04-18T14:44:05.320 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:20.713054+0000", 2024-04-18T14:44:05.320 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.5074999999999999e-05 2024-04-18T14:44:05.320 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:05.321 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:05.321 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-04-18T14:44:05.321 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:20.713068+0000", 2024-04-18T14:44:05.321 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.4032000000000001e-05 2024-04-18T14:44:05.321 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:05.321 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:05.321 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-04-18T14:44:05.321 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:20.718385+0000", 2024-04-18T14:44:05.321 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.005317113 2024-04-18T14:44:05.321 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:05.321 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:05.321 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-04-18T14:44:05.321 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:20.718419+0000", 2024-04-18T14:44:05.321 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.4567000000000003e-05 2024-04-18T14:44:05.321 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:44:05.322 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-04-18T14:44:05.322 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:44:05.322 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:05.322 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:05.322 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(client.4212.0:132 1.0 e25/24 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 25'90, mlcod=25'85)", 2024-04-18T14:44:05.322 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-04-18T14:43:20.877663+0000", 2024-04-18T14:44:05.322 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 44.430470757000002, 2024-04-18T14:44:05.322 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0045707120000000002, 2024-04-18T14:44:05.322 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-04-18T14:44:05.322 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T14:44:05.322 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-04-18T14:44:05.322 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:05.322 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-04-18T14:44:05.323 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:20.877663+0000", 2024-04-18T14:44:05.323 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:44:05.323 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:05.323 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:05.323 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-04-18T14:44:05.323 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:20.877663+0000", 2024-04-18T14:44:05.323 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:44:05.323 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:05.323 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:05.323 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-04-18T14:44:05.323 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:20.877661+0000", 2024-04-18T14:44:05.323 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999986 2024-04-18T14:44:05.323 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:05.324 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:05.324 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-04-18T14:44:05.324 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:20.877674+0000", 2024-04-18T14:44:05.324 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.2859e-05 2024-04-18T14:44:05.324 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:05.324 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:05.324 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-04-18T14:44:05.324 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:20.877698+0000", 2024-04-18T14:44:05.324 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.3847999999999999e-05 2024-04-18T14:44:05.324 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:05.324 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:05.324 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-04-18T14:44:05.324 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:20.877710+0000", 2024-04-18T14:44:05.324 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.2493e-05 2024-04-18T14:44:05.325 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:05.325 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:05.325 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-04-18T14:44:05.325 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:20.878008+0000", 2024-04-18T14:44:05.325 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00029780600000000001 2024-04-18T14:44:05.325 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:05.325 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:05.325 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-04-18T14:44:05.325 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:20.878064+0000", 2024-04-18T14:44:05.325 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.5676e-05 2024-04-18T14:44:05.325 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:05.325 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:05.325 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-04-18T14:44:05.325 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:20.882171+0000", 2024-04-18T14:44:05.325 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0041069210000000004 2024-04-18T14:44:05.326 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:05.326 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:05.326 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-04-18T14:44:05.326 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:20.882233+0000", 2024-04-18T14:44:05.326 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.2701999999999997e-05 2024-04-18T14:44:05.326 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:44:05.326 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-04-18T14:44:05.326 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:44:05.326 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:05.326 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:05.326 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(client.4212.0:133 1.0 e25/24 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 25'91, mlcod=25'85)", 2024-04-18T14:44:05.326 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-04-18T14:43:20.878523+0000", 2024-04-18T14:44:05.326 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 44.429610840000002, 2024-04-18T14:44:05.327 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0047242610000000004, 2024-04-18T14:44:05.327 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-04-18T14:44:05.327 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T14:44:05.327 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-04-18T14:44:05.327 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:05.327 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-04-18T14:44:05.327 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:20.878523+0000", 2024-04-18T14:44:05.327 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:44:05.327 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:05.327 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:05.327 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-04-18T14:44:05.327 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:20.878523+0000", 2024-04-18T14:44:05.327 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:44:05.327 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:05.328 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:05.328 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-04-18T14:44:05.328 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:20.878521+0000", 2024-04-18T14:44:05.328 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999986 2024-04-18T14:44:05.328 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:05.328 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:05.328 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-04-18T14:44:05.328 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:20.878532+0000", 2024-04-18T14:44:05.328 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.0479000000000001e-05 2024-04-18T14:44:05.328 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:05.328 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:05.328 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-04-18T14:44:05.328 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:20.878550+0000", 2024-04-18T14:44:05.328 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.8014999999999999e-05 2024-04-18T14:44:05.329 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:05.329 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:05.329 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-04-18T14:44:05.329 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:20.878560+0000", 2024-04-18T14:44:05.329 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.8959999999999998e-06 2024-04-18T14:44:05.329 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:05.329 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:05.329 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-04-18T14:44:05.329 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:20.878740+0000", 2024-04-18T14:44:05.329 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00018028099999999999 2024-04-18T14:44:05.329 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:05.329 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:05.329 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-04-18T14:44:05.329 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:20.878774+0000", 2024-04-18T14:44:05.330 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.3898e-05 2024-04-18T14:44:05.330 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:05.330 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:05.330 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-04-18T14:44:05.330 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:20.883171+0000", 2024-04-18T14:44:05.330 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0043973939999999998 2024-04-18T14:44:05.330 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:05.330 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:05.330 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-04-18T14:44:05.330 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:20.883247+0000", 2024-04-18T14:44:05.330 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.5561000000000004e-05 2024-04-18T14:44:05.330 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:44:05.330 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-04-18T14:44:05.330 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:44:05.331 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:05.331 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:05.331 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(client.4212.0:137 1.0 e25/24 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 25'95, mlcod=25'88)", 2024-04-18T14:44:05.331 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-04-18T14:43:20.881121+0000", 2024-04-18T14:44:05.331 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 44.427012808000001, 2024-04-18T14:44:05.331 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0068217629999999998, 2024-04-18T14:44:05.331 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-04-18T14:44:05.331 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T14:44:05.331 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-04-18T14:44:05.331 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:05.331 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-04-18T14:44:05.331 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:20.881121+0000", 2024-04-18T14:44:05.331 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:44:05.331 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:05.331 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:05.331 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-04-18T14:44:05.332 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:20.881121+0000", 2024-04-18T14:44:05.332 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:44:05.332 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:05.332 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:05.332 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-04-18T14:44:05.332 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:20.881120+0000", 2024-04-18T14:44:05.332 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-04-18T14:44:05.332 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:05.332 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:05.332 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-04-18T14:44:05.332 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:20.881248+0000", 2024-04-18T14:44:05.332 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000128668 2024-04-18T14:44:05.332 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:05.332 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:05.332 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-04-18T14:44:05.333 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:20.881265+0000", 2024-04-18T14:44:05.333 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.7241999999999999e-05 2024-04-18T14:44:05.333 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:05.333 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:05.333 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-04-18T14:44:05.333 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:20.881276+0000", 2024-04-18T14:44:05.333 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.0249e-05 2024-04-18T14:44:05.333 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:05.333 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:05.333 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-04-18T14:44:05.333 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:20.881354+0000", 2024-04-18T14:44:05.333 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.8721999999999996e-05 2024-04-18T14:44:05.333 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:05.333 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:05.333 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-04-18T14:44:05.334 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:20.881396+0000", 2024-04-18T14:44:05.334 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.1739999999999997e-05 2024-04-18T14:44:05.334 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:05.334 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:05.334 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-04-18T14:44:05.334 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:20.887866+0000", 2024-04-18T14:44:05.334 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0064697330000000001 2024-04-18T14:44:05.334 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:05.334 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:05.334 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-04-18T14:44:05.334 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:20.887942+0000", 2024-04-18T14:44:05.334 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.6542e-05 2024-04-18T14:44:05.334 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:44:05.334 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-04-18T14:44:05.334 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:44:05.335 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:05.335 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:05.335 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(client.4212.0:138 1.0 e25/24 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 25'96, mlcod=25'88)", 2024-04-18T14:44:05.335 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-04-18T14:43:20.882338+0000", 2024-04-18T14:44:05.335 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 44.425795495000003, 2024-04-18T14:44:05.335 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0064705229999999997, 2024-04-18T14:44:05.335 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-04-18T14:44:05.335 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T14:44:05.335 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-04-18T14:44:05.335 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:05.335 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-04-18T14:44:05.335 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:20.882338+0000", 2024-04-18T14:44:05.335 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:44:05.335 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:05.336 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:05.336 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-04-18T14:44:05.336 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:20.882338+0000", 2024-04-18T14:44:05.336 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:44:05.336 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:05.336 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:05.336 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-04-18T14:44:05.336 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:20.882337+0000", 2024-04-18T14:44:05.336 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999986 2024-04-18T14:44:05.336 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:05.336 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:05.336 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-04-18T14:44:05.336 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:20.882349+0000", 2024-04-18T14:44:05.336 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.2381999999999999e-05 2024-04-18T14:44:05.337 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:05.337 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:05.337 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-04-18T14:44:05.337 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:20.882373+0000", 2024-04-18T14:44:05.337 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.3935e-05 2024-04-18T14:44:05.337 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:05.337 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:05.337 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-04-18T14:44:05.337 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:20.882387+0000", 2024-04-18T14:44:05.337 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.4528999999999999e-05 2024-04-18T14:44:05.337 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:05.337 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:05.337 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-04-18T14:44:05.337 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:20.882482+0000", 2024-04-18T14:44:05.338 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.4930000000000001e-05 2024-04-18T14:44:05.338 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:05.338 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:05.338 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-04-18T14:44:05.338 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:20.882532+0000", 2024-04-18T14:44:05.338 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.0033e-05 2024-04-18T14:44:05.338 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:05.338 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:05.338 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-04-18T14:44:05.338 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:20.888732+0000", 2024-04-18T14:44:05.338 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0061996229999999996 2024-04-18T14:44:05.338 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:05.338 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:05.338 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-04-18T14:44:05.339 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:20.888809+0000", 2024-04-18T14:44:05.339 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.6470999999999993e-05 2024-04-18T14:44:05.339 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:44:05.339 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-04-18T14:44:05.339 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:44:05.339 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:05.339 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:05.339 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(client.4212.0:139 1.0 e25/24 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 25'97, mlcod=25'88)", 2024-04-18T14:44:05.339 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-04-18T14:43:20.883426+0000", 2024-04-18T14:44:05.339 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 44.424707527999999, 2024-04-18T14:44:05.339 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0054388659999999997, 2024-04-18T14:44:05.339 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-04-18T14:44:05.339 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T14:44:05.339 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-04-18T14:44:05.339 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:05.340 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-04-18T14:44:05.340 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:20.883426+0000", 2024-04-18T14:44:05.340 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:44:05.340 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:05.340 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:05.340 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-04-18T14:44:05.340 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:20.883426+0000", 2024-04-18T14:44:05.340 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:44:05.340 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:05.340 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:05.340 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-04-18T14:44:05.340 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:20.883425+0000", 2024-04-18T14:44:05.340 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999986 2024-04-18T14:44:05.340 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:05.341 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:05.341 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-04-18T14:44:05.341 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:20.883437+0000", 2024-04-18T14:44:05.341 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.1861999999999999e-05 2024-04-18T14:44:05.341 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:05.341 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:05.341 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-04-18T14:44:05.341 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:20.883461+0000", 2024-04-18T14:44:05.341 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.3995e-05 2024-04-18T14:44:05.341 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:05.341 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:05.341 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-04-18T14:44:05.341 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:20.883478+0000", 2024-04-18T14:44:05.342 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.7762e-05 2024-04-18T14:44:05.342 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:05.342 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:05.342 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-04-18T14:44:05.342 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:20.883572+0000", 2024-04-18T14:44:05.342 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.3586999999999997e-05 2024-04-18T14:44:05.342 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:05.342 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:05.342 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-04-18T14:44:05.342 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:20.883632+0000", 2024-04-18T14:44:05.342 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.0202999999999999e-05 2024-04-18T14:44:05.342 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:05.342 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:05.342 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-04-18T14:44:05.342 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:20.888815+0000", 2024-04-18T14:44:05.343 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0051830920000000003 2024-04-18T14:44:05.343 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:05.343 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:05.343 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-04-18T14:44:05.343 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:20.888865+0000", 2024-04-18T14:44:05.343 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.9660999999999998e-05 2024-04-18T14:44:05.343 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:44:05.343 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-04-18T14:44:05.343 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:44:05.343 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:05.343 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:05.343 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(client.4212.0:140 1.0 e25/24 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 25'98, mlcod=25'90)", 2024-04-18T14:44:05.343 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-04-18T14:43:20.884221+0000", 2024-04-18T14:44:05.343 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 44.423912412999996, 2024-04-18T14:44:05.344 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0069705119999999999, 2024-04-18T14:44:05.344 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-04-18T14:44:05.344 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T14:44:05.344 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-04-18T14:44:05.344 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:05.344 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-04-18T14:44:05.344 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:20.884221+0000", 2024-04-18T14:44:05.344 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:44:05.344 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:05.344 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:05.344 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-04-18T14:44:05.344 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:20.884221+0000", 2024-04-18T14:44:05.344 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:44:05.344 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:05.344 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:05.345 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-04-18T14:44:05.345 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:20.884219+0000", 2024-04-18T14:44:05.345 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999981 2024-04-18T14:44:05.345 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:05.345 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:05.345 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-04-18T14:44:05.345 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:20.884318+0000", 2024-04-18T14:44:05.345 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.9103000000000003e-05 2024-04-18T14:44:05.345 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:05.345 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:05.345 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-04-18T14:44:05.345 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:20.884342+0000", 2024-04-18T14:44:05.345 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.3864000000000001e-05 2024-04-18T14:44:05.345 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:05.346 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:05.346 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-04-18T14:44:05.346 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:20.884355+0000", 2024-04-18T14:44:05.346 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.2829e-05 2024-04-18T14:44:05.346 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:05.346 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:05.346 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-04-18T14:44:05.346 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:20.884446+0000", 2024-04-18T14:44:05.346 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.1328000000000004e-05 2024-04-18T14:44:05.346 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:05.346 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:05.346 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-04-18T14:44:05.346 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:20.884499+0000", 2024-04-18T14:44:05.346 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.2238999999999999e-05 2024-04-18T14:44:05.347 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:05.347 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:05.347 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-04-18T14:44:05.347 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:20.891116+0000", 2024-04-18T14:44:05.347 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0066174229999999999 2024-04-18T14:44:05.347 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:05.347 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:05.347 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-04-18T14:44:05.347 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:20.891192+0000", 2024-04-18T14:44:05.347 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.5542000000000003e-05 2024-04-18T14:44:05.347 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:44:05.347 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-04-18T14:44:05.347 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:44:05.347 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:05.348 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:05.348 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(client.4212.0:141 1.0 e25/24 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 25'99, mlcod=25'90)", 2024-04-18T14:44:05.348 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-04-18T14:43:20.885297+0000", 2024-04-18T14:44:05.348 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 44.422836078000003, 2024-04-18T14:44:05.348 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0085544120000000008, 2024-04-18T14:44:05.348 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-04-18T14:44:05.348 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T14:44:05.348 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-04-18T14:44:05.348 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:05.348 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-04-18T14:44:05.348 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:20.885297+0000", 2024-04-18T14:44:05.348 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:44:05.348 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:05.349 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:05.349 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-04-18T14:44:05.349 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:20.885297+0000", 2024-04-18T14:44:05.349 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:44:05.349 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:05.349 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:05.349 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-04-18T14:44:05.349 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:20.885296+0000", 2024-04-18T14:44:05.349 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999981 2024-04-18T14:44:05.349 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:05.349 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:05.349 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-04-18T14:44:05.349 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:20.885309+0000", 2024-04-18T14:44:05.349 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.3532e-05 2024-04-18T14:44:05.350 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:05.350 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:05.350 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-04-18T14:44:05.350 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:20.885334+0000", 2024-04-18T14:44:05.350 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.4360999999999999e-05 2024-04-18T14:44:05.350 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:05.350 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:05.350 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-04-18T14:44:05.350 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:20.885348+0000", 2024-04-18T14:44:05.350 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.4069e-05 2024-04-18T14:44:05.350 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:05.350 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:05.351 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-04-18T14:44:05.351 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:20.888020+0000", 2024-04-18T14:44:05.351 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0026719650000000001 2024-04-18T14:44:05.351 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:05.351 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:05.351 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-04-18T14:44:05.351 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:20.888077+0000", 2024-04-18T14:44:05.351 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.6938999999999998e-05 2024-04-18T14:44:05.351 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:05.351 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:05.351 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-04-18T14:44:05.351 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:20.893781+0000", 2024-04-18T14:44:05.351 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0057041399999999999 2024-04-18T14:44:05.352 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:05.352 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:05.352 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-04-18T14:44:05.352 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:20.893852+0000", 2024-04-18T14:44:05.352 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.1112000000000006e-05 2024-04-18T14:44:05.352 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:44:05.352 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-04-18T14:44:05.352 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:44:05.352 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:05.352 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:05.352 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(client.4212.0:203 1.0 e26/24 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 26'149, mlcod=25'145)", 2024-04-18T14:44:05.352 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-04-18T14:43:23.027038+0000", 2024-04-18T14:44:05.352 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 42.281095370000003, 2024-04-18T14:44:05.353 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0080089600000000007, 2024-04-18T14:44:05.353 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-04-18T14:44:05.353 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T14:44:05.353 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-04-18T14:44:05.353 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:05.353 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-04-18T14:44:05.353 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:23.027038+0000", 2024-04-18T14:44:05.353 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:44:05.353 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:05.353 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:05.353 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-04-18T14:44:05.353 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:23.027038+0000", 2024-04-18T14:44:05.353 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:44:05.354 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:05.354 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:05.354 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-04-18T14:44:05.354 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:23.027037+0000", 2024-04-18T14:44:05.354 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-04-18T14:44:05.354 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:05.354 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:05.354 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-04-18T14:44:05.354 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:23.027199+0000", 2024-04-18T14:44:05.354 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00016148000000000001 2024-04-18T14:44:05.354 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:05.354 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:05.354 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-04-18T14:44:05.355 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:23.027217+0000", 2024-04-18T14:44:05.355 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.7975e-05 2024-04-18T14:44:05.355 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:05.355 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:05.355 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-04-18T14:44:05.355 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:23.027226+0000", 2024-04-18T14:44:05.355 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.4579999999999999e-06 2024-04-18T14:44:05.355 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:05.355 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:05.355 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-04-18T14:44:05.355 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:23.027271+0000", 2024-04-18T14:44:05.355 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.5323e-05 2024-04-18T14:44:05.355 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:05.356 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:05.356 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-04-18T14:44:05.356 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:23.027291+0000", 2024-04-18T14:44:05.356 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.9264000000000001e-05 2024-04-18T14:44:05.356 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:05.356 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:05.356 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-04-18T14:44:05.356 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:23.034994+0000", 2024-04-18T14:44:05.356 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0077035519999999998 2024-04-18T14:44:05.356 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:05.356 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:05.356 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-04-18T14:44:05.356 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:23.035047+0000", 2024-04-18T14:44:05.356 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.2824000000000001e-05 2024-04-18T14:44:05.357 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:44:05.357 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-04-18T14:44:05.357 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:44:05.357 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:05.357 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:05.357 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(client.4212.0:204 1.0 e26/24 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 26'150, mlcod=25'145)", 2024-04-18T14:44:05.357 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-04-18T14:43:23.028329+0000", 2024-04-18T14:44:05.357 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 42.279804652999999, 2024-04-18T14:44:05.357 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.006743481, 2024-04-18T14:44:05.357 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-04-18T14:44:05.357 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T14:44:05.357 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-04-18T14:44:05.357 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:05.357 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-04-18T14:44:05.358 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:23.028329+0000", 2024-04-18T14:44:05.358 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:44:05.358 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:05.358 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:05.358 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-04-18T14:44:05.358 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:23.028329+0000", 2024-04-18T14:44:05.358 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:44:05.358 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:05.358 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:05.358 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-04-18T14:44:05.358 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:23.028328+0000", 2024-04-18T14:44:05.358 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-04-18T14:44:05.359 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:05.359 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:05.359 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-04-18T14:44:05.359 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:23.028337+0000", 2024-04-18T14:44:05.359 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.2399999999999996e-06 2024-04-18T14:44:05.359 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:05.359 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:05.359 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-04-18T14:44:05.359 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:23.028353+0000", 2024-04-18T14:44:05.359 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.6308999999999999e-05 2024-04-18T14:44:05.359 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:05.359 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:05.359 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-04-18T14:44:05.359 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:23.028362+0000", 2024-04-18T14:44:05.360 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.6910000000000003e-06 2024-04-18T14:44:05.360 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:05.360 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:05.360 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-04-18T14:44:05.360 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:23.028427+0000", 2024-04-18T14:44:05.360 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.4844000000000005e-05 2024-04-18T14:44:05.360 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:05.360 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:05.360 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-04-18T14:44:05.360 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:23.028453+0000", 2024-04-18T14:44:05.360 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.6259999999999999e-05 2024-04-18T14:44:05.360 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:05.360 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:05.360 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-04-18T14:44:05.361 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:23.035050+0000", 2024-04-18T14:44:05.361 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0065966740000000003 2024-04-18T14:44:05.361 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:05.361 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:05.361 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-04-18T14:44:05.361 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:23.035072+0000", 2024-04-18T14:44:05.361 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.2364000000000001e-05 2024-04-18T14:44:05.361 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:44:05.361 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-04-18T14:44:05.361 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:44:05.361 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:05.361 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:05.361 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(client.4212.0:205 1.0 e26/24 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 26'151, mlcod=26'146)", 2024-04-18T14:44:05.361 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-04-18T14:43:23.029545+0000", 2024-04-18T14:44:05.362 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 42.278588249000002, 2024-04-18T14:44:05.362 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0060327799999999997, 2024-04-18T14:44:05.362 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-04-18T14:44:05.362 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T14:44:05.362 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-04-18T14:44:05.362 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:05.362 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-04-18T14:44:05.362 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:23.029545+0000", 2024-04-18T14:44:05.362 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:44:05.362 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:05.362 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:05.362 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-04-18T14:44:05.362 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:23.029545+0000", 2024-04-18T14:44:05.362 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:44:05.363 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:05.363 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:05.363 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-04-18T14:44:05.363 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:23.029544+0000", 2024-04-18T14:44:05.363 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-04-18T14:44:05.363 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:05.363 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:05.363 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-04-18T14:44:05.363 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:23.029552+0000", 2024-04-18T14:44:05.363 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.5490000000000001e-06 2024-04-18T14:44:05.363 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:05.363 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:05.363 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-04-18T14:44:05.363 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:23.029567+0000", 2024-04-18T14:44:05.363 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.5211999999999999e-05 2024-04-18T14:44:05.364 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:05.364 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:05.364 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-04-18T14:44:05.364 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:23.029575+0000", 2024-04-18T14:44:05.364 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.1110000000000008e-06 2024-04-18T14:44:05.364 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:05.364 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:05.364 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-04-18T14:44:05.364 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:23.029616+0000", 2024-04-18T14:44:05.364 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.0756000000000001e-05 2024-04-18T14:44:05.364 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:05.364 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:05.364 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-04-18T14:44:05.364 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:23.029635+0000", 2024-04-18T14:44:05.365 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.9012e-05 2024-04-18T14:44:05.365 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:05.365 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:05.365 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-04-18T14:44:05.365 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:23.035542+0000", 2024-04-18T14:44:05.365 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0059065130000000004 2024-04-18T14:44:05.365 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:05.365 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:05.365 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-04-18T14:44:05.365 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:23.035578+0000", 2024-04-18T14:44:05.365 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.6477999999999999e-05 2024-04-18T14:44:05.365 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:44:05.365 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-04-18T14:44:05.365 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:44:05.366 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:05.366 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:05.366 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(client.4212.0:206 1.0 e26/24 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 26'152, mlcod=26'146)", 2024-04-18T14:44:05.366 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-04-18T14:43:23.030575+0000", 2024-04-18T14:44:05.366 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 42.277558867000003, 2024-04-18T14:44:05.366 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0050234140000000004, 2024-04-18T14:44:05.366 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-04-18T14:44:05.366 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T14:44:05.366 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-04-18T14:44:05.366 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:05.366 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-04-18T14:44:05.366 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:23.030575+0000", 2024-04-18T14:44:05.366 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:44:05.367 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:05.367 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:05.367 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-04-18T14:44:05.367 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:23.030575+0000", 2024-04-18T14:44:05.367 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:44:05.367 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:05.367 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:05.367 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-04-18T14:44:05.367 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:23.030574+0000", 2024-04-18T14:44:05.367 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-04-18T14:44:05.367 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:05.367 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:05.367 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-04-18T14:44:05.367 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:23.030660+0000", 2024-04-18T14:44:05.367 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.5902000000000005e-05 2024-04-18T14:44:05.368 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:05.368 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:05.368 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-04-18T14:44:05.368 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:23.030677+0000", 2024-04-18T14:44:05.368 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.7079e-05 2024-04-18T14:44:05.368 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:05.368 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:05.368 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-04-18T14:44:05.368 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:23.030684+0000", 2024-04-18T14:44:05.368 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.5020000000000003e-06 2024-04-18T14:44:05.368 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:05.368 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:05.368 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-04-18T14:44:05.368 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:23.030736+0000", 2024-04-18T14:44:05.369 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.1526000000000001e-05 2024-04-18T14:44:05.369 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:05.369 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:05.369 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-04-18T14:44:05.369 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:23.030755+0000", 2024-04-18T14:44:05.369 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.895e-05 2024-04-18T14:44:05.369 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:05.369 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:05.369 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-04-18T14:44:05.369 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:23.035580+0000", 2024-04-18T14:44:05.369 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0048251880000000002 2024-04-18T14:44:05.369 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:05.369 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:05.370 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-04-18T14:44:05.370 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:23.035598+0000", 2024-04-18T14:44:05.370 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.8111e-05 2024-04-18T14:44:05.370 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:44:05.370 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-04-18T14:44:05.370 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:44:05.370 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:05.370 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:05.370 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "MOSDECSubOpWrite(3.8s2 41/30 ECSubWrite(tid=35, reqid=client.4559.0:250, at_version=41'18, trim_to=0'0, roll_forward_to=38'16))", 2024-04-18T14:44:05.370 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-04-18T14:43:40.763953+0000", 2024-04-18T14:44:05.370 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 24.544180841999999, 2024-04-18T14:44:05.370 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0053911749999999998, 2024-04-18T14:44:05.371 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-04-18T14:44:05.371 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "reached pg", 2024-04-18T14:44:05.371 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-04-18T14:44:05.371 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:05.371 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-04-18T14:44:05.371 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:40.763953+0000", 2024-04-18T14:44:05.371 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:44:05.371 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:05.371 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:05.371 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-04-18T14:44:05.371 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:40.763953+0000", 2024-04-18T14:44:05.371 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:44:05.371 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:05.371 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:05.371 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-04-18T14:44:05.372 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:40.763952+0000", 2024-04-18T14:44:05.372 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-04-18T14:44:05.372 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:05.372 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:05.372 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-04-18T14:44:05.372 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:40.764008+0000", 2024-04-18T14:44:05.372 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.6538e-05 2024-04-18T14:44:05.372 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:05.372 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:05.372 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-04-18T14:44:05.372 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:40.764051+0000", 2024-04-18T14:44:05.372 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.2534999999999998e-05 2024-04-18T14:44:05.372 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:05.373 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:05.373 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-04-18T14:44:05.373 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:40.764074+0000", 2024-04-18T14:44:05.373 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.3292e-05 2024-04-18T14:44:05.373 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:05.373 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:05.373 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-04-18T14:44:05.373 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:40.764189+0000", 2024-04-18T14:44:05.373 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000114645 2024-04-18T14:44:05.373 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:05.373 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:05.373 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_started", 2024-04-18T14:44:05.373 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:40.764211+0000", 2024-04-18T14:44:05.373 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.2558999999999999e-05 2024-04-18T14:44:05.374 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:05.374 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:05.374 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_committed", 2024-04-18T14:44:05.374 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:40.769315+0000", 2024-04-18T14:44:05.374 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0051034740000000002 2024-04-18T14:44:05.374 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:05.374 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:05.374 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-04-18T14:44:05.374 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:40.769344+0000", 2024-04-18T14:44:05.374 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.8886000000000001e-05 2024-04-18T14:44:05.374 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:44:05.374 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-04-18T14:44:05.374 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:44:05.374 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:05.375 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:05.375 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "MOSDECSubOpWrite(3.es5 45/30 ECSubWrite(tid=21, reqid=client.4559.0:306, at_version=45'13, trim_to=0'0, roll_forward_to=44'11))", 2024-04-18T14:44:05.375 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-04-18T14:43:44.506553+0000", 2024-04-18T14:44:05.375 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 20.80158063, 2024-04-18T14:44:05.375 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0046027179999999996, 2024-04-18T14:44:05.375 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-04-18T14:44:05.375 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "reached pg", 2024-04-18T14:44:05.375 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-04-18T14:44:05.375 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:05.375 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-04-18T14:44:05.375 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:44.506553+0000", 2024-04-18T14:44:05.375 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:44:05.375 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:05.375 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:05.375 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-04-18T14:44:05.376 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:44.506553+0000", 2024-04-18T14:44:05.376 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:44:05.376 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:05.376 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:05.376 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-04-18T14:44:05.376 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:44.506552+0000", 2024-04-18T14:44:05.376 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-04-18T14:44:05.376 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:05.376 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:05.376 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-04-18T14:44:05.376 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:44.506714+0000", 2024-04-18T14:44:05.376 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00016213299999999999 2024-04-18T14:44:05.376 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:05.377 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:05.377 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-04-18T14:44:05.377 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:44.506732+0000", 2024-04-18T14:44:05.377 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.7274000000000001e-05 2024-04-18T14:44:05.377 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:05.377 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:05.377 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-04-18T14:44:05.377 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:44.506743+0000", 2024-04-18T14:44:05.377 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.0834e-05 2024-04-18T14:44:05.377 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:05.377 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:05.377 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-04-18T14:44:05.377 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:44.506815+0000", 2024-04-18T14:44:05.377 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.2082999999999994e-05 2024-04-18T14:44:05.378 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:05.378 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:05.378 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_started", 2024-04-18T14:44:05.378 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:44.506826+0000", 2024-04-18T14:44:05.378 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.097e-05 2024-04-18T14:44:05.378 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:05.378 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:05.378 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_committed", 2024-04-18T14:44:05.378 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:44.511114+0000", 2024-04-18T14:44:05.378 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0042886629999999999 2024-04-18T14:44:05.378 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:05.378 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:05.378 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-04-18T14:44:05.378 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:44.511156+0000", 2024-04-18T14:44:05.379 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.1291000000000002e-05 2024-04-18T14:44:05.379 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:44:05.379 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-04-18T14:44:05.379 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:44:05.379 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:05.379 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:05.379 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "MOSDECSubOpWrite(3.ds2 50/30 ECSubWrite(tid=12, reqid=osd.7.0:12, at_version=50'11, trim_to=0'0, roll_forward_to=49'9))", 2024-04-18T14:44:05.379 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-04-18T14:43:49.405185+0000", 2024-04-18T14:44:05.379 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 15.902948802000001, 2024-04-18T14:44:05.379 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0049198180000000003, 2024-04-18T14:44:05.379 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-04-18T14:44:05.379 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "reached pg", 2024-04-18T14:44:05.379 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-04-18T14:44:05.380 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:05.380 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-04-18T14:44:05.380 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:49.405185+0000", 2024-04-18T14:44:05.380 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:44:05.380 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:05.380 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:05.380 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-04-18T14:44:05.380 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:49.405185+0000", 2024-04-18T14:44:05.380 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:44:05.380 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:05.380 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:05.380 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-04-18T14:44:05.380 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:49.405184+0000", 2024-04-18T14:44:05.381 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-04-18T14:44:05.381 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:05.381 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:05.381 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-04-18T14:44:05.381 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:49.405222+0000", 2024-04-18T14:44:05.381 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.7381e-05 2024-04-18T14:44:05.381 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:05.381 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:05.381 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-04-18T14:44:05.381 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:49.405247+0000", 2024-04-18T14:44:05.381 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.5508e-05 2024-04-18T14:44:05.381 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:05.381 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:05.381 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-04-18T14:44:05.381 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:49.405259+0000", 2024-04-18T14:44:05.382 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.2055999999999999e-05 2024-04-18T14:44:05.382 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:05.382 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:05.382 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-04-18T14:44:05.382 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:49.405328+0000", 2024-04-18T14:44:05.382 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.8759999999999999e-05 2024-04-18T14:44:05.382 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:05.382 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:05.382 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_started", 2024-04-18T14:44:05.382 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:49.405335+0000", 2024-04-18T14:44:05.382 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.0979999999999996e-06 2024-04-18T14:44:05.382 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:05.382 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:05.383 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_committed", 2024-04-18T14:44:05.383 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:49.410066+0000", 2024-04-18T14:44:05.383 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0047305020000000001 2024-04-18T14:44:05.383 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:05.383 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:05.383 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-04-18T14:44:05.383 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:49.410104+0000", 2024-04-18T14:44:05.383 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.8779000000000003e-05 2024-04-18T14:44:05.383 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:44:05.383 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-04-18T14:44:05.383 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:44:05.383 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:05.383 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:05.383 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "MOSDECSubOpWrite(3.ds2 50/30 ECSubWrite(tid=13, reqid=osd.7.0:12, at_version=0'0, trim_to=0'0, roll_forward_to=50'11))", 2024-04-18T14:44:05.383 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-04-18T14:43:49.416724+0000", 2024-04-18T14:44:05.384 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 15.891409399, 2024-04-18T14:44:05.384 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0051942409999999996, 2024-04-18T14:44:05.384 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-04-18T14:44:05.384 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "reached pg", 2024-04-18T14:44:05.384 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-04-18T14:44:05.384 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:05.384 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-04-18T14:44:05.384 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:49.416724+0000", 2024-04-18T14:44:05.384 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:44:05.384 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:05.384 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:05.384 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-04-18T14:44:05.384 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:49.416724+0000", 2024-04-18T14:44:05.384 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:44:05.384 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:05.385 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:05.385 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-04-18T14:44:05.385 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:49.416723+0000", 2024-04-18T14:44:05.385 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-04-18T14:44:05.385 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:05.385 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:05.385 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-04-18T14:44:05.385 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:49.416735+0000", 2024-04-18T14:44:05.385 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.1780000000000001e-05 2024-04-18T14:44:05.385 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:05.385 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:05.385 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-04-18T14:44:05.385 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:49.416749+0000", 2024-04-18T14:44:05.385 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.3915e-05 2024-04-18T14:44:05.385 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:05.386 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:05.386 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-04-18T14:44:05.386 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:49.416756+0000", 2024-04-18T14:44:05.386 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.272e-06 2024-04-18T14:44:05.386 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:05.386 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:05.386 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-04-18T14:44:05.386 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:49.416811+0000", 2024-04-18T14:44:05.386 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.4914000000000003e-05 2024-04-18T14:44:05.386 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:05.386 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:05.386 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_started", 2024-04-18T14:44:05.386 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:49.416821+0000", 2024-04-18T14:44:05.386 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.0195e-05 2024-04-18T14:44:05.387 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:05.387 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:05.387 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_committed", 2024-04-18T14:44:05.387 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:49.421890+0000", 2024-04-18T14:44:05.387 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0050687579999999996 2024-04-18T14:44:05.387 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:05.387 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:05.387 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-04-18T14:44:05.387 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:49.421918+0000", 2024-04-18T14:44:05.387 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.8357e-05 2024-04-18T14:44:05.387 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:44:05.387 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-04-18T14:44:05.387 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:44:05.388 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:05.388 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:05.388 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "MOSDECSubOpWrite(3.1s5 57/30 ECSubWrite(tid=39, reqid=client.4559.0:512, at_version=57'26, trim_to=0'0, roll_forward_to=53'24))", 2024-04-18T14:44:05.388 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-04-18T14:43:56.585652+0000", 2024-04-18T14:44:05.388 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 8.7224813460000004, 2024-04-18T14:44:05.388 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0058697250000000001, 2024-04-18T14:44:05.388 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-04-18T14:44:05.388 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "reached pg", 2024-04-18T14:44:05.388 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-04-18T14:44:05.388 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:05.388 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-04-18T14:44:05.388 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:56.585652+0000", 2024-04-18T14:44:05.388 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:44:05.389 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:05.389 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:05.389 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-04-18T14:44:05.389 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:56.585652+0000", 2024-04-18T14:44:05.389 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:44:05.389 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:05.389 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:05.389 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-04-18T14:44:05.389 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:56.585651+0000", 2024-04-18T14:44:05.389 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999986 2024-04-18T14:44:05.389 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:05.389 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:05.389 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-04-18T14:44:05.389 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:56.586814+0000", 2024-04-18T14:44:05.389 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0011629089999999999 2024-04-18T14:44:05.390 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:05.390 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:05.390 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-04-18T14:44:05.390 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:56.586829+0000", 2024-04-18T14:44:05.390 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.5166e-05 2024-04-18T14:44:05.390 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:05.390 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:05.390 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-04-18T14:44:05.390 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:56.586838+0000", 2024-04-18T14:44:05.390 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.4949999999999997e-06 2024-04-18T14:44:05.390 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:05.390 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:05.390 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-04-18T14:44:05.391 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:56.586905+0000", 2024-04-18T14:44:05.391 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.6444000000000003e-05 2024-04-18T14:44:05.391 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:05.391 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:05.391 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_started", 2024-04-18T14:44:05.391 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:56.586918+0000", 2024-04-18T14:44:05.391 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.2872e-05 2024-04-18T14:44:05.391 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:05.391 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:05.391 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_committed", 2024-04-18T14:44:05.391 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:56.591494+0000", 2024-04-18T14:44:05.391 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0045764500000000001 2024-04-18T14:44:05.391 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:05.391 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:05.391 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-04-18T14:44:05.392 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:56.591522+0000", 2024-04-18T14:44:05.392 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.7783000000000001e-05 2024-04-18T14:44:05.392 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:44:05.392 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-04-18T14:44:05.392 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:44:05.392 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:05.392 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:05.392 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "MOSDECSubOpWrite(3.es5 57/30 ECSubWrite(tid=48, reqid=client.4559.0:514, at_version=57'36, trim_to=0'0, roll_forward_to=57'34))", 2024-04-18T14:44:05.392 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-04-18T14:43:56.585722+0000", 2024-04-18T14:44:05.392 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 8.7224115199999996, 2024-04-18T14:44:05.392 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0051877870000000001, 2024-04-18T14:44:05.392 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-04-18T14:44:05.392 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "reached pg", 2024-04-18T14:44:05.392 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-04-18T14:44:05.393 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:05.393 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-04-18T14:44:05.393 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:56.585722+0000", 2024-04-18T14:44:05.393 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:44:05.393 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:05.393 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:05.393 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-04-18T14:44:05.393 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:56.585722+0000", 2024-04-18T14:44:05.393 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:44:05.393 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:05.393 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:05.393 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-04-18T14:44:05.393 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:56.585721+0000", 2024-04-18T14:44:05.393 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-04-18T14:44:05.394 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:05.394 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:05.394 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-04-18T14:44:05.394 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:56.586046+0000", 2024-04-18T14:44:05.394 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00032557300000000001 2024-04-18T14:44:05.394 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:05.394 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:05.394 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-04-18T14:44:05.394 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:56.586064+0000", 2024-04-18T14:44:05.394 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.7672999999999998e-05 2024-04-18T14:44:05.394 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:05.394 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:05.394 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-04-18T14:44:05.395 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:56.586076+0000", 2024-04-18T14:44:05.395 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.2272999999999999e-05 2024-04-18T14:44:05.395 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:05.395 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:05.395 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-04-18T14:44:05.395 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:56.586157+0000", 2024-04-18T14:44:05.395 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.0252000000000003e-05 2024-04-18T14:44:05.395 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:05.395 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:05.395 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_started", 2024-04-18T14:44:05.395 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:56.586170+0000", 2024-04-18T14:44:05.396 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.3484e-05 2024-04-18T14:44:05.396 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:05.396 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:05.396 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_committed", 2024-04-18T14:44:05.396 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:56.590870+0000", 2024-04-18T14:44:05.396 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0047002959999999996 2024-04-18T14:44:05.396 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:05.396 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:05.396 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-04-18T14:44:05.396 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:56.590910+0000", 2024-04-18T14:44:05.396 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.9399e-05 2024-04-18T14:44:05.396 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:44:05.396 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-04-18T14:44:05.396 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:44:05.397 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:44:05.397 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-04-18T14:44:05.397 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-04-18T14:44:05.399 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-04-18T14:44:05.400 INFO:teuthology.orchestra.run.smithi086.stderr:reweighted osd.13 to 1 (10000) 2024-04-18T14:44:05.400 INFO:tasks.rados.rados.0.smithi134.stdout:239: done (7 left) 2024-04-18T14:44:05.400 INFO:tasks.rados.rados.0.smithi134.stdout:241: done (6 left) 2024-04-18T14:44:05.400 INFO:tasks.rados.rados.0.smithi134.stdout:245: done (5 left) 2024-04-18T14:44:05.400 INFO:tasks.rados.rados.0.smithi134.stdout:246: done (4 left) 2024-04-18T14:44:05.400 INFO:tasks.rados.rados.0.smithi134.stdout:248: done (3 left) 2024-04-18T14:44:05.400 INFO:tasks.rados.rados.0.smithi134.stdout:249: done (2 left) 2024-04-18T14:44:05.400 INFO:tasks.rados.rados.0.smithi134.stdout:250: done (1 left) 2024-04-18T14:44:05.400 INFO:tasks.rados.rados.0.smithi134.stdout:251: done (0 left) 2024-04-18T14:44:05.400 INFO:tasks.rados.rados.0.smithi134.stdout:252: read oid 34 snap -1 2024-04-18T14:44:05.400 INFO:tasks.rados.rados.0.smithi134.stdout:252: expect (ObjNum 33 snap 0 seq_num 33) 2024-04-18T14:44:05.401 INFO:tasks.rados.rados.0.smithi134.stdout:253: delete oid 33 current snap is 22 2024-04-18T14:44:05.401 INFO:tasks.rados.rados.0.smithi134.stdout:253: done (1 left) 2024-04-18T14:44:05.401 INFO:tasks.rados.rados.0.smithi134.stdout:254: read oid 32 snap -1 2024-04-18T14:44:05.401 INFO:tasks.rados.rados.0.smithi134.stdout:254: expect deleted 2024-04-18T14:44:05.401 INFO:tasks.rados.rados.0.smithi134.stdout:append oid 23 current snap is 22 2024-04-18T14:44:05.401 INFO:tasks.rados.rados.0.smithi134.stdout:255: seq_num 105 ranges {753664=606208,1359872=688128,2048000=475136} 2024-04-18T14:44:05.401 INFO:tasks.rados.rados.0.smithi134.stdout:255: writing smithi13430248-23 from 753664 to 1359872 tid 1 2024-04-18T14:44:05.401 INFO:tasks.ceph.osd.1.smithi096.stderr:2024-04-18T14:44:05.393+0000 7f56a7a98640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 24887) UID: 0 2024-04-18T14:44:05.403 INFO:tasks.rados.rados.0.smithi134.stdout:255: writing smithi13430248-23 from 1359872 to 2048000 tid 2 2024-04-18T14:44:05.407 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 14 1 2024-04-18T14:44:05.408 INFO:tasks.rados.rados.0.smithi134.stdout:255: writing smithi13430248-23 from 2048000 to 2523136 tid 3 2024-04-18T14:44:05.408 INFO:tasks.rados.rados.0.smithi134.stdout:append oid 40 current snap is 22 2024-04-18T14:44:05.408 INFO:tasks.rados.rados.0.smithi134.stdout:256: seq_num 106 ranges {802816=622592,1425408=442368,1867776=524288,2392064=196608} 2024-04-18T14:44:05.422 INFO:tasks.rados.rados.0.smithi134.stdout:256: writing smithi13430248-40 from 802816 to 1425408 tid 1 2024-04-18T14:44:05.427 INFO:tasks.rados.rados.0.smithi134.stdout:256: writing smithi13430248-40 from 1425408 to 1867776 tid 2 2024-04-18T14:44:05.433 INFO:tasks.rados.rados.0.smithi134.stdout:256: writing smithi13430248-40 from 1867776 to 2392064 tid 3 2024-04-18T14:44:05.438 INFO:tasks.rados.rados.0.smithi134.stdout:256: writing smithi13430248-40 from 2392064 to 2588672 tid 4 2024-04-18T14:44:05.439 INFO:tasks.rados.rados.0.smithi134.stdout:257: setattr oid 18 current snap is 22 2024-04-18T14:44:05.439 INFO:tasks.rados.rados.0.smithi134.stdout:252: expect (ObjNum 33 snap 0 seq_num 33) 2024-04-18T14:44:05.464 INFO:tasks.rados.rados.0.smithi134.stdout:255: finishing write tid 1 to smithi13430248-23 2024-04-18T14:44:05.464 INFO:tasks.rados.rados.0.smithi134.stdout:255: finishing write tid 2 to smithi13430248-23 2024-04-18T14:44:05.464 INFO:tasks.rados.rados.0.smithi134.stdout:255: finishing write tid 3 to smithi13430248-23 2024-04-18T14:44:05.464 INFO:tasks.rados.rados.0.smithi134.stdout:255: finishing write tid 4 to smithi13430248-23 2024-04-18T14:44:05.464 INFO:tasks.rados.rados.0.smithi134.stdout:255: finishing write tid 5 to smithi13430248-23 2024-04-18T14:44:05.464 INFO:tasks.rados.rados.0.smithi134.stdout:255: oid 23 updating version 0 to 101 2024-04-18T14:44:05.464 INFO:tasks.rados.rados.0.smithi134.stdout:255: oid 23 version 101 is already newer than 98 2024-04-18T14:44:05.464 INFO:tasks.rados.rados.0.smithi134.stdout:255: oid 23 version 101 is already newer than 99 2024-04-18T14:44:05.465 INFO:tasks.rados.rados.0.smithi134.stdout:255: oid 23 version 101 is already newer than 100 2024-04-18T14:44:05.465 INFO:tasks.rados.rados.0.smithi134.stdout:update_object_version oid 23 v 101 (ObjNum 105 snap 22 seq_num 105) dirty exists 2024-04-18T14:44:05.465 INFO:tasks.rados.rados.0.smithi134.stdout:255: left oid 23 (ObjNum 105 snap 22 seq_num 105) 2024-04-18T14:44:05.465 INFO:tasks.rados.rados.0.smithi134.stdout:256: finishing write tid 1 to smithi13430248-40 2024-04-18T14:44:05.465 INFO:tasks.rados.rados.0.smithi134.stdout:256: finishing write tid 2 to smithi13430248-40 2024-04-18T14:44:05.465 INFO:tasks.rados.rados.0.smithi134.stdout:256: finishing write tid 3 to smithi13430248-40 2024-04-18T14:44:05.465 INFO:tasks.rados.rados.0.smithi134.stdout:256: finishing write tid 4 to smithi13430248-40 2024-04-18T14:44:05.465 INFO:tasks.rados.rados.0.smithi134.stdout:256: finishing write tid 5 to smithi13430248-40 2024-04-18T14:44:05.465 INFO:tasks.rados.rados.0.smithi134.stdout:256: finishing write tid 6 to smithi13430248-40 2024-04-18T14:44:05.465 INFO:tasks.rados.rados.0.smithi134.stdout:256: oid 40 updating version 0 to 72 2024-04-18T14:44:05.465 INFO:tasks.rados.rados.0.smithi134.stdout:256: oid 40 updating version 72 to 73 2024-04-18T14:44:05.465 INFO:tasks.rados.rados.0.smithi134.stdout:256: oid 40 updating version 73 to 74 2024-04-18T14:44:05.465 INFO:tasks.rados.rados.0.smithi134.stdout:256: oid 40 updating version 74 to 75 2024-04-18T14:44:05.465 INFO:tasks.rados.rados.0.smithi134.stdout:256: oid 40 updating version 75 to 76 2024-04-18T14:44:05.465 INFO:tasks.rados.rados.0.smithi134.stdout:update_object_version oid 40 v 76 (ObjNum 106 snap 22 seq_num 106) dirty exists 2024-04-18T14:44:05.466 INFO:tasks.rados.rados.0.smithi134.stdout:256: left oid 40 (ObjNum 106 snap 22 seq_num 106) 2024-04-18T14:44:05.466 INFO:tasks.rados.rados.0.smithi134.stdout:252: done (4 left) 2024-04-18T14:44:05.466 INFO:tasks.rados.rados.0.smithi134.stdout:254: done (3 left) 2024-04-18T14:44:05.466 INFO:tasks.rados.rados.0.smithi134.stdout:255: done (2 left) 2024-04-18T14:44:05.466 INFO:tasks.rados.rados.0.smithi134.stdout:256: done (1 left) 2024-04-18T14:44:05.466 INFO:tasks.rados.rados.0.smithi134.stdout:258: rmattr oid 13 current snap is 22 2024-04-18T14:44:05.466 INFO:tasks.rados.rados.0.smithi134.stdout:258: done (1 left) 2024-04-18T14:44:05.466 INFO:tasks.rados.rados.0.smithi134.stdout:append oid 21 current snap is 22 2024-04-18T14:44:05.466 INFO:tasks.rados.rados.0.smithi134.stdout:259: seq_num 107 ranges {1687552=638976,2326528=458752,2785280=704512} 2024-04-18T14:44:05.486 INFO:tasks.rados.rados.0.smithi134.stdout:259: writing smithi13430248-21 from 1687552 to 2326528 tid 1 2024-04-18T14:44:05.491 INFO:tasks.rados.rados.0.smithi134.stdout:259: writing smithi13430248-21 from 2326528 to 2785280 tid 2 2024-04-18T14:44:05.499 INFO:tasks.rados.rados.0.smithi134.stdout:259: writing smithi13430248-21 from 2785280 to 3489792 tid 3 2024-04-18T14:44:05.499 INFO:tasks.rados.rados.0.smithi134.stdout:260: snap_create 2024-04-18T14:44:05.499 INFO:tasks.rados.rados.0.smithi134.stdout:update_object_version oid 18 v 49 (ObjNum 44 snap 0 seq_num 44) dirty exists 2024-04-18T14:44:05.500 INFO:tasks.ceph.osd.14.smithi119.stderr:2024-04-18T14:44:05.502+0000 7f180f599640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 14 (PID: 24900) UID: 0 2024-04-18T14:44:05.500 INFO:tasks.rados.rados.0.smithi134.stdout:259: finishing write tid 1 to smithi13430248-21 2024-04-18T14:44:05.506 INFO:tasks.rados.rados.0.smithi134.stdout:259: finishing write tid 2 to smithi13430248-21 2024-04-18T14:44:05.510 INFO:tasks.rados.rados.0.smithi134.stdout:259: finishing write tid 3 to smithi13430248-21 2024-04-18T14:44:05.512 INFO:tasks.rados.rados.0.smithi134.stdout:259: finishing write tid 4 to smithi13430248-21 2024-04-18T14:44:05.516 INFO:tasks.rados.rados.0.smithi134.stdout:259: finishing write tid 5 to smithi13430248-21 2024-04-18T14:44:05.516 INFO:tasks.rados.rados.0.smithi134.stdout:259: oid 21 updating version 0 to 91 2024-04-18T14:44:05.516 INFO:tasks.rados.rados.0.smithi134.stdout:259: oid 21 updating version 91 to 94 2024-04-18T14:44:05.516 INFO:tasks.rados.rados.0.smithi134.stdout:259: oid 21 version 94 is already newer than 93 2024-04-18T14:44:05.516 INFO:tasks.rados.rados.0.smithi134.stdout:259: oid 21 version 94 is already newer than 92 2024-04-18T14:44:05.516 INFO:tasks.rados.rados.0.smithi134.stdout:update_object_version oid 21 v 94 (ObjNum 107 snap 22 seq_num 107) dirty exists 2024-04-18T14:44:05.516 INFO:tasks.rados.rados.0.smithi134.stdout:259: left oid 21 (ObjNum 107 snap 22 seq_num 107) 2024-04-18T14:44:05.548 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-04-18T14:44:05.578 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-04-18T14:44:05.578 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [], 2024-04-18T14:44:05.578 INFO:teuthology.orchestra.run.smithi086.stdout: "num_ops": 0 2024-04-18T14:44:05.578 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-04-18T14:44:05.595 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-04-18T14:44:05.600 INFO:tasks.ceph.osd.1.smithi096.stderr:2024-04-18T14:44:05.597+0000 7f56a7a98640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 24887) UID: 0 2024-04-18T14:44:05.701 INFO:tasks.ceph.osd.3.smithi134.stderr:2024-04-18T14:44:05.704+0000 7fe7a4443640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25211) UID: 0 2024-04-18T14:44:05.765 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-04-18T14:44:05.765 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [], 2024-04-18T14:44:05.765 INFO:teuthology.orchestra.run.smithi086.stdout: "complaint_time": 30, 2024-04-18T14:44:05.765 INFO:teuthology.orchestra.run.smithi086.stdout: "num_blocked_ops": 0 2024-04-18T14:44:05.765 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-04-18T14:44:05.780 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-04-18T14:44:05.826 INFO:tasks.ceph.osd.4.smithi086.stderr:2024-04-18T14:44:05.826+0000 7f0c4c462640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 24956) UID: 0 2024-04-18T14:44:05.897 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-04-18T14:44:05.897 INFO:teuthology.orchestra.run.smithi086.stdout: "size": 20, 2024-04-18T14:44:05.897 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 600, 2024-04-18T14:44:05.897 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [ 2024-04-18T14:44:05.897 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:05.897 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "MOSDECSubOpWrite(3.7s3 41/30 ECSubWrite(tid=50, reqid=osd.14.0:49, at_version=0'0, trim_to=0'0, roll_forward_to=41'17))", 2024-04-18T14:44:05.898 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-04-18T14:43:40.762947+0000", 2024-04-18T14:44:05.898 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 25.133504969000001, 2024-04-18T14:44:05.898 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0096923070000000007, 2024-04-18T14:44:05.898 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-04-18T14:44:05.898 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "reached pg", 2024-04-18T14:44:05.898 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-04-18T14:44:05.898 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:05.898 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-04-18T14:44:05.898 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:40.762947+0000", 2024-04-18T14:44:05.898 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:44:05.898 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:05.898 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:05.898 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-04-18T14:44:05.898 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:40.762947+0000", 2024-04-18T14:44:05.899 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:44:05.899 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:05.899 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:05.899 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-04-18T14:44:05.899 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:40.762946+0000", 2024-04-18T14:44:05.899 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999986 2024-04-18T14:44:05.899 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:05.899 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:05.899 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-04-18T14:44:05.899 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:40.762974+0000", 2024-04-18T14:44:05.899 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.8242000000000002e-05 2024-04-18T14:44:05.899 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:05.899 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:05.899 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-04-18T14:44:05.899 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:40.763004+0000", 2024-04-18T14:44:05.900 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.9932000000000001e-05 2024-04-18T14:44:05.900 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:05.900 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:05.900 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-04-18T14:44:05.900 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:40.763027+0000", 2024-04-18T14:44:05.900 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.2526000000000001e-05 2024-04-18T14:44:05.900 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:05.900 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:05.900 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-04-18T14:44:05.900 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:40.763080+0000", 2024-04-18T14:44:05.900 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.3529000000000002e-05 2024-04-18T14:44:05.900 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:05.900 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:05.900 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_started", 2024-04-18T14:44:05.900 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:40.763090+0000", 2024-04-18T14:44:05.901 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.7249999999999992e-06 2024-04-18T14:44:05.901 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:05.901 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:05.901 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_committed", 2024-04-18T14:44:05.901 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:40.772540+0000", 2024-04-18T14:44:05.901 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0094502969999999999 2024-04-18T14:44:05.901 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:05.901 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:05.901 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-04-18T14:44:05.901 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:40.772640+0000", 2024-04-18T14:44:05.901 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.9636000000000006e-05 2024-04-18T14:44:05.901 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:44:05.901 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-04-18T14:44:05.901 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:44:05.901 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:05.902 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:05.902 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "MOSDECSubOpWrite(3.8s3 41/30 ECSubWrite(tid=35, reqid=client.4559.0:250, at_version=41'18, trim_to=0'0, roll_forward_to=38'16))", 2024-04-18T14:44:05.902 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-04-18T14:43:40.763913+0000", 2024-04-18T14:44:05.902 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 25.132539523999998, 2024-04-18T14:44:05.902 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.011255968999999999, 2024-04-18T14:44:05.902 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-04-18T14:44:05.902 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "reached pg", 2024-04-18T14:44:05.902 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-04-18T14:44:05.902 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:05.902 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-04-18T14:44:05.902 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:40.763913+0000", 2024-04-18T14:44:05.902 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:44:05.902 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:05.902 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:05.902 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-04-18T14:44:05.903 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:40.763913+0000", 2024-04-18T14:44:05.903 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:44:05.903 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:05.903 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:05.903 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-04-18T14:44:05.903 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:40.763912+0000", 2024-04-18T14:44:05.903 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-04-18T14:44:05.903 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:05.903 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:05.903 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-04-18T14:44:05.903 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:40.763957+0000", 2024-04-18T14:44:05.903 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.4271999999999999e-05 2024-04-18T14:44:05.903 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:05.903 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:05.903 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-04-18T14:44:05.904 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:40.765627+0000", 2024-04-18T14:44:05.904 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.001670878 2024-04-18T14:44:05.904 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:05.904 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:05.904 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-04-18T14:44:05.904 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:40.765654+0000", 2024-04-18T14:44:05.904 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.6435999999999999e-05 2024-04-18T14:44:05.904 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:05.904 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:05.904 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-04-18T14:44:05.904 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:40.765722+0000", 2024-04-18T14:44:05.904 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.8376999999999999e-05 2024-04-18T14:44:05.904 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:05.904 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:05.904 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_started", 2024-04-18T14:44:05.905 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:40.765732+0000", 2024-04-18T14:44:05.905 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.4870000000000008e-06 2024-04-18T14:44:05.905 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:05.905 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:05.905 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_committed", 2024-04-18T14:44:05.905 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:40.775138+0000", 2024-04-18T14:44:05.905 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0094060670000000006 2024-04-18T14:44:05.905 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:05.905 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:05.905 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-04-18T14:44:05.905 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:40.775169+0000", 2024-04-18T14:44:05.905 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.1068999999999997e-05 2024-04-18T14:44:05.905 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:44:05.905 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-04-18T14:44:05.905 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:44:05.905 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:05.906 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:05.906 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "MOSDECSubOpWrite(3.cs4 41/30 ECSubWrite(tid=45, reqid=osd.11.0:45, at_version=41'22, trim_to=0'0, roll_forward_to=39'20))", 2024-04-18T14:44:05.906 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-04-18T14:43:40.764604+0000", 2024-04-18T14:44:05.906 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 25.131848003000002, 2024-04-18T14:44:05.906 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0073682449999999998, 2024-04-18T14:44:05.906 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-04-18T14:44:05.906 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "reached pg", 2024-04-18T14:44:05.906 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-04-18T14:44:05.906 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:05.906 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-04-18T14:44:05.906 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:40.764604+0000", 2024-04-18T14:44:05.906 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:44:05.906 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:05.906 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:05.907 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-04-18T14:44:05.907 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:40.764604+0000", 2024-04-18T14:44:05.907 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:44:05.907 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:05.907 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:05.907 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-04-18T14:44:05.907 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:40.764604+0000", 2024-04-18T14:44:05.907 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-04-18T14:44:05.907 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:05.907 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:05.907 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-04-18T14:44:05.907 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:40.764673+0000", 2024-04-18T14:44:05.907 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.9608000000000002e-05 2024-04-18T14:44:05.907 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:05.907 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:05.907 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-04-18T14:44:05.908 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:40.764714+0000", 2024-04-18T14:44:05.908 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.0794999999999998e-05 2024-04-18T14:44:05.908 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:05.908 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:05.908 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-04-18T14:44:05.908 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:40.764738+0000", 2024-04-18T14:44:05.908 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.3881999999999999e-05 2024-04-18T14:44:05.908 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:05.908 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:05.908 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-04-18T14:44:05.908 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:40.764809+0000", 2024-04-18T14:44:05.908 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.1100999999999996e-05 2024-04-18T14:44:05.908 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:05.908 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:05.908 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_started", 2024-04-18T14:44:05.908 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:40.764818+0000", 2024-04-18T14:44:05.909 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.0739999999999999e-06 2024-04-18T14:44:05.909 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:05.909 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:05.909 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_committed", 2024-04-18T14:44:05.909 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:40.771915+0000", 2024-04-18T14:44:05.909 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0070967479999999999 2024-04-18T14:44:05.909 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:05.909 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:05.909 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-04-18T14:44:05.909 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:40.771973+0000", 2024-04-18T14:44:05.909 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.7821000000000001e-05 2024-04-18T14:44:05.909 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:44:05.909 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-04-18T14:44:05.909 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:44:05.909 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:05.910 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:05.910 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "MOSDECSubOpWrite(3.cs4 41/30 ECSubWrite(tid=46, reqid=osd.11.0:46, at_version=41'24, trim_to=0'0, roll_forward_to=39'20))", 2024-04-18T14:44:05.910 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-04-18T14:43:40.764769+0000", 2024-04-18T14:44:05.910 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 25.131683422999998, 2024-04-18T14:44:05.910 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0098445330000000008, 2024-04-18T14:44:05.910 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-04-18T14:44:05.910 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "reached pg", 2024-04-18T14:44:05.910 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-04-18T14:44:05.910 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:05.910 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-04-18T14:44:05.910 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:40.764769+0000", 2024-04-18T14:44:05.910 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:44:05.910 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:05.910 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:05.911 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-04-18T14:44:05.911 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:40.764769+0000", 2024-04-18T14:44:05.911 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:44:05.911 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:05.911 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:05.911 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-04-18T14:44:05.911 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:40.764768+0000", 2024-04-18T14:44:05.911 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-04-18T14:44:05.911 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:05.911 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:05.911 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-04-18T14:44:05.911 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:40.764809+0000", 2024-04-18T14:44:05.911 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.0917999999999997e-05 2024-04-18T14:44:05.911 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:05.911 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:05.911 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-04-18T14:44:05.912 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:40.764861+0000", 2024-04-18T14:44:05.912 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.2088e-05 2024-04-18T14:44:05.912 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:05.912 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:05.912 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-04-18T14:44:05.912 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:40.764881+0000", 2024-04-18T14:44:05.912 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.0372000000000001e-05 2024-04-18T14:44:05.912 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:05.912 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:05.912 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-04-18T14:44:05.912 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:40.765246+0000", 2024-04-18T14:44:05.912 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00036430499999999999 2024-04-18T14:44:05.912 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:05.912 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:05.912 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_started", 2024-04-18T14:44:05.912 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:40.765271+0000", 2024-04-18T14:44:05.913 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.5083e-05 2024-04-18T14:44:05.913 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:05.913 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:05.913 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_committed", 2024-04-18T14:44:05.913 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:40.774586+0000", 2024-04-18T14:44:05.913 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0093148369999999994 2024-04-18T14:44:05.913 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:05.913 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:05.913 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-04-18T14:44:05.913 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:40.774613+0000", 2024-04-18T14:44:05.913 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.7803000000000001e-05 2024-04-18T14:44:05.913 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:44:05.913 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-04-18T14:44:05.913 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:44:05.913 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:05.913 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:05.914 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "pg_update_log_missing(3.9s3 epoch 41/30 rep_tid 40 entries 41'25 (0'0) error 3:936e42fd:::smithi13430248-33:head by client.4559.0:247 0.000000 0 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 38'23)", 2024-04-18T14:44:05.914 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-04-18T14:43:40.769974+0000", 2024-04-18T14:44:05.914 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 25.126478796000001, 2024-04-18T14:44:05.914 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0046830320000000002, 2024-04-18T14:44:05.914 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-04-18T14:44:05.914 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "reached pg", 2024-04-18T14:44:05.914 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-04-18T14:44:05.914 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:05.914 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-04-18T14:44:05.914 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:40.769974+0000", 2024-04-18T14:44:05.914 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:44:05.914 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:05.914 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:05.914 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-04-18T14:44:05.914 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:40.769974+0000", 2024-04-18T14:44:05.915 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:44:05.915 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:05.915 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:05.915 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-04-18T14:44:05.915 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:40.769973+0000", 2024-04-18T14:44:05.915 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-04-18T14:44:05.915 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:05.915 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:05.915 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-04-18T14:44:05.915 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:40.769989+0000", 2024-04-18T14:44:05.915 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.6113e-05 2024-04-18T14:44:05.915 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:05.915 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:05.915 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-04-18T14:44:05.915 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:40.770024+0000", 2024-04-18T14:44:05.915 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.4856e-05 2024-04-18T14:44:05.916 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:05.916 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:05.916 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-04-18T14:44:05.916 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:40.770052+0000", 2024-04-18T14:44:05.916 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.7996000000000001e-05 2024-04-18T14:44:05.916 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:05.916 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:05.916 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-04-18T14:44:05.916 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:40.770132+0000", 2024-04-18T14:44:05.916 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.9791999999999998e-05 2024-04-18T14:44:05.916 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:05.916 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:05.916 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-04-18T14:44:05.916 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:40.774657+0000", 2024-04-18T14:44:05.916 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0045247969999999997 2024-04-18T14:44:05.916 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:44:05.917 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-04-18T14:44:05.917 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:44:05.917 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:05.917 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:05.917 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "MOSDECSubOpWrite(3.9s3 41/30 ECSubWrite(tid=41, reqid=osd.12.0:41, at_version=41'27, trim_to=0'0, roll_forward_to=38'24))", 2024-04-18T14:44:05.917 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-04-18T14:43:40.770088+0000", 2024-04-18T14:44:05.917 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 25.126364623000001, 2024-04-18T14:44:05.917 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0073282030000000001, 2024-04-18T14:44:05.917 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-04-18T14:44:05.917 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "reached pg", 2024-04-18T14:44:05.917 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-04-18T14:44:05.917 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:05.917 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-04-18T14:44:05.917 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:40.770088+0000", 2024-04-18T14:44:05.917 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:44:05.918 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:05.918 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:05.918 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-04-18T14:44:05.918 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:40.770088+0000", 2024-04-18T14:44:05.918 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:44:05.918 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:05.918 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:05.918 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-04-18T14:44:05.918 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:40.770087+0000", 2024-04-18T14:44:05.918 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-04-18T14:44:05.918 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:05.918 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:05.918 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-04-18T14:44:05.918 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:40.770161+0000", 2024-04-18T14:44:05.918 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.3917000000000004e-05 2024-04-18T14:44:05.919 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:05.919 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:05.919 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-04-18T14:44:05.919 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:40.770184+0000", 2024-04-18T14:44:05.919 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.3244e-05 2024-04-18T14:44:05.919 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:05.919 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:05.919 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-04-18T14:44:05.919 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:40.770202+0000", 2024-04-18T14:44:05.919 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.7997000000000001e-05 2024-04-18T14:44:05.919 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:05.919 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:05.919 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-04-18T14:44:05.919 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:40.770279+0000", 2024-04-18T14:44:05.919 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.7689999999999996e-05 2024-04-18T14:44:05.920 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:05.920 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:05.920 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_started", 2024-04-18T14:44:05.920 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:40.770288+0000", 2024-04-18T14:44:05.920 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.5609999999999999e-06 2024-04-18T14:44:05.920 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:05.920 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:05.920 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_committed", 2024-04-18T14:44:05.920 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:40.777381+0000", 2024-04-18T14:44:05.920 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0070933189999999998 2024-04-18T14:44:05.920 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:05.920 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:05.920 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-04-18T14:44:05.920 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:40.777416+0000", 2024-04-18T14:44:05.920 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.4649e-05 2024-04-18T14:44:05.921 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:44:05.921 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-04-18T14:44:05.921 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:44:05.921 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:05.921 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:05.921 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "MOSDECSubOpWrite(3.8s3 41/30 ECSubWrite(tid=36, reqid=osd.5.0:36, at_version=41'20, trim_to=0'0, roll_forward_to=38'16))", 2024-04-18T14:44:05.921 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-04-18T14:43:40.770246+0000", 2024-04-18T14:44:05.921 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 25.126206315000001, 2024-04-18T14:44:05.921 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0072291999999999999, 2024-04-18T14:44:05.921 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-04-18T14:44:05.921 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "reached pg", 2024-04-18T14:44:05.921 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-04-18T14:44:05.921 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:05.921 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-04-18T14:44:05.921 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:40.770246+0000", 2024-04-18T14:44:05.922 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:44:05.922 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:05.922 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:05.922 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-04-18T14:44:05.922 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:40.770246+0000", 2024-04-18T14:44:05.922 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:44:05.922 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:05.922 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:05.922 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-04-18T14:44:05.922 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:40.770245+0000", 2024-04-18T14:44:05.922 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-04-18T14:44:05.922 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:05.922 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:05.922 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-04-18T14:44:05.923 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:40.770279+0000", 2024-04-18T14:44:05.923 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.3759e-05 2024-04-18T14:44:05.923 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:05.923 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:05.923 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-04-18T14:44:05.923 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:40.770298+0000", 2024-04-18T14:44:05.923 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.9048000000000001e-05 2024-04-18T14:44:05.923 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:05.923 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:05.923 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-04-18T14:44:05.923 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:40.770313+0000", 2024-04-18T14:44:05.923 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.4934e-05 2024-04-18T14:44:05.923 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:05.923 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:05.923 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-04-18T14:44:05.924 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:40.770695+0000", 2024-04-18T14:44:05.924 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00038176900000000001 2024-04-18T14:44:05.924 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:05.924 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:05.924 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_started", 2024-04-18T14:44:05.924 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:40.770719+0000", 2024-04-18T14:44:05.924 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.3992e-05 2024-04-18T14:44:05.924 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:05.924 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:05.924 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_committed", 2024-04-18T14:44:05.924 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:40.777426+0000", 2024-04-18T14:44:05.924 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0067069989999999999 2024-04-18T14:44:05.924 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:05.924 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:05.924 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-04-18T14:44:05.924 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:40.777475+0000", 2024-04-18T14:44:05.925 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.9713999999999999e-05 2024-04-18T14:44:05.925 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:44:05.925 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-04-18T14:44:05.925 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:44:05.925 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:05.925 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:05.925 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "MOSDECSubOpRead(3.8s3 41/30 ECSubRead(tid=37, to_read={3:1890b7c2:::smithi13430248-36:head=0,147456,0}, subchunks={3:1890b7c2:::smithi13430248-36:head=[0,1]}, attrs_to_read=))", 2024-04-18T14:44:05.925 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-04-18T14:43:40.770350+0000", 2024-04-18T14:44:05.925 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 25.126102134, 2024-04-18T14:44:05.925 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0047603380000000002, 2024-04-18T14:44:05.925 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-04-18T14:44:05.925 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "reached pg", 2024-04-18T14:44:05.925 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-04-18T14:44:05.925 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:05.925 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-04-18T14:44:05.926 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:40.770350+0000", 2024-04-18T14:44:05.926 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:44:05.926 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:05.926 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:05.926 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-04-18T14:44:05.926 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:40.770350+0000", 2024-04-18T14:44:05.926 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:44:05.926 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:05.926 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:05.926 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-04-18T14:44:05.926 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:40.770350+0000", 2024-04-18T14:44:05.926 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-04-18T14:44:05.926 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:05.926 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:05.926 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-04-18T14:44:05.927 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:40.770361+0000", 2024-04-18T14:44:05.927 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.1979e-05 2024-04-18T14:44:05.927 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:05.927 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:05.927 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-04-18T14:44:05.927 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:40.770384+0000", 2024-04-18T14:44:05.927 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.2487999999999999e-05 2024-04-18T14:44:05.927 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:05.927 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:05.927 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-04-18T14:44:05.927 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:40.770404+0000", 2024-04-18T14:44:05.927 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.9568e-05 2024-04-18T14:44:05.927 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:05.927 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:05.927 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-04-18T14:44:05.927 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:40.773174+0000", 2024-04-18T14:44:05.928 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00277013 2024-04-18T14:44:05.928 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:05.928 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:05.928 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-04-18T14:44:05.928 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:40.775111+0000", 2024-04-18T14:44:05.928 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.001936901 2024-04-18T14:44:05.928 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:44:05.928 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-04-18T14:44:05.928 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:44:05.928 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:05.928 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:05.928 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "MOSDECSubOpWrite(3.7s3 41/30 ECSubWrite(tid=51, reqid=client.4559.0:242, at_version=41'19, trim_to=0'0, roll_forward_to=41'17))", 2024-04-18T14:44:05.928 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-04-18T14:43:40.782356+0000", 2024-04-18T14:44:05.928 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 25.114096153999999, 2024-04-18T14:44:05.928 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0044232849999999999, 2024-04-18T14:44:05.928 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-04-18T14:44:05.929 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "reached pg", 2024-04-18T14:44:05.929 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-04-18T14:44:05.929 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:05.929 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-04-18T14:44:05.929 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:40.782356+0000", 2024-04-18T14:44:05.929 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:44:05.929 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:05.929 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:05.929 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-04-18T14:44:05.929 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:40.782356+0000", 2024-04-18T14:44:05.929 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:44:05.929 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:05.929 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:05.929 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-04-18T14:44:05.929 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:40.782355+0000", 2024-04-18T14:44:05.930 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999986 2024-04-18T14:44:05.930 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:05.930 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:05.930 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-04-18T14:44:05.930 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:40.783082+0000", 2024-04-18T14:44:05.930 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00072718800000000003 2024-04-18T14:44:05.930 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:05.930 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:05.930 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-04-18T14:44:05.930 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:40.783108+0000", 2024-04-18T14:44:05.930 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.5559e-05 2024-04-18T14:44:05.930 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:05.930 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:05.930 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-04-18T14:44:05.930 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:40.783126+0000", 2024-04-18T14:44:05.931 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.8689999999999999e-05 2024-04-18T14:44:05.931 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:05.931 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:05.931 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-04-18T14:44:05.931 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:40.783261+0000", 2024-04-18T14:44:05.931 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00013474799999999999 2024-04-18T14:44:05.931 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:05.931 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:05.931 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_started", 2024-04-18T14:44:05.931 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:40.783277+0000", 2024-04-18T14:44:05.931 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.5761999999999999e-05 2024-04-18T14:44:05.931 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:05.931 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:05.931 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_committed", 2024-04-18T14:44:05.931 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:40.786722+0000", 2024-04-18T14:44:05.932 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0034453280000000001 2024-04-18T14:44:05.932 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:05.932 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:05.932 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-04-18T14:44:05.932 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:40.786780+0000", 2024-04-18T14:44:05.932 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.7389999999999998e-05 2024-04-18T14:44:05.932 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:44:05.932 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-04-18T14:44:05.932 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:44:05.932 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:05.932 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:05.932 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "MOSDECSubOpWrite(3.es2 45/30 ECSubWrite(tid=21, reqid=client.4559.0:306, at_version=45'13, trim_to=0'0, roll_forward_to=44'11))", 2024-04-18T14:44:05.932 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-04-18T14:43:44.506726+0000", 2024-04-18T14:44:05.932 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 21.389726714999998, 2024-04-18T14:44:05.932 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0047354449999999996, 2024-04-18T14:44:05.933 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-04-18T14:44:05.933 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "reached pg", 2024-04-18T14:44:05.933 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-04-18T14:44:05.933 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:05.933 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-04-18T14:44:05.933 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:44.506726+0000", 2024-04-18T14:44:05.933 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:44:05.933 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:05.933 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:05.933 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-04-18T14:44:05.933 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:44.506726+0000", 2024-04-18T14:44:05.933 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:44:05.933 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:05.933 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:05.933 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-04-18T14:44:05.934 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:44.506725+0000", 2024-04-18T14:44:05.934 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-04-18T14:44:05.934 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:05.934 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:05.934 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-04-18T14:44:05.934 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:44.506952+0000", 2024-04-18T14:44:05.934 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00022749599999999999 2024-04-18T14:44:05.934 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:05.934 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:05.934 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-04-18T14:44:05.934 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:44.506971+0000", 2024-04-18T14:44:05.934 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.8549000000000001e-05 2024-04-18T14:44:05.934 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:05.934 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:05.934 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-04-18T14:44:05.934 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:44.506983+0000", 2024-04-18T14:44:05.935 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.1579999999999999e-05 2024-04-18T14:44:05.935 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:05.935 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:05.935 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-04-18T14:44:05.935 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:44.507106+0000", 2024-04-18T14:44:05.935 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00012304800000000001 2024-04-18T14:44:05.935 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:05.935 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:05.935 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_started", 2024-04-18T14:44:05.935 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:44.507115+0000", 2024-04-18T14:44:05.935 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.7880000000000001e-06 2024-04-18T14:44:05.935 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:05.935 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:05.935 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_committed", 2024-04-18T14:44:05.935 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:44.511433+0000", 2024-04-18T14:44:05.936 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0043175239999999997 2024-04-18T14:44:05.936 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:05.936 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:05.936 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-04-18T14:44:05.936 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:44.511461+0000", 2024-04-18T14:44:05.936 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.8215999999999999e-05 2024-04-18T14:44:05.936 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:44:05.936 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-04-18T14:44:05.936 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:44:05.936 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:05.936 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:05.936 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "MOSDECSubOpWrite(3.7s3 50/30 ECSubWrite(tid=84, reqid=osd.14.0:81, at_version=0'0, trim_to=0'0, roll_forward_to=50'31))", 2024-04-18T14:44:05.936 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-04-18T14:43:49.411295+0000", 2024-04-18T14:44:05.936 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 16.485157214000001, 2024-04-18T14:44:05.936 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0051775679999999996, 2024-04-18T14:44:05.937 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-04-18T14:44:05.937 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "reached pg", 2024-04-18T14:44:05.937 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-04-18T14:44:05.937 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:05.937 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-04-18T14:44:05.937 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:49.411295+0000", 2024-04-18T14:44:05.937 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:44:05.937 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:05.937 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:05.937 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-04-18T14:44:05.937 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:49.411295+0000", 2024-04-18T14:44:05.937 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:44:05.937 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:05.937 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:05.937 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-04-18T14:44:05.938 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:49.411294+0000", 2024-04-18T14:44:05.938 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-04-18T14:44:05.938 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:05.938 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:05.938 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-04-18T14:44:05.938 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:49.411309+0000", 2024-04-18T14:44:05.938 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.5058000000000001e-05 2024-04-18T14:44:05.938 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:05.938 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:05.938 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-04-18T14:44:05.938 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:49.411322+0000", 2024-04-18T14:44:05.938 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.2208999999999999e-05 2024-04-18T14:44:05.938 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:05.938 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:05.938 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-04-18T14:44:05.939 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:49.411329+0000", 2024-04-18T14:44:05.939 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.3139999999999998e-06 2024-04-18T14:44:05.939 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:05.939 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:05.939 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-04-18T14:44:05.939 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:49.411380+0000", 2024-04-18T14:44:05.939 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.0639000000000001e-05 2024-04-18T14:44:05.939 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:05.939 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:05.939 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_started", 2024-04-18T14:44:05.939 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:49.411390+0000", 2024-04-18T14:44:05.939 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.0584999999999999e-05 2024-04-18T14:44:05.939 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:05.939 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:05.939 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_committed", 2024-04-18T14:44:05.940 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:49.416441+0000", 2024-04-18T14:44:05.940 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0050509810000000004 2024-04-18T14:44:05.940 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:05.940 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:05.940 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-04-18T14:44:05.940 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:49.416473+0000", 2024-04-18T14:44:05.940 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.167e-05 2024-04-18T14:44:05.940 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:44:05.940 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-04-18T14:44:05.940 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:44:05.940 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:05.940 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:05.940 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "MOSDECSubOpWrite(3.7s3 51/30 ECSubWrite(tid=96, reqid=client.4559.0:375, at_version=51'33, trim_to=0'0, roll_forward_to=50'31))", 2024-04-18T14:44:05.940 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-04-18T14:43:50.400134+0000", 2024-04-18T14:44:05.940 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 15.496318841000001, 2024-04-18T14:44:05.940 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0043414669999999999, 2024-04-18T14:44:05.941 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-04-18T14:44:05.941 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "reached pg", 2024-04-18T14:44:05.941 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-04-18T14:44:05.941 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:05.941 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-04-18T14:44:05.941 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:50.400134+0000", 2024-04-18T14:44:05.941 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:44:05.941 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:05.941 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:05.941 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-04-18T14:44:05.941 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:50.400134+0000", 2024-04-18T14:44:05.941 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:44:05.941 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:05.941 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:05.941 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-04-18T14:44:05.941 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:50.400133+0000", 2024-04-18T14:44:05.942 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-04-18T14:44:05.942 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:05.942 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:05.942 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-04-18T14:44:05.942 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:50.400431+0000", 2024-04-18T14:44:05.942 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00029784499999999998 2024-04-18T14:44:05.942 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:05.942 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:05.942 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-04-18T14:44:05.942 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:50.400461+0000", 2024-04-18T14:44:05.942 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.0602000000000003e-05 2024-04-18T14:44:05.942 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:05.942 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:05.942 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-04-18T14:44:05.942 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:50.400485+0000", 2024-04-18T14:44:05.943 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.3686e-05 2024-04-18T14:44:05.943 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:05.943 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:05.943 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-04-18T14:44:05.943 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:50.400549+0000", 2024-04-18T14:44:05.943 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.4060999999999995e-05 2024-04-18T14:44:05.943 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:05.943 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:05.943 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_started", 2024-04-18T14:44:05.943 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:50.400560+0000", 2024-04-18T14:44:05.943 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.1243000000000001e-05 2024-04-18T14:44:05.943 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:05.943 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:05.943 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_committed", 2024-04-18T14:44:05.943 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:50.404442+0000", 2024-04-18T14:44:05.943 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0038819610000000002 2024-04-18T14:44:05.944 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:05.944 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:05.944 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-04-18T14:44:05.944 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:50.404475+0000", 2024-04-18T14:44:05.944 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.2774000000000002e-05 2024-04-18T14:44:05.944 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:44:05.944 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-04-18T14:44:05.944 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:44:05.944 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:05.944 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:05.944 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "MOSDECSubOpWrite(3.7s3 51/30 ECSubWrite(tid=99, reqid=client.4559.0:377, at_version=51'35, trim_to=0'0, roll_forward_to=51'34))", 2024-04-18T14:44:05.944 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-04-18T14:43:50.411743+0000", 2024-04-18T14:44:05.944 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 15.484709275, 2024-04-18T14:44:05.944 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0044327189999999999, 2024-04-18T14:44:05.944 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-04-18T14:44:05.945 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "reached pg", 2024-04-18T14:44:05.945 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-04-18T14:44:05.945 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:05.945 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-04-18T14:44:05.945 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:50.411743+0000", 2024-04-18T14:44:05.945 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:44:05.945 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:05.945 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:05.945 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-04-18T14:44:05.945 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:50.411743+0000", 2024-04-18T14:44:05.945 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:44:05.945 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:05.945 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:05.945 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-04-18T14:44:05.945 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:50.411743+0000", 2024-04-18T14:44:05.946 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-04-18T14:44:05.946 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:05.946 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:05.946 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-04-18T14:44:05.946 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:50.411873+0000", 2024-04-18T14:44:05.946 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00013039900000000001 2024-04-18T14:44:05.946 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:05.946 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:05.946 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-04-18T14:44:05.946 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:50.411882+0000", 2024-04-18T14:44:05.946 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.1859999999999998e-06 2024-04-18T14:44:05.946 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:05.946 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:05.946 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-04-18T14:44:05.946 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:50.411887+0000", 2024-04-18T14:44:05.947 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.271e-06 2024-04-18T14:44:05.947 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:05.947 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:05.947 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-04-18T14:44:05.947 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:50.411914+0000", 2024-04-18T14:44:05.947 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.7049000000000001e-05 2024-04-18T14:44:05.947 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:05.947 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:05.947 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_started", 2024-04-18T14:44:05.947 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:50.411920+0000", 2024-04-18T14:44:05.947 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.2859999999999999e-06 2024-04-18T14:44:05.947 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:05.947 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:05.947 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_committed", 2024-04-18T14:44:05.947 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:50.416146+0000", 2024-04-18T14:44:05.947 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0042262250000000001 2024-04-18T14:44:05.948 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:05.948 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:05.948 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-04-18T14:44:05.948 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:50.416176+0000", 2024-04-18T14:44:05.948 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.9819e-05 2024-04-18T14:44:05.948 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:44:05.948 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-04-18T14:44:05.948 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:44:05.948 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:05.948 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:05.948 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "MOSDECSubOpWrite(3.es2 57/30 ECSubWrite(tid=46, reqid=client.4559.0:491, at_version=57'34, trim_to=0'0, roll_forward_to=54'32))", 2024-04-18T14:44:05.948 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-04-18T14:43:56.455784+0000", 2024-04-18T14:44:05.948 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 9.440668337, 2024-04-18T14:44:05.948 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.006409873, 2024-04-18T14:44:05.949 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-04-18T14:44:05.949 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "reached pg", 2024-04-18T14:44:05.949 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-04-18T14:44:05.949 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:05.949 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-04-18T14:44:05.949 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:56.455784+0000", 2024-04-18T14:44:05.949 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:44:05.949 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:05.949 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:05.949 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-04-18T14:44:05.949 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:56.455784+0000", 2024-04-18T14:44:05.949 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:44:05.949 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:05.949 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:05.949 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-04-18T14:44:05.949 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:56.455783+0000", 2024-04-18T14:44:05.950 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-04-18T14:44:05.950 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:05.950 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:05.950 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-04-18T14:44:05.950 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:56.455870+0000", 2024-04-18T14:44:05.950 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.6174000000000005e-05 2024-04-18T14:44:05.950 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:05.950 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:05.950 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-04-18T14:44:05.950 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:56.455916+0000", 2024-04-18T14:44:05.950 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.6573000000000003e-05 2024-04-18T14:44:05.950 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:05.950 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:05.950 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-04-18T14:44:05.950 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:56.455942+0000", 2024-04-18T14:44:05.951 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.5952000000000002e-05 2024-04-18T14:44:05.951 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:05.951 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:05.951 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-04-18T14:44:05.951 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:56.456148+0000", 2024-04-18T14:44:05.951 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000206178 2024-04-18T14:44:05.951 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:05.951 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:05.951 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_started", 2024-04-18T14:44:05.951 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:56.456175+0000", 2024-04-18T14:44:05.951 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.7073e-05 2024-04-18T14:44:05.951 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:05.951 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:05.951 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_committed", 2024-04-18T14:44:05.951 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:56.462106+0000", 2024-04-18T14:44:05.951 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0059310120000000003 2024-04-18T14:44:05.952 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:05.952 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:05.952 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-04-18T14:44:05.952 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:56.462194+0000", 2024-04-18T14:44:05.952 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.7508000000000003e-05 2024-04-18T14:44:05.952 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:44:05.952 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-04-18T14:44:05.952 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:44:05.952 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:05.952 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:05.952 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "MOSDECSubOpWrite(3.9s3 57/30 ECSubWrite(tid=85, reqid=client.4559.0:487, at_version=57'64, trim_to=0'0, roll_forward_to=56'61))", 2024-04-18T14:44:05.952 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-04-18T14:43:56.457929+0000", 2024-04-18T14:44:05.952 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 9.4385236460000002, 2024-04-18T14:44:05.952 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.005696034, 2024-04-18T14:44:05.952 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-04-18T14:44:05.953 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "reached pg", 2024-04-18T14:44:05.953 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-04-18T14:44:05.953 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:05.953 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-04-18T14:44:05.953 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:56.457929+0000", 2024-04-18T14:44:05.953 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:44:05.953 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:05.953 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:05.953 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-04-18T14:44:05.953 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:56.457929+0000", 2024-04-18T14:44:05.953 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:44:05.953 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:05.953 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:05.953 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-04-18T14:44:05.954 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:56.457926+0000", 2024-04-18T14:44:05.954 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999976 2024-04-18T14:44:05.954 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:05.954 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:05.954 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-04-18T14:44:05.954 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:56.458225+0000", 2024-04-18T14:44:05.954 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00029813499999999999 2024-04-18T14:44:05.954 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:05.954 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:05.954 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-04-18T14:44:05.954 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:56.458267+0000", 2024-04-18T14:44:05.954 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.1956000000000003e-05 2024-04-18T14:44:05.955 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:05.955 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:05.955 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-04-18T14:44:05.955 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:56.458297+0000", 2024-04-18T14:44:05.955 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.0842e-05 2024-04-18T14:44:05.955 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:05.955 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:05.955 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-04-18T14:44:05.955 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:56.458407+0000", 2024-04-18T14:44:05.955 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00010976000000000001 2024-04-18T14:44:05.955 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:05.955 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:05.955 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_started", 2024-04-18T14:44:05.955 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:56.458422+0000", 2024-04-18T14:44:05.955 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.5238e-05 2024-04-18T14:44:05.955 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:05.956 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:05.956 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_committed", 2024-04-18T14:44:05.956 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:56.463586+0000", 2024-04-18T14:44:05.956 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0051639169999999996 2024-04-18T14:44:05.956 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:05.956 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:05.956 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-04-18T14:44:05.956 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:56.463625+0000", 2024-04-18T14:44:05.956 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.8510000000000002e-05 2024-04-18T14:44:05.956 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:44:05.956 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-04-18T14:44:05.956 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:44:05.956 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:05.956 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:05.956 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "MOSDECSubOpWrite(3.9s3 57/30 ECSubWrite(tid=91, reqid=client.4559.0:503, at_version=57'68, trim_to=0'0, roll_forward_to=57'66))", 2024-04-18T14:44:05.957 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-04-18T14:43:56.549067+0000", 2024-04-18T14:44:05.957 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 9.3473848949999994, 2024-04-18T14:44:05.957 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0057396219999999998, 2024-04-18T14:44:05.957 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-04-18T14:44:05.957 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "reached pg", 2024-04-18T14:44:05.957 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-04-18T14:44:05.957 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:05.957 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-04-18T14:44:05.957 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:56.549067+0000", 2024-04-18T14:44:05.957 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:44:05.957 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:05.957 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:05.957 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-04-18T14:44:05.957 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:56.549067+0000", 2024-04-18T14:44:05.957 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:44:05.957 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:05.958 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:05.958 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-04-18T14:44:05.958 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:56.549067+0000", 2024-04-18T14:44:05.958 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-04-18T14:44:05.958 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:05.958 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:05.958 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-04-18T14:44:05.958 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:56.549087+0000", 2024-04-18T14:44:05.958 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.0492e-05 2024-04-18T14:44:05.958 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:05.958 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:05.958 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-04-18T14:44:05.958 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:56.549103+0000", 2024-04-18T14:44:05.958 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.5506e-05 2024-04-18T14:44:05.959 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:05.959 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:05.959 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-04-18T14:44:05.959 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:56.549113+0000", 2024-04-18T14:44:05.959 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.0019e-05 2024-04-18T14:44:05.959 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:05.959 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:05.959 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-04-18T14:44:05.959 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:56.549184+0000", 2024-04-18T14:44:05.959 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.1268999999999998e-05 2024-04-18T14:44:05.959 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:05.959 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:05.959 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_started", 2024-04-18T14:44:05.959 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:56.549218+0000", 2024-04-18T14:44:05.959 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.3753e-05 2024-04-18T14:44:05.960 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:05.960 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:05.960 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_committed", 2024-04-18T14:44:05.960 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:56.554775+0000", 2024-04-18T14:44:05.960 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0055570020000000001 2024-04-18T14:44:05.960 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:05.960 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:05.960 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-04-18T14:44:05.960 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:56.554807+0000", 2024-04-18T14:44:05.960 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.2447999999999998e-05 2024-04-18T14:44:05.960 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:44:05.960 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-04-18T14:44:05.960 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:44:05.960 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:05.960 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:05.961 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "MOSDECSubOpWrite(3.9s3 57/30 ECSubWrite(tid=92, reqid=client.4559.0:504, at_version=57'69, trim_to=0'0, roll_forward_to=57'66))", 2024-04-18T14:44:05.961 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-04-18T14:43:56.550419+0000", 2024-04-18T14:44:05.961 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 9.3460333630000001, 2024-04-18T14:44:05.961 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0044101920000000003, 2024-04-18T14:44:05.961 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-04-18T14:44:05.961 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "reached pg", 2024-04-18T14:44:05.961 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-04-18T14:44:05.961 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:05.961 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-04-18T14:44:05.961 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:56.550419+0000", 2024-04-18T14:44:05.961 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:44:05.961 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:05.961 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:05.961 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-04-18T14:44:05.961 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:56.550419+0000", 2024-04-18T14:44:05.962 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:44:05.962 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:05.962 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:05.962 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-04-18T14:44:05.962 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:56.550418+0000", 2024-04-18T14:44:05.962 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-04-18T14:44:05.962 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:05.962 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:05.962 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-04-18T14:44:05.962 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:56.550439+0000", 2024-04-18T14:44:05.962 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.086e-05 2024-04-18T14:44:05.962 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:05.962 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:05.963 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-04-18T14:44:05.963 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:56.550457+0000", 2024-04-18T14:44:05.963 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.8150000000000001e-05 2024-04-18T14:44:05.963 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:05.963 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:05.963 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-04-18T14:44:05.963 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:56.550466+0000", 2024-04-18T14:44:05.963 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.0510000000000002e-06 2024-04-18T14:44:05.963 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:05.963 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:05.963 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-04-18T14:44:05.963 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:56.550523+0000", 2024-04-18T14:44:05.963 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.7272000000000003e-05 2024-04-18T14:44:05.963 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:05.963 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:05.963 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_started", 2024-04-18T14:44:05.964 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:56.550536+0000", 2024-04-18T14:44:05.964 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.2203e-05 2024-04-18T14:44:05.964 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:05.964 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:05.964 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_committed", 2024-04-18T14:44:05.964 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:56.554813+0000", 2024-04-18T14:44:05.964 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.004277505 2024-04-18T14:44:05.964 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:05.964 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:05.964 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-04-18T14:44:05.964 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:56.554829+0000", 2024-04-18T14:44:05.964 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.6028999999999998e-05 2024-04-18T14:44:05.964 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:44:05.964 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-04-18T14:44:05.965 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:44:05.965 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:05.965 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:05.965 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "MOSDECSubOpWrite(3.9s3 57/30 ECSubWrite(tid=95, reqid=client.4559.0:507, at_version=57'71, trim_to=0'0, roll_forward_to=57'69))", 2024-04-18T14:44:05.965 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-04-18T14:43:56.586290+0000", 2024-04-18T14:44:05.965 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 9.31016215, 2024-04-18T14:44:05.965 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0074930279999999997, 2024-04-18T14:44:05.965 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-04-18T14:44:05.965 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "reached pg", 2024-04-18T14:44:05.965 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-04-18T14:44:05.965 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:05.965 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-04-18T14:44:05.965 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:56.586290+0000", 2024-04-18T14:44:05.965 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:44:05.965 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:05.966 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:05.966 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-04-18T14:44:05.966 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:56.586290+0000", 2024-04-18T14:44:05.966 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:44:05.966 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:05.966 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:05.966 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-04-18T14:44:05.966 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:56.586290+0000", 2024-04-18T14:44:05.966 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-04-18T14:44:05.966 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:05.966 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:05.966 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-04-18T14:44:05.966 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:56.586775+0000", 2024-04-18T14:44:05.966 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00048549599999999997 2024-04-18T14:44:05.966 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:05.967 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:05.967 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-04-18T14:44:05.967 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:56.586811+0000", 2024-04-18T14:44:05.967 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.5896000000000003e-05 2024-04-18T14:44:05.967 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:05.967 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:05.967 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-04-18T14:44:05.967 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:56.586821+0000", 2024-04-18T14:44:05.967 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.0137e-05 2024-04-18T14:44:05.967 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:05.967 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:05.967 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-04-18T14:44:05.967 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:56.586936+0000", 2024-04-18T14:44:05.967 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000114364 2024-04-18T14:44:05.967 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:05.967 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:05.968 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_started", 2024-04-18T14:44:05.968 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:56.586949+0000", 2024-04-18T14:44:05.968 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.3230999999999999e-05 2024-04-18T14:44:05.968 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:05.968 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:05.968 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_committed", 2024-04-18T14:44:05.968 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:56.593713+0000", 2024-04-18T14:44:05.968 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0067640729999999998 2024-04-18T14:44:05.968 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:05.968 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:05.968 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-04-18T14:44:05.968 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:56.593783+0000", 2024-04-18T14:44:05.968 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.0392e-05 2024-04-18T14:44:05.968 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:44:05.968 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-04-18T14:44:05.969 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:44:05.969 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:05.969 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:05.969 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "MOSDECSubOpWrite(3.es2 57/30 ECSubWrite(tid=48, reqid=client.4559.0:514, at_version=57'36, trim_to=0'0, roll_forward_to=57'34))", 2024-04-18T14:44:05.969 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-04-18T14:43:56.587880+0000", 2024-04-18T14:44:05.969 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 9.3085719119999997, 2024-04-18T14:44:05.969 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0090015359999999992, 2024-04-18T14:44:05.969 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-04-18T14:44:05.969 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "reached pg", 2024-04-18T14:44:05.969 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-04-18T14:44:05.969 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:05.969 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-04-18T14:44:05.969 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:56.587880+0000", 2024-04-18T14:44:05.969 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:44:05.970 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:05.970 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:05.970 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-04-18T14:44:05.970 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:56.587880+0000", 2024-04-18T14:44:05.970 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:44:05.970 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:05.970 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:05.970 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-04-18T14:44:05.970 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:56.587879+0000", 2024-04-18T14:44:05.970 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-04-18T14:44:05.970 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:05.970 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:05.970 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-04-18T14:44:05.970 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:56.588227+0000", 2024-04-18T14:44:05.971 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00034732099999999999 2024-04-18T14:44:05.971 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:05.971 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:05.971 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-04-18T14:44:05.971 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:56.588240+0000", 2024-04-18T14:44:05.971 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.325e-05 2024-04-18T14:44:05.971 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:05.971 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:05.971 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-04-18T14:44:05.971 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:56.588250+0000", 2024-04-18T14:44:05.971 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.7629999999999995e-06 2024-04-18T14:44:05.971 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:05.971 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:05.971 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-04-18T14:44:05.971 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:56.588308+0000", 2024-04-18T14:44:05.971 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.8607000000000003e-05 2024-04-18T14:44:05.972 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:05.972 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:05.972 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_started", 2024-04-18T14:44:05.972 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:56.588320+0000", 2024-04-18T14:44:05.972 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.1106e-05 2024-04-18T14:44:05.972 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:05.972 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:05.972 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_committed", 2024-04-18T14:44:05.972 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:56.596850+0000", 2024-04-18T14:44:05.972 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0085302520000000003 2024-04-18T14:44:05.972 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:05.972 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:05.972 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-04-18T14:44:05.972 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:56.596882+0000", 2024-04-18T14:44:05.972 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.2221999999999997e-05 2024-04-18T14:44:05.972 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:44:05.973 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-04-18T14:44:05.973 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:44:05.973 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:05.973 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:05.973 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "MOSDECSubOpWrite(3.8s3 66/30 ECSubWrite(tid=123, reqid=client.4559.0:626, at_version=66'98, trim_to=0'0, roll_forward_to=65'96))", 2024-04-18T14:44:05.973 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-04-18T14:44:05.404665+0000", 2024-04-18T14:44:05.973 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 0.49178745800000001, 2024-04-18T14:44:05.973 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0048743399999999996, 2024-04-18T14:44:05.973 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-04-18T14:44:05.973 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "reached pg", 2024-04-18T14:44:05.973 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-04-18T14:44:05.973 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:05.973 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-04-18T14:44:05.973 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:05.404665+0000", 2024-04-18T14:44:05.973 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:44:05.974 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:05.974 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:05.974 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-04-18T14:44:05.974 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:05.404665+0000", 2024-04-18T14:44:05.974 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:44:05.974 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:05.974 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:05.974 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-04-18T14:44:05.974 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:05.404665+0000", 2024-04-18T14:44:05.974 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-04-18T14:44:05.974 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:05.974 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:05.974 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-04-18T14:44:05.975 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:05.405059+0000", 2024-04-18T14:44:05.975 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00039412699999999998 2024-04-18T14:44:05.975 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:05.975 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:05.975 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-04-18T14:44:05.975 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:05.405079+0000", 2024-04-18T14:44:05.975 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.0420000000000001e-05 2024-04-18T14:44:05.975 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:05.975 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:05.975 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-04-18T14:44:05.975 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:05.405097+0000", 2024-04-18T14:44:05.975 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.8366e-05 2024-04-18T14:44:05.975 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:05.975 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:05.975 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-04-18T14:44:05.976 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:05.405178+0000", 2024-04-18T14:44:05.976 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.0926000000000004e-05 2024-04-18T14:44:05.976 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:05.976 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:05.976 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_started", 2024-04-18T14:44:05.976 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:05.405209+0000", 2024-04-18T14:44:05.976 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.1037000000000001e-05 2024-04-18T14:44:05.976 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:05.976 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:05.976 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_committed", 2024-04-18T14:44:05.976 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:05.409502+0000", 2024-04-18T14:44:05.976 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0042927970000000001 2024-04-18T14:44:05.976 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:05.976 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:05.976 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-04-18T14:44:05.976 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:05.409539+0000", 2024-04-18T14:44:05.977 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.7007e-05 2024-04-18T14:44:05.977 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:44:05.977 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-04-18T14:44:05.977 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:44:05.977 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:44:05.977 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-04-18T14:44:05.977 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-04-18T14:44:05.979 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.8.asok dump_ops_in_flight 2024-04-18T14:44:05.979 INFO:tasks.ceph.osd.12.smithi086.stderr:2024-04-18T14:44:05.978+0000 7f6904968640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 12 (PID: 24960) UID: 0 2024-04-18T14:44:06.080 INFO:tasks.ceph.osd.1.smithi096.stderr:2024-04-18T14:44:06.077+0000 7f56a7a98640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 24887) UID: 0 2024-04-18T14:44:06.148 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-04-18T14:44:06.148 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [], 2024-04-18T14:44:06.148 INFO:teuthology.orchestra.run.smithi086.stdout: "num_ops": 0 2024-04-18T14:44:06.148 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-04-18T14:44:06.162 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.8.asok dump_blocked_ops 2024-04-18T14:44:06.181 INFO:tasks.ceph.osd.15.smithi134.stderr:2024-04-18T14:44:06.184+0000 7f08e6a51640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 15 (PID: 25218) UID: 0 2024-04-18T14:44:06.282 INFO:tasks.ceph.osd.8.smithi086.stderr:2024-04-18T14:44:06.278+0000 7f29f7b9d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 8 (PID: 24958) UID: 0 2024-04-18T14:44:06.282 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-04-18T14:44:06.282 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [], 2024-04-18T14:44:06.282 INFO:teuthology.orchestra.run.smithi086.stdout: "complaint_time": 30, 2024-04-18T14:44:06.282 INFO:teuthology.orchestra.run.smithi086.stdout: "num_blocked_ops": 0 2024-04-18T14:44:06.283 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-04-18T14:44:06.296 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.8.asok dump_historic_ops 2024-04-18T14:44:06.378 INFO:teuthology.orchestra.run.smithi086.stderr:reweighted osd.14 to 1 (10000) 2024-04-18T14:44:06.379 INFO:teuthology.orchestra.run.smithi086.stderr:nodeep-scrub is set 2024-04-18T14:44:06.380 INFO:tasks.rados.rados.0.smithi134.stdout:257: done (2 left) 2024-04-18T14:44:06.381 INFO:tasks.rados.rados.0.smithi134.stdout:259: done (1 left) 2024-04-18T14:44:06.381 INFO:tasks.rados.rados.0.smithi134.stdout:260: done (0 left) 2024-04-18T14:44:06.381 INFO:tasks.rados.rados.0.smithi134.stdout:append oid 17 current snap is 23 2024-04-18T14:44:06.381 INFO:tasks.rados.rados.0.smithi134.stdout:261: seq_num 108 ranges {622592=655360,1277952=606208,1884160=475136,2359296=81920} 2024-04-18T14:44:06.382 INFO:tasks.ceph.osd.3.smithi134.stderr:2024-04-18T14:44:06.384+0000 7fe7a4443640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25211) UID: 0 2024-04-18T14:44:06.392 INFO:tasks.rados.rados.0.smithi134.stdout:261: writing smithi13430248-17 from 622592 to 1277952 tid 1 2024-04-18T14:44:06.398 INFO:tasks.rados.rados.0.smithi134.stdout:261: writing smithi13430248-17 from 1277952 to 1884160 tid 2 2024-04-18T14:44:06.402 INFO:tasks.rados.rados.0.smithi134.stdout:261: writing smithi13430248-17 from 1884160 to 2359296 tid 3 2024-04-18T14:44:06.403 INFO:tasks.rados.rados.0.smithi134.stdout:261: writing smithi13430248-17 from 2359296 to 2441216 tid 4 2024-04-18T14:44:06.403 INFO:tasks.rados.rados.0.smithi134.stdout:262: delete oid 7 current snap is 23 2024-04-18T14:44:06.404 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 15 1 2024-04-18T14:44:06.407 INFO:tasks.rados.rados.0.smithi134.stdout:261: finishing write tid 1 to smithi13430248-17 2024-04-18T14:44:06.408 INFO:tasks.rados.rados.0.smithi134.stdout:261: finishing write tid 2 to smithi13430248-17 2024-04-18T14:44:06.410 INFO:tasks.rados.rados.0.smithi134.stdout:261: finishing write tid 3 to smithi13430248-17 2024-04-18T14:44:06.413 INFO:tasks.rados.rados.0.smithi134.stdout:261: finishing write tid 4 to smithi13430248-17 2024-04-18T14:44:06.413 INFO:tasks.rados.rados.0.smithi134.stdout:261: finishing write tid 5 to smithi13430248-17 2024-04-18T14:44:06.415 INFO:tasks.rados.rados.0.smithi134.stdout:261: finishing write tid 6 to smithi13430248-17 2024-04-18T14:44:06.415 INFO:tasks.rados.rados.0.smithi134.stdout:261: oid 17 updating version 0 to 109 2024-04-18T14:44:06.415 INFO:tasks.rados.rados.0.smithi134.stdout:261: oid 17 version 109 is already newer than 108 2024-04-18T14:44:06.416 INFO:tasks.rados.rados.0.smithi134.stdout:261: oid 17 updating version 109 to 110 2024-04-18T14:44:06.416 INFO:tasks.rados.rados.0.smithi134.stdout:261: oid 17 updating version 110 to 111 2024-04-18T14:44:06.416 INFO:tasks.rados.rados.0.smithi134.stdout:261: oid 17 version 111 is already newer than 107 2024-04-18T14:44:06.416 INFO:tasks.rados.rados.0.smithi134.stdout:update_object_version oid 17 v 111 (ObjNum 108 snap 23 seq_num 108) dirty exists 2024-04-18T14:44:06.416 INFO:tasks.rados.rados.0.smithi134.stdout:261: left oid 17 (ObjNum 108 snap 23 seq_num 108) 2024-04-18T14:44:06.416 INFO:tasks.rados.rados.0.smithi134.stdout:261: done (1 left) 2024-04-18T14:44:06.416 INFO:tasks.rados.rados.0.smithi134.stdout:262: done (0 left) 2024-04-18T14:44:06.416 INFO:tasks.rados.rados.0.smithi134.stdout:append oid 32 current snap is 23 2024-04-18T14:44:06.416 INFO:tasks.rados.rados.0.smithi134.stdout:263: seq_num 110 ranges {0=688128,688128=507904,1196032=655360} 2024-04-18T14:44:06.424 INFO:tasks.rados.rados.0.smithi134.stdout:263: writing smithi13430248-32 from 0 to 688128 tid 1 2024-04-18T14:44:06.429 INFO:tasks.rados.rados.0.smithi134.stdout:263: writing smithi13430248-32 from 688128 to 1196032 tid 2 2024-04-18T14:44:06.436 INFO:tasks.rados.rados.0.smithi134.stdout:263: writing smithi13430248-32 from 1196032 to 1851392 tid 3 2024-04-18T14:44:06.436 INFO:tasks.rados.rados.0.smithi134.stdout:append oid 13 current snap is 23 2024-04-18T14:44:06.436 INFO:tasks.rados.rados.0.smithi134.stdout:264: seq_num 111 ranges {753664=704512,1458176=655360,2113536=507904} 2024-04-18T14:44:06.450 INFO:tasks.rados.rados.0.smithi134.stdout:264: writing smithi13430248-13 from 753664 to 1458176 tid 1 2024-04-18T14:44:06.456 INFO:tasks.rados.rados.0.smithi134.stdout:264: writing smithi13430248-13 from 1458176 to 2113536 tid 2 2024-04-18T14:44:06.462 INFO:tasks.rados.rados.0.smithi134.stdout:264: writing smithi13430248-13 from 2113536 to 2621440 tid 3 2024-04-18T14:44:06.462 INFO:tasks.rados.rados.0.smithi134.stdout:265: delete oid 39 current snap is 23 2024-04-18T14:44:06.462 INFO:tasks.rados.rados.0.smithi134.stdout:263: finishing write tid 1 to smithi13430248-32 2024-04-18T14:44:06.462 INFO:tasks.rados.rados.0.smithi134.stdout:263: finishing write tid 2 to smithi13430248-32 2024-04-18T14:44:06.462 INFO:tasks.rados.rados.0.smithi134.stdout:263: finishing write tid 3 to smithi13430248-32 2024-04-18T14:44:06.462 INFO:tasks.rados.rados.0.smithi134.stdout:263: finishing write tid 4 to smithi13430248-32 2024-04-18T14:44:06.462 INFO:tasks.rados.rados.0.smithi134.stdout:263: finishing write tid 5 to smithi13430248-32 2024-04-18T14:44:06.462 INFO:tasks.rados.rados.0.smithi134.stdout:263: oid 32 updating version 0 to 105 2024-04-18T14:44:06.462 INFO:tasks.rados.rados.0.smithi134.stdout:263: oid 32 version 105 is already newer than 103 2024-04-18T14:44:06.462 INFO:tasks.rados.rados.0.smithi134.stdout:263: oid 32 version 105 is already newer than 104 2024-04-18T14:44:06.462 INFO:tasks.rados.rados.0.smithi134.stdout:263: oid 32 version 105 is already newer than 102 2024-04-18T14:44:06.462 INFO:tasks.rados.rados.0.smithi134.stdout:update_object_version oid 32 v 105 (ObjNum 110 snap 23 seq_num 110) dirty exists 2024-04-18T14:44:06.463 INFO:tasks.rados.rados.0.smithi134.stdout:263: left oid 32 (ObjNum 110 snap 23 seq_num 110) 2024-04-18T14:44:06.468 INFO:tasks.rados.rados.0.smithi134.stdout:264: finishing write tid 1 to smithi13430248-13 2024-04-18T14:44:06.469 INFO:tasks.rados.rados.0.smithi134.stdout:264: finishing write tid 2 to smithi13430248-13 2024-04-18T14:44:06.470 INFO:tasks.rados.rados.0.smithi134.stdout:263: done (2 left) 2024-04-18T14:44:06.471 INFO:tasks.rados.rados.0.smithi134.stdout:265: done (1 left) 2024-04-18T14:44:06.471 INFO:tasks.rados.rados.0.smithi134.stdout:266: read oid 8 snap -1 2024-04-18T14:44:06.471 INFO:tasks.rados.rados.0.smithi134.stdout:266: expect (ObjNum 37 snap 0 seq_num 37) 2024-04-18T14:44:06.471 INFO:tasks.rados.rados.0.smithi134.stdout:267: snap_remove snap 6 2024-04-18T14:44:06.483 INFO:tasks.ceph.osd.6.smithi119.stderr:2024-04-18T14:44:06.486+0000 7fb7cb8bd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 24896) UID: 0 2024-04-18T14:44:06.486 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-04-18T14:44:06.486 INFO:teuthology.orchestra.run.smithi086.stdout: "size": 20, 2024-04-18T14:44:06.486 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 600, 2024-04-18T14:44:06.486 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [ 2024-04-18T14:44:06.486 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:06.486 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "MOSDECSubOpWrite(3.as4 36/30 ECSubWrite(tid=19, reqid=client.4559.0:179, at_version=36'13, trim_to=0'0, roll_forward_to=35'10))", 2024-04-18T14:44:06.486 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-04-18T14:43:35.744028+0000", 2024-04-18T14:44:06.486 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 30.742582454000001, 2024-04-18T14:44:06.486 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0035996689999999998, 2024-04-18T14:44:06.487 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-04-18T14:44:06.487 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "reached pg", 2024-04-18T14:44:06.487 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-04-18T14:44:06.487 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:06.487 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-04-18T14:44:06.487 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:35.744028+0000", 2024-04-18T14:44:06.487 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:44:06.487 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:06.487 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:06.487 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-04-18T14:44:06.487 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:35.744028+0000", 2024-04-18T14:44:06.487 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:44:06.487 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:06.487 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:06.487 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-04-18T14:44:06.488 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:35.744027+0000", 2024-04-18T14:44:06.488 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999986 2024-04-18T14:44:06.488 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:06.488 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:06.488 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-04-18T14:44:06.488 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:35.744176+0000", 2024-04-18T14:44:06.488 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00014954899999999999 2024-04-18T14:44:06.488 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:06.488 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:06.488 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-04-18T14:44:06.489 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:35.744204+0000", 2024-04-18T14:44:06.489 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.7682999999999999e-05 2024-04-18T14:44:06.489 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:06.489 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:06.489 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-04-18T14:44:06.489 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:35.744218+0000", 2024-04-18T14:44:06.489 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.4602e-05 2024-04-18T14:44:06.489 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:06.489 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:06.489 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-04-18T14:44:06.490 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:35.744310+0000", 2024-04-18T14:44:06.490 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.1846000000000001e-05 2024-04-18T14:44:06.490 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:06.490 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:06.490 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_started", 2024-04-18T14:44:06.490 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:35.744332+0000", 2024-04-18T14:44:06.490 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.1605000000000001e-05 2024-04-18T14:44:06.490 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:06.490 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:06.490 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_committed", 2024-04-18T14:44:06.490 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:35.747597+0000", 2024-04-18T14:44:06.490 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.003265422 2024-04-18T14:44:06.490 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:06.491 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:06.491 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-04-18T14:44:06.491 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:35.747628+0000", 2024-04-18T14:44:06.491 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.0275000000000001e-05 2024-04-18T14:44:06.491 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:44:06.491 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-04-18T14:44:06.491 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:44:06.491 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:06.491 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:06.491 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "MOSDECSubOpWrite(3.7s1 41/30 ECSubWrite(tid=50, reqid=osd.14.0:49, at_version=0'0, trim_to=0'0, roll_forward_to=41'17))", 2024-04-18T14:44:06.491 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-04-18T14:43:40.763159+0000", 2024-04-18T14:44:06.491 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 25.723451117, 2024-04-18T14:44:06.491 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0031478589999999998, 2024-04-18T14:44:06.491 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-04-18T14:44:06.492 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "reached pg", 2024-04-18T14:44:06.492 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-04-18T14:44:06.492 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:06.492 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-04-18T14:44:06.492 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:40.763159+0000", 2024-04-18T14:44:06.492 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:44:06.492 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:06.492 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:06.492 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-04-18T14:44:06.492 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:40.763159+0000", 2024-04-18T14:44:06.492 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:44:06.492 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:06.492 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:06.492 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-04-18T14:44:06.493 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:40.763157+0000", 2024-04-18T14:44:06.493 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999981 2024-04-18T14:44:06.493 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:06.493 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:06.493 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-04-18T14:44:06.493 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:40.763185+0000", 2024-04-18T14:44:06.493 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.7498999999999999e-05 2024-04-18T14:44:06.493 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:06.493 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:06.493 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-04-18T14:44:06.493 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:40.763217+0000", 2024-04-18T14:44:06.493 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.2048999999999998e-05 2024-04-18T14:44:06.493 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:06.493 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:06.494 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-04-18T14:44:06.494 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:40.763238+0000", 2024-04-18T14:44:06.494 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.1183e-05 2024-04-18T14:44:06.494 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:06.494 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:06.494 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-04-18T14:44:06.494 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:40.763540+0000", 2024-04-18T14:44:06.494 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00030200700000000002 2024-04-18T14:44:06.494 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:06.494 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:06.494 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_started", 2024-04-18T14:44:06.494 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:40.763568+0000", 2024-04-18T14:44:06.494 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.7345e-05 2024-04-18T14:44:06.495 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:06.495 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:06.495 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_committed", 2024-04-18T14:44:06.495 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:40.766234+0000", 2024-04-18T14:44:06.495 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0026666189999999998 2024-04-18T14:44:06.495 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:06.495 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:06.495 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-04-18T14:44:06.495 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:40.766307+0000", 2024-04-18T14:44:06.495 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.2906999999999998e-05 2024-04-18T14:44:06.495 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:44:06.495 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-04-18T14:44:06.495 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:44:06.496 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:06.496 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:06.496 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "MOSDECSubOpWrite(3.7s1 41/30 ECSubWrite(tid=51, reqid=client.4559.0:242, at_version=41'19, trim_to=0'0, roll_forward_to=41'17))", 2024-04-18T14:44:06.496 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-04-18T14:43:40.782525+0000", 2024-04-18T14:44:06.496 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 25.704085384999999, 2024-04-18T14:44:06.496 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0036558799999999998, 2024-04-18T14:44:06.496 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-04-18T14:44:06.496 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "reached pg", 2024-04-18T14:44:06.496 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-04-18T14:44:06.496 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:06.496 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-04-18T14:44:06.496 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:40.782525+0000", 2024-04-18T14:44:06.496 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:44:06.496 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:06.497 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:06.497 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-04-18T14:44:06.497 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:40.782525+0000", 2024-04-18T14:44:06.497 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:44:06.497 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:06.497 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:06.497 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-04-18T14:44:06.497 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:40.782523+0000", 2024-04-18T14:44:06.497 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999981 2024-04-18T14:44:06.497 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:06.497 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:06.497 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-04-18T14:44:06.498 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:40.783074+0000", 2024-04-18T14:44:06.498 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00055112599999999998 2024-04-18T14:44:06.498 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:06.498 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:06.498 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-04-18T14:44:06.498 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:40.783105+0000", 2024-04-18T14:44:06.498 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.1358e-05 2024-04-18T14:44:06.498 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:06.498 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:06.498 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-04-18T14:44:06.498 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:40.783125+0000", 2024-04-18T14:44:06.498 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.929e-05 2024-04-18T14:44:06.498 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:06.498 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:06.499 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-04-18T14:44:06.499 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:40.783263+0000", 2024-04-18T14:44:06.499 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00013819900000000001 2024-04-18T14:44:06.499 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:06.499 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:06.499 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_started", 2024-04-18T14:44:06.499 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:40.783292+0000", 2024-04-18T14:44:06.499 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.9507999999999999e-05 2024-04-18T14:44:06.499 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:06.499 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:06.499 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_committed", 2024-04-18T14:44:06.499 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:40.786144+0000", 2024-04-18T14:44:06.499 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.002851283 2024-04-18T14:44:06.500 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:06.500 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:06.500 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-04-18T14:44:06.500 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:40.786181+0000", 2024-04-18T14:44:06.500 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.7058999999999999e-05 2024-04-18T14:44:06.500 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:44:06.500 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-04-18T14:44:06.500 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:44:06.500 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:06.500 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:06.500 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4559.0:306 3.es0 3:780bca72:::smithi13430248-6:head [append 0~770048] snapc d=[d,b,a,8,7,2] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-18T14:44:06.500 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-04-18T14:43:44.504007+0000", 2024-04-18T14:44:06.500 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 21.982603350000002, 2024-04-18T14:44:06.500 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.011648129, 2024-04-18T14:44:06.500 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-04-18T14:44:06.501 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T14:44:06.501 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-04-18T14:44:06.501 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4559", 2024-04-18T14:44:06.501 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.134:0/3113589487", 2024-04-18T14:44:06.501 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 306 2024-04-18T14:44:06.501 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:06.501 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-04-18T14:44:06.501 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:06.501 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-04-18T14:44:06.501 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:44.504007+0000", 2024-04-18T14:44:06.501 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:44:06.501 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:06.501 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:06.502 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-04-18T14:44:06.502 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:44.504007+0000", 2024-04-18T14:44:06.502 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:44:06.502 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:06.502 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:06.502 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-04-18T14:44:06.502 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:44.504004+0000", 2024-04-18T14:44:06.502 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999967 2024-04-18T14:44:06.502 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:06.502 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:06.502 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-04-18T14:44:06.502 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:44.505037+0000", 2024-04-18T14:44:06.502 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0010331030000000001 2024-04-18T14:44:06.503 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:06.503 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:06.503 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-04-18T14:44:06.503 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:44.505057+0000", 2024-04-18T14:44:06.503 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.0579999999999999e-05 2024-04-18T14:44:06.503 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:06.503 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:06.503 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-04-18T14:44:06.503 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:44.505066+0000", 2024-04-18T14:44:06.503 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.4349999999999997e-06 2024-04-18T14:44:06.503 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:06.503 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:06.503 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-04-18T14:44:06.504 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:44.505117+0000", 2024-04-18T14:44:06.504 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.0782999999999998e-05 2024-04-18T14:44:06.504 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:06.504 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:06.504 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-04-18T14:44:06.504 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:44.505215+0000", 2024-04-18T14:44:06.504 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.8090000000000004e-05 2024-04-18T14:44:06.504 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:06.504 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:06.504 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_started", 2024-04-18T14:44:06.504 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:44.506696+0000", 2024-04-18T14:44:06.504 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0014812429999999999 2024-04-18T14:44:06.504 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:06.504 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:06.505 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_committed", 2024-04-18T14:44:06.505 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:44.512780+0000", 2024-04-18T14:44:06.505 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0060844430000000001 2024-04-18T14:44:06.505 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:06.505 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:06.505 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-04-18T14:44:06.505 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:44.515586+0000", 2024-04-18T14:44:06.505 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.002805896 2024-04-18T14:44:06.505 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:06.505 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:06.505 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-04-18T14:44:06.505 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:44.515655+0000", 2024-04-18T14:44:06.505 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.8749000000000002e-05 2024-04-18T14:44:06.505 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:44:06.505 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-04-18T14:44:06.506 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:44:06.506 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:06.506 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:06.506 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4559.0:307 3.es0 3:780bca72:::smithi13430248-6:head [append 0~376832] snapc d=[d,b,a,8,7,2] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-18T14:44:06.506 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-04-18T14:43:44.510926+0000", 2024-04-18T14:44:06.506 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 21.975684561000001, 2024-04-18T14:44:06.506 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.005843755, 2024-04-18T14:44:06.506 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-04-18T14:44:06.506 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T14:44:06.506 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-04-18T14:44:06.506 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4559", 2024-04-18T14:44:06.507 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.134:0/3113589487", 2024-04-18T14:44:06.507 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 307 2024-04-18T14:44:06.507 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:06.507 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-04-18T14:44:06.507 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:06.507 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-04-18T14:44:06.507 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:44.510926+0000", 2024-04-18T14:44:06.507 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:44:06.507 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:06.507 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:06.507 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-04-18T14:44:06.507 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:44.510926+0000", 2024-04-18T14:44:06.507 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:44:06.507 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:06.507 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:06.508 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-04-18T14:44:06.508 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:44.510924+0000", 2024-04-18T14:44:06.508 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999981 2024-04-18T14:44:06.508 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:06.508 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:06.508 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-04-18T14:44:06.508 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:44.511403+0000", 2024-04-18T14:44:06.508 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00047906199999999999 2024-04-18T14:44:06.508 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:06.508 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:06.508 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-04-18T14:44:06.508 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:44.511418+0000", 2024-04-18T14:44:06.508 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.4674999999999999e-05 2024-04-18T14:44:06.508 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:06.508 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:06.509 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-04-18T14:44:06.509 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:44.511428+0000", 2024-04-18T14:44:06.509 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.0411000000000001e-05 2024-04-18T14:44:06.509 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:06.509 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:06.509 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-04-18T14:44:06.509 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:44.511538+0000", 2024-04-18T14:44:06.509 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000109796 2024-04-18T14:44:06.509 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:06.509 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:06.509 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-04-18T14:44:06.509 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:44.511623+0000", 2024-04-18T14:44:06.509 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.5395999999999994e-05 2024-04-18T14:44:06.509 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:06.509 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:06.510 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_started", 2024-04-18T14:44:06.510 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:44.512194+0000", 2024-04-18T14:44:06.510 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00057113200000000002 2024-04-18T14:44:06.510 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:06.510 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:06.510 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_committed", 2024-04-18T14:44:06.510 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:44.515727+0000", 2024-04-18T14:44:06.510 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0035322999999999999 2024-04-18T14:44:06.510 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:06.510 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:06.510 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-04-18T14:44:06.510 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:44.516704+0000", 2024-04-18T14:44:06.510 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00097737400000000004 2024-04-18T14:44:06.510 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:06.511 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:06.511 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-04-18T14:44:06.511 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:44.516770+0000", 2024-04-18T14:44:06.511 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.5433999999999997e-05 2024-04-18T14:44:06.511 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:44:06.511 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-04-18T14:44:06.511 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:44:06.511 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:06.511 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:06.511 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4559.0:308 3.es0 3:780bca72:::smithi13430248-6:head [setxattr _header (55) in=7b] snapc d=[d,b,a,8,7,2] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-18T14:44:06.511 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-04-18T14:43:44.511486+0000", 2024-04-18T14:44:06.511 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 21.975124227999999, 2024-04-18T14:44:06.511 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0064367519999999996, 2024-04-18T14:44:06.511 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-04-18T14:44:06.511 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T14:44:06.512 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-04-18T14:44:06.512 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4559", 2024-04-18T14:44:06.512 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.134:0/3113589487", 2024-04-18T14:44:06.512 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 308 2024-04-18T14:44:06.512 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:06.512 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-04-18T14:44:06.512 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:06.512 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-04-18T14:44:06.512 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:44.511486+0000", 2024-04-18T14:44:06.512 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:44:06.512 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:06.512 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:06.512 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-04-18T14:44:06.512 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:44.511486+0000", 2024-04-18T14:44:06.512 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:44:06.513 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:06.513 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:06.513 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-04-18T14:44:06.513 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:44.511485+0000", 2024-04-18T14:44:06.513 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-04-18T14:44:06.513 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:06.513 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:06.513 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-04-18T14:44:06.513 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:44.511492+0000", 2024-04-18T14:44:06.513 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.5760000000000002e-06 2024-04-18T14:44:06.513 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:06.513 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:06.513 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-04-18T14:44:06.513 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:44.511501+0000", 2024-04-18T14:44:06.513 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.1050000000000001e-06 2024-04-18T14:44:06.513 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:06.514 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:06.514 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-04-18T14:44:06.514 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:44.511508+0000", 2024-04-18T14:44:06.514 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.3799999999999996e-06 2024-04-18T14:44:06.514 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:06.514 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:06.514 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-04-18T14:44:06.514 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:44.512827+0000", 2024-04-18T14:44:06.514 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0013185060000000001 2024-04-18T14:44:06.514 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:06.514 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:06.514 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-04-18T14:44:06.514 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:44.512972+0000", 2024-04-18T14:44:06.514 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00014464299999999999 2024-04-18T14:44:06.515 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:06.515 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:06.515 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_started", 2024-04-18T14:44:06.515 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:44.513626+0000", 2024-04-18T14:44:06.515 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000654037 2024-04-18T14:44:06.515 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:06.515 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:06.515 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_committed", 2024-04-18T14:44:06.515 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:44.517315+0000", 2024-04-18T14:44:06.515 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0036897140000000002 2024-04-18T14:44:06.515 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:06.515 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:06.515 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-04-18T14:44:06.515 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:44.517814+0000", 2024-04-18T14:44:06.515 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00049903399999999998 2024-04-18T14:44:06.516 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:06.516 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:06.516 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-04-18T14:44:06.516 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:44.517923+0000", 2024-04-18T14:44:06.516 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00010855 2024-04-18T14:44:06.516 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:44:06.516 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-04-18T14:44:06.516 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:44:06.516 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:06.516 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:06.516 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4559.0:309 3.es0 3:780bca72:::smithi13430248-6:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e45)", 2024-04-18T14:44:06.516 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-04-18T14:43:44.511535+0000", 2024-04-18T14:44:06.516 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 21.975075632999999, 2024-04-18T14:44:06.516 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0096989789999999999, 2024-04-18T14:44:06.516 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-04-18T14:44:06.517 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-04-18T14:44:06.517 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-04-18T14:44:06.517 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4559", 2024-04-18T14:44:06.517 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.134:0/3113589487", 2024-04-18T14:44:06.517 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 309 2024-04-18T14:44:06.517 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:06.517 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-04-18T14:44:06.517 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:06.517 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-04-18T14:44:06.517 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:44.511535+0000", 2024-04-18T14:44:06.517 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:44:06.517 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:06.517 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:06.517 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-04-18T14:44:06.517 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:44.511535+0000", 2024-04-18T14:44:06.518 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:44:06.518 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:06.518 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:06.518 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-04-18T14:44:06.518 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:44.511534+0000", 2024-04-18T14:44:06.518 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-04-18T14:44:06.518 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:06.518 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:06.518 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-04-18T14:44:06.518 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:44.511538+0000", 2024-04-18T14:44:06.518 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.72e-06 2024-04-18T14:44:06.518 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:06.518 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:06.518 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-04-18T14:44:06.519 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:44.511546+0000", 2024-04-18T14:44:06.519 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.7589999999999997e-06 2024-04-18T14:44:06.519 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:06.519 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:06.519 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-04-18T14:44:06.519 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:44.511549+0000", 2024-04-18T14:44:06.519 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.6720000000000002e-06 2024-04-18T14:44:06.519 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:06.519 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:06.519 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-04-18T14:44:06.519 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:44.514147+0000", 2024-04-18T14:44:06.519 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0025982100000000001 2024-04-18T14:44:06.519 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:06.519 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:06.519 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for rw locks", 2024-04-18T14:44:06.519 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:44.514218+0000", 2024-04-18T14:44:06.520 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.1007000000000006e-05 2024-04-18T14:44:06.520 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:06.520 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:06.520 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-04-18T14:44:06.520 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:44.518351+0000", 2024-04-18T14:44:06.520 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.004132241 2024-04-18T14:44:06.520 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:06.520 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:06.520 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-04-18T14:44:06.520 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:44.518432+0000", 2024-04-18T14:44:06.520 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.1116000000000001e-05 2024-04-18T14:44:06.520 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:06.520 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:06.520 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-04-18T14:44:06.520 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:44.521234+0000", 2024-04-18T14:44:06.521 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0028019400000000002 2024-04-18T14:44:06.521 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:44:06.521 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-04-18T14:44:06.521 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:44:06.521 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:06.521 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:06.521 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "MOSDECSubOpWrite(3.5s6 47/30 ECSubWrite(tid=15, reqid=client.4559.0:326, at_version=47'13, trim_to=0'0, roll_forward_to=46'12))", 2024-04-18T14:44:06.521 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-04-18T14:43:46.393789+0000", 2024-04-18T14:44:06.521 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 20.092821211, 2024-04-18T14:44:06.521 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0046310489999999999, 2024-04-18T14:44:06.521 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-04-18T14:44:06.521 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "reached pg", 2024-04-18T14:44:06.521 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-04-18T14:44:06.521 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:06.521 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-04-18T14:44:06.522 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:46.393789+0000", 2024-04-18T14:44:06.522 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:44:06.522 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:06.522 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:06.522 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-04-18T14:44:06.522 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:46.393789+0000", 2024-04-18T14:44:06.522 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:44:06.522 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:06.522 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:06.522 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-04-18T14:44:06.522 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:46.393789+0000", 2024-04-18T14:44:06.522 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-04-18T14:44:06.522 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:06.522 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:06.523 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-04-18T14:44:06.523 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:46.395549+0000", 2024-04-18T14:44:06.523 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.001760417 2024-04-18T14:44:06.523 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:06.523 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:06.523 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-04-18T14:44:06.523 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:46.395581+0000", 2024-04-18T14:44:06.523 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.2069000000000001e-05 2024-04-18T14:44:06.523 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:06.523 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:06.523 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-04-18T14:44:06.523 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:46.395601+0000", 2024-04-18T14:44:06.523 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.9619e-05 2024-04-18T14:44:06.523 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:06.524 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:06.524 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-04-18T14:44:06.524 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:46.395747+0000", 2024-04-18T14:44:06.524 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000146231 2024-04-18T14:44:06.524 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:06.524 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:06.524 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_started", 2024-04-18T14:44:06.524 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:46.395776+0000", 2024-04-18T14:44:06.524 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.9045999999999999e-05 2024-04-18T14:44:06.524 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:06.524 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:06.524 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_committed", 2024-04-18T14:44:06.524 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:46.398372+0000", 2024-04-18T14:44:06.524 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.002595918 2024-04-18T14:44:06.524 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:06.525 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:06.525 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-04-18T14:44:06.525 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:46.398420+0000", 2024-04-18T14:44:06.525 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.8145000000000001e-05 2024-04-18T14:44:06.525 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:44:06.525 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-04-18T14:44:06.525 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:44:06.525 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:06.525 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:06.525 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "MOSDECSubOpWrite(3.7s1 50/30 ECSubWrite(tid=84, reqid=osd.14.0:81, at_version=0'0, trim_to=0'0, roll_forward_to=50'31))", 2024-04-18T14:44:06.525 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-04-18T14:43:49.411599+0000", 2024-04-18T14:44:06.525 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 17.075011688, 2024-04-18T14:44:06.525 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.007513924, 2024-04-18T14:44:06.525 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-04-18T14:44:06.526 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "reached pg", 2024-04-18T14:44:06.526 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-04-18T14:44:06.526 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:06.526 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-04-18T14:44:06.526 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:49.411599+0000", 2024-04-18T14:44:06.526 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:44:06.526 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:06.526 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:06.526 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-04-18T14:44:06.526 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:49.411599+0000", 2024-04-18T14:44:06.526 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:44:06.526 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:06.526 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:06.526 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-04-18T14:44:06.526 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:49.411598+0000", 2024-04-18T14:44:06.527 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-04-18T14:44:06.527 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:06.527 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:06.527 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-04-18T14:44:06.527 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:49.411613+0000", 2024-04-18T14:44:06.527 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.5648e-05 2024-04-18T14:44:06.527 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:06.527 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:06.527 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-04-18T14:44:06.527 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:49.411628+0000", 2024-04-18T14:44:06.527 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.4405e-05 2024-04-18T14:44:06.527 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:06.527 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:06.527 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-04-18T14:44:06.527 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:49.411635+0000", 2024-04-18T14:44:06.527 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.3950000000000003e-06 2024-04-18T14:44:06.528 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:06.528 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:06.528 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-04-18T14:44:06.528 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:49.411682+0000", 2024-04-18T14:44:06.528 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.7287000000000003e-05 2024-04-18T14:44:06.528 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:06.528 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:06.528 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_started", 2024-04-18T14:44:06.528 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:49.411691+0000", 2024-04-18T14:44:06.528 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.4500000000000004e-06 2024-04-18T14:44:06.528 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:06.528 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:06.528 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_committed", 2024-04-18T14:44:06.528 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:49.419080+0000", 2024-04-18T14:44:06.529 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0073891779999999997 2024-04-18T14:44:06.529 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:06.529 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:06.529 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-04-18T14:44:06.529 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:49.419113+0000", 2024-04-18T14:44:06.529 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.2601000000000002e-05 2024-04-18T14:44:06.529 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:44:06.529 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-04-18T14:44:06.529 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:44:06.529 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:06.529 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:06.529 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "MOSDECSubOpWrite(3.7s1 51/30 ECSubWrite(tid=96, reqid=client.4559.0:375, at_version=51'33, trim_to=0'0, roll_forward_to=50'31))", 2024-04-18T14:44:06.529 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-04-18T14:43:50.400332+0000", 2024-04-18T14:44:06.529 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 16.086278462999999, 2024-04-18T14:44:06.530 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0039058040000000001, 2024-04-18T14:44:06.530 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-04-18T14:44:06.530 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "reached pg", 2024-04-18T14:44:06.530 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-04-18T14:44:06.530 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:06.530 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-04-18T14:44:06.530 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:50.400332+0000", 2024-04-18T14:44:06.530 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:44:06.530 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:06.530 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:06.530 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-04-18T14:44:06.530 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:50.400332+0000", 2024-04-18T14:44:06.530 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:44:06.531 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:06.531 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:06.531 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-04-18T14:44:06.531 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:50.400331+0000", 2024-04-18T14:44:06.531 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-04-18T14:44:06.531 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:06.531 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:06.531 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-04-18T14:44:06.531 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:50.400754+0000", 2024-04-18T14:44:06.531 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000423132 2024-04-18T14:44:06.531 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:06.531 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:06.531 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-04-18T14:44:06.531 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:50.400783+0000", 2024-04-18T14:44:06.531 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.8535999999999999e-05 2024-04-18T14:44:06.532 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:06.532 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:06.532 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-04-18T14:44:06.532 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:50.400797+0000", 2024-04-18T14:44:06.532 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.4015999999999999e-05 2024-04-18T14:44:06.532 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:06.532 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:06.532 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-04-18T14:44:06.532 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:50.400941+0000", 2024-04-18T14:44:06.532 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00014409199999999999 2024-04-18T14:44:06.532 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:06.532 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:06.532 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_started", 2024-04-18T14:44:06.532 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:50.400975+0000", 2024-04-18T14:44:06.532 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.4261000000000003e-05 2024-04-18T14:44:06.533 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:06.533 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:06.533 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_committed", 2024-04-18T14:44:06.533 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:50.404215+0000", 2024-04-18T14:44:06.533 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0032394939999999999 2024-04-18T14:44:06.533 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:06.533 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:06.533 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-04-18T14:44:06.533 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:50.404238+0000", 2024-04-18T14:44:06.533 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.3169000000000001e-05 2024-04-18T14:44:06.533 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:44:06.533 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-04-18T14:44:06.533 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:44:06.533 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:06.534 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:06.534 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "MOSDECSubOpWrite(3.7s1 51/30 ECSubWrite(tid=98, reqid=client.4559.0:376, at_version=0'0, trim_to=0'0, roll_forward_to=51'34))", 2024-04-18T14:44:06.534 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-04-18T14:43:50.409904+0000", 2024-04-18T14:44:06.534 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 16.076706716, 2024-04-18T14:44:06.534 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0032671610000000002, 2024-04-18T14:44:06.534 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-04-18T14:44:06.534 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "reached pg", 2024-04-18T14:44:06.534 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-04-18T14:44:06.534 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:06.534 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-04-18T14:44:06.534 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:50.409904+0000", 2024-04-18T14:44:06.534 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:44:06.534 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:06.535 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:06.535 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-04-18T14:44:06.535 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:50.409904+0000", 2024-04-18T14:44:06.535 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:44:06.535 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:06.535 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:06.535 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-04-18T14:44:06.535 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:50.409902+0000", 2024-04-18T14:44:06.535 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999981 2024-04-18T14:44:06.535 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:06.535 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:06.535 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-04-18T14:44:06.535 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:50.409925+0000", 2024-04-18T14:44:06.536 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.2753000000000001e-05 2024-04-18T14:44:06.536 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:06.536 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:06.536 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-04-18T14:44:06.536 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:50.409950+0000", 2024-04-18T14:44:06.536 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.4828999999999999e-05 2024-04-18T14:44:06.536 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:06.536 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:06.536 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-04-18T14:44:06.536 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:50.409970+0000", 2024-04-18T14:44:06.536 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.0749000000000001e-05 2024-04-18T14:44:06.536 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:06.536 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:06.536 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-04-18T14:44:06.536 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:50.410035+0000", 2024-04-18T14:44:06.536 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.4697999999999996e-05 2024-04-18T14:44:06.537 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:06.537 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:06.537 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_started", 2024-04-18T14:44:06.537 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:50.410046+0000", 2024-04-18T14:44:06.537 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.1433e-05 2024-04-18T14:44:06.537 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:06.537 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:06.537 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_committed", 2024-04-18T14:44:06.537 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:50.413147+0000", 2024-04-18T14:44:06.537 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0031005519999999999 2024-04-18T14:44:06.537 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:06.537 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:06.537 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-04-18T14:44:06.537 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:50.413171+0000", 2024-04-18T14:44:06.537 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.385e-05 2024-04-18T14:44:06.537 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:44:06.538 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-04-18T14:44:06.538 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:44:06.538 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:06.538 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:06.538 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "MOSDECSubOpWrite(3.7s1 51/30 ECSubWrite(tid=99, reqid=client.4559.0:377, at_version=51'35, trim_to=0'0, roll_forward_to=51'34))", 2024-04-18T14:44:06.538 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-04-18T14:43:50.411987+0000", 2024-04-18T14:44:06.538 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 16.074623420999998, 2024-04-18T14:44:06.538 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0043229080000000003, 2024-04-18T14:44:06.538 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-04-18T14:44:06.538 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "reached pg", 2024-04-18T14:44:06.538 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-04-18T14:44:06.538 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:06.538 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-04-18T14:44:06.539 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:50.411987+0000", 2024-04-18T14:44:06.539 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:44:06.539 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:06.539 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:06.539 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-04-18T14:44:06.539 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:50.411987+0000", 2024-04-18T14:44:06.539 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:44:06.539 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:06.539 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:06.539 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-04-18T14:44:06.540 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:50.411985+0000", 2024-04-18T14:44:06.540 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999981 2024-04-18T14:44:06.540 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:06.540 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:06.540 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-04-18T14:44:06.540 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:50.412195+0000", 2024-04-18T14:44:06.540 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00021013999999999999 2024-04-18T14:44:06.540 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:06.540 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:06.540 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-04-18T14:44:06.540 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:50.412228+0000", 2024-04-18T14:44:06.540 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.2818999999999999e-05 2024-04-18T14:44:06.540 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:06.540 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:06.541 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-04-18T14:44:06.541 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:50.412248+0000", 2024-04-18T14:44:06.541 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.9796000000000002e-05 2024-04-18T14:44:06.541 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:06.541 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:06.541 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-04-18T14:44:06.541 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:50.412297+0000", 2024-04-18T14:44:06.541 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.9366999999999997e-05 2024-04-18T14:44:06.541 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:06.541 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:06.541 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_started", 2024-04-18T14:44:06.541 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:50.412307+0000", 2024-04-18T14:44:06.541 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.2949999999999999e-06 2024-04-18T14:44:06.541 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:06.541 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:06.542 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_committed", 2024-04-18T14:44:06.542 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:50.416274+0000", 2024-04-18T14:44:06.542 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0039669759999999997 2024-04-18T14:44:06.542 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:06.542 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:06.542 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-04-18T14:44:06.542 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:50.416310+0000", 2024-04-18T14:44:06.542 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.6288999999999998e-05 2024-04-18T14:44:06.542 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:44:06.542 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-04-18T14:44:06.542 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:44:06.542 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:06.542 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:06.543 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "MOSDECSubOpWrite(3.7s1 57/30 ECSubWrite(tid=126, reqid=client.4559.0:475, at_version=57'49, trim_to=0'0, roll_forward_to=54'47))", 2024-04-18T14:44:06.543 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-04-18T14:43:56.401958+0000", 2024-04-18T14:44:06.543 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 10.08465196, 2024-04-18T14:44:06.543 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0065955340000000001, 2024-04-18T14:44:06.543 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-04-18T14:44:06.543 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "reached pg", 2024-04-18T14:44:06.543 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-04-18T14:44:06.543 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:06.543 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-04-18T14:44:06.543 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:56.401958+0000", 2024-04-18T14:44:06.543 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:44:06.543 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:06.543 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:06.543 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-04-18T14:44:06.543 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:56.401958+0000", 2024-04-18T14:44:06.544 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:44:06.544 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:06.544 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:06.544 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-04-18T14:44:06.544 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:56.401957+0000", 2024-04-18T14:44:06.544 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-04-18T14:44:06.544 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:06.544 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:06.544 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-04-18T14:44:06.544 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:56.402599+0000", 2024-04-18T14:44:06.544 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00064145700000000001 2024-04-18T14:44:06.544 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:06.544 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:06.544 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-04-18T14:44:06.545 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:56.402624+0000", 2024-04-18T14:44:06.545 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.4924999999999999e-05 2024-04-18T14:44:06.545 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:06.545 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:06.545 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-04-18T14:44:06.545 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:56.402639+0000", 2024-04-18T14:44:06.545 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.5427999999999999e-05 2024-04-18T14:44:06.545 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:06.545 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:06.545 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-04-18T14:44:06.545 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:56.402769+0000", 2024-04-18T14:44:06.545 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00012982799999999999 2024-04-18T14:44:06.545 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:06.545 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:06.545 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_started", 2024-04-18T14:44:06.546 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:56.402797+0000", 2024-04-18T14:44:06.546 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.7605000000000001e-05 2024-04-18T14:44:06.546 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:06.546 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:06.546 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_committed", 2024-04-18T14:44:06.546 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:56.408526+0000", 2024-04-18T14:44:06.546 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0057294499999999996 2024-04-18T14:44:06.546 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:06.546 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:06.546 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-04-18T14:44:06.546 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:56.408554+0000", 2024-04-18T14:44:06.546 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.7755000000000001e-05 2024-04-18T14:44:06.546 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:44:06.546 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-04-18T14:44:06.547 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:44:06.547 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:06.547 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:06.547 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4559.0:491 3.es0 3:780bca72:::smithi13430248-6:head [delete] snapc 19=[19,16,14,13,11,f,b,a,7,2] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e57)", 2024-04-18T14:44:06.547 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-04-18T14:43:56.453647+0000", 2024-04-18T14:44:06.547 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 10.03296381, 2024-04-18T14:44:06.547 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0089469230000000007, 2024-04-18T14:44:06.547 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-04-18T14:44:06.547 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T14:44:06.547 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-04-18T14:44:06.547 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4559", 2024-04-18T14:44:06.547 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.134:0/3113589487", 2024-04-18T14:44:06.547 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 491 2024-04-18T14:44:06.548 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:06.548 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-04-18T14:44:06.548 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:06.548 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-04-18T14:44:06.548 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:56.453647+0000", 2024-04-18T14:44:06.548 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:44:06.548 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:06.548 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:06.548 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-04-18T14:44:06.548 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:56.453647+0000", 2024-04-18T14:44:06.548 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:44:06.548 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:06.548 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:06.548 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-04-18T14:44:06.549 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:56.453643+0000", 2024-04-18T14:44:06.549 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999962 2024-04-18T14:44:06.549 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:06.549 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:06.549 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-04-18T14:44:06.549 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:56.453661+0000", 2024-04-18T14:44:06.549 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.8448999999999999e-05 2024-04-18T14:44:06.549 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:06.549 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:06.549 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-04-18T14:44:06.549 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:56.453702+0000", 2024-04-18T14:44:06.549 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.1315e-05 2024-04-18T14:44:06.549 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:06.550 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:06.550 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-04-18T14:44:06.550 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:56.453725+0000", 2024-04-18T14:44:06.550 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.2169999999999999e-05 2024-04-18T14:44:06.550 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:06.550 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:06.550 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-04-18T14:44:06.550 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:56.453835+0000", 2024-04-18T14:44:06.550 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000110561 2024-04-18T14:44:06.550 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:06.550 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:06.550 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-04-18T14:44:06.550 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:56.453992+0000", 2024-04-18T14:44:06.551 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000156673 2024-04-18T14:44:06.551 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:06.551 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:06.551 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_started", 2024-04-18T14:44:06.551 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:56.455890+0000", 2024-04-18T14:44:06.551 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.001897803 2024-04-18T14:44:06.551 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:06.551 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:06.551 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_committed", 2024-04-18T14:44:06.551 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:56.461603+0000", 2024-04-18T14:44:06.551 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0057137450000000001 2024-04-18T14:44:06.551 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:06.551 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:06.551 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-04-18T14:44:06.551 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:56.462514+0000", 2024-04-18T14:44:06.552 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00091034600000000003 2024-04-18T14:44:06.552 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:06.552 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:06.552 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-04-18T14:44:06.552 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:56.462593+0000", 2024-04-18T14:44:06.552 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.9664000000000002e-05 2024-04-18T14:44:06.552 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:44:06.552 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-04-18T14:44:06.552 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:44:06.552 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:06.552 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:06.552 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4559.0:514 3.es0 3:77281ef4:::smithi13430248-3:head [copy-from ver 55] snapc 19=[19,16,14,13,11,f,b,a,7,2] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-18T14:44:06.552 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-04-18T14:43:56.576333+0000", 2024-04-18T14:44:06.552 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 9.9102775879999996, 2024-04-18T14:44:06.553 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.020917282999999998, 2024-04-18T14:44:06.553 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-04-18T14:44:06.553 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T14:44:06.553 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-04-18T14:44:06.553 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4559", 2024-04-18T14:44:06.553 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.134:0/3113589487", 2024-04-18T14:44:06.553 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 514 2024-04-18T14:44:06.553 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:06.553 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-04-18T14:44:06.553 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:06.553 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-04-18T14:44:06.553 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:56.576333+0000", 2024-04-18T14:44:06.553 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:44:06.553 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:06.554 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:06.554 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-04-18T14:44:06.554 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:56.576333+0000", 2024-04-18T14:44:06.554 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:44:06.554 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:06.554 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:06.554 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-04-18T14:44:06.554 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:56.576330+0000", 2024-04-18T14:44:06.554 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999976 2024-04-18T14:44:06.554 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:06.554 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:06.554 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-04-18T14:44:06.554 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:56.576342+0000", 2024-04-18T14:44:06.555 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.1622e-05 2024-04-18T14:44:06.555 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:06.555 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:06.555 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-04-18T14:44:06.555 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:56.576359+0000", 2024-04-18T14:44:06.555 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.7234000000000001e-05 2024-04-18T14:44:06.555 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:06.555 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:06.555 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-04-18T14:44:06.555 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:56.576369+0000", 2024-04-18T14:44:06.555 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.3419999999999997e-06 2024-04-18T14:44:06.555 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:06.555 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:06.555 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-04-18T14:44:06.556 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:56.576440+0000", 2024-04-18T14:44:06.556 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.1693000000000006e-05 2024-04-18T14:44:06.556 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:06.556 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:06.556 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-04-18T14:44:06.556 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:56.576566+0000", 2024-04-18T14:44:06.556 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00012597699999999999 2024-04-18T14:44:06.556 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:06.556 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:06.556 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_started", 2024-04-18T14:44:06.556 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:56.585726+0000", 2024-04-18T14:44:06.556 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0091601249999999999 2024-04-18T14:44:06.556 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:06.556 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:06.557 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_committed", 2024-04-18T14:44:06.557 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:56.590557+0000", 2024-04-18T14:44:06.557 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0048303699999999996 2024-04-18T14:44:06.557 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:06.557 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:06.557 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-04-18T14:44:06.557 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:56.597131+0000", 2024-04-18T14:44:06.557 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0065739250000000004 2024-04-18T14:44:06.557 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:06.557 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:06.557 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-04-18T14:44:06.557 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:56.597250+0000", 2024-04-18T14:44:06.557 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0001194 2024-04-18T14:44:06.557 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:44:06.558 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-04-18T14:44:06.558 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:44:06.558 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:06.558 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:06.558 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4559.0:515 3.es0 3:77281ef4:::smithi13430248-3:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e57)", 2024-04-18T14:44:06.558 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-04-18T14:43:56.576386+0000", 2024-04-18T14:44:06.558 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 9.9102244259999992, 2024-04-18T14:44:06.558 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.012420726999999999, 2024-04-18T14:44:06.558 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-04-18T14:44:06.558 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-04-18T14:44:06.558 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-04-18T14:44:06.558 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4559", 2024-04-18T14:44:06.558 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.134:0/3113589487", 2024-04-18T14:44:06.558 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 515 2024-04-18T14:44:06.559 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:06.559 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-04-18T14:44:06.559 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:06.559 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-04-18T14:44:06.559 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:56.576386+0000", 2024-04-18T14:44:06.559 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:44:06.559 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:06.559 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:06.559 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-04-18T14:44:06.559 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:56.576386+0000", 2024-04-18T14:44:06.559 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:44:06.559 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:06.559 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:06.560 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-04-18T14:44:06.560 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:56.576385+0000", 2024-04-18T14:44:06.560 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-04-18T14:44:06.560 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:06.560 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:06.560 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-04-18T14:44:06.560 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:56.576388+0000", 2024-04-18T14:44:06.560 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.0189999999999998e-06 2024-04-18T14:44:06.560 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:06.560 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:06.560 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-04-18T14:44:06.560 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:56.576395+0000", 2024-04-18T14:44:06.560 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.8199999999999999e-06 2024-04-18T14:44:06.560 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:06.560 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:06.561 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-04-18T14:44:06.561 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:56.576401+0000", 2024-04-18T14:44:06.561 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.964e-06 2024-04-18T14:44:06.561 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:06.561 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:06.561 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-04-18T14:44:06.561 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:56.576801+0000", 2024-04-18T14:44:06.561 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00040004199999999998 2024-04-18T14:44:06.561 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:06.561 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:06.561 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for blocked object", 2024-04-18T14:44:06.561 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:56.576891+0000", 2024-04-18T14:44:06.561 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.9529000000000003e-05 2024-04-18T14:44:06.561 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:06.562 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:06.562 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-04-18T14:44:06.562 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:56.588587+0000", 2024-04-18T14:44:06.562 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.011696592 2024-04-18T14:44:06.562 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:06.562 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:06.562 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-04-18T14:44:06.562 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:56.588693+0000", 2024-04-18T14:44:06.562 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000105945 2024-04-18T14:44:06.562 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:06.562 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:06.562 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-04-18T14:44:06.563 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:56.588807+0000", 2024-04-18T14:44:06.563 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000113269 2024-04-18T14:44:06.563 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:44:06.563 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-04-18T14:44:06.563 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:44:06.563 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:06.563 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:06.563 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "MOSDECSubOpWrite(3.bs4 57/30 ECSubWrite(tid=42, reqid=client.4559.0:506, at_version=0'0, trim_to=0'0, roll_forward_to=57'16))", 2024-04-18T14:44:06.563 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-04-18T14:43:56.587172+0000", 2024-04-18T14:44:06.563 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 9.8994385099999995, 2024-04-18T14:44:06.563 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0034865450000000002, 2024-04-18T14:44:06.563 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-04-18T14:44:06.563 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "reached pg", 2024-04-18T14:44:06.564 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-04-18T14:44:06.564 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:06.564 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-04-18T14:44:06.564 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:56.587172+0000", 2024-04-18T14:44:06.564 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:44:06.564 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:06.564 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:06.564 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-04-18T14:44:06.564 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:56.587172+0000", 2024-04-18T14:44:06.564 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:44:06.564 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:06.564 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:06.564 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-04-18T14:44:06.564 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:56.587171+0000", 2024-04-18T14:44:06.565 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999986 2024-04-18T14:44:06.565 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:06.565 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:06.565 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-04-18T14:44:06.565 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:56.587190+0000", 2024-04-18T14:44:06.565 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.9154e-05 2024-04-18T14:44:06.565 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:06.565 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:06.565 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-04-18T14:44:06.565 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:56.587203+0000", 2024-04-18T14:44:06.565 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.3405e-05 2024-04-18T14:44:06.565 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:06.565 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:06.566 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-04-18T14:44:06.566 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:56.587213+0000", 2024-04-18T14:44:06.566 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.5249999999999994e-06 2024-04-18T14:44:06.566 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:06.566 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:06.566 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-04-18T14:44:06.566 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:56.587272+0000", 2024-04-18T14:44:06.566 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.8903000000000002e-05 2024-04-18T14:44:06.566 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:06.566 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:06.566 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_started", 2024-04-18T14:44:06.566 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:56.587284+0000", 2024-04-18T14:44:06.566 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.2405000000000001e-05 2024-04-18T14:44:06.566 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:06.567 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:06.567 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_committed", 2024-04-18T14:44:06.567 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:56.590625+0000", 2024-04-18T14:44:06.567 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0033414579999999998 2024-04-18T14:44:06.567 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:06.567 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:06.567 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-04-18T14:44:06.567 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:56.590658+0000", 2024-04-18T14:44:06.567 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.2969000000000002e-05 2024-04-18T14:44:06.567 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:44:06.567 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-04-18T14:44:06.567 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:44:06.567 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:06.567 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:06.568 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "MOSDECSubOpWrite(3.7s1 63/30 ECSubWrite(tid=160, reqid=osd.14.0:160, at_version=63'68, trim_to=0'0, roll_forward_to=60'65))", 2024-04-18T14:44:06.568 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-04-18T14:44:02.386985+0000", 2024-04-18T14:44:06.568 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 4.0996250090000004, 2024-04-18T14:44:06.568 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0070728529999999996, 2024-04-18T14:44:06.568 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-04-18T14:44:06.568 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "reached pg", 2024-04-18T14:44:06.568 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-04-18T14:44:06.568 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:06.568 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-04-18T14:44:06.568 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:02.386985+0000", 2024-04-18T14:44:06.568 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:44:06.568 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:06.568 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:06.568 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-04-18T14:44:06.569 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:02.386985+0000", 2024-04-18T14:44:06.569 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:44:06.569 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:06.569 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:06.569 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-04-18T14:44:06.569 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:02.386985+0000", 2024-04-18T14:44:06.569 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-04-18T14:44:06.569 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:06.569 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:06.569 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-04-18T14:44:06.569 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:02.387006+0000", 2024-04-18T14:44:06.569 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.0834000000000001e-05 2024-04-18T14:44:06.569 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:06.569 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:06.570 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-04-18T14:44:06.570 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:02.387015+0000", 2024-04-18T14:44:06.570 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.3430000000000002e-06 2024-04-18T14:44:06.570 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:06.570 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:06.570 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-04-18T14:44:06.570 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:02.387025+0000", 2024-04-18T14:44:06.570 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.3680000000000008e-06 2024-04-18T14:44:06.570 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:06.570 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:06.570 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-04-18T14:44:06.571 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:02.387129+0000", 2024-04-18T14:44:06.571 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000104208 2024-04-18T14:44:06.571 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:06.571 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:06.571 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_started", 2024-04-18T14:44:06.571 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:02.387138+0000", 2024-04-18T14:44:06.571 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.5710000000000004e-06 2024-04-18T14:44:06.571 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:06.571 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:06.571 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_committed", 2024-04-18T14:44:06.571 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:02.394016+0000", 2024-04-18T14:44:06.571 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0068776139999999998 2024-04-18T14:44:06.571 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:06.571 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:06.571 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-04-18T14:44:06.572 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:02.394058+0000", 2024-04-18T14:44:06.572 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.2184999999999997e-05 2024-04-18T14:44:06.572 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:44:06.572 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-04-18T14:44:06.572 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:44:06.572 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:06.572 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:06.572 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "MOSDECSubOpWrite(3.7s1 63/30 ECSubWrite(tid=162, reqid=osd.14.0:162, at_version=63'70, trim_to=0'0, roll_forward_to=60'65))", 2024-04-18T14:44:06.572 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-04-18T14:44:02.387673+0000", 2024-04-18T14:44:06.572 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 4.0989371139999999, 2024-04-18T14:44:06.572 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.011396827, 2024-04-18T14:44:06.572 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-04-18T14:44:06.572 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "reached pg", 2024-04-18T14:44:06.572 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-04-18T14:44:06.572 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:06.573 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-04-18T14:44:06.573 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:02.387673+0000", 2024-04-18T14:44:06.573 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:44:06.573 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:06.573 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:06.573 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-04-18T14:44:06.573 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:02.387673+0000", 2024-04-18T14:44:06.573 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:44:06.573 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:06.573 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:06.573 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-04-18T14:44:06.573 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:02.387672+0000", 2024-04-18T14:44:06.573 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-04-18T14:44:06.573 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:06.573 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:06.573 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-04-18T14:44:06.574 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:02.387691+0000", 2024-04-18T14:44:06.574 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.8215000000000001e-05 2024-04-18T14:44:06.574 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:06.574 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:06.574 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-04-18T14:44:06.574 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:02.387701+0000", 2024-04-18T14:44:06.574 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.8640000000000008e-06 2024-04-18T14:44:06.574 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:06.574 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:06.574 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-04-18T14:44:06.574 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:02.387707+0000", 2024-04-18T14:44:06.574 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.049e-06 2024-04-18T14:44:06.574 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:06.574 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:06.574 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-04-18T14:44:06.575 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:02.387752+0000", 2024-04-18T14:44:06.575 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.5510999999999998e-05 2024-04-18T14:44:06.575 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:06.575 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:06.575 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_started", 2024-04-18T14:44:06.575 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:02.387761+0000", 2024-04-18T14:44:06.575 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.4339999999999992e-06 2024-04-18T14:44:06.575 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:06.575 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:06.575 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_committed", 2024-04-18T14:44:06.575 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:02.399030+0000", 2024-04-18T14:44:06.575 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.011269713000000001 2024-04-18T14:44:06.575 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:06.575 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:06.575 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-04-18T14:44:06.575 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:02.399070+0000", 2024-04-18T14:44:06.576 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.9823000000000001e-05 2024-04-18T14:44:06.576 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:44:06.576 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-04-18T14:44:06.576 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:44:06.576 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:06.576 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:06.576 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "MOSDECSubOpWrite(3.bs4 63/30 ECSubWrite(tid=51, reqid=osd.10.0:50, at_version=0'0, trim_to=0'0, roll_forward_to=63'22))", 2024-04-18T14:44:06.576 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-04-18T14:44:02.391039+0000", 2024-04-18T14:44:06.576 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 4.095571047, 2024-04-18T14:44:06.576 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0080048640000000004, 2024-04-18T14:44:06.576 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-04-18T14:44:06.576 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "reached pg", 2024-04-18T14:44:06.576 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-04-18T14:44:06.576 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:06.577 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-04-18T14:44:06.577 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:02.391039+0000", 2024-04-18T14:44:06.577 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:44:06.577 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:06.577 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:06.577 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-04-18T14:44:06.577 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:02.391039+0000", 2024-04-18T14:44:06.577 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:44:06.577 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:06.577 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:06.577 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-04-18T14:44:06.577 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:02.391038+0000", 2024-04-18T14:44:06.577 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-04-18T14:44:06.577 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:06.577 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:06.578 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-04-18T14:44:06.578 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:02.391054+0000", 2024-04-18T14:44:06.578 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.5149e-05 2024-04-18T14:44:06.578 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:06.578 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:06.578 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-04-18T14:44:06.578 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:02.391222+0000", 2024-04-18T14:44:06.578 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00016834099999999999 2024-04-18T14:44:06.578 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:06.578 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:06.578 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-04-18T14:44:06.578 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:02.391234+0000", 2024-04-18T14:44:06.578 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.2388999999999999e-05 2024-04-18T14:44:06.579 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:06.579 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:06.579 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-04-18T14:44:06.579 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:02.391290+0000", 2024-04-18T14:44:06.579 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.6141999999999999e-05 2024-04-18T14:44:06.579 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:06.579 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:06.579 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_started", 2024-04-18T14:44:06.579 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:02.391301+0000", 2024-04-18T14:44:06.579 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.0541e-05 2024-04-18T14:44:06.579 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:06.579 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:06.579 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_committed", 2024-04-18T14:44:06.579 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:02.399010+0000", 2024-04-18T14:44:06.579 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0077092970000000004 2024-04-18T14:44:06.580 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:06.580 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:06.580 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-04-18T14:44:06.580 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:02.399044+0000", 2024-04-18T14:44:06.580 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.3943999999999999e-05 2024-04-18T14:44:06.580 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:44:06.580 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-04-18T14:44:06.580 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:44:06.580 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:44:06.580 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-04-18T14:44:06.580 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-04-18T14:44:06.581 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.12.asok dump_ops_in_flight 2024-04-18T14:44:06.584 INFO:tasks.ceph.osd.1.smithi096.stderr:2024-04-18T14:44:06.581+0000 7f56a7a98640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 24887) UID: 0 2024-04-18T14:44:06.685 INFO:tasks.ceph.osd.12.smithi086.stderr:2024-04-18T14:44:06.682+0000 7f6904968640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 12 (PID: 24960) UID: 0 2024-04-18T14:44:06.740 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-04-18T14:44:06.740 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [], 2024-04-18T14:44:06.741 INFO:teuthology.orchestra.run.smithi086.stdout: "num_ops": 0 2024-04-18T14:44:06.741 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-04-18T14:44:06.755 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.12.asok dump_blocked_ops 2024-04-18T14:44:06.799 INFO:tasks.ceph.osd.4.smithi086.stderr:2024-04-18T14:44:06.798+0000 7f0c4c462640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 24956) UID: 0 2024-04-18T14:44:06.887 INFO:tasks.ceph.osd.1.smithi096.stderr:2024-04-18T14:44:06.885+0000 7f56a7a98640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 24887) UID: 0 2024-04-18T14:44:06.921 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-04-18T14:44:06.921 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [], 2024-04-18T14:44:06.921 INFO:teuthology.orchestra.run.smithi086.stdout: "complaint_time": 30, 2024-04-18T14:44:06.921 INFO:teuthology.orchestra.run.smithi086.stdout: "num_blocked_ops": 0 2024-04-18T14:44:06.921 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-04-18T14:44:06.935 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.12.asok dump_historic_ops 2024-04-18T14:44:06.988 INFO:tasks.ceph.osd.6.smithi119.stderr:2024-04-18T14:44:06.990+0000 7fb7cb8bd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 24896) UID: 0 2024-04-18T14:44:07.010 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-18T14:44:07.062 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-04-18T14:44:07.062 INFO:teuthology.orchestra.run.smithi086.stdout: "size": 20, 2024-04-18T14:44:07.062 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 600, 2024-04-18T14:44:07.063 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [ 2024-04-18T14:44:07.063 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:07.063 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4559.0:247 3.9s0 3:936e42fd:::smithi13430248-33:head [rollback 8] snapc 8=[8,7,4,2] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-04-18T14:44:07.063 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-04-18T14:43:40.758084+0000", 2024-04-18T14:44:07.063 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 26.302150352000002, 2024-04-18T14:44:07.063 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.01694913, 2024-04-18T14:44:07.064 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-04-18T14:44:07.064 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-04-18T14:44:07.064 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-04-18T14:44:07.064 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4559", 2024-04-18T14:44:07.064 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.134:0/3113589487", 2024-04-18T14:44:07.064 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 247 2024-04-18T14:44:07.065 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:07.065 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-04-18T14:44:07.065 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:07.065 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-04-18T14:44:07.065 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:40.758084+0000", 2024-04-18T14:44:07.065 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:44:07.065 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:07.066 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:07.066 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-04-18T14:44:07.066 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:40.758084+0000", 2024-04-18T14:44:07.066 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:44:07.066 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:07.066 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:07.067 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-04-18T14:44:07.067 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:40.758082+0000", 2024-04-18T14:44:07.067 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999976 2024-04-18T14:44:07.067 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:07.067 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:07.067 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-04-18T14:44:07.068 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:40.758095+0000", 2024-04-18T14:44:07.068 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.2542e-05 2024-04-18T14:44:07.068 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:07.068 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:07.068 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-04-18T14:44:07.068 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:40.758121+0000", 2024-04-18T14:44:07.069 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.6653e-05 2024-04-18T14:44:07.069 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:07.069 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:07.069 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-04-18T14:44:07.069 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:40.758136+0000", 2024-04-18T14:44:07.069 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.4647999999999999e-05 2024-04-18T14:44:07.070 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:07.070 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:07.070 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-04-18T14:44:07.070 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:40.758238+0000", 2024-04-18T14:44:07.070 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000102221 2024-04-18T14:44:07.070 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:07.071 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:07.071 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op must wait for map", 2024-04-18T14:44:07.071 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:40.758252+0000", 2024-04-18T14:44:07.072 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.4409999999999999e-05 2024-04-18T14:44:07.072 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:07.073 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:07.073 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-04-18T14:44:07.073 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:40.764488+0000", 2024-04-18T14:44:07.073 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0062357890000000003 2024-04-18T14:44:07.073 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:07.074 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:07.074 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-04-18T14:44:07.074 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:40.764705+0000", 2024-04-18T14:44:07.074 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00021706000000000001 2024-04-18T14:44:07.075 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:07.075 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:07.075 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-04-18T14:44:07.075 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:40.775034+0000", 2024-04-18T14:44:07.075 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.010328198 2024-04-18T14:44:07.075 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:44:07.076 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-04-18T14:44:07.076 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:44:07.076 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:07.076 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:07.076 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4559.0:486 3.9s0 3:98a09a6d:::smithi13430248-38:head [append 0~720896] snapc 19=[19,16,14,13,11,f,b,a,7,2] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-18T14:44:07.076 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-04-18T14:43:56.447555+0000", 2024-04-18T14:44:07.076 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 10.612679948, 2024-04-18T14:44:07.077 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.01549087, 2024-04-18T14:44:07.077 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-04-18T14:44:07.077 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T14:44:07.077 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-04-18T14:44:07.077 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4559", 2024-04-18T14:44:07.077 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.134:0/3113589487", 2024-04-18T14:44:07.077 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 486 2024-04-18T14:44:07.078 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:07.078 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-04-18T14:44:07.078 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:07.078 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-04-18T14:44:07.078 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:56.447555+0000", 2024-04-18T14:44:07.078 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:44:07.078 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:07.079 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:07.079 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-04-18T14:44:07.079 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:56.447555+0000", 2024-04-18T14:44:07.079 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:44:07.079 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:07.079 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:07.080 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-04-18T14:44:07.080 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:56.447551+0000", 2024-04-18T14:44:07.080 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999962 2024-04-18T14:44:07.080 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:07.081 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:07.081 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-04-18T14:44:07.081 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:56.448771+0000", 2024-04-18T14:44:07.081 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.001219543 2024-04-18T14:44:07.081 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:07.081 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:07.081 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-04-18T14:44:07.082 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:56.448806+0000", 2024-04-18T14:44:07.082 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.5199e-05 2024-04-18T14:44:07.082 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:07.082 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:07.082 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-04-18T14:44:07.083 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:56.448831+0000", 2024-04-18T14:44:07.083 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.4803e-05 2024-04-18T14:44:07.083 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:07.083 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:07.083 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-04-18T14:44:07.083 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:56.448963+0000", 2024-04-18T14:44:07.083 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00013249299999999999 2024-04-18T14:44:07.084 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:07.084 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:07.084 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-04-18T14:44:07.084 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:56.449126+0000", 2024-04-18T14:44:07.084 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00016307299999999999 2024-04-18T14:44:07.084 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:07.085 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:07.085 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_started", 2024-04-18T14:44:07.085 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:56.451189+0000", 2024-04-18T14:44:07.085 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.002062454 2024-04-18T14:44:07.085 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:07.085 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:07.086 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_committed", 2024-04-18T14:44:07.086 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:56.459360+0000", 2024-04-18T14:44:07.086 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0081711389999999991 2024-04-18T14:44:07.086 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:07.086 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:07.086 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-04-18T14:44:07.087 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:56.462826+0000", 2024-04-18T14:44:07.087 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0034659249999999999 2024-04-18T14:44:07.087 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:07.087 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:07.087 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-04-18T14:44:07.087 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:56.463046+0000", 2024-04-18T14:44:07.087 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00022002400000000001 2024-04-18T14:44:07.088 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:44:07.088 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-04-18T14:44:07.088 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:44:07.088 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:07.088 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:07.088 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4559.0:487 3.9s0 3:98a09a6d:::smithi13430248-38:head [append 0~442368] snapc 19=[19,16,14,13,11,f,b,a,7,2] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-18T14:44:07.089 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-04-18T14:43:56.450970+0000", 2024-04-18T14:44:07.089 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 10.609264854999999, 2024-04-18T14:44:07.089 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.014296059999999999, 2024-04-18T14:44:07.089 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-04-18T14:44:07.090 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T14:44:07.090 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-04-18T14:44:07.090 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4559", 2024-04-18T14:44:07.090 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.134:0/3113589487", 2024-04-18T14:44:07.090 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 487 2024-04-18T14:44:07.090 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:07.091 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-04-18T14:44:07.091 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:07.091 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-04-18T14:44:07.091 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:56.450970+0000", 2024-04-18T14:44:07.091 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:44:07.091 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:07.091 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:07.092 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-04-18T14:44:07.092 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:56.450970+0000", 2024-04-18T14:44:07.092 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:44:07.092 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:07.092 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:07.092 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-04-18T14:44:07.093 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:56.450968+0000", 2024-04-18T14:44:07.093 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999981 2024-04-18T14:44:07.093 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:07.093 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:07.093 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-04-18T14:44:07.093 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:56.452370+0000", 2024-04-18T14:44:07.094 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0014018780000000001 2024-04-18T14:44:07.094 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:07.094 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:07.094 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-04-18T14:44:07.094 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:56.452401+0000", 2024-04-18T14:44:07.095 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.0929000000000002e-05 2024-04-18T14:44:07.095 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:07.095 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:07.095 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-04-18T14:44:07.095 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:56.452421+0000", 2024-04-18T14:44:07.095 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.9996e-05 2024-04-18T14:44:07.096 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:07.096 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:07.096 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-04-18T14:44:07.096 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:56.454319+0000", 2024-04-18T14:44:07.097 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.001898928 2024-04-18T14:44:07.097 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:07.097 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:07.097 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-04-18T14:44:07.097 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:56.454545+0000", 2024-04-18T14:44:07.098 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000225107 2024-04-18T14:44:07.098 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:07.098 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:07.098 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_started", 2024-04-18T14:44:07.098 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:56.456501+0000", 2024-04-18T14:44:07.098 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0019567260000000002 2024-04-18T14:44:07.099 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:07.099 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:07.099 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_committed", 2024-04-18T14:44:07.099 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:56.461859+0000", 2024-04-18T14:44:07.099 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0053572100000000003 2024-04-18T14:44:07.099 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:07.099 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:07.100 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-04-18T14:44:07.100 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:56.465119+0000", 2024-04-18T14:44:07.100 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0032608429999999998 2024-04-18T14:44:07.100 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:07.100 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:07.100 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-04-18T14:44:07.101 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:56.465266+0000", 2024-04-18T14:44:07.101 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00014657299999999999 2024-04-18T14:44:07.101 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:44:07.101 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-04-18T14:44:07.101 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:44:07.101 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:07.101 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:07.101 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4559.0:488 3.9s0 3:98a09a6d:::smithi13430248-38:head [append 0~327680] snapc 19=[19,16,14,13,11,f,b,a,7,2] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-18T14:44:07.101 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-04-18T14:43:56.453627+0000", 2024-04-18T14:44:07.101 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 10.606608057999999, 2024-04-18T14:44:07.101 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.012641879, 2024-04-18T14:44:07.101 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-04-18T14:44:07.102 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T14:44:07.102 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-04-18T14:44:07.102 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4559", 2024-04-18T14:44:07.102 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.134:0/3113589487", 2024-04-18T14:44:07.102 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 488 2024-04-18T14:44:07.102 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:07.106 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-04-18T14:44:07.107 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:07.107 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-04-18T14:44:07.107 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:56.453627+0000", 2024-04-18T14:44:07.107 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:44:07.107 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:07.107 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:07.107 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-04-18T14:44:07.107 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:56.453627+0000", 2024-04-18T14:44:07.107 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:44:07.107 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:07.107 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:07.107 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-04-18T14:44:07.107 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:56.453624+0000", 2024-04-18T14:44:07.108 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999971 2024-04-18T14:44:07.108 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:07.108 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:07.108 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-04-18T14:44:07.108 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:56.454243+0000", 2024-04-18T14:44:07.108 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00061905300000000005 2024-04-18T14:44:07.108 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:07.108 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:07.108 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-04-18T14:44:07.108 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:56.454276+0000", 2024-04-18T14:44:07.108 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.3399000000000003e-05 2024-04-18T14:44:07.108 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:07.108 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:07.108 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-04-18T14:44:07.108 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:56.454298+0000", 2024-04-18T14:44:07.109 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.1416e-05 2024-04-18T14:44:07.109 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:07.109 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:07.109 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-04-18T14:44:07.109 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:56.459395+0000", 2024-04-18T14:44:07.109 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0050973590000000001 2024-04-18T14:44:07.109 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:07.109 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:07.109 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-04-18T14:44:07.109 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:56.459535+0000", 2024-04-18T14:44:07.109 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00013988 2024-04-18T14:44:07.109 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:07.109 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:07.109 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_started", 2024-04-18T14:44:07.109 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:56.460302+0000", 2024-04-18T14:44:07.110 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00076662500000000005 2024-04-18T14:44:07.110 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:07.110 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:07.110 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_committed", 2024-04-18T14:44:07.110 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:56.463194+0000", 2024-04-18T14:44:07.110 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0028919269999999999 2024-04-18T14:44:07.110 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:07.110 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:07.110 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-04-18T14:44:07.110 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:56.466136+0000", 2024-04-18T14:44:07.110 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0029428890000000002 2024-04-18T14:44:07.110 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:07.110 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:07.110 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-04-18T14:44:07.110 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:56.466269+0000", 2024-04-18T14:44:07.111 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00013214100000000001 2024-04-18T14:44:07.111 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:44:07.111 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-04-18T14:44:07.111 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:44:07.111 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:07.111 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:07.111 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4559.0:489 3.9s0 3:98a09a6d:::smithi13430248-38:head [setxattr _header (57) in=7b] snapc 19=[19,16,14,13,11,f,b,a,7,2] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-18T14:44:07.111 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-04-18T14:43:56.454317+0000", 2024-04-18T14:44:07.111 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 10.605917751, 2024-04-18T14:44:07.111 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.012423783000000001, 2024-04-18T14:44:07.111 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-04-18T14:44:07.111 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T14:44:07.111 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-04-18T14:44:07.111 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4559", 2024-04-18T14:44:07.111 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.134:0/3113589487", 2024-04-18T14:44:07.112 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 489 2024-04-18T14:44:07.112 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:07.112 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-04-18T14:44:07.112 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:07.112 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-04-18T14:44:07.112 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:56.454317+0000", 2024-04-18T14:44:07.112 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:44:07.112 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:07.112 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:07.112 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-04-18T14:44:07.112 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:56.454317+0000", 2024-04-18T14:44:07.112 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:44:07.112 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:07.112 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:07.112 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-04-18T14:44:07.113 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:56.454315+0000", 2024-04-18T14:44:07.113 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999986 2024-04-18T14:44:07.113 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:07.113 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:07.113 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-04-18T14:44:07.113 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:56.454328+0000", 2024-04-18T14:44:07.113 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.309e-05 2024-04-18T14:44:07.113 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:07.113 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:07.113 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-04-18T14:44:07.113 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:56.454346+0000", 2024-04-18T14:44:07.113 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.7269e-05 2024-04-18T14:44:07.113 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:07.113 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:07.113 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-04-18T14:44:07.113 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:56.454361+0000", 2024-04-18T14:44:07.114 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.5549999999999999e-05 2024-04-18T14:44:07.114 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:07.114 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:07.114 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-04-18T14:44:07.114 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:56.460968+0000", 2024-04-18T14:44:07.114 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0066067950000000004 2024-04-18T14:44:07.114 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:07.114 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:07.114 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-04-18T14:44:07.114 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:56.461114+0000", 2024-04-18T14:44:07.114 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00014624000000000001 2024-04-18T14:44:07.114 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:07.114 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:07.114 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_started", 2024-04-18T14:44:07.114 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:56.461614+0000", 2024-04-18T14:44:07.115 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00049955500000000005 2024-04-18T14:44:07.115 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:07.115 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:07.115 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_committed", 2024-04-18T14:44:07.115 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:56.464895+0000", 2024-04-18T14:44:07.115 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0032811110000000002 2024-04-18T14:44:07.115 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:07.115 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:07.115 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-04-18T14:44:07.115 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:56.466578+0000", 2024-04-18T14:44:07.115 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.001682577 2024-04-18T14:44:07.115 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:07.115 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:07.115 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-04-18T14:44:07.115 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:56.466741+0000", 2024-04-18T14:44:07.116 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00016322600000000001 2024-04-18T14:44:07.116 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:44:07.116 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-04-18T14:44:07.116 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:44:07.116 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:07.116 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:07.116 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4559.0:490 3.9s0 3:98a09a6d:::smithi13430248-38:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e57)", 2024-04-18T14:44:07.116 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-04-18T14:43:56.454375+0000", 2024-04-18T14:44:07.116 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 10.605859469, 2024-04-18T14:44:07.116 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.015524559, 2024-04-18T14:44:07.116 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-04-18T14:44:07.116 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-04-18T14:44:07.116 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-04-18T14:44:07.116 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4559", 2024-04-18T14:44:07.116 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.134:0/3113589487", 2024-04-18T14:44:07.117 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 490 2024-04-18T14:44:07.117 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:07.117 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-04-18T14:44:07.117 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:07.117 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-04-18T14:44:07.117 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:56.454375+0000", 2024-04-18T14:44:07.117 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:44:07.117 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:07.117 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:07.117 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-04-18T14:44:07.117 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:56.454375+0000", 2024-04-18T14:44:07.117 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:44:07.117 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:07.117 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:07.117 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-04-18T14:44:07.118 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:56.454374+0000", 2024-04-18T14:44:07.118 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999986 2024-04-18T14:44:07.118 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:07.118 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:07.118 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-04-18T14:44:07.118 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:56.454383+0000", 2024-04-18T14:44:07.118 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.4530000000000008e-06 2024-04-18T14:44:07.118 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:07.118 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:07.118 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-04-18T14:44:07.118 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:56.454402+0000", 2024-04-18T14:44:07.118 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.8315999999999999e-05 2024-04-18T14:44:07.118 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:07.118 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:07.118 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-04-18T14:44:07.119 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:56.454417+0000", 2024-04-18T14:44:07.119 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.5033e-05 2024-04-18T14:44:07.119 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:07.119 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:07.119 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-04-18T14:44:07.119 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:56.464402+0000", 2024-04-18T14:44:07.119 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0099848720000000005 2024-04-18T14:44:07.119 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:07.119 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:07.119 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for rw locks", 2024-04-18T14:44:07.119 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:56.464745+0000", 2024-04-18T14:44:07.119 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00034393 2024-04-18T14:44:07.119 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:07.119 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:07.119 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-04-18T14:44:07.120 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:56.467517+0000", 2024-04-18T14:44:07.120 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0027717839999999998 2024-04-18T14:44:07.120 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:07.120 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:07.120 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-04-18T14:44:07.120 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:56.467784+0000", 2024-04-18T14:44:07.120 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00026669200000000001 2024-04-18T14:44:07.120 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:07.120 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:07.120 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-04-18T14:44:07.120 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:56.469900+0000", 2024-04-18T14:44:07.120 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0021158919999999999 2024-04-18T14:44:07.120 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:44:07.120 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-04-18T14:44:07.120 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:44:07.121 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:07.121 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:07.121 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4559.0:502 3.9s0 3:98a09a6d:::smithi13430248-38:head [append 0~0] snapc 19=[19,16,14,13,11,f,b,a,7,2] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-18T14:44:07.121 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-04-18T14:43:56.547072+0000", 2024-04-18T14:44:07.121 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 10.513162788000001, 2024-04-18T14:44:07.121 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0091378550000000003, 2024-04-18T14:44:07.121 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-04-18T14:44:07.121 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T14:44:07.121 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-04-18T14:44:07.121 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4559", 2024-04-18T14:44:07.121 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.134:0/3113589487", 2024-04-18T14:44:07.121 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 502 2024-04-18T14:44:07.121 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:07.121 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-04-18T14:44:07.121 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:07.121 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-04-18T14:44:07.122 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:56.547072+0000", 2024-04-18T14:44:07.122 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:44:07.122 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:07.122 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:07.122 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-04-18T14:44:07.122 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:56.547072+0000", 2024-04-18T14:44:07.122 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:44:07.122 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:07.122 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:07.122 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-04-18T14:44:07.122 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:56.547069+0000", 2024-04-18T14:44:07.122 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999971 2024-04-18T14:44:07.122 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:07.122 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:07.123 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-04-18T14:44:07.123 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:56.547082+0000", 2024-04-18T14:44:07.123 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.2662e-05 2024-04-18T14:44:07.123 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:07.123 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:07.123 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-04-18T14:44:07.123 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:56.547110+0000", 2024-04-18T14:44:07.123 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.7795000000000001e-05 2024-04-18T14:44:07.123 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:07.123 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:07.123 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-04-18T14:44:07.123 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:56.547123+0000", 2024-04-18T14:44:07.123 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.3063e-05 2024-04-18T14:44:07.123 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:07.123 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:07.123 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-04-18T14:44:07.124 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:56.547202+0000", 2024-04-18T14:44:07.124 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.9250000000000002e-05 2024-04-18T14:44:07.124 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:07.124 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:07.124 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-04-18T14:44:07.124 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:56.547338+0000", 2024-04-18T14:44:07.124 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000136379 2024-04-18T14:44:07.124 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:07.124 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:07.124 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_started", 2024-04-18T14:44:07.124 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:56.547734+0000", 2024-04-18T14:44:07.124 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000395654 2024-04-18T14:44:07.124 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:07.124 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:07.124 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_committed", 2024-04-18T14:44:07.124 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:56.550762+0000", 2024-04-18T14:44:07.125 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0030281349999999999 2024-04-18T14:44:07.125 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:07.125 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:07.125 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-04-18T14:44:07.125 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:56.556144+0000", 2024-04-18T14:44:07.125 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0053817980000000001 2024-04-18T14:44:07.125 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:07.125 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:07.125 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-04-18T14:44:07.125 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:56.556210+0000", 2024-04-18T14:44:07.125 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.5889999999999994e-05 2024-04-18T14:44:07.125 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:44:07.125 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-04-18T14:44:07.125 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:44:07.125 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:07.126 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:07.126 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4559.0:503 3.9s0 3:98a09a6d:::smithi13430248-38:head [rollback b] snapc 19=[19,16,14,13,11,f,b,a,7,2] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-18T14:44:07.126 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-04-18T14:43:56.547141+0000", 2024-04-18T14:44:07.126 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 10.513093324, 2024-04-18T14:44:07.126 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.010673334, 2024-04-18T14:44:07.126 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-04-18T14:44:07.126 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T14:44:07.126 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-04-18T14:44:07.126 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4559", 2024-04-18T14:44:07.126 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.134:0/3113589487", 2024-04-18T14:44:07.126 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 503 2024-04-18T14:44:07.126 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:07.126 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-04-18T14:44:07.126 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:07.126 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-04-18T14:44:07.127 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:56.547141+0000", 2024-04-18T14:44:07.127 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:44:07.127 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:07.127 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:07.127 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-04-18T14:44:07.127 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:56.547141+0000", 2024-04-18T14:44:07.127 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:44:07.127 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:07.127 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:07.127 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-04-18T14:44:07.127 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:56.547141+0000", 2024-04-18T14:44:07.127 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-04-18T14:44:07.127 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:07.127 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:07.127 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-04-18T14:44:07.127 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:56.547146+0000", 2024-04-18T14:44:07.128 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.1100000000000002e-06 2024-04-18T14:44:07.128 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:07.128 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:07.128 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-04-18T14:44:07.128 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:56.547157+0000", 2024-04-18T14:44:07.128 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.1328000000000001e-05 2024-04-18T14:44:07.128 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:07.128 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:07.128 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-04-18T14:44:07.128 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:56.547175+0000", 2024-04-18T14:44:07.128 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.7564e-05 2024-04-18T14:44:07.128 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:07.128 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:07.128 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-04-18T14:44:07.128 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:56.548083+0000", 2024-04-18T14:44:07.129 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00090815000000000004 2024-04-18T14:44:07.129 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:07.129 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:07.129 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-04-18T14:44:07.129 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:56.548225+0000", 2024-04-18T14:44:07.129 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00014208800000000001 2024-04-18T14:44:07.129 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:07.129 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:07.129 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_started", 2024-04-18T14:44:07.129 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:56.549058+0000", 2024-04-18T14:44:07.129 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00083258799999999999 2024-04-18T14:44:07.129 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:07.129 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:07.129 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_committed", 2024-04-18T14:44:07.129 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:56.550878+0000", 2024-04-18T14:44:07.130 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0018205750000000001 2024-04-18T14:44:07.130 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:07.130 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:07.130 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-04-18T14:44:07.130 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:56.557756+0000", 2024-04-18T14:44:07.130 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0068781570000000002 2024-04-18T14:44:07.130 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:07.130 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:07.130 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-04-18T14:44:07.130 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:56.557815+0000", 2024-04-18T14:44:07.130 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.8501000000000001e-05 2024-04-18T14:44:07.130 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:44:07.130 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-04-18T14:44:07.130 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:44:07.130 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:07.131 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:07.131 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4559.0:504 3.9s0 3:98a09a6d:::smithi13430248-38:head [append 0~0] snapc 19=[19,16,14,13,11,f,b,a,7,2] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-18T14:44:07.131 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-04-18T14:43:56.547183+0000", 2024-04-18T14:44:07.131 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 10.513052041, 2024-04-18T14:44:07.131 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.013133432, 2024-04-18T14:44:07.131 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-04-18T14:44:07.131 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T14:44:07.131 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-04-18T14:44:07.131 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4559", 2024-04-18T14:44:07.131 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.134:0/3113589487", 2024-04-18T14:44:07.131 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 504 2024-04-18T14:44:07.131 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:07.131 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-04-18T14:44:07.131 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:07.131 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-04-18T14:44:07.132 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:56.547183+0000", 2024-04-18T14:44:07.132 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:44:07.132 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:07.132 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:07.132 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-04-18T14:44:07.132 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:56.547183+0000", 2024-04-18T14:44:07.132 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:44:07.132 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:07.132 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:07.132 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-04-18T14:44:07.132 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:56.547182+0000", 2024-04-18T14:44:07.132 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-04-18T14:44:07.132 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:07.132 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:07.132 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-04-18T14:44:07.133 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:56.547186+0000", 2024-04-18T14:44:07.133 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.464e-06 2024-04-18T14:44:07.133 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:07.133 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:07.133 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-04-18T14:44:07.133 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:56.547196+0000", 2024-04-18T14:44:07.133 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.5400000000000001e-06 2024-04-18T14:44:07.133 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:07.133 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:07.133 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-04-18T14:44:07.133 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:56.547203+0000", 2024-04-18T14:44:07.133 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.72e-06 2024-04-18T14:44:07.133 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:07.133 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:07.133 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-04-18T14:44:07.134 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:56.549707+0000", 2024-04-18T14:44:07.134 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0025045990000000001 2024-04-18T14:44:07.134 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:07.134 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:07.134 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-04-18T14:44:07.134 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:56.549841+0000", 2024-04-18T14:44:07.134 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000133404 2024-04-18T14:44:07.134 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:07.134 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:07.134 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_started", 2024-04-18T14:44:07.134 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:56.550457+0000", 2024-04-18T14:44:07.134 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00061647000000000004 2024-04-18T14:44:07.134 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:07.134 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:07.135 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_committed", 2024-04-18T14:44:07.135 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:56.551675+0000", 2024-04-18T14:44:07.135 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0012178600000000001 2024-04-18T14:44:07.135 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:07.135 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:07.135 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-04-18T14:44:07.135 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:56.560246+0000", 2024-04-18T14:44:07.135 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0085714169999999996 2024-04-18T14:44:07.135 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:07.135 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:07.135 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-04-18T14:44:07.135 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:56.560316+0000", 2024-04-18T14:44:07.135 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.9645000000000002e-05 2024-04-18T14:44:07.135 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:44:07.135 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-04-18T14:44:07.135 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:44:07.136 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:07.136 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:07.136 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4559.0:507 3.9s0 3:9cf55191:::smithi13430248-16:head [copy-from ver 48] snapc 19=[19,16,14,13,11,f,b,a,7,2] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-18T14:44:07.136 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-04-18T14:43:56.576189+0000", 2024-04-18T14:44:07.136 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 10.484045466, 2024-04-18T14:44:07.136 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.020256327000000001, 2024-04-18T14:44:07.136 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-04-18T14:44:07.136 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T14:44:07.136 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-04-18T14:44:07.136 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4559", 2024-04-18T14:44:07.136 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.134:0/3113589487", 2024-04-18T14:44:07.136 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 507 2024-04-18T14:44:07.136 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:07.136 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-04-18T14:44:07.136 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:07.137 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-04-18T14:44:07.137 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:56.576189+0000", 2024-04-18T14:44:07.137 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:44:07.137 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:07.137 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:07.137 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-04-18T14:44:07.137 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:56.576189+0000", 2024-04-18T14:44:07.137 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:44:07.137 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:07.137 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:07.137 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-04-18T14:44:07.137 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:56.576187+0000", 2024-04-18T14:44:07.137 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999976 2024-04-18T14:44:07.137 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:07.137 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:07.138 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-04-18T14:44:07.138 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:56.576199+0000", 2024-04-18T14:44:07.138 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.2729e-05 2024-04-18T14:44:07.138 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:07.138 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:07.138 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-04-18T14:44:07.138 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:56.576222+0000", 2024-04-18T14:44:07.138 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.2047000000000001e-05 2024-04-18T14:44:07.138 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:07.138 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:07.138 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-04-18T14:44:07.138 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:56.576233+0000", 2024-04-18T14:44:07.138 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.1741e-05 2024-04-18T14:44:07.138 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:07.138 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:07.139 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-04-18T14:44:07.139 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:56.576290+0000", 2024-04-18T14:44:07.139 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.6774000000000002e-05 2024-04-18T14:44:07.139 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:07.139 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:07.139 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-04-18T14:44:07.139 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:56.576423+0000", 2024-04-18T14:44:07.139 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00013259 2024-04-18T14:44:07.139 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:07.139 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:07.139 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_started", 2024-04-18T14:44:07.139 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:56.585718+0000", 2024-04-18T14:44:07.139 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0092951079999999998 2024-04-18T14:44:07.139 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:07.139 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:07.139 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_committed", 2024-04-18T14:44:07.140 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:56.593570+0000", 2024-04-18T14:44:07.140 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.007852632 2024-04-18T14:44:07.140 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:07.140 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:07.140 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-04-18T14:44:07.140 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:56.596350+0000", 2024-04-18T14:44:07.140 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0027794489999999998 2024-04-18T14:44:07.140 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:07.140 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:07.140 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-04-18T14:44:07.140 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:56.596446+0000", 2024-04-18T14:44:07.140 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.5773000000000006e-05 2024-04-18T14:44:07.140 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:44:07.140 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-04-18T14:44:07.140 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:44:07.140 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:07.141 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:07.141 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4559.0:508 3.9s0 3:9cf55191:::smithi13430248-16:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e57)", 2024-04-18T14:44:07.141 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-04-18T14:43:56.576245+0000", 2024-04-18T14:44:07.141 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 10.483989543, 2024-04-18T14:44:07.141 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.012675728000000001, 2024-04-18T14:44:07.141 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-04-18T14:44:07.141 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-04-18T14:44:07.141 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-04-18T14:44:07.141 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4559", 2024-04-18T14:44:07.141 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.134:0/3113589487", 2024-04-18T14:44:07.141 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 508 2024-04-18T14:44:07.141 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:07.141 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-04-18T14:44:07.141 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:07.141 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-04-18T14:44:07.142 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:56.576245+0000", 2024-04-18T14:44:07.142 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:44:07.142 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:07.142 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:07.142 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-04-18T14:44:07.142 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:56.576245+0000", 2024-04-18T14:44:07.142 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:44:07.142 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:07.142 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:07.142 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-04-18T14:44:07.142 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:56.576245+0000", 2024-04-18T14:44:07.142 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-04-18T14:44:07.142 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:07.142 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:07.143 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-04-18T14:44:07.143 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:56.576248+0000", 2024-04-18T14:44:07.143 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.625e-06 2024-04-18T14:44:07.143 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:07.143 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:07.143 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-04-18T14:44:07.143 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:56.576257+0000", 2024-04-18T14:44:07.143 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.9910000000000008e-06 2024-04-18T14:44:07.143 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:07.143 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:07.143 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-04-18T14:44:07.143 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:56.576264+0000", 2024-04-18T14:44:07.143 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.5869999999999998e-06 2024-04-18T14:44:07.143 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:07.143 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:07.144 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-04-18T14:44:07.144 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:56.576670+0000", 2024-04-18T14:44:07.144 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000405976 2024-04-18T14:44:07.144 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:07.144 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:07.144 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for blocked object", 2024-04-18T14:44:07.144 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:56.576749+0000", 2024-04-18T14:44:07.144 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.8882999999999997e-05 2024-04-18T14:44:07.144 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:07.144 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:07.144 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-04-18T14:44:07.144 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:56.588691+0000", 2024-04-18T14:44:07.144 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.011942708 2024-04-18T14:44:07.144 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:07.144 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:07.144 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-04-18T14:44:07.145 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:56.588815+0000", 2024-04-18T14:44:07.145 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00012397299999999999 2024-04-18T14:44:07.145 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:07.145 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:07.145 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-04-18T14:44:07.145 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:56.588921+0000", 2024-04-18T14:44:07.145 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00010563799999999999 2024-04-18T14:44:07.145 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:44:07.145 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-04-18T14:44:07.145 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:44:07.145 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:07.145 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:07.145 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "MOSDECSubOpWrite(3.1s4 57/30 ECSubWrite(tid=39, reqid=client.4559.0:512, at_version=57'26, trim_to=0'0, roll_forward_to=53'24))", 2024-04-18T14:44:07.145 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-04-18T14:43:56.586438+0000", 2024-04-18T14:44:07.145 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 10.473796961, 2024-04-18T14:44:07.146 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.010461745999999999, 2024-04-18T14:44:07.146 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-04-18T14:44:07.146 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "reached pg", 2024-04-18T14:44:07.146 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-04-18T14:44:07.146 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:07.146 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-04-18T14:44:07.146 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:56.586438+0000", 2024-04-18T14:44:07.146 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:44:07.146 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:07.146 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:07.146 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-04-18T14:44:07.146 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:56.586438+0000", 2024-04-18T14:44:07.146 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:44:07.146 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:07.146 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:07.147 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-04-18T14:44:07.147 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:56.586437+0000", 2024-04-18T14:44:07.147 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999986 2024-04-18T14:44:07.147 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:07.147 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:07.147 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-04-18T14:44:07.147 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:56.588141+0000", 2024-04-18T14:44:07.147 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.001704845 2024-04-18T14:44:07.147 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:07.147 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:07.147 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-04-18T14:44:07.147 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:56.588160+0000", 2024-04-18T14:44:07.147 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.9086999999999999e-05 2024-04-18T14:44:07.147 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:07.147 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:07.148 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-04-18T14:44:07.148 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:56.588175+0000", 2024-04-18T14:44:07.148 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.4138000000000001e-05 2024-04-18T14:44:07.148 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:07.148 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:07.148 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-04-18T14:44:07.148 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:56.588719+0000", 2024-04-18T14:44:07.148 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00054445700000000004 2024-04-18T14:44:07.148 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:07.148 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:07.148 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_started", 2024-04-18T14:44:07.148 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:56.588731+0000", 2024-04-18T14:44:07.148 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.1711e-05 2024-04-18T14:44:07.148 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:07.148 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:07.148 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_committed", 2024-04-18T14:44:07.149 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:56.596867+0000", 2024-04-18T14:44:07.149 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0081359929999999994 2024-04-18T14:44:07.149 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:07.149 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:07.149 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-04-18T14:44:07.149 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:56.596900+0000", 2024-04-18T14:44:07.149 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.2753000000000003e-05 2024-04-18T14:44:07.149 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:44:07.149 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-04-18T14:44:07.149 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:44:07.149 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:07.149 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:07.149 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4559.0:575 3.9s0 3:9cf55191:::smithi13430248-16:head [append 0~491520] snapc 1e=[1e,1d,1c,1a,19,16,14,13,11,b,a,7,2] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-04-18T14:44:07.149 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-04-18T14:44:01.427816+0000", 2024-04-18T14:44:07.149 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 5.6324190239999998, 2024-04-18T14:44:07.150 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0079229379999999992, 2024-04-18T14:44:07.150 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-04-18T14:44:07.150 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T14:44:07.150 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-04-18T14:44:07.150 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4559", 2024-04-18T14:44:07.150 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.134:0/3113589487", 2024-04-18T14:44:07.150 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 575 2024-04-18T14:44:07.150 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:07.150 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-04-18T14:44:07.150 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:07.150 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-04-18T14:44:07.150 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:01.427816+0000", 2024-04-18T14:44:07.150 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:44:07.150 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:07.150 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:07.150 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-04-18T14:44:07.151 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:01.427816+0000", 2024-04-18T14:44:07.151 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:44:07.151 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:07.151 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:07.151 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-04-18T14:44:07.151 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:01.427814+0000", 2024-04-18T14:44:07.151 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999981 2024-04-18T14:44:07.151 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:07.151 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:07.151 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-04-18T14:44:07.151 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:01.428591+0000", 2024-04-18T14:44:07.151 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00077674000000000005 2024-04-18T14:44:07.151 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:07.151 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:07.151 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-04-18T14:44:07.152 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:01.428607+0000", 2024-04-18T14:44:07.152 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.6308e-05 2024-04-18T14:44:07.152 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:07.152 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:07.152 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-04-18T14:44:07.152 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:01.428613+0000", 2024-04-18T14:44:07.152 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.4670000000000001e-06 2024-04-18T14:44:07.152 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:07.152 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:07.152 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-04-18T14:44:07.152 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:01.428668+0000", 2024-04-18T14:44:07.152 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.435e-05 2024-04-18T14:44:07.152 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:07.152 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:07.152 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-04-18T14:44:07.152 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:01.428770+0000", 2024-04-18T14:44:07.153 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00010254700000000001 2024-04-18T14:44:07.153 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:07.153 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:07.153 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_started", 2024-04-18T14:44:07.153 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:01.429843+0000", 2024-04-18T14:44:07.153 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.001072171 2024-04-18T14:44:07.153 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:07.153 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:07.153 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_committed", 2024-04-18T14:44:07.153 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:01.431463+0000", 2024-04-18T14:44:07.153 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.001620184 2024-04-18T14:44:07.153 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:07.153 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:07.153 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-04-18T14:44:07.153 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:01.435673+0000", 2024-04-18T14:44:07.154 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0042103770000000004 2024-04-18T14:44:07.154 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:07.154 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:07.154 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-04-18T14:44:07.154 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:01.435739+0000", 2024-04-18T14:44:07.154 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.5535000000000002e-05 2024-04-18T14:44:07.154 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:44:07.154 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-04-18T14:44:07.154 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:44:07.154 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:07.154 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:07.154 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4559.0:580 3.9s0 3:9cf55191:::smithi13430248-16:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e62)", 2024-04-18T14:44:07.154 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-04-18T14:44:01.446416+0000", 2024-04-18T14:44:07.154 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 5.6138187659999996, 2024-04-18T14:44:07.154 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0091626039999999995, 2024-04-18T14:44:07.155 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-04-18T14:44:07.155 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-04-18T14:44:07.155 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-04-18T14:44:07.155 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4559", 2024-04-18T14:44:07.155 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.134:0/3113589487", 2024-04-18T14:44:07.155 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 580 2024-04-18T14:44:07.155 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:07.155 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-04-18T14:44:07.155 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:07.155 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-04-18T14:44:07.155 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:01.446416+0000", 2024-04-18T14:44:07.155 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:44:07.155 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:07.155 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:07.155 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-04-18T14:44:07.156 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:01.446416+0000", 2024-04-18T14:44:07.156 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:44:07.156 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:07.156 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:07.156 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-04-18T14:44:07.156 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:01.446415+0000", 2024-04-18T14:44:07.156 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-04-18T14:44:07.156 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:07.156 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:07.156 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-04-18T14:44:07.156 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:01.446420+0000", 2024-04-18T14:44:07.156 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.2569999999999998e-06 2024-04-18T14:44:07.156 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:07.156 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:07.156 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-04-18T14:44:07.157 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:01.446434+0000", 2024-04-18T14:44:07.157 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.4136e-05 2024-04-18T14:44:07.157 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:07.157 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:07.157 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-04-18T14:44:07.157 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:01.446445+0000", 2024-04-18T14:44:07.157 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.0633e-05 2024-04-18T14:44:07.157 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:07.157 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:07.157 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-04-18T14:44:07.157 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:01.449395+0000", 2024-04-18T14:44:07.157 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.002949718 2024-04-18T14:44:07.157 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:07.157 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:07.157 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for rw locks", 2024-04-18T14:44:07.158 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:01.449533+0000", 2024-04-18T14:44:07.158 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000137806 2024-04-18T14:44:07.158 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:07.158 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:07.158 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-04-18T14:44:07.158 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:01.453383+0000", 2024-04-18T14:44:07.158 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0038508330000000001 2024-04-18T14:44:07.158 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:07.158 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:07.158 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-04-18T14:44:07.158 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:01.453462+0000", 2024-04-18T14:44:07.158 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.8818000000000003e-05 2024-04-18T14:44:07.158 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:07.158 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:07.158 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-04-18T14:44:07.159 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:01.455579+0000", 2024-04-18T14:44:07.159 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0021162860000000002 2024-04-18T14:44:07.159 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:44:07.159 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-04-18T14:44:07.159 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:44:07.159 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:07.159 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:07.159 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "MOSDECSubOpWrite(3.1s4 63/30 ECSubWrite(tid=57, reqid=osd.6.0:57, at_version=63'39, trim_to=0'0, roll_forward_to=59'35))", 2024-04-18T14:44:07.159 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-04-18T14:44:02.387500+0000", 2024-04-18T14:44:07.159 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 4.6727347349999997, 2024-04-18T14:44:07.159 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0087134499999999993, 2024-04-18T14:44:07.159 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-04-18T14:44:07.159 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "reached pg", 2024-04-18T14:44:07.159 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-04-18T14:44:07.159 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:07.160 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-04-18T14:44:07.160 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:02.387500+0000", 2024-04-18T14:44:07.160 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:44:07.160 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:07.160 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:07.160 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-04-18T14:44:07.160 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:02.387500+0000", 2024-04-18T14:44:07.160 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:44:07.160 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:07.160 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:07.160 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-04-18T14:44:07.160 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:02.387500+0000", 2024-04-18T14:44:07.160 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-04-18T14:44:07.160 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:07.160 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:07.160 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-04-18T14:44:07.161 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:02.387516+0000", 2024-04-18T14:44:07.161 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.5956000000000001e-05 2024-04-18T14:44:07.161 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:07.161 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:07.161 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-04-18T14:44:07.161 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:02.387520+0000", 2024-04-18T14:44:07.161 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.6519999999999997e-06 2024-04-18T14:44:07.161 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:07.161 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:07.161 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-04-18T14:44:07.161 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:02.387524+0000", 2024-04-18T14:44:07.161 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.4240000000000002e-06 2024-04-18T14:44:07.161 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:07.161 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:07.161 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-04-18T14:44:07.162 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:02.388300+0000", 2024-04-18T14:44:07.162 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00077584300000000002 2024-04-18T14:44:07.162 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:07.162 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:07.162 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_started", 2024-04-18T14:44:07.162 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:02.388305+0000", 2024-04-18T14:44:07.162 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.6840000000000001e-06 2024-04-18T14:44:07.162 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:07.162 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:07.162 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_committed", 2024-04-18T14:44:07.162 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:02.396177+0000", 2024-04-18T14:44:07.162 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0078718980000000004 2024-04-18T14:44:07.162 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:07.162 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:07.162 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-04-18T14:44:07.163 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:02.396213+0000", 2024-04-18T14:44:07.163 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.6282999999999998e-05 2024-04-18T14:44:07.163 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:44:07.163 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-04-18T14:44:07.163 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:44:07.163 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:07.163 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:07.163 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4559.0:644 3.9s0 3:94766bb7:::smithi13430248-17:head [append 0~655360] snapc 23=[23,22,1e,1d,1c,1a,16,14,13,11,a,2] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-04-18T14:44:07.163 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-04-18T14:44:06.395465+0000", 2024-04-18T14:44:07.163 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 0.66476962500000003, 2024-04-18T14:44:07.163 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.014701519, 2024-04-18T14:44:07.163 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-04-18T14:44:07.163 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T14:44:07.163 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-04-18T14:44:07.163 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4559", 2024-04-18T14:44:07.164 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.134:0/3113589487", 2024-04-18T14:44:07.164 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 644 2024-04-18T14:44:07.164 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:07.164 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-04-18T14:44:07.164 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:07.164 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-04-18T14:44:07.164 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:06.395465+0000", 2024-04-18T14:44:07.164 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:44:07.164 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:07.164 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:07.164 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-04-18T14:44:07.164 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:06.395465+0000", 2024-04-18T14:44:07.164 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:44:07.164 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:07.164 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:07.164 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-04-18T14:44:07.165 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:06.395462+0000", 2024-04-18T14:44:07.165 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999971 2024-04-18T14:44:07.165 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:07.165 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:07.165 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-04-18T14:44:07.165 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:06.396348+0000", 2024-04-18T14:44:07.165 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00088584199999999997 2024-04-18T14:44:07.165 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:07.165 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:07.165 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-04-18T14:44:07.165 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:06.396371+0000", 2024-04-18T14:44:07.165 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.2841e-05 2024-04-18T14:44:07.165 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:07.165 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:07.165 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-04-18T14:44:07.166 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:06.396385+0000", 2024-04-18T14:44:07.166 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.3878e-05 2024-04-18T14:44:07.166 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:07.166 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:07.166 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-04-18T14:44:07.166 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:06.396460+0000", 2024-04-18T14:44:07.166 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.5066000000000003e-05 2024-04-18T14:44:07.166 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:07.166 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:07.166 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-04-18T14:44:07.166 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:06.396568+0000", 2024-04-18T14:44:07.166 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00010834 2024-04-18T14:44:07.166 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:07.166 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:07.166 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_started", 2024-04-18T14:44:07.167 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:06.397748+0000", 2024-04-18T14:44:07.167 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0011796300000000001 2024-04-18T14:44:07.167 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:07.167 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:07.167 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_committed", 2024-04-18T14:44:07.167 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:06.400307+0000", 2024-04-18T14:44:07.167 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0025595150000000001 2024-04-18T14:44:07.167 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:07.167 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:07.167 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-04-18T14:44:07.167 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:06.410069+0000", 2024-04-18T14:44:07.167 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0097613549999999993 2024-04-18T14:44:07.167 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:07.167 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:07.168 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-04-18T14:44:07.168 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:06.410167+0000", 2024-04-18T14:44:07.168 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.7874000000000005e-05 2024-04-18T14:44:07.168 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:44:07.168 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-04-18T14:44:07.168 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:44:07.168 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:07.168 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:07.168 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4559.0:645 3.9s0 3:94766bb7:::smithi13430248-17:head [append 0~606208] snapc 23=[23,22,1e,1d,1c,1a,16,14,13,11,a,2] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-04-18T14:44:07.168 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-04-18T14:44:06.400988+0000", 2024-04-18T14:44:07.168 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 0.65924718000000004, 2024-04-18T14:44:07.168 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.010162093000000001, 2024-04-18T14:44:07.168 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-04-18T14:44:07.168 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T14:44:07.169 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-04-18T14:44:07.169 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4559", 2024-04-18T14:44:07.169 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.134:0/3113589487", 2024-04-18T14:44:07.169 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 645 2024-04-18T14:44:07.169 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:07.169 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-04-18T14:44:07.169 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:07.169 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-04-18T14:44:07.169 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:06.400988+0000", 2024-04-18T14:44:07.169 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:44:07.169 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:07.169 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:07.169 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-04-18T14:44:07.169 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:06.400988+0000", 2024-04-18T14:44:07.170 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:44:07.170 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:07.170 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:07.170 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-04-18T14:44:07.170 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:06.400985+0000", 2024-04-18T14:44:07.170 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999981 2024-04-18T14:44:07.170 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:07.170 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:07.170 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-04-18T14:44:07.170 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:06.401581+0000", 2024-04-18T14:44:07.170 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00059547400000000002 2024-04-18T14:44:07.170 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:07.170 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:07.170 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-04-18T14:44:07.171 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:06.401596+0000", 2024-04-18T14:44:07.171 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.4571e-05 2024-04-18T14:44:07.171 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:07.171 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:07.171 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-04-18T14:44:07.171 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:06.401605+0000", 2024-04-18T14:44:07.171 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.4539999999999996e-06 2024-04-18T14:44:07.171 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:07.171 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:07.171 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-04-18T14:44:07.171 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:06.401633+0000", 2024-04-18T14:44:07.171 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.7543e-05 2024-04-18T14:44:07.171 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:07.171 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:07.171 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-04-18T14:44:07.172 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:06.401715+0000", 2024-04-18T14:44:07.172 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.2237999999999994e-05 2024-04-18T14:44:07.172 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:07.172 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:07.172 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_started", 2024-04-18T14:44:07.172 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:06.402419+0000", 2024-04-18T14:44:07.172 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000704056 2024-04-18T14:44:07.172 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:07.172 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:07.172 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_committed", 2024-04-18T14:44:07.172 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:06.403840+0000", 2024-04-18T14:44:07.172 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.001421463 2024-04-18T14:44:07.172 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:07.172 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:07.172 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-04-18T14:44:07.173 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:06.411078+0000", 2024-04-18T14:44:07.173 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0072378160000000002 2024-04-18T14:44:07.173 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:07.173 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:07.173 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-04-18T14:44:07.173 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:06.411150+0000", 2024-04-18T14:44:07.173 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.1570999999999996e-05 2024-04-18T14:44:07.173 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:44:07.173 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-04-18T14:44:07.173 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:44:07.173 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:07.173 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:07.173 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4559.0:647 3.9s0 3:94766bb7:::smithi13430248-17:head [append 0~81920] snapc 23=[23,22,1e,1d,1c,1a,16,14,13,11,a,2] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-04-18T14:44:07.173 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-04-18T14:44:06.406329+0000", 2024-04-18T14:44:07.173 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 0.653905611, 2024-04-18T14:44:07.174 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0096303670000000008, 2024-04-18T14:44:07.174 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-04-18T14:44:07.174 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T14:44:07.174 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-04-18T14:44:07.174 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4559", 2024-04-18T14:44:07.174 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.134:0/3113589487", 2024-04-18T14:44:07.174 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 647 2024-04-18T14:44:07.174 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:07.174 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-04-18T14:44:07.174 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:07.174 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-04-18T14:44:07.174 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:06.406329+0000", 2024-04-18T14:44:07.174 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:44:07.174 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:07.174 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:07.175 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-04-18T14:44:07.175 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:06.406329+0000", 2024-04-18T14:44:07.175 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:44:07.175 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:07.175 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:07.175 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-04-18T14:44:07.175 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:06.406328+0000", 2024-04-18T14:44:07.175 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999986 2024-04-18T14:44:07.175 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:07.175 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:07.175 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-04-18T14:44:07.175 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:06.406425+0000", 2024-04-18T14:44:07.175 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.7122999999999998e-05 2024-04-18T14:44:07.175 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:07.175 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:07.176 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-04-18T14:44:07.176 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:06.406433+0000", 2024-04-18T14:44:07.176 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.0819999999999999e-06 2024-04-18T14:44:07.176 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:07.176 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:07.176 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-04-18T14:44:07.176 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:06.406438+0000", 2024-04-18T14:44:07.176 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.5140000000000003e-06 2024-04-18T14:44:07.176 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:07.176 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:07.176 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-04-18T14:44:07.176 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:06.408386+0000", 2024-04-18T14:44:07.176 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0019482309999999999 2024-04-18T14:44:07.176 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:07.177 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:07.177 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-04-18T14:44:07.177 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:06.408487+0000", 2024-04-18T14:44:07.177 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000100832 2024-04-18T14:44:07.177 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:07.177 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:07.177 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_started", 2024-04-18T14:44:07.177 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:06.408898+0000", 2024-04-18T14:44:07.177 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00041165100000000002 2024-04-18T14:44:07.177 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:07.177 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:07.177 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_committed", 2024-04-18T14:44:07.177 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:06.410294+0000", 2024-04-18T14:44:07.177 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0013958289999999999 2024-04-18T14:44:07.177 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:07.178 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:07.178 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-04-18T14:44:07.178 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:06.415886+0000", 2024-04-18T14:44:07.178 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0055916849999999999 2024-04-18T14:44:07.178 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:07.178 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:07.178 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-04-18T14:44:07.178 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:06.415960+0000", 2024-04-18T14:44:07.178 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.3771999999999998e-05 2024-04-18T14:44:07.178 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:44:07.178 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-04-18T14:44:07.178 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:44:07.178 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:07.178 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:07.178 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4559.0:648 3.9s0 3:94766bb7:::smithi13430248-17:head [setxattr _header (57) in=7b] snapc 23=[23,22,1e,1d,1c,1a,16,14,13,11,a,2] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-04-18T14:44:07.179 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-04-18T14:44:06.406441+0000", 2024-04-18T14:44:07.179 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 0.65379327300000001, 2024-04-18T14:44:07.179 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0096501109999999994, 2024-04-18T14:44:07.179 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-04-18T14:44:07.179 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T14:44:07.179 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-04-18T14:44:07.179 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4559", 2024-04-18T14:44:07.179 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.134:0/3113589487", 2024-04-18T14:44:07.179 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 648 2024-04-18T14:44:07.179 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:07.179 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-04-18T14:44:07.179 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:07.179 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-04-18T14:44:07.179 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:06.406441+0000", 2024-04-18T14:44:07.180 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:44:07.180 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:07.180 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:07.180 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-04-18T14:44:07.180 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:06.406441+0000", 2024-04-18T14:44:07.180 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:44:07.180 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:07.180 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:07.180 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-04-18T14:44:07.180 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:06.406441+0000", 2024-04-18T14:44:07.180 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-04-18T14:44:07.180 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:07.180 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:07.180 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-04-18T14:44:07.180 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:06.406443+0000", 2024-04-18T14:44:07.181 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.3250000000000002e-06 2024-04-18T14:44:07.181 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:07.181 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:07.181 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-04-18T14:44:07.181 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:06.406447+0000", 2024-04-18T14:44:07.181 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.382e-06 2024-04-18T14:44:07.181 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:07.181 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:07.181 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-04-18T14:44:07.181 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:06.406450+0000", 2024-04-18T14:44:07.181 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.9500000000000001e-06 2024-04-18T14:44:07.181 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:07.181 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:07.181 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-04-18T14:44:07.181 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:06.409264+0000", 2024-04-18T14:44:07.182 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.002814352 2024-04-18T14:44:07.182 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:07.182 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:07.182 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-04-18T14:44:07.182 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:06.409359+0000", 2024-04-18T14:44:07.182 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.4500000000000007e-05 2024-04-18T14:44:07.182 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:07.182 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:07.182 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_started", 2024-04-18T14:44:07.182 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:06.409684+0000", 2024-04-18T14:44:07.182 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00032499699999999999 2024-04-18T14:44:07.182 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:07.182 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:07.182 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_committed", 2024-04-18T14:44:07.183 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:06.410307+0000", 2024-04-18T14:44:07.183 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00062361399999999998 2024-04-18T14:44:07.183 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:07.183 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:07.183 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-04-18T14:44:07.183 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:06.416039+0000", 2024-04-18T14:44:07.183 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0057323130000000002 2024-04-18T14:44:07.183 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:07.183 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:07.183 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-04-18T14:44:07.183 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:06.416092+0000", 2024-04-18T14:44:07.183 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.2098999999999997e-05 2024-04-18T14:44:07.183 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:44:07.183 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-04-18T14:44:07.183 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:44:07.184 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:07.184 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:07.184 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4559.0:649 3.9s0 3:94766bb7:::smithi13430248-17:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e67)", 2024-04-18T14:44:07.184 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-04-18T14:44:06.406452+0000", 2024-04-18T14:44:07.184 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 0.65378248999999999, 2024-04-18T14:44:07.184 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.011828353, 2024-04-18T14:44:07.184 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-04-18T14:44:07.184 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-04-18T14:44:07.184 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-04-18T14:44:07.184 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4559", 2024-04-18T14:44:07.184 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.134:0/3113589487", 2024-04-18T14:44:07.184 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 649 2024-04-18T14:44:07.184 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:07.184 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-04-18T14:44:07.184 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:07.185 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-04-18T14:44:07.185 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:06.406452+0000", 2024-04-18T14:44:07.185 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:44:07.185 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:07.185 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:07.185 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-04-18T14:44:07.185 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:06.406452+0000", 2024-04-18T14:44:07.185 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:44:07.185 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:07.185 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:07.185 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-04-18T14:44:07.185 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:06.406452+0000", 2024-04-18T14:44:07.185 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967296 2024-04-18T14:44:07.185 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:07.185 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:07.186 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-04-18T14:44:07.186 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:06.406455+0000", 2024-04-18T14:44:07.186 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.332e-06 2024-04-18T14:44:07.186 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:07.186 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:07.186 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-04-18T14:44:07.186 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:06.406459+0000", 2024-04-18T14:44:07.186 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.9999999999999998e-06 2024-04-18T14:44:07.186 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:07.186 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:07.186 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-04-18T14:44:07.186 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:06.406468+0000", 2024-04-18T14:44:07.186 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.3559999999999993e-06 2024-04-18T14:44:07.186 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:07.186 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:07.186 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-04-18T14:44:07.187 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:06.410228+0000", 2024-04-18T14:44:07.187 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0037600960000000001 2024-04-18T14:44:07.187 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:07.187 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:07.187 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for rw locks", 2024-04-18T14:44:07.187 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:06.410285+0000", 2024-04-18T14:44:07.187 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.7111000000000003e-05 2024-04-18T14:44:07.187 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:07.187 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:07.187 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-04-18T14:44:07.187 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:06.416450+0000", 2024-04-18T14:44:07.187 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0061647189999999999 2024-04-18T14:44:07.187 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:07.187 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:07.187 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-04-18T14:44:07.188 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:06.416596+0000", 2024-04-18T14:44:07.188 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000146484 2024-04-18T14:44:07.188 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:07.188 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:07.188 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-04-18T14:44:07.188 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:06.418281+0000", 2024-04-18T14:44:07.188 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.001684489 2024-04-18T14:44:07.188 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:44:07.188 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-04-18T14:44:07.188 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:44:07.188 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:44:07.188 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-04-18T14:44:07.188 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-04-18T14:44:07.190 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-18T14:44:07.190 INFO:teuthology.orchestra.run.smithi086.stdout:osd.0: {} 2024-04-18T14:44:07.191 INFO:teuthology.orchestra.run.smithi086.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-18T14:44:07.191 INFO:teuthology.orchestra.run.smithi086.stdout:osd.1: {} 2024-04-18T14:44:07.191 INFO:teuthology.orchestra.run.smithi086.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-18T14:44:07.192 INFO:tasks.ceph.osd.8.smithi086.stderr:2024-04-18T14:44:07.186+0000 7f29f7b9d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 8 (PID: 24958) UID: 0 2024-04-18T14:44:07.192 INFO:teuthology.orchestra.run.smithi086.stdout:osd.2: {} 2024-04-18T14:44:07.193 INFO:teuthology.orchestra.run.smithi086.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-18T14:44:07.213 INFO:teuthology.orchestra.run.smithi086.stdout:osd.3: {} 2024-04-18T14:44:07.213 INFO:teuthology.orchestra.run.smithi086.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-18T14:44:07.229 INFO:teuthology.orchestra.run.smithi086.stdout:osd.4: {} 2024-04-18T14:44:07.229 INFO:teuthology.orchestra.run.smithi086.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-18T14:44:07.248 INFO:teuthology.orchestra.run.smithi086.stdout:osd.5: {} 2024-04-18T14:44:07.248 INFO:teuthology.orchestra.run.smithi086.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-18T14:44:07.270 INFO:teuthology.orchestra.run.smithi086.stdout:osd.6: {} 2024-04-18T14:44:07.271 INFO:teuthology.orchestra.run.smithi086.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-18T14:44:07.290 INFO:teuthology.orchestra.run.smithi086.stdout:osd.7: {} 2024-04-18T14:44:07.290 INFO:teuthology.orchestra.run.smithi086.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-18T14:44:07.291 INFO:tasks.ceph.osd.8.smithi086.stderr:2024-04-18T14:44:07.286+0000 7f29f7b9d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 8 (PID: 24958) UID: 0 2024-04-18T14:44:07.308 INFO:teuthology.orchestra.run.smithi086.stdout:osd.8: {} 2024-04-18T14:44:07.308 INFO:teuthology.orchestra.run.smithi086.stderr:osd.8: osd_enable_op_tracker = '' 2024-04-18T14:44:07.321 INFO:teuthology.orchestra.run.smithi096.stdout:ERROR: (22) Invalid argument 2024-04-18T14:44:07.322 INFO:teuthology.orchestra.run.smithi096.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T14:44:07.329 INFO:teuthology.orchestra.run.smithi086.stdout:osd.9: {} 2024-04-18T14:44:07.330 INFO:teuthology.orchestra.run.smithi086.stderr:osd.9: osd_enable_op_tracker = '' 2024-04-18T14:44:07.335 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-18T14:44:07.350 INFO:teuthology.orchestra.run.smithi086.stdout:osd.10: {} 2024-04-18T14:44:07.350 INFO:teuthology.orchestra.run.smithi086.stderr:osd.10: osd_enable_op_tracker = '' 2024-04-18T14:44:07.372 INFO:teuthology.orchestra.run.smithi086.stdout:osd.11: {} 2024-04-18T14:44:07.372 INFO:teuthology.orchestra.run.smithi086.stderr:osd.11: osd_enable_op_tracker = '' 2024-04-18T14:44:07.385 INFO:tasks.rados.rados.0.smithi134.stdout:267: done (2 left) 2024-04-18T14:44:07.385 INFO:tasks.rados.rados.0.smithi134.stdout:268: snap_remove snap 19 2024-04-18T14:44:07.386 INFO:teuthology.orchestra.run.smithi086.stderr:reweighted osd.15 to 1 (10000) 2024-04-18T14:44:07.391 INFO:tasks.ceph.osd.8.smithi086.stderr:2024-04-18T14:44:07.390+0000 7f29f7b9d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 8 (PID: 24958) UID: 0 2024-04-18T14:44:07.396 INFO:teuthology.orchestra.run.smithi086.stdout:osd.12: {} 2024-04-18T14:44:07.396 INFO:teuthology.orchestra.run.smithi086.stderr:osd.12: osd_enable_op_tracker = '' 2024-04-18T14:44:07.415 INFO:tasks.ceph.ceph_manager.ceph:waiting for recovery to complete 2024-04-18T14:44:07.415 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-18T14:44:07.420 INFO:teuthology.orchestra.run.smithi086.stdout:osd.13: {} 2024-04-18T14:44:07.420 INFO:teuthology.orchestra.run.smithi086.stderr:osd.13: osd_enable_op_tracker = '' 2024-04-18T14:44:07.422 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-18T14:44:07.422+0000 7f4f1bfff640 0 -- 172.21.15.86:0/3009862941 >> [v2:172.21.15.119:6808/24905,v1:172.21.15.119:6809/24905] conn(0x7f4f2421bf30 msgr2=0x7f4f2421e320 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-04-18T14:44:07.452 INFO:teuthology.orchestra.run.smithi086.stdout:osd.14: {} 2024-04-18T14:44:07.452 INFO:teuthology.orchestra.run.smithi086.stderr:osd.14: osd_enable_op_tracker = '' 2024-04-18T14:44:07.467 INFO:teuthology.orchestra.run.smithi096.stdout:ERROR: (22) Invalid argument 2024-04-18T14:44:07.467 INFO:teuthology.orchestra.run.smithi096.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T14:44:07.471 INFO:teuthology.orchestra.run.smithi086.stdout:osd.15: {} 2024-04-18T14:44:07.472 INFO:teuthology.orchestra.run.smithi086.stderr:osd.15: osd_enable_op_tracker = '' 2024-04-18T14:44:07.481 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-18T14:44:07.492 INFO:tasks.ceph.osd.11.smithi134.stderr:2024-04-18T14:44:07.496+0000 7f2d36f12640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 11 (PID: 25216) UID: 0 2024-04-18T14:44:07.593 INFO:tasks.ceph.osd.0.smithi086.stderr:2024-04-18T14:44:07.590+0000 7f7cdfd78640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 24953) UID: 0 2024-04-18T14:44:07.599 INFO:teuthology.orchestra.run.smithi096.stdout:ERROR: (22) Invalid argument 2024-04-18T14:44:07.599 INFO:teuthology.orchestra.run.smithi096.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T14:44:07.613 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-04-18T14:44:07.694 INFO:tasks.ceph.osd.1.smithi096.stderr:2024-04-18T14:44:07.689+0000 7f56a7a98640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 24887) UID: 0 2024-04-18T14:44:07.722 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-04-18T14:44:07.723 INFO:teuthology.orchestra.run.smithi086.stderr:dumped all 2024-04-18T14:44:07.734 INFO:teuthology.orchestra.run.smithi096.stdout:ERROR: (22) Invalid argument 2024-04-18T14:44:07.735 INFO:teuthology.orchestra.run.smithi096.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T14:44:07.741 INFO:teuthology.orchestra.run.smithi086.stdout:{"pg_ready":true,"pg_map":{"version":82,"stamp":"2024-04-18T14:44:07.385856+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":80413216,"num_objects":136,"num_object_clones":84,"num_object_copies":942,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":136,"num_whiteouts":10,"num_read":448,"num_read_kb":82303,"num_write":671,"num_write_kb":85460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":913,"ondisk_log_size":913,"up":130,"acting":130,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":130,"num_osds":15,"num_per_pool_osds":15,"num_per_pool_omap_osds":15,"kb":1415577600,"kb_used":576940,"kb_used_data":138796,"kb_used_omap":23,"kb_used_meta":437864,"kb_avail":1415000660,"statfs":{"total":1449551462400,"available":1448960675840,"internally_reserved":0,"allocated":142127104,"data_stored":195288079,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":23912,"internal_metadata":448373400},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":43,"apply_latency_ms":43,"commit_latency_ns":43000000,"apply_latency_ns":43000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":8142848,"num_objects":6,"num_object_clones":6,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":1,"num_read":16,"num_read_kb":3367,"num_write":27,"num_write_kb":9312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"3.881212"},"pg_stats":[{"pgid":"3.f","version":"59'24","reported_seq":116,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-18T14:44:02.401013+0000","last_change":"2024-04-18T14:44:02.403173+0000","last_active":"2024-04-18T14:44:02.401013+0000","last_peered":"2024-04-18T14:44:02.401013+0000","last_clean":"2024-04-18T14:44:02.401013+0000","last_became_active":"2024-04-18T14:43:30.738648+0000","last_became_peered":"2024-04-18T14:43:30.738648+0000","last_unstale":"2024-04-18T14:44:02.401013+0000","last_undegraded":"2024-04-18T14:44:02.401013+0000","last_fullsized":"2024-04-18T14:44:02.401013+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T14:43:29.615264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T14:43:29.615264+0000","last_clean_scrub_stamp":"2024-04-18T14:43:29.615264+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T14:44:32.547784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0026750860000000001,"stat_sum":{"num_bytes":1196032,"num_objects":5,"num_object_clones":3,"num_object_copies":35,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":13,"num_read_kb":2788,"num_write":9,"num_write_kb":1168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,12,4,13,14,10,2],"acting":[11,12,4,13,14,10,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[{"start":"f","length":"1"},{"start":"17","length":"1"},{"start":"19","length":"1"}]},{"pgid":"3.e","version":"64'56","reported_seq":149,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-04-18T14:44:03.585344+0000","last_change":"2024-04-18T14:44:03.535963+0000","last_active":"2024-04-18T14:44:03.585344+0000","last_peered":"2024-04-18T14:44:03.585344+0000","last_clean":"2024-04-18T14:44:03.585344+0000","last_became_active":"2024-04-18T14:43:30.749869+0000","last_became_peered":"2024-04-18T14:43:30.749869+0000","last_unstale":"2024-04-18T14:44:03.585344+0000","last_undegraded":"2024-04-18T14:44:03.585344+0000","last_fullsized":"2024-04-18T14:44:03.585344+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T14:43:29.615264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T14:43:29.615264+0000","last_clean_scrub_stamp":"2024-04-18T14:43:29.615264+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T14:44:29.697588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.031169183999999999,"stat_sum":{"num_bytes":4456448,"num_objects":9,"num_object_clones":6,"num_object_copies":63,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":1,"num_read":19,"num_read_kb":5720,"num_write":62,"num_write_kb":5712,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,4,11,2,0,3],"acting":[8,9,4,11,2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[{"start":"b","length":"1"},{"start":"f","length":"1"},{"start":"17","length":"1"},{"start":"19","length":"1"}]},{"pgid":"3.d","version":"64'31","reported_seq":119,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-04-18T14:44:03.564192+0000","last_change":"2024-04-18T14:44:03.566790+0000","last_active":"2024-04-18T14:44:03.564192+0000","last_peered":"2024-04-18T14:44:03.564192+0000","last_clean":"2024-04-18T14:44:03.564192+0000","last_became_active":"2024-04-18T14:43:30.735975+0000","last_became_peered":"2024-04-18T14:43:30.735975+0000","last_unstale":"2024-04-18T14:44:03.564192+0000","last_undegraded":"2024-04-18T14:44:03.564192+0000","last_fullsized":"2024-04-18T14:44:03.564192+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T14:43:29.615264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T14:43:29.615264+0000","last_clean_scrub_stamp":"2024-04-18T14:43:29.615264+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T14:44:53.155373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.034467420999999998,"stat_sum":{"num_bytes":2146304,"num_objects":6,"num_object_clones":4,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":1,"num_read":5,"num_read_kb":2,"num_write":11,"num_write_kb":2096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,0,12,10,2,6],"acting":[7,3,0,12,10,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"b","length":"1"},{"start":"f","length":"1"},{"start":"17","length":"1"},{"start":"19","length":"1"}]},{"pgid":"3.c","version":"63'69","reported_seq":171,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-18T14:44:02.426431+0000","last_change":"2024-04-18T14:44:02.427614+0000","last_active":"2024-04-18T14:44:02.426431+0000","last_peered":"2024-04-18T14:44:02.426431+0000","last_clean":"2024-04-18T14:44:02.426431+0000","last_became_active":"2024-04-18T14:43:30.737285+0000","last_became_peered":"2024-04-18T14:43:30.737285+0000","last_unstale":"2024-04-18T14:44:02.426431+0000","last_undegraded":"2024-04-18T14:44:02.426431+0000","last_fullsized":"2024-04-18T14:44:02.426431+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T14:43:29.615264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T14:43:29.615264+0000","last_clean_scrub_stamp":"2024-04-18T14:43:29.615264+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":0,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T14:44:34.651938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.027171862000000001,"stat_sum":{"num_bytes":8470528,"num_objects":16,"num_object_clones":10,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":1,"num_read":43,"num_read_kb":9087,"num_write":51,"num_write_kb":6464,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,10,14,12,4,2,6],"acting":[11,10,14,12,4,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[{"start":"f","length":"1"},{"start":"17","length":"1"},{"start":"19","length":"1"}]},{"pgid":"3.b","version":"63'22","reported_seq":110,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-18T14:44:02.393292+0000","last_change":"2024-04-18T14:44:02.394019+0000","last_active":"2024-04-18T14:44:02.393292+0000","last_peered":"2024-04-18T14:44:02.393292+0000","last_clean":"2024-04-18T14:44:02.393292+0000","last_became_active":"2024-04-18T14:43:30.745638+0000","last_became_peered":"2024-04-18T14:43:30.745638+0000","last_unstale":"2024-04-18T14:44:02.393292+0000","last_undegraded":"2024-04-18T14:44:02.393292+0000","last_fullsized":"2024-04-18T14:44:02.393292+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T14:43:29.615264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T14:43:29.615264+0000","last_clean_scrub_stamp":"2024-04-18T14:43:29.615264+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T14:44:32.453854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.010185381,"stat_sum":{"num_bytes":2228224,"num_objects":6,"num_object_clones":3,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":7,"num_read_kb":3,"num_write":36,"num_write_kb":2176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,6,4,9,8,7,14],"acting":[10,6,4,9,8,7,14],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[{"start":"f","length":"1"},{"start":"17","length":"1"},{"start":"19","length":"1"}]},{"pgid":"3.a","version":"64'49","reported_seq":146,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-04-18T14:44:03.593313+0000","last_change":"2024-04-18T14:44:03.546556+0000","last_active":"2024-04-18T14:44:03.593313+0000","last_peered":"2024-04-18T14:44:03.593313+0000","last_clean":"2024-04-18T14:44:03.593313+0000","last_became_active":"2024-04-18T14:43:30.747627+0000","last_became_peered":"2024-04-18T14:43:30.747627+0000","last_unstale":"2024-04-18T14:44:03.593313+0000","last_undegraded":"2024-04-18T14:44:03.593313+0000","last_fullsized":"2024-04-18T14:44:03.593313+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T14:43:29.615264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T14:43:29.615264+0000","last_clean_scrub_stamp":"2024-04-18T14:43:29.615264+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T14:44:46.251182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.028915545000000001,"stat_sum":{"num_bytes":7798784,"num_objects":10,"num_object_clones":6,"num_object_copies":70,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":21,"num_read_kb":2986,"num_write":28,"num_write_kb":7440,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,12,9,8,15,11],"acting":[3,7,12,9,8,15,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"b","length":"1"},{"start":"f","length":"1"},{"start":"17","length":"1"},{"start":"19","length":"1"}]},{"pgid":"3.9","version":"63'92","reported_seq":193,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-18T14:44:02.420668+0000","last_change":"2024-04-18T14:44:02.421281+0000","last_active":"2024-04-18T14:44:02.420668+0000","last_peered":"2024-04-18T14:44:02.420668+0000","last_clean":"2024-04-18T14:44:02.420668+0000","last_became_active":"2024-04-18T14:43:30.739560+0000","last_became_peered":"2024-04-18T14:43:30.739560+0000","last_unstale":"2024-04-18T14:44:02.420668+0000","last_undegraded":"2024-04-18T14:44:02.420668+0000","last_fullsized":"2024-04-18T14:44:02.420668+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T14:43:29.615264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T14:43:29.615264+0000","last_clean_scrub_stamp":"2024-04-18T14:43:29.615264+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T14:44:52.637394+0000","scrub_duration":0,"objects_trimmed":2,"snaptrim_duration":0.029001329999999999,"stat_sum":{"num_bytes":10141696,"num_objects":14,"num_object_clones":8,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":1,"num_read":34,"num_read_kb":7840,"num_write":49,"num_write_kb":12960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[12,5,14,4,15,10,6],"acting":[12,5,14,4,15,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":12,"acting_primary":12,"purged_snaps":[{"start":"f","length":"1"},{"start":"17","length":"1"},{"start":"19","length":"1"}]},{"pgid":"3.8","version":"65'96","reported_seq":212,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-04-18T14:44:04.440023+0000","last_change":"2024-04-18T14:44:04.441469+0000","last_active":"2024-04-18T14:44:04.440023+0000","last_peered":"2024-04-18T14:44:04.440023+0000","last_clean":"2024-04-18T14:44:04.440023+0000","last_became_active":"2024-04-18T14:43:30.736462+0000","last_became_peered":"2024-04-18T14:43:30.736462+0000","last_unstale":"2024-04-18T14:44:04.440023+0000","last_undegraded":"2024-04-18T14:44:04.440023+0000","last_fullsized":"2024-04-18T14:44:04.440023+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T14:43:29.615264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T14:43:29.615264+0000","last_clean_scrub_stamp":"2024-04-18T14:43:29.615264+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":0,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T14:44:41.558673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.062922890999999995,"stat_sum":{"num_bytes":8142848,"num_objects":15,"num_object_clones":9,"num_object_copies":105,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":1,"num_read":49,"num_read_kb":18977,"num_write":51,"num_write_kb":7952,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,0,4,14,15,13],"acting":[5,10,0,4,14,15,13],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"7","length":"1"},{"start":"b","length":"1"},{"start":"19","length":"1"}]},{"pgid":"1.0","version":"26'157","reported_seq":244,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-04-18T14:44:03.520578+0000","last_change":"2024-04-18T14:43:20.323829+0000","last_active":"2024-04-18T14:44:03.520578+0000","last_peered":"2024-04-18T14:44:03.520578+0000","last_clean":"2024-04-18T14:44:03.520578+0000","last_became_active":"2024-04-18T14:43:20.323133+0000","last_became_peered":"2024-04-18T14:43:20.323133+0000","last_unstale":"2024-04-18T14:44:03.520578+0000","last_undegraded":"2024-04-18T14:44:03.520578+0000","last_fullsized":"2024-04-18T14:44:03.520578+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T14:43:18.296821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T14:43:18.296821+0000","last_clean_scrub_stamp":"2024-04-18T14:43:18.296821+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T14:44:25.445335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[13,0],"acting":[13,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":13,"acting_primary":13,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":48,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-04-18T14:44:03.510942+0000","last_change":"2024-04-18T14:43:21.329224+0000","last_active":"2024-04-18T14:44:03.510942+0000","last_peered":"2024-04-18T14:44:03.510942+0000","last_clean":"2024-04-18T14:44:03.510942+0000","last_became_active":"2024-04-18T14:43:21.327764+0000","last_became_peered":"2024-04-18T14:43:21.327764+0000","last_unstale":"2024-04-18T14:44:03.510942+0000","last_undegraded":"2024-04-18T14:44:03.510942+0000","last_fullsized":"2024-04-18T14:44:03.510942+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T14:43:20.303322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T14:43:20.303322+0000","last_clean_scrub_stamp":"2024-04-18T14:43:20.303322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T14:44:20.633685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,15],"acting":[5,15],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"65'35","reported_seq":133,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-04-18T14:44:04.418150+0000","last_change":"2024-04-18T14:44:04.420733+0000","last_active":"2024-04-18T14:44:04.418150+0000","last_peered":"2024-04-18T14:44:04.418150+0000","last_clean":"2024-04-18T14:44:04.418150+0000","last_became_active":"2024-04-18T14:43:30.737254+0000","last_became_peered":"2024-04-18T14:43:30.737254+0000","last_unstale":"2024-04-18T14:44:04.418150+0000","last_undegraded":"2024-04-18T14:44:04.418150+0000","last_fullsized":"2024-04-18T14:44:04.418150+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T14:43:29.615264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T14:43:29.615264+0000","last_clean_scrub_stamp":"2024-04-18T14:43:29.615264+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T14:44:42.268037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.036869977999999998,"stat_sum":{"num_bytes":4653056,"num_objects":5,"num_object_clones":3,"num_object_copies":35,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":1,"num_read":11,"num_read_kb":102,"num_write":16,"num_write_kb":4544,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[13,12,3,4,15,7,11],"acting":[13,12,3,4,15,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":13,"acting_primary":13,"purged_snaps":[{"start":"7","length":"1"},{"start":"b","length":"1"},{"start":"19","length":"1"}]},{"pgid":"2.0","version":"0'0","reported_seq":46,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-18T14:44:02.392629+0000","last_change":"2024-04-18T14:43:21.414881+0000","last_active":"2024-04-18T14:44:02.392629+0000","last_peered":"2024-04-18T14:44:02.392629+0000","last_clean":"2024-04-18T14:44:02.392629+0000","last_became_active":"2024-04-18T14:43:21.414060+0000","last_became_peered":"2024-04-18T14:43:21.414060+0000","last_unstale":"2024-04-18T14:44:02.392629+0000","last_undegraded":"2024-04-18T14:44:02.392629+0000","last_fullsized":"2024-04-18T14:44:02.392629+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T14:43:20.303322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T14:43:20.303322+0000","last_clean_scrub_stamp":"2024-04-18T14:43:20.303322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T14:44:26.835605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"63'39","reported_seq":139,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-18T14:44:02.403023+0000","last_change":"2024-04-18T14:44:02.403791+0000","last_active":"2024-04-18T14:44:02.403023+0000","last_peered":"2024-04-18T14:44:02.403023+0000","last_clean":"2024-04-18T14:44:02.403023+0000","last_became_active":"2024-04-18T14:43:30.746554+0000","last_became_peered":"2024-04-18T14:43:30.746554+0000","last_unstale":"2024-04-18T14:44:02.403023+0000","last_undegraded":"2024-04-18T14:44:02.403023+0000","last_fullsized":"2024-04-18T14:44:02.403023+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T14:43:29.615264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T14:43:29.615264+0000","last_clean_scrub_stamp":"2024-04-18T14:43:29.615264+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T14:44:30.628320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.016704111000000001,"stat_sum":{"num_bytes":4849664,"num_objects":8,"num_object_clones":4,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":28,"num_read_kb":16138,"num_write":20,"num_write_kb":4880,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,11,9,5,12,0,13],"acting":[6,11,9,5,12,0,13],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"f","length":"1"},{"start":"17","length":"1"},{"start":"19","length":"1"}]},{"pgid":"2.1","version":"0'0","reported_seq":47,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-04-18T14:44:03.520794+0000","last_change":"2024-04-18T14:43:21.329508+0000","last_active":"2024-04-18T14:44:03.520794+0000","last_peered":"2024-04-18T14:44:03.520794+0000","last_clean":"2024-04-18T14:44:03.520794+0000","last_became_active":"2024-04-18T14:43:21.328534+0000","last_became_peered":"2024-04-18T14:43:21.328534+0000","last_unstale":"2024-04-18T14:44:03.520794+0000","last_undegraded":"2024-04-18T14:44:03.520794+0000","last_fullsized":"2024-04-18T14:44:03.520794+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T14:43:20.303322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T14:43:20.303322+0000","last_clean_scrub_stamp":"2024-04-18T14:43:20.303322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T14:44:22.866788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[13,5],"acting":[13,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":13,"acting_primary":13,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":86,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-18T14:44:02.391907+0000","last_change":"2024-04-18T14:44:02.392234+0000","last_active":"2024-04-18T14:44:02.391907+0000","last_peered":"2024-04-18T14:44:02.391907+0000","last_clean":"2024-04-18T14:44:02.391907+0000","last_became_active":"2024-04-18T14:43:30.735711+0000","last_became_peered":"2024-04-18T14:43:30.735711+0000","last_unstale":"2024-04-18T14:44:02.391907+0000","last_undegraded":"2024-04-18T14:44:02.391907+0000","last_fullsized":"2024-04-18T14:44:02.391907+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T14:43:29.615264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T14:43:29.615264+0000","last_clean_scrub_stamp":"2024-04-18T14:43:29.615264+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T14:44:49.070959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00061578900000000005,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[12,11,15,0,5,8,6],"acting":[12,11,15,0,5,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":12,"acting_primary":12,"purged_snaps":[{"start":"f","length":"1"},{"start":"17","length":"1"},{"start":"19","length":"1"}]},{"pgid":"2.2","version":"0'0","reported_seq":46,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-18T14:44:02.393442+0000","last_change":"2024-04-18T14:43:21.465969+0000","last_active":"2024-04-18T14:44:02.393442+0000","last_peered":"2024-04-18T14:44:02.393442+0000","last_clean":"2024-04-18T14:44:02.393442+0000","last_became_active":"2024-04-18T14:43:21.465481+0000","last_became_peered":"2024-04-18T14:43:21.465481+0000","last_unstale":"2024-04-18T14:44:02.393442+0000","last_undegraded":"2024-04-18T14:44:02.393442+0000","last_fullsized":"2024-04-18T14:44:02.393442+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T14:43:20.303322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T14:43:20.303322+0000","last_clean_scrub_stamp":"2024-04-18T14:43:20.303322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T14:44:45.650560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10],"acting":[3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"65'39","reported_seq":137,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-04-18T14:44:04.413466+0000","last_change":"2024-04-18T14:44:04.415972+0000","last_active":"2024-04-18T14:44:04.413466+0000","last_peered":"2024-04-18T14:44:04.413466+0000","last_clean":"2024-04-18T14:44:04.413466+0000","last_became_active":"2024-04-18T14:43:30.737990+0000","last_became_peered":"2024-04-18T14:43:30.737990+0000","last_unstale":"2024-04-18T14:44:04.413466+0000","last_undegraded":"2024-04-18T14:44:04.413466+0000","last_fullsized":"2024-04-18T14:44:04.413466+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T14:43:29.615264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T14:43:29.615264+0000","last_clean_scrub_stamp":"2024-04-18T14:43:29.615264+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T14:44:56.230031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.031999012,"stat_sum":{"num_bytes":3112960,"num_objects":7,"num_object_clones":5,"num_object_copies":49,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":13,"num_read_kb":379,"num_write":14,"num_write_kb":3456,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[13,7,2,15,4,5,3],"acting":[13,7,2,15,4,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":13,"acting_primary":13,"purged_snaps":[{"start":"7","length":"1"},{"start":"b","length":"1"},{"start":"19","length":"1"}]},{"pgid":"3.5","version":"64'23","reported_seq":117,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-04-18T14:44:03.575332+0000","last_change":"2024-04-18T14:44:03.568971+0000","last_active":"2024-04-18T14:44:03.575332+0000","last_peered":"2024-04-18T14:44:03.575332+0000","last_clean":"2024-04-18T14:44:03.575332+0000","last_became_active":"2024-04-18T14:43:30.653147+0000","last_became_peered":"2024-04-18T14:43:30.653147+0000","last_unstale":"2024-04-18T14:44:03.575332+0000","last_undegraded":"2024-04-18T14:44:03.575332+0000","last_fullsized":"2024-04-18T14:44:03.575332+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T14:43:29.615264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T14:43:29.615264+0000","last_clean_scrub_stamp":"2024-04-18T14:43:29.615264+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T14:44:48.289654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.042236103999999997,"stat_sum":{"num_bytes":3653632,"num_objects":3,"num_object_clones":2,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":1876,"num_write":12,"num_write_kb":4624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[15,6,14,13,7,11,8],"acting":[15,6,14,13,7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":15,"acting_primary":15,"purged_snaps":[{"start":"b","length":"1"},{"start":"f","length":"1"},{"start":"17","length":"1"},{"start":"19","length":"1"}]},{"pgid":"2.4","version":"0'0","reported_seq":46,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-18T14:44:01.396202+0000","last_change":"2024-04-18T14:43:21.348882+0000","last_active":"2024-04-18T14:44:01.396202+0000","last_peered":"2024-04-18T14:44:01.396202+0000","last_clean":"2024-04-18T14:44:01.396202+0000","last_became_active":"2024-04-18T14:43:21.348012+0000","last_became_peered":"2024-04-18T14:43:21.348012+0000","last_unstale":"2024-04-18T14:44:01.396202+0000","last_undegraded":"2024-04-18T14:44:01.396202+0000","last_fullsized":"2024-04-18T14:44:01.396202+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T14:43:20.303322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T14:43:20.303322+0000","last_clean_scrub_stamp":"2024-04-18T14:43:20.303322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T14:44:27.891832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,12],"acting":[6,12],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.4","version":"59'14","reported_seq":105,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-18T14:44:02.384079+0000","last_change":"2024-04-18T14:44:02.384425+0000","last_active":"2024-04-18T14:44:02.384079+0000","last_peered":"2024-04-18T14:44:02.384079+0000","last_clean":"2024-04-18T14:44:02.384079+0000","last_became_active":"2024-04-18T14:43:30.745133+0000","last_became_peered":"2024-04-18T14:43:30.745133+0000","last_unstale":"2024-04-18T14:44:02.384079+0000","last_undegraded":"2024-04-18T14:44:02.384079+0000","last_fullsized":"2024-04-18T14:44:02.384079+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T14:43:29.615264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T14:43:29.615264+0000","last_clean_scrub_stamp":"2024-04-18T14:43:29.615264+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T14:44:41.134460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00044418099999999998,"stat_sum":{"num_bytes":507904,"num_objects":2,"num_object_clones":1,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":1,"num_read":6,"num_read_kb":1490,"num_write":5,"num_write_kb":496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,12,14,9,6,11,13],"acting":[10,12,14,9,6,11,13],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[{"start":"f","length":"1"},{"start":"17","length":"1"},{"start":"19","length":"1"}]},{"pgid":"2.5","version":"0'0","reported_seq":47,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-18T14:44:02.384719+0000","last_change":"2024-04-18T14:43:21.423043+0000","last_active":"2024-04-18T14:44:02.384719+0000","last_peered":"2024-04-18T14:44:02.384719+0000","last_clean":"2024-04-18T14:44:02.384719+0000","last_became_active":"2024-04-18T14:43:21.422468+0000","last_became_peered":"2024-04-18T14:43:21.422468+0000","last_unstale":"2024-04-18T14:44:02.384719+0000","last_undegraded":"2024-04-18T14:44:02.384719+0000","last_fullsized":"2024-04-18T14:44:02.384719+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T14:43:20.303322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T14:43:20.303322+0000","last_clean_scrub_stamp":"2024-04-18T14:43:20.303322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T14:44:36.598607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2],"acting":[8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.7","version":"65'86","reported_seq":191,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-04-18T14:44:05.382942+0000","last_change":"2024-04-18T14:44:04.448589+0000","last_active":"2024-04-18T14:44:05.382942+0000","last_peered":"2024-04-18T14:44:05.382942+0000","last_clean":"2024-04-18T14:44:05.382942+0000","last_became_active":"2024-04-18T14:43:30.747200+0000","last_became_peered":"2024-04-18T14:43:30.747200+0000","last_unstale":"2024-04-18T14:44:05.382942+0000","last_undegraded":"2024-04-18T14:44:05.382942+0000","last_fullsized":"2024-04-18T14:44:05.382942+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T14:43:29.615264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T14:43:29.615264+0000","last_clean_scrub_stamp":"2024-04-18T14:43:29.615264+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":0,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T14:44:46.083412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.051520773999999998,"stat_sum":{"num_bytes":8667136,"num_objects":13,"num_object_clones":9,"num_object_copies":91,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":1,"num_read":32,"num_read_kb":12580,"num_write":70,"num_write_kb":8464,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[14,8,9,4,2,5,11],"acting":[14,8,9,4,2,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":14,"acting_primary":14,"purged_snaps":[{"start":"7","length":"1"},{"start":"b","length":"1"},{"start":"19","length":"1"}]},{"pgid":"2.6","version":"0'0","reported_seq":50,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-04-18T14:44:05.382753+0000","last_change":"2024-04-18T14:43:21.414621+0000","last_active":"2024-04-18T14:44:05.382753+0000","last_peered":"2024-04-18T14:44:05.382753+0000","last_clean":"2024-04-18T14:44:05.382753+0000","last_became_active":"2024-04-18T14:43:21.413906+0000","last_became_peered":"2024-04-18T14:43:21.413906+0000","last_unstale":"2024-04-18T14:44:05.382753+0000","last_undegraded":"2024-04-18T14:44:05.382753+0000","last_fullsized":"2024-04-18T14:44:05.382753+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T14:43:20.303322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T14:43:20.303322+0000","last_clean_scrub_stamp":"2024-04-18T14:43:20.303322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T14:44:28.448910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[14,0],"acting":[14,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":14,"acting_primary":14,"purged_snaps":[]},{"pgid":"3.6","version":"67'81","reported_seq":182,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-18T14:44:06.478645+0000","last_change":"2024-04-18T14:44:04.430098+0000","last_active":"2024-04-18T14:44:06.478645+0000","last_peered":"2024-04-18T14:44:06.478645+0000","last_clean":"2024-04-18T14:44:06.478645+0000","last_became_active":"2024-04-18T14:43:30.746945+0000","last_became_peered":"2024-04-18T14:43:30.746945+0000","last_unstale":"2024-04-18T14:44:06.478645+0000","last_undegraded":"2024-04-18T14:44:06.478645+0000","last_fullsized":"2024-04-18T14:44:06.478645+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T14:43:29.615264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T14:43:29.615264+0000","last_clean_scrub_stamp":"2024-04-18T14:43:29.615264+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":0,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T14:44:35.748592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.037022620999999999,"stat_sum":{"num_bytes":9797632,"num_objects":15,"num_object_clones":11,"num_object_copies":105,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":2,"num_read":22,"num_read_kb":2217,"num_write":34,"num_write_kb":9568,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[14,13,12,15,6,7,9],"acting":[14,13,12,15,6,7,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":14,"acting_primary":14,"purged_snaps":[{"start":"7","length":"1"},{"start":"b","length":"1"},{"start":"19","length":"1"}]},{"pgid":"2.7","version":"0'0","reported_seq":46,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-18T14:44:02.384842+0000","last_change":"2024-04-18T14:43:21.328715+0000","last_active":"2024-04-18T14:44:02.384842+0000","last_peered":"2024-04-18T14:44:02.384842+0000","last_clean":"2024-04-18T14:44:02.384842+0000","last_became_active":"2024-04-18T14:43:21.328185+0000","last_became_peered":"2024-04-18T14:43:21.328185+0000","last_unstale":"2024-04-18T14:44:02.384842+0000","last_undegraded":"2024-04-18T14:44:02.384842+0000","last_fullsized":"2024-04-18T14:44:02.384842+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T14:43:20.303322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T14:43:20.303322+0000","last_clean_scrub_stamp":"2024-04-18T14:43:20.303322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T14:44:20.541816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[15,13],"acting":[15,13],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":15,"acting_primary":15,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":16,"stat_sum":{"num_bytes":79822848,"num_objects":134,"num_object_clones":84,"num_object_copies":938,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":134,"num_whiteouts":10,"num_read":312,"num_read_kb":82185,"num_write":468,"num_write_kb":82000,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":129814528,"data_stored":189464576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":756,"ondisk_log_size":756,"up":112,"acting":112,"num_store_stats":15},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":11},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1064960,"data_stored":1057856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":13,"up_from":24,"seq":103079215116,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40368,"kb_used_data":9252,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94331472,"statfs":{"total":96636764160,"available":96595427328,"internally_reserved":0,"allocated":9474048,"data_stored":13036533,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,2,3,4,5,7,11,12,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65400000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81699999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89400000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57199999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83999999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1950000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95999999999999996}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0609999999999999}]},{"osd":12,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.147}]},{"osd":14,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93799999999999994}]},{"osd":15,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0820000000000001}]}]},{"osd":9,"up_from":24,"seq":103079215117,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40396,"kb_used_data":9276,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94331444,"statfs":{"total":96636764160,"available":96595398656,"internally_reserved":0,"allocated":9498624,"data_stored":12927622,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1599,"internal_metadata":31848897},"hb_peers":[0,1,3,8,10,11,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93100000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72999999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1379999999999999}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.091}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3360000000000001}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.024}]},{"osd":12,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6759999999999999}]},{"osd":13,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6060000000000001}]},{"osd":14,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.55}]},{"osd":15,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.452}]}]},{"osd":5,"up_from":24,"seq":103079215118,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40516,"kb_used_data":9396,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94331324,"statfs":{"total":96636764160,"available":96595275776,"internally_reserved":0,"allocated":9621504,"data_stored":13206150,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,3,4,6,10,11,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78100000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94199999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68799999999999994}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84099999999999997}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2330000000000001}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96599999999999997}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0600000000000001}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1879999999999999}]},{"osd":12,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1000000000000001}]},{"osd":13,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2170000000000001}]},{"osd":14,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.345}]},{"osd":15,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2829999999999999}]}]},{"osd":14,"up_from":21,"seq":90194313230,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":46236,"kb_used_data":15112,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94325604,"statfs":{"total":96636764160,"available":96589418496,"internally_reserved":0,"allocated":15474688,"data_stored":22074056,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,2,4,5,6,7,8,9,11,12,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65200000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45200000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94499999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47399999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85599999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59599999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91500000000000004}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63700000000000001}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81599999999999995}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4219999999999999}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79600000000000004}]},{"osd":12,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75}]},{"osd":13,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86799999999999999}]},{"osd":15,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95699999999999996}]}]},{"osd":1,"up_from":0,"seq":103079215118,"num_pgs":0,"num_osds":0,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":0,"kb_used":0,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":0,"statfs":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},{"osd":2,"up_from":22,"seq":94489280525,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":34252,"kb_used_data":7224,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94337588,"statfs":{"total":96636764160,"available":96601690112,"internally_reserved":0,"allocated":7397376,"data_stored":9949548,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,3,5,6,7,8,10,11,12,14],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76500000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96999999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96699999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.014}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69099999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2010000000000001}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.335}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.357}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.242}]},{"osd":12,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4319999999999999}]},{"osd":14,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.456}]}]},{"osd":15,"up_from":23,"seq":98784247822,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41324,"kb_used_data":10196,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94330516,"statfs":{"total":96636764160,"available":96594448384,"internally_reserved":0,"allocated":10440704,"data_stored":14339616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31848903},"hb_peers":[0,4,5,6,7,8,10,11,13,14],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1359999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2050000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97899999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.016}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.371}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.046}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79300000000000004}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2769999999999999}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2430000000000001}]},{"osd":13,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.401}]},{"osd":14,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.518}]}]},{"osd":4,"up_from":22,"seq":94489280524,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39456,"kb_used_data":12428,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94332384,"statfs":{"total":96636764160,"available":96596361216,"internally_reserved":0,"allocated":12726272,"data_stored":17755680,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[2,3,5,6,10,11,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2330000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92100000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79000000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.103}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.151}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.21}]},{"osd":12,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1299999999999999}]},{"osd":13,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.99099999999999999}]},{"osd":14,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0820000000000001}]},{"osd":15,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5980000000000001}]}]},{"osd":6,"up_from":22,"seq":94489280524,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36624,"kb_used_data":9600,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94335216,"statfs":{"total":96636764160,"available":96599261184,"internally_reserved":0,"allocated":9830400,"data_stored":14055699,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,5,7,8,9,11,12,13,14],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93999999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.129}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95399999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86599999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98999999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.165}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3380000000000001}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3069999999999999}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3240000000000001}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.522}]},{"osd":12,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5}]},{"osd":13,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4530000000000001}]},{"osd":14,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5429999999999999}]}]},{"osd":10,"up_from":22,"seq":94489280525,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35016,"kb_used_data":7988,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94336824,"statfs":{"total":96636764160,"available":96600907776,"internally_reserved":0,"allocated":8179712,"data_stored":11316768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1599,"internal_metadata":27654593},"hb_peers":[4,6,7,8,9,11,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.371}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98399999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.871}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91000000000000003}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84499999999999997}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.208}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94299999999999995}]},{"osd":12,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0129999999999999}]},{"osd":13,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.135}]},{"osd":14,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.236}]},{"osd":15,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1759999999999999}]}]},{"osd":11,"up_from":22,"seq":94489280525,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37312,"kb_used_data":10292,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94334528,"statfs":{"total":96636764160,"available":96598556672,"internally_reserved":0,"allocated":10539008,"data_stored":14503456,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[2,4,5,6,8,10,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69099999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65900000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1080000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84499999999999997}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98399999999999999}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1739999999999999}]},{"osd":12,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.282}]},{"osd":13,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3100000000000001}]},{"osd":14,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2050000000000001}]},{"osd":15,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3819999999999999}]}]},{"osd":12,"up_from":22,"seq":94489280525,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":38152,"kb_used_data":11124,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94333688,"statfs":{"total":96636764160,"available":96597696512,"internally_reserved":0,"allocated":11390976,"data_stored":16420384,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,8,10,11,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92400000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2909999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.341}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2649999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3939999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1539999999999999}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4370000000000001}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5600000000000001}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6519999999999999}]},{"osd":13,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6739999999999999}]},{"osd":14,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.7410000000000001}]},{"osd":15,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.625}]}]},{"osd":0,"up_from":23,"seq":98784247821,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37256,"kb_used_data":6144,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94334584,"statfs":{"total":96636764160,"available":96598614016,"internally_reserved":0,"allocated":6291456,"data_stored":8026281,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[1,4,6,7,8,10,11,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63300000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83699999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0649999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.105}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0820000000000001}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.181}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3700000000000001}]},{"osd":13,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94899999999999995}]},{"osd":14,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.304}]},{"osd":15,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.554}]}]},{"osd":3,"up_from":23,"seq":98784247820,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33232,"kb_used_data":6212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94338608,"statfs":{"total":96636764160,"available":96602734592,"internally_reserved":0,"allocated":6361088,"data_stored":8145365,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,2,4,5,7,8,9,10,11,12,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83799999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92600000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.165}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0229999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.472}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.391}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0569999999999999}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.222}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3540000000000001}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6759999999999999}]},{"osd":12,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.331}]},{"osd":14,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.7270000000000001}]},{"osd":15,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.768}]}]},{"osd":7,"up_from":23,"seq":98784247822,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":38340,"kb_used_data":7212,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94333500,"statfs":{"total":96636764160,"available":96597504000,"internally_reserved":0,"allocated":7385088,"data_stored":9850400,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":31848907},"hb_peers":[0,2,3,4,5,6,8,10,12,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.87}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81000000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71099999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2350000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.125}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84699999999999998}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2829999999999999}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0660000000000001}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71699999999999997}]},{"osd":12,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.175}]},{"osd":14,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3819999999999999}]},{"osd":15,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.45}]}]},{"osd":8,"up_from":23,"seq":98784247822,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":38460,"kb_used_data":7340,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94333380,"statfs":{"total":96636764160,"available":96597381120,"internally_reserved":0,"allocated":7516160,"data_stored":9680521,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,2,3,4,5,7,9,11,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59099999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90400000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66400000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2170000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.28}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.026}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.339}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.665}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.383}]},{"osd":12,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5629999999999999}]},{"osd":14,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2989999999999999}]},{"osd":15,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4139999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":13,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":12,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":13,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":14,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":15,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4886528,"data_stored":7012352,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":6537216,"data_stored":9474048,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":5484544,"data_stored":7659520,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":11870208,"data_stored":17281024,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8728576,"data_stored":12709888,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8646656,"data_stored":12775424,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":7389184,"data_stored":10735616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":6643712,"data_stored":9195520,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":8605696,"data_stored":12431360,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":7323648,"data_stored":10842112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":9682944,"data_stored":14028800,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":12,"total":0,"available":0,"internally_reserved":0,"allocated":10534912,"data_stored":15945728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":13,"total":0,"available":0,"internally_reserved":0,"allocated":8065024,"data_stored":12021760,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":14,"total":0,"available":0,"internally_reserved":0,"allocated":14548992,"data_stored":21557248,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":15,"total":0,"available":0,"internally_reserved":0,"allocated":10866688,"data_stored":15794176,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-18T14:44:07.743 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-18T14:44:07.748 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-04-18T14:44:07.835 INFO:tasks.ceph.osd.1.smithi096.stderr:2024-04-18T14:44:07.833+0000 7f56a7a98640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 24887) UID: 0 2024-04-18T14:44:07.896 INFO:tasks.ceph.osd.1.smithi096.stderr:2024-04-18T14:44:07.893+0000 7f56a7a98640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 24887) UID: 0 2024-04-18T14:44:07.914 INFO:teuthology.orchestra.run.smithi096.stdout:ERROR: (22) Invalid argument 2024-04-18T14:44:07.914 INFO:teuthology.orchestra.run.smithi096.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T14:44:07.928 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-04-18T14:44:08.015 INFO:tasks.ceph.osd.9.smithi096.stderr:2024-04-18T14:44:08.013+0000 7fa2c1cbf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 9 (PID: 24891) UID: 0 2024-04-18T14:44:08.081 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-04-18T14:44:08.081 INFO:teuthology.orchestra.run.smithi086.stderr:dumped all 2024-04-18T14:44:08.090 INFO:teuthology.orchestra.run.smithi096.stdout:ERROR: (22) Invalid argument 2024-04-18T14:44:08.090 INFO:teuthology.orchestra.run.smithi096.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T14:44:08.098 INFO:teuthology.orchestra.run.smithi086.stdout:{"pg_ready":true,"pg_map":{"version":82,"stamp":"2024-04-18T14:44:07.385856+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":80413216,"num_objects":136,"num_object_clones":84,"num_object_copies":942,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":136,"num_whiteouts":10,"num_read":448,"num_read_kb":82303,"num_write":671,"num_write_kb":85460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":913,"ondisk_log_size":913,"up":130,"acting":130,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":130,"num_osds":15,"num_per_pool_osds":15,"num_per_pool_omap_osds":15,"kb":1415577600,"kb_used":576940,"kb_used_data":138796,"kb_used_omap":23,"kb_used_meta":437864,"kb_avail":1415000660,"statfs":{"total":1449551462400,"available":1448960675840,"internally_reserved":0,"allocated":142127104,"data_stored":195288079,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":23912,"internal_metadata":448373400},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":43,"apply_latency_ms":43,"commit_latency_ns":43000000,"apply_latency_ns":43000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":8142848,"num_objects":6,"num_object_clones":6,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":1,"num_read":16,"num_read_kb":3367,"num_write":27,"num_write_kb":9312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"3.881212"},"pg_stats":[{"pgid":"3.f","version":"59'24","reported_seq":116,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-18T14:44:02.401013+0000","last_change":"2024-04-18T14:44:02.403173+0000","last_active":"2024-04-18T14:44:02.401013+0000","last_peered":"2024-04-18T14:44:02.401013+0000","last_clean":"2024-04-18T14:44:02.401013+0000","last_became_active":"2024-04-18T14:43:30.738648+0000","last_became_peered":"2024-04-18T14:43:30.738648+0000","last_unstale":"2024-04-18T14:44:02.401013+0000","last_undegraded":"2024-04-18T14:44:02.401013+0000","last_fullsized":"2024-04-18T14:44:02.401013+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T14:43:29.615264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T14:43:29.615264+0000","last_clean_scrub_stamp":"2024-04-18T14:43:29.615264+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T14:44:32.547784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0026750860000000001,"stat_sum":{"num_bytes":1196032,"num_objects":5,"num_object_clones":3,"num_object_copies":35,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":13,"num_read_kb":2788,"num_write":9,"num_write_kb":1168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,12,4,13,14,10,2],"acting":[11,12,4,13,14,10,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[{"start":"f","length":"1"},{"start":"17","length":"1"},{"start":"19","length":"1"}]},{"pgid":"3.e","version":"64'56","reported_seq":149,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-04-18T14:44:03.585344+0000","last_change":"2024-04-18T14:44:03.535963+0000","last_active":"2024-04-18T14:44:03.585344+0000","last_peered":"2024-04-18T14:44:03.585344+0000","last_clean":"2024-04-18T14:44:03.585344+0000","last_became_active":"2024-04-18T14:43:30.749869+0000","last_became_peered":"2024-04-18T14:43:30.749869+0000","last_unstale":"2024-04-18T14:44:03.585344+0000","last_undegraded":"2024-04-18T14:44:03.585344+0000","last_fullsized":"2024-04-18T14:44:03.585344+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T14:43:29.615264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T14:43:29.615264+0000","last_clean_scrub_stamp":"2024-04-18T14:43:29.615264+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T14:44:29.697588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.031169183999999999,"stat_sum":{"num_bytes":4456448,"num_objects":9,"num_object_clones":6,"num_object_copies":63,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":1,"num_read":19,"num_read_kb":5720,"num_write":62,"num_write_kb":5712,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,4,11,2,0,3],"acting":[8,9,4,11,2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[{"start":"b","length":"1"},{"start":"f","length":"1"},{"start":"17","length":"1"},{"start":"19","length":"1"}]},{"pgid":"3.d","version":"64'31","reported_seq":119,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-04-18T14:44:03.564192+0000","last_change":"2024-04-18T14:44:03.566790+0000","last_active":"2024-04-18T14:44:03.564192+0000","last_peered":"2024-04-18T14:44:03.564192+0000","last_clean":"2024-04-18T14:44:03.564192+0000","last_became_active":"2024-04-18T14:43:30.735975+0000","last_became_peered":"2024-04-18T14:43:30.735975+0000","last_unstale":"2024-04-18T14:44:03.564192+0000","last_undegraded":"2024-04-18T14:44:03.564192+0000","last_fullsized":"2024-04-18T14:44:03.564192+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T14:43:29.615264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T14:43:29.615264+0000","last_clean_scrub_stamp":"2024-04-18T14:43:29.615264+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T14:44:53.155373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.034467420999999998,"stat_sum":{"num_bytes":2146304,"num_objects":6,"num_object_clones":4,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":1,"num_read":5,"num_read_kb":2,"num_write":11,"num_write_kb":2096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,0,12,10,2,6],"acting":[7,3,0,12,10,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"b","length":"1"},{"start":"f","length":"1"},{"start":"17","length":"1"},{"start":"19","length":"1"}]},{"pgid":"3.c","version":"63'69","reported_seq":171,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-18T14:44:02.426431+0000","last_change":"2024-04-18T14:44:02.427614+0000","last_active":"2024-04-18T14:44:02.426431+0000","last_peered":"2024-04-18T14:44:02.426431+0000","last_clean":"2024-04-18T14:44:02.426431+0000","last_became_active":"2024-04-18T14:43:30.737285+0000","last_became_peered":"2024-04-18T14:43:30.737285+0000","last_unstale":"2024-04-18T14:44:02.426431+0000","last_undegraded":"2024-04-18T14:44:02.426431+0000","last_fullsized":"2024-04-18T14:44:02.426431+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T14:43:29.615264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T14:43:29.615264+0000","last_clean_scrub_stamp":"2024-04-18T14:43:29.615264+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":0,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T14:44:34.651938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.027171862000000001,"stat_sum":{"num_bytes":8470528,"num_objects":16,"num_object_clones":10,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":1,"num_read":43,"num_read_kb":9087,"num_write":51,"num_write_kb":6464,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,10,14,12,4,2,6],"acting":[11,10,14,12,4,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[{"start":"f","length":"1"},{"start":"17","length":"1"},{"start":"19","length":"1"}]},{"pgid":"3.b","version":"63'22","reported_seq":110,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-18T14:44:02.393292+0000","last_change":"2024-04-18T14:44:02.394019+0000","last_active":"2024-04-18T14:44:02.393292+0000","last_peered":"2024-04-18T14:44:02.393292+0000","last_clean":"2024-04-18T14:44:02.393292+0000","last_became_active":"2024-04-18T14:43:30.745638+0000","last_became_peered":"2024-04-18T14:43:30.745638+0000","last_unstale":"2024-04-18T14:44:02.393292+0000","last_undegraded":"2024-04-18T14:44:02.393292+0000","last_fullsized":"2024-04-18T14:44:02.393292+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T14:43:29.615264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T14:43:29.615264+0000","last_clean_scrub_stamp":"2024-04-18T14:43:29.615264+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T14:44:32.453854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.010185381,"stat_sum":{"num_bytes":2228224,"num_objects":6,"num_object_clones":3,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":7,"num_read_kb":3,"num_write":36,"num_write_kb":2176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,6,4,9,8,7,14],"acting":[10,6,4,9,8,7,14],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[{"start":"f","length":"1"},{"start":"17","length":"1"},{"start":"19","length":"1"}]},{"pgid":"3.a","version":"64'49","reported_seq":146,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-04-18T14:44:03.593313+0000","last_change":"2024-04-18T14:44:03.546556+0000","last_active":"2024-04-18T14:44:03.593313+0000","last_peered":"2024-04-18T14:44:03.593313+0000","last_clean":"2024-04-18T14:44:03.593313+0000","last_became_active":"2024-04-18T14:43:30.747627+0000","last_became_peered":"2024-04-18T14:43:30.747627+0000","last_unstale":"2024-04-18T14:44:03.593313+0000","last_undegraded":"2024-04-18T14:44:03.593313+0000","last_fullsized":"2024-04-18T14:44:03.593313+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T14:43:29.615264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T14:43:29.615264+0000","last_clean_scrub_stamp":"2024-04-18T14:43:29.615264+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T14:44:46.251182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.028915545000000001,"stat_sum":{"num_bytes":7798784,"num_objects":10,"num_object_clones":6,"num_object_copies":70,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":21,"num_read_kb":2986,"num_write":28,"num_write_kb":7440,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,12,9,8,15,11],"acting":[3,7,12,9,8,15,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"b","length":"1"},{"start":"f","length":"1"},{"start":"17","length":"1"},{"start":"19","length":"1"}]},{"pgid":"3.9","version":"63'92","reported_seq":193,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-18T14:44:02.420668+0000","last_change":"2024-04-18T14:44:02.421281+0000","last_active":"2024-04-18T14:44:02.420668+0000","last_peered":"2024-04-18T14:44:02.420668+0000","last_clean":"2024-04-18T14:44:02.420668+0000","last_became_active":"2024-04-18T14:43:30.739560+0000","last_became_peered":"2024-04-18T14:43:30.739560+0000","last_unstale":"2024-04-18T14:44:02.420668+0000","last_undegraded":"2024-04-18T14:44:02.420668+0000","last_fullsized":"2024-04-18T14:44:02.420668+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T14:43:29.615264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T14:43:29.615264+0000","last_clean_scrub_stamp":"2024-04-18T14:43:29.615264+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T14:44:52.637394+0000","scrub_duration":0,"objects_trimmed":2,"snaptrim_duration":0.029001329999999999,"stat_sum":{"num_bytes":10141696,"num_objects":14,"num_object_clones":8,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":1,"num_read":34,"num_read_kb":7840,"num_write":49,"num_write_kb":12960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[12,5,14,4,15,10,6],"acting":[12,5,14,4,15,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":12,"acting_primary":12,"purged_snaps":[{"start":"f","length":"1"},{"start":"17","length":"1"},{"start":"19","length":"1"}]},{"pgid":"3.8","version":"65'96","reported_seq":212,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-04-18T14:44:04.440023+0000","last_change":"2024-04-18T14:44:04.441469+0000","last_active":"2024-04-18T14:44:04.440023+0000","last_peered":"2024-04-18T14:44:04.440023+0000","last_clean":"2024-04-18T14:44:04.440023+0000","last_became_active":"2024-04-18T14:43:30.736462+0000","last_became_peered":"2024-04-18T14:43:30.736462+0000","last_unstale":"2024-04-18T14:44:04.440023+0000","last_undegraded":"2024-04-18T14:44:04.440023+0000","last_fullsized":"2024-04-18T14:44:04.440023+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T14:43:29.615264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T14:43:29.615264+0000","last_clean_scrub_stamp":"2024-04-18T14:43:29.615264+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":0,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T14:44:41.558673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.062922890999999995,"stat_sum":{"num_bytes":8142848,"num_objects":15,"num_object_clones":9,"num_object_copies":105,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":1,"num_read":49,"num_read_kb":18977,"num_write":51,"num_write_kb":7952,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,0,4,14,15,13],"acting":[5,10,0,4,14,15,13],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"7","length":"1"},{"start":"b","length":"1"},{"start":"19","length":"1"}]},{"pgid":"1.0","version":"26'157","reported_seq":244,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-04-18T14:44:03.520578+0000","last_change":"2024-04-18T14:43:20.323829+0000","last_active":"2024-04-18T14:44:03.520578+0000","last_peered":"2024-04-18T14:44:03.520578+0000","last_clean":"2024-04-18T14:44:03.520578+0000","last_became_active":"2024-04-18T14:43:20.323133+0000","last_became_peered":"2024-04-18T14:43:20.323133+0000","last_unstale":"2024-04-18T14:44:03.520578+0000","last_undegraded":"2024-04-18T14:44:03.520578+0000","last_fullsized":"2024-04-18T14:44:03.520578+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T14:43:18.296821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T14:43:18.296821+0000","last_clean_scrub_stamp":"2024-04-18T14:43:18.296821+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T14:44:25.445335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[13,0],"acting":[13,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":13,"acting_primary":13,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":48,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-04-18T14:44:03.510942+0000","last_change":"2024-04-18T14:43:21.329224+0000","last_active":"2024-04-18T14:44:03.510942+0000","last_peered":"2024-04-18T14:44:03.510942+0000","last_clean":"2024-04-18T14:44:03.510942+0000","last_became_active":"2024-04-18T14:43:21.327764+0000","last_became_peered":"2024-04-18T14:43:21.327764+0000","last_unstale":"2024-04-18T14:44:03.510942+0000","last_undegraded":"2024-04-18T14:44:03.510942+0000","last_fullsized":"2024-04-18T14:44:03.510942+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T14:43:20.303322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T14:43:20.303322+0000","last_clean_scrub_stamp":"2024-04-18T14:43:20.303322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T14:44:20.633685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,15],"acting":[5,15],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"65'35","reported_seq":133,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-04-18T14:44:04.418150+0000","last_change":"2024-04-18T14:44:04.420733+0000","last_active":"2024-04-18T14:44:04.418150+0000","last_peered":"2024-04-18T14:44:04.418150+0000","last_clean":"2024-04-18T14:44:04.418150+0000","last_became_active":"2024-04-18T14:43:30.737254+0000","last_became_peered":"2024-04-18T14:43:30.737254+0000","last_unstale":"2024-04-18T14:44:04.418150+0000","last_undegraded":"2024-04-18T14:44:04.418150+0000","last_fullsized":"2024-04-18T14:44:04.418150+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T14:43:29.615264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T14:43:29.615264+0000","last_clean_scrub_stamp":"2024-04-18T14:43:29.615264+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T14:44:42.268037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.036869977999999998,"stat_sum":{"num_bytes":4653056,"num_objects":5,"num_object_clones":3,"num_object_copies":35,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":1,"num_read":11,"num_read_kb":102,"num_write":16,"num_write_kb":4544,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[13,12,3,4,15,7,11],"acting":[13,12,3,4,15,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":13,"acting_primary":13,"purged_snaps":[{"start":"7","length":"1"},{"start":"b","length":"1"},{"start":"19","length":"1"}]},{"pgid":"2.0","version":"0'0","reported_seq":46,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-18T14:44:02.392629+0000","last_change":"2024-04-18T14:43:21.414881+0000","last_active":"2024-04-18T14:44:02.392629+0000","last_peered":"2024-04-18T14:44:02.392629+0000","last_clean":"2024-04-18T14:44:02.392629+0000","last_became_active":"2024-04-18T14:43:21.414060+0000","last_became_peered":"2024-04-18T14:43:21.414060+0000","last_unstale":"2024-04-18T14:44:02.392629+0000","last_undegraded":"2024-04-18T14:44:02.392629+0000","last_fullsized":"2024-04-18T14:44:02.392629+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T14:43:20.303322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T14:43:20.303322+0000","last_clean_scrub_stamp":"2024-04-18T14:43:20.303322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T14:44:26.835605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"63'39","reported_seq":139,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-18T14:44:02.403023+0000","last_change":"2024-04-18T14:44:02.403791+0000","last_active":"2024-04-18T14:44:02.403023+0000","last_peered":"2024-04-18T14:44:02.403023+0000","last_clean":"2024-04-18T14:44:02.403023+0000","last_became_active":"2024-04-18T14:43:30.746554+0000","last_became_peered":"2024-04-18T14:43:30.746554+0000","last_unstale":"2024-04-18T14:44:02.403023+0000","last_undegraded":"2024-04-18T14:44:02.403023+0000","last_fullsized":"2024-04-18T14:44:02.403023+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T14:43:29.615264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T14:43:29.615264+0000","last_clean_scrub_stamp":"2024-04-18T14:43:29.615264+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T14:44:30.628320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.016704111000000001,"stat_sum":{"num_bytes":4849664,"num_objects":8,"num_object_clones":4,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":28,"num_read_kb":16138,"num_write":20,"num_write_kb":4880,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,11,9,5,12,0,13],"acting":[6,11,9,5,12,0,13],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"f","length":"1"},{"start":"17","length":"1"},{"start":"19","length":"1"}]},{"pgid":"2.1","version":"0'0","reported_seq":47,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-04-18T14:44:03.520794+0000","last_change":"2024-04-18T14:43:21.329508+0000","last_active":"2024-04-18T14:44:03.520794+0000","last_peered":"2024-04-18T14:44:03.520794+0000","last_clean":"2024-04-18T14:44:03.520794+0000","last_became_active":"2024-04-18T14:43:21.328534+0000","last_became_peered":"2024-04-18T14:43:21.328534+0000","last_unstale":"2024-04-18T14:44:03.520794+0000","last_undegraded":"2024-04-18T14:44:03.520794+0000","last_fullsized":"2024-04-18T14:44:03.520794+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T14:43:20.303322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T14:43:20.303322+0000","last_clean_scrub_stamp":"2024-04-18T14:43:20.303322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T14:44:22.866788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[13,5],"acting":[13,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":13,"acting_primary":13,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":86,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-18T14:44:02.391907+0000","last_change":"2024-04-18T14:44:02.392234+0000","last_active":"2024-04-18T14:44:02.391907+0000","last_peered":"2024-04-18T14:44:02.391907+0000","last_clean":"2024-04-18T14:44:02.391907+0000","last_became_active":"2024-04-18T14:43:30.735711+0000","last_became_peered":"2024-04-18T14:43:30.735711+0000","last_unstale":"2024-04-18T14:44:02.391907+0000","last_undegraded":"2024-04-18T14:44:02.391907+0000","last_fullsized":"2024-04-18T14:44:02.391907+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T14:43:29.615264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T14:43:29.615264+0000","last_clean_scrub_stamp":"2024-04-18T14:43:29.615264+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T14:44:49.070959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00061578900000000005,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[12,11,15,0,5,8,6],"acting":[12,11,15,0,5,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":12,"acting_primary":12,"purged_snaps":[{"start":"f","length":"1"},{"start":"17","length":"1"},{"start":"19","length":"1"}]},{"pgid":"2.2","version":"0'0","reported_seq":46,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-18T14:44:02.393442+0000","last_change":"2024-04-18T14:43:21.465969+0000","last_active":"2024-04-18T14:44:02.393442+0000","last_peered":"2024-04-18T14:44:02.393442+0000","last_clean":"2024-04-18T14:44:02.393442+0000","last_became_active":"2024-04-18T14:43:21.465481+0000","last_became_peered":"2024-04-18T14:43:21.465481+0000","last_unstale":"2024-04-18T14:44:02.393442+0000","last_undegraded":"2024-04-18T14:44:02.393442+0000","last_fullsized":"2024-04-18T14:44:02.393442+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T14:43:20.303322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T14:43:20.303322+0000","last_clean_scrub_stamp":"2024-04-18T14:43:20.303322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T14:44:45.650560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10],"acting":[3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"65'39","reported_seq":137,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-04-18T14:44:04.413466+0000","last_change":"2024-04-18T14:44:04.415972+0000","last_active":"2024-04-18T14:44:04.413466+0000","last_peered":"2024-04-18T14:44:04.413466+0000","last_clean":"2024-04-18T14:44:04.413466+0000","last_became_active":"2024-04-18T14:43:30.737990+0000","last_became_peered":"2024-04-18T14:43:30.737990+0000","last_unstale":"2024-04-18T14:44:04.413466+0000","last_undegraded":"2024-04-18T14:44:04.413466+0000","last_fullsized":"2024-04-18T14:44:04.413466+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T14:43:29.615264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T14:43:29.615264+0000","last_clean_scrub_stamp":"2024-04-18T14:43:29.615264+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T14:44:56.230031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.031999012,"stat_sum":{"num_bytes":3112960,"num_objects":7,"num_object_clones":5,"num_object_copies":49,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":13,"num_read_kb":379,"num_write":14,"num_write_kb":3456,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[13,7,2,15,4,5,3],"acting":[13,7,2,15,4,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":13,"acting_primary":13,"purged_snaps":[{"start":"7","length":"1"},{"start":"b","length":"1"},{"start":"19","length":"1"}]},{"pgid":"3.5","version":"64'23","reported_seq":117,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-04-18T14:44:03.575332+0000","last_change":"2024-04-18T14:44:03.568971+0000","last_active":"2024-04-18T14:44:03.575332+0000","last_peered":"2024-04-18T14:44:03.575332+0000","last_clean":"2024-04-18T14:44:03.575332+0000","last_became_active":"2024-04-18T14:43:30.653147+0000","last_became_peered":"2024-04-18T14:43:30.653147+0000","last_unstale":"2024-04-18T14:44:03.575332+0000","last_undegraded":"2024-04-18T14:44:03.575332+0000","last_fullsized":"2024-04-18T14:44:03.575332+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T14:43:29.615264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T14:43:29.615264+0000","last_clean_scrub_stamp":"2024-04-18T14:43:29.615264+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T14:44:48.289654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.042236103999999997,"stat_sum":{"num_bytes":3653632,"num_objects":3,"num_object_clones":2,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":1876,"num_write":12,"num_write_kb":4624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[15,6,14,13,7,11,8],"acting":[15,6,14,13,7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":15,"acting_primary":15,"purged_snaps":[{"start":"b","length":"1"},{"start":"f","length":"1"},{"start":"17","length":"1"},{"start":"19","length":"1"}]},{"pgid":"2.4","version":"0'0","reported_seq":46,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-18T14:44:01.396202+0000","last_change":"2024-04-18T14:43:21.348882+0000","last_active":"2024-04-18T14:44:01.396202+0000","last_peered":"2024-04-18T14:44:01.396202+0000","last_clean":"2024-04-18T14:44:01.396202+0000","last_became_active":"2024-04-18T14:43:21.348012+0000","last_became_peered":"2024-04-18T14:43:21.348012+0000","last_unstale":"2024-04-18T14:44:01.396202+0000","last_undegraded":"2024-04-18T14:44:01.396202+0000","last_fullsized":"2024-04-18T14:44:01.396202+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T14:43:20.303322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T14:43:20.303322+0000","last_clean_scrub_stamp":"2024-04-18T14:43:20.303322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T14:44:27.891832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,12],"acting":[6,12],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.4","version":"59'14","reported_seq":105,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-18T14:44:02.384079+0000","last_change":"2024-04-18T14:44:02.384425+0000","last_active":"2024-04-18T14:44:02.384079+0000","last_peered":"2024-04-18T14:44:02.384079+0000","last_clean":"2024-04-18T14:44:02.384079+0000","last_became_active":"2024-04-18T14:43:30.745133+0000","last_became_peered":"2024-04-18T14:43:30.745133+0000","last_unstale":"2024-04-18T14:44:02.384079+0000","last_undegraded":"2024-04-18T14:44:02.384079+0000","last_fullsized":"2024-04-18T14:44:02.384079+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T14:43:29.615264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T14:43:29.615264+0000","last_clean_scrub_stamp":"2024-04-18T14:43:29.615264+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T14:44:41.134460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00044418099999999998,"stat_sum":{"num_bytes":507904,"num_objects":2,"num_object_clones":1,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":1,"num_read":6,"num_read_kb":1490,"num_write":5,"num_write_kb":496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,12,14,9,6,11,13],"acting":[10,12,14,9,6,11,13],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[{"start":"f","length":"1"},{"start":"17","length":"1"},{"start":"19","length":"1"}]},{"pgid":"2.5","version":"0'0","reported_seq":47,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-18T14:44:02.384719+0000","last_change":"2024-04-18T14:43:21.423043+0000","last_active":"2024-04-18T14:44:02.384719+0000","last_peered":"2024-04-18T14:44:02.384719+0000","last_clean":"2024-04-18T14:44:02.384719+0000","last_became_active":"2024-04-18T14:43:21.422468+0000","last_became_peered":"2024-04-18T14:43:21.422468+0000","last_unstale":"2024-04-18T14:44:02.384719+0000","last_undegraded":"2024-04-18T14:44:02.384719+0000","last_fullsized":"2024-04-18T14:44:02.384719+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T14:43:20.303322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T14:43:20.303322+0000","last_clean_scrub_stamp":"2024-04-18T14:43:20.303322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T14:44:36.598607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2],"acting":[8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.7","version":"65'86","reported_seq":191,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-04-18T14:44:05.382942+0000","last_change":"2024-04-18T14:44:04.448589+0000","last_active":"2024-04-18T14:44:05.382942+0000","last_peered":"2024-04-18T14:44:05.382942+0000","last_clean":"2024-04-18T14:44:05.382942+0000","last_became_active":"2024-04-18T14:43:30.747200+0000","last_became_peered":"2024-04-18T14:43:30.747200+0000","last_unstale":"2024-04-18T14:44:05.382942+0000","last_undegraded":"2024-04-18T14:44:05.382942+0000","last_fullsized":"2024-04-18T14:44:05.382942+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T14:43:29.615264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T14:43:29.615264+0000","last_clean_scrub_stamp":"2024-04-18T14:43:29.615264+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":0,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T14:44:46.083412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.051520773999999998,"stat_sum":{"num_bytes":8667136,"num_objects":13,"num_object_clones":9,"num_object_copies":91,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":1,"num_read":32,"num_read_kb":12580,"num_write":70,"num_write_kb":8464,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[14,8,9,4,2,5,11],"acting":[14,8,9,4,2,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":14,"acting_primary":14,"purged_snaps":[{"start":"7","length":"1"},{"start":"b","length":"1"},{"start":"19","length":"1"}]},{"pgid":"2.6","version":"0'0","reported_seq":50,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-04-18T14:44:05.382753+0000","last_change":"2024-04-18T14:43:21.414621+0000","last_active":"2024-04-18T14:44:05.382753+0000","last_peered":"2024-04-18T14:44:05.382753+0000","last_clean":"2024-04-18T14:44:05.382753+0000","last_became_active":"2024-04-18T14:43:21.413906+0000","last_became_peered":"2024-04-18T14:43:21.413906+0000","last_unstale":"2024-04-18T14:44:05.382753+0000","last_undegraded":"2024-04-18T14:44:05.382753+0000","last_fullsized":"2024-04-18T14:44:05.382753+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T14:43:20.303322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T14:43:20.303322+0000","last_clean_scrub_stamp":"2024-04-18T14:43:20.303322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T14:44:28.448910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[14,0],"acting":[14,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":14,"acting_primary":14,"purged_snaps":[]},{"pgid":"3.6","version":"67'81","reported_seq":182,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-18T14:44:06.478645+0000","last_change":"2024-04-18T14:44:04.430098+0000","last_active":"2024-04-18T14:44:06.478645+0000","last_peered":"2024-04-18T14:44:06.478645+0000","last_clean":"2024-04-18T14:44:06.478645+0000","last_became_active":"2024-04-18T14:43:30.746945+0000","last_became_peered":"2024-04-18T14:43:30.746945+0000","last_unstale":"2024-04-18T14:44:06.478645+0000","last_undegraded":"2024-04-18T14:44:06.478645+0000","last_fullsized":"2024-04-18T14:44:06.478645+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T14:43:29.615264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T14:43:29.615264+0000","last_clean_scrub_stamp":"2024-04-18T14:43:29.615264+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":0,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T14:44:35.748592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.037022620999999999,"stat_sum":{"num_bytes":9797632,"num_objects":15,"num_object_clones":11,"num_object_copies":105,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":2,"num_read":22,"num_read_kb":2217,"num_write":34,"num_write_kb":9568,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[14,13,12,15,6,7,9],"acting":[14,13,12,15,6,7,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":14,"acting_primary":14,"purged_snaps":[{"start":"7","length":"1"},{"start":"b","length":"1"},{"start":"19","length":"1"}]},{"pgid":"2.7","version":"0'0","reported_seq":46,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-18T14:44:02.384842+0000","last_change":"2024-04-18T14:43:21.328715+0000","last_active":"2024-04-18T14:44:02.384842+0000","last_peered":"2024-04-18T14:44:02.384842+0000","last_clean":"2024-04-18T14:44:02.384842+0000","last_became_active":"2024-04-18T14:43:21.328185+0000","last_became_peered":"2024-04-18T14:43:21.328185+0000","last_unstale":"2024-04-18T14:44:02.384842+0000","last_undegraded":"2024-04-18T14:44:02.384842+0000","last_fullsized":"2024-04-18T14:44:02.384842+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T14:43:20.303322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T14:43:20.303322+0000","last_clean_scrub_stamp":"2024-04-18T14:43:20.303322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T14:44:20.541816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[15,13],"acting":[15,13],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":15,"acting_primary":15,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":16,"stat_sum":{"num_bytes":79822848,"num_objects":134,"num_object_clones":84,"num_object_copies":938,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":134,"num_whiteouts":10,"num_read":312,"num_read_kb":82185,"num_write":468,"num_write_kb":82000,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":129814528,"data_stored":189464576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":756,"ondisk_log_size":756,"up":112,"acting":112,"num_store_stats":15},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":11},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1064960,"data_stored":1057856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":13,"up_from":24,"seq":103079215116,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40368,"kb_used_data":9252,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94331472,"statfs":{"total":96636764160,"available":96595427328,"internally_reserved":0,"allocated":9474048,"data_stored":13036533,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,2,3,4,5,7,11,12,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65400000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81699999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89400000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57199999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83999999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1950000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95999999999999996}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0609999999999999}]},{"osd":12,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.147}]},{"osd":14,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93799999999999994}]},{"osd":15,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0820000000000001}]}]},{"osd":9,"up_from":24,"seq":103079215117,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40396,"kb_used_data":9276,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94331444,"statfs":{"total":96636764160,"available":96595398656,"internally_reserved":0,"allocated":9498624,"data_stored":12927622,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1599,"internal_metadata":31848897},"hb_peers":[0,1,3,8,10,11,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93100000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72999999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1379999999999999}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.091}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3360000000000001}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.024}]},{"osd":12,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6759999999999999}]},{"osd":13,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6060000000000001}]},{"osd":14,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.55}]},{"osd":15,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.452}]}]},{"osd":5,"up_from":24,"seq":103079215118,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40516,"kb_used_data":9396,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94331324,"statfs":{"total":96636764160,"available":96595275776,"internally_reserved":0,"allocated":9621504,"data_stored":13206150,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,3,4,6,10,11,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78100000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94199999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68799999999999994}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84099999999999997}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2330000000000001}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96599999999999997}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0600000000000001}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1879999999999999}]},{"osd":12,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1000000000000001}]},{"osd":13,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2170000000000001}]},{"osd":14,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.345}]},{"osd":15,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2829999999999999}]}]},{"osd":14,"up_from":21,"seq":90194313230,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":46236,"kb_used_data":15112,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94325604,"statfs":{"total":96636764160,"available":96589418496,"internally_reserved":0,"allocated":15474688,"data_stored":22074056,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,2,4,5,6,7,8,9,11,12,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65200000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45200000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94499999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47399999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85599999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59599999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91500000000000004}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63700000000000001}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81599999999999995}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4219999999999999}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79600000000000004}]},{"osd":12,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75}]},{"osd":13,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86799999999999999}]},{"osd":15,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95699999999999996}]}]},{"osd":1,"up_from":0,"seq":103079215118,"num_pgs":0,"num_osds":0,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":0,"kb_used":0,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":0,"statfs":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},{"osd":2,"up_from":22,"seq":94489280525,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":34252,"kb_used_data":7224,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94337588,"statfs":{"total":96636764160,"available":96601690112,"internally_reserved":0,"allocated":7397376,"data_stored":9949548,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,3,5,6,7,8,10,11,12,14],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76500000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96999999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96699999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.014}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69099999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2010000000000001}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.335}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.357}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.242}]},{"osd":12,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4319999999999999}]},{"osd":14,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.456}]}]},{"osd":15,"up_from":23,"seq":98784247822,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41324,"kb_used_data":10196,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94330516,"statfs":{"total":96636764160,"available":96594448384,"internally_reserved":0,"allocated":10440704,"data_stored":14339616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31848903},"hb_peers":[0,4,5,6,7,8,10,11,13,14],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1359999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2050000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97899999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.016}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.371}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.046}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79300000000000004}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2769999999999999}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2430000000000001}]},{"osd":13,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.401}]},{"osd":14,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.518}]}]},{"osd":4,"up_from":22,"seq":94489280524,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39456,"kb_used_data":12428,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94332384,"statfs":{"total":96636764160,"available":96596361216,"internally_reserved":0,"allocated":12726272,"data_stored":17755680,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[2,3,5,6,10,11,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2330000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92100000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79000000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.103}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.151}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.21}]},{"osd":12,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1299999999999999}]},{"osd":13,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.99099999999999999}]},{"osd":14,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0820000000000001}]},{"osd":15,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5980000000000001}]}]},{"osd":6,"up_from":22,"seq":94489280524,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36624,"kb_used_data":9600,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94335216,"statfs":{"total":96636764160,"available":96599261184,"internally_reserved":0,"allocated":9830400,"data_stored":14055699,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,5,7,8,9,11,12,13,14],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93999999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.129}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95399999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86599999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98999999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.165}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3380000000000001}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3069999999999999}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3240000000000001}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.522}]},{"osd":12,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5}]},{"osd":13,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4530000000000001}]},{"osd":14,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5429999999999999}]}]},{"osd":10,"up_from":22,"seq":94489280525,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35016,"kb_used_data":7988,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94336824,"statfs":{"total":96636764160,"available":96600907776,"internally_reserved":0,"allocated":8179712,"data_stored":11316768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1599,"internal_metadata":27654593},"hb_peers":[4,6,7,8,9,11,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.371}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98399999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.871}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91000000000000003}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84499999999999997}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.208}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94299999999999995}]},{"osd":12,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0129999999999999}]},{"osd":13,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.135}]},{"osd":14,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.236}]},{"osd":15,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1759999999999999}]}]},{"osd":11,"up_from":22,"seq":94489280525,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37312,"kb_used_data":10292,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94334528,"statfs":{"total":96636764160,"available":96598556672,"internally_reserved":0,"allocated":10539008,"data_stored":14503456,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[2,4,5,6,8,10,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69099999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65900000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1080000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84499999999999997}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98399999999999999}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1739999999999999}]},{"osd":12,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.282}]},{"osd":13,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3100000000000001}]},{"osd":14,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2050000000000001}]},{"osd":15,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3819999999999999}]}]},{"osd":12,"up_from":22,"seq":94489280525,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":38152,"kb_used_data":11124,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94333688,"statfs":{"total":96636764160,"available":96597696512,"internally_reserved":0,"allocated":11390976,"data_stored":16420384,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,8,10,11,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92400000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2909999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.341}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2649999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3939999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1539999999999999}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4370000000000001}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5600000000000001}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6519999999999999}]},{"osd":13,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6739999999999999}]},{"osd":14,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.7410000000000001}]},{"osd":15,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.625}]}]},{"osd":0,"up_from":23,"seq":98784247821,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37256,"kb_used_data":6144,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94334584,"statfs":{"total":96636764160,"available":96598614016,"internally_reserved":0,"allocated":6291456,"data_stored":8026281,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[1,4,6,7,8,10,11,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63300000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83699999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0649999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.105}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0820000000000001}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.181}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3700000000000001}]},{"osd":13,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94899999999999995}]},{"osd":14,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.304}]},{"osd":15,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.554}]}]},{"osd":3,"up_from":23,"seq":98784247820,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33232,"kb_used_data":6212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94338608,"statfs":{"total":96636764160,"available":96602734592,"internally_reserved":0,"allocated":6361088,"data_stored":8145365,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,2,4,5,7,8,9,10,11,12,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83799999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92600000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.165}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0229999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.472}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.391}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0569999999999999}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.222}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3540000000000001}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6759999999999999}]},{"osd":12,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.331}]},{"osd":14,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.7270000000000001}]},{"osd":15,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.768}]}]},{"osd":7,"up_from":23,"seq":98784247822,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":38340,"kb_used_data":7212,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94333500,"statfs":{"total":96636764160,"available":96597504000,"internally_reserved":0,"allocated":7385088,"data_stored":9850400,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":31848907},"hb_peers":[0,2,3,4,5,6,8,10,12,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.87}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81000000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71099999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2350000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.125}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84699999999999998}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2829999999999999}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0660000000000001}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71699999999999997}]},{"osd":12,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.175}]},{"osd":14,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3819999999999999}]},{"osd":15,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.45}]}]},{"osd":8,"up_from":23,"seq":98784247822,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":38460,"kb_used_data":7340,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94333380,"statfs":{"total":96636764160,"available":96597381120,"internally_reserved":0,"allocated":7516160,"data_stored":9680521,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,2,3,4,5,7,9,11,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59099999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90400000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66400000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2170000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.28}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.026}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.339}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.665}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.383}]},{"osd":12,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5629999999999999}]},{"osd":14,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2989999999999999}]},{"osd":15,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4139999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":13,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":12,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":13,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":14,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":15,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4886528,"data_stored":7012352,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":6537216,"data_stored":9474048,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":5484544,"data_stored":7659520,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":11870208,"data_stored":17281024,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8728576,"data_stored":12709888,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8646656,"data_stored":12775424,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":7389184,"data_stored":10735616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":6643712,"data_stored":9195520,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":8605696,"data_stored":12431360,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":7323648,"data_stored":10842112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":9682944,"data_stored":14028800,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":12,"total":0,"available":0,"internally_reserved":0,"allocated":10534912,"data_stored":15945728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":13,"total":0,"available":0,"internally_reserved":0,"allocated":8065024,"data_stored":12021760,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":14,"total":0,"available":0,"internally_reserved":0,"allocated":14548992,"data_stored":21557248,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":15,"total":0,"available":0,"internally_reserved":0,"allocated":10866688,"data_stored":15794176,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-18T14:44:08.101 INFO:tasks.ceph.ceph_manager.ceph:recovered! 2024-04-18T14:44:08.101 INFO:tasks.thrashosds.thrasher:choose_action: min_in 8 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-04-18T14:44:08.101 INFO:tasks.thrashosds.thrasher:Adding osd 1 2024-04-18T14:44:08.101 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd in 1 2024-04-18T14:44:08.102 INFO:tasks.ceph.osd.10.smithi119.stderr:2024-04-18T14:44:08.098+0000 7f6f24c12640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 10 (PID: 24898) UID: 0 2024-04-18T14:44:08.105 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.9.asok dump_ops_in_flight 2024-04-18T14:44:08.199 INFO:tasks.ceph.osd.3.smithi134.stderr:2024-04-18T14:44:08.204+0000 7fe7a4443640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25211) UID: 0 2024-04-18T14:44:08.271 INFO:teuthology.orchestra.run.smithi096.stdout:ERROR: (22) Invalid argument 2024-04-18T14:44:08.271 INFO:teuthology.orchestra.run.smithi096.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T14:44:08.285 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.9.asok dump_blocked_ops 2024-04-18T14:44:08.301 INFO:tasks.ceph.osd.3.smithi134.stderr:2024-04-18T14:44:08.304+0000 7fe7a4443640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25211) UID: 0 2024-04-18T14:44:08.389 INFO:tasks.rados.rados.0.smithi134.stdout:268: done (2 left) 2024-04-18T14:44:08.435 INFO:tasks.rados.rados.0.smithi134.stdout:269: rollback oid 48 current snap is 23 2024-04-18T14:44:08.436 INFO:tasks.rados.rados.0.smithi134.stdout:rollback oid 48 to 12 2024-04-18T14:44:08.436 INFO:tasks.rados.rados.0.smithi134.stdout:append oid 17 current snap is 23 2024-04-18T14:44:08.436 INFO:tasks.rados.rados.0.smithi134.stdout:270: seq_num 113 ranges {2441216=737280,3178496=557056,3735552=606208} 2024-04-18T14:44:08.436 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-04-18T14:44:08.438 INFO:tasks.ceph.mon.a.smithi086.stderr:2024-04-18T14:44:08.410+0000 7f0d98e5e640 -1 mon.a@0(leader).osd e69 definitely_dead 0 2024-04-18T14:44:08.438 INFO:tasks.rados.rados.0.smithi134.stdout:270: writing smithi13430248-17 from 2441216 to 3178496 tid 1 2024-04-18T14:44:08.438 INFO:tasks.rados.rados.0.smithi134.stdout:270: writing smithi13430248-17 from 3178496 to 3735552 tid 2 2024-04-18T14:44:08.439 INFO:teuthology.orchestra.run.smithi096.stdout:ERROR: (22) Invalid argument 2024-04-18T14:44:08.439 INFO:teuthology.orchestra.run.smithi096.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T14:44:08.439 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.9.asok dump_historic_ops 2024-04-18T14:44:08.440 INFO:tasks.ceph.osd.13.smithi096.stderr:2024-04-18T14:44:08.433+0000 7f7e72fad640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 13 (PID: 24893) UID: 0 2024-04-18T14:44:08.442 INFO:tasks.rados.rados.0.smithi134.stdout:270: writing smithi13430248-17 from 3735552 to 4341760 tid 3 2024-04-18T14:44:08.443 INFO:tasks.rados.rados.0.smithi134.stdout:append oid 4 current snap is 23 2024-04-18T14:44:08.443 INFO:tasks.rados.rados.0.smithi134.stdout:264: finishing write tid 3 to smithi13430248-13 2024-04-18T14:44:08.443 INFO:tasks.rados.rados.0.smithi134.stdout:264: finishing write tid 4 to smithi13430248-13 2024-04-18T14:44:08.443 INFO:tasks.rados.rados.0.smithi134.stdout:264: finishing write tid 5 to smithi13430248-13 2024-04-18T14:44:08.443 INFO:tasks.rados.rados.0.smithi134.stdout:264: oid 13 updating version 0 to 79 2024-04-18T14:44:08.443 INFO:tasks.rados.rados.0.smithi134.stdout:264: oid 13 updating version 79 to 81 2024-04-18T14:44:08.443 INFO:tasks.rados.rados.0.smithi134.stdout:264: oid 13 version 81 is already newer than 78 2024-04-18T14:44:08.443 INFO:tasks.rados.rados.0.smithi134.stdout:264: oid 13 version 81 is already newer than 80 2024-04-18T14:44:08.443 INFO:tasks.rados.rados.0.smithi134.stdout:update_object_version oid 13 v 81 (ObjNum 111 snap 23 seq_num 111) dirty exists 2024-04-18T14:44:08.443 INFO:tasks.rados.rados.0.smithi134.stdout:264: left oid 13 (ObjNum 111 snap 23 seq_num 111) 2024-04-18T14:44:08.443 INFO:tasks.rados.rados.0.smithi134.stdout:271: seq_num 114 ranges {0=753664,753664=688128,1441792=475136} 2024-04-18T14:44:08.449 INFO:tasks.rados.rados.0.smithi134.stdout:271: writing smithi13430248-4 from 0 to 753664 tid 1 2024-04-18T14:44:08.457 INFO:tasks.rados.rados.0.smithi134.stdout:271: writing smithi13430248-4 from 753664 to 1441792 tid 2 2024-04-18T14:44:08.462 INFO:tasks.rados.rados.0.smithi134.stdout:271: writing smithi13430248-4 from 1441792 to 1916928 tid 3 2024-04-18T14:44:08.463 INFO:tasks.rados.rados.0.smithi134.stdout:264: done (4 left) 2024-04-18T14:44:08.463 INFO:tasks.rados.rados.0.smithi134.stdout:append oid 10 current snap is 23 2024-04-18T14:44:08.463 INFO:tasks.rados.rados.0.smithi134.stdout:272: seq_num 115 ranges {0=770048,770048=704512,1474560=458752} 2024-04-18T14:44:08.470 INFO:tasks.rados.rados.0.smithi134.stdout:272: writing smithi13430248-10 from 0 to 770048 tid 1 2024-04-18T14:44:08.477 INFO:tasks.rados.rados.0.smithi134.stdout:272: writing smithi13430248-10 from 770048 to 1474560 tid 2 2024-04-18T14:44:08.482 INFO:tasks.rados.rados.0.smithi134.stdout:272: writing smithi13430248-10 from 1474560 to 1933312 tid 3 2024-04-18T14:44:08.482 INFO:tasks.rados.rados.0.smithi134.stdout:273: snap_create 2024-04-18T14:44:08.482 INFO:tasks.rados.rados.0.smithi134.stdout:266: expect (ObjNum 37 snap 0 seq_num 37) 2024-04-18T14:44:08.522 INFO:tasks.rados.rados.0.smithi134.stdout:269: finishing rollback tid 0 to smithi13430248-48 2024-04-18T14:44:08.522 INFO:tasks.rados.rados.0.smithi134.stdout:269: finishing rollback tid 1 to smithi13430248-48 2024-04-18T14:44:08.523 INFO:tasks.rados.rados.0.smithi134.stdout:269: finishing rollback tid 2 to smithi13430248-48 2024-04-18T14:44:08.523 INFO:tasks.rados.rados.0.smithi134.stdout:update_object_version oid 48 v 51 (ObjNum 47 snap 0 seq_num 47) dirty exists 2024-04-18T14:44:08.523 INFO:tasks.rados.rados.0.smithi134.stdout:270: finishing write tid 1 to smithi13430248-17 2024-04-18T14:44:08.523 INFO:tasks.rados.rados.0.smithi134.stdout:270: finishing write tid 2 to smithi13430248-17 2024-04-18T14:44:08.523 INFO:tasks.rados.rados.0.smithi134.stdout:270: finishing write tid 3 to smithi13430248-17 2024-04-18T14:44:08.523 INFO:tasks.rados.rados.0.smithi134.stdout:270: finishing write tid 4 to smithi13430248-17 2024-04-18T14:44:08.523 INFO:tasks.rados.rados.0.smithi134.stdout:270: finishing write tid 5 to smithi13430248-17 2024-04-18T14:44:08.523 INFO:tasks.rados.rados.0.smithi134.stdout:270: oid 17 updating version 0 to 126 2024-04-18T14:44:08.523 INFO:tasks.rados.rados.0.smithi134.stdout:270: oid 17 version 126 is already newer than 124 2024-04-18T14:44:08.523 INFO:tasks.rados.rados.0.smithi134.stdout:270: oid 17 updating version 126 to 127 2024-04-18T14:44:08.523 INFO:tasks.rados.rados.0.smithi134.stdout:270: oid 17 version 127 is already newer than 125 2024-04-18T14:44:08.524 INFO:tasks.rados.rados.0.smithi134.stdout:update_object_version oid 17 v 127 (ObjNum 113 snap 23 seq_num 113) dirty exists 2024-04-18T14:44:08.524 INFO:tasks.rados.rados.0.smithi134.stdout:270: left oid 17 (ObjNum 113 snap 23 seq_num 113) 2024-04-18T14:44:08.524 INFO:tasks.rados.rados.0.smithi134.stdout:271: finishing write tid 1 to smithi13430248-4 2024-04-18T14:44:08.524 INFO:tasks.rados.rados.0.smithi134.stdout:271: finishing write tid 2 to smithi13430248-4 2024-04-18T14:44:08.524 INFO:tasks.rados.rados.0.smithi134.stdout:271: finishing write tid 3 to smithi13430248-4 2024-04-18T14:44:08.524 INFO:tasks.rados.rados.0.smithi134.stdout:271: finishing write tid 4 to smithi13430248-4 2024-04-18T14:44:08.524 INFO:tasks.rados.rados.0.smithi134.stdout:271: finishing write tid 5 to smithi13430248-4 2024-04-18T14:44:08.524 INFO:tasks.rados.rados.0.smithi134.stdout:271: oid 4 updating version 0 to 96 2024-04-18T14:44:08.524 INFO:tasks.rados.rados.0.smithi134.stdout:271: oid 4 updating version 96 to 98 2024-04-18T14:44:08.524 INFO:tasks.rados.rados.0.smithi134.stdout:271: oid 4 version 98 is already newer than 97 2024-04-18T14:44:08.524 INFO:tasks.rados.rados.0.smithi134.stdout:271: oid 4 updating version 98 to 99 2024-04-18T14:44:08.524 INFO:tasks.rados.rados.0.smithi134.stdout:update_object_version oid 4 v 99 (ObjNum 114 snap 23 seq_num 114) dirty exists 2024-04-18T14:44:08.524 INFO:tasks.rados.rados.0.smithi134.stdout:271: left oid 4 (ObjNum 114 snap 23 seq_num 114) 2024-04-18T14:44:08.525 INFO:tasks.rados.rados.0.smithi134.stdout:272: finishing write tid 1 to smithi13430248-10 2024-04-18T14:44:08.525 INFO:tasks.rados.rados.0.smithi134.stdout:272: finishing write tid 2 to smithi13430248-10 2024-04-18T14:44:08.525 INFO:tasks.rados.rados.0.smithi134.stdout:272: finishing write tid 3 to smithi13430248-10 2024-04-18T14:44:08.525 INFO:tasks.rados.rados.0.smithi134.stdout:272: finishing write tid 4 to smithi13430248-10 2024-04-18T14:44:08.525 INFO:tasks.rados.rados.0.smithi134.stdout:272: finishing write tid 5 to smithi13430248-10 2024-04-18T14:44:08.525 INFO:tasks.rados.rados.0.smithi134.stdout:272: oid 10 updating version 0 to 117 2024-04-18T14:44:08.525 INFO:tasks.rados.rados.0.smithi134.stdout:272: oid 10 version 117 is already newer than 115 2024-04-18T14:44:08.525 INFO:tasks.rados.rados.0.smithi134.stdout:272: oid 10 version 117 is already newer than 116 2024-04-18T14:44:08.525 INFO:tasks.rados.rados.0.smithi134.stdout:272: oid 10 updating version 117 to 118 2024-04-18T14:44:08.525 INFO:tasks.rados.rados.0.smithi134.stdout:update_object_version oid 10 v 118 (ObjNum 115 snap 23 seq_num 115) dirty exists 2024-04-18T14:44:08.525 INFO:tasks.rados.rados.0.smithi134.stdout:272: left oid 10 (ObjNum 115 snap 23 seq_num 115) 2024-04-18T14:44:08.538 INFO:tasks.ceph.osd.8.smithi086.stderr:2024-04-18T14:44:08.534+0000 7f29f7b9d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 8 (PID: 24958) UID: 0 2024-04-18T14:44:08.603 INFO:teuthology.orchestra.run.smithi096.stdout:ERROR: (22) Invalid argument 2024-04-18T14:44:08.603 INFO:teuthology.orchestra.run.smithi096.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T14:44:08.617 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.13.asok dump_ops_in_flight 2024-04-18T14:44:08.639 INFO:tasks.ceph.osd.10.smithi119.stderr:2024-04-18T14:44:08.638+0000 7f6f24c12640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 10 (PID: 24898) UID: 0 2024-04-18T14:44:08.736 INFO:teuthology.orchestra.run.smithi096.stdout:ERROR: (22) Invalid argument 2024-04-18T14:44:08.736 INFO:teuthology.orchestra.run.smithi096.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T14:44:08.739 INFO:tasks.ceph.osd.8.smithi086.stderr:2024-04-18T14:44:08.738+0000 7f29f7b9d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 8 (PID: 24958) UID: 0 2024-04-18T14:44:08.750 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.13.asok dump_blocked_ops 2024-04-18T14:44:08.840 INFO:tasks.ceph.osd.8.smithi086.stderr:2024-04-18T14:44:08.842+0000 7f29f7b9d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 8 (PID: 24958) UID: 0 2024-04-18T14:44:08.871 INFO:teuthology.orchestra.run.smithi096.stdout:ERROR: (22) Invalid argument 2024-04-18T14:44:08.872 INFO:teuthology.orchestra.run.smithi096.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T14:44:08.885 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.13.asok dump_historic_ops 2024-04-18T14:44:08.941 INFO:tasks.ceph.osd.7.smithi134.stderr:2024-04-18T14:44:08.944+0000 7fd7de549640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25213) UID: 0 2024-04-18T14:44:09.006 INFO:teuthology.orchestra.run.smithi096.stdout:ERROR: (22) Invalid argument 2024-04-18T14:44:09.006 INFO:teuthology.orchestra.run.smithi096.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T14:44:09.020 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-18T14:44:09.041 INFO:tasks.ceph.osd.5.smithi096.stderr:2024-04-18T14:44:09.037+0000 7fc33f25b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 24889) UID: 0 2024-04-18T14:44:09.142 INFO:tasks.ceph.osd.5.smithi096.stderr:2024-04-18T14:44:09.141+0000 7fc33f25b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 24889) UID: 0 2024-04-18T14:44:09.151 INFO:teuthology.orchestra.run.smithi119.stdout:ERROR: (22) Invalid argument 2024-04-18T14:44:09.151 INFO:teuthology.orchestra.run.smithi119.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T14:44:09.165 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-18T14:44:09.243 INFO:tasks.ceph.osd.4.smithi086.stderr:2024-04-18T14:44:09.242+0000 7f0c4c462640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 24956) UID: 0 2024-04-18T14:44:09.280 INFO:teuthology.orchestra.run.smithi119.stdout:ERROR: (22) Invalid argument 2024-04-18T14:44:09.280 INFO:teuthology.orchestra.run.smithi119.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T14:44:09.294 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-18T14:44:09.344 INFO:tasks.ceph.osd.11.smithi134.stderr:2024-04-18T14:44:09.348+0000 7f2d36f12640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 11 (PID: 25216) UID: 0 2024-04-18T14:44:09.378 INFO:teuthology.orchestra.run.smithi086.stderr:marked in osd.1. 2024-04-18T14:44:09.378 INFO:teuthology.orchestra.run.smithi086.stderr:noscrub is unset 2024-04-18T14:44:09.379 INFO:tasks.rados.rados.0.smithi134.stdout:266: done (5 left) 2024-04-18T14:44:09.379 INFO:tasks.rados.rados.0.smithi134.stdout:269: done (4 left) 2024-04-18T14:44:09.380 INFO:tasks.rados.rados.0.smithi134.stdout:270: done (3 left) 2024-04-18T14:44:09.380 INFO:tasks.rados.rados.0.smithi134.stdout:271: done (2 left) 2024-04-18T14:44:09.380 INFO:tasks.rados.rados.0.smithi134.stdout:272: done (1 left) 2024-04-18T14:44:09.380 INFO:tasks.rados.rados.0.smithi134.stdout:273: done (0 left) 2024-04-18T14:44:09.380 INFO:tasks.rados.rados.0.smithi134.stdout:274: read oid 5 snap -1 2024-04-18T14:44:09.380 INFO:tasks.rados.rados.0.smithi134.stdout:274: expect (ObjNum 74 snap 15 seq_num 74) 2024-04-18T14:44:09.380 INFO:tasks.rados.rados.0.smithi134.stdout:append oid 31 current snap is 24 2024-04-18T14:44:09.380 INFO:tasks.rados.rados.0.smithi134.stdout:275: seq_num 116 ranges {0=786432,786432=458752,1245184=442368,1687552=262144} 2024-04-18T14:44:09.388 INFO:tasks.rados.rados.0.smithi134.stdout:275: writing smithi13430248-31 from 0 to 786432 tid 1 2024-04-18T14:44:09.393 INFO:tasks.rados.rados.0.smithi134.stdout:275: writing smithi13430248-31 from 786432 to 1245184 tid 2 2024-04-18T14:44:09.397 INFO:tasks.rados.rados.0.smithi134.stdout:275: writing smithi13430248-31 from 1245184 to 1687552 tid 3 2024-04-18T14:44:09.399 INFO:tasks.rados.rados.0.smithi134.stdout:275: writing smithi13430248-31 from 1687552 to 1949696 tid 4 2024-04-18T14:44:09.399 INFO:tasks.rados.rados.0.smithi134.stdout:276: delete oid 4 current snap is 24 2024-04-18T14:44:09.407 INFO:tasks.rados.rados.0.smithi134.stdout:274: expect (ObjNum 74 snap 15 seq_num 74) 2024-04-18T14:44:09.412 INFO:tasks.thrashosds.thrasher:Added osd 1 2024-04-18T14:44:09.425 INFO:teuthology.orchestra.run.smithi119.stdout:ERROR: (22) Invalid argument 2024-04-18T14:44:09.425 INFO:teuthology.orchestra.run.smithi119.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T14:44:09.439 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-04-18T14:44:09.463 INFO:tasks.ceph.osd.12.smithi086.stderr:2024-04-18T14:44:09.462+0000 7f6904968640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 12 (PID: 24960) UID: 0 2024-04-18T14:44:09.491 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-18T14:44:09.545 INFO:tasks.ceph.osd.10.smithi119.stderr:2024-04-18T14:44:09.546+0000 7f6f24c12640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 10 (PID: 24898) UID: 0 2024-04-18T14:44:09.559 INFO:teuthology.orchestra.run.smithi119.stdout:ERROR: (22) Invalid argument 2024-04-18T14:44:09.559 INFO:teuthology.orchestra.run.smithi119.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T14:44:09.573 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-04-18T14:44:09.647 INFO:teuthology.orchestra.run.smithi086.stdout:osd.0: {} 2024-04-18T14:44:09.647 INFO:teuthology.orchestra.run.smithi086.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-18T14:44:09.647 INFO:tasks.ceph.osd.3.smithi134.stderr:2024-04-18T14:44:09.652+0000 7fe7a4443640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25211) UID: 0 2024-04-18T14:44:09.666 INFO:teuthology.orchestra.run.smithi086.stdout:osd.1: {} 2024-04-18T14:44:09.667 INFO:teuthology.orchestra.run.smithi086.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-18T14:44:09.684 INFO:teuthology.orchestra.run.smithi086.stdout:osd.2: {} 2024-04-18T14:44:09.684 INFO:teuthology.orchestra.run.smithi086.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-18T14:44:09.704 INFO:teuthology.orchestra.run.smithi086.stdout:osd.3: {} 2024-04-18T14:44:09.704 INFO:teuthology.orchestra.run.smithi086.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-18T14:44:09.722 INFO:teuthology.orchestra.run.smithi086.stdout:osd.4: {} 2024-04-18T14:44:09.722 INFO:teuthology.orchestra.run.smithi086.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-18T14:44:09.735 INFO:teuthology.orchestra.run.smithi119.stdout:ERROR: (22) Invalid argument 2024-04-18T14:44:09.736 INFO:teuthology.orchestra.run.smithi119.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T14:44:09.742 INFO:teuthology.orchestra.run.smithi086.stdout:osd.5: {} 2024-04-18T14:44:09.742 INFO:teuthology.orchestra.run.smithi086.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-18T14:44:09.748 INFO:tasks.ceph.osd.14.smithi119.stderr:2024-04-18T14:44:09.750+0000 7f180f599640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 14 (PID: 24900) UID: 0 2024-04-18T14:44:09.749 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-04-18T14:44:09.762 INFO:teuthology.orchestra.run.smithi086.stdout:osd.6: {} 2024-04-18T14:44:09.762 INFO:teuthology.orchestra.run.smithi086.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-18T14:44:09.782 INFO:teuthology.orchestra.run.smithi086.stdout:osd.7: {} 2024-04-18T14:44:09.782 INFO:teuthology.orchestra.run.smithi086.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-18T14:44:09.799 INFO:teuthology.orchestra.run.smithi086.stdout:osd.8: {} 2024-04-18T14:44:09.799 INFO:teuthology.orchestra.run.smithi086.stderr:osd.8: osd_enable_op_tracker = '' 2024-04-18T14:44:09.820 INFO:teuthology.orchestra.run.smithi086.stdout:osd.9: {} 2024-04-18T14:44:09.820 INFO:teuthology.orchestra.run.smithi086.stderr:osd.9: osd_enable_op_tracker = '' 2024-04-18T14:44:09.838 INFO:teuthology.orchestra.run.smithi086.stdout:osd.10: {} 2024-04-18T14:44:09.839 INFO:teuthology.orchestra.run.smithi086.stderr:osd.10: osd_enable_op_tracker = '' 2024-04-18T14:44:09.849 INFO:tasks.ceph.osd.2.smithi119.stderr:2024-04-18T14:44:09.850+0000 7fcbd30c0640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 24894) UID: 0 2024-04-18T14:44:09.858 INFO:teuthology.orchestra.run.smithi086.stdout:osd.11: {} 2024-04-18T14:44:09.859 INFO:teuthology.orchestra.run.smithi086.stderr:osd.11: osd_enable_op_tracker = '' 2024-04-18T14:44:09.878 INFO:teuthology.orchestra.run.smithi086.stdout:osd.12: {} 2024-04-18T14:44:09.878 INFO:teuthology.orchestra.run.smithi086.stderr:osd.12: osd_enable_op_tracker = '' 2024-04-18T14:44:09.897 INFO:teuthology.orchestra.run.smithi086.stdout:osd.13: {} 2024-04-18T14:44:09.898 INFO:teuthology.orchestra.run.smithi086.stderr:osd.13: osd_enable_op_tracker = '' 2024-04-18T14:44:09.915 INFO:teuthology.orchestra.run.smithi086.stdout:osd.14: {} 2024-04-18T14:44:09.916 INFO:teuthology.orchestra.run.smithi086.stderr:osd.14: osd_enable_op_tracker = '' 2024-04-18T14:44:09.917 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-18T14:44:09.914+0000 7f5d6d703640 0 -- 172.21.15.86:0/3581793805 >> [v2:172.21.15.134:6808/25223,v1:172.21.15.134:6812/25223] conn(0x7f5d682219c0 msgr2=0x7f5d68223db0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-04-18T14:44:09.918 INFO:teuthology.orchestra.run.smithi119.stdout:{ 2024-04-18T14:44:09.918 INFO:teuthology.orchestra.run.smithi119.stdout: "size": 20, 2024-04-18T14:44:09.918 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 600, 2024-04-18T14:44:09.918 INFO:teuthology.orchestra.run.smithi119.stdout: "ops": [ 2024-04-18T14:44:09.919 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:09.919 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(client.4559.0:186 3.1s0 3:8de3c091:::smithi13430248-9:head [append 0~540672] snapc 4=[4,2] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-18T14:44:09.919 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-04-18T14:43:36.754855+0000", 2024-04-18T14:44:09.919 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 33.165561115999999, 2024-04-18T14:44:09.919 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.011816834, 2024-04-18T14:44:09.919 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-04-18T14:44:09.919 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T14:44:09.919 INFO:teuthology.orchestra.run.smithi119.stdout: "client_info": { 2024-04-18T14:44:09.919 INFO:teuthology.orchestra.run.smithi119.stdout: "client": "client.4559", 2024-04-18T14:44:09.919 INFO:teuthology.orchestra.run.smithi119.stdout: "client_addr": "172.21.15.134:0/3113589487", 2024-04-18T14:44:09.919 INFO:teuthology.orchestra.run.smithi119.stdout: "tid": 186 2024-04-18T14:44:09.919 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:09.919 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-04-18T14:44:09.919 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:09.919 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-04-18T14:44:09.920 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:36.754855+0000", 2024-04-18T14:44:09.920 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:44:09.920 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:09.920 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:09.920 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-04-18T14:44:09.920 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:36.754855+0000", 2024-04-18T14:44:09.920 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:44:09.920 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:09.920 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:09.920 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-04-18T14:44:09.920 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:36.754850+0000", 2024-04-18T14:44:09.920 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4294967295.9999952 2024-04-18T14:44:09.920 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:09.920 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:09.920 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-04-18T14:44:09.920 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:36.756415+0000", 2024-04-18T14:44:09.921 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0015650550000000001 2024-04-18T14:44:09.921 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:09.921 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:09.921 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-04-18T14:44:09.921 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:36.756448+0000", 2024-04-18T14:44:09.921 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.2657000000000003e-05 2024-04-18T14:44:09.921 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:09.921 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:09.921 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-04-18T14:44:09.921 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:36.756464+0000", 2024-04-18T14:44:09.921 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.6044000000000001e-05 2024-04-18T14:44:09.921 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:09.921 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:09.921 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-04-18T14:44:09.921 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:36.756562+0000", 2024-04-18T14:44:09.921 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 9.8208999999999994e-05 2024-04-18T14:44:09.922 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:09.922 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:09.922 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-04-18T14:44:09.922 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:36.756733+0000", 2024-04-18T14:44:09.922 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00017070799999999999 2024-04-18T14:44:09.922 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:09.922 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:09.923 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_started", 2024-04-18T14:44:09.923 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:36.758906+0000", 2024-04-18T14:44:09.923 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0021729869999999999 2024-04-18T14:44:09.923 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:09.923 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:09.923 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_committed", 2024-04-18T14:44:09.923 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:36.766167+0000", 2024-04-18T14:44:09.923 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0072611739999999996 2024-04-18T14:44:09.923 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:09.923 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:09.924 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-04-18T14:44:09.924 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:36.766546+0000", 2024-04-18T14:44:09.924 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00037840699999999998 2024-04-18T14:44:09.924 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:09.924 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:09.924 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-04-18T14:44:09.924 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:36.766672+0000", 2024-04-18T14:44:09.924 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00012634300000000001 2024-04-18T14:44:09.924 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:44:09.924 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-04-18T14:44:09.924 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:44:09.924 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:09.924 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:09.924 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(client.4559.0:187 3.1s0 3:8de3c091:::smithi13430248-9:head [append 0~376832] snapc 4=[4,2] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-18T14:44:09.925 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-04-18T14:43:36.761169+0000", 2024-04-18T14:44:09.925 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 33.159246746000001, 2024-04-18T14:44:09.925 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.013441859, 2024-04-18T14:44:09.925 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-04-18T14:44:09.925 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T14:44:09.925 INFO:teuthology.orchestra.run.smithi119.stdout: "client_info": { 2024-04-18T14:44:09.925 INFO:teuthology.orchestra.run.smithi119.stdout: "client": "client.4559", 2024-04-18T14:44:09.925 INFO:teuthology.orchestra.run.smithi119.stdout: "client_addr": "172.21.15.134:0/3113589487", 2024-04-18T14:44:09.925 INFO:teuthology.orchestra.run.smithi119.stdout: "tid": 187 2024-04-18T14:44:09.925 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:09.926 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-04-18T14:44:09.926 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:09.926 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-04-18T14:44:09.926 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:36.761169+0000", 2024-04-18T14:44:09.926 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:44:09.926 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:09.926 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:09.926 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-04-18T14:44:09.926 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:36.761169+0000", 2024-04-18T14:44:09.926 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:44:09.926 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:09.926 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:09.926 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-04-18T14:44:09.927 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:36.761167+0000", 2024-04-18T14:44:09.927 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4294967295.9999976 2024-04-18T14:44:09.927 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:09.927 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:09.927 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-04-18T14:44:09.927 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:36.761787+0000", 2024-04-18T14:44:09.927 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00062004300000000003 2024-04-18T14:44:09.927 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:09.927 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:09.927 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-04-18T14:44:09.927 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:36.761816+0000", 2024-04-18T14:44:09.927 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.8527e-05 2024-04-18T14:44:09.927 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:09.927 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:09.927 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-04-18T14:44:09.928 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:36.761831+0000", 2024-04-18T14:44:09.928 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.5654e-05 2024-04-18T14:44:09.928 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:09.928 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:09.928 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-04-18T14:44:09.928 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:36.762166+0000", 2024-04-18T14:44:09.928 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00033494200000000002 2024-04-18T14:44:09.928 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:09.928 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:09.928 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-04-18T14:44:09.928 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:36.762326+0000", 2024-04-18T14:44:09.928 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00015945799999999999 2024-04-18T14:44:09.929 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:09.929 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:09.929 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_started", 2024-04-18T14:44:09.929 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:36.763464+0000", 2024-04-18T14:44:09.929 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00113849 2024-04-18T14:44:09.929 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:09.929 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:09.929 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_committed", 2024-04-18T14:44:09.929 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:36.766311+0000", 2024-04-18T14:44:09.929 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0028469379999999998 2024-04-18T14:44:09.929 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:09.929 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:09.929 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-04-18T14:44:09.929 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:36.774508+0000", 2024-04-18T14:44:09.929 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0081971209999999999 2024-04-18T14:44:09.930 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:09.930 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:09.930 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-04-18T14:44:09.930 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:36.774611+0000", 2024-04-18T14:44:09.930 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000103063 2024-04-18T14:44:09.930 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:44:09.930 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-04-18T14:44:09.930 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:44:09.930 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:09.930 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:09.930 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(client.4559.0:188 3.1s0 3:8de3c091:::smithi13430248-9:head [setxattr _header (55) in=7b] snapc 4=[4,2] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-18T14:44:09.930 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-04-18T14:43:36.761844+0000", 2024-04-18T14:44:09.930 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 33.158571881999997, 2024-04-18T14:44:09.930 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.013080046999999999, 2024-04-18T14:44:09.931 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-04-18T14:44:09.931 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T14:44:09.931 INFO:teuthology.orchestra.run.smithi119.stdout: "client_info": { 2024-04-18T14:44:09.931 INFO:teuthology.orchestra.run.smithi119.stdout: "client": "client.4559", 2024-04-18T14:44:09.931 INFO:teuthology.orchestra.run.smithi119.stdout: "client_addr": "172.21.15.134:0/3113589487", 2024-04-18T14:44:09.931 INFO:teuthology.orchestra.run.smithi119.stdout: "tid": 188 2024-04-18T14:44:09.931 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:09.931 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-04-18T14:44:09.931 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:09.931 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-04-18T14:44:09.931 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:36.761844+0000", 2024-04-18T14:44:09.931 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:44:09.931 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:09.931 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:09.931 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-04-18T14:44:09.931 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:36.761844+0000", 2024-04-18T14:44:09.932 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:44:09.932 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:09.932 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:09.932 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-04-18T14:44:09.932 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:36.761843+0000", 2024-04-18T14:44:09.932 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4294967295.999999 2024-04-18T14:44:09.932 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:09.932 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:09.932 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-04-18T14:44:09.932 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:36.761850+0000", 2024-04-18T14:44:09.932 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 6.7900000000000002e-06 2024-04-18T14:44:09.932 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:09.932 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:09.932 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-04-18T14:44:09.932 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:36.761863+0000", 2024-04-18T14:44:09.932 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.2554e-05 2024-04-18T14:44:09.933 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:09.933 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:09.933 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-04-18T14:44:09.933 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:36.761873+0000", 2024-04-18T14:44:09.933 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.0854e-05 2024-04-18T14:44:09.933 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:09.933 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:09.933 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-04-18T14:44:09.933 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:36.764403+0000", 2024-04-18T14:44:09.933 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0025291459999999999 2024-04-18T14:44:09.933 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:09.933 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:09.933 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-04-18T14:44:09.934 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:36.764592+0000", 2024-04-18T14:44:09.934 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00018972800000000001 2024-04-18T14:44:09.934 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:09.934 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:09.934 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_started", 2024-04-18T14:44:09.934 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:36.765646+0000", 2024-04-18T14:44:09.934 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.001053944 2024-04-18T14:44:09.934 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:09.934 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:09.934 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_committed", 2024-04-18T14:44:09.934 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:36.767122+0000", 2024-04-18T14:44:09.934 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0014754150000000001 2024-04-18T14:44:09.934 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:09.934 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:09.935 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-04-18T14:44:09.935 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:36.774806+0000", 2024-04-18T14:44:09.935 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0076844890000000001 2024-04-18T14:44:09.935 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:09.935 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:09.935 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-04-18T14:44:09.935 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:36.774924+0000", 2024-04-18T14:44:09.935 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00011815 2024-04-18T14:44:09.935 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:44:09.935 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-04-18T14:44:09.935 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:44:09.935 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:09.937 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:09.937 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(client.4559.0:189 3.1s0 3:8de3c091:::smithi13430248-9:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e37)", 2024-04-18T14:44:09.937 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-04-18T14:43:36.761939+0000", 2024-04-18T14:44:09.937 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 33.158476995999997, 2024-04-18T14:44:09.937 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.018164527, 2024-04-18T14:44:09.937 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-04-18T14:44:09.937 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "started", 2024-04-18T14:44:09.937 INFO:teuthology.orchestra.run.smithi119.stdout: "client_info": { 2024-04-18T14:44:09.937 INFO:teuthology.orchestra.run.smithi119.stdout: "client": "client.4559", 2024-04-18T14:44:09.937 INFO:teuthology.orchestra.run.smithi119.stdout: "client_addr": "172.21.15.134:0/3113589487", 2024-04-18T14:44:09.937 INFO:teuthology.orchestra.run.smithi119.stdout: "tid": 189 2024-04-18T14:44:09.938 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:09.938 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-04-18T14:44:09.938 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:09.938 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-04-18T14:44:09.938 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:36.761939+0000", 2024-04-18T14:44:09.938 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:44:09.938 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:09.938 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:09.938 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-04-18T14:44:09.938 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:36.761939+0000", 2024-04-18T14:44:09.938 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:44:09.938 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:09.938 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:09.938 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-04-18T14:44:09.938 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:36.761938+0000", 2024-04-18T14:44:09.939 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4294967295.9999986 2024-04-18T14:44:09.939 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:09.939 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:09.939 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-04-18T14:44:09.939 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:36.761947+0000", 2024-04-18T14:44:09.939 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 9.2399999999999996e-06 2024-04-18T14:44:09.939 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:09.939 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:09.939 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-04-18T14:44:09.939 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:36.761967+0000", 2024-04-18T14:44:09.939 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.9956999999999999e-05 2024-04-18T14:44:09.939 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:09.939 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:09.939 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-04-18T14:44:09.939 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:36.761988+0000", 2024-04-18T14:44:09.940 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.1115e-05 2024-04-18T14:44:09.940 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:09.940 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:09.940 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-04-18T14:44:09.940 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:36.767166+0000", 2024-04-18T14:44:09.940 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0051778420000000002 2024-04-18T14:44:09.940 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:09.940 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:09.940 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for rw locks", 2024-04-18T14:44:09.940 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:36.767335+0000", 2024-04-18T14:44:09.940 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00016923099999999999 2024-04-18T14:44:09.940 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:09.940 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:09.940 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-04-18T14:44:09.941 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:36.775552+0000", 2024-04-18T14:44:09.941 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0082173460000000004 2024-04-18T14:44:09.941 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:09.941 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:09.941 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-04-18T14:44:09.941 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:36.775682+0000", 2024-04-18T14:44:09.941 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000129803 2024-04-18T14:44:09.941 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:09.941 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:09.941 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-04-18T14:44:09.941 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:36.780104+0000", 2024-04-18T14:44:09.941 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0044214129999999999 2024-04-18T14:44:09.941 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:44:09.941 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-04-18T14:44:09.941 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:44:09.942 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:09.942 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:09.942 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "MOSDECSubOpWrite(3.cs6 41/30 ECSubWrite(tid=46, reqid=osd.11.0:46, at_version=41'24, trim_to=0'0, roll_forward_to=39'20))", 2024-04-18T14:44:09.942 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-04-18T14:43:40.766310+0000", 2024-04-18T14:44:09.942 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 29.154106072000001, 2024-04-18T14:44:09.942 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0085406670000000001, 2024-04-18T14:44:09.942 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-04-18T14:44:09.942 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "reached pg", 2024-04-18T14:44:09.942 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-04-18T14:44:09.942 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:09.942 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-04-18T14:44:09.942 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:40.766310+0000", 2024-04-18T14:44:09.942 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:44:09.942 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:09.943 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:09.943 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-04-18T14:44:09.943 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:40.766310+0000", 2024-04-18T14:44:09.943 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:44:09.943 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:09.943 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:09.943 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-04-18T14:44:09.943 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:40.766309+0000", 2024-04-18T14:44:09.943 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4294967295.999999 2024-04-18T14:44:09.943 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:09.943 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:09.943 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-04-18T14:44:09.943 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:40.766357+0000", 2024-04-18T14:44:09.943 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4.7984e-05 2024-04-18T14:44:09.943 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:09.944 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:09.944 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-04-18T14:44:09.944 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:40.766384+0000", 2024-04-18T14:44:09.944 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.6656999999999999e-05 2024-04-18T14:44:09.944 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:09.944 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:09.944 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-04-18T14:44:09.944 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:40.766403+0000", 2024-04-18T14:44:09.944 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.8947999999999999e-05 2024-04-18T14:44:09.944 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:09.944 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:09.944 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-04-18T14:44:09.944 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:40.768792+0000", 2024-04-18T14:44:09.944 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0023896299999999998 2024-04-18T14:44:09.944 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:09.944 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:09.945 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_started", 2024-04-18T14:44:09.945 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:40.768817+0000", 2024-04-18T14:44:09.945 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.4263000000000001e-05 2024-04-18T14:44:09.945 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:09.945 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:09.945 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_committed", 2024-04-18T14:44:09.945 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:40.774817+0000", 2024-04-18T14:44:09.945 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0060000440000000004 2024-04-18T14:44:09.945 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:09.945 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:09.945 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-04-18T14:44:09.945 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:40.774851+0000", 2024-04-18T14:44:09.945 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.4037e-05 2024-04-18T14:44:09.945 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:44:09.945 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-04-18T14:44:09.945 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:44:09.946 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:09.946 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:09.946 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(client.4559.0:285 3.1s0 3:891e68bf:::smithi13430248-19:2 [read 0~311296,checksum,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-04-18T14:44:09.946 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-04-18T14:43:44.372864+0000", 2024-04-18T14:44:09.946 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 25.547551812999998, 2024-04-18T14:44:09.946 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.010186044, 2024-04-18T14:44:09.946 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-04-18T14:44:09.946 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "started", 2024-04-18T14:44:09.946 INFO:teuthology.orchestra.run.smithi119.stdout: "client_info": { 2024-04-18T14:44:09.946 INFO:teuthology.orchestra.run.smithi119.stdout: "client": "client.4559", 2024-04-18T14:44:09.946 INFO:teuthology.orchestra.run.smithi119.stdout: "client_addr": "172.21.15.134:0/3113589487", 2024-04-18T14:44:09.946 INFO:teuthology.orchestra.run.smithi119.stdout: "tid": 285 2024-04-18T14:44:09.946 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:09.947 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-04-18T14:44:09.947 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:09.947 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-04-18T14:44:09.947 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:44.372864+0000", 2024-04-18T14:44:09.947 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:44:09.947 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:09.947 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:09.947 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-04-18T14:44:09.947 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:44.372864+0000", 2024-04-18T14:44:09.947 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:44:09.947 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:09.947 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:09.947 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-04-18T14:44:09.947 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:44.372862+0000", 2024-04-18T14:44:09.948 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4294967295.9999971 2024-04-18T14:44:09.948 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:09.948 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:09.948 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-04-18T14:44:09.948 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:44.372880+0000", 2024-04-18T14:44:09.948 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.8688000000000001e-05 2024-04-18T14:44:09.948 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:09.948 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:09.948 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-04-18T14:44:09.948 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:44.372914+0000", 2024-04-18T14:44:09.948 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.3837000000000001e-05 2024-04-18T14:44:09.948 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:09.948 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:09.948 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-04-18T14:44:09.949 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:44.372950+0000", 2024-04-18T14:44:09.949 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.5604e-05 2024-04-18T14:44:09.949 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:09.949 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:09.949 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-04-18T14:44:09.949 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:44.373068+0000", 2024-04-18T14:44:09.949 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000118385 2024-04-18T14:44:09.949 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:09.949 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:09.949 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "op must wait for map", 2024-04-18T14:44:09.949 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:44.373082+0000", 2024-04-18T14:44:09.949 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.4087000000000001e-05 2024-04-18T14:44:09.950 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:09.950 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:09.950 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-04-18T14:44:09.950 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:44.377259+0000", 2024-04-18T14:44:09.950 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0041765300000000003 2024-04-18T14:44:09.950 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:09.950 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:09.950 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-04-18T14:44:09.950 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:44.377542+0000", 2024-04-18T14:44:09.950 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00028300500000000002 2024-04-18T14:44:09.950 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:09.950 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:09.950 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-04-18T14:44:09.950 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:44.383050+0000", 2024-04-18T14:44:09.950 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0055085749999999999 2024-04-18T14:44:09.951 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:44:09.951 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-04-18T14:44:09.951 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:44:09.951 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:09.951 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:09.951 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(client.4559.0:286 3.1s0 3:891e68bf:::smithi13430248-19:2 [read 0~311296,checksum] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-04-18T14:44:09.951 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-04-18T14:43:44.372973+0000", 2024-04-18T14:44:09.951 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 25.547442904, 2024-04-18T14:44:09.951 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.011021772000000001, 2024-04-18T14:44:09.951 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-04-18T14:44:09.951 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "started", 2024-04-18T14:44:09.951 INFO:teuthology.orchestra.run.smithi119.stdout: "client_info": { 2024-04-18T14:44:09.951 INFO:teuthology.orchestra.run.smithi119.stdout: "client": "client.4559", 2024-04-18T14:44:09.952 INFO:teuthology.orchestra.run.smithi119.stdout: "client_addr": "172.21.15.134:0/3113589487", 2024-04-18T14:44:09.952 INFO:teuthology.orchestra.run.smithi119.stdout: "tid": 286 2024-04-18T14:44:09.952 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:09.952 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-04-18T14:44:09.952 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:09.952 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-04-18T14:44:09.952 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:44.372973+0000", 2024-04-18T14:44:09.952 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:44:09.952 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:09.952 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:09.952 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-04-18T14:44:09.952 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:44.372973+0000", 2024-04-18T14:44:09.952 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:44:09.952 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:09.952 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:09.953 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-04-18T14:44:09.953 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:44.372972+0000", 2024-04-18T14:44:09.953 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4294967295.999999 2024-04-18T14:44:09.953 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:09.953 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:09.953 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-04-18T14:44:09.953 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:44.372979+0000", 2024-04-18T14:44:09.953 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 7.0509999999999999e-06 2024-04-18T14:44:09.953 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:09.953 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:09.953 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-04-18T14:44:09.953 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:44.373015+0000", 2024-04-18T14:44:09.953 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.5583999999999997e-05 2024-04-18T14:44:09.953 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:09.954 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:09.954 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-04-18T14:44:09.954 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:44.373026+0000", 2024-04-18T14:44:09.954 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.1586000000000001e-05 2024-04-18T14:44:09.954 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:09.954 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:09.954 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-04-18T14:44:09.954 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:44.373222+0000", 2024-04-18T14:44:09.954 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000195391 2024-04-18T14:44:09.954 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:09.954 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:09.954 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting_for_map not empty", 2024-04-18T14:44:09.954 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:44.373233+0000", 2024-04-18T14:44:09.954 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.1586999999999999e-05 2024-04-18T14:44:09.954 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:09.955 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:09.955 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-04-18T14:44:09.955 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:44.379041+0000", 2024-04-18T14:44:09.955 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0058081030000000002 2024-04-18T14:44:09.955 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:09.955 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:09.955 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-04-18T14:44:09.955 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:44.379196+0000", 2024-04-18T14:44:09.955 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00015440199999999999 2024-04-18T14:44:09.955 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:09.955 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:09.955 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-04-18T14:44:09.955 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:44.383995+0000", 2024-04-18T14:44:09.955 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0047992419999999996 2024-04-18T14:44:09.956 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:44:09.956 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-04-18T14:44:09.956 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:44:09.956 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:09.956 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:09.956 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(client.4559.0:287 3.1s0 3:891e68bf:::smithi13430248-19:2 [read 0~311296,checksum] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-04-18T14:44:09.956 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-04-18T14:43:44.373037+0000", 2024-04-18T14:44:09.956 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 25.547378813000002, 2024-04-18T14:44:09.956 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.015018301, 2024-04-18T14:44:09.956 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-04-18T14:44:09.956 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "started", 2024-04-18T14:44:09.956 INFO:teuthology.orchestra.run.smithi119.stdout: "client_info": { 2024-04-18T14:44:09.956 INFO:teuthology.orchestra.run.smithi119.stdout: "client": "client.4559", 2024-04-18T14:44:09.956 INFO:teuthology.orchestra.run.smithi119.stdout: "client_addr": "172.21.15.134:0/3113589487", 2024-04-18T14:44:09.956 INFO:teuthology.orchestra.run.smithi119.stdout: "tid": 287 2024-04-18T14:44:09.957 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:09.957 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-04-18T14:44:09.957 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:09.957 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-04-18T14:44:09.957 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:44.373037+0000", 2024-04-18T14:44:09.957 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:44:09.957 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:09.957 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:09.957 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-04-18T14:44:09.957 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:44.373037+0000", 2024-04-18T14:44:09.957 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:44:09.957 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:09.957 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:09.957 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-04-18T14:44:09.958 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:44.373036+0000", 2024-04-18T14:44:09.958 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4294967295.999999 2024-04-18T14:44:09.958 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:09.958 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:09.958 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-04-18T14:44:09.958 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:44.373042+0000", 2024-04-18T14:44:09.958 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 5.8370000000000002e-06 2024-04-18T14:44:09.958 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:09.958 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:09.958 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-04-18T14:44:09.958 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:44.373052+0000", 2024-04-18T14:44:09.958 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 9.9869999999999994e-06 2024-04-18T14:44:09.958 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:09.958 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:09.958 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-04-18T14:44:09.959 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:44.373060+0000", 2024-04-18T14:44:09.959 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 7.34e-06 2024-04-18T14:44:09.959 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:09.959 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:09.959 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-04-18T14:44:09.959 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:44.373308+0000", 2024-04-18T14:44:09.959 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00024842100000000003 2024-04-18T14:44:09.959 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:09.959 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:09.959 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting_for_map not empty", 2024-04-18T14:44:09.959 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:44.373327+0000", 2024-04-18T14:44:09.959 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.9417000000000001e-05 2024-04-18T14:44:09.959 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:09.959 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:09.959 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-04-18T14:44:09.960 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:44.384088+0000", 2024-04-18T14:44:09.960 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.010760357 2024-04-18T14:44:09.960 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:09.960 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:09.960 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-04-18T14:44:09.960 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:44.384388+0000", 2024-04-18T14:44:09.960 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00029992499999999999 2024-04-18T14:44:09.960 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:09.960 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:09.960 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-04-18T14:44:09.960 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:44.388056+0000", 2024-04-18T14:44:09.960 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0036678499999999998 2024-04-18T14:44:09.960 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:44:09.960 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-04-18T14:44:09.960 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:44:09.960 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:09.961 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:09.961 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(client.4559.0:319 3.1s0 3:86043532:::smithi13430248-49:head [rollback 2] snapc d=[d,b,a,8,7,2] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-18T14:44:09.961 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-04-18T14:43:44.563613+0000", 2024-04-18T14:44:09.961 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 25.356803251999999, 2024-04-18T14:44:09.961 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.010064484, 2024-04-18T14:44:09.961 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-04-18T14:44:09.961 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T14:44:09.961 INFO:teuthology.orchestra.run.smithi119.stdout: "client_info": { 2024-04-18T14:44:09.961 INFO:teuthology.orchestra.run.smithi119.stdout: "client": "client.4559", 2024-04-18T14:44:09.961 INFO:teuthology.orchestra.run.smithi119.stdout: "client_addr": "172.21.15.134:0/3113589487", 2024-04-18T14:44:09.961 INFO:teuthology.orchestra.run.smithi119.stdout: "tid": 319 2024-04-18T14:44:09.961 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:09.961 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-04-18T14:44:09.962 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:09.962 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-04-18T14:44:09.962 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:44.563613+0000", 2024-04-18T14:44:09.962 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:44:09.962 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:09.962 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:09.962 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-04-18T14:44:09.962 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:44.563613+0000", 2024-04-18T14:44:09.962 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:44:09.962 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:09.962 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:09.962 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-04-18T14:44:09.962 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:44.563612+0000", 2024-04-18T14:44:09.962 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4294967295.999999 2024-04-18T14:44:09.962 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:09.963 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:09.963 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-04-18T14:44:09.963 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:44.563618+0000", 2024-04-18T14:44:09.963 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 6.4829999999999996e-06 2024-04-18T14:44:09.963 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:09.963 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:09.963 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-04-18T14:44:09.963 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:44.563631+0000", 2024-04-18T14:44:09.963 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.2594e-05 2024-04-18T14:44:09.963 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:09.963 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:09.963 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-04-18T14:44:09.963 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:44.563639+0000", 2024-04-18T14:44:09.963 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 8.1969999999999996e-06 2024-04-18T14:44:09.963 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:09.963 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:09.964 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-04-18T14:44:09.964 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:44.566084+0000", 2024-04-18T14:44:09.964 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0024452609999999998 2024-04-18T14:44:09.964 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:09.964 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:09.964 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-04-18T14:44:09.964 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:44.566366+0000", 2024-04-18T14:44:09.964 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00028144200000000002 2024-04-18T14:44:09.964 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:09.964 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:09.964 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_started", 2024-04-18T14:44:09.964 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:44.567405+0000", 2024-04-18T14:44:09.964 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0010387319999999999 2024-04-18T14:44:09.964 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:09.964 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:09.964 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_committed", 2024-04-18T14:44:09.965 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:44.569681+0000", 2024-04-18T14:44:09.965 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0022766420000000002 2024-04-18T14:44:09.965 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:09.965 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:09.965 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-04-18T14:44:09.965 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:44.573577+0000", 2024-04-18T14:44:09.965 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0038952349999999999 2024-04-18T14:44:09.965 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:09.965 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:09.965 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-04-18T14:44:09.965 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:44.573677+0000", 2024-04-18T14:44:09.965 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00010084799999999999 2024-04-18T14:44:09.965 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:44:09.965 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-04-18T14:44:09.966 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:44:09.966 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:09.966 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:09.966 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(client.4559.0:320 3.1s0 3:86043532:::smithi13430248-49:head [append 0~0] snapc d=[d,b,a,8,7,2] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-18T14:44:09.966 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-04-18T14:43:44.563733+0000", 2024-04-18T14:44:09.966 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 25.356682976999998, 2024-04-18T14:44:09.966 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.010280269, 2024-04-18T14:44:09.966 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-04-18T14:44:09.966 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T14:44:09.966 INFO:teuthology.orchestra.run.smithi119.stdout: "client_info": { 2024-04-18T14:44:09.966 INFO:teuthology.orchestra.run.smithi119.stdout: "client": "client.4559", 2024-04-18T14:44:09.966 INFO:teuthology.orchestra.run.smithi119.stdout: "client_addr": "172.21.15.134:0/3113589487", 2024-04-18T14:44:09.966 INFO:teuthology.orchestra.run.smithi119.stdout: "tid": 320 2024-04-18T14:44:09.967 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:09.967 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-04-18T14:44:09.967 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:09.967 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-04-18T14:44:09.967 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:44.563733+0000", 2024-04-18T14:44:09.967 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:44:09.967 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:09.967 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:09.967 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-04-18T14:44:09.967 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:44.563733+0000", 2024-04-18T14:44:09.967 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:44:09.967 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:09.967 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:09.967 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-04-18T14:44:09.968 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:44.563731+0000", 2024-04-18T14:44:09.968 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4294967295.9999976 2024-04-18T14:44:09.968 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:09.968 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:09.968 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-04-18T14:44:09.968 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:44.563744+0000", 2024-04-18T14:44:09.968 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.311e-05 2024-04-18T14:44:09.968 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:09.968 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:09.968 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-04-18T14:44:09.968 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:44.563777+0000", 2024-04-18T14:44:09.968 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.2984000000000001e-05 2024-04-18T14:44:09.968 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:09.968 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:09.968 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-04-18T14:44:09.969 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:44.563812+0000", 2024-04-18T14:44:09.969 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.4793999999999999e-05 2024-04-18T14:44:09.969 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:09.969 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:09.969 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-04-18T14:44:09.969 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:44.568010+0000", 2024-04-18T14:44:09.969 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0041978069999999996 2024-04-18T14:44:09.969 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:09.969 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:09.969 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-04-18T14:44:09.969 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:44.568172+0000", 2024-04-18T14:44:09.969 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00016264599999999999 2024-04-18T14:44:09.969 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:09.969 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:09.970 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_started", 2024-04-18T14:44:09.970 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:44.568987+0000", 2024-04-18T14:44:09.970 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00081480500000000004 2024-04-18T14:44:09.970 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:09.970 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:09.970 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_committed", 2024-04-18T14:44:09.970 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:44.570293+0000", 2024-04-18T14:44:09.970 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0013059499999999999 2024-04-18T14:44:09.970 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:09.970 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:09.970 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-04-18T14:44:09.970 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:44.573919+0000", 2024-04-18T14:44:09.970 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0036257400000000001 2024-04-18T14:44:09.970 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:09.971 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:09.971 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-04-18T14:44:09.971 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:44.574013+0000", 2024-04-18T14:44:09.971 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 9.4769e-05 2024-04-18T14:44:09.971 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:44:09.971 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-04-18T14:44:09.971 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:44:09.971 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:09.971 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:09.971 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(client.4559.0:372 3.1s0 3:8de3c091:::smithi13430248-9:head [read 0~1409024,checksum,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-04-18T14:44:09.971 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-04-18T14:43:50.376227+0000", 2024-04-18T14:44:09.971 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 19.544189277000001, 2024-04-18T14:44:09.971 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.014725912000000001, 2024-04-18T14:44:09.971 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-04-18T14:44:09.971 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "started", 2024-04-18T14:44:09.972 INFO:teuthology.orchestra.run.smithi119.stdout: "client_info": { 2024-04-18T14:44:09.972 INFO:teuthology.orchestra.run.smithi119.stdout: "client": "client.4559", 2024-04-18T14:44:09.972 INFO:teuthology.orchestra.run.smithi119.stdout: "client_addr": "172.21.15.134:0/3113589487", 2024-04-18T14:44:09.972 INFO:teuthology.orchestra.run.smithi119.stdout: "tid": 372 2024-04-18T14:44:09.972 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:09.972 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-04-18T14:44:09.972 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:09.972 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-04-18T14:44:09.972 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:50.376227+0000", 2024-04-18T14:44:09.972 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:44:09.972 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:09.972 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:09.972 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-04-18T14:44:09.972 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:50.376227+0000", 2024-04-18T14:44:09.972 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:44:09.972 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:09.973 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:09.973 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-04-18T14:44:09.973 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:50.376224+0000", 2024-04-18T14:44:09.973 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4294967295.9999971 2024-04-18T14:44:09.973 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:09.973 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:09.973 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-04-18T14:44:09.973 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:50.376241+0000", 2024-04-18T14:44:09.973 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.6393999999999999e-05 2024-04-18T14:44:09.973 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:09.973 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:09.973 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-04-18T14:44:09.973 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:50.376283+0000", 2024-04-18T14:44:09.973 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4.2234000000000003e-05 2024-04-18T14:44:09.973 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:09.974 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:09.974 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-04-18T14:44:09.974 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:50.376306+0000", 2024-04-18T14:44:09.974 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.2917000000000001e-05 2024-04-18T14:44:09.974 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:09.974 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:09.974 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-04-18T14:44:09.974 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:50.376438+0000", 2024-04-18T14:44:09.974 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000132695 2024-04-18T14:44:09.974 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:09.974 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:09.974 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "op must wait for map", 2024-04-18T14:44:09.974 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:50.376461+0000", 2024-04-18T14:44:09.974 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.243e-05 2024-04-18T14:44:09.975 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:09.975 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:09.975 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-04-18T14:44:09.975 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:50.381413+0000", 2024-04-18T14:44:09.975 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0049522860000000002 2024-04-18T14:44:09.975 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:09.975 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:09.975 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-04-18T14:44:09.975 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:50.381644+0000", 2024-04-18T14:44:09.975 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000230416 2024-04-18T14:44:09.975 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:09.975 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:09.975 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-04-18T14:44:09.975 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:50.390953+0000", 2024-04-18T14:44:09.975 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0093092069999999999 2024-04-18T14:44:09.976 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:44:09.976 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-04-18T14:44:09.976 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:44:09.976 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:09.976 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:09.976 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(client.4559.0:373 3.1s0 3:8de3c091:::smithi13430248-9:head [read 0~1409024,checksum] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-04-18T14:44:09.976 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-04-18T14:43:50.376336+0000", 2024-04-18T14:44:09.976 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 19.544080326, 2024-04-18T14:44:09.976 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.017062416, 2024-04-18T14:44:09.976 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-04-18T14:44:09.976 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "started", 2024-04-18T14:44:09.976 INFO:teuthology.orchestra.run.smithi119.stdout: "client_info": { 2024-04-18T14:44:09.976 INFO:teuthology.orchestra.run.smithi119.stdout: "client": "client.4559", 2024-04-18T14:44:09.976 INFO:teuthology.orchestra.run.smithi119.stdout: "client_addr": "172.21.15.134:0/3113589487", 2024-04-18T14:44:09.977 INFO:teuthology.orchestra.run.smithi119.stdout: "tid": 373 2024-04-18T14:44:09.977 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:09.977 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-04-18T14:44:09.977 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:09.977 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-04-18T14:44:09.977 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:50.376336+0000", 2024-04-18T14:44:09.977 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:44:09.977 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:09.977 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:09.977 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-04-18T14:44:09.977 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:50.376336+0000", 2024-04-18T14:44:09.977 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:44:09.977 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:09.977 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:09.977 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-04-18T14:44:09.977 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:50.376334+0000", 2024-04-18T14:44:09.978 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4294967295.9999986 2024-04-18T14:44:09.978 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:09.978 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:09.978 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-04-18T14:44:09.978 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:50.376344+0000", 2024-04-18T14:44:09.978 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 9.9939999999999995e-06 2024-04-18T14:44:09.978 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:09.978 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:09.978 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-04-18T14:44:09.978 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:50.376363+0000", 2024-04-18T14:44:09.978 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.9063e-05 2024-04-18T14:44:09.978 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:09.978 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:09.978 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-04-18T14:44:09.979 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:50.376379+0000", 2024-04-18T14:44:09.979 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.5153999999999999e-05 2024-04-18T14:44:09.979 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:09.979 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:09.979 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-04-18T14:44:09.979 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:50.376635+0000", 2024-04-18T14:44:09.979 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00025632600000000003 2024-04-18T14:44:09.979 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:09.979 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:09.979 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting_for_map not empty", 2024-04-18T14:44:09.979 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:50.376657+0000", 2024-04-18T14:44:09.979 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.1693999999999999e-05 2024-04-18T14:44:09.979 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:09.979 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:09.979 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-04-18T14:44:09.980 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:50.383261+0000", 2024-04-18T14:44:09.980 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0066047579999999996 2024-04-18T14:44:09.980 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:09.980 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:09.980 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-04-18T14:44:09.980 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:50.383496+0000", 2024-04-18T14:44:09.980 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00023489299999999999 2024-04-18T14:44:09.980 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:09.980 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:09.980 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-04-18T14:44:09.980 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:50.393398+0000", 2024-04-18T14:44:09.980 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0099019269999999996 2024-04-18T14:44:09.980 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:44:09.980 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-04-18T14:44:09.980 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:44:09.981 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:09.981 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:09.981 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(client.4559.0:374 3.1s0 3:8de3c091:::smithi13430248-9:head [read 0~1409024,checksum] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-04-18T14:44:09.981 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-04-18T14:43:50.376424+0000", 2024-04-18T14:44:09.981 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 19.543992608, 2024-04-18T14:44:09.981 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.018965715000000001, 2024-04-18T14:44:09.981 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-04-18T14:44:09.981 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "started", 2024-04-18T14:44:09.981 INFO:teuthology.orchestra.run.smithi119.stdout: "client_info": { 2024-04-18T14:44:09.981 INFO:teuthology.orchestra.run.smithi119.stdout: "client": "client.4559", 2024-04-18T14:44:09.981 INFO:teuthology.orchestra.run.smithi119.stdout: "client_addr": "172.21.15.134:0/3113589487", 2024-04-18T14:44:09.981 INFO:teuthology.orchestra.run.smithi119.stdout: "tid": 374 2024-04-18T14:44:09.981 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:09.981 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-04-18T14:44:09.982 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:09.982 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-04-18T14:44:09.982 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:50.376424+0000", 2024-04-18T14:44:09.982 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:44:09.982 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:09.982 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:09.982 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-04-18T14:44:09.982 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:50.376424+0000", 2024-04-18T14:44:09.982 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:44:09.982 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:09.982 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:09.982 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-04-18T14:44:09.982 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:50.376422+0000", 2024-04-18T14:44:09.983 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4294967295.9999986 2024-04-18T14:44:09.983 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:09.983 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:09.983 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-04-18T14:44:09.983 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:50.376430+0000", 2024-04-18T14:44:09.983 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 7.7610000000000007e-06 2024-04-18T14:44:09.983 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:09.983 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:09.983 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-04-18T14:44:09.983 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:50.376447+0000", 2024-04-18T14:44:09.983 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.734e-05 2024-04-18T14:44:09.984 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:09.984 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:09.984 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-04-18T14:44:09.984 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:50.376462+0000", 2024-04-18T14:44:09.984 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.4286e-05 2024-04-18T14:44:09.984 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:09.984 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:09.984 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-04-18T14:44:09.984 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:50.376723+0000", 2024-04-18T14:44:09.984 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000260914 2024-04-18T14:44:09.984 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:09.984 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:09.984 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting_for_map not empty", 2024-04-18T14:44:09.984 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:50.376743+0000", 2024-04-18T14:44:09.985 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.031e-05 2024-04-18T14:44:09.985 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:09.985 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:09.985 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-04-18T14:44:09.985 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:50.387572+0000", 2024-04-18T14:44:09.985 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.010829544 2024-04-18T14:44:09.985 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:09.985 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:09.985 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-04-18T14:44:09.985 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:50.387758+0000", 2024-04-18T14:44:09.985 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000185849 2024-04-18T14:44:09.985 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:09.985 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:09.985 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-04-18T14:44:09.985 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:50.395389+0000", 2024-04-18T14:44:09.986 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0076309810000000002 2024-04-18T14:44:09.986 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:44:09.986 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-04-18T14:44:09.986 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:44:09.986 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:09.986 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:09.986 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "MOSDECSubOpWrite(3.ds6 57/30 ECSubWrite(tid=20, reqid=client.4559.0:495, at_version=57'19, trim_to=0'0, roll_forward_to=54'17))", 2024-04-18T14:44:09.986 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-04-18T14:43:56.552436+0000", 2024-04-18T14:44:09.986 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 13.367980426000001, 2024-04-18T14:44:09.986 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0092140309999999993, 2024-04-18T14:44:09.986 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-04-18T14:44:09.986 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "reached pg", 2024-04-18T14:44:09.986 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-04-18T14:44:09.986 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:09.986 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-04-18T14:44:09.987 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:56.552436+0000", 2024-04-18T14:44:09.987 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:44:09.987 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:09.987 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:09.987 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-04-18T14:44:09.987 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:56.552436+0000", 2024-04-18T14:44:09.987 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:44:09.987 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:09.987 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:09.987 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-04-18T14:44:09.987 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:56.552434+0000", 2024-04-18T14:44:09.987 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4294967295.9999981 2024-04-18T14:44:09.987 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:09.987 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:09.987 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-04-18T14:44:09.988 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:56.553692+0000", 2024-04-18T14:44:09.988 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0012579690000000001 2024-04-18T14:44:09.988 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:09.988 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:09.988 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-04-18T14:44:09.988 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:56.553719+0000", 2024-04-18T14:44:09.988 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.7076999999999998e-05 2024-04-18T14:44:09.988 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:09.988 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:09.988 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-04-18T14:44:09.988 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:56.553740+0000", 2024-04-18T14:44:09.988 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.1420000000000002e-05 2024-04-18T14:44:09.988 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:09.989 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:09.989 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-04-18T14:44:09.989 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:56.553888+0000", 2024-04-18T14:44:09.989 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000147732 2024-04-18T14:44:09.989 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:09.989 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:09.989 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_started", 2024-04-18T14:44:09.989 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:56.553914+0000", 2024-04-18T14:44:09.989 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.5950000000000001e-05 2024-04-18T14:44:09.989 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:09.989 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:09.989 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_committed", 2024-04-18T14:44:09.989 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:56.561590+0000", 2024-04-18T14:44:09.989 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0076763059999999999 2024-04-18T14:44:09.990 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:09.990 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:09.990 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-04-18T14:44:09.990 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:56.561650+0000", 2024-04-18T14:44:09.990 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 5.9413000000000002e-05 2024-04-18T14:44:09.990 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:44:09.990 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-04-18T14:44:09.990 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:44:09.990 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:09.990 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:09.990 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(client.4559.0:512 3.1s0 3:8edef92b:::smithi13430248-24:head [copy-from ver 13] snapc 19=[19,16,14,13,11,f,b,a,7,2] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-18T14:44:09.990 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-04-18T14:43:56.578477+0000", 2024-04-18T14:44:09.990 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 13.341938832, 2024-04-18T14:44:09.990 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.021126664, 2024-04-18T14:44:09.990 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-04-18T14:44:09.991 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T14:44:09.991 INFO:teuthology.orchestra.run.smithi119.stdout: "client_info": { 2024-04-18T14:44:09.991 INFO:teuthology.orchestra.run.smithi119.stdout: "client": "client.4559", 2024-04-18T14:44:09.991 INFO:teuthology.orchestra.run.smithi119.stdout: "client_addr": "172.21.15.134:0/3113589487", 2024-04-18T14:44:09.991 INFO:teuthology.orchestra.run.smithi119.stdout: "tid": 512 2024-04-18T14:44:09.991 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:09.991 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-04-18T14:44:09.991 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:09.991 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-04-18T14:44:09.991 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:56.578477+0000", 2024-04-18T14:44:09.991 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:44:09.991 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:09.991 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:09.991 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-04-18T14:44:09.991 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:56.578477+0000", 2024-04-18T14:44:09.992 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:44:09.992 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:09.992 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:09.992 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-04-18T14:44:09.992 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:56.578473+0000", 2024-04-18T14:44:09.992 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4294967295.9999962 2024-04-18T14:44:09.992 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:09.992 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:09.992 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-04-18T14:44:09.992 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:56.578491+0000", 2024-04-18T14:44:09.992 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.7784000000000001e-05 2024-04-18T14:44:09.992 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:09.992 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:09.992 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-04-18T14:44:09.992 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:56.578576+0000", 2024-04-18T14:44:09.993 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 8.5117000000000005e-05 2024-04-18T14:44:09.993 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:09.993 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:09.993 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-04-18T14:44:09.993 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:56.578601+0000", 2024-04-18T14:44:09.993 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.4581000000000001e-05 2024-04-18T14:44:09.993 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:09.993 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:09.993 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-04-18T14:44:09.993 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:56.578739+0000", 2024-04-18T14:44:09.993 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000138271 2024-04-18T14:44:09.993 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:09.993 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:09.993 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-04-18T14:44:09.994 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:56.578932+0000", 2024-04-18T14:44:09.994 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000192649 2024-04-18T14:44:09.994 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:09.994 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:09.994 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_started", 2024-04-18T14:44:09.994 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:56.587757+0000", 2024-04-18T14:44:09.994 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0088247970000000005 2024-04-18T14:44:09.994 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:09.994 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:09.994 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_committed", 2024-04-18T14:44:09.994 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:56.591615+0000", 2024-04-18T14:44:09.994 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.003858336 2024-04-18T14:44:09.994 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:09.994 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:09.995 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-04-18T14:44:09.995 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:56.599453+0000", 2024-04-18T14:44:09.995 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0078382509999999992 2024-04-18T14:44:09.995 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:09.995 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:09.995 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-04-18T14:44:09.995 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:56.599604+0000", 2024-04-18T14:44:09.995 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000150688 2024-04-18T14:44:09.995 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:44:09.995 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-04-18T14:44:09.995 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:44:09.995 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:09.995 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:09.995 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(client.4559.0:513 3.1s0 3:8edef92b:::smithi13430248-24:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e57)", 2024-04-18T14:44:09.996 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-04-18T14:43:56.578631+0000", 2024-04-18T14:44:09.996 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 13.341784692999999, 2024-04-18T14:44:09.996 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.012977336000000001, 2024-04-18T14:44:09.996 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-04-18T14:44:09.996 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "started", 2024-04-18T14:44:09.996 INFO:teuthology.orchestra.run.smithi119.stdout: "client_info": { 2024-04-18T14:44:09.996 INFO:teuthology.orchestra.run.smithi119.stdout: "client": "client.4559", 2024-04-18T14:44:09.996 INFO:teuthology.orchestra.run.smithi119.stdout: "client_addr": "172.21.15.134:0/3113589487", 2024-04-18T14:44:09.996 INFO:teuthology.orchestra.run.smithi119.stdout: "tid": 513 2024-04-18T14:44:09.996 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:09.996 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-04-18T14:44:09.996 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:09.996 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-04-18T14:44:09.996 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:56.578631+0000", 2024-04-18T14:44:09.996 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:44:09.996 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:09.997 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:09.997 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-04-18T14:44:09.997 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:56.578631+0000", 2024-04-18T14:44:09.997 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:44:09.997 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:09.997 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:09.997 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-04-18T14:44:09.997 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:56.578630+0000", 2024-04-18T14:44:09.997 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4294967295.9999981 2024-04-18T14:44:09.997 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:09.997 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:09.997 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-04-18T14:44:09.997 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:56.578640+0000", 2024-04-18T14:44:09.997 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.0074e-05 2024-04-18T14:44:09.997 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:09.998 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:09.998 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-04-18T14:44:09.998 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:56.578663+0000", 2024-04-18T14:44:09.998 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.3343e-05 2024-04-18T14:44:09.998 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:09.998 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:09.998 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-04-18T14:44:09.998 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:56.578679+0000", 2024-04-18T14:44:09.998 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.6016999999999999e-05 2024-04-18T14:44:09.998 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:09.998 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:09.998 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-04-18T14:44:09.998 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:56.579396+0000", 2024-04-18T14:44:09.998 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00071690800000000004 2024-04-18T14:44:09.999 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:09.999 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:09.999 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for blocked object", 2024-04-18T14:44:09.999 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:56.579516+0000", 2024-04-18T14:44:09.999 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000120227 2024-04-18T14:44:09.999 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:09.999 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:09.999 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-04-18T14:44:09.999 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:56.591181+0000", 2024-04-18T14:44:09.999 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.011664496999999999 2024-04-18T14:44:09.999 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:09.999 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:09.999 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-04-18T14:44:09.999 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:56.591457+0000", 2024-04-18T14:44:09.999 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00027621299999999998 2024-04-18T14:44:09.999 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:10.000 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:10.000 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-04-18T14:44:10.000 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:56.591609+0000", 2024-04-18T14:44:10.000 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000151731 2024-04-18T14:44:10.000 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:44:10.000 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-04-18T14:44:10.000 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:44:10.000 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:10.000 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:10.000 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(client.4559.0:568 3.1s0 3:8de3c091:::smithi13430248-9:head [read 0~2965504,checksum,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-04-18T14:44:10.000 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-04-18T14:44:01.395531+0000", 2024-04-18T14:44:10.000 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 8.5248854069999993, 2024-04-18T14:44:10.000 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.012097393999999999, 2024-04-18T14:44:10.000 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-04-18T14:44:10.001 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "started", 2024-04-18T14:44:10.001 INFO:teuthology.orchestra.run.smithi119.stdout: "client_info": { 2024-04-18T14:44:10.001 INFO:teuthology.orchestra.run.smithi119.stdout: "client": "client.4559", 2024-04-18T14:44:10.001 INFO:teuthology.orchestra.run.smithi119.stdout: "client_addr": "172.21.15.134:0/3113589487", 2024-04-18T14:44:10.001 INFO:teuthology.orchestra.run.smithi119.stdout: "tid": 568 2024-04-18T14:44:10.001 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:10.001 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-04-18T14:44:10.001 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:10.001 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-04-18T14:44:10.001 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:01.395531+0000", 2024-04-18T14:44:10.001 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:44:10.001 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:10.001 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:10.001 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-04-18T14:44:10.002 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:01.395531+0000", 2024-04-18T14:44:10.002 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:44:10.002 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:10.002 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:10.002 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-04-18T14:44:10.002 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:01.395528+0000", 2024-04-18T14:44:10.002 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4294967295.9999976 2024-04-18T14:44:10.002 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:10.002 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:10.002 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-04-18T14:44:10.002 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:01.395545+0000", 2024-04-18T14:44:10.002 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.7306e-05 2024-04-18T14:44:10.002 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:10.002 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:10.003 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-04-18T14:44:10.003 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:01.395573+0000", 2024-04-18T14:44:10.003 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.7120000000000001e-05 2024-04-18T14:44:10.003 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:10.003 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:10.003 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-04-18T14:44:10.003 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:01.395591+0000", 2024-04-18T14:44:10.003 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.8393000000000002e-05 2024-04-18T14:44:10.003 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:10.003 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:10.003 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-04-18T14:44:10.003 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:01.396457+0000", 2024-04-18T14:44:10.003 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00086618999999999997 2024-04-18T14:44:10.004 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:10.004 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:10.004 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-04-18T14:44:10.004 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:01.396723+0000", 2024-04-18T14:44:10.004 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00026560499999999998 2024-04-18T14:44:10.004 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:10.004 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:10.004 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-04-18T14:44:10.004 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:01.407628+0000", 2024-04-18T14:44:10.004 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.010905339999999999 2024-04-18T14:44:10.004 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:44:10.004 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-04-18T14:44:10.004 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:44:10.004 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:10.005 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:10.005 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(client.4559.0:569 3.1s0 3:8de3c091:::smithi13430248-9:head [read 0~2965504,checksum] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-04-18T14:44:10.005 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-04-18T14:44:01.395633+0000", 2024-04-18T14:44:10.005 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 8.5247835379999994, 2024-04-18T14:44:10.005 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.013434883999999999, 2024-04-18T14:44:10.005 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-04-18T14:44:10.005 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "started", 2024-04-18T14:44:10.005 INFO:teuthology.orchestra.run.smithi119.stdout: "client_info": { 2024-04-18T14:44:10.005 INFO:teuthology.orchestra.run.smithi119.stdout: "client": "client.4559", 2024-04-18T14:44:10.005 INFO:teuthology.orchestra.run.smithi119.stdout: "client_addr": "172.21.15.134:0/3113589487", 2024-04-18T14:44:10.005 INFO:teuthology.orchestra.run.smithi119.stdout: "tid": 569 2024-04-18T14:44:10.005 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:10.005 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-04-18T14:44:10.005 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:10.006 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-04-18T14:44:10.006 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:01.395633+0000", 2024-04-18T14:44:10.006 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:44:10.006 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:10.006 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:10.006 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-04-18T14:44:10.006 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:01.395633+0000", 2024-04-18T14:44:10.006 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:44:10.006 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:10.006 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:10.006 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-04-18T14:44:10.006 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:01.395631+0000", 2024-04-18T14:44:10.006 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4294967295.9999986 2024-04-18T14:44:10.006 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:10.006 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:10.007 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-04-18T14:44:10.007 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:01.395640+0000", 2024-04-18T14:44:10.007 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 8.8440000000000004e-06 2024-04-18T14:44:10.007 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:10.007 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:10.007 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-04-18T14:44:10.007 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:01.395658+0000", 2024-04-18T14:44:10.007 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.8436000000000001e-05 2024-04-18T14:44:10.007 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:10.007 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:10.007 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-04-18T14:44:10.007 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:01.395672+0000", 2024-04-18T14:44:10.007 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.359e-05 2024-04-18T14:44:10.007 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:10.007 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:10.007 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-04-18T14:44:10.008 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:01.397951+0000", 2024-04-18T14:44:10.008 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0022788109999999999 2024-04-18T14:44:10.008 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:10.008 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:10.008 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-04-18T14:44:10.008 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:01.398063+0000", 2024-04-18T14:44:10.008 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00011175000000000001 2024-04-18T14:44:10.008 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:10.008 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:10.008 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-04-18T14:44:10.008 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:01.409067+0000", 2024-04-18T14:44:10.008 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.011004923 2024-04-18T14:44:10.008 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:44:10.008 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-04-18T14:44:10.008 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:44:10.009 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:10.009 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:10.009 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(client.4559.0:570 3.1s0 3:8de3c091:::smithi13430248-9:head [read 0~2965504,checksum] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-04-18T14:44:10.009 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-04-18T14:44:01.395684+0000", 2024-04-18T14:44:10.009 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 8.5247326250000004, 2024-04-18T14:44:10.009 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.015163787, 2024-04-18T14:44:10.009 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-04-18T14:44:10.009 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "started", 2024-04-18T14:44:10.009 INFO:teuthology.orchestra.run.smithi119.stdout: "client_info": { 2024-04-18T14:44:10.009 INFO:teuthology.orchestra.run.smithi119.stdout: "client": "client.4559", 2024-04-18T14:44:10.009 INFO:teuthology.orchestra.run.smithi119.stdout: "client_addr": "172.21.15.134:0/3113589487", 2024-04-18T14:44:10.009 INFO:teuthology.orchestra.run.smithi119.stdout: "tid": 570 2024-04-18T14:44:10.009 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:10.009 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-04-18T14:44:10.009 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:10.009 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-04-18T14:44:10.010 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:01.395684+0000", 2024-04-18T14:44:10.010 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:44:10.010 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:10.010 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:10.010 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-04-18T14:44:10.010 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:01.395684+0000", 2024-04-18T14:44:10.010 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:44:10.010 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:10.010 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:10.010 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-04-18T14:44:10.010 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:01.395683+0000", 2024-04-18T14:44:10.010 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4294967295.999999 2024-04-18T14:44:10.010 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:10.011 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:10.011 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-04-18T14:44:10.011 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:01.395691+0000", 2024-04-18T14:44:10.011 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 8.7029999999999995e-06 2024-04-18T14:44:10.011 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:10.011 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:10.011 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-04-18T14:44:10.011 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:01.395708+0000", 2024-04-18T14:44:10.011 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.6554000000000001e-05 2024-04-18T14:44:10.011 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:10.011 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:10.011 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-04-18T14:44:10.011 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:01.395722+0000", 2024-04-18T14:44:10.011 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.468e-05 2024-04-18T14:44:10.011 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:10.011 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:10.012 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-04-18T14:44:10.012 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:01.401454+0000", 2024-04-18T14:44:10.012 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.005731346 2024-04-18T14:44:10.012 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:10.012 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:10.012 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-04-18T14:44:10.012 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:01.401588+0000", 2024-04-18T14:44:10.012 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000133974 2024-04-18T14:44:10.012 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:10.012 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:10.012 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-04-18T14:44:10.012 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:01.410847+0000", 2024-04-18T14:44:10.012 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.009259527 2024-04-18T14:44:10.012 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:44:10.012 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-04-18T14:44:10.012 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:44:10.013 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:10.013 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:10.013 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "MOSDECSubOpWrite(3.9s6 67/30 ECSubWrite(tid=134, reqid=client.4559.0:644, at_version=67'107, trim_to=0'0, roll_forward_to=65'104))", 2024-04-18T14:44:10.013 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-04-18T14:44:06.400802+0000", 2024-04-18T14:44:10.013 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 3.519614437, 2024-04-18T14:44:10.013 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0081022209999999997, 2024-04-18T14:44:10.013 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-04-18T14:44:10.013 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "reached pg", 2024-04-18T14:44:10.013 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-04-18T14:44:10.013 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:10.013 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-04-18T14:44:10.013 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:06.400802+0000", 2024-04-18T14:44:10.013 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:44:10.013 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:10.014 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:10.014 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-04-18T14:44:10.014 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:06.400802+0000", 2024-04-18T14:44:10.014 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:44:10.014 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:10.014 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:10.014 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-04-18T14:44:10.014 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:06.400801+0000", 2024-04-18T14:44:10.014 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4294967295.999999 2024-04-18T14:44:10.014 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:10.014 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:10.014 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-04-18T14:44:10.014 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:06.401548+0000", 2024-04-18T14:44:10.014 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00074662100000000005 2024-04-18T14:44:10.014 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:10.015 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:10.015 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-04-18T14:44:10.015 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:06.401597+0000", 2024-04-18T14:44:10.015 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4.9382999999999998e-05 2024-04-18T14:44:10.015 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:10.015 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:10.015 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-04-18T14:44:10.015 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:06.401619+0000", 2024-04-18T14:44:10.015 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.2469000000000001e-05 2024-04-18T14:44:10.015 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:10.015 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:10.015 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-04-18T14:44:10.015 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:06.401780+0000", 2024-04-18T14:44:10.015 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000160526 2024-04-18T14:44:10.015 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:10.016 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:10.016 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_started", 2024-04-18T14:44:10.016 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:06.401808+0000", 2024-04-18T14:44:10.016 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.8370000000000001e-05 2024-04-18T14:44:10.016 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:10.016 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:10.016 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_committed", 2024-04-18T14:44:10.016 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:06.408838+0000", 2024-04-18T14:44:10.016 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0070292890000000002 2024-04-18T14:44:10.016 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:10.016 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:10.016 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-04-18T14:44:10.016 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:06.408904+0000", 2024-04-18T14:44:10.016 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 6.6365999999999994e-05 2024-04-18T14:44:10.016 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:44:10.016 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-04-18T14:44:10.017 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:44:10.017 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:44:10.017 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-04-18T14:44:10.017 INFO:teuthology.orchestra.run.smithi119.stdout:} 2024-04-18T14:44:10.018 INFO:teuthology.orchestra.run.smithi086.stdout:osd.15: {} 2024-04-18T14:44:10.019 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.10.asok dump_ops_in_flight 2024-04-18T14:44:10.020 INFO:teuthology.orchestra.run.smithi086.stderr:osd.15: osd_enable_op_tracker = '' 2024-04-18T14:44:10.020 INFO:tasks.ceph.osd.0.smithi086.stderr:2024-04-18T14:44:10.014+0000 7f7cdfd78640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 24953) UID: 0 2024-04-18T14:44:10.119 INFO:tasks.ceph.osd.0.smithi086.stderr:2024-04-18T14:44:10.118+0000 7f7cdfd78640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 24953) UID: 0 2024-04-18T14:44:10.188 INFO:teuthology.orchestra.run.smithi119.stdout:{ 2024-04-18T14:44:10.189 INFO:teuthology.orchestra.run.smithi119.stdout: "ops": [], 2024-04-18T14:44:10.189 INFO:teuthology.orchestra.run.smithi119.stdout: "num_ops": 0 2024-04-18T14:44:10.189 INFO:teuthology.orchestra.run.smithi119.stdout:} 2024-04-18T14:44:10.202 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.10.asok dump_blocked_ops 2024-04-18T14:44:10.247 INFO:tasks.ceph.osd.2.smithi119.stderr:2024-04-18T14:44:10.250+0000 7fcbd30c0640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 24894) UID: 0 2024-04-18T14:44:10.321 INFO:tasks.ceph.osd.3.smithi134.stderr:2024-04-18T14:44:10.324+0000 7fe7a4443640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25211) UID: 0 2024-04-18T14:44:10.323 INFO:teuthology.orchestra.run.smithi119.stdout:{ 2024-04-18T14:44:10.323 INFO:teuthology.orchestra.run.smithi119.stdout: "ops": [], 2024-04-18T14:44:10.323 INFO:teuthology.orchestra.run.smithi119.stdout: "complaint_time": 30, 2024-04-18T14:44:10.323 INFO:teuthology.orchestra.run.smithi119.stdout: "num_blocked_ops": 0 2024-04-18T14:44:10.323 INFO:teuthology.orchestra.run.smithi119.stdout:} 2024-04-18T14:44:10.337 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.10.asok dump_historic_ops 2024-04-18T14:44:10.422 INFO:tasks.ceph.osd.12.smithi086.stderr:2024-04-18T14:44:10.422+0000 7f6904968640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 12 (PID: 24960) UID: 0 2024-04-18T14:44:10.431 INFO:tasks.rados.rados.0.smithi134.stdout:275: finishing write tid 1 to smithi13430248-31 2024-04-18T14:44:10.431 INFO:tasks.rados.rados.0.smithi134.stdout:275: finishing write tid 2 to smithi13430248-31 2024-04-18T14:44:10.433 INFO:tasks.rados.rados.0.smithi134.stdout:275: finishing write tid 3 to smithi13430248-31 2024-04-18T14:44:10.437 INFO:tasks.rados.rados.0.smithi134.stdout:275: finishing write tid 4 to smithi13430248-31 2024-04-18T14:44:10.437 INFO:tasks.rados.rados.0.smithi134.stdout:275: finishing write tid 5 to smithi13430248-31 2024-04-18T14:44:10.441 INFO:tasks.rados.rados.0.smithi134.stdout:275: finishing write tid 6 to smithi13430248-31 2024-04-18T14:44:10.441 INFO:tasks.rados.rados.0.smithi134.stdout:275: oid 31 updating version 0 to 25 2024-04-18T14:44:10.441 INFO:tasks.rados.rados.0.smithi134.stdout:275: oid 31 version 25 is already newer than 22 2024-04-18T14:44:10.441 INFO:tasks.rados.rados.0.smithi134.stdout:275: oid 31 version 25 is already newer than 24 2024-04-18T14:44:10.441 INFO:tasks.rados.rados.0.smithi134.stdout:275: oid 31 version 25 is already newer than 23 2024-04-18T14:44:10.441 INFO:tasks.rados.rados.0.smithi134.stdout:275: oid 31 version 25 is already newer than 21 2024-04-18T14:44:10.441 INFO:tasks.rados.rados.0.smithi134.stdout:update_object_version oid 31 v 25 (ObjNum 116 snap 24 seq_num 116) dirty exists 2024-04-18T14:44:10.442 INFO:tasks.rados.rados.0.smithi134.stdout:275: left oid 31 (ObjNum 116 snap 24 seq_num 116) 2024-04-18T14:44:10.446 INFO:tasks.rados.rados.0.smithi134.stdout:274: done (2 left) 2024-04-18T14:44:10.446 INFO:tasks.rados.rados.0.smithi134.stdout:275: done (1 left) 2024-04-18T14:44:10.447 INFO:tasks.rados.rados.0.smithi134.stdout:276: done (0 left) 2024-04-18T14:44:10.447 INFO:tasks.rados.rados.0.smithi134.stdout:277: rollback oid 21 current snap is 24 2024-04-18T14:44:10.447 INFO:tasks.rados.rados.0.smithi134.stdout:rollback oid 21 to 11 2024-04-18T14:44:10.447 INFO:tasks.rados.rados.0.smithi134.stdout:278: setattr oid 2 current snap is 24 2024-04-18T14:44:10.447 INFO:tasks.rados.rados.0.smithi134.stdout:279: read oid 36 snap -1 2024-04-18T14:44:10.447 INFO:tasks.rados.rados.0.smithi134.stdout:279: expect (ObjNum 100 snap 21 seq_num 100) 2024-04-18T14:44:10.447 INFO:tasks.rados.rados.0.smithi134.stdout:280: delete oid 9 current snap is 24 2024-04-18T14:44:10.454 INFO:tasks.rados.rados.0.smithi134.stdout:277: finishing rollback tid 0 to smithi13430248-21 2024-04-18T14:44:10.456 INFO:tasks.rados.rados.0.smithi134.stdout:280: done (3 left) 2024-04-18T14:44:10.456 INFO:tasks.rados.rados.0.smithi134.stdout:281: read oid 46 snap -1 2024-04-18T14:44:10.456 INFO:tasks.rados.rados.0.smithi134.stdout:281: expect (ObjNum 94 snap 19 seq_num 94) 2024-04-18T14:44:10.456 INFO:tasks.rados.rados.0.smithi134.stdout:282: delete oid 9 current snap is 24 2024-04-18T14:44:10.456 INFO:tasks.rados.rados.0.smithi134.stdout:277: finishing rollback tid 1 to smithi13430248-21 2024-04-18T14:44:10.457 INFO:tasks.rados.rados.0.smithi134.stdout:277: finishing rollback tid 2 to smithi13430248-21 2024-04-18T14:44:10.457 INFO:tasks.rados.rados.0.smithi134.stdout:update_object_version oid 21 v 122 (ObjNum 20 snap 0 seq_num 20) dirty exists 2024-04-18T14:44:10.462 INFO:tasks.rados.rados.0.smithi134.stdout:277: done (4 left) 2024-04-18T14:44:10.462 INFO:tasks.rados.rados.0.smithi134.stdout:282: done (3 left) 2024-04-18T14:44:10.462 INFO:tasks.rados.rados.0.smithi134.stdout:283: snap_create 2024-04-18T14:44:10.467 INFO:tasks.rados.rados.0.smithi134.stdout:update_object_version oid 2 v 40 (ObjNum 97 snap 0 seq_num 636164935) dirty exists 2024-04-18T14:44:10.471 INFO:tasks.rados.rados.0.smithi134.stdout:281: expect (ObjNum 94 snap 19 seq_num 94) 2024-04-18T14:44:10.523 INFO:tasks.ceph.osd.8.smithi086.stderr:2024-04-18T14:44:10.522+0000 7f29f7b9d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 8 (PID: 24958) UID: 0 2024-04-18T14:44:10.526 INFO:teuthology.orchestra.run.smithi119.stdout:{ 2024-04-18T14:44:10.527 INFO:teuthology.orchestra.run.smithi119.stdout: "size": 20, 2024-04-18T14:44:10.527 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 600, 2024-04-18T14:44:10.527 INFO:teuthology.orchestra.run.smithi119.stdout: "ops": [ 2024-04-18T14:44:10.527 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:10.527 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(client.4559.0:185 3.bs0 3:db6a9fd1:::smithi13430248-42:head [delete] snapc 4=[4,2] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e37)", 2024-04-18T14:44:10.527 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-04-18T14:43:36.725191+0000", 2024-04-18T14:44:10.527 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 33.804345920999999, 2024-04-18T14:44:10.527 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0090198750000000001, 2024-04-18T14:44:10.527 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-04-18T14:44:10.527 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T14:44:10.527 INFO:teuthology.orchestra.run.smithi119.stdout: "client_info": { 2024-04-18T14:44:10.527 INFO:teuthology.orchestra.run.smithi119.stdout: "client": "client.4559", 2024-04-18T14:44:10.527 INFO:teuthology.orchestra.run.smithi119.stdout: "client_addr": "172.21.15.134:0/3113589487", 2024-04-18T14:44:10.527 INFO:teuthology.orchestra.run.smithi119.stdout: "tid": 185 2024-04-18T14:44:10.528 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:10.528 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-04-18T14:44:10.528 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:10.528 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-04-18T14:44:10.528 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:36.725191+0000", 2024-04-18T14:44:10.528 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:44:10.528 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:10.528 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:10.528 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-04-18T14:44:10.528 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:36.725191+0000", 2024-04-18T14:44:10.528 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:44:10.528 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:10.528 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:10.528 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-04-18T14:44:10.528 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:36.725188+0000", 2024-04-18T14:44:10.528 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4294967295.9999967 2024-04-18T14:44:10.529 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:10.529 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:10.529 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-04-18T14:44:10.529 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:36.725206+0000", 2024-04-18T14:44:10.529 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.8051e-05 2024-04-18T14:44:10.529 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:10.529 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:10.529 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-04-18T14:44:10.529 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:36.725239+0000", 2024-04-18T14:44:10.529 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.2416999999999998e-05 2024-04-18T14:44:10.529 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:10.529 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:10.529 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-04-18T14:44:10.529 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:36.725262+0000", 2024-04-18T14:44:10.530 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.3638e-05 2024-04-18T14:44:10.530 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:10.530 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:10.530 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-04-18T14:44:10.530 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:36.725389+0000", 2024-04-18T14:44:10.530 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00012678599999999999 2024-04-18T14:44:10.530 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:10.530 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:10.530 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-04-18T14:44:10.530 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:36.725609+0000", 2024-04-18T14:44:10.530 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00022012299999999999 2024-04-18T14:44:10.530 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:10.530 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:10.530 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_started", 2024-04-18T14:44:10.531 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:36.726907+0000", 2024-04-18T14:44:10.531 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.001297458 2024-04-18T14:44:10.531 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:10.531 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:10.531 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_committed", 2024-04-18T14:44:10.531 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:36.729252+0000", 2024-04-18T14:44:10.531 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0023456810000000001 2024-04-18T14:44:10.531 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:10.531 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:10.531 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-04-18T14:44:10.531 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:36.734032+0000", 2024-04-18T14:44:10.531 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0047791630000000003 2024-04-18T14:44:10.531 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:10.531 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:10.532 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-04-18T14:44:10.532 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:36.734211+0000", 2024-04-18T14:44:10.532 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00017970799999999999 2024-04-18T14:44:10.532 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:44:10.532 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-04-18T14:44:10.532 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:44:10.532 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:10.532 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:10.532 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(client.4559.0:198 3.4s0 3:253cfff6:::smithi13430248-31:2 [read 0~507904,checksum,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37)", 2024-04-18T14:44:10.532 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-04-18T14:43:36.777890+0000", 2024-04-18T14:44:10.532 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 33.751647261999999, 2024-04-18T14:44:10.532 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.007730888, 2024-04-18T14:44:10.532 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-04-18T14:44:10.533 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "started", 2024-04-18T14:44:10.533 INFO:teuthology.orchestra.run.smithi119.stdout: "client_info": { 2024-04-18T14:44:10.533 INFO:teuthology.orchestra.run.smithi119.stdout: "client": "client.4559", 2024-04-18T14:44:10.533 INFO:teuthology.orchestra.run.smithi119.stdout: "client_addr": "172.21.15.134:0/3113589487", 2024-04-18T14:44:10.533 INFO:teuthology.orchestra.run.smithi119.stdout: "tid": 198 2024-04-18T14:44:10.533 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:10.533 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-04-18T14:44:10.533 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:10.533 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-04-18T14:44:10.533 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:36.777890+0000", 2024-04-18T14:44:10.533 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:44:10.533 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:10.533 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:10.533 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-04-18T14:44:10.533 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:36.777890+0000", 2024-04-18T14:44:10.534 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:44:10.534 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:10.534 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:10.534 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-04-18T14:44:10.534 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:36.777887+0000", 2024-04-18T14:44:10.534 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4294967295.9999967 2024-04-18T14:44:10.535 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:10.535 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:10.535 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-04-18T14:44:10.535 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:36.777903+0000", 2024-04-18T14:44:10.535 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.6078000000000001e-05 2024-04-18T14:44:10.535 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:10.535 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:10.535 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-04-18T14:44:10.535 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:36.777968+0000", 2024-04-18T14:44:10.535 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 6.5154999999999995e-05 2024-04-18T14:44:10.535 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:10.535 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:10.535 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-04-18T14:44:10.535 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:36.777986+0000", 2024-04-18T14:44:10.535 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.7856999999999999e-05 2024-04-18T14:44:10.536 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:10.536 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:10.536 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-04-18T14:44:10.536 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:36.778086+0000", 2024-04-18T14:44:10.536 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000100453 2024-04-18T14:44:10.536 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:10.536 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:10.536 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-04-18T14:44:10.536 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:36.778378+0000", 2024-04-18T14:44:10.536 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000291897 2024-04-18T14:44:10.536 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:10.536 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:10.536 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-04-18T14:44:10.536 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:36.785621+0000", 2024-04-18T14:44:10.536 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0072427749999999999 2024-04-18T14:44:10.536 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:44:10.537 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-04-18T14:44:10.537 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:44:10.537 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:10.537 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:10.537 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(client.4559.0:199 3.4s0 3:253cfff6:::smithi13430248-31:2 [read 0~507904,checksum] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37)", 2024-04-18T14:44:10.537 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-04-18T14:43:36.778006+0000", 2024-04-18T14:44:10.537 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 33.751531139000001, 2024-04-18T14:44:10.537 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0092398740000000004, 2024-04-18T14:44:10.537 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-04-18T14:44:10.537 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "started", 2024-04-18T14:44:10.537 INFO:teuthology.orchestra.run.smithi119.stdout: "client_info": { 2024-04-18T14:44:10.537 INFO:teuthology.orchestra.run.smithi119.stdout: "client": "client.4559", 2024-04-18T14:44:10.537 INFO:teuthology.orchestra.run.smithi119.stdout: "client_addr": "172.21.15.134:0/3113589487", 2024-04-18T14:44:10.537 INFO:teuthology.orchestra.run.smithi119.stdout: "tid": 199 2024-04-18T14:44:10.537 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:10.538 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-04-18T14:44:10.538 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:10.538 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-04-18T14:44:10.538 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:36.778006+0000", 2024-04-18T14:44:10.538 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:44:10.538 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:10.538 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:10.538 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-04-18T14:44:10.538 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:36.778006+0000", 2024-04-18T14:44:10.538 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:44:10.538 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:10.538 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:10.538 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-04-18T14:44:10.538 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:36.778005+0000", 2024-04-18T14:44:10.538 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4294967295.9999986 2024-04-18T14:44:10.539 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:10.539 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:10.539 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-04-18T14:44:10.539 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:36.778015+0000", 2024-04-18T14:44:10.539 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.0603e-05 2024-04-18T14:44:10.539 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:10.539 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:10.539 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-04-18T14:44:10.539 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:36.778452+0000", 2024-04-18T14:44:10.539 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00043702500000000001 2024-04-18T14:44:10.539 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:10.539 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:10.539 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-04-18T14:44:10.539 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:36.778487+0000", 2024-04-18T14:44:10.539 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.4610999999999998e-05 2024-04-18T14:44:10.540 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:10.540 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:10.540 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-04-18T14:44:10.540 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:36.779721+0000", 2024-04-18T14:44:10.540 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.001234076 2024-04-18T14:44:10.540 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:10.540 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:10.540 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-04-18T14:44:10.540 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:36.779994+0000", 2024-04-18T14:44:10.540 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00027332700000000002 2024-04-18T14:44:10.540 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:10.540 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:10.540 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-04-18T14:44:10.540 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:36.787246+0000", 2024-04-18T14:44:10.541 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0072518779999999998 2024-04-18T14:44:10.541 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:44:10.541 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-04-18T14:44:10.541 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:44:10.541 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:10.541 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:10.541 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(client.4559.0:200 3.4s0 3:253cfff6:::smithi13430248-31:2 [read 0~507904,checksum] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37)", 2024-04-18T14:44:10.541 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-04-18T14:43:36.778511+0000", 2024-04-18T14:44:10.541 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 33.751026058999997, 2024-04-18T14:44:10.541 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.009537841, 2024-04-18T14:44:10.541 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-04-18T14:44:10.541 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "started", 2024-04-18T14:44:10.541 INFO:teuthology.orchestra.run.smithi119.stdout: "client_info": { 2024-04-18T14:44:10.541 INFO:teuthology.orchestra.run.smithi119.stdout: "client": "client.4559", 2024-04-18T14:44:10.541 INFO:teuthology.orchestra.run.smithi119.stdout: "client_addr": "172.21.15.134:0/3113589487", 2024-04-18T14:44:10.542 INFO:teuthology.orchestra.run.smithi119.stdout: "tid": 200 2024-04-18T14:44:10.542 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:10.542 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-04-18T14:44:10.542 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:10.542 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-04-18T14:44:10.542 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:36.778511+0000", 2024-04-18T14:44:10.542 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:44:10.542 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:10.542 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:10.542 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-04-18T14:44:10.542 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:36.778511+0000", 2024-04-18T14:44:10.542 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:44:10.542 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:10.542 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:10.542 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-04-18T14:44:10.543 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:36.778509+0000", 2024-04-18T14:44:10.543 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4294967295.9999981 2024-04-18T14:44:10.543 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:10.543 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:10.543 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-04-18T14:44:10.543 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:36.778522+0000", 2024-04-18T14:44:10.543 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.2167000000000001e-05 2024-04-18T14:44:10.543 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:10.543 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:10.543 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-04-18T14:44:10.543 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:36.778542+0000", 2024-04-18T14:44:10.543 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.9996999999999998e-05 2024-04-18T14:44:10.543 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:10.543 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:10.543 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-04-18T14:44:10.544 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:36.778555+0000", 2024-04-18T14:44:10.544 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.3176999999999999e-05 2024-04-18T14:44:10.544 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:10.544 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:10.544 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-04-18T14:44:10.544 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:36.782090+0000", 2024-04-18T14:44:10.544 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0035351499999999999 2024-04-18T14:44:10.544 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:10.544 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:10.544 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-04-18T14:44:10.544 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:36.782278+0000", 2024-04-18T14:44:10.544 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00018805100000000001 2024-04-18T14:44:10.544 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:10.544 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:10.545 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-04-18T14:44:10.545 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:36.788049+0000", 2024-04-18T14:44:10.545 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0057712290000000001 2024-04-18T14:44:10.545 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:44:10.545 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-04-18T14:44:10.545 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:44:10.545 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:10.545 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:10.545 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(osd.14.21:5 3.4s0 3:253cfff6:::smithi13430248-31:head [assert-version v2,copy-get max 8388608] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-04-18T14:44:10.545 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-04-18T14:43:40.761159+0000", 2024-04-18T14:44:10.545 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 29.768378300999998, 2024-04-18T14:44:10.545 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.018141377, 2024-04-18T14:44:10.545 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-04-18T14:44:10.545 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "started", 2024-04-18T14:44:10.545 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-04-18T14:44:10.546 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:10.546 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-04-18T14:44:10.546 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:40.761159+0000", 2024-04-18T14:44:10.546 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:44:10.546 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:10.546 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:10.546 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-04-18T14:44:10.546 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:40.761159+0000", 2024-04-18T14:44:10.546 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:44:10.546 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:10.546 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:10.546 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-04-18T14:44:10.546 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:40.761154+0000", 2024-04-18T14:44:10.546 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4294967295.9999952 2024-04-18T14:44:10.546 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:10.547 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:10.547 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-04-18T14:44:10.547 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:40.761176+0000", 2024-04-18T14:44:10.547 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.1684000000000001e-05 2024-04-18T14:44:10.547 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:10.547 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:10.547 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-04-18T14:44:10.547 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:40.761228+0000", 2024-04-18T14:44:10.547 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 5.2130999999999999e-05 2024-04-18T14:44:10.547 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:10.547 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:10.547 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-04-18T14:44:10.547 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:40.761253+0000", 2024-04-18T14:44:10.547 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.4624e-05 2024-04-18T14:44:10.549 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:10.549 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:10.549 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-04-18T14:44:10.550 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:40.761416+0000", 2024-04-18T14:44:10.550 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000162993 2024-04-18T14:44:10.550 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:10.550 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:10.550 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "op must wait for map", 2024-04-18T14:44:10.550 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:40.761441+0000", 2024-04-18T14:44:10.550 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.4814e-05 2024-04-18T14:44:10.550 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:10.550 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:10.550 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-04-18T14:44:10.550 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:40.768188+0000", 2024-04-18T14:44:10.550 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0067475540000000002 2024-04-18T14:44:10.550 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:10.550 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:10.550 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-04-18T14:44:10.551 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:40.768430+0000", 2024-04-18T14:44:10.551 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000241969 2024-04-18T14:44:10.551 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:10.551 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:10.551 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-04-18T14:44:10.551 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:40.779300+0000", 2024-04-18T14:44:10.551 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.010870434999999999 2024-04-18T14:44:10.551 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:44:10.551 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-04-18T14:44:10.551 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:44:10.551 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:10.551 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:10.551 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "MOSDECSubOpWrite(3.cs1 41/30 ECSubWrite(tid=46, reqid=osd.11.0:46, at_version=41'24, trim_to=0'0, roll_forward_to=39'20))", 2024-04-18T14:44:10.551 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-04-18T14:43:40.765734+0000", 2024-04-18T14:44:10.551 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 29.763803789000001, 2024-04-18T14:44:10.552 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.01275631, 2024-04-18T14:44:10.552 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-04-18T14:44:10.552 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "reached pg", 2024-04-18T14:44:10.552 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-04-18T14:44:10.552 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:10.552 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-04-18T14:44:10.552 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:40.765734+0000", 2024-04-18T14:44:10.552 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:44:10.552 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:10.552 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:10.552 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-04-18T14:44:10.552 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:40.765734+0000", 2024-04-18T14:44:10.552 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:44:10.552 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:10.552 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:10.553 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-04-18T14:44:10.553 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:40.765733+0000", 2024-04-18T14:44:10.553 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4294967295.999999 2024-04-18T14:44:10.553 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:10.553 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:10.553 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-04-18T14:44:10.553 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:40.765777+0000", 2024-04-18T14:44:10.553 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4.4790999999999999e-05 2024-04-18T14:44:10.553 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:10.553 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:10.553 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-04-18T14:44:10.553 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:40.765799+0000", 2024-04-18T14:44:10.553 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.1891000000000001e-05 2024-04-18T14:44:10.553 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:10.553 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:10.553 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-04-18T14:44:10.554 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:40.765817+0000", 2024-04-18T14:44:10.554 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.7863000000000002e-05 2024-04-18T14:44:10.554 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:10.554 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:10.554 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-04-18T14:44:10.554 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:40.766689+0000", 2024-04-18T14:44:10.554 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00087157000000000001 2024-04-18T14:44:10.554 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:10.554 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:10.554 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_started", 2024-04-18T14:44:10.554 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:40.766712+0000", 2024-04-18T14:44:10.554 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.3609999999999999e-05 2024-04-18T14:44:10.554 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:10.554 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:10.555 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_committed", 2024-04-18T14:44:10.555 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:40.778433+0000", 2024-04-18T14:44:10.555 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.011720774 2024-04-18T14:44:10.555 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:10.555 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:10.555 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-04-18T14:44:10.555 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:40.778490+0000", 2024-04-18T14:44:10.555 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 5.6845000000000002e-05 2024-04-18T14:44:10.555 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:44:10.555 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-04-18T14:44:10.555 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:44:10.555 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:10.555 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:10.555 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "MOSDECSubOpWrite(3.8s1 41/30 ECSubWrite(tid=35, reqid=client.4559.0:250, at_version=41'18, trim_to=0'0, roll_forward_to=38'16))", 2024-04-18T14:44:10.555 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-04-18T14:43:40.768038+0000", 2024-04-18T14:44:10.556 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 29.761499088000001, 2024-04-18T14:44:10.556 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0093087900000000008, 2024-04-18T14:44:10.556 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-04-18T14:44:10.556 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "reached pg", 2024-04-18T14:44:10.556 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-04-18T14:44:10.556 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:10.556 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-04-18T14:44:10.556 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:40.768038+0000", 2024-04-18T14:44:10.556 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:44:10.556 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:10.556 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:10.556 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-04-18T14:44:10.556 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:40.768038+0000", 2024-04-18T14:44:10.556 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:44:10.557 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:10.557 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:10.557 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-04-18T14:44:10.557 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:40.768038+0000", 2024-04-18T14:44:10.557 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4294967295.999999 2024-04-18T14:44:10.557 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:10.557 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:10.557 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-04-18T14:44:10.557 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:40.768094+0000", 2024-04-18T14:44:10.557 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 5.6161e-05 2024-04-18T14:44:10.557 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:10.557 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:10.557 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-04-18T14:44:10.557 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:40.768123+0000", 2024-04-18T14:44:10.558 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.8773999999999999e-05 2024-04-18T14:44:10.558 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:10.558 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:10.558 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-04-18T14:44:10.558 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:40.768142+0000", 2024-04-18T14:44:10.558 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.9766999999999999e-05 2024-04-18T14:44:10.558 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:10.558 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:10.558 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-04-18T14:44:10.558 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:40.768269+0000", 2024-04-18T14:44:10.558 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000126873 2024-04-18T14:44:10.558 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:10.558 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:10.558 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_started", 2024-04-18T14:44:10.558 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:40.768293+0000", 2024-04-18T14:44:10.559 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.4063999999999999e-05 2024-04-18T14:44:10.559 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:10.559 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:10.559 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_committed", 2024-04-18T14:44:10.559 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:40.777286+0000", 2024-04-18T14:44:10.559 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0089925600000000001 2024-04-18T14:44:10.559 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:10.559 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:10.559 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-04-18T14:44:10.559 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:40.777347+0000", 2024-04-18T14:44:10.559 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 6.1323999999999998e-05 2024-04-18T14:44:10.559 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:44:10.559 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-04-18T14:44:10.559 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:44:10.559 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:10.560 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:10.560 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "MOSDECSubOpReadReply(3.4s0 41/30 ECSubReadReply(tid=22, attrs_read=0))", 2024-04-18T14:44:10.560 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-04-18T14:43:40.770441+0000", 2024-04-18T14:44:10.560 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 29.759096590999999, 2024-04-18T14:44:10.560 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0080556589999999997, 2024-04-18T14:44:10.560 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-04-18T14:44:10.560 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "reached pg", 2024-04-18T14:44:10.560 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-04-18T14:44:10.560 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:10.560 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-04-18T14:44:10.560 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:40.770441+0000", 2024-04-18T14:44:10.560 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:44:10.560 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:10.560 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:10.560 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-04-18T14:44:10.560 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:40.770441+0000", 2024-04-18T14:44:10.561 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:44:10.561 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:10.561 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:10.561 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-04-18T14:44:10.561 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:40.770440+0000", 2024-04-18T14:44:10.561 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4294967295.9999986 2024-04-18T14:44:10.561 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:10.561 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:10.561 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-04-18T14:44:10.561 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:40.770735+0000", 2024-04-18T14:44:10.561 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00029500700000000002 2024-04-18T14:44:10.561 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:10.561 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:10.561 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-04-18T14:44:10.561 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:40.770757+0000", 2024-04-18T14:44:10.562 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.268e-05 2024-04-18T14:44:10.562 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:10.562 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:10.562 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-04-18T14:44:10.562 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:40.770774+0000", 2024-04-18T14:44:10.562 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.6390999999999999e-05 2024-04-18T14:44:10.562 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:10.562 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:10.562 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-04-18T14:44:10.562 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:40.778318+0000", 2024-04-18T14:44:10.562 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.007544345 2024-04-18T14:44:10.562 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:10.562 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:10.563 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-04-18T14:44:10.563 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:40.778496+0000", 2024-04-18T14:44:10.563 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00017851999999999999 2024-04-18T14:44:10.563 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:44:10.563 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-04-18T14:44:10.563 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:44:10.563 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:10.563 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:10.563 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(client.4559.0:322 3.4s0 3:253cfff6:::smithi13430248-31:head [append 0~0] snapc d=[b,a,8,7,2] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-04-18T14:44:10.563 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-04-18T14:43:45.374943+0000", 2024-04-18T14:44:10.563 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 25.154594710000001, 2024-04-18T14:44:10.563 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.016060366, 2024-04-18T14:44:10.563 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-04-18T14:44:10.563 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T14:44:10.563 INFO:teuthology.orchestra.run.smithi119.stdout: "client_info": { 2024-04-18T14:44:10.564 INFO:teuthology.orchestra.run.smithi119.stdout: "client": "client.4559", 2024-04-18T14:44:10.564 INFO:teuthology.orchestra.run.smithi119.stdout: "client_addr": "172.21.15.134:0/3113589487", 2024-04-18T14:44:10.564 INFO:teuthology.orchestra.run.smithi119.stdout: "tid": 322 2024-04-18T14:44:10.564 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:10.564 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-04-18T14:44:10.564 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:10.564 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-04-18T14:44:10.564 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:45.374943+0000", 2024-04-18T14:44:10.564 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:44:10.564 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:10.564 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:10.564 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-04-18T14:44:10.565 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:45.374943+0000", 2024-04-18T14:44:10.565 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:44:10.565 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:10.565 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:10.565 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-04-18T14:44:10.565 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:45.374939+0000", 2024-04-18T14:44:10.565 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4294967295.9999962 2024-04-18T14:44:10.565 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:10.565 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:10.565 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-04-18T14:44:10.565 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:45.374958+0000", 2024-04-18T14:44:10.565 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.9037000000000001e-05 2024-04-18T14:44:10.565 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:10.565 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:10.565 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-04-18T14:44:10.566 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:45.375005+0000", 2024-04-18T14:44:10.566 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4.6733999999999997e-05 2024-04-18T14:44:10.566 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:10.566 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:10.566 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-04-18T14:44:10.566 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:45.375036+0000", 2024-04-18T14:44:10.566 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.1414000000000001e-05 2024-04-18T14:44:10.566 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:10.566 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:10.566 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-04-18T14:44:10.567 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:45.375147+0000", 2024-04-18T14:44:10.567 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000111199 2024-04-18T14:44:10.567 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:10.567 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:10.567 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "op must wait for map", 2024-04-18T14:44:10.567 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:45.375157+0000", 2024-04-18T14:44:10.567 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 9.5289999999999997e-06 2024-04-18T14:44:10.567 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:10.567 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:10.567 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-04-18T14:44:10.567 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:45.377821+0000", 2024-04-18T14:44:10.567 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0026638769999999998 2024-04-18T14:44:10.568 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:10.568 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:10.568 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-04-18T14:44:10.568 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:45.378116+0000", 2024-04-18T14:44:10.568 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00029550799999999999 2024-04-18T14:44:10.568 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:10.568 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:10.568 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_started", 2024-04-18T14:44:10.568 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:45.380261+0000", 2024-04-18T14:44:10.568 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0021443550000000001 2024-04-18T14:44:10.568 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:10.568 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:10.568 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_committed", 2024-04-18T14:44:10.568 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:45.382507+0000", 2024-04-18T14:44:10.568 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0022458669999999999 2024-04-18T14:44:10.569 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:10.569 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:10.569 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-04-18T14:44:10.569 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:45.390928+0000", 2024-04-18T14:44:10.569 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0084211870000000001 2024-04-18T14:44:10.569 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:10.569 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:10.569 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-04-18T14:44:10.569 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:45.391003+0000", 2024-04-18T14:44:10.569 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 7.5296000000000006e-05 2024-04-18T14:44:10.569 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:44:10.569 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-04-18T14:44:10.569 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:44:10.569 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:10.569 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:10.570 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(client.4559.0:323 3.4s0 3:253cfff6:::smithi13430248-31:head [rollback a] snapc d=[b,a,8,7,2] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-04-18T14:44:10.571 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-04-18T14:43:45.375072+0000", 2024-04-18T14:44:10.571 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 25.154465335000001, 2024-04-18T14:44:10.571 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.017411607999999999, 2024-04-18T14:44:10.571 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-04-18T14:44:10.571 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T14:44:10.571 INFO:teuthology.orchestra.run.smithi119.stdout: "client_info": { 2024-04-18T14:44:10.571 INFO:teuthology.orchestra.run.smithi119.stdout: "client": "client.4559", 2024-04-18T14:44:10.571 INFO:teuthology.orchestra.run.smithi119.stdout: "client_addr": "172.21.15.134:0/3113589487", 2024-04-18T14:44:10.571 INFO:teuthology.orchestra.run.smithi119.stdout: "tid": 323 2024-04-18T14:44:10.571 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:10.571 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-04-18T14:44:10.571 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:10.571 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-04-18T14:44:10.572 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:45.375072+0000", 2024-04-18T14:44:10.572 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:44:10.572 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:10.572 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:10.572 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-04-18T14:44:10.572 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:45.375072+0000", 2024-04-18T14:44:10.572 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:44:10.572 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:10.572 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:10.572 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-04-18T14:44:10.572 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:45.375071+0000", 2024-04-18T14:44:10.572 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4294967295.9999986 2024-04-18T14:44:10.572 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:10.572 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:10.572 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-04-18T14:44:10.573 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:45.375079+0000", 2024-04-18T14:44:10.573 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 8.6470000000000004e-06 2024-04-18T14:44:10.573 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:10.573 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:10.573 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-04-18T14:44:10.573 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:45.375100+0000", 2024-04-18T14:44:10.573 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.0421e-05 2024-04-18T14:44:10.573 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:10.573 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:10.573 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-04-18T14:44:10.573 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:45.375109+0000", 2024-04-18T14:44:10.573 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 8.9770000000000006e-06 2024-04-18T14:44:10.573 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:10.573 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:10.573 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-04-18T14:44:10.574 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:45.375223+0000", 2024-04-18T14:44:10.574 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000114269 2024-04-18T14:44:10.574 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:10.574 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:10.574 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting_for_map not empty", 2024-04-18T14:44:10.574 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:45.375229+0000", 2024-04-18T14:44:10.574 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 6.1890000000000004e-06 2024-04-18T14:44:10.574 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:10.574 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:10.574 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-04-18T14:44:10.574 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:45.381020+0000", 2024-04-18T14:44:10.574 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0057905040000000001 2024-04-18T14:44:10.574 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:10.574 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:10.575 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-04-18T14:44:10.575 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:45.381093+0000", 2024-04-18T14:44:10.575 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 7.2962999999999999e-05 2024-04-18T14:44:10.575 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:10.575 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:10.575 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_started", 2024-04-18T14:44:10.575 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:45.381554+0000", 2024-04-18T14:44:10.575 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00046082499999999999 2024-04-18T14:44:10.575 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:10.575 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:10.575 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_committed", 2024-04-18T14:44:10.575 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:45.382509+0000", 2024-04-18T14:44:10.575 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00095550799999999999 2024-04-18T14:44:10.575 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:10.575 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:10.576 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-04-18T14:44:10.576 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:45.392417+0000", 2024-04-18T14:44:10.576 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0099082270000000004 2024-04-18T14:44:10.576 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:10.576 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:10.576 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-04-18T14:44:10.576 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:45.392484+0000", 2024-04-18T14:44:10.576 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 6.6445000000000005e-05 2024-04-18T14:44:10.576 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:44:10.576 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-04-18T14:44:10.576 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:44:10.576 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:10.576 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:10.576 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(client.4559.0:324 3.4s0 3:253cfff6:::smithi13430248-31:head [append 0~0] snapc d=[b,a,8,7,2] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-04-18T14:44:10.576 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-04-18T14:43:45.375117+0000", 2024-04-18T14:44:10.577 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 25.154420514000002, 2024-04-18T14:44:10.577 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.017657787000000001, 2024-04-18T14:44:10.577 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-04-18T14:44:10.577 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T14:44:10.577 INFO:teuthology.orchestra.run.smithi119.stdout: "client_info": { 2024-04-18T14:44:10.577 INFO:teuthology.orchestra.run.smithi119.stdout: "client": "client.4559", 2024-04-18T14:44:10.577 INFO:teuthology.orchestra.run.smithi119.stdout: "client_addr": "172.21.15.134:0/3113589487", 2024-04-18T14:44:10.577 INFO:teuthology.orchestra.run.smithi119.stdout: "tid": 324 2024-04-18T14:44:10.577 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:10.577 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-04-18T14:44:10.577 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:10.577 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-04-18T14:44:10.577 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:45.375117+0000", 2024-04-18T14:44:10.577 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:44:10.577 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:10.577 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:10.578 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-04-18T14:44:10.578 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:45.375117+0000", 2024-04-18T14:44:10.578 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:44:10.578 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:10.578 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:10.578 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-04-18T14:44:10.578 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:45.375116+0000", 2024-04-18T14:44:10.578 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4294967295.999999 2024-04-18T14:44:10.578 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:10.578 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:10.578 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-04-18T14:44:10.578 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:45.375122+0000", 2024-04-18T14:44:10.578 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 5.8270000000000003e-06 2024-04-18T14:44:10.578 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:10.579 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:10.579 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-04-18T14:44:10.579 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:45.375135+0000", 2024-04-18T14:44:10.579 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.3373000000000001e-05 2024-04-18T14:44:10.579 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:10.579 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:10.579 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-04-18T14:44:10.579 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:45.375143+0000", 2024-04-18T14:44:10.579 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 7.5739999999999998e-06 2024-04-18T14:44:10.579 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:10.579 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:10.579 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-04-18T14:44:10.579 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:45.375251+0000", 2024-04-18T14:44:10.579 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00010815999999999999 2024-04-18T14:44:10.579 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:10.579 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:10.580 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting_for_map not empty", 2024-04-18T14:44:10.580 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:45.375255+0000", 2024-04-18T14:44:10.580 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.9369999999999997e-06 2024-04-18T14:44:10.580 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:10.580 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:10.580 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-04-18T14:44:10.580 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:45.381914+0000", 2024-04-18T14:44:10.580 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.006658537 2024-04-18T14:44:10.580 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:10.580 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:10.580 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-04-18T14:44:10.581 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:45.381977+0000", 2024-04-18T14:44:10.581 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 6.3929000000000004e-05 2024-04-18T14:44:10.581 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:10.581 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:10.581 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_started", 2024-04-18T14:44:10.581 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:45.382319+0000", 2024-04-18T14:44:10.581 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000341365 2024-04-18T14:44:10.581 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:10.581 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:10.581 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_committed", 2024-04-18T14:44:10.581 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:45.383423+0000", 2024-04-18T14:44:10.581 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.001104584 2024-04-18T14:44:10.581 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:10.581 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:10.582 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-04-18T14:44:10.582 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:45.392699+0000", 2024-04-18T14:44:10.582 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0092753390000000005 2024-04-18T14:44:10.582 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:10.582 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:10.582 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-04-18T14:44:10.582 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:45.392775+0000", 2024-04-18T14:44:10.582 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 7.5899e-05 2024-04-18T14:44:10.582 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:44:10.583 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-04-18T14:44:10.583 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:44:10.583 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:10.583 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:10.583 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "MOSDECSubOpWrite(3.ds4 50/30 ECSubWrite(tid=12, reqid=osd.7.0:12, at_version=50'11, trim_to=0'0, roll_forward_to=49'9))", 2024-04-18T14:44:10.583 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-04-18T14:43:49.406573+0000", 2024-04-18T14:44:10.583 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 21.122964211999999, 2024-04-18T14:44:10.583 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0085566119999999999, 2024-04-18T14:44:10.583 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-04-18T14:44:10.583 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "reached pg", 2024-04-18T14:44:10.583 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-04-18T14:44:10.583 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:10.583 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-04-18T14:44:10.583 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:49.406573+0000", 2024-04-18T14:44:10.583 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:44:10.584 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:10.584 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:10.584 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-04-18T14:44:10.584 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:49.406573+0000", 2024-04-18T14:44:10.584 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:44:10.584 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:10.584 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:10.584 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-04-18T14:44:10.584 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:49.406573+0000", 2024-04-18T14:44:10.584 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4294967295.9999995 2024-04-18T14:44:10.584 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:10.584 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:10.584 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-04-18T14:44:10.584 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:49.406630+0000", 2024-04-18T14:44:10.584 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 5.6971000000000001e-05 2024-04-18T14:44:10.585 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:10.585 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:10.585 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-04-18T14:44:10.585 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:49.406656+0000", 2024-04-18T14:44:10.585 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.6750999999999998e-05 2024-04-18T14:44:10.585 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:10.585 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:10.585 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-04-18T14:44:10.585 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:49.406678+0000", 2024-04-18T14:44:10.585 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.1583e-05 2024-04-18T14:44:10.585 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:10.585 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:10.585 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-04-18T14:44:10.585 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:49.406940+0000", 2024-04-18T14:44:10.585 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00026161100000000003 2024-04-18T14:44:10.586 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:10.586 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:10.586 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_started", 2024-04-18T14:44:10.586 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:49.406966+0000", 2024-04-18T14:44:10.586 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.6716999999999998e-05 2024-04-18T14:44:10.586 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:10.586 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:10.586 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_committed", 2024-04-18T14:44:10.586 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:49.415081+0000", 2024-04-18T14:44:10.586 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0081149789999999996 2024-04-18T14:44:10.586 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:10.586 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:10.587 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-04-18T14:44:10.587 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:49.415130+0000", 2024-04-18T14:44:10.587 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4.8497e-05 2024-04-18T14:44:10.588 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:44:10.588 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-04-18T14:44:10.588 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:44:10.588 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:10.588 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:10.588 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "MOSDECSubOpWrite(3.8s1 50/30 ECSubWrite(tid=63, reqid=osd.5.0:63, at_version=50'48, trim_to=0'0, roll_forward_to=48'46))", 2024-04-18T14:44:10.588 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-04-18T14:43:49.409112+0000", 2024-04-18T14:44:10.588 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 21.120425311999998, 2024-04-18T14:44:10.588 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0083014449999999993, 2024-04-18T14:44:10.588 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-04-18T14:44:10.588 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "reached pg", 2024-04-18T14:44:10.588 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-04-18T14:44:10.588 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:10.588 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-04-18T14:44:10.588 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:49.409112+0000", 2024-04-18T14:44:10.588 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:44:10.589 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:10.589 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:10.589 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-04-18T14:44:10.589 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:49.409112+0000", 2024-04-18T14:44:10.589 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:44:10.589 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:10.589 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:10.589 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-04-18T14:44:10.589 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:49.409111+0000", 2024-04-18T14:44:10.589 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4294967295.999999 2024-04-18T14:44:10.589 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:10.589 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:10.589 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-04-18T14:44:10.589 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:49.409165+0000", 2024-04-18T14:44:10.589 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 5.3467999999999997e-05 2024-04-18T14:44:10.590 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:10.590 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:10.590 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-04-18T14:44:10.590 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:49.409190+0000", 2024-04-18T14:44:10.590 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.5873000000000001e-05 2024-04-18T14:44:10.590 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:10.590 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:10.590 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-04-18T14:44:10.590 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:49.409209+0000", 2024-04-18T14:44:10.590 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.8689999999999999e-05 2024-04-18T14:44:10.590 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:10.590 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:10.590 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-04-18T14:44:10.590 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:49.409354+0000", 2024-04-18T14:44:10.591 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00014432599999999999 2024-04-18T14:44:10.591 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:10.591 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:10.591 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_started", 2024-04-18T14:44:10.591 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:49.409379+0000", 2024-04-18T14:44:10.591 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.5857e-05 2024-04-18T14:44:10.591 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:10.591 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:10.591 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_committed", 2024-04-18T14:44:10.591 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:49.417289+0000", 2024-04-18T14:44:10.591 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0079097490000000006 2024-04-18T14:44:10.591 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:10.591 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:10.591 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-04-18T14:44:10.591 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:49.417414+0000", 2024-04-18T14:44:10.592 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00012442900000000001 2024-04-18T14:44:10.592 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:44:10.592 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-04-18T14:44:10.592 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:44:10.592 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:10.592 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:10.592 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "MOSDECSubOpWrite(3.cs1 51/30 ECSubWrite(tid=72, reqid=client.4559.0:380, at_version=51'32, trim_to=0'0, roll_forward_to=44'30))", 2024-04-18T14:44:10.592 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-04-18T14:43:50.419592+0000", 2024-04-18T14:44:10.592 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 20.109945375999999, 2024-04-18T14:44:10.592 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0088576639999999995, 2024-04-18T14:44:10.592 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-04-18T14:44:10.592 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "reached pg", 2024-04-18T14:44:10.592 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-04-18T14:44:10.592 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:10.592 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-04-18T14:44:10.593 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:50.419592+0000", 2024-04-18T14:44:10.593 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:44:10.593 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:10.593 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:10.593 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-04-18T14:44:10.593 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:50.419592+0000", 2024-04-18T14:44:10.593 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:44:10.593 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:10.593 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:10.593 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-04-18T14:44:10.593 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:50.419591+0000", 2024-04-18T14:44:10.593 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4294967295.999999 2024-04-18T14:44:10.593 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:10.593 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:10.593 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-04-18T14:44:10.594 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:50.420496+0000", 2024-04-18T14:44:10.594 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00090420699999999997 2024-04-18T14:44:10.594 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:10.594 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:10.594 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-04-18T14:44:10.594 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:50.420520+0000", 2024-04-18T14:44:10.594 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.4134999999999998e-05 2024-04-18T14:44:10.594 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:10.594 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:10.594 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-04-18T14:44:10.594 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:50.420536+0000", 2024-04-18T14:44:10.594 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.649e-05 2024-04-18T14:44:10.594 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:10.594 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:10.595 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-04-18T14:44:10.595 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:50.420668+0000", 2024-04-18T14:44:10.595 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000131989 2024-04-18T14:44:10.595 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:10.595 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:10.595 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_started", 2024-04-18T14:44:10.595 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:50.420694+0000", 2024-04-18T14:44:10.595 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.5449999999999999e-05 2024-04-18T14:44:10.595 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:10.595 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:10.595 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_committed", 2024-04-18T14:44:10.595 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:50.428370+0000", 2024-04-18T14:44:10.595 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0076765490000000004 2024-04-18T14:44:10.595 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:10.595 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:10.595 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-04-18T14:44:10.596 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:50.428450+0000", 2024-04-18T14:44:10.596 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 7.9567999999999994e-05 2024-04-18T14:44:10.596 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:44:10.596 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-04-18T14:44:10.596 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:44:10.596 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:10.596 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:10.596 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(client.4559.0:500 3.bs0 3:dcadfff4:::smithi13430248-18:head [copy-from ver 46] snapc 19=[19,16,14,13,11,f,b,a,7,2] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-18T14:44:10.596 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-04-18T14:43:56.549171+0000", 2024-04-18T14:44:10.596 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 13.980366868000001, 2024-04-18T14:44:10.596 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.029487076000000001, 2024-04-18T14:44:10.596 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-04-18T14:44:10.596 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T14:44:10.596 INFO:teuthology.orchestra.run.smithi119.stdout: "client_info": { 2024-04-18T14:44:10.596 INFO:teuthology.orchestra.run.smithi119.stdout: "client": "client.4559", 2024-04-18T14:44:10.597 INFO:teuthology.orchestra.run.smithi119.stdout: "client_addr": "172.21.15.134:0/3113589487", 2024-04-18T14:44:10.597 INFO:teuthology.orchestra.run.smithi119.stdout: "tid": 500 2024-04-18T14:44:10.597 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:10.597 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-04-18T14:44:10.597 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:10.597 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-04-18T14:44:10.597 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:56.549171+0000", 2024-04-18T14:44:10.597 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:44:10.597 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:10.597 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:10.597 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-04-18T14:44:10.597 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:56.549171+0000", 2024-04-18T14:44:10.597 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:44:10.597 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:10.597 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:10.597 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-04-18T14:44:10.598 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:56.549165+0000", 2024-04-18T14:44:10.598 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4294967295.9999948 2024-04-18T14:44:10.598 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:10.598 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:10.598 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-04-18T14:44:10.598 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:56.549189+0000", 2024-04-18T14:44:10.598 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.3450000000000001e-05 2024-04-18T14:44:10.598 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:10.598 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:10.598 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-04-18T14:44:10.598 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:56.549237+0000", 2024-04-18T14:44:10.598 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4.7843999999999998e-05 2024-04-18T14:44:10.598 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:10.598 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:10.599 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-04-18T14:44:10.599 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:56.549262+0000", 2024-04-18T14:44:10.599 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.5596999999999999e-05 2024-04-18T14:44:10.599 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:10.599 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:10.599 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-04-18T14:44:10.599 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:56.549423+0000", 2024-04-18T14:44:10.599 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00016087799999999999 2024-04-18T14:44:10.599 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:10.599 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:10.599 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-04-18T14:44:10.599 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:56.549715+0000", 2024-04-18T14:44:10.599 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00029231599999999998 2024-04-18T14:44:10.599 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:10.599 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:10.600 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_started", 2024-04-18T14:44:10.600 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:56.571279+0000", 2024-04-18T14:44:10.600 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.021564102000000002 2024-04-18T14:44:10.600 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:10.600 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:10.600 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_committed", 2024-04-18T14:44:10.600 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:56.575627+0000", 2024-04-18T14:44:10.600 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0043473380000000001 2024-04-18T14:44:10.600 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:10.600 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:10.600 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-04-18T14:44:10.600 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:56.578450+0000", 2024-04-18T14:44:10.600 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0028231189999999998 2024-04-18T14:44:10.600 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:10.600 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:10.601 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-04-18T14:44:10.601 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:56.578658+0000", 2024-04-18T14:44:10.601 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000207715 2024-04-18T14:44:10.601 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:44:10.601 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-04-18T14:44:10.601 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:44:10.601 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:10.601 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:10.601 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(client.4559.0:501 3.bs0 3:dcadfff4:::smithi13430248-18:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e57)", 2024-04-18T14:44:10.601 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-04-18T14:43:56.549295+0000", 2024-04-18T14:44:10.601 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 13.980242713999999, 2024-04-18T14:44:10.601 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.025687614000000001, 2024-04-18T14:44:10.601 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-04-18T14:44:10.601 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "started", 2024-04-18T14:44:10.601 INFO:teuthology.orchestra.run.smithi119.stdout: "client_info": { 2024-04-18T14:44:10.602 INFO:teuthology.orchestra.run.smithi119.stdout: "client": "client.4559", 2024-04-18T14:44:10.602 INFO:teuthology.orchestra.run.smithi119.stdout: "client_addr": "172.21.15.134:0/3113589487", 2024-04-18T14:44:10.602 INFO:teuthology.orchestra.run.smithi119.stdout: "tid": 501 2024-04-18T14:44:10.602 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:10.602 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-04-18T14:44:10.602 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:10.602 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-04-18T14:44:10.602 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:56.549295+0000", 2024-04-18T14:44:10.602 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:44:10.602 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:10.602 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:10.602 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-04-18T14:44:10.602 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:56.549295+0000", 2024-04-18T14:44:10.602 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:44:10.602 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:10.602 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:10.603 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-04-18T14:44:10.603 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:56.549293+0000", 2024-04-18T14:44:10.603 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4294967295.9999981 2024-04-18T14:44:10.603 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:10.603 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:10.603 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-04-18T14:44:10.603 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:56.549304+0000", 2024-04-18T14:44:10.603 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.1324e-05 2024-04-18T14:44:10.603 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:10.603 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:10.603 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-04-18T14:44:10.603 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:56.549332+0000", 2024-04-18T14:44:10.603 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.7603999999999999e-05 2024-04-18T14:44:10.603 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:10.603 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:10.603 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-04-18T14:44:10.603 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:56.549353+0000", 2024-04-18T14:44:10.604 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.173e-05 2024-04-18T14:44:10.604 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:10.604 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:10.604 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-04-18T14:44:10.604 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:56.550446+0000", 2024-04-18T14:44:10.604 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0010926569999999999 2024-04-18T14:44:10.604 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:10.604 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:10.604 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for blocked object", 2024-04-18T14:44:10.604 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:56.550593+0000", 2024-04-18T14:44:10.604 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00014672599999999999 2024-04-18T14:44:10.604 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:10.604 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:10.604 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-04-18T14:44:10.604 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:56.574447+0000", 2024-04-18T14:44:10.604 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.023853863999999999 2024-04-18T14:44:10.605 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:10.605 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:10.605 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-04-18T14:44:10.605 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:56.574708+0000", 2024-04-18T14:44:10.605 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00026138300000000001 2024-04-18T14:44:10.605 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:10.605 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:10.605 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-04-18T14:44:10.605 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:56.574982+0000", 2024-04-18T14:44:10.605 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00027428899999999999 2024-04-18T14:44:10.605 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:44:10.605 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-04-18T14:44:10.605 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:44:10.605 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:10.605 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:10.605 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "MOSDECSubOpWrite(3.9s5 57/30 ECSubWrite(tid=90, reqid=client.4559.0:502, at_version=57'67, trim_to=0'0, roll_forward_to=57'66))", 2024-04-18T14:44:10.606 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-04-18T14:43:56.549995+0000", 2024-04-18T14:44:10.606 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 13.979542879, 2024-04-18T14:44:10.606 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0079871219999999993, 2024-04-18T14:44:10.606 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-04-18T14:44:10.606 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "reached pg", 2024-04-18T14:44:10.606 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-04-18T14:44:10.606 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:10.606 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-04-18T14:44:10.606 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:56.549995+0000", 2024-04-18T14:44:10.606 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:44:10.606 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:10.606 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:10.606 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-04-18T14:44:10.606 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:56.549995+0000", 2024-04-18T14:44:10.606 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:44:10.607 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:10.607 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:10.607 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-04-18T14:44:10.607 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:56.549992+0000", 2024-04-18T14:44:10.607 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4294967295.9999981 2024-04-18T14:44:10.607 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:10.607 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:10.607 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-04-18T14:44:10.607 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:56.550069+0000", 2024-04-18T14:44:10.607 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 7.6234000000000002e-05 2024-04-18T14:44:10.607 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:10.607 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:10.607 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-04-18T14:44:10.607 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:56.550117+0000", 2024-04-18T14:44:10.607 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4.7904000000000001e-05 2024-04-18T14:44:10.607 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:10.607 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:10.608 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-04-18T14:44:10.608 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:56.550139+0000", 2024-04-18T14:44:10.608 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.2277e-05 2024-04-18T14:44:10.608 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:10.608 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:10.608 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-04-18T14:44:10.608 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:56.550782+0000", 2024-04-18T14:44:10.608 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00064300700000000002 2024-04-18T14:44:10.608 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:10.608 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:10.608 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_started", 2024-04-18T14:44:10.608 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:56.550812+0000", 2024-04-18T14:44:10.608 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.0320000000000001e-05 2024-04-18T14:44:10.608 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:10.608 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:10.608 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_committed", 2024-04-18T14:44:10.608 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:56.557911+0000", 2024-04-18T14:44:10.609 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0070989390000000003 2024-04-18T14:44:10.609 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:10.609 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:10.609 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-04-18T14:44:10.609 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:56.557982+0000", 2024-04-18T14:44:10.609 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 7.0498000000000002e-05 2024-04-18T14:44:10.609 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:44:10.609 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-04-18T14:44:10.609 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:44:10.609 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:10.609 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:10.609 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(client.4559.0:506 3.bs0 3:db6a9fd1:::smithi13430248-42:head [create,setxattr ]WgaosmdfPPRdkpbZiadS^rbeOnh[]_]jP^NtiTR (383) in=40b,setxattr rr_tfPaVagsbWoabVljS`TbNsrcdd^kfftlmOUTg (455) in=40b,setxattr ZZ\\PVbSthoccpfTRqjm_WRdUe^mjcbPhoPd`hg\\d (699) in=40b,setxattr fO`_i`TUW\\OSfPnobUih\\fNj (6244) in=24b,setxattr NbYkVrYnWsYhr[aR`tnVTbqlgVPlg_ai]X_V[sWc (8349) in=40b,setxattr YVaet_f\\dtPtX\\iXW\\YgVNR^_sTamhYYo_lbfq[Q (35) in=40b,setxattr ZmbV_Vl]nmo[mgos]bo]Xoh`biiicdThkUnTX^`o (769) in=40b,setxattr pNoht[c[krcdUQXcj^`RUQfrp[e]Z[ZXVXocfj]r (1156) in=40b,setxattr Z`YRf\\U^dplamaajt[SdhXfa^NjT_PaYbPXmVs_s (593) in=40b,setxattr hmTgdjNcmPbo[Zs^e[k_Rj`_bXtbNaQtTSpaV^dP (69) in=40b,setxattr \\c_OftjQRst[kaadt\\hOYXR_tjSN`bsNYR_fhrmT (16348) in=40b,setxattr m]cQr]pmga]PhUVUVSkZiiThci^\\OrYSdooalsTq (874) in=40b,setxattr kdNZbsof^ijYePS\\bbNigT[h[b\\biV\\kZQphsRVn (13964) in=40b,setxattr aeR`f]aR`ldVPcc`qg[nSY`ccbdjYoqQQVUZ[gje (807) in=40b,setxattr Tp^ihY[RodorrTf_qc\\]ft[\\VdpZic[tctXgUl_\\ (1614) in=40b,setxattr WT_tigRbP_imYcfp_hsVX_NrhgY (6244) in=27b,setxattr dotZsNmriU^mgUnbegQZoXSUijPOrPkc][`pQhUn (13472) in=40b,setxattr eebjRTViesRkkqUShaff_l\\mgNl^p_`OaeZsNahT (1823) in=40b,setxattr ^tOrUaWgfdRN_oSrRt`ndbPan_smSOPYoRipZlnT (594) in=40b,setxattr km[SNefTfeS (6244) in=11b] snapc 19=[19,16,14,13,11,f,b,a,7,2] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-18T14:44:10.609 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-04-18T14:43:56.578294+0000", 2024-04-18T14:44:10.609 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 13.951243448, 2024-04-18T14:44:10.610 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0096219949999999995, 2024-04-18T14:44:10.610 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-04-18T14:44:10.610 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T14:44:10.610 INFO:teuthology.orchestra.run.smithi119.stdout: "client_info": { 2024-04-18T14:44:10.610 INFO:teuthology.orchestra.run.smithi119.stdout: "client": "client.4559", 2024-04-18T14:44:10.610 INFO:teuthology.orchestra.run.smithi119.stdout: "client_addr": "172.21.15.134:0/3113589487", 2024-04-18T14:44:10.610 INFO:teuthology.orchestra.run.smithi119.stdout: "tid": 506 2024-04-18T14:44:10.610 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:10.610 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-04-18T14:44:10.610 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:10.610 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-04-18T14:44:10.610 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:56.578294+0000", 2024-04-18T14:44:10.610 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:44:10.610 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:10.611 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:10.611 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-04-18T14:44:10.611 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:56.578294+0000", 2024-04-18T14:44:10.611 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:44:10.611 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:10.611 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:10.611 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-04-18T14:44:10.611 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:56.578290+0000", 2024-04-18T14:44:10.611 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4294967295.9999967 2024-04-18T14:44:10.611 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:10.611 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:10.611 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-04-18T14:44:10.611 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:56.578660+0000", 2024-04-18T14:44:10.611 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00036913400000000002 2024-04-18T14:44:10.611 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:10.612 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:10.612 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-04-18T14:44:10.612 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:56.578693+0000", 2024-04-18T14:44:10.612 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.3441000000000001e-05 2024-04-18T14:44:10.612 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:10.612 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:10.612 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-04-18T14:44:10.612 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:56.578714+0000", 2024-04-18T14:44:10.612 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.0516000000000001e-05 2024-04-18T14:44:10.612 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:10.612 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:10.612 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-04-18T14:44:10.612 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:56.579719+0000", 2024-04-18T14:44:10.612 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0010056970000000001 2024-04-18T14:44:10.612 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:10.613 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:10.613 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-04-18T14:44:10.613 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:56.580046+0000", 2024-04-18T14:44:10.613 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000326681 2024-04-18T14:44:10.613 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:10.613 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:10.613 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_started", 2024-04-18T14:44:10.613 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:56.582283+0000", 2024-04-18T14:44:10.613 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0022367289999999998 2024-04-18T14:44:10.613 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:10.613 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:10.613 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_committed", 2024-04-18T14:44:10.613 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:56.585591+0000", 2024-04-18T14:44:10.614 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0033080800000000001 2024-04-18T14:44:10.614 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:10.614 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:10.614 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-04-18T14:44:10.614 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:56.587623+0000", 2024-04-18T14:44:10.614 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0020325109999999999 2024-04-18T14:44:10.614 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:10.614 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:10.614 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-04-18T14:44:10.614 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:56.587916+0000", 2024-04-18T14:44:10.614 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00029271000000000001 2024-04-18T14:44:10.614 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:44:10.614 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-04-18T14:44:10.614 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:44:10.614 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:10.615 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:10.615 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "MOSDECSubOpWrite(3.9s5 67/30 ECSubWrite(tid=134, reqid=client.4559.0:644, at_version=67'107, trim_to=0'0, roll_forward_to=65'104))", 2024-04-18T14:44:10.615 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-04-18T14:44:06.401052+0000", 2024-04-18T14:44:10.615 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 4.1284855199999999, 2024-04-18T14:44:10.615 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.011023045, 2024-04-18T14:44:10.615 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-04-18T14:44:10.615 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "reached pg", 2024-04-18T14:44:10.615 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-04-18T14:44:10.615 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:10.615 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-04-18T14:44:10.615 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:06.401052+0000", 2024-04-18T14:44:10.615 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:44:10.615 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:10.615 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:10.615 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-04-18T14:44:10.615 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:06.401052+0000", 2024-04-18T14:44:10.616 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:44:10.616 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:10.616 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:10.616 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-04-18T14:44:10.616 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:06.401051+0000", 2024-04-18T14:44:10.616 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4294967295.999999 2024-04-18T14:44:10.616 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:10.616 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:10.616 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-04-18T14:44:10.616 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:06.401694+0000", 2024-04-18T14:44:10.616 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00064303899999999998 2024-04-18T14:44:10.616 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:10.616 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:10.616 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-04-18T14:44:10.616 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:06.401753+0000", 2024-04-18T14:44:10.616 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 5.9122000000000001e-05 2024-04-18T14:44:10.616 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:10.617 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:10.617 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-04-18T14:44:10.617 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:06.401776+0000", 2024-04-18T14:44:10.617 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.3407000000000001e-05 2024-04-18T14:44:10.617 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:10.617 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:10.617 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-04-18T14:44:10.617 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:06.401930+0000", 2024-04-18T14:44:10.617 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00015313499999999999 2024-04-18T14:44:10.617 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:10.617 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:10.617 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_started", 2024-04-18T14:44:10.617 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:06.401958+0000", 2024-04-18T14:44:10.617 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.887e-05 2024-04-18T14:44:10.617 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:10.617 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:10.617 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_committed", 2024-04-18T14:44:10.617 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:06.412022+0000", 2024-04-18T14:44:10.618 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.010063437 2024-04-18T14:44:10.618 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:10.618 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:10.618 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-04-18T14:44:10.618 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:06.412075+0000", 2024-04-18T14:44:10.618 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 5.3012e-05 2024-04-18T14:44:10.618 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:44:10.618 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-04-18T14:44:10.618 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:44:10.618 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:10.618 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:10.618 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "MOSDECSubOpWrite(3.9s5 67/30 ECSubWrite(tid=135, reqid=client.4559.0:645, at_version=67'108, trim_to=0'0, roll_forward_to=65'104))", 2024-04-18T14:44:10.618 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-04-18T14:44:06.405508+0000", 2024-04-18T14:44:10.618 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 4.1240293509999999, 2024-04-18T14:44:10.618 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0081427240000000005, 2024-04-18T14:44:10.618 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-04-18T14:44:10.619 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "reached pg", 2024-04-18T14:44:10.619 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-04-18T14:44:10.619 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:10.619 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-04-18T14:44:10.619 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:06.405508+0000", 2024-04-18T14:44:10.619 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:44:10.619 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:10.619 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:10.619 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-04-18T14:44:10.619 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:06.405508+0000", 2024-04-18T14:44:10.619 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:44:10.619 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:10.619 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:10.619 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-04-18T14:44:10.619 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:06.405506+0000", 2024-04-18T14:44:10.619 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4294967295.9999981 2024-04-18T14:44:10.620 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:10.620 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:10.620 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-04-18T14:44:10.620 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:06.405909+0000", 2024-04-18T14:44:10.620 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00040250699999999997 2024-04-18T14:44:10.620 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:10.620 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:10.620 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-04-18T14:44:10.620 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:06.405949+0000", 2024-04-18T14:44:10.620 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4.0309000000000003e-05 2024-04-18T14:44:10.620 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:10.620 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:10.620 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-04-18T14:44:10.620 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:06.405967+0000", 2024-04-18T14:44:10.620 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.8063e-05 2024-04-18T14:44:10.621 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:10.621 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:10.621 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-04-18T14:44:10.621 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:06.407462+0000", 2024-04-18T14:44:10.621 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.001494525 2024-04-18T14:44:10.621 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:10.621 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:10.621 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_started", 2024-04-18T14:44:10.621 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:06.407487+0000", 2024-04-18T14:44:10.621 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.5579999999999999e-05 2024-04-18T14:44:10.621 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:10.621 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:10.621 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_committed", 2024-04-18T14:44:10.621 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:06.413590+0000", 2024-04-18T14:44:10.621 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.006102817 2024-04-18T14:44:10.622 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:10.622 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:10.622 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-04-18T14:44:10.622 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:06.413651+0000", 2024-04-18T14:44:10.622 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 6.0866000000000003e-05 2024-04-18T14:44:10.622 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:44:10.622 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-04-18T14:44:10.622 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:44:10.622 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:44:10.622 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-04-18T14:44:10.622 INFO:teuthology.orchestra.run.smithi119.stdout:} 2024-04-18T14:44:10.624 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.14.asok dump_ops_in_flight 2024-04-18T14:44:10.624 INFO:tasks.ceph.osd.3.smithi134.stderr:2024-04-18T14:44:10.628+0000 7fe7a4443640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25211) UID: 0 2024-04-18T14:44:10.725 INFO:tasks.ceph.osd.4.smithi086.stderr:2024-04-18T14:44:10.722+0000 7f0c4c462640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 24956) UID: 0 2024-04-18T14:44:10.755 INFO:teuthology.orchestra.run.smithi119.stdout:{ 2024-04-18T14:44:10.756 INFO:teuthology.orchestra.run.smithi119.stdout: "ops": [], 2024-04-18T14:44:10.756 INFO:teuthology.orchestra.run.smithi119.stdout: "num_ops": 0 2024-04-18T14:44:10.756 INFO:teuthology.orchestra.run.smithi119.stdout:} 2024-04-18T14:44:10.770 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.14.asok dump_blocked_ops 2024-04-18T14:44:10.826 INFO:tasks.ceph.osd.9.smithi096.stderr:2024-04-18T14:44:10.821+0000 7fa2c1cbf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 9 (PID: 24891) UID: 0 2024-04-18T14:44:10.891 INFO:teuthology.orchestra.run.smithi119.stdout:{ 2024-04-18T14:44:10.891 INFO:teuthology.orchestra.run.smithi119.stdout: "ops": [], 2024-04-18T14:44:10.891 INFO:teuthology.orchestra.run.smithi119.stdout: "complaint_time": 30, 2024-04-18T14:44:10.891 INFO:teuthology.orchestra.run.smithi119.stdout: "num_blocked_ops": 0 2024-04-18T14:44:10.891 INFO:teuthology.orchestra.run.smithi119.stdout:} 2024-04-18T14:44:10.905 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.14.asok dump_historic_ops 2024-04-18T14:44:10.926 INFO:tasks.ceph.osd.8.smithi086.stderr:2024-04-18T14:44:10.926+0000 7f29f7b9d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 8 (PID: 24958) UID: 0 2024-04-18T14:44:11.027 INFO:tasks.ceph.osd.10.smithi119.stderr:2024-04-18T14:44:11.030+0000 7f6f24c12640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 10 (PID: 24898) UID: 0 2024-04-18T14:44:11.030 INFO:teuthology.orchestra.run.smithi119.stdout:{ 2024-04-18T14:44:11.030 INFO:teuthology.orchestra.run.smithi119.stdout: "size": 20, 2024-04-18T14:44:11.030 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 600, 2024-04-18T14:44:11.030 INFO:teuthology.orchestra.run.smithi119.stdout: "ops": [ 2024-04-18T14:44:11.030 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:11.031 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(client.4559.0:183 3.7s0 3:e3a0e00d:::smithi13430248-30:head [copy-from ver 12] snapc 4=[4,2] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-18T14:44:11.031 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-04-18T14:43:36.725584+0000", 2024-04-18T14:44:11.031 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 34.306986956000003, 2024-04-18T14:44:11.031 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.032002501000000003, 2024-04-18T14:44:11.031 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-04-18T14:44:11.031 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T14:44:11.031 INFO:teuthology.orchestra.run.smithi119.stdout: "client_info": { 2024-04-18T14:44:11.031 INFO:teuthology.orchestra.run.smithi119.stdout: "client": "client.4559", 2024-04-18T14:44:11.031 INFO:teuthology.orchestra.run.smithi119.stdout: "client_addr": "172.21.15.134:0/3113589487", 2024-04-18T14:44:11.031 INFO:teuthology.orchestra.run.smithi119.stdout: "tid": 183 2024-04-18T14:44:11.031 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:11.031 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-04-18T14:44:11.031 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:11.031 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-04-18T14:44:11.031 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:36.725584+0000", 2024-04-18T14:44:11.032 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:44:11.032 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:11.032 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:11.032 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-04-18T14:44:11.032 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:36.725584+0000", 2024-04-18T14:44:11.032 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:44:11.032 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:11.032 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:11.032 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-04-18T14:44:11.032 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:36.725582+0000", 2024-04-18T14:44:11.032 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4294967295.9999976 2024-04-18T14:44:11.032 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:11.032 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:11.032 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-04-18T14:44:11.032 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:36.725595+0000", 2024-04-18T14:44:11.033 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.325e-05 2024-04-18T14:44:11.033 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:11.033 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:11.033 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-04-18T14:44:11.033 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:36.725618+0000", 2024-04-18T14:44:11.033 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.2574000000000001e-05 2024-04-18T14:44:11.033 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:11.033 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:11.033 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-04-18T14:44:11.033 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:36.725633+0000", 2024-04-18T14:44:11.033 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.5197e-05 2024-04-18T14:44:11.033 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:11.033 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:11.033 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-04-18T14:44:11.033 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:36.725764+0000", 2024-04-18T14:44:11.034 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00013052300000000001 2024-04-18T14:44:11.034 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:11.034 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:11.034 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "op must wait for map", 2024-04-18T14:44:11.034 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:36.725784+0000", 2024-04-18T14:44:11.034 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.0111000000000001e-05 2024-04-18T14:44:11.034 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:11.034 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:11.034 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-04-18T14:44:11.034 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:36.731424+0000", 2024-04-18T14:44:11.034 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0056403479999999999 2024-04-18T14:44:11.034 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:11.034 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:11.034 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-04-18T14:44:11.035 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:36.731754+0000", 2024-04-18T14:44:11.035 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00032950200000000002 2024-04-18T14:44:11.035 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:11.035 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:11.035 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_started", 2024-04-18T14:44:11.035 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:36.748259+0000", 2024-04-18T14:44:11.035 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.016505701000000001 2024-04-18T14:44:11.035 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:11.035 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:11.035 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_committed", 2024-04-18T14:44:11.035 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:36.751859+0000", 2024-04-18T14:44:11.035 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.003599671 2024-04-18T14:44:11.035 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:11.035 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:11.035 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-04-18T14:44:11.035 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:36.757474+0000", 2024-04-18T14:44:11.036 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0056144810000000002 2024-04-18T14:44:11.036 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:11.036 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:11.036 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-04-18T14:44:11.036 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:36.757587+0000", 2024-04-18T14:44:11.036 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000113393 2024-04-18T14:44:11.036 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:44:11.036 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-04-18T14:44:11.036 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:44:11.036 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:11.036 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:11.036 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(client.4559.0:184 3.7s0 3:e3a0e00d:::smithi13430248-30:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e37)", 2024-04-18T14:44:11.036 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-04-18T14:43:36.725653+0000", 2024-04-18T14:44:11.036 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 34.306918475000003, 2024-04-18T14:44:11.036 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.025569002, 2024-04-18T14:44:11.037 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-04-18T14:44:11.037 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "started", 2024-04-18T14:44:11.037 INFO:teuthology.orchestra.run.smithi119.stdout: "client_info": { 2024-04-18T14:44:11.037 INFO:teuthology.orchestra.run.smithi119.stdout: "client": "client.4559", 2024-04-18T14:44:11.037 INFO:teuthology.orchestra.run.smithi119.stdout: "client_addr": "172.21.15.134:0/3113589487", 2024-04-18T14:44:11.037 INFO:teuthology.orchestra.run.smithi119.stdout: "tid": 184 2024-04-18T14:44:11.037 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:11.037 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-04-18T14:44:11.037 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:11.037 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-04-18T14:44:11.037 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:36.725653+0000", 2024-04-18T14:44:11.037 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:44:11.037 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:11.037 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:11.037 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-04-18T14:44:11.038 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:36.725653+0000", 2024-04-18T14:44:11.038 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:44:11.038 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:11.038 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:11.038 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-04-18T14:44:11.038 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:36.725652+0000", 2024-04-18T14:44:11.038 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4294967295.999999 2024-04-18T14:44:11.038 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:11.038 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:11.038 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-04-18T14:44:11.038 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:36.725657+0000", 2024-04-18T14:44:11.038 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4.5170000000000001e-06 2024-04-18T14:44:11.038 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:11.038 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:11.039 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-04-18T14:44:11.039 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:36.725670+0000", 2024-04-18T14:44:11.039 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.3536999999999999e-05 2024-04-18T14:44:11.039 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:11.039 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:11.039 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-04-18T14:44:11.039 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:36.725678+0000", 2024-04-18T14:44:11.039 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 8.2099999999999993e-06 2024-04-18T14:44:11.039 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:11.039 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:11.039 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-04-18T14:44:11.039 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:36.725920+0000", 2024-04-18T14:44:11.039 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00024127299999999999 2024-04-18T14:44:11.039 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:11.039 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:11.040 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting_for_map not empty", 2024-04-18T14:44:11.040 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:36.725937+0000", 2024-04-18T14:44:11.040 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.7011e-05 2024-04-18T14:44:11.040 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:11.040 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:11.040 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-04-18T14:44:11.040 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:36.732196+0000", 2024-04-18T14:44:11.040 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0062595209999999997 2024-04-18T14:44:11.040 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:11.040 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:11.040 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for blocked object", 2024-04-18T14:44:11.040 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:36.732319+0000", 2024-04-18T14:44:11.040 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000122977 2024-04-18T14:44:11.040 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:11.040 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:11.041 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-04-18T14:44:11.041 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:36.750655+0000", 2024-04-18T14:44:11.041 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.018336431 2024-04-18T14:44:11.041 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:11.041 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:11.041 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-04-18T14:44:11.041 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:36.750956+0000", 2024-04-18T14:44:11.041 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00030036800000000002 2024-04-18T14:44:11.041 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:11.041 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:11.041 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-04-18T14:44:11.041 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:36.751222+0000", 2024-04-18T14:44:11.041 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00026612000000000001 2024-04-18T14:44:11.041 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:44:11.042 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-04-18T14:44:11.042 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:44:11.042 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:11.042 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:11.042 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(client.4559.0:208 3.7s0 3:ee42865b:::smithi13430248-46:head [copy-from ver 12] snapc 4=[4,2] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-18T14:44:11.042 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-04-18T14:43:36.859263+0000", 2024-04-18T14:44:11.042 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 34.173307926, 2024-04-18T14:44:11.042 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.020148866000000001, 2024-04-18T14:44:11.042 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-04-18T14:44:11.042 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T14:44:11.042 INFO:teuthology.orchestra.run.smithi119.stdout: "client_info": { 2024-04-18T14:44:11.042 INFO:teuthology.orchestra.run.smithi119.stdout: "client": "client.4559", 2024-04-18T14:44:11.042 INFO:teuthology.orchestra.run.smithi119.stdout: "client_addr": "172.21.15.134:0/3113589487", 2024-04-18T14:44:11.042 INFO:teuthology.orchestra.run.smithi119.stdout: "tid": 208 2024-04-18T14:44:11.042 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:11.043 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-04-18T14:44:11.043 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:11.043 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-04-18T14:44:11.043 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:36.859263+0000", 2024-04-18T14:44:11.043 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:44:11.043 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:11.043 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:11.043 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-04-18T14:44:11.043 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:36.859263+0000", 2024-04-18T14:44:11.043 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:44:11.043 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:11.043 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:11.043 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-04-18T14:44:11.043 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:36.859261+0000", 2024-04-18T14:44:11.043 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4294967295.9999976 2024-04-18T14:44:11.044 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:11.044 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:11.044 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-04-18T14:44:11.044 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:36.859276+0000", 2024-04-18T14:44:11.044 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.5252999999999999e-05 2024-04-18T14:44:11.044 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:11.044 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:11.044 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-04-18T14:44:11.044 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:36.859312+0000", 2024-04-18T14:44:11.044 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.5414999999999999e-05 2024-04-18T14:44:11.044 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:11.044 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:11.044 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-04-18T14:44:11.044 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:36.859335+0000", 2024-04-18T14:44:11.044 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.3767000000000001e-05 2024-04-18T14:44:11.044 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:11.045 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:11.045 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-04-18T14:44:11.045 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:36.859473+0000", 2024-04-18T14:44:11.045 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00013787000000000001 2024-04-18T14:44:11.045 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:11.045 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:11.045 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-04-18T14:44:11.045 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:36.859624+0000", 2024-04-18T14:44:11.045 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000151244 2024-04-18T14:44:11.045 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:11.045 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:11.045 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_started", 2024-04-18T14:44:11.045 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:36.875191+0000", 2024-04-18T14:44:11.045 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.015566722 2024-04-18T14:44:11.045 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:11.046 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:11.046 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_committed", 2024-04-18T14:44:11.046 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:36.878849+0000", 2024-04-18T14:44:11.046 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0036577939999999998 2024-04-18T14:44:11.046 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:11.046 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:11.046 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-04-18T14:44:11.046 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:36.879281+0000", 2024-04-18T14:44:11.046 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00043213799999999999 2024-04-18T14:44:11.046 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:11.046 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:11.046 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-04-18T14:44:11.046 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:36.879412+0000", 2024-04-18T14:44:11.046 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00013128 2024-04-18T14:44:11.046 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:44:11.047 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-04-18T14:44:11.047 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:44:11.047 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:11.047 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:11.047 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(client.4559.0:209 3.7s0 3:ee42865b:::smithi13430248-46:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e37)", 2024-04-18T14:44:11.047 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-04-18T14:43:36.859370+0000", 2024-04-18T14:44:11.047 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 34.173201433999999, 2024-04-18T14:44:11.047 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.018800118000000001, 2024-04-18T14:44:11.047 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-04-18T14:44:11.047 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "started", 2024-04-18T14:44:11.047 INFO:teuthology.orchestra.run.smithi119.stdout: "client_info": { 2024-04-18T14:44:11.047 INFO:teuthology.orchestra.run.smithi119.stdout: "client": "client.4559", 2024-04-18T14:44:11.047 INFO:teuthology.orchestra.run.smithi119.stdout: "client_addr": "172.21.15.134:0/3113589487", 2024-04-18T14:44:11.047 INFO:teuthology.orchestra.run.smithi119.stdout: "tid": 209 2024-04-18T14:44:11.047 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:11.047 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-04-18T14:44:11.047 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:11.048 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-04-18T14:44:11.048 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:36.859370+0000", 2024-04-18T14:44:11.048 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:44:11.048 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:11.048 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:11.048 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-04-18T14:44:11.048 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:36.859370+0000", 2024-04-18T14:44:11.048 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:44:11.048 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:11.048 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:11.048 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-04-18T14:44:11.048 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:36.859369+0000", 2024-04-18T14:44:11.048 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4294967295.9999986 2024-04-18T14:44:11.048 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:11.049 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:11.049 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-04-18T14:44:11.049 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:36.859377+0000", 2024-04-18T14:44:11.049 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 8.3110000000000006e-06 2024-04-18T14:44:11.049 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:11.049 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:11.049 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-04-18T14:44:11.049 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:36.859398+0000", 2024-04-18T14:44:11.049 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.0716e-05 2024-04-18T14:44:11.049 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:11.049 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:11.049 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-04-18T14:44:11.049 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:36.859414+0000", 2024-04-18T14:44:11.049 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.5988e-05 2024-04-18T14:44:11.049 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:11.049 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:11.050 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-04-18T14:44:11.050 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:36.859991+0000", 2024-04-18T14:44:11.050 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00057741499999999996 2024-04-18T14:44:11.050 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:11.050 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:11.050 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for blocked object", 2024-04-18T14:44:11.050 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:36.860117+0000", 2024-04-18T14:44:11.050 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000126026 2024-04-18T14:44:11.050 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:11.050 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:11.050 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-04-18T14:44:11.050 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:36.877677+0000", 2024-04-18T14:44:11.050 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.017559549000000001 2024-04-18T14:44:11.050 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:11.050 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:11.051 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-04-18T14:44:11.051 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:36.877914+0000", 2024-04-18T14:44:11.051 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00023726899999999999 2024-04-18T14:44:11.051 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:11.051 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:11.051 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-04-18T14:44:11.051 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:36.878170+0000", 2024-04-18T14:44:11.051 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00025624399999999998 2024-04-18T14:44:11.051 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:44:11.051 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-04-18T14:44:11.051 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:44:11.051 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:11.051 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:11.051 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(client.4559.0:242 3.7s0 3:e2767c91:::smithi13430248-5:head [copy-from ver 2] snapc 8=[8,7,4,2] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-04-18T14:44:11.051 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-04-18T14:43:40.759272+0000", 2024-04-18T14:44:11.051 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 30.273299409, 2024-04-18T14:44:11.052 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.031013309999999999, 2024-04-18T14:44:11.052 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-04-18T14:44:11.052 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T14:44:11.052 INFO:teuthology.orchestra.run.smithi119.stdout: "client_info": { 2024-04-18T14:44:11.052 INFO:teuthology.orchestra.run.smithi119.stdout: "client": "client.4559", 2024-04-18T14:44:11.052 INFO:teuthology.orchestra.run.smithi119.stdout: "client_addr": "172.21.15.134:0/3113589487", 2024-04-18T14:44:11.052 INFO:teuthology.orchestra.run.smithi119.stdout: "tid": 242 2024-04-18T14:44:11.052 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:11.052 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-04-18T14:44:11.052 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:11.052 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-04-18T14:44:11.052 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:40.759272+0000", 2024-04-18T14:44:11.052 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:44:11.052 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:11.052 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:11.052 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-04-18T14:44:11.052 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:40.759272+0000", 2024-04-18T14:44:11.053 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:44:11.053 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:11.053 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:11.053 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-04-18T14:44:11.053 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:40.759269+0000", 2024-04-18T14:44:11.053 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4294967295.9999971 2024-04-18T14:44:11.053 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:11.053 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:11.053 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-04-18T14:44:11.053 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:40.759294+0000", 2024-04-18T14:44:11.053 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.5335999999999999e-05 2024-04-18T14:44:11.053 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:11.053 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:11.053 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-04-18T14:44:11.053 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:40.759330+0000", 2024-04-18T14:44:11.053 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.5531000000000003e-05 2024-04-18T14:44:11.053 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:11.054 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:11.054 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-04-18T14:44:11.054 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:40.759353+0000", 2024-04-18T14:44:11.054 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.3441000000000001e-05 2024-04-18T14:44:11.054 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:11.054 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:11.054 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-04-18T14:44:11.054 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:40.760398+0000", 2024-04-18T14:44:11.054 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00104484 2024-04-18T14:44:11.054 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:11.054 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:11.054 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-04-18T14:44:11.054 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:40.760662+0000", 2024-04-18T14:44:11.054 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00026342599999999998 2024-04-18T14:44:11.055 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:11.055 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:11.055 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_started", 2024-04-18T14:44:11.055 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:40.783559+0000", 2024-04-18T14:44:11.055 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.022896989 2024-04-18T14:44:11.055 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:11.055 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:11.055 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_committed", 2024-04-18T14:44:11.055 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:40.789488+0000", 2024-04-18T14:44:11.055 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0059289260000000002 2024-04-18T14:44:11.055 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:11.055 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:11.055 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-04-18T14:44:11.055 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:40.790079+0000", 2024-04-18T14:44:11.055 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00059128299999999996 2024-04-18T14:44:11.055 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:11.056 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:11.056 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-04-18T14:44:11.056 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:40.790285+0000", 2024-04-18T14:44:11.056 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000206448 2024-04-18T14:44:11.056 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:44:11.056 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-04-18T14:44:11.056 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:44:11.056 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:11.056 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:11.056 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(client.4559.0:243 3.7s0 3:e2767c91:::smithi13430248-5:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e41)", 2024-04-18T14:44:11.056 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-04-18T14:43:40.759392+0000", 2024-04-18T14:44:11.056 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 30.273179184, 2024-04-18T14:44:11.056 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.032366368, 2024-04-18T14:44:11.056 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-04-18T14:44:11.057 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "started", 2024-04-18T14:44:11.057 INFO:teuthology.orchestra.run.smithi119.stdout: "client_info": { 2024-04-18T14:44:11.057 INFO:teuthology.orchestra.run.smithi119.stdout: "client": "client.4559", 2024-04-18T14:44:11.057 INFO:teuthology.orchestra.run.smithi119.stdout: "client_addr": "172.21.15.134:0/3113589487", 2024-04-18T14:44:11.057 INFO:teuthology.orchestra.run.smithi119.stdout: "tid": 243 2024-04-18T14:44:11.057 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:11.057 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-04-18T14:44:11.057 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:11.057 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-04-18T14:44:11.057 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:40.759392+0000", 2024-04-18T14:44:11.057 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:44:11.057 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:11.057 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:11.057 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-04-18T14:44:11.057 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:40.759392+0000", 2024-04-18T14:44:11.057 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:44:11.058 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:11.058 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:11.058 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-04-18T14:44:11.058 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:40.759391+0000", 2024-04-18T14:44:11.058 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4294967295.9999986 2024-04-18T14:44:11.058 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:11.058 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:11.058 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-04-18T14:44:11.058 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:40.759400+0000", 2024-04-18T14:44:11.058 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 8.9770000000000006e-06 2024-04-18T14:44:11.058 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:11.058 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:11.058 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-04-18T14:44:11.058 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:40.759421+0000", 2024-04-18T14:44:11.058 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.1557e-05 2024-04-18T14:44:11.059 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:11.059 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:11.059 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-04-18T14:44:11.059 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:40.759438+0000", 2024-04-18T14:44:11.059 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.6663999999999998e-05 2024-04-18T14:44:11.059 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:11.059 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:11.059 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-04-18T14:44:11.059 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:40.761106+0000", 2024-04-18T14:44:11.059 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.001668367 2024-04-18T14:44:11.059 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:11.059 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:11.059 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for blocked object", 2024-04-18T14:44:11.059 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:40.761224+0000", 2024-04-18T14:44:11.059 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000117376 2024-04-18T14:44:11.060 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:11.060 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:11.060 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-04-18T14:44:11.060 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:40.791296+0000", 2024-04-18T14:44:11.060 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.030072040000000001 2024-04-18T14:44:11.060 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:11.060 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:11.060 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-04-18T14:44:11.060 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:40.791484+0000", 2024-04-18T14:44:11.060 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000188717 2024-04-18T14:44:11.060 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:11.060 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:11.060 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-04-18T14:44:11.060 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:40.791759+0000", 2024-04-18T14:44:11.060 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00027425000000000003 2024-04-18T14:44:11.060 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:44:11.061 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-04-18T14:44:11.061 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:44:11.061 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:11.061 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:11.061 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(client.4559.0:475 3.7s0 3:e3a0e00d:::smithi13430248-30:head [append 0~704512] snapc 19=[19,16,14,13,11,f,b,a,7,2] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-18T14:44:11.061 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-04-18T14:43:56.399253+0000", 2024-04-18T14:44:11.061 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 14.633318049, 2024-04-18T14:44:11.061 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.019253031, 2024-04-18T14:44:11.061 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-04-18T14:44:11.061 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T14:44:11.061 INFO:teuthology.orchestra.run.smithi119.stdout: "client_info": { 2024-04-18T14:44:11.061 INFO:teuthology.orchestra.run.smithi119.stdout: "client": "client.4559", 2024-04-18T14:44:11.061 INFO:teuthology.orchestra.run.smithi119.stdout: "client_addr": "172.21.15.134:0/3113589487", 2024-04-18T14:44:11.061 INFO:teuthology.orchestra.run.smithi119.stdout: "tid": 475 2024-04-18T14:44:11.062 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:11.062 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-04-18T14:44:11.062 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:11.062 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-04-18T14:44:11.062 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:56.399253+0000", 2024-04-18T14:44:11.062 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:44:11.062 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:11.062 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:11.062 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-04-18T14:44:11.062 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:56.399253+0000", 2024-04-18T14:44:11.062 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:44:11.062 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:11.062 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:11.062 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-04-18T14:44:11.062 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:56.399251+0000", 2024-04-18T14:44:11.062 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4294967295.9999971 2024-04-18T14:44:11.063 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:11.063 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:11.063 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-04-18T14:44:11.063 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:56.400332+0000", 2024-04-18T14:44:11.063 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0010816109999999999 2024-04-18T14:44:11.063 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:11.063 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:11.063 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-04-18T14:44:11.063 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:56.400366+0000", 2024-04-18T14:44:11.063 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.3899999999999997e-05 2024-04-18T14:44:11.063 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:11.063 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:11.063 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-04-18T14:44:11.063 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:56.400388+0000", 2024-04-18T14:44:11.063 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.2137000000000002e-05 2024-04-18T14:44:11.063 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:11.064 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:11.064 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-04-18T14:44:11.064 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:56.400539+0000", 2024-04-18T14:44:11.064 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00015065200000000001 2024-04-18T14:44:11.064 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:11.064 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:11.064 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-04-18T14:44:11.064 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:56.400857+0000", 2024-04-18T14:44:11.064 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00031790300000000002 2024-04-18T14:44:11.064 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:11.064 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:11.064 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_started", 2024-04-18T14:44:11.064 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:56.403966+0000", 2024-04-18T14:44:11.064 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.003108815 2024-04-18T14:44:11.064 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:11.064 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:11.064 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_committed", 2024-04-18T14:44:11.065 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:56.408578+0000", 2024-04-18T14:44:11.065 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0046126680000000003 2024-04-18T14:44:11.065 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:11.065 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:11.065 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-04-18T14:44:11.065 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:56.418318+0000", 2024-04-18T14:44:11.065 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0097398369999999995 2024-04-18T14:44:11.065 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:11.065 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:11.065 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-04-18T14:44:11.065 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:56.418506+0000", 2024-04-18T14:44:11.065 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00018824799999999999 2024-04-18T14:44:11.065 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:44:11.065 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-04-18T14:44:11.065 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:44:11.065 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:11.065 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:11.066 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "MOSDECSubOpWrite(3.4s2 68/30 ECSubWrite(tid=63, reqid=osd.10.0:63, at_version=68'20, trim_to=0'0, roll_forward_to=65'18))", 2024-04-18T14:44:11.066 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-04-18T14:44:07.411065+0000", 2024-04-18T14:44:11.066 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 3.6215061789999998, 2024-04-18T14:44:11.066 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.024750998, 2024-04-18T14:44:11.066 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-04-18T14:44:11.066 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "reached pg", 2024-04-18T14:44:11.066 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-04-18T14:44:11.066 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:11.066 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-04-18T14:44:11.066 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:07.411065+0000", 2024-04-18T14:44:11.066 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:44:11.066 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:11.066 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:11.066 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-04-18T14:44:11.066 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:07.411065+0000", 2024-04-18T14:44:11.066 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:44:11.067 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:11.067 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:11.067 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-04-18T14:44:11.067 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:07.411064+0000", 2024-04-18T14:44:11.067 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4294967295.999999 2024-04-18T14:44:11.067 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:11.067 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:11.067 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-04-18T14:44:11.067 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:07.411123+0000", 2024-04-18T14:44:11.067 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 5.8686e-05 2024-04-18T14:44:11.067 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:11.067 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:11.067 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-04-18T14:44:11.067 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:07.411151+0000", 2024-04-18T14:44:11.068 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.8056999999999999e-05 2024-04-18T14:44:11.068 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:11.068 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:11.068 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-04-18T14:44:11.068 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:07.411171+0000", 2024-04-18T14:44:11.068 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.0233000000000001e-05 2024-04-18T14:44:11.068 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:11.068 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:11.068 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-04-18T14:44:11.068 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:07.411295+0000", 2024-04-18T14:44:11.068 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000124012 2024-04-18T14:44:11.068 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:11.068 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:11.068 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_started", 2024-04-18T14:44:11.068 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:07.411321+0000", 2024-04-18T14:44:11.068 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.6069999999999999e-05 2024-04-18T14:44:11.069 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:11.069 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:11.069 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_committed", 2024-04-18T14:44:11.069 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:07.435757+0000", 2024-04-18T14:44:11.069 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.024435779000000001 2024-04-18T14:44:11.069 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:11.069 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:11.069 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-04-18T14:44:11.069 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:07.435816+0000", 2024-04-18T14:44:11.069 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 5.9256999999999999e-05 2024-04-18T14:44:11.069 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:44:11.069 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-04-18T14:44:11.069 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:44:11.069 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:11.069 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:11.069 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "MOSDECSubOpWrite(3.fs4 68/30 ECSubWrite(tid=165, reqid=osd.11.0:165, at_version=68'34, trim_to=0'0, roll_forward_to=65'32))", 2024-04-18T14:44:11.070 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-04-18T14:44:07.412419+0000", 2024-04-18T14:44:11.070 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 3.6201524119999999, 2024-04-18T14:44:11.070 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.029301166, 2024-04-18T14:44:11.070 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-04-18T14:44:11.070 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "reached pg", 2024-04-18T14:44:11.070 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-04-18T14:44:11.070 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:11.070 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-04-18T14:44:11.070 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:07.412419+0000", 2024-04-18T14:44:11.070 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:44:11.070 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:11.070 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:11.070 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-04-18T14:44:11.070 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:07.412419+0000", 2024-04-18T14:44:11.071 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:44:11.071 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:11.071 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:11.071 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-04-18T14:44:11.071 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:07.412418+0000", 2024-04-18T14:44:11.071 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4294967295.999999 2024-04-18T14:44:11.071 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:11.071 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:11.071 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-04-18T14:44:11.071 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:07.412468+0000", 2024-04-18T14:44:11.071 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 5.0274e-05 2024-04-18T14:44:11.071 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:11.071 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:11.071 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-04-18T14:44:11.071 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:07.412493+0000", 2024-04-18T14:44:11.071 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.5052e-05 2024-04-18T14:44:11.072 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:11.072 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:11.072 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-04-18T14:44:11.072 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:07.412512+0000", 2024-04-18T14:44:11.072 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.8176999999999999e-05 2024-04-18T14:44:11.072 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:11.072 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:11.072 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-04-18T14:44:11.072 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:07.412620+0000", 2024-04-18T14:44:11.072 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000108429 2024-04-18T14:44:11.072 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:11.072 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:11.072 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_started", 2024-04-18T14:44:11.072 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:07.412646+0000", 2024-04-18T14:44:11.072 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.6310000000000001e-05 2024-04-18T14:44:11.072 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:11.072 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:11.073 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_committed", 2024-04-18T14:44:11.073 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:07.441671+0000", 2024-04-18T14:44:11.073 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.029024583999999999 2024-04-18T14:44:11.073 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:11.073 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:11.073 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-04-18T14:44:11.073 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:07.441720+0000", 2024-04-18T14:44:11.073 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4.9237000000000003e-05 2024-04-18T14:44:11.073 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:44:11.073 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-04-18T14:44:11.073 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:44:11.073 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:11.073 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:11.073 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "MOSDECSubOpWrite(3.fs4 68/30 ECSubWrite(tid=167, reqid=osd.11.0:167, at_version=68'36, trim_to=0'0, roll_forward_to=65'32))", 2024-04-18T14:44:11.073 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-04-18T14:44:07.413949+0000", 2024-04-18T14:44:11.073 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 3.6186223370000001, 2024-04-18T14:44:11.074 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.02828085, 2024-04-18T14:44:11.074 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-04-18T14:44:11.074 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "reached pg", 2024-04-18T14:44:11.074 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-04-18T14:44:11.074 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:11.074 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-04-18T14:44:11.074 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:07.413949+0000", 2024-04-18T14:44:11.074 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:44:11.074 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:11.074 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:11.074 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-04-18T14:44:11.074 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:07.413949+0000", 2024-04-18T14:44:11.074 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:44:11.074 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:11.074 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:11.075 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-04-18T14:44:11.075 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:07.413947+0000", 2024-04-18T14:44:11.075 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4294967295.9999981 2024-04-18T14:44:11.075 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:11.075 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:11.075 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-04-18T14:44:11.075 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:07.414001+0000", 2024-04-18T14:44:11.075 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 5.3220000000000002e-05 2024-04-18T14:44:11.075 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:11.075 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:11.075 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-04-18T14:44:11.075 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:07.414034+0000", 2024-04-18T14:44:11.075 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.2985999999999999e-05 2024-04-18T14:44:11.075 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:11.075 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:11.075 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-04-18T14:44:11.075 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:07.414106+0000", 2024-04-18T14:44:11.076 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 7.2255999999999994e-05 2024-04-18T14:44:11.076 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:11.076 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:11.076 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-04-18T14:44:11.076 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:07.422158+0000", 2024-04-18T14:44:11.076 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0080523190000000005 2024-04-18T14:44:11.076 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:11.076 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:11.076 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_started", 2024-04-18T14:44:11.076 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:07.422185+0000", 2024-04-18T14:44:11.076 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.6928999999999999e-05 2024-04-18T14:44:11.076 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:11.076 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:11.076 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_committed", 2024-04-18T14:44:11.076 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:07.442178+0000", 2024-04-18T14:44:11.076 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.019992916999999999 2024-04-18T14:44:11.076 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:11.077 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:11.077 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-04-18T14:44:11.077 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:07.442230+0000", 2024-04-18T14:44:11.077 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 5.1990000000000002e-05 2024-04-18T14:44:11.077 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:44:11.077 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-04-18T14:44:11.077 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:44:11.077 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:11.077 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:11.077 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "MOSDECSubOpWriteReply(3.7s0 68/30 ECSubWriteReply(tid=203, last_complete=68'90, committed=1, applied=1))", 2024-04-18T14:44:11.077 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-04-18T14:44:07.417478+0000", 2024-04-18T14:44:11.077 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 3.6150931440000003, 2024-04-18T14:44:11.077 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.023983576, 2024-04-18T14:44:11.077 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-04-18T14:44:11.077 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "reached pg", 2024-04-18T14:44:11.077 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-04-18T14:44:11.078 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:11.078 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-04-18T14:44:11.078 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:07.417478+0000", 2024-04-18T14:44:11.078 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:44:11.078 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:11.078 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:11.078 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-04-18T14:44:11.078 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:07.417478+0000", 2024-04-18T14:44:11.078 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:44:11.078 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:11.078 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:11.078 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-04-18T14:44:11.078 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:07.417477+0000", 2024-04-18T14:44:11.078 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4294967295.9999981 2024-04-18T14:44:11.078 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:11.079 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:11.079 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-04-18T14:44:11.079 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:07.417487+0000", 2024-04-18T14:44:11.079 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.076e-05 2024-04-18T14:44:11.079 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:11.079 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:11.079 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-04-18T14:44:11.079 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:07.417521+0000", 2024-04-18T14:44:11.079 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.3426999999999997e-05 2024-04-18T14:44:11.079 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:11.079 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:11.079 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-04-18T14:44:11.079 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:07.417541+0000", 2024-04-18T14:44:11.079 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.0296e-05 2024-04-18T14:44:11.079 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:11.080 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:11.080 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-04-18T14:44:11.080 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:07.441431+0000", 2024-04-18T14:44:11.080 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.023889924 2024-04-18T14:44:11.080 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:11.080 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:11.080 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-04-18T14:44:11.080 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:07.441462+0000", 2024-04-18T14:44:11.080 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.0892999999999997e-05 2024-04-18T14:44:11.080 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:44:11.080 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-04-18T14:44:11.080 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:44:11.080 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:11.080 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:11.080 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "MOSDECSubOpWriteReply(3.7s0 68/30 ECSubWriteReply(tid=203, last_complete=68'90, committed=1, applied=1))", 2024-04-18T14:44:11.081 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-04-18T14:44:07.418200+0000", 2024-04-18T14:44:11.081 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 3.6143717469999999, 2024-04-18T14:44:11.081 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.023339612999999999, 2024-04-18T14:44:11.081 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-04-18T14:44:11.081 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "reached pg", 2024-04-18T14:44:11.081 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-04-18T14:44:11.081 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:11.081 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-04-18T14:44:11.081 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:07.418200+0000", 2024-04-18T14:44:11.081 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:44:11.081 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:11.081 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:11.081 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-04-18T14:44:11.081 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:07.418200+0000", 2024-04-18T14:44:11.081 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:44:11.081 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:11.082 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:11.082 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-04-18T14:44:11.082 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:07.418198+0000", 2024-04-18T14:44:11.082 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4294967295.9999981 2024-04-18T14:44:11.082 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:11.082 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:11.082 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-04-18T14:44:11.082 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:07.418211+0000", 2024-04-18T14:44:11.082 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.2993000000000001e-05 2024-04-18T14:44:11.082 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:11.082 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:11.082 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-04-18T14:44:11.082 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:07.418250+0000", 2024-04-18T14:44:11.082 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.8902999999999997e-05 2024-04-18T14:44:11.082 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:11.083 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:11.083 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-04-18T14:44:11.083 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:07.418270+0000", 2024-04-18T14:44:11.083 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.9749999999999999e-05 2024-04-18T14:44:11.083 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:11.083 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:11.083 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-04-18T14:44:11.083 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:07.441515+0000", 2024-04-18T14:44:11.083 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.023245717999999999 2024-04-18T14:44:11.083 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:11.083 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:11.083 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-04-18T14:44:11.083 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:07.441539+0000", 2024-04-18T14:44:11.083 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.3961999999999999e-05 2024-04-18T14:44:11.083 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:44:11.083 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-04-18T14:44:11.084 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:44:11.084 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:11.084 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:11.084 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "MOSDECSubOpWriteReply(3.7s0 68/30 ECSubWriteReply(tid=205, last_complete=68'92, committed=1, applied=1))", 2024-04-18T14:44:11.084 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-04-18T14:44:07.420757+0000", 2024-04-18T14:44:11.084 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 3.611814383, 2024-04-18T14:44:11.084 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.020985119999999999, 2024-04-18T14:44:11.084 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-04-18T14:44:11.084 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "reached pg", 2024-04-18T14:44:11.084 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-04-18T14:44:11.084 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:11.084 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-04-18T14:44:11.084 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:07.420757+0000", 2024-04-18T14:44:11.084 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:44:11.084 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:11.084 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:11.085 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-04-18T14:44:11.085 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:07.420757+0000", 2024-04-18T14:44:11.085 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:44:11.085 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:11.085 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:11.085 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-04-18T14:44:11.085 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:07.420755+0000", 2024-04-18T14:44:11.085 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4294967295.9999976 2024-04-18T14:44:11.085 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:11.085 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:11.085 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-04-18T14:44:11.085 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:07.420767+0000", 2024-04-18T14:44:11.085 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.1867e-05 2024-04-18T14:44:11.085 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:11.085 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:11.085 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-04-18T14:44:11.086 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:07.420804+0000", 2024-04-18T14:44:11.086 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.7530000000000002e-05 2024-04-18T14:44:11.086 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:11.086 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:11.086 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-04-18T14:44:11.086 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:07.420823+0000", 2024-04-18T14:44:11.086 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.8493000000000001e-05 2024-04-18T14:44:11.086 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:11.086 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:11.086 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-04-18T14:44:11.086 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:07.441625+0000", 2024-04-18T14:44:11.086 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.020802264000000001 2024-04-18T14:44:11.086 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:11.086 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:11.087 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-04-18T14:44:11.087 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:07.441742+0000", 2024-04-18T14:44:11.087 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000117236 2024-04-18T14:44:11.087 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:44:11.087 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-04-18T14:44:11.087 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:44:11.087 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:11.087 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:11.087 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "MOSDECSubOpWriteReply(3.7s0 68/30 ECSubWriteReply(tid=203, last_complete=68'90, committed=1, applied=1))", 2024-04-18T14:44:11.087 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-04-18T14:44:07.420917+0000", 2024-04-18T14:44:11.087 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 3.6116548239999999, 2024-04-18T14:44:11.087 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.020927753, 2024-04-18T14:44:11.087 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-04-18T14:44:11.087 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "reached pg", 2024-04-18T14:44:11.087 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-04-18T14:44:11.088 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:11.088 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-04-18T14:44:11.088 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:07.420917+0000", 2024-04-18T14:44:11.088 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:44:11.088 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:11.088 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:11.088 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-04-18T14:44:11.088 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:07.420917+0000", 2024-04-18T14:44:11.088 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:44:11.088 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:11.088 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:11.088 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-04-18T14:44:11.088 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:07.420915+0000", 2024-04-18T14:44:11.088 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4294967295.9999981 2024-04-18T14:44:11.088 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:11.088 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:11.088 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-04-18T14:44:11.089 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:07.420950+0000", 2024-04-18T14:44:11.089 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.5250000000000003e-05 2024-04-18T14:44:11.089 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:11.089 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:11.089 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-04-18T14:44:11.089 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:07.420981+0000", 2024-04-18T14:44:11.089 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.1130000000000002e-05 2024-04-18T14:44:11.089 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:11.089 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:11.089 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-04-18T14:44:11.089 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:07.421000+0000", 2024-04-18T14:44:11.089 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.9273e-05 2024-04-18T14:44:11.089 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:11.089 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:11.089 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-04-18T14:44:11.090 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:07.441813+0000", 2024-04-18T14:44:11.090 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.020812913999999998 2024-04-18T14:44:11.090 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:11.090 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:11.090 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-04-18T14:44:11.090 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:07.441844+0000", 2024-04-18T14:44:11.090 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.1016000000000003e-05 2024-04-18T14:44:11.090 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:44:11.090 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-04-18T14:44:11.090 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:44:11.090 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:11.090 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:11.090 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "MOSDECSubOpWriteReply(3.7s0 68/30 ECSubWriteReply(tid=203, last_complete=68'90, committed=1, applied=1))", 2024-04-18T14:44:11.091 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-04-18T14:44:07.422318+0000", 2024-04-18T14:44:11.091 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 3.6102535749999998, 2024-04-18T14:44:11.091 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.01962581, 2024-04-18T14:44:11.091 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-04-18T14:44:11.091 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "reached pg", 2024-04-18T14:44:11.091 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-04-18T14:44:11.091 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:11.091 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-04-18T14:44:11.091 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:07.422318+0000", 2024-04-18T14:44:11.091 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:44:11.091 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:11.091 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:11.091 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-04-18T14:44:11.091 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:07.422318+0000", 2024-04-18T14:44:11.091 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:44:11.092 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:11.092 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:11.092 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-04-18T14:44:11.092 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:07.422316+0000", 2024-04-18T14:44:11.092 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4294967295.9999981 2024-04-18T14:44:11.092 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:11.092 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:11.092 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-04-18T14:44:11.092 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:07.422329+0000", 2024-04-18T14:44:11.092 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.328e-05 2024-04-18T14:44:11.092 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:11.092 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:11.092 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-04-18T14:44:11.092 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:07.422358+0000", 2024-04-18T14:44:11.092 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.8177000000000001e-05 2024-04-18T14:44:11.092 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:11.093 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:11.093 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-04-18T14:44:11.093 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:07.422376+0000", 2024-04-18T14:44:11.093 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.8620000000000001e-05 2024-04-18T14:44:11.093 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:11.093 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:11.093 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-04-18T14:44:11.093 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:07.441914+0000", 2024-04-18T14:44:11.093 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.019537395999999999 2024-04-18T14:44:11.093 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:11.093 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:11.093 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-04-18T14:44:11.093 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:07.441944+0000", 2024-04-18T14:44:11.093 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.0090000000000002e-05 2024-04-18T14:44:11.093 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:44:11.094 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-04-18T14:44:11.094 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:44:11.094 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:11.094 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:11.094 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "MOSDECSubOpWriteReply(3.7s0 68/30 ECSubWriteReply(tid=203, last_complete=68'90, committed=1, applied=1))", 2024-04-18T14:44:11.094 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-04-18T14:44:07.422407+0000", 2024-04-18T14:44:11.094 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 3.6101646020000002, 2024-04-18T14:44:11.094 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.019639403, 2024-04-18T14:44:11.094 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-04-18T14:44:11.094 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "reached pg", 2024-04-18T14:44:11.094 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-04-18T14:44:11.094 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:11.094 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-04-18T14:44:11.094 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:07.422407+0000", 2024-04-18T14:44:11.095 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:44:11.095 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:11.095 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:11.095 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-04-18T14:44:11.095 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:07.422407+0000", 2024-04-18T14:44:11.095 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:44:11.095 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:11.095 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:11.095 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-04-18T14:44:11.095 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:07.422406+0000", 2024-04-18T14:44:11.095 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4294967295.999999 2024-04-18T14:44:11.095 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:11.095 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:11.095 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-04-18T14:44:11.095 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:07.422413+0000", 2024-04-18T14:44:11.096 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 7.6170000000000001e-06 2024-04-18T14:44:11.096 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:11.096 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:11.096 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-04-18T14:44:11.096 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:07.422433+0000", 2024-04-18T14:44:11.096 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.9426e-05 2024-04-18T14:44:11.096 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:11.096 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:11.096 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-04-18T14:44:11.096 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:07.422446+0000", 2024-04-18T14:44:11.096 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.358e-05 2024-04-18T14:44:11.096 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:11.096 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:11.096 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-04-18T14:44:11.096 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:07.442014+0000", 2024-04-18T14:44:11.096 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.019567715999999999 2024-04-18T14:44:11.097 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:11.097 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:11.097 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-04-18T14:44:11.097 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:07.442046+0000", 2024-04-18T14:44:11.097 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.2036999999999998e-05 2024-04-18T14:44:11.097 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:44:11.097 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-04-18T14:44:11.097 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:44:11.097 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:11.097 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:11.097 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "MOSDECSubOpWriteReply(3.7s0 68/30 ECSubWriteReply(tid=203, last_complete=68'90, committed=1, applied=1))", 2024-04-18T14:44:11.097 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-04-18T14:44:07.422457+0000", 2024-04-18T14:44:11.097 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 3.6101141719999998, 2024-04-18T14:44:11.097 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.019780025, 2024-04-18T14:44:11.097 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-04-18T14:44:11.097 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "reached pg", 2024-04-18T14:44:11.098 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-04-18T14:44:11.098 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:11.098 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-04-18T14:44:11.098 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:07.422457+0000", 2024-04-18T14:44:11.098 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:44:11.098 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:11.098 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:11.098 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-04-18T14:44:11.098 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:07.422457+0000", 2024-04-18T14:44:11.098 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:44:11.098 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:11.098 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:11.098 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-04-18T14:44:11.098 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:07.422455+0000", 2024-04-18T14:44:11.098 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4294967295.9999981 2024-04-18T14:44:11.099 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:11.099 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:11.099 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-04-18T14:44:11.099 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:07.422469+0000", 2024-04-18T14:44:11.099 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.3356000000000001e-05 2024-04-18T14:44:11.099 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:11.099 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:11.099 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-04-18T14:44:11.099 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:07.422500+0000", 2024-04-18T14:44:11.099 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.1294000000000002e-05 2024-04-18T14:44:11.099 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:11.099 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:11.099 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-04-18T14:44:11.099 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:07.422520+0000", 2024-04-18T14:44:11.099 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.9626000000000001e-05 2024-04-18T14:44:11.100 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:11.100 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:11.100 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-04-18T14:44:11.100 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:07.442105+0000", 2024-04-18T14:44:11.100 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.019585463000000001 2024-04-18T14:44:11.100 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:11.100 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:11.100 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-04-18T14:44:11.100 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:07.442237+0000", 2024-04-18T14:44:11.100 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00013217599999999999 2024-04-18T14:44:11.100 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:44:11.100 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-04-18T14:44:11.100 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:44:11.100 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:11.101 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:11.101 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "MOSDECSubOpWriteReply(3.7s0 68/30 ECSubWriteReply(tid=205, last_complete=68'92, committed=1, applied=1))", 2024-04-18T14:44:11.101 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-04-18T14:44:07.422597+0000", 2024-04-18T14:44:11.101 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 3.6099741270000001, 2024-04-18T14:44:11.101 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.019738436000000002, 2024-04-18T14:44:11.101 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-04-18T14:44:11.101 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "reached pg", 2024-04-18T14:44:11.101 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-04-18T14:44:11.101 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:11.101 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-04-18T14:44:11.101 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:07.422597+0000", 2024-04-18T14:44:11.101 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:44:11.101 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:11.101 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:11.101 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-04-18T14:44:11.101 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:07.422597+0000", 2024-04-18T14:44:11.102 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:44:11.102 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:11.102 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:11.102 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-04-18T14:44:11.102 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:07.422596+0000", 2024-04-18T14:44:11.102 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4294967295.9999986 2024-04-18T14:44:11.102 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:11.102 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:11.102 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-04-18T14:44:11.102 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:07.422604+0000", 2024-04-18T14:44:11.102 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 8.4460000000000001e-06 2024-04-18T14:44:11.102 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:11.102 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:11.102 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-04-18T14:44:11.102 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:07.422627+0000", 2024-04-18T14:44:11.103 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.2986999999999999e-05 2024-04-18T14:44:11.103 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:11.103 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:11.103 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-04-18T14:44:11.103 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:07.422647+0000", 2024-04-18T14:44:11.103 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.0117000000000001e-05 2024-04-18T14:44:11.103 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:11.103 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:11.103 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-04-18T14:44:11.103 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:07.442306+0000", 2024-04-18T14:44:11.103 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.019658414999999999 2024-04-18T14:44:11.103 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:11.103 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:11.103 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-04-18T14:44:11.103 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:07.442336+0000", 2024-04-18T14:44:11.103 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.9957000000000001e-05 2024-04-18T14:44:11.104 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:44:11.104 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-04-18T14:44:11.104 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:44:11.104 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:11.104 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:11.104 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "MOSDECSubOpWriteReply(3.7s0 68/30 ECSubWriteReply(tid=205, last_complete=68'92, committed=1, applied=1))", 2024-04-18T14:44:11.104 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-04-18T14:44:07.423504+0000", 2024-04-18T14:44:11.104 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 3.609067274, 2024-04-18T14:44:11.104 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.018915562, 2024-04-18T14:44:11.104 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-04-18T14:44:11.104 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "reached pg", 2024-04-18T14:44:11.104 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-04-18T14:44:11.104 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:11.104 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-04-18T14:44:11.104 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:07.423504+0000", 2024-04-18T14:44:11.104 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:44:11.105 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:11.105 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:11.105 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-04-18T14:44:11.105 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:07.423504+0000", 2024-04-18T14:44:11.105 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:44:11.105 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:11.105 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:11.105 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-04-18T14:44:11.105 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:07.423495+0000", 2024-04-18T14:44:11.105 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4294967295.9999914 2024-04-18T14:44:11.105 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:11.105 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:11.105 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-04-18T14:44:11.105 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:07.423514+0000", 2024-04-18T14:44:11.105 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.8366999999999999e-05 2024-04-18T14:44:11.105 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:11.106 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:11.106 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-04-18T14:44:11.106 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:07.423545+0000", 2024-04-18T14:44:11.106 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.1313000000000003e-05 2024-04-18T14:44:11.106 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:11.106 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:11.106 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-04-18T14:44:11.106 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:07.423564+0000", 2024-04-18T14:44:11.106 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.8504000000000001e-05 2024-04-18T14:44:11.106 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:11.106 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:11.106 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-04-18T14:44:11.106 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:07.442393+0000", 2024-04-18T14:44:11.106 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.018829351000000001 2024-04-18T14:44:11.107 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:11.107 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:11.107 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-04-18T14:44:11.107 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:07.442420+0000", 2024-04-18T14:44:11.107 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.6817000000000001e-05 2024-04-18T14:44:11.107 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:44:11.107 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-04-18T14:44:11.107 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:44:11.107 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:11.107 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:11.107 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "MOSDECSubOpWrite(3.9s2 68/30 ECSubWrite(tid=145, reqid=osd.12.0:145, at_version=68'119, trim_to=0'0, roll_forward_to=68'115))", 2024-04-18T14:44:11.107 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-04-18T14:44:07.425972+0000", 2024-04-18T14:44:11.107 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 3.6065990919999997, 2024-04-18T14:44:11.107 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.019823013, 2024-04-18T14:44:11.107 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-04-18T14:44:11.107 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "reached pg", 2024-04-18T14:44:11.107 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-04-18T14:44:11.108 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:11.108 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-04-18T14:44:11.108 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:07.425972+0000", 2024-04-18T14:44:11.108 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:44:11.108 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:11.108 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:11.108 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-04-18T14:44:11.108 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:07.425972+0000", 2024-04-18T14:44:11.108 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:44:11.108 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:11.108 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:11.108 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-04-18T14:44:11.108 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:07.425971+0000", 2024-04-18T14:44:11.108 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4294967295.9999986 2024-04-18T14:44:11.108 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:11.108 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:11.108 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-04-18T14:44:11.109 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:07.426015+0000", 2024-04-18T14:44:11.109 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4.3883e-05 2024-04-18T14:44:11.109 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:11.109 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:11.109 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-04-18T14:44:11.109 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:07.426039+0000", 2024-04-18T14:44:11.109 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.4660000000000001e-05 2024-04-18T14:44:11.109 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:11.109 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:11.109 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-04-18T14:44:11.109 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:07.426074+0000", 2024-04-18T14:44:11.109 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.4759999999999999e-05 2024-04-18T14:44:11.109 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:11.109 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:11.109 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-04-18T14:44:11.109 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:07.434178+0000", 2024-04-18T14:44:11.110 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0081041930000000009 2024-04-18T14:44:11.110 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:11.110 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:11.110 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_started", 2024-04-18T14:44:11.110 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:07.434199+0000", 2024-04-18T14:44:11.110 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.0962999999999999e-05 2024-04-18T14:44:11.110 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:11.110 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:11.110 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_committed", 2024-04-18T14:44:11.110 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:07.445771+0000", 2024-04-18T14:44:11.110 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.011571349999999999 2024-04-18T14:44:11.110 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:11.110 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:11.110 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-04-18T14:44:11.110 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:07.445795+0000", 2024-04-18T14:44:11.111 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.4598000000000001e-05 2024-04-18T14:44:11.111 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:44:11.111 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-04-18T14:44:11.111 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:44:11.111 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:44:11.111 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-04-18T14:44:11.111 INFO:teuthology.orchestra.run.smithi119.stdout:} 2024-04-18T14:44:11.112 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-04-18T14:44:11.156 INFO:tasks.ceph.osd.6.smithi119.stderr:2024-04-18T14:44:11.158+0000 7fb7cb8bd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 24896) UID: 0 2024-04-18T14:44:11.228 INFO:tasks.ceph.osd.3.smithi134.stderr:2024-04-18T14:44:11.232+0000 7fe7a4443640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25211) UID: 0 2024-04-18T14:44:11.242 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-04-18T14:44:11.242 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [], 2024-04-18T14:44:11.243 INFO:teuthology.orchestra.run.smithi134.stdout: "num_ops": 0 2024-04-18T14:44:11.243 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-04-18T14:44:11.257 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-04-18T14:44:11.329 INFO:tasks.ceph.osd.13.smithi096.stderr:2024-04-18T14:44:11.329+0000 7f7e72fad640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 13 (PID: 24893) UID: 0 2024-04-18T14:44:11.386 INFO:tasks.rados.rados.0.smithi134.stdout:278: done (3 left) 2024-04-18T14:44:11.386 INFO:tasks.rados.rados.0.smithi134.stdout:281: done (2 left) 2024-04-18T14:44:11.386 INFO:tasks.rados.rados.0.smithi134.stdout:283: done (1 left) 2024-04-18T14:44:11.386 INFO:tasks.rados.rados.0.smithi134.stdout:284: read oid 44 snap -1 2024-04-18T14:44:11.386 INFO:tasks.rados.rados.0.smithi134.stdout:284: expect (ObjNum 83 snap 15 seq_num 83) 2024-04-18T14:44:11.386 INFO:tasks.rados.rados.0.smithi134.stdout:285: read oid 46 snap 13 2024-04-18T14:44:11.386 INFO:tasks.rados.rados.0.smithi134.stdout:285: expect (ObjNum 37 snap 0 seq_num 37) 2024-04-18T14:44:11.386 INFO:tasks.rados.rados.0.smithi134.stdout:286: copy_from oid 19 from oid 23 current snap is 25 2024-04-18T14:44:11.387 INFO:tasks.rados.rados.0.smithi134.stdout:append oid 40 current snap is 25 2024-04-18T14:44:11.387 INFO:tasks.rados.rados.0.smithi134.stdout:287: seq_num 120 ranges {2588672=475136,3063808=655360,3719168=622592,4341760=278528} 2024-04-18T14:44:11.417 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-04-18T14:44:11.418 INFO:tasks.rados.rados.0.smithi134.stdout:287: writing smithi13430248-40 from 2588672 to 3063808 tid 1 2024-04-18T14:44:11.423 INFO:tasks.rados.rados.0.smithi134.stdout:287: writing smithi13430248-40 from 3063808 to 3719168 tid 2 2024-04-18T14:44:11.429 INFO:tasks.rados.rados.0.smithi134.stdout:287: writing smithi13430248-40 from 3719168 to 4341760 tid 3 2024-04-18T14:44:11.429 INFO:tasks.ceph.osd.3.smithi134.stderr:2024-04-18T14:44:11.432+0000 7fe7a4443640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25211) UID: 0 2024-04-18T14:44:11.431 INFO:tasks.rados.rados.0.smithi134.stdout:287: writing smithi13430248-40 from 4341760 to 4620288 tid 4 2024-04-18T14:44:11.432 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-04-18T14:44:11.432 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [], 2024-04-18T14:44:11.432 INFO:teuthology.orchestra.run.smithi134.stdout: "complaint_time": 30, 2024-04-18T14:44:11.432 INFO:teuthology.orchestra.run.smithi134.stdout: "num_blocked_ops": 0 2024-04-18T14:44:11.432 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-04-18T14:44:11.433 INFO:tasks.rados.rados.0.smithi134.stdout:288: read oid 9 snap -1 2024-04-18T14:44:11.433 INFO:tasks.rados.rados.0.smithi134.stdout:288: expect deleted 2024-04-18T14:44:11.433 INFO:tasks.rados.rados.0.smithi134.stdout:289: read oid 50 snap -1 2024-04-18T14:44:11.433 INFO:tasks.rados.rados.0.smithi134.stdout:289: expect deleted 2024-04-18T14:44:11.433 INFO:tasks.rados.rados.0.smithi134.stdout:290: setattr oid 41 current snap is 25 2024-04-18T14:44:11.433 INFO:tasks.rados.rados.0.smithi134.stdout:285: expect (ObjNum 37 snap 0 seq_num 37) 2024-04-18T14:44:11.449 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-04-18T14:44:11.450 INFO:tasks.rados.rados.0.smithi134.stdout:284: expect (ObjNum 83 snap 15 seq_num 83) 2024-04-18T14:44:11.531 INFO:tasks.ceph.osd.3.smithi134.stderr:2024-04-18T14:44:11.536+0000 7fe7a4443640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25211) UID: 0 2024-04-18T14:44:11.574 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-04-18T14:44:11.574 INFO:teuthology.orchestra.run.smithi134.stdout: "size": 20, 2024-04-18T14:44:11.574 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 600, 2024-04-18T14:44:11.574 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [ 2024-04-18T14:44:11.574 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:11.574 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4559.0:176 3.as0 3:5dff433d:::smithi13430248-20:head [delete] snapc 3=[3,2] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e35)", 2024-04-18T14:44:11.574 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T14:43:34.715612+0000", 2024-04-18T14:44:11.574 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 36.859000553000001, 2024-04-18T14:44:11.574 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.011905134, 2024-04-18T14:44:11.574 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T14:44:11.575 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T14:44:11.575 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-18T14:44:11.575 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4559", 2024-04-18T14:44:11.575 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/3113589487", 2024-04-18T14:44:11.575 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 176 2024-04-18T14:44:11.575 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:11.575 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T14:44:11.575 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:11.575 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T14:44:11.575 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:34.715612+0000", 2024-04-18T14:44:11.575 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:44:11.575 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:11.575 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:11.575 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T14:44:11.575 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:34.715612+0000", 2024-04-18T14:44:11.576 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:44:11.576 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:11.576 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:11.576 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T14:44:11.576 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:34.715609+0000", 2024-04-18T14:44:11.576 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999971 2024-04-18T14:44:11.576 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:11.576 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:11.576 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T14:44:11.576 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:34.715623+0000", 2024-04-18T14:44:11.576 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.4578e-05 2024-04-18T14:44:11.576 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:11.576 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:11.576 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T14:44:11.576 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:34.715659+0000", 2024-04-18T14:44:11.577 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.5824000000000001e-05 2024-04-18T14:44:11.577 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:11.577 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:11.577 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T14:44:11.577 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:34.715676+0000", 2024-04-18T14:44:11.577 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6594000000000001e-05 2024-04-18T14:44:11.577 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:11.577 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:11.577 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T14:44:11.577 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:34.715794+0000", 2024-04-18T14:44:11.577 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000118744 2024-04-18T14:44:11.577 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:11.577 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:11.577 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op must wait for map", 2024-04-18T14:44:11.577 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:34.715807+0000", 2024-04-18T14:44:11.578 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2486e-05 2024-04-18T14:44:11.578 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:11.578 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:11.578 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T14:44:11.578 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:34.718556+0000", 2024-04-18T14:44:11.578 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.002749175 2024-04-18T14:44:11.578 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:11.578 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:11.578 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T14:44:11.578 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:34.718699+0000", 2024-04-18T14:44:11.578 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00014262000000000001 2024-04-18T14:44:11.578 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:11.578 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:11.578 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_started", 2024-04-18T14:44:11.579 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:34.720045+0000", 2024-04-18T14:44:11.579 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0013458400000000001 2024-04-18T14:44:11.579 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:11.579 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:11.579 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_committed", 2024-04-18T14:44:11.579 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:34.721856+0000", 2024-04-18T14:44:11.579 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.001811226 2024-04-18T14:44:11.579 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:11.579 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:11.579 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T14:44:11.579 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:34.727477+0000", 2024-04-18T14:44:11.579 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0056212290000000002 2024-04-18T14:44:11.579 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:11.579 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:11.579 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T14:44:11.580 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:34.727517+0000", 2024-04-18T14:44:11.580 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.9712000000000002e-05 2024-04-18T14:44:11.580 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:44:11.580 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T14:44:11.580 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:44:11.580 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:11.580 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:11.580 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4559.0:178 3.as0 3:504bbe78:::smithi13430248-37:head [append 0~507904] snapc 4=[4,3,2] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-04-18T14:44:11.580 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T14:43:35.731082+0000", 2024-04-18T14:44:11.580 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 35.843530250000001, 2024-04-18T14:44:11.580 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.015989092, 2024-04-18T14:44:11.580 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T14:44:11.580 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T14:44:11.580 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-18T14:44:11.580 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4559", 2024-04-18T14:44:11.581 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/3113589487", 2024-04-18T14:44:11.581 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 178 2024-04-18T14:44:11.581 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:11.581 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T14:44:11.581 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:11.581 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T14:44:11.581 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:35.731082+0000", 2024-04-18T14:44:11.581 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:44:11.581 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:11.581 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:11.581 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T14:44:11.581 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:35.731082+0000", 2024-04-18T14:44:11.581 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:44:11.581 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:11.581 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:11.581 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T14:44:11.582 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:35.731079+0000", 2024-04-18T14:44:11.582 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999971 2024-04-18T14:44:11.582 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:11.582 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:11.582 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T14:44:11.582 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:35.731663+0000", 2024-04-18T14:44:11.582 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00058377699999999995 2024-04-18T14:44:11.582 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:11.582 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:11.582 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T14:44:11.582 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:35.731697+0000", 2024-04-18T14:44:11.582 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.4578e-05 2024-04-18T14:44:11.582 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:11.582 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:11.583 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T14:44:11.583 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:35.731716+0000", 2024-04-18T14:44:11.583 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8413000000000001e-05 2024-04-18T14:44:11.583 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:11.583 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:11.583 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T14:44:11.583 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:35.731829+0000", 2024-04-18T14:44:11.583 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000113323 2024-04-18T14:44:11.583 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:11.583 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:11.583 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op must wait for map", 2024-04-18T14:44:11.583 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:35.731843+0000", 2024-04-18T14:44:11.583 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.4072e-05 2024-04-18T14:44:11.583 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:11.583 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:11.583 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T14:44:11.584 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:35.735773+0000", 2024-04-18T14:44:11.584 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0039293569999999996 2024-04-18T14:44:11.584 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:11.584 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:11.584 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T14:44:11.584 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:35.736021+0000", 2024-04-18T14:44:11.584 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00024879299999999997 2024-04-18T14:44:11.584 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:11.584 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:11.584 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_started", 2024-04-18T14:44:11.584 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:35.738679+0000", 2024-04-18T14:44:11.584 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0026578460000000002 2024-04-18T14:44:11.584 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:11.584 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:11.584 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_committed", 2024-04-18T14:44:11.585 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:35.745018+0000", 2024-04-18T14:44:11.585 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0063392070000000003 2024-04-18T14:44:11.585 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:11.585 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:11.585 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T14:44:11.585 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:35.746981+0000", 2024-04-18T14:44:11.585 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00196254 2024-04-18T14:44:11.585 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:11.585 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:11.585 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T14:44:11.585 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:35.747071+0000", 2024-04-18T14:44:11.585 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.0016e-05 2024-04-18T14:44:11.585 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:44:11.585 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T14:44:11.585 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:44:11.585 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:11.586 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:11.586 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4559.0:179 3.as0 3:504bbe78:::smithi13430248-37:head [append 0~376832] snapc 4=[4,3,2] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-04-18T14:44:11.586 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T14:43:35.735197+0000", 2024-04-18T14:44:11.586 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 35.839415432999999, 2024-04-18T14:44:11.586 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.013886849999999999, 2024-04-18T14:44:11.586 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T14:44:11.586 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T14:44:11.586 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-18T14:44:11.586 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4559", 2024-04-18T14:44:11.586 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/3113589487", 2024-04-18T14:44:11.586 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 179 2024-04-18T14:44:11.586 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:11.586 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T14:44:11.586 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:11.586 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T14:44:11.586 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:35.735197+0000", 2024-04-18T14:44:11.587 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:44:11.587 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:11.587 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:11.587 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T14:44:11.587 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:35.735197+0000", 2024-04-18T14:44:11.587 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:44:11.587 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:11.587 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:11.587 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T14:44:11.587 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:35.735193+0000", 2024-04-18T14:44:11.587 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999967 2024-04-18T14:44:11.587 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:11.587 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:11.588 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T14:44:11.588 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:35.735791+0000", 2024-04-18T14:44:11.588 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00059791 2024-04-18T14:44:11.588 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:11.588 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:11.588 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T14:44:11.588 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:35.735818+0000", 2024-04-18T14:44:11.588 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.6214e-05 2024-04-18T14:44:11.588 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:11.588 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:11.588 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T14:44:11.588 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:35.735834+0000", 2024-04-18T14:44:11.588 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6603999999999999e-05 2024-04-18T14:44:11.588 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:11.588 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:11.588 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T14:44:11.589 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:35.741060+0000", 2024-04-18T14:44:11.589 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0052256580000000002 2024-04-18T14:44:11.589 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:11.589 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:11.589 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T14:44:11.589 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:35.741402+0000", 2024-04-18T14:44:11.589 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00034264000000000001 2024-04-18T14:44:11.589 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:11.589 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:11.589 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_started", 2024-04-18T14:44:11.589 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:35.743027+0000", 2024-04-18T14:44:11.589 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0016244250000000001 2024-04-18T14:44:11.589 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:11.590 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:11.590 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_committed", 2024-04-18T14:44:11.590 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:35.746673+0000", 2024-04-18T14:44:11.590 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0036466189999999998 2024-04-18T14:44:11.590 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:11.590 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:11.590 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T14:44:11.590 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:35.749020+0000", 2024-04-18T14:44:11.590 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0023462439999999999 2024-04-18T14:44:11.590 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:11.590 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:11.590 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T14:44:11.590 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:35.749084+0000", 2024-04-18T14:44:11.590 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.3875999999999996e-05 2024-04-18T14:44:11.590 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:44:11.591 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T14:44:11.591 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:44:11.591 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:11.591 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:11.591 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4559.0:180 3.as0 3:504bbe78:::smithi13430248-37:head [setxattr _header (56) in=7b] snapc 4=[4,3,2] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-04-18T14:44:11.591 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T14:43:35.735855+0000", 2024-04-18T14:44:11.591 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 35.838757330999996, 2024-04-18T14:44:11.591 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.013531458999999999, 2024-04-18T14:44:11.591 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T14:44:11.591 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T14:44:11.591 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-18T14:44:11.591 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4559", 2024-04-18T14:44:11.591 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/3113589487", 2024-04-18T14:44:11.591 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 180 2024-04-18T14:44:11.591 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:11.592 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T14:44:11.592 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:11.592 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T14:44:11.592 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:35.735855+0000", 2024-04-18T14:44:11.592 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:44:11.592 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:11.592 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:11.592 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T14:44:11.592 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:35.735855+0000", 2024-04-18T14:44:11.592 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:44:11.592 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:11.592 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:11.592 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T14:44:11.592 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:35.735853+0000", 2024-04-18T14:44:11.592 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999986 2024-04-18T14:44:11.593 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:11.593 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:11.593 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T14:44:11.593 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:35.735860+0000", 2024-04-18T14:44:11.593 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.024e-06 2024-04-18T14:44:11.593 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:11.593 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:11.593 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T14:44:11.593 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:35.735871+0000", 2024-04-18T14:44:11.593 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.076e-05 2024-04-18T14:44:11.593 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:11.593 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:11.593 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T14:44:11.593 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:35.735895+0000", 2024-04-18T14:44:11.593 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.3623999999999999e-05 2024-04-18T14:44:11.594 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:11.594 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:11.594 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T14:44:11.594 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:35.745199+0000", 2024-04-18T14:44:11.594 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0093043380000000005 2024-04-18T14:44:11.594 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:11.594 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:11.594 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T14:44:11.594 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:35.745372+0000", 2024-04-18T14:44:11.594 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00017296100000000001 2024-04-18T14:44:11.594 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:11.594 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:11.594 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_started", 2024-04-18T14:44:11.594 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:35.746162+0000", 2024-04-18T14:44:11.594 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00078974600000000002 2024-04-18T14:44:11.595 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:11.595 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:11.595 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_committed", 2024-04-18T14:44:11.595 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:35.748150+0000", 2024-04-18T14:44:11.595 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0019877649999999998 2024-04-18T14:44:11.595 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:11.595 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:11.595 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T14:44:11.595 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:35.749316+0000", 2024-04-18T14:44:11.595 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0011658949999999999 2024-04-18T14:44:11.595 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:11.595 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:11.595 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T14:44:11.595 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:35.749386+0000", 2024-04-18T14:44:11.595 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.0729999999999995e-05 2024-04-18T14:44:11.595 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:44:11.596 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T14:44:11.596 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:44:11.596 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:11.596 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:11.596 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4559.0:181 3.as0 3:504bbe78:::smithi13430248-37:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e36)", 2024-04-18T14:44:11.596 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T14:43:35.735904+0000", 2024-04-18T14:44:11.596 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 35.838708445999998, 2024-04-18T14:44:11.596 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.015807422000000002, 2024-04-18T14:44:11.596 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T14:44:11.596 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-04-18T14:44:11.596 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-18T14:44:11.596 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4559", 2024-04-18T14:44:11.596 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/3113589487", 2024-04-18T14:44:11.596 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 181 2024-04-18T14:44:11.596 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:11.597 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T14:44:11.597 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:11.597 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T14:44:11.597 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:35.735904+0000", 2024-04-18T14:44:11.597 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:44:11.597 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:11.597 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:11.597 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T14:44:11.597 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:35.735904+0000", 2024-04-18T14:44:11.597 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:44:11.597 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:11.597 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:11.597 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T14:44:11.597 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:35.735903+0000", 2024-04-18T14:44:11.597 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-18T14:44:11.598 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:11.598 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:11.598 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T14:44:11.598 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:35.735907+0000", 2024-04-18T14:44:11.598 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.1899999999999997e-06 2024-04-18T14:44:11.598 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:11.598 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:11.598 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T14:44:11.598 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:35.735920+0000", 2024-04-18T14:44:11.598 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2857000000000001e-05 2024-04-18T14:44:11.598 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:11.598 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:11.598 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T14:44:11.598 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:35.735927+0000", 2024-04-18T14:44:11.598 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.447e-06 2024-04-18T14:44:11.599 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:11.599 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:11.599 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T14:44:11.599 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:35.746529+0000", 2024-04-18T14:44:11.599 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.010601348 2024-04-18T14:44:11.599 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:11.599 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:11.599 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for rw locks", 2024-04-18T14:44:11.599 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:35.746655+0000", 2024-04-18T14:44:11.599 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000125823 2024-04-18T14:44:11.599 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:11.599 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:11.599 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T14:44:11.599 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:35.749858+0000", 2024-04-18T14:44:11.599 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0032038209999999999 2024-04-18T14:44:11.600 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:11.600 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:11.600 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T14:44:11.600 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:35.750001+0000", 2024-04-18T14:44:11.600 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000142602 2024-04-18T14:44:11.600 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:11.600 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:11.600 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T14:44:11.600 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:35.751711+0000", 2024-04-18T14:44:11.600 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0017101709999999999 2024-04-18T14:44:11.600 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:44:11.600 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T14:44:11.600 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:44:11.600 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:11.601 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:11.601 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4559.0:190 3.as0 3:5474a36d:::smithi13430248-11:head [delete] snapc 4=[4,2] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e37)", 2024-04-18T14:44:11.601 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T14:43:36.761006+0000", 2024-04-18T14:44:11.601 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 34.813606634000003, 2024-04-18T14:44:11.601 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.014529398000000001, 2024-04-18T14:44:11.601 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T14:44:11.601 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T14:44:11.601 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-18T14:44:11.601 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4559", 2024-04-18T14:44:11.601 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/3113589487", 2024-04-18T14:44:11.601 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 190 2024-04-18T14:44:11.601 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:11.601 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T14:44:11.601 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:11.601 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T14:44:11.602 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.761006+0000", 2024-04-18T14:44:11.602 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:44:11.602 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:11.602 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:11.602 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T14:44:11.602 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.761006+0000", 2024-04-18T14:44:11.602 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:44:11.602 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:11.602 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:11.602 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T14:44:11.602 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.761002+0000", 2024-04-18T14:44:11.602 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999967 2024-04-18T14:44:11.602 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:11.602 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:11.603 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T14:44:11.603 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.761018+0000", 2024-04-18T14:44:11.603 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5339999999999999e-05 2024-04-18T14:44:11.603 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:11.603 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:11.603 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T14:44:11.603 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.761058+0000", 2024-04-18T14:44:11.603 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.0197999999999997e-05 2024-04-18T14:44:11.603 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:11.603 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:11.603 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T14:44:11.603 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.761074+0000", 2024-04-18T14:44:11.603 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6646999999999998e-05 2024-04-18T14:44:11.603 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:11.603 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:11.604 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T14:44:11.604 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.761215+0000", 2024-04-18T14:44:11.604 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00014079399999999999 2024-04-18T14:44:11.604 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:11.604 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:11.604 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op must wait for map", 2024-04-18T14:44:11.604 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.761236+0000", 2024-04-18T14:44:11.604 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.105e-05 2024-04-18T14:44:11.604 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:11.604 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:11.604 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T14:44:11.604 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.765644+0000", 2024-04-18T14:44:11.604 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.004408159 2024-04-18T14:44:11.604 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:11.604 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:11.605 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T14:44:11.605 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.765818+0000", 2024-04-18T14:44:11.605 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00017385799999999999 2024-04-18T14:44:11.605 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:11.605 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:11.605 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_started", 2024-04-18T14:44:11.605 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.767388+0000", 2024-04-18T14:44:11.605 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0015693980000000001 2024-04-18T14:44:11.605 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:11.605 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:11.605 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_committed", 2024-04-18T14:44:11.605 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.774151+0000", 2024-04-18T14:44:11.605 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0067634050000000001 2024-04-18T14:44:11.605 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:11.605 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:11.605 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T14:44:11.606 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.775409+0000", 2024-04-18T14:44:11.606 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00125745 2024-04-18T14:44:11.606 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:11.606 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:11.606 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T14:44:11.606 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.775535+0000", 2024-04-18T14:44:11.606 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000126379 2024-04-18T14:44:11.606 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:44:11.606 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T14:44:11.606 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:44:11.606 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:11.606 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:11.606 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "MOSDECSubOpWriteReply(3.as0 37/30 ECSubWriteReply(tid=23, last_complete=37'16, committed=1, applied=1))", 2024-04-18T14:44:11.606 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T14:43:36.768128+0000", 2024-04-18T14:44:11.606 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 34.806483870999998, 2024-04-18T14:44:11.607 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0069581299999999999, 2024-04-18T14:44:11.607 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T14:44:11.607 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-04-18T14:44:11.607 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T14:44:11.607 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:11.607 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T14:44:11.607 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.768128+0000", 2024-04-18T14:44:11.607 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:44:11.607 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:11.607 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:11.607 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T14:44:11.607 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.768128+0000", 2024-04-18T14:44:11.607 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:44:11.607 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:11.608 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:11.608 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T14:44:11.608 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.768126+0000", 2024-04-18T14:44:11.608 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999981 2024-04-18T14:44:11.608 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:11.608 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:11.608 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T14:44:11.608 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.768139+0000", 2024-04-18T14:44:11.608 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2493e-05 2024-04-18T14:44:11.608 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:11.608 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:11.608 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T14:44:11.608 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.768169+0000", 2024-04-18T14:44:11.608 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.0463999999999998e-05 2024-04-18T14:44:11.608 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:11.609 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:11.609 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T14:44:11.609 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.768190+0000", 2024-04-18T14:44:11.609 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.1070999999999999e-05 2024-04-18T14:44:11.609 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:11.609 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:11.609 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T14:44:11.609 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.774008+0000", 2024-04-18T14:44:11.609 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0058170929999999997 2024-04-18T14:44:11.609 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:11.609 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:11.609 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T14:44:11.609 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.775086+0000", 2024-04-18T14:44:11.609 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.001078905 2024-04-18T14:44:11.609 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:44:11.610 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T14:44:11.610 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:44:11.610 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:11.610 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:11.610 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4559.0:244 3.as0 3:577932fb:::smithi13430248-41:head [read 0~688128,checksum,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-04-18T14:44:11.610 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T14:43:40.759326+0000", 2024-04-18T14:44:11.610 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 30.815285735, 2024-04-18T14:44:11.610 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.017168499, 2024-04-18T14:44:11.610 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T14:44:11.610 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-04-18T14:44:11.610 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-18T14:44:11.610 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4559", 2024-04-18T14:44:11.610 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/3113589487", 2024-04-18T14:44:11.610 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 244 2024-04-18T14:44:11.610 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:11.611 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T14:44:11.611 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:11.611 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T14:44:11.611 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:40.759326+0000", 2024-04-18T14:44:11.611 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:44:11.611 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:11.611 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:11.611 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T14:44:11.611 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:40.759326+0000", 2024-04-18T14:44:11.611 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:44:11.611 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:11.611 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:11.611 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T14:44:11.611 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:40.759323+0000", 2024-04-18T14:44:11.612 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999971 2024-04-18T14:44:11.612 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:11.612 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:11.612 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T14:44:11.612 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:40.759340+0000", 2024-04-18T14:44:11.612 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6344000000000001e-05 2024-04-18T14:44:11.612 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:11.612 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:11.612 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T14:44:11.612 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:40.759375+0000", 2024-04-18T14:44:11.612 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.5043999999999999e-05 2024-04-18T14:44:11.612 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:11.612 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:11.612 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T14:44:11.612 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:40.759392+0000", 2024-04-18T14:44:11.613 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6801000000000001e-05 2024-04-18T14:44:11.613 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:11.613 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:11.613 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T14:44:11.613 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:40.759518+0000", 2024-04-18T14:44:11.613 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00012620200000000001 2024-04-18T14:44:11.613 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:11.613 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:11.613 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op must wait for map", 2024-04-18T14:44:11.613 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:40.759537+0000", 2024-04-18T14:44:11.613 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.9670999999999999e-05 2024-04-18T14:44:11.613 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:11.613 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:11.613 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T14:44:11.613 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:40.764645+0000", 2024-04-18T14:44:11.614 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0051078240000000004 2024-04-18T14:44:11.614 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:11.614 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:11.614 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T14:44:11.614 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:40.764872+0000", 2024-04-18T14:44:11.614 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00022684499999999999 2024-04-18T14:44:11.614 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:11.614 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:11.614 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T14:44:11.614 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:40.776495+0000", 2024-04-18T14:44:11.614 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.011622791 2024-04-18T14:44:11.614 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:44:11.614 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T14:44:11.614 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:44:11.614 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:11.615 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:11.615 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4559.0:245 3.as0 3:577932fb:::smithi13430248-41:head [read 0~688128,checksum] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-04-18T14:44:11.615 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T14:43:40.759413+0000", 2024-04-18T14:44:11.615 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 30.815199023000002, 2024-04-18T14:44:11.615 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.017883375999999999, 2024-04-18T14:44:11.615 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T14:44:11.615 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-04-18T14:44:11.615 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-18T14:44:11.615 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4559", 2024-04-18T14:44:11.615 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/3113589487", 2024-04-18T14:44:11.615 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 245 2024-04-18T14:44:11.615 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:11.615 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T14:44:11.615 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:11.615 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T14:44:11.616 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:40.759413+0000", 2024-04-18T14:44:11.616 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:44:11.616 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:11.616 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:11.616 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T14:44:11.616 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:40.759413+0000", 2024-04-18T14:44:11.616 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:44:11.616 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:11.616 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:11.616 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T14:44:11.616 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:40.759412+0000", 2024-04-18T14:44:11.616 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999986 2024-04-18T14:44:11.616 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:11.616 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:11.616 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T14:44:11.617 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:40.759421+0000", 2024-04-18T14:44:11.617 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.3409999999999992e-06 2024-04-18T14:44:11.617 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:11.617 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:11.617 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T14:44:11.617 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:40.759440+0000", 2024-04-18T14:44:11.617 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8467000000000001e-05 2024-04-18T14:44:11.617 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:11.617 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:11.617 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T14:44:11.617 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:40.759454+0000", 2024-04-18T14:44:11.617 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.4113e-05 2024-04-18T14:44:11.617 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:11.617 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:11.617 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T14:44:11.618 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:40.759694+0000", 2024-04-18T14:44:11.618 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00023988199999999999 2024-04-18T14:44:11.618 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:11.618 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:11.618 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting_for_map not empty", 2024-04-18T14:44:11.618 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:40.759711+0000", 2024-04-18T14:44:11.618 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6988000000000001e-05 2024-04-18T14:44:11.618 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:11.618 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:11.618 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T14:44:11.618 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:40.766045+0000", 2024-04-18T14:44:11.618 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0063342169999999996 2024-04-18T14:44:11.618 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:11.618 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:11.618 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T14:44:11.619 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:40.766299+0000", 2024-04-18T14:44:11.619 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00025419199999999998 2024-04-18T14:44:11.619 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:11.619 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:11.619 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T14:44:11.619 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:40.777297+0000", 2024-04-18T14:44:11.619 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.010997536 2024-04-18T14:44:11.619 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:44:11.619 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T14:44:11.619 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:44:11.619 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:11.619 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:11.619 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4559.0:246 3.as0 3:577932fb:::smithi13430248-41:head [read 0~688128,checksum] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-04-18T14:44:11.619 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T14:43:40.759528+0000", 2024-04-18T14:44:11.619 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 30.815083846, 2024-04-18T14:44:11.620 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.019049244, 2024-04-18T14:44:11.620 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T14:44:11.620 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-04-18T14:44:11.620 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-18T14:44:11.620 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4559", 2024-04-18T14:44:11.620 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/3113589487", 2024-04-18T14:44:11.620 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 246 2024-04-18T14:44:11.620 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:11.620 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T14:44:11.620 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:11.620 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T14:44:11.620 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:40.759528+0000", 2024-04-18T14:44:11.620 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:44:11.620 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:11.620 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:11.621 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T14:44:11.621 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:40.759528+0000", 2024-04-18T14:44:11.621 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:44:11.621 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:11.621 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:11.621 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T14:44:11.621 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:40.759527+0000", 2024-04-18T14:44:11.621 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999986 2024-04-18T14:44:11.621 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:11.621 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:11.621 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T14:44:11.621 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:40.759536+0000", 2024-04-18T14:44:11.621 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.1540000000000008e-06 2024-04-18T14:44:11.621 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:11.621 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:11.622 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T14:44:11.622 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:40.759555+0000", 2024-04-18T14:44:11.622 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.9133000000000001e-05 2024-04-18T14:44:11.622 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:11.622 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:11.622 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T14:44:11.622 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:40.759570+0000", 2024-04-18T14:44:11.622 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5017999999999999e-05 2024-04-18T14:44:11.622 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:11.622 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:11.622 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T14:44:11.622 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:40.759776+0000", 2024-04-18T14:44:11.622 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000205577 2024-04-18T14:44:11.622 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:11.622 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:11.623 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting_for_map not empty", 2024-04-18T14:44:11.623 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:40.759792+0000", 2024-04-18T14:44:11.623 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6381000000000001e-05 2024-04-18T14:44:11.623 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:11.623 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:11.623 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T14:44:11.623 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:40.767014+0000", 2024-04-18T14:44:11.623 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0072223299999999999 2024-04-18T14:44:11.623 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:11.623 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:11.623 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T14:44:11.623 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:40.767254+0000", 2024-04-18T14:44:11.623 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00023931899999999999 2024-04-18T14:44:11.623 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:11.624 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:11.624 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T14:44:11.624 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:40.778578+0000", 2024-04-18T14:44:11.624 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.011323796000000001 2024-04-18T14:44:11.624 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:44:11.624 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T14:44:11.624 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:44:11.624 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:11.624 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:11.624 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "MOSDECSubOpReadReply(3.as0 41/30 ECSubReadReply(tid=27, attrs_read=0))", 2024-04-18T14:44:11.624 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T14:43:40.768641+0000", 2024-04-18T14:44:11.624 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 30.805971033999999, 2024-04-18T14:44:11.624 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0068345070000000001, 2024-04-18T14:44:11.624 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T14:44:11.624 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-04-18T14:44:11.625 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T14:44:11.625 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:11.625 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T14:44:11.625 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:40.768641+0000", 2024-04-18T14:44:11.625 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:44:11.625 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:11.625 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:11.625 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T14:44:11.625 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:40.768641+0000", 2024-04-18T14:44:11.625 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:44:11.625 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:11.625 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:11.625 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T14:44:11.625 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:40.768639+0000", 2024-04-18T14:44:11.625 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999976 2024-04-18T14:44:11.625 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:11.626 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:11.626 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T14:44:11.626 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:40.770039+0000", 2024-04-18T14:44:11.626 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.001400479 2024-04-18T14:44:11.626 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:11.626 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:11.626 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T14:44:11.626 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:40.770052+0000", 2024-04-18T14:44:11.626 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2913e-05 2024-04-18T14:44:11.626 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:11.626 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:11.626 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T14:44:11.626 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:40.770059+0000", 2024-04-18T14:44:11.626 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.4300000000000003e-06 2024-04-18T14:44:11.627 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:11.627 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:11.627 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T14:44:11.627 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:40.775428+0000", 2024-04-18T14:44:11.627 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0053696079999999997 2024-04-18T14:44:11.627 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:11.627 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:11.627 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T14:44:11.627 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:40.775476+0000", 2024-04-18T14:44:11.627 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.7327000000000003e-05 2024-04-18T14:44:11.627 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:44:11.627 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T14:44:11.627 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:44:11.627 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:11.627 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:11.628 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "MOSDECSubOpReadReply(3.as0 41/30 ECSubReadReply(tid=29, attrs_read=0))", 2024-04-18T14:44:11.628 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T14:43:40.769626+0000", 2024-04-18T14:44:11.628 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 30.804985933000001, 2024-04-18T14:44:11.628 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0057718960000000003, 2024-04-18T14:44:11.628 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T14:44:11.628 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-04-18T14:44:11.628 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T14:44:11.628 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:11.628 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T14:44:11.628 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:40.769626+0000", 2024-04-18T14:44:11.628 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:44:11.628 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:11.628 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:11.628 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T14:44:11.628 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:40.769626+0000", 2024-04-18T14:44:11.628 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:44:11.629 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:11.629 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:11.629 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T14:44:11.629 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:40.769626+0000", 2024-04-18T14:44:11.629 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-04-18T14:44:11.629 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:11.629 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:11.629 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T14:44:11.629 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:40.769771+0000", 2024-04-18T14:44:11.629 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000145356 2024-04-18T14:44:11.629 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:11.629 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:11.629 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T14:44:11.629 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:40.769782+0000", 2024-04-18T14:44:11.630 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1253999999999999e-05 2024-04-18T14:44:11.630 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:11.630 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:11.630 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T14:44:11.630 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:40.769789+0000", 2024-04-18T14:44:11.630 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.6529999999999997e-06 2024-04-18T14:44:11.630 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:11.630 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:11.630 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T14:44:11.630 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:40.772303+0000", 2024-04-18T14:44:11.630 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.002513721 2024-04-18T14:44:11.630 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:11.630 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:11.631 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T14:44:11.631 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:40.775398+0000", 2024-04-18T14:44:11.631 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0030953249999999999 2024-04-18T14:44:11.631 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:44:11.631 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T14:44:11.631 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:44:11.631 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:11.631 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:11.631 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "MOSDECSubOpWrite(3.es6 45/30 ECSubWrite(tid=21, reqid=client.4559.0:306, at_version=45'13, trim_to=0'0, roll_forward_to=44'11))", 2024-04-18T14:44:11.631 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T14:43:44.508424+0000", 2024-04-18T14:44:11.631 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 27.066188581999999, 2024-04-18T14:44:11.631 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0084897640000000003, 2024-04-18T14:44:11.631 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T14:44:11.631 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-04-18T14:44:11.631 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T14:44:11.631 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:11.632 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T14:44:11.632 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:44.508424+0000", 2024-04-18T14:44:11.632 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:44:11.632 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:11.632 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:11.632 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T14:44:11.632 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:44.508424+0000", 2024-04-18T14:44:11.632 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:44:11.632 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:11.632 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:11.632 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T14:44:11.632 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:44.508423+0000", 2024-04-18T14:44:11.632 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-04-18T14:44:11.632 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:11.632 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:11.633 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T14:44:11.633 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:44.508991+0000", 2024-04-18T14:44:11.633 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00056772400000000003 2024-04-18T14:44:11.633 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:11.633 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:11.633 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T14:44:11.633 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:44.509028+0000", 2024-04-18T14:44:11.633 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.7718e-05 2024-04-18T14:44:11.633 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:11.633 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:11.633 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T14:44:11.633 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:44.509055+0000", 2024-04-18T14:44:11.633 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.6489999999999999e-05 2024-04-18T14:44:11.633 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:11.633 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:11.633 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T14:44:11.634 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:44.509231+0000", 2024-04-18T14:44:11.634 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000175787 2024-04-18T14:44:11.634 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:11.634 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:11.634 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_started", 2024-04-18T14:44:11.634 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:44.509264+0000", 2024-04-18T14:44:11.634 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.2777000000000001e-05 2024-04-18T14:44:11.634 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:11.634 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:11.634 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_committed", 2024-04-18T14:44:11.634 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:44.516873+0000", 2024-04-18T14:44:11.634 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0076094739999999998 2024-04-18T14:44:11.634 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:11.634 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:11.634 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T14:44:11.635 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:44.516913+0000", 2024-04-18T14:44:11.635 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.0357e-05 2024-04-18T14:44:11.635 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:44:11.635 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T14:44:11.635 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:44:11.635 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:11.635 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:11.635 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "MOSDECSubOpWrite(3.2s2 46/30 ECSubWrite(tid=190, reqid=osd.13.0:190, at_version=46'10, trim_to=0'0, roll_forward_to=45'8))", 2024-04-18T14:44:11.635 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T14:43:45.385429+0000", 2024-04-18T14:44:11.635 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 26.189183164999999, 2024-04-18T14:44:11.635 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0074861670000000002, 2024-04-18T14:44:11.635 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T14:44:11.635 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-04-18T14:44:11.635 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T14:44:11.636 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:11.636 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T14:44:11.636 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:45.385429+0000", 2024-04-18T14:44:11.636 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:44:11.636 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:11.636 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:11.636 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T14:44:11.636 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:45.385429+0000", 2024-04-18T14:44:11.636 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:44:11.636 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:11.636 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:11.636 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T14:44:11.636 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:45.385428+0000", 2024-04-18T14:44:11.636 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-18T14:44:11.636 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:11.636 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:11.637 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T14:44:11.637 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:45.385487+0000", 2024-04-18T14:44:11.637 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.8451e-05 2024-04-18T14:44:11.637 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:11.637 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:11.637 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T14:44:11.637 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:45.385517+0000", 2024-04-18T14:44:11.637 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.0354000000000001e-05 2024-04-18T14:44:11.637 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:11.637 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:11.637 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T14:44:11.637 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:45.385546+0000", 2024-04-18T14:44:11.637 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.8594000000000001e-05 2024-04-18T14:44:11.637 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:11.637 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:11.638 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T14:44:11.638 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:45.385684+0000", 2024-04-18T14:44:11.638 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000138856 2024-04-18T14:44:11.638 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:11.638 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:11.638 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_started", 2024-04-18T14:44:11.638 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:45.385716+0000", 2024-04-18T14:44:11.638 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.1306999999999997e-05 2024-04-18T14:44:11.638 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:11.638 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:11.638 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_committed", 2024-04-18T14:44:11.638 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:45.392850+0000", 2024-04-18T14:44:11.638 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.007134367 2024-04-18T14:44:11.638 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:11.638 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:11.639 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T14:44:11.639 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:45.392915+0000", 2024-04-18T14:44:11.639 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.5110999999999994e-05 2024-04-18T14:44:11.639 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:44:11.639 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T14:44:11.639 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:44:11.639 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:11.639 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:11.639 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "MOSDECSubOpWrite(3.es6 46/30 ECSubWrite(tid=26, reqid=osd.8.0:26, at_version=46'17, trim_to=0'0, roll_forward_to=45'15))", 2024-04-18T14:44:11.639 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T14:43:45.389687+0000", 2024-04-18T14:44:11.639 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 26.184925239999998, 2024-04-18T14:44:11.639 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0056600269999999998, 2024-04-18T14:44:11.639 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T14:44:11.639 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-04-18T14:44:11.640 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T14:44:11.640 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:11.640 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T14:44:11.640 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:45.389687+0000", 2024-04-18T14:44:11.640 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:44:11.640 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:11.640 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:11.640 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T14:44:11.640 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:45.389687+0000", 2024-04-18T14:44:11.640 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:44:11.640 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:11.640 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:11.640 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T14:44:11.640 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:45.389686+0000", 2024-04-18T14:44:11.640 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-04-18T14:44:11.641 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:11.641 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:11.641 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T14:44:11.641 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:45.389725+0000", 2024-04-18T14:44:11.641 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.8300999999999998e-05 2024-04-18T14:44:11.641 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:11.641 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:11.641 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T14:44:11.641 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:45.389745+0000", 2024-04-18T14:44:11.641 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0746000000000001e-05 2024-04-18T14:44:11.641 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:11.641 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:11.641 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T14:44:11.641 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:45.389783+0000", 2024-04-18T14:44:11.641 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.7153000000000002e-05 2024-04-18T14:44:11.642 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:11.642 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:11.642 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T14:44:11.642 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:45.390021+0000", 2024-04-18T14:44:11.642 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00023869599999999999 2024-04-18T14:44:11.642 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:11.642 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:11.642 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_started", 2024-04-18T14:44:11.642 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:45.390048+0000", 2024-04-18T14:44:11.642 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.6474000000000001e-05 2024-04-18T14:44:11.642 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:11.642 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:11.642 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_committed", 2024-04-18T14:44:11.642 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:45.395293+0000", 2024-04-18T14:44:11.643 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0052450700000000001 2024-04-18T14:44:11.643 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:11.643 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:11.643 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T14:44:11.643 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:45.395347+0000", 2024-04-18T14:44:11.643 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.4156999999999997e-05 2024-04-18T14:44:11.643 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:44:11.643 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T14:44:11.643 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:44:11.643 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:11.643 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:11.643 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "MOSDECSubOpWrite(3.ds1 50/30 ECSubWrite(tid=12, reqid=osd.7.0:12, at_version=50'11, trim_to=0'0, roll_forward_to=49'9))", 2024-04-18T14:44:11.643 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T14:43:49.406464+0000", 2024-04-18T14:44:11.643 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 22.168148420000001, 2024-04-18T14:44:11.643 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.010390701, 2024-04-18T14:44:11.644 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T14:44:11.644 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-04-18T14:44:11.644 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T14:44:11.644 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:11.644 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T14:44:11.644 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:49.406464+0000", 2024-04-18T14:44:11.644 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:44:11.644 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:11.644 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:11.644 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T14:44:11.644 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:49.406464+0000", 2024-04-18T14:44:11.644 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:44:11.644 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:11.644 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:11.644 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T14:44:11.645 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:49.406463+0000", 2024-04-18T14:44:11.645 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-18T14:44:11.645 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:11.645 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:11.645 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T14:44:11.645 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:49.406539+0000", 2024-04-18T14:44:11.645 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.6114999999999999e-05 2024-04-18T14:44:11.645 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:11.645 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:11.645 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T14:44:11.645 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:49.406577+0000", 2024-04-18T14:44:11.645 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.7806999999999999e-05 2024-04-18T14:44:11.645 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:11.645 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:11.645 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T14:44:11.646 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:49.406601+0000", 2024-04-18T14:44:11.646 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.4090000000000001e-05 2024-04-18T14:44:11.646 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:11.646 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:11.646 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T14:44:11.646 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:49.409363+0000", 2024-04-18T14:44:11.646 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0027624640000000001 2024-04-18T14:44:11.646 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:11.646 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:11.646 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_started", 2024-04-18T14:44:11.646 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:49.409399+0000", 2024-04-18T14:44:11.646 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.5830000000000001e-05 2024-04-18T14:44:11.646 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:11.646 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:11.646 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_committed", 2024-04-18T14:44:11.647 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:49.416792+0000", 2024-04-18T14:44:11.647 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0073926620000000004 2024-04-18T14:44:11.647 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:11.647 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:11.647 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T14:44:11.647 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:49.416854+0000", 2024-04-18T14:44:11.647 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.2527000000000006e-05 2024-04-18T14:44:11.647 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:44:11.647 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T14:44:11.647 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:44:11.647 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:11.647 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:11.647 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4559.0:362 3.as0 3:5474a36d:::smithi13430248-11:head [append 0~0] snapc 13=[13,11,f,b,a,8,7,2] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-04-18T14:44:11.647 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T14:43:50.376205+0000", 2024-04-18T14:44:11.647 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 21.198407194000001, 2024-04-18T14:44:11.647 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.013968441, 2024-04-18T14:44:11.648 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T14:44:11.648 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T14:44:11.648 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-18T14:44:11.648 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4559", 2024-04-18T14:44:11.648 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/3113589487", 2024-04-18T14:44:11.648 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 362 2024-04-18T14:44:11.648 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:11.648 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T14:44:11.648 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:11.648 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T14:44:11.648 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:50.376205+0000", 2024-04-18T14:44:11.648 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:44:11.648 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:11.648 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:11.648 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T14:44:11.648 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:50.376205+0000", 2024-04-18T14:44:11.649 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:44:11.649 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:11.649 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:11.649 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T14:44:11.649 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:50.376202+0000", 2024-04-18T14:44:11.649 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999971 2024-04-18T14:44:11.649 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:11.649 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:11.649 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T14:44:11.649 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:50.376220+0000", 2024-04-18T14:44:11.649 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.7876999999999998e-05 2024-04-18T14:44:11.649 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:11.649 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:11.649 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T14:44:11.649 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:50.376256+0000", 2024-04-18T14:44:11.649 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.6384000000000003e-05 2024-04-18T14:44:11.650 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:11.650 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:11.650 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T14:44:11.650 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:50.376274+0000", 2024-04-18T14:44:11.650 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.7727000000000002e-05 2024-04-18T14:44:11.650 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:11.650 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:11.650 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T14:44:11.650 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:50.376445+0000", 2024-04-18T14:44:11.650 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000171046 2024-04-18T14:44:11.650 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:11.650 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:11.650 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op must wait for map", 2024-04-18T14:44:11.650 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:50.376460+0000", 2024-04-18T14:44:11.651 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.4620000000000001e-05 2024-04-18T14:44:11.651 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:11.651 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:11.651 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T14:44:11.651 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:50.381860+0000", 2024-04-18T14:44:11.651 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0054002199999999998 2024-04-18T14:44:11.651 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:11.651 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:11.651 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T14:44:11.651 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:50.382042+0000", 2024-04-18T14:44:11.651 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00018185900000000001 2024-04-18T14:44:11.651 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:11.651 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:11.651 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_started", 2024-04-18T14:44:11.651 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:50.383954+0000", 2024-04-18T14:44:11.652 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0019126530000000001 2024-04-18T14:44:11.652 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:11.652 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:11.652 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_committed", 2024-04-18T14:44:11.652 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:50.389758+0000", 2024-04-18T14:44:11.652 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.005803702 2024-04-18T14:44:11.652 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:11.652 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:11.652 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T14:44:11.652 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:50.390098+0000", 2024-04-18T14:44:11.652 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00033984400000000001 2024-04-18T14:44:11.652 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:11.652 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:11.652 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T14:44:11.653 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:50.390173+0000", 2024-04-18T14:44:11.653 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.5581999999999996e-05 2024-04-18T14:44:11.653 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:44:11.653 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T14:44:11.653 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:44:11.653 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:11.653 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:11.653 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4559.0:363 3.as0 3:5474a36d:::smithi13430248-11:head [rollback 7] snapc 13=[13,11,f,b,a,8,7,2] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-04-18T14:44:11.653 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T14:43:50.376296+0000", 2024-04-18T14:44:11.653 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 21.198316292000001, 2024-04-18T14:44:11.653 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.015443114000000001, 2024-04-18T14:44:11.653 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T14:44:11.653 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T14:44:11.653 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-18T14:44:11.653 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4559", 2024-04-18T14:44:11.653 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/3113589487", 2024-04-18T14:44:11.654 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 363 2024-04-18T14:44:11.654 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:11.654 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T14:44:11.654 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:11.654 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T14:44:11.654 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:50.376296+0000", 2024-04-18T14:44:11.654 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:44:11.654 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:11.654 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:11.654 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T14:44:11.654 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:50.376296+0000", 2024-04-18T14:44:11.654 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:44:11.654 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:11.654 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:11.654 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T14:44:11.655 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:50.376295+0000", 2024-04-18T14:44:11.655 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-18T14:44:11.655 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:11.655 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:11.655 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T14:44:11.655 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:50.376300+0000", 2024-04-18T14:44:11.655 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.7199999999999997e-06 2024-04-18T14:44:11.655 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:11.655 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:11.655 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T14:44:11.655 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:50.376333+0000", 2024-04-18T14:44:11.655 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.3315999999999997e-05 2024-04-18T14:44:11.655 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:11.655 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:11.655 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T14:44:11.656 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:50.376343+0000", 2024-04-18T14:44:11.656 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0346999999999999e-05 2024-04-18T14:44:11.656 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:11.656 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:11.656 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T14:44:11.656 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:50.376596+0000", 2024-04-18T14:44:11.656 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00025260099999999998 2024-04-18T14:44:11.656 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:11.656 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:11.656 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting_for_map not empty", 2024-04-18T14:44:11.656 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:50.376611+0000", 2024-04-18T14:44:11.656 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5594e-05 2024-04-18T14:44:11.656 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:11.656 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:11.656 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T14:44:11.656 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:50.385330+0000", 2024-04-18T14:44:11.657 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0087181299999999993 2024-04-18T14:44:11.657 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:11.657 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:11.657 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T14:44:11.657 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:50.385574+0000", 2024-04-18T14:44:11.657 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00024469699999999999 2024-04-18T14:44:11.657 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:11.657 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:11.657 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_started", 2024-04-18T14:44:11.657 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:50.386969+0000", 2024-04-18T14:44:11.657 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0013943639999999999 2024-04-18T14:44:11.657 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:11.657 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:11.657 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_committed", 2024-04-18T14:44:11.657 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:50.389892+0000", 2024-04-18T14:44:11.658 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0029229059999999999 2024-04-18T14:44:11.658 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:11.658 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:11.658 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T14:44:11.658 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:50.391671+0000", 2024-04-18T14:44:11.658 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0017797080000000001 2024-04-18T14:44:11.658 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:11.658 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:11.658 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T14:44:11.658 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:50.391739+0000", 2024-04-18T14:44:11.658 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.7756999999999995e-05 2024-04-18T14:44:11.658 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:44:11.658 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T14:44:11.658 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:44:11.659 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:11.659 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:11.659 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4559.0:498 3.as0 3:5474a36d:::smithi13430248-11:head [rollback 2] snapc 19=[19,16,14,13,11,f,b,a,7,2] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-18T14:44:11.659 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T14:43:56.549174+0000", 2024-04-18T14:44:11.659 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 15.025438532000001, 2024-04-18T14:44:11.659 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0062678109999999999, 2024-04-18T14:44:11.659 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T14:44:11.659 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T14:44:11.659 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-18T14:44:11.659 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4559", 2024-04-18T14:44:11.659 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/3113589487", 2024-04-18T14:44:11.659 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 498 2024-04-18T14:44:11.659 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:11.659 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T14:44:11.659 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:11.660 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T14:44:11.660 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:56.549174+0000", 2024-04-18T14:44:11.660 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:44:11.660 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:11.660 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:11.660 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T14:44:11.660 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:56.549174+0000", 2024-04-18T14:44:11.660 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:44:11.660 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:11.660 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:11.660 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T14:44:11.660 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:56.549171+0000", 2024-04-18T14:44:11.660 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999976 2024-04-18T14:44:11.660 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:11.660 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:11.661 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T14:44:11.661 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:56.549183+0000", 2024-04-18T14:44:11.661 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1953999999999999e-05 2024-04-18T14:44:11.661 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:11.661 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:11.661 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T14:44:11.661 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:56.549202+0000", 2024-04-18T14:44:11.661 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.9051000000000001e-05 2024-04-18T14:44:11.661 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:11.661 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:11.661 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T14:44:11.661 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:56.549210+0000", 2024-04-18T14:44:11.661 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.8369999999999997e-06 2024-04-18T14:44:11.661 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:11.661 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:11.661 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T14:44:11.662 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:56.549278+0000", 2024-04-18T14:44:11.662 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.7618000000000002e-05 2024-04-18T14:44:11.662 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:11.662 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:11.662 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T14:44:11.662 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:56.549420+0000", 2024-04-18T14:44:11.662 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000142218 2024-04-18T14:44:11.662 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:11.662 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:11.662 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_started", 2024-04-18T14:44:11.662 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:56.550993+0000", 2024-04-18T14:44:11.662 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0015731269999999999 2024-04-18T14:44:11.662 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:11.662 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:11.662 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_committed", 2024-04-18T14:44:11.663 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:56.552008+0000", 2024-04-18T14:44:11.663 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.001014767 2024-04-18T14:44:11.663 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:11.663 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:11.663 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T14:44:11.663 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:56.555363+0000", 2024-04-18T14:44:11.663 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0033550350000000001 2024-04-18T14:44:11.663 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:11.663 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:11.663 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T14:44:11.663 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:56.555441+0000", 2024-04-18T14:44:11.663 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.8708000000000006e-05 2024-04-18T14:44:11.663 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:44:11.663 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T14:44:11.663 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:44:11.664 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:11.664 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:11.664 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4559.0:499 3.as0 3:5474a36d:::smithi13430248-11:head [append 0~0] snapc 19=[19,16,14,13,11,f,b,a,7,2] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-18T14:44:11.664 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T14:43:56.549225+0000", 2024-04-18T14:44:11.664 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 15.025387387, 2024-04-18T14:44:11.664 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0064802530000000001, 2024-04-18T14:44:11.664 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T14:44:11.664 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T14:44:11.664 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-18T14:44:11.664 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4559", 2024-04-18T14:44:11.664 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/3113589487", 2024-04-18T14:44:11.664 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 499 2024-04-18T14:44:11.664 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:11.664 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T14:44:11.664 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:11.664 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T14:44:11.665 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:56.549225+0000", 2024-04-18T14:44:11.665 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:44:11.665 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:11.665 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:11.665 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T14:44:11.665 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:56.549225+0000", 2024-04-18T14:44:11.665 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:44:11.665 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:11.665 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:11.665 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T14:44:11.665 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:56.549224+0000", 2024-04-18T14:44:11.665 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-04-18T14:44:11.665 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:11.665 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:11.666 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T14:44:11.666 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:56.549229+0000", 2024-04-18T14:44:11.666 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.2179999999999998e-06 2024-04-18T14:44:11.666 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:11.666 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:11.666 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T14:44:11.666 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:56.549240+0000", 2024-04-18T14:44:11.666 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0210000000000001e-05 2024-04-18T14:44:11.666 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:11.666 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:11.666 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T14:44:11.666 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:56.549246+0000", 2024-04-18T14:44:11.666 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.9539999999999998e-06 2024-04-18T14:44:11.666 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:11.666 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:11.667 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T14:44:11.667 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:56.551282+0000", 2024-04-18T14:44:11.667 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0020357660000000001 2024-04-18T14:44:11.667 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:11.667 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:11.667 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T14:44:11.667 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:56.551394+0000", 2024-04-18T14:44:11.667 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00011189800000000001 2024-04-18T14:44:11.667 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:11.667 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:11.667 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_started", 2024-04-18T14:44:11.667 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:56.551835+0000", 2024-04-18T14:44:11.667 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00044089599999999997 2024-04-18T14:44:11.667 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:11.667 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:11.667 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_committed", 2024-04-18T14:44:11.668 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:56.553081+0000", 2024-04-18T14:44:11.668 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.001245927 2024-04-18T14:44:11.668 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:11.668 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:11.668 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T14:44:11.668 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:56.555630+0000", 2024-04-18T14:44:11.668 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0025486250000000001 2024-04-18T14:44:11.668 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:11.668 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:11.668 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T14:44:11.668 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:56.555705+0000", 2024-04-18T14:44:11.668 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.5457999999999995e-05 2024-04-18T14:44:11.669 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:44:11.669 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T14:44:11.669 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:44:11.669 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:44:11.669 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T14:44:11.669 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-04-18T14:44:11.671 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-04-18T14:44:11.671 INFO:tasks.rados.rados.0.smithi134.stdout:287: finishing write tid 1 to smithi13430248-40 2024-04-18T14:44:11.671 INFO:tasks.rados.rados.0.smithi134.stdout:287: finishing write tid 2 to smithi13430248-40 2024-04-18T14:44:11.671 INFO:tasks.rados.rados.0.smithi134.stdout:287: finishing write tid 3 to smithi13430248-40 2024-04-18T14:44:11.671 INFO:tasks.rados.rados.0.smithi134.stdout:287: finishing write tid 4 to smithi13430248-40 2024-04-18T14:44:11.671 INFO:tasks.rados.rados.0.smithi134.stdout:287: finishing write tid 5 to smithi13430248-40 2024-04-18T14:44:11.671 INFO:tasks.rados.rados.0.smithi134.stdout:287: finishing write tid 6 to smithi13430248-40 2024-04-18T14:44:11.671 INFO:tasks.rados.rados.0.smithi134.stdout:287: oid 40 updating version 0 to 106 2024-04-18T14:44:11.671 INFO:tasks.rados.rados.0.smithi134.stdout:287: oid 40 version 106 is already newer than 103 2024-04-18T14:44:11.671 INFO:tasks.rados.rados.0.smithi134.stdout:287: oid 40 version 106 is already newer than 104 2024-04-18T14:44:11.672 INFO:tasks.rados.rados.0.smithi134.stdout:287: oid 40 updating version 106 to 107 2024-04-18T14:44:11.672 INFO:tasks.rados.rados.0.smithi134.stdout:287: oid 40 version 107 is already newer than 105 2024-04-18T14:44:11.672 INFO:tasks.rados.rados.0.smithi134.stdout:update_object_version oid 40 v 107 (ObjNum 120 snap 25 seq_num 120) dirty exists 2024-04-18T14:44:11.672 INFO:tasks.rados.rados.0.smithi134.stdout:287: left oid 40 (ObjNum 120 snap 25 seq_num 120) 2024-04-18T14:44:11.672 INFO:tasks.rados.rados.0.smithi134.stdout:279: expect (ObjNum 100 snap 21 seq_num 100) 2024-04-18T14:44:11.672 INFO:tasks.ceph.osd.11.smithi134.stderr:2024-04-18T14:44:11.672+0000 7f2d36f12640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 11 (PID: 25216) UID: 0 2024-04-18T14:44:11.730 INFO:tasks.rados.rados.0.smithi134.stdout:286: finishing copy_from racing read to smithi13430248-19 2024-04-18T14:44:11.730 INFO:tasks.rados.rados.0.smithi134.stdout:286: finishing copy_from to smithi13430248-19 2024-04-18T14:44:11.730 INFO:tasks.rados.rados.0.smithi134.stdout:update_object_version oid 19 v 101 (ObjNum 105 snap 22 seq_num 105) dirty exists 2024-04-18T14:44:11.730 INFO:tasks.rados.rados.0.smithi134.stdout:279: done (7 left) 2024-04-18T14:44:11.730 INFO:tasks.rados.rados.0.smithi134.stdout:284: done (6 left) 2024-04-18T14:44:11.730 INFO:tasks.rados.rados.0.smithi134.stdout:285: done (5 left) 2024-04-18T14:44:11.730 INFO:tasks.rados.rados.0.smithi134.stdout:286: done (4 left) 2024-04-18T14:44:11.730 INFO:tasks.rados.rados.0.smithi134.stdout:287: done (3 left) 2024-04-18T14:44:11.730 INFO:tasks.rados.rados.0.smithi134.stdout:288: done (2 left) 2024-04-18T14:44:11.730 INFO:tasks.rados.rados.0.smithi134.stdout:289: done (1 left) 2024-04-18T14:44:11.730 INFO:tasks.rados.rados.0.smithi134.stdout:append oid 8 current snap is 25 2024-04-18T14:44:11.730 INFO:tasks.rados.rados.0.smithi134.stdout:291: seq_num 121 ranges {622592=491520,1114112=802816,1916928=720896,2637824=32768} 2024-04-18T14:44:11.738 INFO:tasks.rados.rados.0.smithi134.stdout:291: writing smithi13430248-8 from 622592 to 1114112 tid 1 2024-04-18T14:44:11.744 INFO:tasks.rados.rados.0.smithi134.stdout:291: writing smithi13430248-8 from 1114112 to 1916928 tid 2 2024-04-18T14:44:11.750 INFO:tasks.rados.rados.0.smithi134.stdout:291: writing smithi13430248-8 from 1916928 to 2637824 tid 3 2024-04-18T14:44:11.750 INFO:tasks.rados.rados.0.smithi134.stdout:291: writing smithi13430248-8 from 2637824 to 2670592 tid 4 2024-04-18T14:44:11.750 INFO:tasks.rados.rados.0.smithi134.stdout:292: read oid 36 snap -1 2024-04-18T14:44:11.751 INFO:tasks.rados.rados.0.smithi134.stdout:292: expect (ObjNum 100 snap 21 seq_num 100) 2024-04-18T14:44:11.751 INFO:tasks.rados.rados.0.smithi134.stdout:293: read oid 40 snap -1 2024-04-18T14:44:11.751 INFO:tasks.rados.rados.0.smithi134.stdout:293: expect (ObjNum 120 snap 25 seq_num 120) 2024-04-18T14:44:11.751 INFO:tasks.rados.rados.0.smithi134.stdout:append oid 43 current snap is 25 2024-04-18T14:44:11.751 INFO:tasks.rados.rados.0.smithi134.stdout:update_object_version oid 41 v 61 (ObjNum 103 snap 21 seq_num 103) dirty exists 2024-04-18T14:44:11.751 INFO:tasks.rados.rados.0.smithi134.stdout:294: seq_num 122 ranges {98304=507904,606208=425984,1032192=442368,1474560=540672,2015232=147456} 2024-04-18T14:44:11.754 INFO:tasks.rados.rados.0.smithi134.stdout:294: writing smithi13430248-43 from 98304 to 606208 tid 1 2024-04-18T14:44:11.757 INFO:tasks.rados.rados.0.smithi134.stdout:294: writing smithi13430248-43 from 606208 to 1032192 tid 2 2024-04-18T14:44:11.760 INFO:tasks.rados.rados.0.smithi134.stdout:294: writing smithi13430248-43 from 1032192 to 1474560 tid 3 2024-04-18T14:44:11.764 INFO:tasks.rados.rados.0.smithi134.stdout:294: writing smithi13430248-43 from 1474560 to 2015232 tid 4 2024-04-18T14:44:11.766 INFO:tasks.rados.rados.0.smithi134.stdout:294: writing smithi13430248-43 from 2015232 to 2162688 tid 5 2024-04-18T14:44:11.766 INFO:tasks.rados.rados.0.smithi134.stdout:290: done (4 left) 2024-04-18T14:44:11.766 INFO:tasks.rados.rados.0.smithi134.stdout:295: read oid 34 snap -1 2024-04-18T14:44:11.766 INFO:tasks.rados.rados.0.smithi134.stdout:295: expect (ObjNum 33 snap 0 seq_num 33) 2024-04-18T14:44:11.766 INFO:tasks.rados.rados.0.smithi134.stdout:296: read oid 18 snap -1 2024-04-18T14:44:11.766 INFO:tasks.rados.rados.0.smithi134.stdout:296: expect (ObjNum 44 snap 0 seq_num 44) 2024-04-18T14:44:11.766 INFO:tasks.rados.rados.0.smithi134.stdout:297: read oid 7 snap -1 2024-04-18T14:44:11.766 INFO:tasks.rados.rados.0.smithi134.stdout:297: expect deleted 2024-04-18T14:44:11.766 INFO:tasks.rados.rados.0.smithi134.stdout:append oid 27 current snap is 25 2024-04-18T14:44:11.767 INFO:tasks.rados.rados.0.smithi134.stdout:291: finishing write tid 1 to smithi13430248-8 2024-04-18T14:44:11.767 INFO:tasks.rados.rados.0.smithi134.stdout:291: finishing write tid 2 to smithi13430248-8 2024-04-18T14:44:11.767 INFO:tasks.rados.rados.0.smithi134.stdout:298: seq_num 123 ranges {442368=524288,966656=573440,1540096=688128,2228224=294912} 2024-04-18T14:44:11.771 INFO:tasks.ceph.osd.4.smithi086.stderr:2024-04-18T14:44:11.770+0000 7f0c4c462640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 24956) UID: 0 2024-04-18T14:44:11.772 INFO:tasks.rados.rados.0.smithi134.stdout:298: writing smithi13430248-27 from 442368 to 966656 tid 1 2024-04-18T14:44:11.777 INFO:tasks.rados.rados.0.smithi134.stdout:298: writing smithi13430248-27 from 966656 to 1540096 tid 2 2024-04-18T14:44:11.780 INFO:tasks.rados.rados.0.smithi134.stdout:298: writing smithi13430248-27 from 1540096 to 2228224 tid 3 2024-04-18T14:44:11.783 INFO:tasks.rados.rados.0.smithi134.stdout:298: writing smithi13430248-27 from 2228224 to 2523136 tid 4 2024-04-18T14:44:11.783 INFO:tasks.rados.rados.0.smithi134.stdout:299: delete oid 5 current snap is 25 2024-04-18T14:44:11.783 INFO:tasks.rados.rados.0.smithi134.stdout:295: expect (ObjNum 33 snap 0 seq_num 33) 2024-04-18T14:44:11.799 INFO:tasks.rados.rados.0.smithi134.stdout:294: finishing write tid 1 to smithi13430248-43 2024-04-18T14:44:11.799 INFO:tasks.rados.rados.0.smithi134.stdout:294: finishing write tid 2 to smithi13430248-43 2024-04-18T14:44:11.799 INFO:tasks.rados.rados.0.smithi134.stdout:294: finishing write tid 3 to smithi13430248-43 2024-04-18T14:44:11.799 INFO:tasks.rados.rados.0.smithi134.stdout:292: expect (ObjNum 100 snap 21 seq_num 100) 2024-04-18T14:44:11.854 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-04-18T14:44:11.854 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [], 2024-04-18T14:44:11.855 INFO:teuthology.orchestra.run.smithi134.stdout: "num_ops": 0 2024-04-18T14:44:11.855 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-04-18T14:44:11.868 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-04-18T14:44:11.869 INFO:tasks.rados.rados.0.smithi134.stdout:291: finishing write tid 3 to smithi13430248-8 2024-04-18T14:44:11.869 INFO:tasks.rados.rados.0.smithi134.stdout:291: finishing write tid 4 to smithi13430248-8 2024-04-18T14:44:11.869 INFO:tasks.rados.rados.0.smithi134.stdout:292: done (8 left) 2024-04-18T14:44:11.869 INFO:tasks.rados.rados.0.smithi134.stdout:295: done (7 left) 2024-04-18T14:44:11.869 INFO:tasks.rados.rados.0.smithi134.stdout:297: done (6 left) 2024-04-18T14:44:11.870 INFO:tasks.rados.rados.0.smithi134.stdout:299: done (5 left) 2024-04-18T14:44:11.870 INFO:tasks.rados.rados.0.smithi134.stdout:300: rmattr oid 37 current snap is 25 2024-04-18T14:44:11.870 INFO:tasks.rados.rados.0.smithi134.stdout:300: done (5 left) 2024-04-18T14:44:11.870 INFO:tasks.rados.rados.0.smithi134.stdout:301: read oid 45 snap 21 2024-04-18T14:44:11.870 INFO:tasks.rados.rados.0.smithi134.stdout:301: expect deleted 2024-04-18T14:44:11.870 INFO:tasks.rados.rados.0.smithi134.stdout:302: snap_create 2024-04-18T14:44:11.870 INFO:tasks.rados.rados.0.smithi134.stdout:291: finishing write tid 5 to smithi13430248-8 2024-04-18T14:44:11.870 INFO:tasks.rados.rados.0.smithi134.stdout:294: finishing write tid 4 to smithi13430248-43 2024-04-18T14:44:11.870 INFO:tasks.rados.rados.0.smithi134.stdout:294: finishing write tid 5 to smithi13430248-43 2024-04-18T14:44:11.870 INFO:tasks.rados.rados.0.smithi134.stdout:294: finishing write tid 6 to smithi13430248-43 2024-04-18T14:44:11.870 INFO:tasks.rados.rados.0.smithi134.stdout:296: expect (ObjNum 44 snap 0 seq_num 44) 2024-04-18T14:44:11.871 INFO:tasks.ceph.osd.14.smithi119.stderr:2024-04-18T14:44:11.874+0000 7f180f599640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 14 (PID: 24900) UID: 0 2024-04-18T14:44:11.891 INFO:tasks.rados.rados.0.smithi134.stdout:298: finishing write tid 1 to smithi13430248-27 2024-04-18T14:44:11.891 INFO:tasks.rados.rados.0.smithi134.stdout:298: finishing write tid 2 to smithi13430248-27 2024-04-18T14:44:11.891 INFO:tasks.rados.rados.0.smithi134.stdout:291: finishing write tid 6 to smithi13430248-8 2024-04-18T14:44:11.891 INFO:tasks.rados.rados.0.smithi134.stdout:291: oid 8 updating version 0 to 119 2024-04-18T14:44:11.891 INFO:tasks.rados.rados.0.smithi134.stdout:291: oid 8 updating version 119 to 123 2024-04-18T14:44:11.891 INFO:tasks.rados.rados.0.smithi134.stdout:291: oid 8 version 123 is already newer than 122 2024-04-18T14:44:11.891 INFO:tasks.rados.rados.0.smithi134.stdout:291: oid 8 version 123 is already newer than 120 2024-04-18T14:44:11.891 INFO:tasks.rados.rados.0.smithi134.stdout:291: oid 8 version 123 is already newer than 121 2024-04-18T14:44:11.891 INFO:tasks.rados.rados.0.smithi134.stdout:update_object_version oid 8 v 123 (ObjNum 121 snap 25 seq_num 121) dirty exists 2024-04-18T14:44:11.891 INFO:tasks.rados.rados.0.smithi134.stdout:291: left oid 8 (ObjNum 121 snap 25 seq_num 121) 2024-04-18T14:44:11.891 INFO:tasks.rados.rados.0.smithi134.stdout:294: finishing write tid 7 to smithi13430248-43 2024-04-18T14:44:11.891 INFO:tasks.rados.rados.0.smithi134.stdout:294: oid 43 updating version 0 to 127 2024-04-18T14:44:11.891 INFO:tasks.rados.rados.0.smithi134.stdout:294: oid 43 updating version 127 to 128 2024-04-18T14:44:11.891 INFO:tasks.rados.rados.0.smithi134.stdout:294: oid 43 version 128 is already newer than 126 2024-04-18T14:44:11.892 INFO:tasks.rados.rados.0.smithi134.stdout:294: oid 43 version 128 is already newer than 125 2024-04-18T14:44:11.892 INFO:tasks.rados.rados.0.smithi134.stdout:294: oid 43 updating version 128 to 129 2024-04-18T14:44:11.892 INFO:tasks.rados.rados.0.smithi134.stdout:294: oid 43 version 129 is already newer than 124 2024-04-18T14:44:11.892 INFO:tasks.rados.rados.0.smithi134.stdout:update_object_version oid 43 v 129 (ObjNum 122 snap 25 seq_num 122) dirty exists 2024-04-18T14:44:11.892 INFO:tasks.rados.rados.0.smithi134.stdout:294: left oid 43 (ObjNum 122 snap 25 seq_num 122) 2024-04-18T14:44:11.892 INFO:tasks.rados.rados.0.smithi134.stdout:298: finishing write tid 3 to smithi13430248-27 2024-04-18T14:44:11.892 INFO:tasks.rados.rados.0.smithi134.stdout:298: finishing write tid 4 to smithi13430248-27 2024-04-18T14:44:11.892 INFO:tasks.rados.rados.0.smithi134.stdout:298: finishing write tid 5 to smithi13430248-27 2024-04-18T14:44:11.892 INFO:tasks.rados.rados.0.smithi134.stdout:298: finishing write tid 6 to smithi13430248-27 2024-04-18T14:44:11.892 INFO:tasks.rados.rados.0.smithi134.stdout:298: oid 27 updating version 0 to 131 2024-04-18T14:44:11.892 INFO:tasks.rados.rados.0.smithi134.stdout:298: oid 27 updating version 131 to 133 2024-04-18T14:44:11.892 INFO:tasks.rados.rados.0.smithi134.stdout:298: oid 27 version 133 is already newer than 132 2024-04-18T14:44:11.892 INFO:tasks.rados.rados.0.smithi134.stdout:298: oid 27 updating version 133 to 135 2024-04-18T14:44:11.892 INFO:tasks.rados.rados.0.smithi134.stdout:298: oid 27 version 135 is already newer than 134 2024-04-18T14:44:11.892 INFO:tasks.rados.rados.0.smithi134.stdout:update_object_version oid 27 v 135 (ObjNum 123 snap 25 seq_num 123) dirty exists 2024-04-18T14:44:11.893 INFO:tasks.rados.rados.0.smithi134.stdout:298: left oid 27 (ObjNum 123 snap 25 seq_num 123) 2024-04-18T14:44:11.893 INFO:tasks.rados.rados.0.smithi134.stdout:293: expect (ObjNum 120 snap 25 seq_num 120) 2024-04-18T14:44:11.973 INFO:tasks.ceph.osd.12.smithi086.stderr:2024-04-18T14:44:11.974+0000 7f6904968640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 12 (PID: 24960) UID: 0 2024-04-18T14:44:12.008 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-04-18T14:44:12.008 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [], 2024-04-18T14:44:12.008 INFO:teuthology.orchestra.run.smithi134.stdout: "complaint_time": 30, 2024-04-18T14:44:12.008 INFO:teuthology.orchestra.run.smithi134.stdout: "num_blocked_ops": 0 2024-04-18T14:44:12.008 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-04-18T14:44:12.021 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-18T14:44:12.023 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-04-18T14:44:12.074 INFO:tasks.ceph.osd.5.smithi096.stderr:2024-04-18T14:44:12.073+0000 7fc33f25b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 24889) UID: 0 2024-04-18T14:44:12.145 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-04-18T14:44:12.146 INFO:teuthology.orchestra.run.smithi134.stdout: "size": 20, 2024-04-18T14:44:12.146 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 600, 2024-04-18T14:44:12.146 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [ 2024-04-18T14:44:12.146 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:12.146 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "MOSDECSubOpWrite(3.as1 35/30 ECSubWrite(tid=16, reqid=client.4559.0:176, at_version=35'10, trim_to=0'0, roll_forward_to=33'8))", 2024-04-18T14:44:12.146 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T14:43:34.719973+0000", 2024-04-18T14:44:12.146 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 37.427884356, 2024-04-18T14:44:12.146 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0071817529999999999, 2024-04-18T14:44:12.146 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T14:44:12.146 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-04-18T14:44:12.146 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T14:44:12.146 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:12.146 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T14:44:12.147 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:34.719973+0000", 2024-04-18T14:44:12.147 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:44:12.147 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:12.147 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:12.147 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T14:44:12.147 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:34.719973+0000", 2024-04-18T14:44:12.147 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:44:12.147 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:12.147 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:12.147 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T14:44:12.147 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:34.719973+0000", 2024-04-18T14:44:12.147 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-04-18T14:44:12.147 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:12.147 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:12.148 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T14:44:12.148 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:34.720054+0000", 2024-04-18T14:44:12.148 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.0933000000000006e-05 2024-04-18T14:44:12.148 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:12.148 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:12.148 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T14:44:12.148 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:34.720091+0000", 2024-04-18T14:44:12.148 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.7611000000000003e-05 2024-04-18T14:44:12.148 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:12.148 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:12.148 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T14:44:12.148 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:34.725072+0000", 2024-04-18T14:44:12.148 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0049810920000000003 2024-04-18T14:44:12.148 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:12.148 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:12.149 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T14:44:12.149 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:34.725204+0000", 2024-04-18T14:44:12.149 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00013195700000000001 2024-04-18T14:44:12.149 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:12.149 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:12.149 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_started", 2024-04-18T14:44:12.149 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:34.725235+0000", 2024-04-18T14:44:12.149 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.0314000000000001e-05 2024-04-18T14:44:12.149 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:12.149 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:12.149 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_committed", 2024-04-18T14:44:12.149 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:34.727109+0000", 2024-04-18T14:44:12.149 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.001874625 2024-04-18T14:44:12.149 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:12.149 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:12.149 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T14:44:12.150 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:34.727155+0000", 2024-04-18T14:44:12.150 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.5748000000000003e-05 2024-04-18T14:44:12.150 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:44:12.150 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T14:44:12.150 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:44:12.150 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:12.150 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:12.150 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "MOSDECSubOpRead(3.as1 41/30 ECSubRead(tid=27, to_read={3:577932fb:::smithi13430248-41:head=0,172032,0}, subchunks={3:577932fb:::smithi13430248-41:head=[0,1]}, attrs_to_read=))", 2024-04-18T14:44:12.150 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T14:43:40.766524+0000", 2024-04-18T14:44:12.150 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 31.381333965, 2024-04-18T14:44:12.150 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0050926499999999998, 2024-04-18T14:44:12.150 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T14:44:12.150 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-04-18T14:44:12.150 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T14:44:12.151 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:12.151 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T14:44:12.151 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:40.766524+0000", 2024-04-18T14:44:12.151 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:44:12.151 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:12.151 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:12.151 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T14:44:12.151 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:40.766524+0000", 2024-04-18T14:44:12.151 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:44:12.151 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:12.151 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:12.151 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T14:44:12.151 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:40.766523+0000", 2024-04-18T14:44:12.151 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-04-18T14:44:12.151 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:12.152 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:12.152 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T14:44:12.152 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:40.766545+0000", 2024-04-18T14:44:12.152 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2164e-05 2024-04-18T14:44:12.152 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:12.152 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:12.152 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T14:44:12.152 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:40.766592+0000", 2024-04-18T14:44:12.152 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.6953999999999998e-05 2024-04-18T14:44:12.152 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:12.152 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:12.152 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T14:44:12.152 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:40.766620+0000", 2024-04-18T14:44:12.152 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.7937e-05 2024-04-18T14:44:12.152 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:12.153 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:12.153 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T14:44:12.153 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:40.766833+0000", 2024-04-18T14:44:12.153 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000213122 2024-04-18T14:44:12.153 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:12.153 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:12.153 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T14:44:12.153 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:40.771616+0000", 2024-04-18T14:44:12.153 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0047831530000000001 2024-04-18T14:44:12.153 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:44:12.153 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T14:44:12.153 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:44:12.153 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:12.153 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:12.153 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "MOSDECSubOpRead(3.as1 41/30 ECSubRead(tid=28, to_read={3:577932fb:::smithi13430248-41:head=0,172032,0}, subchunks={3:577932fb:::smithi13430248-41:head=[0,1]}, attrs_to_read=))", 2024-04-18T14:44:12.154 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T14:43:40.767264+0000", 2024-04-18T14:44:12.154 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 31.380593274999999, 2024-04-18T14:44:12.154 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0045755769999999999, 2024-04-18T14:44:12.154 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T14:44:12.154 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-04-18T14:44:12.154 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T14:44:12.154 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:12.154 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T14:44:12.154 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:40.767264+0000", 2024-04-18T14:44:12.154 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:44:12.154 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:12.154 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:12.154 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T14:44:12.154 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:40.767264+0000", 2024-04-18T14:44:12.155 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:44:12.155 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:12.155 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:12.155 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T14:44:12.155 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:40.767263+0000", 2024-04-18T14:44:12.155 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999986 2024-04-18T14:44:12.155 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:12.155 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:12.155 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T14:44:12.155 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:40.767278+0000", 2024-04-18T14:44:12.155 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.502e-05 2024-04-18T14:44:12.155 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:12.155 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:12.155 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T14:44:12.155 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:40.767305+0000", 2024-04-18T14:44:12.156 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.7007000000000001e-05 2024-04-18T14:44:12.156 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:12.156 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:12.156 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T14:44:12.156 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:40.767362+0000", 2024-04-18T14:44:12.156 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.7485000000000003e-05 2024-04-18T14:44:12.156 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:12.156 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:12.156 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T14:44:12.156 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:40.771714+0000", 2024-04-18T14:44:12.156 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0043512430000000003 2024-04-18T14:44:12.156 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:12.156 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:12.156 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T14:44:12.156 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:40.771840+0000", 2024-04-18T14:44:12.157 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000126222 2024-04-18T14:44:12.157 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:44:12.157 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T14:44:12.157 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:44:12.157 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:12.157 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:12.157 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "MOSDECSubOpWrite(3.6s5 45/30 ECSubWrite(tid=62, reqid=client.4559.0:310, at_version=45'19, trim_to=0'0, roll_forward_to=44'17))", 2024-04-18T14:44:12.157 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T14:43:44.540683+0000", 2024-04-18T14:44:12.157 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 27.607174637, 2024-04-18T14:44:12.157 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0059607940000000002, 2024-04-18T14:44:12.157 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T14:44:12.157 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-04-18T14:44:12.157 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T14:44:12.157 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:12.157 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T14:44:12.158 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:44.540683+0000", 2024-04-18T14:44:12.158 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:44:12.158 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:12.158 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:12.158 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T14:44:12.158 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:44.540683+0000", 2024-04-18T14:44:12.158 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:44:12.158 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:12.158 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:12.158 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T14:44:12.158 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:44.540682+0000", 2024-04-18T14:44:12.158 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-18T14:44:12.158 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:12.158 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:12.158 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T14:44:12.159 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:44.541332+0000", 2024-04-18T14:44:12.159 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000650222 2024-04-18T14:44:12.159 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:12.159 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:12.159 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T14:44:12.159 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:44.541363+0000", 2024-04-18T14:44:12.159 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.0341e-05 2024-04-18T14:44:12.159 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:12.159 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:12.159 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T14:44:12.159 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:44.541378+0000", 2024-04-18T14:44:12.159 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.577e-05 2024-04-18T14:44:12.159 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:12.159 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:12.160 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T14:44:12.160 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:44.541490+0000", 2024-04-18T14:44:12.160 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000111512 2024-04-18T14:44:12.160 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:12.160 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:12.160 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_started", 2024-04-18T14:44:12.160 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:44.541514+0000", 2024-04-18T14:44:12.160 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.3898000000000001e-05 2024-04-18T14:44:12.160 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:12.160 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:12.160 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_committed", 2024-04-18T14:44:12.160 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:44.546604+0000", 2024-04-18T14:44:12.160 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0050903770000000001 2024-04-18T14:44:12.160 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:12.160 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:12.161 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T14:44:12.161 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:44.546644+0000", 2024-04-18T14:44:12.161 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.9594000000000001e-05 2024-04-18T14:44:12.161 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:44:12.161 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T14:44:12.161 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:44:12.161 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:12.161 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:12.161 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "MOSDECSubOpWrite(3.2s5 46/30 ECSubWrite(tid=190, reqid=osd.13.0:190, at_version=46'10, trim_to=0'0, roll_forward_to=45'8))", 2024-04-18T14:44:12.161 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T14:43:45.385116+0000", 2024-04-18T14:44:12.161 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 26.762742108000001, 2024-04-18T14:44:12.161 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0044629780000000003, 2024-04-18T14:44:12.161 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T14:44:12.161 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-04-18T14:44:12.162 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T14:44:12.162 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:12.162 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T14:44:12.162 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:45.385116+0000", 2024-04-18T14:44:12.162 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:44:12.162 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:12.162 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:12.162 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T14:44:12.162 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:45.385116+0000", 2024-04-18T14:44:12.162 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:44:12.162 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:12.162 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:12.162 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T14:44:12.162 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:45.385115+0000", 2024-04-18T14:44:12.162 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-18T14:44:12.163 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:12.163 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:12.163 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T14:44:12.163 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:45.385187+0000", 2024-04-18T14:44:12.163 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.1934999999999995e-05 2024-04-18T14:44:12.163 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:12.163 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:12.163 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T14:44:12.163 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:45.385217+0000", 2024-04-18T14:44:12.163 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.0774e-05 2024-04-18T14:44:12.163 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:12.163 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:12.163 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T14:44:12.163 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:45.385239+0000", 2024-04-18T14:44:12.164 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.1967000000000002e-05 2024-04-18T14:44:12.164 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:12.164 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:12.164 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T14:44:12.164 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:45.385392+0000", 2024-04-18T14:44:12.164 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00015229999999999999 2024-04-18T14:44:12.164 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:12.164 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:12.164 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_started", 2024-04-18T14:44:12.164 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:45.385422+0000", 2024-04-18T14:44:12.164 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.029e-05 2024-04-18T14:44:12.164 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:12.164 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:12.164 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_committed", 2024-04-18T14:44:12.164 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:45.389516+0000", 2024-04-18T14:44:12.165 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0040940849999999999 2024-04-18T14:44:12.165 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:12.165 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:12.165 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T14:44:12.165 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:45.389579+0000", 2024-04-18T14:44:12.165 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.2414000000000002e-05 2024-04-18T14:44:12.165 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:44:12.165 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T14:44:12.165 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:44:12.165 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:12.165 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:12.165 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "MOSDECSubOpWrite(3.5s4 46/30 ECSubWrite(tid=14, reqid=osd.15.0:13, at_version=0'0, trim_to=0'0, roll_forward_to=46'12))", 2024-04-18T14:44:12.165 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T14:43:45.391429+0000", 2024-04-18T14:44:12.165 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 26.756428486000001, 2024-04-18T14:44:12.165 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.010693606, 2024-04-18T14:44:12.166 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T14:44:12.166 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-04-18T14:44:12.166 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T14:44:12.166 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:12.166 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T14:44:12.166 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:45.391429+0000", 2024-04-18T14:44:12.166 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:44:12.166 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:12.166 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:12.166 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T14:44:12.166 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:45.391429+0000", 2024-04-18T14:44:12.166 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:44:12.166 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:12.166 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:12.166 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T14:44:12.167 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:45.391427+0000", 2024-04-18T14:44:12.167 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999981 2024-04-18T14:44:12.167 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:12.167 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:12.167 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T14:44:12.167 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:45.391458+0000", 2024-04-18T14:44:12.167 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.04e-05 2024-04-18T14:44:12.167 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:12.167 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:12.167 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T14:44:12.167 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:45.391489+0000", 2024-04-18T14:44:12.167 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.1424000000000003e-05 2024-04-18T14:44:12.167 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:12.167 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:12.167 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T14:44:12.168 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:45.391514+0000", 2024-04-18T14:44:12.168 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.4740999999999999e-05 2024-04-18T14:44:12.168 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:12.168 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:12.168 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T14:44:12.168 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:45.392451+0000", 2024-04-18T14:44:12.168 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000937227 2024-04-18T14:44:12.168 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:12.168 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:12.168 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_started", 2024-04-18T14:44:12.168 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:45.392476+0000", 2024-04-18T14:44:12.168 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.4797e-05 2024-04-18T14:44:12.168 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:12.168 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:12.168 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_committed", 2024-04-18T14:44:12.168 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:45.402059+0000", 2024-04-18T14:44:12.169 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0095835150000000008 2024-04-18T14:44:12.169 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:12.169 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:12.169 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T14:44:12.169 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:45.402123+0000", 2024-04-18T14:44:12.169 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.3307999999999998e-05 2024-04-18T14:44:12.169 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:44:12.169 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T14:44:12.169 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:44:12.169 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:12.169 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:12.169 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "MOSDECSubOpWrite(3.2s5 46/30 ECSubWrite(tid=191, reqid=osd.13.0:190, at_version=0'0, trim_to=0'0, roll_forward_to=46'10))", 2024-04-18T14:44:12.169 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T14:43:45.395046+0000", 2024-04-18T14:44:12.169 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 26.752811243, 2024-04-18T14:44:12.169 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0074998809999999999, 2024-04-18T14:44:12.170 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T14:44:12.170 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-04-18T14:44:12.170 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T14:44:12.170 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:12.170 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T14:44:12.170 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:45.395046+0000", 2024-04-18T14:44:12.170 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:44:12.170 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:12.170 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:12.170 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T14:44:12.170 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:45.395046+0000", 2024-04-18T14:44:12.170 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:44:12.170 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:12.170 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:12.171 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T14:44:12.171 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:45.395044+0000", 2024-04-18T14:44:12.171 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999981 2024-04-18T14:44:12.171 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:12.171 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:12.171 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T14:44:12.171 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:45.395075+0000", 2024-04-18T14:44:12.171 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.0158000000000002e-05 2024-04-18T14:44:12.171 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:12.171 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:12.171 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T14:44:12.171 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:45.395107+0000", 2024-04-18T14:44:12.171 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.2465999999999997e-05 2024-04-18T14:44:12.171 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:12.171 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:12.172 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T14:44:12.172 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:45.395130+0000", 2024-04-18T14:44:12.172 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2591000000000001e-05 2024-04-18T14:44:12.172 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:12.172 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:12.172 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T14:44:12.172 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:45.395859+0000", 2024-04-18T14:44:12.172 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00072886700000000001 2024-04-18T14:44:12.172 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:12.172 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:12.172 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_started", 2024-04-18T14:44:12.172 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:45.395882+0000", 2024-04-18T14:44:12.172 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.3836999999999999e-05 2024-04-18T14:44:12.173 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:12.173 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:12.173 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_committed", 2024-04-18T14:44:12.173 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:45.402479+0000", 2024-04-18T14:44:12.173 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0065963469999999998 2024-04-18T14:44:12.173 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:12.173 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:12.173 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T14:44:12.173 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:45.402546+0000", 2024-04-18T14:44:12.173 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.7534999999999996e-05 2024-04-18T14:44:12.173 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:44:12.173 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T14:44:12.173 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:44:12.173 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:12.174 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:12.174 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "MOSDECSubOpWrite(3.6s5 50/30 ECSubWrite(tid=83, reqid=osd.14.0:83, at_version=50'34, trim_to=0'0, roll_forward_to=49'30))", 2024-04-18T14:44:12.174 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T14:43:49.400376+0000", 2024-04-18T14:44:12.174 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 22.747481315000002, 2024-04-18T14:44:12.174 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0069812629999999997, 2024-04-18T14:44:12.174 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T14:44:12.174 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-04-18T14:44:12.174 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T14:44:12.174 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:12.174 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T14:44:12.174 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:49.400376+0000", 2024-04-18T14:44:12.174 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:44:12.174 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:12.174 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:12.174 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T14:44:12.175 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:49.400376+0000", 2024-04-18T14:44:12.175 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:44:12.175 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:12.175 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:12.175 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T14:44:12.175 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:49.400374+0000", 2024-04-18T14:44:12.175 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999981 2024-04-18T14:44:12.175 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:12.175 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:12.175 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T14:44:12.175 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:49.400448+0000", 2024-04-18T14:44:12.175 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.3311000000000003e-05 2024-04-18T14:44:12.175 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:12.175 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:12.175 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T14:44:12.176 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:49.400492+0000", 2024-04-18T14:44:12.176 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.3955000000000002e-05 2024-04-18T14:44:12.176 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:12.176 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:12.176 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T14:44:12.176 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:49.400513+0000", 2024-04-18T14:44:12.176 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.1895999999999998e-05 2024-04-18T14:44:12.176 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:12.176 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:12.176 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T14:44:12.176 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:49.400642+0000", 2024-04-18T14:44:12.176 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00012908599999999999 2024-04-18T14:44:12.176 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:12.176 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:12.176 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_started", 2024-04-18T14:44:12.177 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:49.400668+0000", 2024-04-18T14:44:12.177 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.5389999999999999e-05 2024-04-18T14:44:12.177 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:12.177 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:12.177 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_committed", 2024-04-18T14:44:12.177 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:49.407304+0000", 2024-04-18T14:44:12.177 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0066362349999999999 2024-04-18T14:44:12.177 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:12.177 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:12.177 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T14:44:12.177 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:49.407358+0000", 2024-04-18T14:44:12.177 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.3486999999999998e-05 2024-04-18T14:44:12.177 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:44:12.177 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T14:44:12.177 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:44:12.178 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:12.178 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:12.178 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "MOSDECSubOpWrite(3.6s5 51/30 ECSubWrite(tid=86, reqid=client.4559.0:359, at_version=51'36, trim_to=0'0, roll_forward_to=50'34))", 2024-04-18T14:44:12.178 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T14:43:50.377763+0000", 2024-04-18T14:44:12.178 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 21.770094160999999, 2024-04-18T14:44:12.178 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0075355739999999997, 2024-04-18T14:44:12.178 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T14:44:12.178 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-04-18T14:44:12.178 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T14:44:12.178 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:12.178 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T14:44:12.178 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:50.377763+0000", 2024-04-18T14:44:12.178 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:44:12.178 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:12.178 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:12.179 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T14:44:12.179 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:50.377763+0000", 2024-04-18T14:44:12.179 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:44:12.179 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:12.179 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:12.179 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T14:44:12.179 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:50.377763+0000", 2024-04-18T14:44:12.179 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-04-18T14:44:12.179 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:12.179 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:12.179 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T14:44:12.179 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:50.377875+0000", 2024-04-18T14:44:12.179 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000112095 2024-04-18T14:44:12.179 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:12.179 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:12.179 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T14:44:12.180 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:50.377907+0000", 2024-04-18T14:44:12.180 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.1720999999999997e-05 2024-04-18T14:44:12.180 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:12.180 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:12.180 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T14:44:12.180 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:50.377932+0000", 2024-04-18T14:44:12.180 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.5182999999999999e-05 2024-04-18T14:44:12.180 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:12.180 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:12.180 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T14:44:12.180 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:50.378089+0000", 2024-04-18T14:44:12.180 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00015708200000000001 2024-04-18T14:44:12.180 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:12.180 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:12.180 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_started", 2024-04-18T14:44:12.181 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:50.378122+0000", 2024-04-18T14:44:12.181 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.3090999999999999e-05 2024-04-18T14:44:12.181 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:12.181 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:12.181 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_committed", 2024-04-18T14:44:12.181 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:50.385267+0000", 2024-04-18T14:44:12.181 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0071449829999999997 2024-04-18T14:44:12.181 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:12.181 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:12.181 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T14:44:12.181 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:50.385299+0000", 2024-04-18T14:44:12.181 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.1924999999999997e-05 2024-04-18T14:44:12.181 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:44:12.181 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T14:44:12.181 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:44:12.182 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:12.182 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:12.182 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "MOSDECSubOpWrite(3.6s5 51/30 ECSubWrite(tid=89, reqid=client.4559.0:360, at_version=51'37, trim_to=0'0, roll_forward_to=50'34))", 2024-04-18T14:44:12.182 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T14:43:50.380897+0000", 2024-04-18T14:44:12.182 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 21.766960228999999, 2024-04-18T14:44:12.182 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0057415909999999999, 2024-04-18T14:44:12.182 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T14:44:12.182 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-04-18T14:44:12.182 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T14:44:12.182 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:12.182 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T14:44:12.182 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:50.380897+0000", 2024-04-18T14:44:12.182 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:44:12.182 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:12.182 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:12.183 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T14:44:12.183 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:50.380897+0000", 2024-04-18T14:44:12.183 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:44:12.183 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:12.183 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:12.183 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T14:44:12.183 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:50.380896+0000", 2024-04-18T14:44:12.183 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999981 2024-04-18T14:44:12.183 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:12.183 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:12.183 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T14:44:12.183 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:50.380949+0000", 2024-04-18T14:44:12.183 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.3701e-05 2024-04-18T14:44:12.183 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:12.183 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:12.183 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T14:44:12.185 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:50.380991+0000", 2024-04-18T14:44:12.185 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.1597999999999997e-05 2024-04-18T14:44:12.185 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:12.185 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:12.185 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T14:44:12.185 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:50.381009+0000", 2024-04-18T14:44:12.185 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8063e-05 2024-04-18T14:44:12.185 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:12.185 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:12.185 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T14:44:12.185 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:50.381126+0000", 2024-04-18T14:44:12.185 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000116852 2024-04-18T14:44:12.186 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:12.186 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:12.186 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_started", 2024-04-18T14:44:12.186 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:50.381158+0000", 2024-04-18T14:44:12.186 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.1829999999999998e-05 2024-04-18T14:44:12.186 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:12.186 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:12.186 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_committed", 2024-04-18T14:44:12.186 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:50.386613+0000", 2024-04-18T14:44:12.186 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.005455512 2024-04-18T14:44:12.186 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:12.186 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:12.186 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T14:44:12.186 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:50.386639+0000", 2024-04-18T14:44:12.187 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.5931999999999998e-05 2024-04-18T14:44:12.187 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:44:12.187 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T14:44:12.187 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:44:12.187 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:12.187 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:12.187 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "MOSDECSubOpWrite(3.6s5 51/30 ECSubWrite(tid=93, reqid=client.4559.0:361, at_version=0'0, trim_to=0'0, roll_forward_to=51'38))", 2024-04-18T14:44:12.187 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T14:43:50.389576+0000", 2024-04-18T14:44:12.187 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 21.758281619999998, 2024-04-18T14:44:12.187 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0046882080000000001, 2024-04-18T14:44:12.187 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T14:44:12.187 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-04-18T14:44:12.187 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T14:44:12.187 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:12.187 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T14:44:12.188 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:50.389576+0000", 2024-04-18T14:44:12.188 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:44:12.188 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:12.188 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:12.188 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T14:44:12.188 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:50.389576+0000", 2024-04-18T14:44:12.188 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:44:12.188 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:12.188 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:12.188 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T14:44:12.188 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:50.389575+0000", 2024-04-18T14:44:12.188 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-18T14:44:12.188 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:12.188 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:12.188 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T14:44:12.189 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:50.389604+0000", 2024-04-18T14:44:12.189 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.9082999999999999e-05 2024-04-18T14:44:12.189 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:12.189 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:12.189 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T14:44:12.189 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:50.389621+0000", 2024-04-18T14:44:12.189 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.7439999999999999e-05 2024-04-18T14:44:12.189 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:12.189 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:12.189 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T14:44:12.189 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:50.389631+0000", 2024-04-18T14:44:12.189 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.4399999999999994e-06 2024-04-18T14:44:12.189 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:12.189 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:12.189 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T14:44:12.190 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:50.389778+0000", 2024-04-18T14:44:12.190 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000147384 2024-04-18T14:44:12.190 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:12.190 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:12.190 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_started", 2024-04-18T14:44:12.190 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:50.389811+0000", 2024-04-18T14:44:12.190 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.3154000000000001e-05 2024-04-18T14:44:12.190 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:12.190 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:12.190 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_committed", 2024-04-18T14:44:12.190 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:50.394218+0000", 2024-04-18T14:44:12.190 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0044069280000000001 2024-04-18T14:44:12.190 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:12.190 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:12.191 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T14:44:12.191 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:50.394264+0000", 2024-04-18T14:44:12.191 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.5893000000000003e-05 2024-04-18T14:44:12.191 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:44:12.191 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T14:44:12.191 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:44:12.191 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:12.191 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:12.191 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "MOSDECSubOpWrite(3.as1 51/30 ECSubWrite(tid=40, reqid=client.4559.0:363, at_version=0'0, trim_to=0'0, roll_forward_to=51'28))", 2024-04-18T14:44:12.191 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T14:43:50.391883+0000", 2024-04-18T14:44:12.191 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 21.755975000999999, 2024-04-18T14:44:12.191 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0050354600000000003, 2024-04-18T14:44:12.191 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T14:44:12.191 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-04-18T14:44:12.191 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T14:44:12.192 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:12.192 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T14:44:12.192 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:50.391883+0000", 2024-04-18T14:44:12.192 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:44:12.192 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:12.192 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:12.192 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T14:44:12.192 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:50.391883+0000", 2024-04-18T14:44:12.192 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:44:12.192 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:12.192 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:12.192 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T14:44:12.192 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:50.391880+0000", 2024-04-18T14:44:12.192 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999976 2024-04-18T14:44:12.192 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:12.193 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:12.193 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T14:44:12.193 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:50.391917+0000", 2024-04-18T14:44:12.193 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.6066999999999999e-05 2024-04-18T14:44:12.193 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:12.193 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:12.193 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T14:44:12.193 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:50.391962+0000", 2024-04-18T14:44:12.193 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.5914000000000001e-05 2024-04-18T14:44:12.193 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:12.193 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:12.193 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T14:44:12.193 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:50.391987+0000", 2024-04-18T14:44:12.193 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.4164000000000001e-05 2024-04-18T14:44:12.193 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:12.193 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:12.194 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T14:44:12.194 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:50.392124+0000", 2024-04-18T14:44:12.194 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000137665 2024-04-18T14:44:12.194 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:12.194 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:12.194 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_started", 2024-04-18T14:44:12.194 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:50.392150+0000", 2024-04-18T14:44:12.194 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.5947000000000001e-05 2024-04-18T14:44:12.194 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:12.194 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:12.194 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_committed", 2024-04-18T14:44:12.194 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:50.396889+0000", 2024-04-18T14:44:12.194 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0047389219999999996 2024-04-18T14:44:12.195 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:12.195 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:12.195 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T14:44:12.195 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:50.396918+0000", 2024-04-18T14:44:12.195 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.8968000000000001e-05 2024-04-18T14:44:12.195 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:44:12.195 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T14:44:12.195 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:44:12.195 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:12.195 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:12.195 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4559.0:495 3.ds0 3:be45a49b:::smithi13430248-50:head [copy-from ver 48] snapc 19=[19,16,14,13,11,f,b,a,7,2] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-18T14:44:12.195 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T14:43:56.541633+0000", 2024-04-18T14:44:12.195 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 15.606225030000001, 2024-04-18T14:44:12.195 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.020360488999999999, 2024-04-18T14:44:12.195 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T14:44:12.196 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T14:44:12.196 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-18T14:44:12.196 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4559", 2024-04-18T14:44:12.196 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/3113589487", 2024-04-18T14:44:12.196 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 495 2024-04-18T14:44:12.196 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:12.196 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T14:44:12.196 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:12.196 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T14:44:12.196 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:56.541633+0000", 2024-04-18T14:44:12.196 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:44:12.196 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:12.196 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:12.196 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T14:44:12.197 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:56.541633+0000", 2024-04-18T14:44:12.197 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:44:12.197 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:12.197 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:12.197 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T14:44:12.197 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:56.541631+0000", 2024-04-18T14:44:12.197 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999981 2024-04-18T14:44:12.197 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:12.197 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:12.197 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T14:44:12.197 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:56.541641+0000", 2024-04-18T14:44:12.197 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0414999999999999e-05 2024-04-18T14:44:12.197 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:12.197 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:12.197 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T14:44:12.197 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:56.541658+0000", 2024-04-18T14:44:12.198 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6626e-05 2024-04-18T14:44:12.198 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:12.198 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:12.198 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T14:44:12.198 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:56.541670+0000", 2024-04-18T14:44:12.198 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2354000000000001e-05 2024-04-18T14:44:12.198 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:12.198 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:12.198 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T14:44:12.198 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:56.541716+0000", 2024-04-18T14:44:12.198 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.5736999999999999e-05 2024-04-18T14:44:12.198 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:12.198 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:12.198 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T14:44:12.199 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:56.541792+0000", 2024-04-18T14:44:12.199 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.6038999999999995e-05 2024-04-18T14:44:12.199 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:12.199 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:12.199 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_started", 2024-04-18T14:44:12.199 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:56.551821+0000", 2024-04-18T14:44:12.199 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.010029222000000001 2024-04-18T14:44:12.199 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:12.199 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:12.199 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_committed", 2024-04-18T14:44:12.199 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:56.555036+0000", 2024-04-18T14:44:12.199 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0032150519999999999 2024-04-18T14:44:12.199 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:12.199 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:12.200 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T14:44:12.200 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:56.561911+0000", 2024-04-18T14:44:12.200 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.006874425 2024-04-18T14:44:12.200 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:12.200 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:12.200 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T14:44:12.200 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:56.561993+0000", 2024-04-18T14:44:12.200 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.2414000000000001e-05 2024-04-18T14:44:12.200 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:44:12.200 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T14:44:12.200 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:44:12.200 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:12.200 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:12.200 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4559.0:496 3.ds0 3:be45a49b:::smithi13430248-50:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e57)", 2024-04-18T14:44:12.200 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T14:43:56.541687+0000", 2024-04-18T14:44:12.201 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 15.606171100999999, 2024-04-18T14:44:12.201 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.013225494000000001, 2024-04-18T14:44:12.201 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T14:44:12.201 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-04-18T14:44:12.201 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-18T14:44:12.201 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4559", 2024-04-18T14:44:12.201 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/3113589487", 2024-04-18T14:44:12.201 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 496 2024-04-18T14:44:12.201 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:12.201 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T14:44:12.201 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:12.201 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T14:44:12.201 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:56.541687+0000", 2024-04-18T14:44:12.201 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:44:12.201 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:12.202 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:12.202 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T14:44:12.202 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:56.541687+0000", 2024-04-18T14:44:12.202 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:44:12.202 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:12.202 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:12.202 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T14:44:12.202 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:56.541686+0000", 2024-04-18T14:44:12.202 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-04-18T14:44:12.202 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:12.202 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:12.202 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T14:44:12.202 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:56.541691+0000", 2024-04-18T14:44:12.202 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.6879999999999998e-06 2024-04-18T14:44:12.203 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:12.203 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:12.203 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T14:44:12.203 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:56.541700+0000", 2024-04-18T14:44:12.203 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.5999999999999996e-06 2024-04-18T14:44:12.203 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:12.203 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:12.203 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T14:44:12.203 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:56.541708+0000", 2024-04-18T14:44:12.203 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.3490000000000003e-06 2024-04-18T14:44:12.203 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:12.203 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:12.203 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T14:44:12.203 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:56.541934+0000", 2024-04-18T14:44:12.203 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00022686399999999999 2024-04-18T14:44:12.204 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:12.204 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:12.204 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for blocked object", 2024-04-18T14:44:12.204 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:56.541985+0000", 2024-04-18T14:44:12.204 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.0426000000000001e-05 2024-04-18T14:44:12.204 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:12.204 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:12.204 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T14:44:12.204 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:56.554624+0000", 2024-04-18T14:44:12.204 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.012639091999999999 2024-04-18T14:44:12.204 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:12.204 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:12.204 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T14:44:12.204 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:56.554762+0000", 2024-04-18T14:44:12.204 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00013839000000000001 2024-04-18T14:44:12.205 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:12.205 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:12.205 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T14:44:12.205 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:56.554912+0000", 2024-04-18T14:44:12.205 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00014976200000000001 2024-04-18T14:44:12.205 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:44:12.205 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T14:44:12.205 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:44:12.205 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:12.205 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:12.205 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "MOSDECSubOpWrite(3.3s1 57/30 ECSubWrite(tid=219, reqid=client.4559.0:497, at_version=57'20, trim_to=0'0, roll_forward_to=54'18))", 2024-04-18T14:44:12.205 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T14:43:56.543669+0000", 2024-04-18T14:44:12.205 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 15.604188274, 2024-04-18T14:44:12.205 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.004692842, 2024-04-18T14:44:12.205 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T14:44:12.206 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-04-18T14:44:12.206 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T14:44:12.206 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:12.206 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T14:44:12.206 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:56.543669+0000", 2024-04-18T14:44:12.206 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:44:12.206 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:12.206 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:12.206 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T14:44:12.206 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:56.543669+0000", 2024-04-18T14:44:12.206 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:44:12.206 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:12.206 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:12.206 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T14:44:12.206 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:56.543668+0000", 2024-04-18T14:44:12.207 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-18T14:44:12.207 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:12.207 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:12.207 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T14:44:12.207 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:56.543696+0000", 2024-04-18T14:44:12.207 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.7464e-05 2024-04-18T14:44:12.207 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:12.207 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:12.207 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T14:44:12.207 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:56.543723+0000", 2024-04-18T14:44:12.207 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.7387999999999999e-05 2024-04-18T14:44:12.207 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:12.207 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:12.207 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T14:44:12.207 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:56.543734+0000", 2024-04-18T14:44:12.208 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0390999999999999e-05 2024-04-18T14:44:12.208 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:12.208 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:12.208 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T14:44:12.208 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:56.543846+0000", 2024-04-18T14:44:12.208 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000112116 2024-04-18T14:44:12.208 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:12.208 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:12.208 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_started", 2024-04-18T14:44:12.208 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:56.543864+0000", 2024-04-18T14:44:12.208 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.7966e-05 2024-04-18T14:44:12.208 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:12.208 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:12.208 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_committed", 2024-04-18T14:44:12.208 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:56.548330+0000", 2024-04-18T14:44:12.209 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0044657840000000004 2024-04-18T14:44:12.209 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:12.209 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:12.209 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T14:44:12.209 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:56.548362+0000", 2024-04-18T14:44:12.209 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.2678999999999997e-05 2024-04-18T14:44:12.209 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:44:12.209 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T14:44:12.209 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:44:12.209 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:12.209 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:12.209 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4559.0:566 3.ds0 3:be45a49b:::smithi13430248-50:head [delete] snapc 1e=[1e,1d,1c,1a,19,16,14,13,11,b,a,7,2] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e62)", 2024-04-18T14:44:12.209 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T14:44:01.385603+0000", 2024-04-18T14:44:12.209 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 10.762254674999999, 2024-04-18T14:44:12.209 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0092962909999999999, 2024-04-18T14:44:12.210 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T14:44:12.210 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T14:44:12.210 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-18T14:44:12.210 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4559", 2024-04-18T14:44:12.210 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/3113589487", 2024-04-18T14:44:12.210 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 566 2024-04-18T14:44:12.210 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:12.210 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T14:44:12.210 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:12.210 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T14:44:12.210 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:01.385603+0000", 2024-04-18T14:44:12.210 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:44:12.210 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:12.210 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:12.211 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T14:44:12.211 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:01.385603+0000", 2024-04-18T14:44:12.211 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:44:12.211 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:12.211 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:12.211 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T14:44:12.211 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:01.385600+0000", 2024-04-18T14:44:12.211 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999967 2024-04-18T14:44:12.211 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:12.211 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:12.211 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T14:44:12.211 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:01.385617+0000", 2024-04-18T14:44:12.211 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.7546000000000001e-05 2024-04-18T14:44:12.211 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:12.211 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:12.212 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T14:44:12.212 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:01.385652+0000", 2024-04-18T14:44:12.212 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.4507e-05 2024-04-18T14:44:12.212 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:12.212 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:12.212 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T14:44:12.212 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:01.385669+0000", 2024-04-18T14:44:12.212 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.7416000000000001e-05 2024-04-18T14:44:12.212 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:12.212 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:12.212 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T14:44:12.212 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:01.385813+0000", 2024-04-18T14:44:12.212 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000143296 2024-04-18T14:44:12.212 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:12.213 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:12.213 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op must wait for map", 2024-04-18T14:44:12.213 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:01.385825+0000", 2024-04-18T14:44:12.213 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2763e-05 2024-04-18T14:44:12.213 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:12.213 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:12.213 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T14:44:12.213 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:01.389415+0000", 2024-04-18T14:44:12.213 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0035898190000000002 2024-04-18T14:44:12.213 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:12.213 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:12.213 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T14:44:12.213 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:01.389575+0000", 2024-04-18T14:44:12.213 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00015958500000000001 2024-04-18T14:44:12.213 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:12.214 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:12.214 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_started", 2024-04-18T14:44:12.214 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:01.390888+0000", 2024-04-18T14:44:12.214 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0013131729999999999 2024-04-18T14:44:12.214 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:12.214 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:12.214 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_committed", 2024-04-18T14:44:12.214 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:01.392715+0000", 2024-04-18T14:44:12.214 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.001826816 2024-04-18T14:44:12.214 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:12.214 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:12.214 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T14:44:12.214 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:01.394750+0000", 2024-04-18T14:44:12.214 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.002034891 2024-04-18T14:44:12.215 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:12.215 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:12.215 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T14:44:12.215 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:01.394899+0000", 2024-04-18T14:44:12.215 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00014964899999999999 2024-04-18T14:44:12.215 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:44:12.215 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T14:44:12.215 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:44:12.215 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:12.215 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:12.215 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4559.0:619 3.ds0 3:b48f58f5:::smithi13430248-34:head [read 0~557056,checksum,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e66)", 2024-04-18T14:44:12.215 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T14:44:05.386939+0000", 2024-04-18T14:44:12.215 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 6.7609185009999999, 2024-04-18T14:44:12.215 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.011158332999999999, 2024-04-18T14:44:12.215 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T14:44:12.216 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-04-18T14:44:12.216 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-18T14:44:12.216 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4559", 2024-04-18T14:44:12.216 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/3113589487", 2024-04-18T14:44:12.216 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 619 2024-04-18T14:44:12.216 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:12.216 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T14:44:12.216 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:12.216 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T14:44:12.216 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:05.386939+0000", 2024-04-18T14:44:12.216 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:44:12.216 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:12.216 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:12.216 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T14:44:12.216 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:05.386939+0000", 2024-04-18T14:44:12.216 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:44:12.217 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:12.217 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:12.217 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T14:44:12.217 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:05.386936+0000", 2024-04-18T14:44:12.217 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999967 2024-04-18T14:44:12.217 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:12.217 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:12.217 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T14:44:12.217 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:05.386953+0000", 2024-04-18T14:44:12.217 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.7606999999999999e-05 2024-04-18T14:44:12.217 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:12.217 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:12.217 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T14:44:12.217 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:05.386996+0000", 2024-04-18T14:44:12.217 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.2599999999999999e-05 2024-04-18T14:44:12.218 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:12.218 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:12.218 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T14:44:12.218 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:05.387014+0000", 2024-04-18T14:44:12.218 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8583000000000001e-05 2024-04-18T14:44:12.218 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:12.218 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:12.218 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T14:44:12.218 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:05.387138+0000", 2024-04-18T14:44:12.218 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000123075 2024-04-18T14:44:12.218 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:12.218 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:12.218 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op must wait for map", 2024-04-18T14:44:12.218 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:05.387150+0000", 2024-04-18T14:44:12.219 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2442999999999999e-05 2024-04-18T14:44:12.219 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:12.219 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:12.219 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T14:44:12.219 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:05.391814+0000", 2024-04-18T14:44:12.219 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0046638039999999997 2024-04-18T14:44:12.219 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:12.219 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:12.219 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T14:44:12.219 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:05.392076+0000", 2024-04-18T14:44:12.219 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000261971 2024-04-18T14:44:12.219 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:12.219 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:12.219 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T14:44:12.219 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:05.398097+0000", 2024-04-18T14:44:12.220 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.006021747 2024-04-18T14:44:12.220 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:44:12.220 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T14:44:12.220 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:44:12.220 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:12.220 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:12.220 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4559.0:620 3.ds0 3:b48f58f5:::smithi13430248-34:head [read 0~557056,checksum] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e66)", 2024-04-18T14:44:12.220 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T14:44:05.387040+0000", 2024-04-18T14:44:12.220 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 6.7608180319999995, 2024-04-18T14:44:12.220 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.011816439999999999, 2024-04-18T14:44:12.220 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T14:44:12.220 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-04-18T14:44:12.220 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-18T14:44:12.220 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4559", 2024-04-18T14:44:12.220 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/3113589487", 2024-04-18T14:44:12.221 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 620 2024-04-18T14:44:12.221 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:12.221 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T14:44:12.221 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:12.221 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T14:44:12.221 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:05.387040+0000", 2024-04-18T14:44:12.221 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:44:12.221 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:12.221 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:12.221 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T14:44:12.221 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:05.387040+0000", 2024-04-18T14:44:12.221 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:44:12.221 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:12.221 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:12.222 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T14:44:12.222 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:05.387039+0000", 2024-04-18T14:44:12.222 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-18T14:44:12.222 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:12.222 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:12.222 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T14:44:12.222 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:05.387045+0000", 2024-04-18T14:44:12.222 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.5760000000000002e-06 2024-04-18T14:44:12.222 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:12.222 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:12.222 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T14:44:12.222 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:05.387057+0000", 2024-04-18T14:44:12.222 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1714e-05 2024-04-18T14:44:12.222 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:12.223 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:12.223 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T14:44:12.223 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:05.387065+0000", 2024-04-18T14:44:12.223 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.7800000000000001e-06 2024-04-18T14:44:12.223 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:12.223 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:12.223 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T14:44:12.223 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:05.387302+0000", 2024-04-18T14:44:12.223 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00023728399999999999 2024-04-18T14:44:12.223 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:12.223 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:12.223 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting_for_map not empty", 2024-04-18T14:44:12.223 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:05.387323+0000", 2024-04-18T14:44:12.223 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.1330000000000001e-05 2024-04-18T14:44:12.223 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:12.224 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:12.224 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T14:44:12.224 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:05.393386+0000", 2024-04-18T14:44:12.224 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0060623500000000002 2024-04-18T14:44:12.224 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:12.224 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:12.224 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T14:44:12.224 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:05.393566+0000", 2024-04-18T14:44:12.224 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000180135 2024-04-18T14:44:12.224 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:12.224 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:12.224 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T14:44:12.224 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:05.398856+0000", 2024-04-18T14:44:12.224 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.005290271 2024-04-18T14:44:12.224 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:44:12.225 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T14:44:12.225 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:44:12.225 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:12.225 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:12.225 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4559.0:621 3.ds0 3:b48f58f5:::smithi13430248-34:head [read 0~557056,checksum] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e66)", 2024-04-18T14:44:12.225 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T14:44:05.387116+0000", 2024-04-18T14:44:12.225 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 6.7607412760000001, 2024-04-18T14:44:12.225 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.012593152, 2024-04-18T14:44:12.225 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T14:44:12.225 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-04-18T14:44:12.225 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-18T14:44:12.225 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4559", 2024-04-18T14:44:12.225 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/3113589487", 2024-04-18T14:44:12.225 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 621 2024-04-18T14:44:12.225 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:12.226 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T14:44:12.226 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:12.226 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T14:44:12.226 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:05.387116+0000", 2024-04-18T14:44:12.226 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:44:12.226 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:12.226 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:12.226 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T14:44:12.226 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:05.387116+0000", 2024-04-18T14:44:12.226 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:44:12.226 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:12.226 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:12.226 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T14:44:12.226 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:05.387116+0000", 2024-04-18T14:44:12.227 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-18T14:44:12.227 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:12.227 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:12.227 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T14:44:12.227 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:05.387121+0000", 2024-04-18T14:44:12.227 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.0560000000000004e-06 2024-04-18T14:44:12.227 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:12.227 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:12.227 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T14:44:12.227 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:05.387131+0000", 2024-04-18T14:44:12.227 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0573e-05 2024-04-18T14:44:12.227 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:12.227 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:12.227 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T14:44:12.227 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:05.387139+0000", 2024-04-18T14:44:12.228 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.8539999999999997e-06 2024-04-18T14:44:12.228 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:12.228 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:12.228 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T14:44:12.228 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:05.387377+0000", 2024-04-18T14:44:12.228 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00023790500000000001 2024-04-18T14:44:12.228 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:12.228 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:12.228 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting_for_map not empty", 2024-04-18T14:44:12.228 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:05.387387+0000", 2024-04-18T14:44:12.228 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.7489999999999993e-06 2024-04-18T14:44:12.228 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:12.228 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:12.228 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T14:44:12.228 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:05.394286+0000", 2024-04-18T14:44:12.229 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0068987500000000004 2024-04-18T14:44:12.229 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:12.229 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:12.229 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T14:44:12.229 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:05.394424+0000", 2024-04-18T14:44:12.229 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000138629 2024-04-18T14:44:12.229 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:12.229 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:12.229 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T14:44:12.229 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:05.399710+0000", 2024-04-18T14:44:12.229 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0052853919999999999 2024-04-18T14:44:12.229 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:44:12.229 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T14:44:12.229 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:44:12.229 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:12.230 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:12.230 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "MOSDECSubOpWrite(3.6s5 72/70 ECSubWrite(tid=258, reqid=client.4559.0:720, at_version=72'106, trim_to=0'0, roll_forward_to=72'104))", 2024-04-18T14:44:12.230 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T14:44:11.443336+0000", 2024-04-18T14:44:12.230 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.70452183199999996, 2024-04-18T14:44:12.230 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0051646929999999997, 2024-04-18T14:44:12.230 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T14:44:12.230 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-04-18T14:44:12.230 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T14:44:12.230 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:12.230 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T14:44:12.230 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:11.443336+0000", 2024-04-18T14:44:12.230 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:44:12.230 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:12.231 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:12.231 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T14:44:12.231 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:11.443336+0000", 2024-04-18T14:44:12.231 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:44:12.231 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:12.231 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:12.231 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T14:44:12.231 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:11.443334+0000", 2024-04-18T14:44:12.231 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999981 2024-04-18T14:44:12.231 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:12.231 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:12.231 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T14:44:12.231 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:11.443544+0000", 2024-04-18T14:44:12.231 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00021039499999999999 2024-04-18T14:44:12.232 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:12.232 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:12.232 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T14:44:12.232 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:11.443579+0000", 2024-04-18T14:44:12.232 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.4499999999999998e-05 2024-04-18T14:44:12.232 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:12.232 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:12.232 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T14:44:12.232 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:11.443605+0000", 2024-04-18T14:44:12.232 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.597e-05 2024-04-18T14:44:12.232 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:12.232 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:12.232 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T14:44:12.232 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:11.443739+0000", 2024-04-18T14:44:12.232 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000133879 2024-04-18T14:44:12.233 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:12.233 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:12.233 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_started", 2024-04-18T14:44:12.233 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:11.443757+0000", 2024-04-18T14:44:12.233 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8790000000000001e-05 2024-04-18T14:44:12.233 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:12.233 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:12.233 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_committed", 2024-04-18T14:44:12.233 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:11.448467+0000", 2024-04-18T14:44:12.233 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.004710072 2024-04-18T14:44:12.233 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:12.233 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:12.233 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T14:44:12.233 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:11.448501+0000", 2024-04-18T14:44:12.233 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.3144e-05 2024-04-18T14:44:12.234 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:44:12.234 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T14:44:12.234 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:44:12.234 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:44:12.234 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T14:44:12.234 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-04-18T14:44:12.235 INFO:teuthology.orchestra.run.smithi086.stdout:osd.0: {} 2024-04-18T14:44:12.236 INFO:teuthology.orchestra.run.smithi086.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-18T14:44:12.236 INFO:teuthology.orchestra.run.smithi086.stdout:osd.1: {} 2024-04-18T14:44:12.236 INFO:teuthology.orchestra.run.smithi086.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-18T14:44:12.237 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.11.asok dump_ops_in_flight 2024-04-18T14:44:12.237 INFO:teuthology.orchestra.run.smithi086.stdout:osd.2: {} 2024-04-18T14:44:12.237 INFO:teuthology.orchestra.run.smithi086.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-18T14:44:12.238 INFO:teuthology.orchestra.run.smithi086.stdout:osd.3: {} 2024-04-18T14:44:12.238 INFO:teuthology.orchestra.run.smithi086.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-18T14:44:12.238 INFO:tasks.ceph.osd.12.smithi086.stderr:2024-04-18T14:44:12.234+0000 7f6904968640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 12 (PID: 24960) UID: 0 2024-04-18T14:44:12.254 INFO:teuthology.orchestra.run.smithi086.stdout:osd.4: {} 2024-04-18T14:44:12.255 INFO:teuthology.orchestra.run.smithi086.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-18T14:44:12.275 INFO:teuthology.orchestra.run.smithi086.stdout:osd.5: {} 2024-04-18T14:44:12.275 INFO:teuthology.orchestra.run.smithi086.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-18T14:44:12.295 INFO:teuthology.orchestra.run.smithi086.stdout:osd.6: {} 2024-04-18T14:44:12.295 INFO:teuthology.orchestra.run.smithi086.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-18T14:44:12.313 INFO:teuthology.orchestra.run.smithi086.stdout:osd.7: {} 2024-04-18T14:44:12.314 INFO:teuthology.orchestra.run.smithi086.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-18T14:44:12.330 INFO:teuthology.orchestra.run.smithi086.stdout:osd.8: {} 2024-04-18T14:44:12.331 INFO:teuthology.orchestra.run.smithi086.stderr:osd.8: osd_enable_op_tracker = '' 2024-04-18T14:44:12.336 INFO:tasks.ceph.osd.15.smithi134.stderr:2024-04-18T14:44:12.340+0000 7f08e6a51640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 15 (PID: 25218) UID: 0 2024-04-18T14:44:12.352 INFO:teuthology.orchestra.run.smithi086.stdout:osd.9: {} 2024-04-18T14:44:12.352 INFO:teuthology.orchestra.run.smithi086.stderr:osd.9: osd_enable_op_tracker = '' 2024-04-18T14:44:12.364 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-04-18T14:44:12.364 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [], 2024-04-18T14:44:12.364 INFO:teuthology.orchestra.run.smithi134.stdout: "num_ops": 0 2024-04-18T14:44:12.364 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-04-18T14:44:12.372 INFO:teuthology.orchestra.run.smithi086.stdout:osd.10: {} 2024-04-18T14:44:12.372 INFO:teuthology.orchestra.run.smithi086.stderr:osd.10: osd_enable_op_tracker = '' 2024-04-18T14:44:12.378 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.11.asok dump_blocked_ops 2024-04-18T14:44:12.392 INFO:teuthology.orchestra.run.smithi086.stdout:osd.11: {} 2024-04-18T14:44:12.393 INFO:teuthology.orchestra.run.smithi086.stderr:osd.11: osd_enable_op_tracker = '' 2024-04-18T14:44:12.411 INFO:teuthology.orchestra.run.smithi086.stdout:osd.12: {} 2024-04-18T14:44:12.411 INFO:teuthology.orchestra.run.smithi086.stderr:osd.12: osd_enable_op_tracker = '' 2024-04-18T14:44:12.432 INFO:teuthology.orchestra.run.smithi086.stdout:osd.13: {} 2024-04-18T14:44:12.432 INFO:teuthology.orchestra.run.smithi086.stderr:osd.13: osd_enable_op_tracker = '' 2024-04-18T14:44:12.454 INFO:teuthology.orchestra.run.smithi086.stdout:osd.14: {} 2024-04-18T14:44:12.455 INFO:teuthology.orchestra.run.smithi086.stderr:osd.14: osd_enable_op_tracker = '' 2024-04-18T14:44:12.455 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-18T14:44:12.454+0000 7f1b49096640 0 -- 172.21.15.86:0/4017872430 >> [v2:172.21.15.134:6808/25223,v1:172.21.15.134:6812/25223] conn(0x7f1b4421ee50 msgr2=0x7f1b44221240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-04-18T14:44:12.463 INFO:tasks.ceph.osd.11.smithi134.stderr:2024-04-18T14:44:12.468+0000 7f2d36f12640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 11 (PID: 25216) UID: 0 2024-04-18T14:44:12.534 INFO:teuthology.orchestra.run.smithi086.stderr:nodeep-scrub is unset 2024-04-18T14:44:12.538 INFO:tasks.ceph.osd.7.smithi134.stderr:2024-04-18T14:44:12.540+0000 7fd7de549640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25213) UID: 0 2024-04-18T14:44:12.539 INFO:tasks.rados.rados.0.smithi134.stdout:291: done (6 left) 2024-04-18T14:44:12.539 INFO:tasks.rados.rados.0.smithi134.stdout:293: done (5 left) 2024-04-18T14:44:12.539 INFO:tasks.rados.rados.0.smithi134.stdout:294: done (4 left) 2024-04-18T14:44:12.539 INFO:tasks.rados.rados.0.smithi134.stdout:296: done (3 left) 2024-04-18T14:44:12.539 INFO:tasks.rados.rados.0.smithi134.stdout:298: done (2 left) 2024-04-18T14:44:12.539 INFO:tasks.rados.rados.0.smithi134.stdout:301: done (1 left) 2024-04-18T14:44:12.539 INFO:tasks.rados.rados.0.smithi134.stdout:302: done (0 left) 2024-04-18T14:44:12.539 INFO:tasks.rados.rados.0.smithi134.stdout:303: snap_create 2024-04-18T14:44:12.540 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-04-18T14:44:12.540 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T14:44:12.555 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.11.asok dump_historic_ops 2024-04-18T14:44:12.639 INFO:tasks.ceph.osd.8.smithi086.stderr:2024-04-18T14:44:12.638+0000 7f29f7b9d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 8 (PID: 24958) UID: 0 2024-04-18T14:44:12.681 INFO:teuthology.orchestra.run.smithi086.stdout:osd.15: {} 2024-04-18T14:44:12.681 INFO:teuthology.orchestra.run.smithi086.stderr:osd.15: osd_enable_op_tracker = '' 2024-04-18T14:44:12.719 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-04-18T14:44:12.719 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T14:44:12.733 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.15.asok dump_ops_in_flight 2024-04-18T14:44:12.783 INFO:tasks.ceph.osd.7.smithi134.stderr:2024-04-18T14:44:12.788+0000 7fd7de549640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25213) UID: 0 2024-04-18T14:44:12.841 INFO:tasks.ceph.osd.10.smithi119.stderr:2024-04-18T14:44:12.842+0000 7f6f24c12640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 10 (PID: 24898) UID: 0 2024-04-18T14:44:12.854 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-04-18T14:44:12.854 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T14:44:12.869 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.15.asok dump_blocked_ops 2024-04-18T14:44:12.942 INFO:tasks.ceph.osd.14.smithi119.stderr:2024-04-18T14:44:12.946+0000 7f180f599640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 14 (PID: 24900) UID: 0 2024-04-18T14:44:13.034 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-04-18T14:44:13.035 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T14:44:13.043 INFO:tasks.ceph.osd.7.smithi134.stderr:2024-04-18T14:44:13.048+0000 7fd7de549640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25213) UID: 0 2024-04-18T14:44:13.049 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.15.asok dump_historic_ops 2024-04-18T14:44:13.144 INFO:tasks.ceph.osd.6.smithi119.stderr:2024-04-18T14:44:13.146+0000 7fb7cb8bd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 24896) UID: 0 2024-04-18T14:44:13.210 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-04-18T14:44:13.210 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T14:44:13.225 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-18T14:44:13.271 INFO:tasks.ceph.osd.0.smithi086.stderr:2024-04-18T14:44:13.270+0000 7f7cdfd78640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 24953) UID: 0 2024-04-18T14:44:13.346 INFO:tasks.ceph.osd.11.smithi134.stderr:2024-04-18T14:44:13.348+0000 7f2d36f12640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 11 (PID: 25216) UID: 0 2024-04-18T14:44:13.356 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-04-18T14:44:13.356 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T14:44:13.370 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-18T14:44:13.447 INFO:tasks.ceph.osd.2.smithi119.stderr:2024-04-18T14:44:13.446+0000 7fcbd30c0640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 24894) UID: 0 2024-04-18T14:44:13.542 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-04-18T14:44:13.542 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T14:44:13.542 INFO:tasks.rados.rados.0.smithi134.stdout:303: done (0 left) 2024-04-18T14:44:13.542 INFO:tasks.rados.rados.0.smithi134.stdout:304: snap_create 2024-04-18T14:44:13.548 INFO:tasks.ceph.osd.8.smithi086.stderr:2024-04-18T14:44:13.546+0000 7f29f7b9d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 8 (PID: 24958) UID: 0 2024-04-18T14:44:13.559 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-18T14:44:13.650 INFO:tasks.ceph.osd.4.smithi086.stderr:2024-04-18T14:44:13.649+0000 7f0c4c462640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 24956) UID: 0 2024-04-18T14:44:13.730 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-04-18T14:44:13.730 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T14:44:13.744 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-04-18T14:44:13.749 INFO:tasks.ceph.osd.14.smithi119.stderr:2024-04-18T14:44:13.750+0000 7f180f599640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 14 (PID: 24900) UID: 0 2024-04-18T14:44:13.851 INFO:tasks.ceph.osd.11.smithi134.stderr:2024-04-18T14:44:13.856+0000 7f2d36f12640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 11 (PID: 25216) UID: 0 2024-04-18T14:44:13.909 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-04-18T14:44:13.909 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T14:44:13.923 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-04-18T14:44:13.966 INFO:tasks.ceph.osd.8.smithi086.stderr:2024-04-18T14:44:13.965+0000 7f29f7b9d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 8 (PID: 24958) UID: 0 2024-04-18T14:44:14.041 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-04-18T14:44:14.041 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T14:44:14.052 INFO:tasks.ceph.osd.5.smithi096.stderr:2024-04-18T14:44:14.053+0000 7fc33f25b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 24889) UID: 0 2024-04-18T14:44:14.055 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-04-18T14:44:14.154 INFO:tasks.ceph.osd.2.smithi119.stderr:2024-04-18T14:44:14.154+0000 7fcbd30c0640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 24894) UID: 0 2024-04-18T14:44:14.219 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-04-18T14:44:14.219 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T14:44:14.234 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.8.asok dump_ops_in_flight 2024-04-18T14:44:14.279 INFO:tasks.ceph.osd.0.smithi086.stderr:2024-04-18T14:44:14.277+0000 7f7cdfd78640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 24953) UID: 0 2024-04-18T14:44:14.356 INFO:tasks.ceph.osd.6.smithi119.stderr:2024-04-18T14:44:14.358+0000 7fb7cb8bd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 24896) UID: 0 2024-04-18T14:44:14.358 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-04-18T14:44:14.358 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T14:44:14.372 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.8.asok dump_blocked_ops 2024-04-18T14:44:14.379 INFO:tasks.rados.rados.0.smithi134.stdout:304: done (0 left) 2024-04-18T14:44:14.380 INFO:tasks.rados.rados.0.smithi134.stdout:305: snap_create 2024-04-18T14:44:14.413 INFO:tasks.thrashosds.thrasher:in_osds: [0, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 1] out_osds: [] dead_osds: [] live_osds: [0, 4, 8, 12, 1, 5, 9, 13, 2, 6, 10, 14, 3, 7, 11, 15] 2024-04-18T14:44:14.413 INFO:tasks.thrashosds.thrasher:choose_action: min_in 8 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-04-18T14:44:14.413 INFO:tasks.thrashosds.thrasher:Setting full ratio to .001 2024-04-18T14:44:14.413 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set-full-ratio .001 2024-04-18T14:44:14.458 INFO:tasks.ceph.osd.10.smithi119.stderr:2024-04-18T14:44:14.458+0000 7f6f24c12640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 10 (PID: 24898) UID: 0 2024-04-18T14:44:14.541 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-04-18T14:44:14.541 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T14:44:14.556 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.8.asok dump_historic_ops 2024-04-18T14:44:14.558 INFO:tasks.ceph.osd.6.smithi119.stderr:2024-04-18T14:44:14.558+0000 7fb7cb8bd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 24896) UID: 0 2024-04-18T14:44:14.560 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-04-18T14:44:14.659 INFO:tasks.ceph.osd.12.smithi086.stderr:2024-04-18T14:44:14.657+0000 7f6904968640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 12 (PID: 24960) UID: 0 2024-04-18T14:44:14.671 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-04-18T14:44:14.672 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T14:44:14.687 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.12.asok dump_ops_in_flight 2024-04-18T14:44:14.705 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-18T14:44:14.760 INFO:tasks.ceph.osd.10.smithi119.stderr:2024-04-18T14:44:14.762+0000 7f6f24c12640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 10 (PID: 24898) UID: 0 2024-04-18T14:44:14.847 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-04-18T14:44:14.847 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T14:44:14.860 INFO:tasks.ceph.osd.0.smithi086.stderr:2024-04-18T14:44:14.857+0000 7f7cdfd78640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 24953) UID: 0 2024-04-18T14:44:14.862 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.12.asok dump_blocked_ops 2024-04-18T14:44:14.865 INFO:teuthology.orchestra.run.smithi086.stdout:osd.0: {} 2024-04-18T14:44:14.866 INFO:teuthology.orchestra.run.smithi086.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-18T14:44:14.886 INFO:teuthology.orchestra.run.smithi086.stdout:osd.1: {} 2024-04-18T14:44:14.886 INFO:teuthology.orchestra.run.smithi086.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-18T14:44:14.905 INFO:teuthology.orchestra.run.smithi086.stdout:osd.2: {} 2024-04-18T14:44:14.906 INFO:teuthology.orchestra.run.smithi086.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-18T14:44:14.925 INFO:teuthology.orchestra.run.smithi086.stdout:osd.3: {} 2024-04-18T14:44:14.925 INFO:teuthology.orchestra.run.smithi086.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-18T14:44:14.940 INFO:teuthology.orchestra.run.smithi086.stdout:osd.4: {} 2024-04-18T14:44:14.941 INFO:teuthology.orchestra.run.smithi086.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-18T14:44:14.960 INFO:teuthology.orchestra.run.smithi086.stdout:osd.5: {} 2024-04-18T14:44:14.960 INFO:teuthology.orchestra.run.smithi086.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-18T14:44:14.961 INFO:tasks.ceph.osd.0.smithi086.stderr:2024-04-18T14:44:14.957+0000 7f7cdfd78640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 24953) UID: 0 2024-04-18T14:44:14.972 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-04-18T14:44:14.972 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T14:44:14.979 INFO:teuthology.orchestra.run.smithi086.stdout:osd.6: {} 2024-04-18T14:44:14.979 INFO:teuthology.orchestra.run.smithi086.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-18T14:44:14.985 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.12.asok dump_historic_ops 2024-04-18T14:44:14.998 INFO:teuthology.orchestra.run.smithi086.stdout:osd.7: {} 2024-04-18T14:44:14.999 INFO:teuthology.orchestra.run.smithi086.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-18T14:44:15.013 INFO:teuthology.orchestra.run.smithi086.stdout:osd.8: {} 2024-04-18T14:44:15.013 INFO:teuthology.orchestra.run.smithi086.stderr:osd.8: osd_enable_op_tracker = '' 2024-04-18T14:44:15.032 INFO:teuthology.orchestra.run.smithi086.stdout:osd.9: {} 2024-04-18T14:44:15.032 INFO:teuthology.orchestra.run.smithi086.stderr:osd.9: osd_enable_op_tracker = '' 2024-04-18T14:44:15.050 INFO:teuthology.orchestra.run.smithi086.stdout:osd.10: {} 2024-04-18T14:44:15.051 INFO:teuthology.orchestra.run.smithi086.stderr:osd.10: osd_enable_op_tracker = '' 2024-04-18T14:44:15.062 INFO:tasks.ceph.osd.8.smithi086.stderr:2024-04-18T14:44:15.057+0000 7f29f7b9d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 8 (PID: 24958) UID: 0 2024-04-18T14:44:15.069 INFO:teuthology.orchestra.run.smithi086.stdout:osd.11: {} 2024-04-18T14:44:15.069 INFO:teuthology.orchestra.run.smithi086.stderr:osd.11: osd_enable_op_tracker = '' 2024-04-18T14:44:15.085 INFO:teuthology.orchestra.run.smithi086.stdout:osd.12: {} 2024-04-18T14:44:15.086 INFO:teuthology.orchestra.run.smithi086.stderr:osd.12: osd_enable_op_tracker = '' 2024-04-18T14:44:15.105 INFO:teuthology.orchestra.run.smithi086.stdout:osd.13: {} 2024-04-18T14:44:15.105 INFO:teuthology.orchestra.run.smithi086.stderr:osd.13: osd_enable_op_tracker = '' 2024-04-18T14:44:15.106 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-18T14:44:15.101+0000 7f7e9ffff640 0 -- 172.21.15.86:0/3665416280 >> [v2:172.21.15.119:6808/24905,v1:172.21.15.119:6809/24905] conn(0x7f7ea821f210 msgr2=0x7f7ea8221600 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-04-18T14:44:15.107 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-04-18T14:44:15.107 INFO:teuthology.orchestra.run.smithi086.stdout: "size": 20, 2024-04-18T14:44:15.107 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 600, 2024-04-18T14:44:15.108 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [ 2024-04-18T14:44:15.108 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:15.108 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4559.0:247 3.9s0 3:936e42fd:::smithi13430248-33:head [rollback 8] snapc 8=[8,7,4,2] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-04-18T14:44:15.108 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-04-18T14:43:40.758084+0000", 2024-04-18T14:44:15.108 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 34.350306197999998, 2024-04-18T14:44:15.108 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.01694913, 2024-04-18T14:44:15.108 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-04-18T14:44:15.108 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-04-18T14:44:15.108 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-04-18T14:44:15.108 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4559", 2024-04-18T14:44:15.108 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.134:0/3113589487", 2024-04-18T14:44:15.108 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 247 2024-04-18T14:44:15.108 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:15.108 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-04-18T14:44:15.108 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:15.108 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-04-18T14:44:15.109 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:40.758084+0000", 2024-04-18T14:44:15.109 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:44:15.109 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:15.109 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:15.109 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-04-18T14:44:15.109 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:40.758084+0000", 2024-04-18T14:44:15.109 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:44:15.109 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:15.109 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:15.109 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-04-18T14:44:15.109 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:40.758082+0000", 2024-04-18T14:44:15.109 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999976 2024-04-18T14:44:15.109 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:15.109 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:15.110 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-04-18T14:44:15.110 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:40.758095+0000", 2024-04-18T14:44:15.110 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.2542e-05 2024-04-18T14:44:15.110 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:15.110 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:15.110 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-04-18T14:44:15.110 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:40.758121+0000", 2024-04-18T14:44:15.110 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.6653e-05 2024-04-18T14:44:15.110 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:15.110 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:15.110 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-04-18T14:44:15.110 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:40.758136+0000", 2024-04-18T14:44:15.110 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.4647999999999999e-05 2024-04-18T14:44:15.110 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:15.110 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:15.110 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-04-18T14:44:15.111 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:40.758238+0000", 2024-04-18T14:44:15.111 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000102221 2024-04-18T14:44:15.111 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:15.111 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:15.111 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op must wait for map", 2024-04-18T14:44:15.111 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:40.758252+0000", 2024-04-18T14:44:15.111 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.4409999999999999e-05 2024-04-18T14:44:15.111 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:15.111 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:15.111 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-04-18T14:44:15.111 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:40.764488+0000", 2024-04-18T14:44:15.111 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0062357890000000003 2024-04-18T14:44:15.111 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:15.111 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:15.111 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-04-18T14:44:15.112 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:40.764705+0000", 2024-04-18T14:44:15.112 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00021706000000000001 2024-04-18T14:44:15.112 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:15.112 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:15.112 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-04-18T14:44:15.112 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:40.775034+0000", 2024-04-18T14:44:15.112 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.010328198 2024-04-18T14:44:15.112 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:44:15.112 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-04-18T14:44:15.112 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:44:15.112 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:15.112 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:15.112 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4559.0:486 3.9s0 3:98a09a6d:::smithi13430248-38:head [append 0~720896] snapc 19=[19,16,14,13,11,f,b,a,7,2] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-18T14:44:15.112 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-04-18T14:43:56.447555+0000", 2024-04-18T14:44:15.112 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 18.660835794, 2024-04-18T14:44:15.112 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.01549087, 2024-04-18T14:44:15.113 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-04-18T14:44:15.113 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T14:44:15.113 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-04-18T14:44:15.113 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4559", 2024-04-18T14:44:15.113 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.134:0/3113589487", 2024-04-18T14:44:15.113 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 486 2024-04-18T14:44:15.113 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:15.113 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-04-18T14:44:15.113 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:15.113 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-04-18T14:44:15.113 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:56.447555+0000", 2024-04-18T14:44:15.113 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:44:15.113 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:15.113 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:15.113 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-04-18T14:44:15.113 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:56.447555+0000", 2024-04-18T14:44:15.114 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:44:15.114 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:15.114 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:15.114 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-04-18T14:44:15.114 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:56.447551+0000", 2024-04-18T14:44:15.114 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999962 2024-04-18T14:44:15.114 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:15.114 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:15.114 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-04-18T14:44:15.114 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:56.448771+0000", 2024-04-18T14:44:15.114 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.001219543 2024-04-18T14:44:15.114 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:15.114 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:15.114 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-04-18T14:44:15.114 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:56.448806+0000", 2024-04-18T14:44:15.114 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.5199e-05 2024-04-18T14:44:15.115 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:15.115 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:15.115 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-04-18T14:44:15.115 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:56.448831+0000", 2024-04-18T14:44:15.115 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.4803e-05 2024-04-18T14:44:15.115 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:15.115 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:15.115 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-04-18T14:44:15.115 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:56.448963+0000", 2024-04-18T14:44:15.115 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00013249299999999999 2024-04-18T14:44:15.115 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:15.115 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:15.115 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-04-18T14:44:15.115 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:56.449126+0000", 2024-04-18T14:44:15.115 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00016307299999999999 2024-04-18T14:44:15.115 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:15.116 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:15.116 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_started", 2024-04-18T14:44:15.116 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:56.451189+0000", 2024-04-18T14:44:15.116 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.002062454 2024-04-18T14:44:15.116 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:15.116 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:15.116 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_committed", 2024-04-18T14:44:15.116 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:56.459360+0000", 2024-04-18T14:44:15.116 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0081711389999999991 2024-04-18T14:44:15.116 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:15.116 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:15.116 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-04-18T14:44:15.116 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:56.462826+0000", 2024-04-18T14:44:15.117 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0034659249999999999 2024-04-18T14:44:15.117 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:15.117 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:15.117 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-04-18T14:44:15.117 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:56.463046+0000", 2024-04-18T14:44:15.117 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00022002400000000001 2024-04-18T14:44:15.117 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:44:15.117 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-04-18T14:44:15.117 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:44:15.117 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:15.117 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:15.117 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4559.0:487 3.9s0 3:98a09a6d:::smithi13430248-38:head [append 0~442368] snapc 19=[19,16,14,13,11,f,b,a,7,2] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-18T14:44:15.117 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-04-18T14:43:56.450970+0000", 2024-04-18T14:44:15.117 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 18.657420700999999, 2024-04-18T14:44:15.117 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.014296059999999999, 2024-04-18T14:44:15.117 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-04-18T14:44:15.118 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T14:44:15.118 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-04-18T14:44:15.118 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4559", 2024-04-18T14:44:15.118 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.134:0/3113589487", 2024-04-18T14:44:15.118 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 487 2024-04-18T14:44:15.118 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:15.118 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-04-18T14:44:15.118 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:15.118 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-04-18T14:44:15.118 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:56.450970+0000", 2024-04-18T14:44:15.118 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:44:15.118 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:15.118 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:15.118 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-04-18T14:44:15.118 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:56.450970+0000", 2024-04-18T14:44:15.119 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:44:15.119 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:15.119 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:15.119 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-04-18T14:44:15.119 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:56.450968+0000", 2024-04-18T14:44:15.119 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999981 2024-04-18T14:44:15.119 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:15.119 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:15.119 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-04-18T14:44:15.119 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:56.452370+0000", 2024-04-18T14:44:15.119 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0014018780000000001 2024-04-18T14:44:15.119 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:15.119 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:15.119 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-04-18T14:44:15.119 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:56.452401+0000", 2024-04-18T14:44:15.119 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.0929000000000002e-05 2024-04-18T14:44:15.120 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:15.120 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:15.120 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-04-18T14:44:15.120 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:56.452421+0000", 2024-04-18T14:44:15.120 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.9996e-05 2024-04-18T14:44:15.120 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:15.120 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:15.120 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-04-18T14:44:15.120 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:56.454319+0000", 2024-04-18T14:44:15.120 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.001898928 2024-04-18T14:44:15.120 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:15.120 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:15.120 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-04-18T14:44:15.120 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:56.454545+0000", 2024-04-18T14:44:15.120 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000225107 2024-04-18T14:44:15.121 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:15.121 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:15.121 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_started", 2024-04-18T14:44:15.121 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:56.456501+0000", 2024-04-18T14:44:15.121 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0019567260000000002 2024-04-18T14:44:15.121 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:15.121 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:15.121 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_committed", 2024-04-18T14:44:15.121 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:56.461859+0000", 2024-04-18T14:44:15.121 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0053572100000000003 2024-04-18T14:44:15.121 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:15.121 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:15.121 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-04-18T14:44:15.121 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:56.465119+0000", 2024-04-18T14:44:15.122 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0032608429999999998 2024-04-18T14:44:15.122 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:15.122 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:15.122 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-04-18T14:44:15.122 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:56.465266+0000", 2024-04-18T14:44:15.122 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00014657299999999999 2024-04-18T14:44:15.122 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:44:15.122 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-04-18T14:44:15.122 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:44:15.122 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:15.122 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:15.123 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4559.0:488 3.9s0 3:98a09a6d:::smithi13430248-38:head [append 0~327680] snapc 19=[19,16,14,13,11,f,b,a,7,2] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-18T14:44:15.123 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-04-18T14:43:56.453627+0000", 2024-04-18T14:44:15.123 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 18.654763903999999, 2024-04-18T14:44:15.123 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.012641879, 2024-04-18T14:44:15.123 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-04-18T14:44:15.123 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T14:44:15.123 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-04-18T14:44:15.123 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4559", 2024-04-18T14:44:15.123 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.134:0/3113589487", 2024-04-18T14:44:15.123 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 488 2024-04-18T14:44:15.123 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:15.123 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-04-18T14:44:15.123 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:15.123 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-04-18T14:44:15.123 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:56.453627+0000", 2024-04-18T14:44:15.123 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:44:15.124 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:15.124 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:15.124 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-04-18T14:44:15.124 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:56.453627+0000", 2024-04-18T14:44:15.124 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:44:15.124 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:15.124 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:15.124 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-04-18T14:44:15.124 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:56.453624+0000", 2024-04-18T14:44:15.124 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999971 2024-04-18T14:44:15.124 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:15.124 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:15.124 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-04-18T14:44:15.125 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:56.454243+0000", 2024-04-18T14:44:15.125 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00061905300000000005 2024-04-18T14:44:15.125 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:15.125 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:15.125 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-04-18T14:44:15.125 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:56.454276+0000", 2024-04-18T14:44:15.125 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.3399000000000003e-05 2024-04-18T14:44:15.125 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:15.125 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:15.125 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-04-18T14:44:15.125 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:56.454298+0000", 2024-04-18T14:44:15.125 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.1416e-05 2024-04-18T14:44:15.125 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:15.125 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:15.125 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-04-18T14:44:15.126 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:56.459395+0000", 2024-04-18T14:44:15.126 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0050973590000000001 2024-04-18T14:44:15.126 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:15.126 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:15.126 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-04-18T14:44:15.126 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:56.459535+0000", 2024-04-18T14:44:15.126 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00013988 2024-04-18T14:44:15.126 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:15.126 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:15.126 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_started", 2024-04-18T14:44:15.126 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:56.460302+0000", 2024-04-18T14:44:15.126 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00076662500000000005 2024-04-18T14:44:15.126 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:15.126 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:15.126 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_committed", 2024-04-18T14:44:15.127 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:56.463194+0000", 2024-04-18T14:44:15.127 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0028919269999999999 2024-04-18T14:44:15.127 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:15.127 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:15.127 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-04-18T14:44:15.127 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:56.466136+0000", 2024-04-18T14:44:15.127 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0029428890000000002 2024-04-18T14:44:15.127 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:15.127 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:15.127 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-04-18T14:44:15.127 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:56.466269+0000", 2024-04-18T14:44:15.127 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00013214100000000001 2024-04-18T14:44:15.127 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:44:15.127 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-04-18T14:44:15.127 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:44:15.127 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:15.128 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:15.128 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4559.0:489 3.9s0 3:98a09a6d:::smithi13430248-38:head [setxattr _header (57) in=7b] snapc 19=[19,16,14,13,11,f,b,a,7,2] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-18T14:44:15.128 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-04-18T14:43:56.454317+0000", 2024-04-18T14:44:15.128 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 18.654073597, 2024-04-18T14:44:15.128 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.012423783000000001, 2024-04-18T14:44:15.128 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-04-18T14:44:15.128 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T14:44:15.128 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-04-18T14:44:15.128 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4559", 2024-04-18T14:44:15.128 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.134:0/3113589487", 2024-04-18T14:44:15.128 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 489 2024-04-18T14:44:15.128 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:15.128 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-04-18T14:44:15.128 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:15.128 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-04-18T14:44:15.129 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:56.454317+0000", 2024-04-18T14:44:15.129 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:44:15.129 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:15.129 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:15.129 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-04-18T14:44:15.129 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:56.454317+0000", 2024-04-18T14:44:15.129 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:44:15.129 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:15.129 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:15.129 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-04-18T14:44:15.129 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:56.454315+0000", 2024-04-18T14:44:15.129 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999986 2024-04-18T14:44:15.129 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:15.129 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:15.129 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-04-18T14:44:15.129 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:56.454328+0000", 2024-04-18T14:44:15.130 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.309e-05 2024-04-18T14:44:15.130 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:15.130 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:15.130 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-04-18T14:44:15.130 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:56.454346+0000", 2024-04-18T14:44:15.130 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.7269e-05 2024-04-18T14:44:15.130 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:15.130 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:15.130 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-04-18T14:44:15.130 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:56.454361+0000", 2024-04-18T14:44:15.130 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.5549999999999999e-05 2024-04-18T14:44:15.130 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:15.130 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:15.130 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-04-18T14:44:15.130 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:56.460968+0000", 2024-04-18T14:44:15.131 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0066067950000000004 2024-04-18T14:44:15.131 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:15.131 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:15.131 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-04-18T14:44:15.131 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:56.461114+0000", 2024-04-18T14:44:15.131 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00014624000000000001 2024-04-18T14:44:15.131 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:15.131 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:15.131 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_started", 2024-04-18T14:44:15.131 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:56.461614+0000", 2024-04-18T14:44:15.131 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00049955500000000005 2024-04-18T14:44:15.131 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:15.131 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:15.131 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_committed", 2024-04-18T14:44:15.131 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:56.464895+0000", 2024-04-18T14:44:15.132 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0032811110000000002 2024-04-18T14:44:15.132 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:15.132 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:15.132 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-04-18T14:44:15.132 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:56.466578+0000", 2024-04-18T14:44:15.132 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.001682577 2024-04-18T14:44:15.132 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:15.132 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:15.132 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-04-18T14:44:15.132 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:56.466741+0000", 2024-04-18T14:44:15.132 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00016322600000000001 2024-04-18T14:44:15.132 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:44:15.132 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-04-18T14:44:15.132 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:44:15.132 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:15.132 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:15.133 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4559.0:490 3.9s0 3:98a09a6d:::smithi13430248-38:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e57)", 2024-04-18T14:44:15.133 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-04-18T14:43:56.454375+0000", 2024-04-18T14:44:15.133 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 18.654015314999999, 2024-04-18T14:44:15.133 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.015524559, 2024-04-18T14:44:15.133 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-04-18T14:44:15.133 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-04-18T14:44:15.133 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-04-18T14:44:15.133 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4559", 2024-04-18T14:44:15.133 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.134:0/3113589487", 2024-04-18T14:44:15.133 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 490 2024-04-18T14:44:15.133 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:15.133 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-04-18T14:44:15.133 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:15.133 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-04-18T14:44:15.134 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:56.454375+0000", 2024-04-18T14:44:15.134 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:44:15.134 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:15.134 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:15.134 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-04-18T14:44:15.134 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:56.454375+0000", 2024-04-18T14:44:15.134 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:44:15.134 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:15.134 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:15.134 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-04-18T14:44:15.134 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:56.454374+0000", 2024-04-18T14:44:15.134 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999986 2024-04-18T14:44:15.134 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:15.134 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:15.135 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-04-18T14:44:15.135 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:56.454383+0000", 2024-04-18T14:44:15.135 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.4530000000000008e-06 2024-04-18T14:44:15.135 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:15.135 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:15.135 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-04-18T14:44:15.135 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:56.454402+0000", 2024-04-18T14:44:15.135 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.8315999999999999e-05 2024-04-18T14:44:15.135 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:15.135 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:15.135 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-04-18T14:44:15.135 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:56.454417+0000", 2024-04-18T14:44:15.135 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.5033e-05 2024-04-18T14:44:15.135 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:15.135 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:15.136 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-04-18T14:44:15.136 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:56.464402+0000", 2024-04-18T14:44:15.136 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0099848720000000005 2024-04-18T14:44:15.136 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:15.136 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:15.136 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for rw locks", 2024-04-18T14:44:15.136 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:56.464745+0000", 2024-04-18T14:44:15.136 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00034393 2024-04-18T14:44:15.136 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:15.136 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:15.136 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-04-18T14:44:15.136 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:56.467517+0000", 2024-04-18T14:44:15.136 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0027717839999999998 2024-04-18T14:44:15.136 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:15.136 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:15.136 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-04-18T14:44:15.137 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:56.467784+0000", 2024-04-18T14:44:15.137 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00026669200000000001 2024-04-18T14:44:15.137 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:15.137 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:15.137 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-04-18T14:44:15.137 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:56.469900+0000", 2024-04-18T14:44:15.137 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0021158919999999999 2024-04-18T14:44:15.137 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:44:15.137 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-04-18T14:44:15.137 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:44:15.137 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:15.137 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:15.137 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4559.0:502 3.9s0 3:98a09a6d:::smithi13430248-38:head [append 0~0] snapc 19=[19,16,14,13,11,f,b,a,7,2] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-18T14:44:15.137 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-04-18T14:43:56.547072+0000", 2024-04-18T14:44:15.137 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 18.561318633999999, 2024-04-18T14:44:15.138 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0091378550000000003, 2024-04-18T14:44:15.138 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-04-18T14:44:15.138 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T14:44:15.138 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-04-18T14:44:15.138 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4559", 2024-04-18T14:44:15.138 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.134:0/3113589487", 2024-04-18T14:44:15.138 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 502 2024-04-18T14:44:15.138 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:15.138 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-04-18T14:44:15.138 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:15.138 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-04-18T14:44:15.138 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:56.547072+0000", 2024-04-18T14:44:15.138 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:44:15.138 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:15.139 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:15.139 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-04-18T14:44:15.139 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:56.547072+0000", 2024-04-18T14:44:15.139 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:44:15.139 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:15.139 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:15.139 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-04-18T14:44:15.139 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:56.547069+0000", 2024-04-18T14:44:15.139 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999971 2024-04-18T14:44:15.139 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:15.139 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:15.139 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-04-18T14:44:15.139 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:56.547082+0000", 2024-04-18T14:44:15.139 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.2662e-05 2024-04-18T14:44:15.139 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:15.139 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:15.140 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-04-18T14:44:15.140 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:56.547110+0000", 2024-04-18T14:44:15.140 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.7795000000000001e-05 2024-04-18T14:44:15.140 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:15.140 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:15.140 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-04-18T14:44:15.140 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:56.547123+0000", 2024-04-18T14:44:15.140 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.3063e-05 2024-04-18T14:44:15.140 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:15.140 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:15.140 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-04-18T14:44:15.140 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:56.547202+0000", 2024-04-18T14:44:15.140 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.9250000000000002e-05 2024-04-18T14:44:15.140 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:15.140 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:15.140 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-04-18T14:44:15.141 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:56.547338+0000", 2024-04-18T14:44:15.141 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000136379 2024-04-18T14:44:15.141 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:15.141 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:15.141 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_started", 2024-04-18T14:44:15.141 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:56.547734+0000", 2024-04-18T14:44:15.141 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000395654 2024-04-18T14:44:15.141 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:15.141 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:15.141 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_committed", 2024-04-18T14:44:15.141 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:56.550762+0000", 2024-04-18T14:44:15.141 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0030281349999999999 2024-04-18T14:44:15.141 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:15.141 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:15.141 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-04-18T14:44:15.141 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:56.556144+0000", 2024-04-18T14:44:15.142 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0053817980000000001 2024-04-18T14:44:15.142 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:15.142 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:15.142 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-04-18T14:44:15.142 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:56.556210+0000", 2024-04-18T14:44:15.142 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.5889999999999994e-05 2024-04-18T14:44:15.142 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:44:15.142 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-04-18T14:44:15.142 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:44:15.142 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:15.142 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:15.142 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4559.0:503 3.9s0 3:98a09a6d:::smithi13430248-38:head [rollback b] snapc 19=[19,16,14,13,11,f,b,a,7,2] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-18T14:44:15.142 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-04-18T14:43:56.547141+0000", 2024-04-18T14:44:15.142 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 18.56124917, 2024-04-18T14:44:15.143 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.010673334, 2024-04-18T14:44:15.143 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-04-18T14:44:15.143 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T14:44:15.143 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-04-18T14:44:15.143 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4559", 2024-04-18T14:44:15.143 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.134:0/3113589487", 2024-04-18T14:44:15.143 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 503 2024-04-18T14:44:15.143 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:15.143 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-04-18T14:44:15.143 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:15.143 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-04-18T14:44:15.143 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:56.547141+0000", 2024-04-18T14:44:15.143 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:44:15.143 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:15.143 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:15.143 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-04-18T14:44:15.143 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:56.547141+0000", 2024-04-18T14:44:15.144 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:44:15.144 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:15.144 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:15.144 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-04-18T14:44:15.144 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:56.547141+0000", 2024-04-18T14:44:15.144 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-04-18T14:44:15.144 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:15.144 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:15.144 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-04-18T14:44:15.144 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:56.547146+0000", 2024-04-18T14:44:15.144 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.1100000000000002e-06 2024-04-18T14:44:15.144 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:15.144 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:15.144 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-04-18T14:44:15.144 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:56.547157+0000", 2024-04-18T14:44:15.144 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.1328000000000001e-05 2024-04-18T14:44:15.145 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:15.145 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:15.145 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-04-18T14:44:15.145 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:56.547175+0000", 2024-04-18T14:44:15.145 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.7564e-05 2024-04-18T14:44:15.145 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:15.145 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:15.145 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-04-18T14:44:15.145 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:56.548083+0000", 2024-04-18T14:44:15.145 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00090815000000000004 2024-04-18T14:44:15.145 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:15.145 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:15.145 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-04-18T14:44:15.145 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:56.548225+0000", 2024-04-18T14:44:15.145 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00014208800000000001 2024-04-18T14:44:15.146 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:15.146 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:15.146 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_started", 2024-04-18T14:44:15.146 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:56.549058+0000", 2024-04-18T14:44:15.146 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00083258799999999999 2024-04-18T14:44:15.146 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:15.146 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:15.146 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_committed", 2024-04-18T14:44:15.146 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:56.550878+0000", 2024-04-18T14:44:15.146 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0018205750000000001 2024-04-18T14:44:15.146 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:15.146 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:15.146 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-04-18T14:44:15.146 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:56.557756+0000", 2024-04-18T14:44:15.146 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0068781570000000002 2024-04-18T14:44:15.147 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:15.147 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:15.147 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-04-18T14:44:15.147 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:56.557815+0000", 2024-04-18T14:44:15.147 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.8501000000000001e-05 2024-04-18T14:44:15.147 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:44:15.147 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-04-18T14:44:15.147 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:44:15.147 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:15.147 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:15.147 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4559.0:504 3.9s0 3:98a09a6d:::smithi13430248-38:head [append 0~0] snapc 19=[19,16,14,13,11,f,b,a,7,2] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-18T14:44:15.147 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-04-18T14:43:56.547183+0000", 2024-04-18T14:44:15.147 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 18.561207886999998, 2024-04-18T14:44:15.147 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.013133432, 2024-04-18T14:44:15.147 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-04-18T14:44:15.147 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T14:44:15.148 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-04-18T14:44:15.148 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4559", 2024-04-18T14:44:15.148 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.134:0/3113589487", 2024-04-18T14:44:15.148 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 504 2024-04-18T14:44:15.148 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:15.148 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-04-18T14:44:15.148 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:15.148 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-04-18T14:44:15.148 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:56.547183+0000", 2024-04-18T14:44:15.148 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:44:15.148 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:15.148 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:15.148 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-04-18T14:44:15.148 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:56.547183+0000", 2024-04-18T14:44:15.148 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:44:15.149 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:15.149 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:15.149 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-04-18T14:44:15.149 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:56.547182+0000", 2024-04-18T14:44:15.149 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-04-18T14:44:15.149 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:15.149 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:15.149 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-04-18T14:44:15.149 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:56.547186+0000", 2024-04-18T14:44:15.149 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.464e-06 2024-04-18T14:44:15.149 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:15.149 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:15.149 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-04-18T14:44:15.149 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:56.547196+0000", 2024-04-18T14:44:15.149 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.5400000000000001e-06 2024-04-18T14:44:15.150 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:15.150 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:15.150 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-04-18T14:44:15.150 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:56.547203+0000", 2024-04-18T14:44:15.150 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.72e-06 2024-04-18T14:44:15.150 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:15.150 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:15.150 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-04-18T14:44:15.150 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:56.549707+0000", 2024-04-18T14:44:15.150 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0025045990000000001 2024-04-18T14:44:15.150 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:15.150 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:15.150 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-04-18T14:44:15.150 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:56.549841+0000", 2024-04-18T14:44:15.150 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000133404 2024-04-18T14:44:15.151 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:15.151 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:15.151 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_started", 2024-04-18T14:44:15.151 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:56.550457+0000", 2024-04-18T14:44:15.151 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00061647000000000004 2024-04-18T14:44:15.151 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:15.151 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:15.151 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_committed", 2024-04-18T14:44:15.151 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:56.551675+0000", 2024-04-18T14:44:15.151 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0012178600000000001 2024-04-18T14:44:15.151 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:15.151 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:15.151 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-04-18T14:44:15.151 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:56.560246+0000", 2024-04-18T14:44:15.151 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0085714169999999996 2024-04-18T14:44:15.151 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:15.152 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:15.152 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-04-18T14:44:15.152 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:56.560316+0000", 2024-04-18T14:44:15.152 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.9645000000000002e-05 2024-04-18T14:44:15.152 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:44:15.152 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-04-18T14:44:15.152 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:44:15.152 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:15.152 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:15.152 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4559.0:507 3.9s0 3:9cf55191:::smithi13430248-16:head [copy-from ver 48] snapc 19=[19,16,14,13,11,f,b,a,7,2] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-18T14:44:15.152 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-04-18T14:43:56.576189+0000", 2024-04-18T14:44:15.152 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 18.532201312000002, 2024-04-18T14:44:15.152 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.020256327000000001, 2024-04-18T14:44:15.152 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-04-18T14:44:15.152 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T14:44:15.152 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-04-18T14:44:15.153 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4559", 2024-04-18T14:44:15.153 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.134:0/3113589487", 2024-04-18T14:44:15.153 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 507 2024-04-18T14:44:15.153 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:15.153 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-04-18T14:44:15.153 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:15.153 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-04-18T14:44:15.153 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:56.576189+0000", 2024-04-18T14:44:15.153 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:44:15.153 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:15.153 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:15.153 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-04-18T14:44:15.153 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:56.576189+0000", 2024-04-18T14:44:15.153 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:44:15.153 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:15.154 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:15.154 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-04-18T14:44:15.154 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:56.576187+0000", 2024-04-18T14:44:15.154 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999976 2024-04-18T14:44:15.154 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:15.154 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:15.154 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-04-18T14:44:15.154 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:56.576199+0000", 2024-04-18T14:44:15.154 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.2729e-05 2024-04-18T14:44:15.154 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:15.154 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:15.154 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-04-18T14:44:15.154 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:56.576222+0000", 2024-04-18T14:44:15.154 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.2047000000000001e-05 2024-04-18T14:44:15.154 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:15.155 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:15.155 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-04-18T14:44:15.155 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:56.576233+0000", 2024-04-18T14:44:15.155 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.1741e-05 2024-04-18T14:44:15.155 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:15.155 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:15.155 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-04-18T14:44:15.155 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:56.576290+0000", 2024-04-18T14:44:15.155 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.6774000000000002e-05 2024-04-18T14:44:15.155 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:15.155 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:15.155 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-04-18T14:44:15.155 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:56.576423+0000", 2024-04-18T14:44:15.155 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00013259 2024-04-18T14:44:15.155 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:15.155 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:15.155 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_started", 2024-04-18T14:44:15.156 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:56.585718+0000", 2024-04-18T14:44:15.156 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0092951079999999998 2024-04-18T14:44:15.156 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:15.156 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:15.156 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_committed", 2024-04-18T14:44:15.156 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:56.593570+0000", 2024-04-18T14:44:15.156 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.007852632 2024-04-18T14:44:15.156 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:15.156 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:15.156 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-04-18T14:44:15.156 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:56.596350+0000", 2024-04-18T14:44:15.156 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0027794489999999998 2024-04-18T14:44:15.156 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:15.156 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:15.156 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-04-18T14:44:15.157 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:56.596446+0000", 2024-04-18T14:44:15.157 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.5773000000000006e-05 2024-04-18T14:44:15.157 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:44:15.157 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-04-18T14:44:15.157 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:44:15.157 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:15.157 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:15.157 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4559.0:508 3.9s0 3:9cf55191:::smithi13430248-16:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e57)", 2024-04-18T14:44:15.157 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-04-18T14:43:56.576245+0000", 2024-04-18T14:44:15.157 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 18.532145389, 2024-04-18T14:44:15.157 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.012675728000000001, 2024-04-18T14:44:15.157 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-04-18T14:44:15.157 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-04-18T14:44:15.157 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-04-18T14:44:15.157 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4559", 2024-04-18T14:44:15.157 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.134:0/3113589487", 2024-04-18T14:44:15.158 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 508 2024-04-18T14:44:15.158 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:15.158 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-04-18T14:44:15.158 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:15.158 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-04-18T14:44:15.158 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:56.576245+0000", 2024-04-18T14:44:15.158 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:44:15.158 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:15.158 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:15.158 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-04-18T14:44:15.158 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:56.576245+0000", 2024-04-18T14:44:15.158 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:44:15.158 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:15.158 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:15.158 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-04-18T14:44:15.159 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:56.576245+0000", 2024-04-18T14:44:15.159 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-04-18T14:44:15.159 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:15.159 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:15.159 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-04-18T14:44:15.159 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:56.576248+0000", 2024-04-18T14:44:15.159 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.625e-06 2024-04-18T14:44:15.159 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:15.159 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:15.159 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-04-18T14:44:15.159 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:56.576257+0000", 2024-04-18T14:44:15.159 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.9910000000000008e-06 2024-04-18T14:44:15.159 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:15.159 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:15.159 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-04-18T14:44:15.159 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:56.576264+0000", 2024-04-18T14:44:15.160 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.5869999999999998e-06 2024-04-18T14:44:15.160 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:15.160 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:15.160 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-04-18T14:44:15.160 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:56.576670+0000", 2024-04-18T14:44:15.160 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000405976 2024-04-18T14:44:15.160 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:15.160 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:15.160 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for blocked object", 2024-04-18T14:44:15.160 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:56.576749+0000", 2024-04-18T14:44:15.160 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.8882999999999997e-05 2024-04-18T14:44:15.160 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:15.160 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:15.160 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-04-18T14:44:15.160 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:56.588691+0000", 2024-04-18T14:44:15.161 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.011942708 2024-04-18T14:44:15.161 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:15.161 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:15.161 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-04-18T14:44:15.161 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:56.588815+0000", 2024-04-18T14:44:15.161 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00012397299999999999 2024-04-18T14:44:15.161 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:15.161 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:15.161 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-04-18T14:44:15.161 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:56.588921+0000", 2024-04-18T14:44:15.161 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00010563799999999999 2024-04-18T14:44:15.161 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:44:15.161 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-04-18T14:44:15.161 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:44:15.161 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:15.162 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:15.162 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "MOSDECSubOpWrite(3.1s4 57/30 ECSubWrite(tid=39, reqid=client.4559.0:512, at_version=57'26, trim_to=0'0, roll_forward_to=53'24))", 2024-04-18T14:44:15.162 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-04-18T14:43:56.586438+0000", 2024-04-18T14:44:15.162 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 18.521952807000002, 2024-04-18T14:44:15.162 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.010461745999999999, 2024-04-18T14:44:15.162 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-04-18T14:44:15.162 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "reached pg", 2024-04-18T14:44:15.162 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-04-18T14:44:15.162 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:15.162 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-04-18T14:44:15.162 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:56.586438+0000", 2024-04-18T14:44:15.162 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:44:15.162 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:15.162 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:15.162 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-04-18T14:44:15.162 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:56.586438+0000", 2024-04-18T14:44:15.163 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:44:15.163 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:15.163 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:15.163 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-04-18T14:44:15.163 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:56.586437+0000", 2024-04-18T14:44:15.163 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999986 2024-04-18T14:44:15.163 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:15.163 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:15.163 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-04-18T14:44:15.163 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:56.588141+0000", 2024-04-18T14:44:15.163 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.001704845 2024-04-18T14:44:15.163 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:15.163 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:15.163 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-04-18T14:44:15.163 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:56.588160+0000", 2024-04-18T14:44:15.163 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.9086999999999999e-05 2024-04-18T14:44:15.164 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:15.164 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:15.164 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-04-18T14:44:15.164 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:56.588175+0000", 2024-04-18T14:44:15.164 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.4138000000000001e-05 2024-04-18T14:44:15.164 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:15.164 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:15.164 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-04-18T14:44:15.164 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:56.588719+0000", 2024-04-18T14:44:15.164 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00054445700000000004 2024-04-18T14:44:15.164 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:15.164 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:15.164 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_started", 2024-04-18T14:44:15.164 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:56.588731+0000", 2024-04-18T14:44:15.164 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.1711e-05 2024-04-18T14:44:15.164 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:15.164 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:15.165 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_committed", 2024-04-18T14:44:15.165 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:56.596867+0000", 2024-04-18T14:44:15.165 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0081359929999999994 2024-04-18T14:44:15.165 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:15.165 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:15.165 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-04-18T14:44:15.165 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:56.596900+0000", 2024-04-18T14:44:15.165 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.2753000000000003e-05 2024-04-18T14:44:15.165 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:44:15.165 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-04-18T14:44:15.165 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:44:15.165 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:15.165 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:15.165 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4559.0:580 3.9s0 3:9cf55191:::smithi13430248-16:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e62)", 2024-04-18T14:44:15.165 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-04-18T14:44:01.446416+0000", 2024-04-18T14:44:15.165 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 13.661974612, 2024-04-18T14:44:15.165 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0091626039999999995, 2024-04-18T14:44:15.166 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-04-18T14:44:15.166 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-04-18T14:44:15.166 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-04-18T14:44:15.166 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4559", 2024-04-18T14:44:15.166 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.134:0/3113589487", 2024-04-18T14:44:15.166 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 580 2024-04-18T14:44:15.166 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:15.166 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-04-18T14:44:15.166 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:15.166 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-04-18T14:44:15.166 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:01.446416+0000", 2024-04-18T14:44:15.166 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:44:15.166 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:15.166 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:15.167 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-04-18T14:44:15.167 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:01.446416+0000", 2024-04-18T14:44:15.167 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:44:15.167 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:15.167 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:15.167 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-04-18T14:44:15.167 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:01.446415+0000", 2024-04-18T14:44:15.167 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-04-18T14:44:15.167 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:15.167 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:15.167 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-04-18T14:44:15.167 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:01.446420+0000", 2024-04-18T14:44:15.167 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.2569999999999998e-06 2024-04-18T14:44:15.167 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:15.167 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:15.167 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-04-18T14:44:15.168 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:01.446434+0000", 2024-04-18T14:44:15.168 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.4136e-05 2024-04-18T14:44:15.168 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:15.168 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:15.168 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-04-18T14:44:15.168 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:01.446445+0000", 2024-04-18T14:44:15.168 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.0633e-05 2024-04-18T14:44:15.168 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:15.168 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:15.168 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-04-18T14:44:15.168 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:01.449395+0000", 2024-04-18T14:44:15.168 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.002949718 2024-04-18T14:44:15.168 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:15.168 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:15.168 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for rw locks", 2024-04-18T14:44:15.169 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:01.449533+0000", 2024-04-18T14:44:15.169 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000137806 2024-04-18T14:44:15.169 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:15.169 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:15.169 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-04-18T14:44:15.169 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:01.453383+0000", 2024-04-18T14:44:15.169 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0038508330000000001 2024-04-18T14:44:15.169 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:15.169 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:15.169 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-04-18T14:44:15.169 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:01.453462+0000", 2024-04-18T14:44:15.169 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.8818000000000003e-05 2024-04-18T14:44:15.169 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:15.169 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:15.169 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-04-18T14:44:15.169 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:01.455579+0000", 2024-04-18T14:44:15.170 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0021162860000000002 2024-04-18T14:44:15.170 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:44:15.170 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-04-18T14:44:15.170 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:44:15.170 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:15.170 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:15.170 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "MOSDECSubOpWrite(3.1s4 63/30 ECSubWrite(tid=57, reqid=osd.6.0:57, at_version=63'39, trim_to=0'0, roll_forward_to=59'35))", 2024-04-18T14:44:15.170 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-04-18T14:44:02.387500+0000", 2024-04-18T14:44:15.170 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 12.720890581000001, 2024-04-18T14:44:15.170 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0087134499999999993, 2024-04-18T14:44:15.170 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-04-18T14:44:15.170 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "reached pg", 2024-04-18T14:44:15.170 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-04-18T14:44:15.170 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:15.170 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-04-18T14:44:15.171 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:02.387500+0000", 2024-04-18T14:44:15.171 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:44:15.171 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:15.171 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:15.171 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-04-18T14:44:15.171 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:02.387500+0000", 2024-04-18T14:44:15.171 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:44:15.171 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:15.171 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:15.171 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-04-18T14:44:15.171 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:02.387500+0000", 2024-04-18T14:44:15.171 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-04-18T14:44:15.171 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:15.171 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:15.171 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-04-18T14:44:15.172 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:02.387516+0000", 2024-04-18T14:44:15.172 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.5956000000000001e-05 2024-04-18T14:44:15.172 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:15.172 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:15.172 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-04-18T14:44:15.172 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:02.387520+0000", 2024-04-18T14:44:15.172 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.6519999999999997e-06 2024-04-18T14:44:15.172 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:15.172 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:15.172 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-04-18T14:44:15.172 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:02.387524+0000", 2024-04-18T14:44:15.172 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.4240000000000002e-06 2024-04-18T14:44:15.172 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:15.172 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:15.172 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-04-18T14:44:15.173 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:02.388300+0000", 2024-04-18T14:44:15.173 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00077584300000000002 2024-04-18T14:44:15.173 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:15.173 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:15.173 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_started", 2024-04-18T14:44:15.173 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:02.388305+0000", 2024-04-18T14:44:15.173 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.6840000000000001e-06 2024-04-18T14:44:15.173 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:15.173 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:15.173 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_committed", 2024-04-18T14:44:15.173 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:02.396177+0000", 2024-04-18T14:44:15.173 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0078718980000000004 2024-04-18T14:44:15.173 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:15.173 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:15.173 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-04-18T14:44:15.173 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:02.396213+0000", 2024-04-18T14:44:15.174 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.6282999999999998e-05 2024-04-18T14:44:15.174 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:44:15.174 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-04-18T14:44:15.174 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:44:15.174 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:15.174 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:15.174 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4559.0:644 3.9s0 3:94766bb7:::smithi13430248-17:head [append 0~655360] snapc 23=[23,22,1e,1d,1c,1a,16,14,13,11,a,2] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-04-18T14:44:15.174 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-04-18T14:44:06.395465+0000", 2024-04-18T14:44:15.174 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 8.7129254710000001, 2024-04-18T14:44:15.174 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.014701519, 2024-04-18T14:44:15.174 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-04-18T14:44:15.174 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T14:44:15.174 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-04-18T14:44:15.174 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4559", 2024-04-18T14:44:15.174 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.134:0/3113589487", 2024-04-18T14:44:15.175 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 644 2024-04-18T14:44:15.175 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:15.175 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-04-18T14:44:15.175 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:15.175 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-04-18T14:44:15.175 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:06.395465+0000", 2024-04-18T14:44:15.175 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:44:15.175 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:15.175 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:15.175 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-04-18T14:44:15.175 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:06.395465+0000", 2024-04-18T14:44:15.175 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:44:15.175 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:15.175 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:15.175 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-04-18T14:44:15.175 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:06.395462+0000", 2024-04-18T14:44:15.176 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999971 2024-04-18T14:44:15.176 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:15.176 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:15.176 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-04-18T14:44:15.176 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:06.396348+0000", 2024-04-18T14:44:15.176 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00088584199999999997 2024-04-18T14:44:15.176 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:15.176 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:15.176 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-04-18T14:44:15.176 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:06.396371+0000", 2024-04-18T14:44:15.176 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.2841e-05 2024-04-18T14:44:15.176 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:15.177 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:15.177 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-04-18T14:44:15.177 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:06.396385+0000", 2024-04-18T14:44:15.177 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.3878e-05 2024-04-18T14:44:15.177 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:15.177 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:15.177 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-04-18T14:44:15.177 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:06.396460+0000", 2024-04-18T14:44:15.177 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.5066000000000003e-05 2024-04-18T14:44:15.177 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:15.177 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:15.177 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-04-18T14:44:15.177 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:06.396568+0000", 2024-04-18T14:44:15.177 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00010834 2024-04-18T14:44:15.177 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:15.177 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:15.178 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_started", 2024-04-18T14:44:15.178 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:06.397748+0000", 2024-04-18T14:44:15.178 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0011796300000000001 2024-04-18T14:44:15.178 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:15.178 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:15.178 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_committed", 2024-04-18T14:44:15.178 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:06.400307+0000", 2024-04-18T14:44:15.178 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0025595150000000001 2024-04-18T14:44:15.178 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:15.178 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:15.178 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-04-18T14:44:15.178 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:06.410069+0000", 2024-04-18T14:44:15.178 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0097613549999999993 2024-04-18T14:44:15.178 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:15.178 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:15.179 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-04-18T14:44:15.179 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:06.410167+0000", 2024-04-18T14:44:15.179 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.7874000000000005e-05 2024-04-18T14:44:15.179 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:44:15.179 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-04-18T14:44:15.179 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:44:15.179 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:15.179 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:15.179 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4559.0:645 3.9s0 3:94766bb7:::smithi13430248-17:head [append 0~606208] snapc 23=[23,22,1e,1d,1c,1a,16,14,13,11,a,2] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-04-18T14:44:15.179 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-04-18T14:44:06.400988+0000", 2024-04-18T14:44:15.179 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 8.7074030259999997, 2024-04-18T14:44:15.179 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.010162093000000001, 2024-04-18T14:44:15.179 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-04-18T14:44:15.179 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T14:44:15.179 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-04-18T14:44:15.180 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4559", 2024-04-18T14:44:15.180 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.134:0/3113589487", 2024-04-18T14:44:15.180 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 645 2024-04-18T14:44:15.180 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:15.180 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-04-18T14:44:15.180 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:15.180 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-04-18T14:44:15.180 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:06.400988+0000", 2024-04-18T14:44:15.180 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:44:15.180 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:15.180 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:15.180 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-04-18T14:44:15.180 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:06.400988+0000", 2024-04-18T14:44:15.180 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:44:15.180 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:15.181 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:15.181 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-04-18T14:44:15.181 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:06.400985+0000", 2024-04-18T14:44:15.181 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999981 2024-04-18T14:44:15.181 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:15.181 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:15.181 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-04-18T14:44:15.181 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:06.401581+0000", 2024-04-18T14:44:15.181 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00059547400000000002 2024-04-18T14:44:15.181 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:15.181 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:15.181 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-04-18T14:44:15.181 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:06.401596+0000", 2024-04-18T14:44:15.181 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.4571e-05 2024-04-18T14:44:15.181 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:15.182 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:15.182 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-04-18T14:44:15.182 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:06.401605+0000", 2024-04-18T14:44:15.182 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.4539999999999996e-06 2024-04-18T14:44:15.182 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:15.182 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:15.182 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-04-18T14:44:15.182 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:06.401633+0000", 2024-04-18T14:44:15.182 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.7543e-05 2024-04-18T14:44:15.182 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:15.182 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:15.182 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-04-18T14:44:15.182 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:06.401715+0000", 2024-04-18T14:44:15.182 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.2237999999999994e-05 2024-04-18T14:44:15.183 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:15.183 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:15.183 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_started", 2024-04-18T14:44:15.183 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:06.402419+0000", 2024-04-18T14:44:15.183 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000704056 2024-04-18T14:44:15.183 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:15.183 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:15.183 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_committed", 2024-04-18T14:44:15.183 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:06.403840+0000", 2024-04-18T14:44:15.183 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.001421463 2024-04-18T14:44:15.183 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:15.183 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:15.183 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-04-18T14:44:15.183 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:06.411078+0000", 2024-04-18T14:44:15.183 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0072378160000000002 2024-04-18T14:44:15.184 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:15.184 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:15.184 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-04-18T14:44:15.184 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:06.411150+0000", 2024-04-18T14:44:15.184 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.1570999999999996e-05 2024-04-18T14:44:15.184 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:44:15.184 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-04-18T14:44:15.184 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:44:15.184 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:15.184 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:15.184 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4559.0:647 3.9s0 3:94766bb7:::smithi13430248-17:head [append 0~81920] snapc 23=[23,22,1e,1d,1c,1a,16,14,13,11,a,2] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-04-18T14:44:15.184 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-04-18T14:44:06.406329+0000", 2024-04-18T14:44:15.184 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 8.7020614569999992, 2024-04-18T14:44:15.184 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0096303670000000008, 2024-04-18T14:44:15.184 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-04-18T14:44:15.185 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T14:44:15.185 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-04-18T14:44:15.185 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4559", 2024-04-18T14:44:15.185 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.134:0/3113589487", 2024-04-18T14:44:15.185 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 647 2024-04-18T14:44:15.185 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:15.185 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-04-18T14:44:15.185 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:15.185 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-04-18T14:44:15.185 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:06.406329+0000", 2024-04-18T14:44:15.185 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:44:15.185 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:15.185 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:15.185 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-04-18T14:44:15.185 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:06.406329+0000", 2024-04-18T14:44:15.185 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:44:15.186 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:15.186 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:15.186 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-04-18T14:44:15.186 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:06.406328+0000", 2024-04-18T14:44:15.186 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999986 2024-04-18T14:44:15.186 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:15.186 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:15.186 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-04-18T14:44:15.186 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:06.406425+0000", 2024-04-18T14:44:15.186 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.7122999999999998e-05 2024-04-18T14:44:15.186 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:15.186 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:15.186 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-04-18T14:44:15.186 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:06.406433+0000", 2024-04-18T14:44:15.187 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.0819999999999999e-06 2024-04-18T14:44:15.187 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:15.187 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:15.187 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-04-18T14:44:15.187 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:06.406438+0000", 2024-04-18T14:44:15.187 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.5140000000000003e-06 2024-04-18T14:44:15.187 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:15.187 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:15.187 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-04-18T14:44:15.187 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:06.408386+0000", 2024-04-18T14:44:15.187 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0019482309999999999 2024-04-18T14:44:15.187 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:15.187 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:15.187 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-04-18T14:44:15.188 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:06.408487+0000", 2024-04-18T14:44:15.188 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000100832 2024-04-18T14:44:15.188 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:15.188 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:15.188 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_started", 2024-04-18T14:44:15.188 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:06.408898+0000", 2024-04-18T14:44:15.188 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00041165100000000002 2024-04-18T14:44:15.188 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:15.188 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:15.188 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_committed", 2024-04-18T14:44:15.188 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:06.410294+0000", 2024-04-18T14:44:15.188 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0013958289999999999 2024-04-18T14:44:15.188 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:15.188 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:15.188 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-04-18T14:44:15.189 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:06.415886+0000", 2024-04-18T14:44:15.189 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0055916849999999999 2024-04-18T14:44:15.189 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:15.189 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:15.189 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-04-18T14:44:15.189 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:06.415960+0000", 2024-04-18T14:44:15.189 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.3771999999999998e-05 2024-04-18T14:44:15.189 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:44:15.189 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-04-18T14:44:15.189 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:44:15.189 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:15.189 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:15.189 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4559.0:648 3.9s0 3:94766bb7:::smithi13430248-17:head [setxattr _header (57) in=7b] snapc 23=[23,22,1e,1d,1c,1a,16,14,13,11,a,2] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-04-18T14:44:15.189 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-04-18T14:44:06.406441+0000", 2024-04-18T14:44:15.189 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 8.701949119, 2024-04-18T14:44:15.190 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0096501109999999994, 2024-04-18T14:44:15.190 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-04-18T14:44:15.190 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T14:44:15.190 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-04-18T14:44:15.190 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4559", 2024-04-18T14:44:15.190 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.134:0/3113589487", 2024-04-18T14:44:15.190 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 648 2024-04-18T14:44:15.190 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:15.190 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-04-18T14:44:15.190 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:15.190 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-04-18T14:44:15.190 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:06.406441+0000", 2024-04-18T14:44:15.190 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:44:15.190 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:15.191 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:15.191 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-04-18T14:44:15.191 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:06.406441+0000", 2024-04-18T14:44:15.191 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:44:15.191 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:15.191 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:15.191 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-04-18T14:44:15.191 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:06.406441+0000", 2024-04-18T14:44:15.191 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-04-18T14:44:15.191 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:15.191 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:15.191 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-04-18T14:44:15.191 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:06.406443+0000", 2024-04-18T14:44:15.191 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.3250000000000002e-06 2024-04-18T14:44:15.191 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:15.191 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:15.192 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-04-18T14:44:15.192 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:06.406447+0000", 2024-04-18T14:44:15.192 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.382e-06 2024-04-18T14:44:15.192 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:15.192 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:15.192 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-04-18T14:44:15.192 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:06.406450+0000", 2024-04-18T14:44:15.192 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.9500000000000001e-06 2024-04-18T14:44:15.192 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:15.192 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:15.192 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-04-18T14:44:15.192 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:06.409264+0000", 2024-04-18T14:44:15.192 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.002814352 2024-04-18T14:44:15.192 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:15.192 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:15.193 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-04-18T14:44:15.193 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:06.409359+0000", 2024-04-18T14:44:15.193 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.4500000000000007e-05 2024-04-18T14:44:15.193 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:15.193 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:15.193 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_started", 2024-04-18T14:44:15.193 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:06.409684+0000", 2024-04-18T14:44:15.193 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00032499699999999999 2024-04-18T14:44:15.193 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:15.193 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:15.193 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_committed", 2024-04-18T14:44:15.193 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:06.410307+0000", 2024-04-18T14:44:15.193 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00062361399999999998 2024-04-18T14:44:15.193 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:15.193 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:15.193 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-04-18T14:44:15.194 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:06.416039+0000", 2024-04-18T14:44:15.194 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0057323130000000002 2024-04-18T14:44:15.194 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:15.194 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:15.194 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-04-18T14:44:15.194 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:06.416092+0000", 2024-04-18T14:44:15.194 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.2098999999999997e-05 2024-04-18T14:44:15.194 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:44:15.194 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-04-18T14:44:15.194 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:44:15.194 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:15.194 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:15.194 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4559.0:649 3.9s0 3:94766bb7:::smithi13430248-17:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e67)", 2024-04-18T14:44:15.194 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-04-18T14:44:06.406452+0000", 2024-04-18T14:44:15.194 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 8.7019383359999996, 2024-04-18T14:44:15.195 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.011828353, 2024-04-18T14:44:15.195 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-04-18T14:44:15.195 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-04-18T14:44:15.195 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-04-18T14:44:15.195 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4559", 2024-04-18T14:44:15.195 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.134:0/3113589487", 2024-04-18T14:44:15.195 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 649 2024-04-18T14:44:15.195 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:15.195 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-04-18T14:44:15.195 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:15.195 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-04-18T14:44:15.195 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:06.406452+0000", 2024-04-18T14:44:15.195 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:44:15.195 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:15.195 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:15.196 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-04-18T14:44:15.196 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:06.406452+0000", 2024-04-18T14:44:15.196 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:44:15.196 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:15.196 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:15.196 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-04-18T14:44:15.196 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:06.406452+0000", 2024-04-18T14:44:15.196 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967296 2024-04-18T14:44:15.196 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:15.196 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:15.196 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-04-18T14:44:15.196 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:06.406455+0000", 2024-04-18T14:44:15.196 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.332e-06 2024-04-18T14:44:15.196 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:15.196 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:15.197 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-04-18T14:44:15.197 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:06.406459+0000", 2024-04-18T14:44:15.197 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.9999999999999998e-06 2024-04-18T14:44:15.197 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:15.197 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:15.197 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-04-18T14:44:15.197 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:06.406468+0000", 2024-04-18T14:44:15.197 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.3559999999999993e-06 2024-04-18T14:44:15.197 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:15.197 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:15.197 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-04-18T14:44:15.197 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:06.410228+0000", 2024-04-18T14:44:15.197 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0037600960000000001 2024-04-18T14:44:15.197 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:15.197 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:15.197 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for rw locks", 2024-04-18T14:44:15.198 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:06.410285+0000", 2024-04-18T14:44:15.198 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.7111000000000003e-05 2024-04-18T14:44:15.198 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:15.198 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:15.198 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-04-18T14:44:15.198 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:06.416450+0000", 2024-04-18T14:44:15.198 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0061647189999999999 2024-04-18T14:44:15.198 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:15.198 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:15.198 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-04-18T14:44:15.198 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:06.416596+0000", 2024-04-18T14:44:15.198 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000146484 2024-04-18T14:44:15.198 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:15.198 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:15.198 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-04-18T14:44:15.198 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:06.418281+0000", 2024-04-18T14:44:15.199 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.001684489 2024-04-18T14:44:15.199 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:44:15.199 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-04-18T14:44:15.199 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:44:15.199 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:15.199 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:15.199 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "MOSDECSubOpWrite(3.cs3 72/30 ECSubWrite(tid=193, reqid=client.4559.0:744, at_version=72'126, trim_to=0'0, roll_forward_to=71'122))", 2024-04-18T14:44:15.199 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-04-18T14:44:11.765155+0000", 2024-04-18T14:44:15.199 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 3.3432360709999998, 2024-04-18T14:44:15.199 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.010496800000000001, 2024-04-18T14:44:15.199 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-04-18T14:44:15.199 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "reached pg", 2024-04-18T14:44:15.199 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-04-18T14:44:15.199 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:15.199 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-04-18T14:44:15.200 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:11.765155+0000", 2024-04-18T14:44:15.200 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:44:15.200 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:15.200 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:15.200 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-04-18T14:44:15.200 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:11.765155+0000", 2024-04-18T14:44:15.200 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:44:15.200 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:15.200 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:15.200 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-04-18T14:44:15.200 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:11.765154+0000", 2024-04-18T14:44:15.200 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-04-18T14:44:15.200 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:15.200 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:15.200 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-04-18T14:44:15.201 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:11.765670+0000", 2024-04-18T14:44:15.201 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00051563800000000001 2024-04-18T14:44:15.201 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:15.201 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:15.201 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-04-18T14:44:15.201 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:11.765685+0000", 2024-04-18T14:44:15.201 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.5892999999999998e-05 2024-04-18T14:44:15.201 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:15.201 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:15.201 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-04-18T14:44:15.201 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:11.765695+0000", 2024-04-18T14:44:15.201 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.3899999999999999e-06 2024-04-18T14:44:15.201 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:15.201 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:15.201 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-04-18T14:44:15.201 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:11.765770+0000", 2024-04-18T14:44:15.202 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.5310999999999998e-05 2024-04-18T14:44:15.202 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:15.202 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:15.202 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_started", 2024-04-18T14:44:15.202 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:11.765786+0000", 2024-04-18T14:44:15.202 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.5951e-05 2024-04-18T14:44:15.202 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:15.202 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:15.202 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_committed", 2024-04-18T14:44:15.202 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:11.775604+0000", 2024-04-18T14:44:15.202 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0098176900000000004 2024-04-18T14:44:15.202 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:15.202 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:15.202 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-04-18T14:44:15.202 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:11.775651+0000", 2024-04-18T14:44:15.203 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.7580999999999997e-05 2024-04-18T14:44:15.203 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:44:15.203 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-04-18T14:44:15.203 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:44:15.203 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:44:15.203 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-04-18T14:44:15.203 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-04-18T14:44:15.204 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-18T14:44:15.205 INFO:tasks.ceph.osd.9.smithi096.stderr:2024-04-18T14:44:15.205+0000 7fa2c1cbf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 9 (PID: 24891) UID: 0 2024-04-18T14:44:15.306 INFO:tasks.ceph.osd.1.smithi096.stderr:2024-04-18T14:44:15.301+0000 7f56a7a98640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 24887) UID: 0 2024-04-18T14:44:15.328 INFO:teuthology.orchestra.run.smithi086.stdout:osd.14: {} 2024-04-18T14:44:15.328 INFO:teuthology.orchestra.run.smithi086.stderr:osd.14: osd_enable_op_tracker = '' 2024-04-18T14:44:15.337 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2024-04-18T14:44:15.337 INFO:teuthology.orchestra.run.smithi096.stdout: "ops": [], 2024-04-18T14:44:15.337 INFO:teuthology.orchestra.run.smithi096.stdout: "num_ops": 0 2024-04-18T14:44:15.337 INFO:teuthology.orchestra.run.smithi096.stdout:} 2024-04-18T14:44:15.351 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-18T14:44:15.358 INFO:teuthology.orchestra.run.smithi086.stdout:osd.15: {} 2024-04-18T14:44:15.358 INFO:teuthology.orchestra.run.smithi086.stderr:osd.15: osd_enable_op_tracker = '' 2024-04-18T14:44:15.374 INFO:tasks.ceph.mon.a.smithi086.stderr:2024-04-18T14:44:15.369+0000 7f0d9b663640 -1 log_channel(cluster) log [ERR] : Health check failed: full ratio(s) out of order (OSD_OUT_OF_ORDER_FULL) 2024-04-18T14:44:15.380 INFO:teuthology.orchestra.run.smithi086.stderr:osd set-full-ratio 0.001 2024-04-18T14:44:15.381 INFO:teuthology.orchestra.run.smithi086.stderr:noscrub is set 2024-04-18T14:44:15.382 INFO:tasks.rados.rados.0.smithi134.stdout:305: done (0 left) 2024-04-18T14:44:15.382 INFO:tasks.rados.rados.0.smithi134.stdout:306: setattr oid 39 current snap is 29 2024-04-18T14:44:15.385 INFO:tasks.rados.rados.0.smithi134.stdout:307: copy_from oid 17 from oid 15 current snap is 29 2024-04-18T14:44:15.385 INFO:tasks.rados.rados.0.smithi134.stdout:308: setattr oid 1 current snap is 29 2024-04-18T14:44:15.389 INFO:tasks.rados.rados.0.smithi134.stdout:309: read oid 50 snap 23 2024-04-18T14:44:15.389 INFO:tasks.rados.rados.0.smithi134.stdout:309: expect deleted 2024-04-18T14:44:15.389 INFO:tasks.rados.rados.0.smithi134.stdout:310: read oid 38 snap -1 2024-04-18T14:44:15.389 INFO:tasks.rados.rados.0.smithi134.stdout:310: expect (ObjNum 60 snap 4 seq_num 60) 2024-04-18T14:44:15.389 INFO:tasks.rados.rados.0.smithi134.stdout:311: copy_from oid 3 from oid 37 current snap is 29 2024-04-18T14:44:15.390 INFO:tasks.rados.rados.0.smithi134.stdout:312: rmattr oid 19 current snap is 29 2024-04-18T14:44:15.390 INFO:tasks.rados.rados.0.smithi134.stdout:313: copy_from oid 35 from oid 41 current snap is 29 2024-04-18T14:44:15.390 INFO:tasks.rados.rados.0.smithi134.stdout:append oid 8 current snap is 29 2024-04-18T14:44:15.390 INFO:tasks.rados.rados.0.smithi134.stdout:314: seq_num 125 ranges {2670592=557056,3227648=475136,3702784=507904,4210688=475136,4685824=98304} 2024-04-18T14:44:15.407 INFO:tasks.ceph.osd.4.smithi086.stderr:2024-04-18T14:44:15.405+0000 7f0c4c462640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 24956) UID: 0 2024-04-18T14:44:15.441 INFO:tasks.rados.rados.0.smithi134.stdout:314: writing smithi13430248-8 from 2670592 to 3227648 tid 1 2024-04-18T14:44:15.446 INFO:tasks.rados.rados.0.smithi134.stdout:314: writing smithi13430248-8 from 3227648 to 3702784 tid 2 2024-04-18T14:44:15.452 INFO:tasks.rados.rados.0.smithi134.stdout:314: writing smithi13430248-8 from 3702784 to 4210688 tid 3 2024-04-18T14:44:15.457 INFO:tasks.rados.rados.0.smithi134.stdout:314: writing smithi13430248-8 from 4210688 to 4685824 tid 4 2024-04-18T14:44:15.458 INFO:tasks.rados.rados.0.smithi134.stdout:314: writing smithi13430248-8 from 4685824 to 4784128 tid 5 2024-04-18T14:44:15.458 INFO:tasks.rados.rados.0.smithi134.stdout:315: delete oid 29 current snap is 29 2024-04-18T14:44:15.458 INFO:tasks.rados.rados.0.smithi134.stdout:update_object_version oid 1 v 97 (ObjNum 0 snap 0 seq_num 304) dirty exists 2024-04-18T14:44:15.458 INFO:tasks.rados.rados.0.smithi134.stdout:update_object_version oid 39 v 49 (ObjNum 129 snap 0 seq_num 2054927904) dirty exists 2024-04-18T14:44:15.458 INFO:tasks.rados.rados.0.smithi134.stdout:update_object_version oid 19 v 102 (ObjNum 105 snap 22 seq_num 105) dirty exists 2024-04-18T14:44:15.458 INFO:tasks.rados.rados.0.smithi134.stdout:310: expect (ObjNum 60 snap 4 seq_num 60) 2024-04-18T14:44:15.508 INFO:tasks.ceph.osd.12.smithi086.stderr:2024-04-18T14:44:15.505+0000 7f6904968640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 12 (PID: 24960) UID: 0 2024-04-18T14:44:15.528 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2024-04-18T14:44:15.529 INFO:teuthology.orchestra.run.smithi096.stdout: "ops": [], 2024-04-18T14:44:15.529 INFO:teuthology.orchestra.run.smithi096.stdout: "complaint_time": 30, 2024-04-18T14:44:15.529 INFO:teuthology.orchestra.run.smithi096.stdout: "num_blocked_ops": 0 2024-04-18T14:44:15.529 INFO:teuthology.orchestra.run.smithi096.stdout:} 2024-04-18T14:44:15.542 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-18T14:44:15.560 INFO:tasks.rados.rados.0.smithi134.stdout:307: finishing copy_from racing read to smithi13430248-17 2024-04-18T14:44:15.561 INFO:tasks.rados.rados.0.smithi134.stdout:307: finishing copy_from to smithi13430248-17 2024-04-18T14:44:15.561 INFO:tasks.rados.rados.0.smithi134.stdout:update_object_version oid 17 v 22 (ObjNum 35 snap 0 seq_num 35) dirty exists 2024-04-18T14:44:15.561 INFO:tasks.rados.rados.0.smithi134.stdout:313: finishing copy_from racing read to smithi13430248-35 2024-04-18T14:44:15.561 INFO:tasks.rados.rados.0.smithi134.stdout:311: finishing copy_from racing read to smithi13430248-3 2024-04-18T14:44:15.561 INFO:tasks.rados.rados.0.smithi134.stdout:313: finishing copy_from to smithi13430248-35 2024-04-18T14:44:15.561 INFO:tasks.rados.rados.0.smithi134.stdout:update_object_version oid 35 v 61 (ObjNum 103 snap 21 seq_num 103) dirty exists 2024-04-18T14:44:15.561 INFO:tasks.rados.rados.0.smithi134.stdout:311: finishing copy_from to smithi13430248-3 2024-04-18T14:44:15.561 INFO:tasks.rados.rados.0.smithi134.stdout:update_object_version oid 3 v 32 (ObjNum 75 snap 15 seq_num 75) dirty exists 2024-04-18T14:44:15.561 INFO:tasks.rados.rados.0.smithi134.stdout:314: finishing write tid 1 to smithi13430248-8 2024-04-18T14:44:15.561 INFO:tasks.rados.rados.0.smithi134.stdout:314: finishing write tid 2 to smithi13430248-8 2024-04-18T14:44:15.561 INFO:tasks.rados.rados.0.smithi134.stdout:314: finishing write tid 3 to smithi13430248-8 2024-04-18T14:44:15.561 INFO:tasks.rados.rados.0.smithi134.stdout:314: finishing write tid 4 to smithi13430248-8 2024-04-18T14:44:15.561 INFO:tasks.rados.rados.0.smithi134.stdout:314: finishing write tid 5 to smithi13430248-8 2024-04-18T14:44:15.561 INFO:tasks.rados.rados.0.smithi134.stdout:314: finishing write tid 6 to smithi13430248-8 2024-04-18T14:44:15.562 INFO:tasks.rados.rados.0.smithi134.stdout:314: finishing write tid 7 to smithi13430248-8 2024-04-18T14:44:15.562 INFO:tasks.rados.rados.0.smithi134.stdout:314: oid 8 updating version 0 to 131 2024-04-18T14:44:15.562 INFO:tasks.rados.rados.0.smithi134.stdout:314: oid 8 version 131 is already newer than 127 2024-04-18T14:44:15.562 INFO:tasks.rados.rados.0.smithi134.stdout:314: oid 8 updating version 131 to 132 2024-04-18T14:44:15.562 INFO:tasks.rados.rados.0.smithi134.stdout:314: oid 8 version 132 is already newer than 129 2024-04-18T14:44:15.562 INFO:tasks.rados.rados.0.smithi134.stdout:314: oid 8 version 132 is already newer than 130 2024-04-18T14:44:15.562 INFO:tasks.rados.rados.0.smithi134.stdout:314: oid 8 version 132 is already newer than 128 2024-04-18T14:44:15.562 INFO:tasks.rados.rados.0.smithi134.stdout:update_object_version oid 8 v 132 (ObjNum 125 snap 29 seq_num 125) dirty exists 2024-04-18T14:44:15.562 INFO:tasks.rados.rados.0.smithi134.stdout:314: left oid 8 (ObjNum 125 snap 29 seq_num 125) 2024-04-18T14:44:15.562 INFO:tasks.rados.rados.0.smithi134.stdout:306: done (9 left) 2024-04-18T14:44:15.562 INFO:tasks.rados.rados.0.smithi134.stdout:307: done (8 left) 2024-04-18T14:44:15.562 INFO:tasks.rados.rados.0.smithi134.stdout:308: done (7 left) 2024-04-18T14:44:15.562 INFO:tasks.rados.rados.0.smithi134.stdout:309: done (6 left) 2024-04-18T14:44:15.562 INFO:tasks.rados.rados.0.smithi134.stdout:310: done (5 left) 2024-04-18T14:44:15.562 INFO:tasks.rados.rados.0.smithi134.stdout:311: done (4 left) 2024-04-18T14:44:15.563 INFO:tasks.rados.rados.0.smithi134.stdout:312: done (3 left) 2024-04-18T14:44:15.563 INFO:tasks.rados.rados.0.smithi134.stdout:313: done (2 left) 2024-04-18T14:44:15.563 INFO:tasks.rados.rados.0.smithi134.stdout:314: done (1 left) 2024-04-18T14:44:15.563 INFO:tasks.rados.rados.0.smithi134.stdout:315: done (0 left) 2024-04-18T14:44:15.563 INFO:tasks.rados.rados.0.smithi134.stdout:316: setattr oid 49 current snap is 29 2024-04-18T14:44:15.563 INFO:tasks.rados.rados.0.smithi134.stdout:317: read oid 45 snap -1 2024-04-18T14:44:15.563 INFO:tasks.rados.rados.0.smithi134.stdout:317: expect deleted 2024-04-18T14:44:15.564 INFO:tasks.rados.rados.0.smithi134.stdout:318: copy_from oid 46 from oid 41 current snap is 29 2024-04-18T14:44:15.564 INFO:tasks.rados.rados.0.smithi134.stdout:append oid 35 current snap is 29 2024-04-18T14:44:15.564 INFO:tasks.rados.rados.0.smithi134.stdout:319: seq_num 127 ranges {2424832=589824,3014656=753664,3768320=475136,4243456=327680} 2024-04-18T14:44:15.585 INFO:tasks.rados.rados.0.smithi134.stdout:319: writing smithi13430248-35 from 2424832 to 3014656 tid 1 2024-04-18T14:44:15.591 INFO:tasks.rados.rados.0.smithi134.stdout:319: writing smithi13430248-35 from 3014656 to 3768320 tid 2 2024-04-18T14:44:15.595 INFO:tasks.rados.rados.0.smithi134.stdout:319: writing smithi13430248-35 from 3768320 to 4243456 tid 3 2024-04-18T14:44:15.597 INFO:tasks.rados.rados.0.smithi134.stdout:319: writing smithi13430248-35 from 4243456 to 4571136 tid 4 2024-04-18T14:44:15.598 INFO:tasks.rados.rados.0.smithi134.stdout:append oid 12 current snap is 29 2024-04-18T14:44:15.598 INFO:tasks.rados.rados.0.smithi134.stdout:320: seq_num 128 ranges {1310720=606208,1916928=507904,2424832=573440,2998272=475136} 2024-04-18T14:44:15.609 INFO:tasks.ceph.osd.4.smithi086.stderr:2024-04-18T14:44:15.605+0000 7f0c4c462640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 24956) UID: 0 2024-04-18T14:44:15.611 INFO:tasks.rados.rados.0.smithi134.stdout:320: writing smithi13430248-12 from 1310720 to 1916928 tid 1 2024-04-18T14:44:15.615 INFO:tasks.rados.rados.0.smithi134.stdout:320: writing smithi13430248-12 from 1916928 to 2424832 tid 2 2024-04-18T14:44:15.619 INFO:tasks.rados.rados.0.smithi134.stdout:320: writing smithi13430248-12 from 2424832 to 2998272 tid 3 2024-04-18T14:44:15.622 INFO:tasks.rados.rados.0.smithi134.stdout:320: writing smithi13430248-12 from 2998272 to 3473408 tid 4 2024-04-18T14:44:15.622 INFO:tasks.rados.rados.0.smithi134.stdout:append oid 28 current snap is 29 2024-04-18T14:44:15.623 INFO:tasks.rados.rados.0.smithi134.stdout:321: seq_num 129 ranges {1736704=622592,2359296=655360,3014656=688128,3702784=212992} 2024-04-18T14:44:15.637 INFO:tasks.rados.rados.0.smithi134.stdout:321: writing smithi13430248-28 from 1736704 to 2359296 tid 1 2024-04-18T14:44:15.641 INFO:tasks.rados.rados.0.smithi134.stdout:321: writing smithi13430248-28 from 2359296 to 3014656 tid 2 2024-04-18T14:44:15.646 INFO:tasks.rados.rados.0.smithi134.stdout:321: writing smithi13430248-28 from 3014656 to 3702784 tid 3 2024-04-18T14:44:15.647 INFO:tasks.rados.rados.0.smithi134.stdout:321: writing smithi13430248-28 from 3702784 to 3915776 tid 4 2024-04-18T14:44:15.647 INFO:tasks.rados.rados.0.smithi134.stdout:append oid 44 current snap is 29 2024-04-18T14:44:15.647 INFO:tasks.rados.rados.0.smithi134.stdout:322: seq_num 130 ranges {4620288=638976,5259264=671744,5931008=802816,6733824=81920} 2024-04-18T14:44:15.676 INFO:tasks.rados.rados.0.smithi134.stdout:322: writing smithi13430248-44 from 4620288 to 5259264 tid 1 2024-04-18T14:44:15.677 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2024-04-18T14:44:15.678 INFO:teuthology.orchestra.run.smithi096.stdout: "size": 20, 2024-04-18T14:44:15.678 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 600, 2024-04-18T14:44:15.678 INFO:teuthology.orchestra.run.smithi096.stdout: "ops": [ 2024-04-18T14:44:15.678 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:15.678 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "MOSDECSubOpWrite(3.4s3 71/70 ECSubWrite(tid=72, reqid=client.4559.0:691, at_version=71'23, trim_to=0'0, roll_forward_to=0'0))", 2024-04-18T14:44:15.678 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-04-18T14:44:10.429352+0000", 2024-04-18T14:44:15.678 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 5.2475732620000004, 2024-04-18T14:44:15.678 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0054626049999999997, 2024-04-18T14:44:15.678 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-04-18T14:44:15.678 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "reached pg", 2024-04-18T14:44:15.678 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-04-18T14:44:15.678 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:15.678 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-04-18T14:44:15.679 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:10.429352+0000", 2024-04-18T14:44:15.679 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:44:15.679 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:15.679 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:15.679 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-04-18T14:44:15.679 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:10.429352+0000", 2024-04-18T14:44:15.679 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:44:15.679 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:15.679 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:15.679 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-04-18T14:44:15.679 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:10.429351+0000", 2024-04-18T14:44:15.679 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 4294967295.9999986 2024-04-18T14:44:15.679 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:15.679 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:15.679 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-04-18T14:44:15.680 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:10.429574+0000", 2024-04-18T14:44:15.680 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000222604 2024-04-18T14:44:15.680 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:15.680 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:15.680 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-04-18T14:44:15.680 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:10.429599+0000", 2024-04-18T14:44:15.680 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.4791e-05 2024-04-18T14:44:15.680 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:15.680 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:15.680 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-04-18T14:44:15.680 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:10.429759+0000", 2024-04-18T14:44:15.680 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00016075099999999999 2024-04-18T14:44:15.680 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:15.681 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:15.681 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-04-18T14:44:15.681 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:10.429853+0000", 2024-04-18T14:44:15.681 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 9.3243000000000002e-05 2024-04-18T14:44:15.681 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:15.681 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:15.681 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_started", 2024-04-18T14:44:15.681 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:10.429871+0000", 2024-04-18T14:44:15.681 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.8272999999999999e-05 2024-04-18T14:44:15.681 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:15.681 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:15.681 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_committed", 2024-04-18T14:44:15.681 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:10.434776+0000", 2024-04-18T14:44:15.681 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.004905693 2024-04-18T14:44:15.682 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:15.682 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:15.682 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-04-18T14:44:15.682 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:10.434815+0000", 2024-04-18T14:44:15.682 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.8633000000000001e-05 2024-04-18T14:44:15.682 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:44:15.682 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T14:44:15.682 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:44:15.682 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:15.682 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:15.682 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "MOSDECSubOpWrite(3.6s2 71/70 ECSubWrite(tid=227, reqid=client.4559.0:695, at_version=71'101, trim_to=0'0, roll_forward_to=0'0))", 2024-04-18T14:44:15.682 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-04-18T14:44:10.443125+0000", 2024-04-18T14:44:15.682 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 5.2338007979999999, 2024-04-18T14:44:15.683 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0057524239999999999, 2024-04-18T14:44:15.683 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-04-18T14:44:15.683 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "reached pg", 2024-04-18T14:44:15.683 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-04-18T14:44:15.683 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:15.683 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-04-18T14:44:15.683 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:10.443125+0000", 2024-04-18T14:44:15.683 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:44:15.683 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:15.683 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:15.683 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-04-18T14:44:15.683 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:10.443125+0000", 2024-04-18T14:44:15.683 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:44:15.683 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:15.684 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:15.684 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-04-18T14:44:15.684 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:10.443124+0000", 2024-04-18T14:44:15.684 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 4294967295.999999 2024-04-18T14:44:15.684 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:15.684 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:15.684 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-04-18T14:44:15.684 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:10.443171+0000", 2024-04-18T14:44:15.684 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 4.727e-05 2024-04-18T14:44:15.684 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:15.684 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:15.684 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-04-18T14:44:15.684 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:10.443206+0000", 2024-04-18T14:44:15.684 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.4557000000000001e-05 2024-04-18T14:44:15.684 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:15.685 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:15.685 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-04-18T14:44:15.685 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:10.443219+0000", 2024-04-18T14:44:15.685 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.2714000000000001e-05 2024-04-18T14:44:15.685 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:15.685 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:15.685 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-04-18T14:44:15.685 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:10.443336+0000", 2024-04-18T14:44:15.685 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00011725199999999999 2024-04-18T14:44:15.685 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:15.685 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:15.685 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_started", 2024-04-18T14:44:15.685 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:10.443351+0000", 2024-04-18T14:44:15.685 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.4684999999999999e-05 2024-04-18T14:44:15.685 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:15.686 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:15.686 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_committed", 2024-04-18T14:44:15.686 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:10.448822+0000", 2024-04-18T14:44:15.686 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0054712809999999997 2024-04-18T14:44:15.686 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:15.686 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:15.686 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-04-18T14:44:15.686 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:10.448877+0000", 2024-04-18T14:44:15.686 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 5.5519000000000002e-05 2024-04-18T14:44:15.686 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:44:15.686 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T14:44:15.686 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:44:15.686 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:15.686 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:15.687 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "MOSDPGPush(3.6s2 71/70 [PushOp(3:6c5ba706:::smithi13430248-4:19, version: 63'59, data_included: [524288~196608], data_size: 196608, omap_header_size: 0, omap_entries_size: 0, attrset_size: 0, recovery_info: ObjectRecoveryInfo(3:6c5ba706:::smithi13430248-4:19@63'59, size: 2883584, copy_subset: [], clone_subset: {}, snapset: 26=[]:{4=[2],11=[11],19=[16,14,13],26=[26]}, object_exist: 1), after_progress: ObjectRecoveryProgress(!first, data_recovered_to:2883584, data_complete:true, omap_recovered_to:, omap_complete:true, error:false), before_progress: ObjectRecoveryProgress(!first, data_recovered_to:2097152, data_complete:false, omap_recovered_to:, omap_complete:true, error:false))])", 2024-04-18T14:44:15.687 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-04-18T14:44:10.518648+0000", 2024-04-18T14:44:15.687 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 5.1582782079999996, 2024-04-18T14:44:15.687 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0033724860000000001, 2024-04-18T14:44:15.687 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-04-18T14:44:15.687 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "reached pg", 2024-04-18T14:44:15.687 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-04-18T14:44:15.687 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:15.687 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-04-18T14:44:15.687 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:10.518648+0000", 2024-04-18T14:44:15.687 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:44:15.687 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:15.687 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:15.687 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-04-18T14:44:15.687 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:10.518648+0000", 2024-04-18T14:44:15.688 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:44:15.688 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:15.688 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:15.688 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-04-18T14:44:15.688 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:10.518646+0000", 2024-04-18T14:44:15.688 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 4294967295.9999986 2024-04-18T14:44:15.688 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:15.688 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:15.688 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-04-18T14:44:15.688 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:10.518863+0000", 2024-04-18T14:44:15.688 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00021667299999999999 2024-04-18T14:44:15.688 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:15.688 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:15.688 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-04-18T14:44:15.688 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:10.518898+0000", 2024-04-18T14:44:15.689 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.5318999999999998e-05 2024-04-18T14:44:15.689 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:15.689 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:15.689 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-04-18T14:44:15.689 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:10.518939+0000", 2024-04-18T14:44:15.689 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 4.0201999999999999e-05 2024-04-18T14:44:15.689 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:15.689 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:15.689 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-04-18T14:44:15.689 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:10.519086+0000", 2024-04-18T14:44:15.689 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000147589 2024-04-18T14:44:15.689 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:15.689 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:15.689 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-04-18T14:44:15.689 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:10.522020+0000", 2024-04-18T14:44:15.690 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0029339280000000001 2024-04-18T14:44:15.690 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:44:15.690 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T14:44:15.690 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:44:15.690 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:15.690 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:15.690 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "MOSDECSubOpWrite(3.6s2 72/70 ECSubWrite(tid=255, reqid=client.4559.0:717, at_version=72'103, trim_to=0'0, roll_forward_to=71'101))", 2024-04-18T14:44:15.690 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-04-18T14:44:11.424299+0000", 2024-04-18T14:44:15.690 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 4.2526268309999997, 2024-04-18T14:44:15.690 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0059841160000000003, 2024-04-18T14:44:15.690 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-04-18T14:44:15.690 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "reached pg", 2024-04-18T14:44:15.690 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-04-18T14:44:15.691 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:15.691 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-04-18T14:44:15.691 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:11.424299+0000", 2024-04-18T14:44:15.691 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:44:15.691 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:15.691 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:15.691 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-04-18T14:44:15.691 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:11.424299+0000", 2024-04-18T14:44:15.691 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:44:15.691 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:15.691 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:15.691 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-04-18T14:44:15.691 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:11.424298+0000", 2024-04-18T14:44:15.691 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 4294967295.999999 2024-04-18T14:44:15.691 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:15.692 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:15.692 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-04-18T14:44:15.692 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:11.425341+0000", 2024-04-18T14:44:15.692 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.001043144 2024-04-18T14:44:15.692 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:15.692 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:15.692 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-04-18T14:44:15.692 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:11.425391+0000", 2024-04-18T14:44:15.692 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 5.0336000000000001e-05 2024-04-18T14:44:15.692 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:15.692 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:15.692 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-04-18T14:44:15.692 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:11.425443+0000", 2024-04-18T14:44:15.692 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 5.1901999999999999e-05 2024-04-18T14:44:15.692 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:15.692 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:15.693 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-04-18T14:44:15.693 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:11.425529+0000", 2024-04-18T14:44:15.693 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 8.5371000000000006e-05 2024-04-18T14:44:15.693 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:15.693 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:15.693 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_started", 2024-04-18T14:44:15.693 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:11.425543+0000", 2024-04-18T14:44:15.693 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.4214e-05 2024-04-18T14:44:15.693 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:15.693 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:15.693 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_committed", 2024-04-18T14:44:15.693 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:11.430221+0000", 2024-04-18T14:44:15.693 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.004678303 2024-04-18T14:44:15.693 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:15.694 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:15.694 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-04-18T14:44:15.694 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:11.430283+0000", 2024-04-18T14:44:15.694 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 6.1969000000000002e-05 2024-04-18T14:44:15.694 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:44:15.694 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T14:44:15.694 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:44:15.694 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:15.694 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:15.694 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "MOSDECSubOpWrite(3.6s2 72/70 ECSubWrite(tid=256, reqid=client.4559.0:718, at_version=72'104, trim_to=0'0, roll_forward_to=71'101))", 2024-04-18T14:44:15.694 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-04-18T14:44:11.430697+0000", 2024-04-18T14:44:15.694 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 4.2462283830000001, 2024-04-18T14:44:15.694 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.004565342, 2024-04-18T14:44:15.694 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-04-18T14:44:15.694 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "reached pg", 2024-04-18T14:44:15.695 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-04-18T14:44:15.695 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:15.695 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-04-18T14:44:15.695 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:11.430697+0000", 2024-04-18T14:44:15.695 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:44:15.695 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:15.695 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:15.695 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-04-18T14:44:15.695 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:11.430697+0000", 2024-04-18T14:44:15.695 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:44:15.696 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:15.696 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:15.696 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-04-18T14:44:15.696 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:11.430696+0000", 2024-04-18T14:44:15.696 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 4294967295.999999 2024-04-18T14:44:15.696 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:15.696 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:15.696 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-04-18T14:44:15.696 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:11.430926+0000", 2024-04-18T14:44:15.696 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00022945299999999999 2024-04-18T14:44:15.696 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:15.697 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:15.697 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-04-18T14:44:15.697 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:11.430944+0000", 2024-04-18T14:44:15.697 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.7798000000000001e-05 2024-04-18T14:44:15.697 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:15.697 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:15.697 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-04-18T14:44:15.697 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:11.430956+0000", 2024-04-18T14:44:15.697 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.2014000000000001e-05 2024-04-18T14:44:15.697 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:15.697 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:15.697 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-04-18T14:44:15.697 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:11.431019+0000", 2024-04-18T14:44:15.697 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 6.3093000000000001e-05 2024-04-18T14:44:15.698 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:15.698 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:15.698 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_started", 2024-04-18T14:44:15.698 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:11.431033+0000", 2024-04-18T14:44:15.698 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.4209000000000001e-05 2024-04-18T14:44:15.698 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:15.698 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:15.698 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_committed", 2024-04-18T14:44:15.698 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:11.435205+0000", 2024-04-18T14:44:15.698 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0041718370000000003 2024-04-18T14:44:15.698 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:15.698 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:15.698 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-04-18T14:44:15.698 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:11.435263+0000", 2024-04-18T14:44:15.698 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 5.7926000000000001e-05 2024-04-18T14:44:15.699 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:44:15.699 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T14:44:15.699 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:44:15.699 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:15.699 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:15.699 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "MOSDECSubOpWrite(3.6s2 72/70 ECSubWrite(tid=257, reqid=client.4559.0:719, at_version=72'105, trim_to=0'0, roll_forward_to=71'101))", 2024-04-18T14:44:15.699 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-04-18T14:44:11.436039+0000", 2024-04-18T14:44:15.699 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 4.2408870910000003, 2024-04-18T14:44:15.699 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0061391529999999996, 2024-04-18T14:44:15.699 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-04-18T14:44:15.699 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "reached pg", 2024-04-18T14:44:15.699 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-04-18T14:44:15.699 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:15.699 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-04-18T14:44:15.700 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:11.436039+0000", 2024-04-18T14:44:15.700 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:44:15.700 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:15.700 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:15.700 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-04-18T14:44:15.700 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:11.436039+0000", 2024-04-18T14:44:15.700 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:44:15.700 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:15.700 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:15.700 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-04-18T14:44:15.700 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:11.436037+0000", 2024-04-18T14:44:15.700 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 4294967295.9999986 2024-04-18T14:44:15.700 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:15.700 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:15.701 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-04-18T14:44:15.701 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:11.436348+0000", 2024-04-18T14:44:15.701 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00031125599999999999 2024-04-18T14:44:15.701 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:15.701 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:15.701 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-04-18T14:44:15.701 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:11.436382+0000", 2024-04-18T14:44:15.701 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.3976000000000001e-05 2024-04-18T14:44:15.701 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:15.701 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:15.701 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-04-18T14:44:15.701 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:11.436405+0000", 2024-04-18T14:44:15.701 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.2623e-05 2024-04-18T14:44:15.701 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:15.702 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:15.702 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-04-18T14:44:15.702 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:11.436540+0000", 2024-04-18T14:44:15.702 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00013499700000000001 2024-04-18T14:44:15.702 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:15.702 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:15.702 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_started", 2024-04-18T14:44:15.702 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:11.436568+0000", 2024-04-18T14:44:15.702 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.7742999999999998e-05 2024-04-18T14:44:15.702 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:15.702 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:15.702 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_committed", 2024-04-18T14:44:15.702 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:11.442029+0000", 2024-04-18T14:44:15.702 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0054611240000000004 2024-04-18T14:44:15.702 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:15.703 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:15.703 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-04-18T14:44:15.703 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:11.442178+0000", 2024-04-18T14:44:15.703 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00014897000000000001 2024-04-18T14:44:15.703 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:44:15.703 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T14:44:15.703 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:44:15.703 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:15.703 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:15.703 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "MOSDECSubOpWrite(3.6s2 72/70 ECSubWrite(tid=258, reqid=client.4559.0:720, at_version=72'106, trim_to=0'0, roll_forward_to=72'104))", 2024-04-18T14:44:15.703 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-04-18T14:44:11.440435+0000", 2024-04-18T14:44:15.703 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 4.2364906949999996, 2024-04-18T14:44:15.703 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0051091039999999997, 2024-04-18T14:44:15.703 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-04-18T14:44:15.704 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "reached pg", 2024-04-18T14:44:15.704 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-04-18T14:44:15.704 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:15.704 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-04-18T14:44:15.704 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:11.440435+0000", 2024-04-18T14:44:15.704 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:44:15.704 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:15.704 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:15.704 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-04-18T14:44:15.704 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:11.440435+0000", 2024-04-18T14:44:15.704 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:44:15.704 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:15.704 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:15.704 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-04-18T14:44:15.705 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:11.440433+0000", 2024-04-18T14:44:15.705 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 4294967295.9999986 2024-04-18T14:44:15.705 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:15.705 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:15.705 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-04-18T14:44:15.705 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:11.440526+0000", 2024-04-18T14:44:15.705 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 9.2227999999999999e-05 2024-04-18T14:44:15.705 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:15.705 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:15.705 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-04-18T14:44:15.705 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:11.440553+0000", 2024-04-18T14:44:15.705 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.7379e-05 2024-04-18T14:44:15.705 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:15.705 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:15.706 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-04-18T14:44:15.706 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:11.440575+0000", 2024-04-18T14:44:15.706 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.1526999999999999e-05 2024-04-18T14:44:15.706 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:15.706 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:15.706 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-04-18T14:44:15.706 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:11.440694+0000", 2024-04-18T14:44:15.706 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00011976699999999999 2024-04-18T14:44:15.706 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:15.706 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:15.706 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_started", 2024-04-18T14:44:15.706 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:11.440713+0000", 2024-04-18T14:44:15.706 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.8987e-05 2024-04-18T14:44:15.707 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:15.707 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:15.707 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_committed", 2024-04-18T14:44:15.707 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:11.445420+0000", 2024-04-18T14:44:15.707 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0047064589999999996 2024-04-18T14:44:15.707 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:15.707 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:15.707 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-04-18T14:44:15.707 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:11.445544+0000", 2024-04-18T14:44:15.707 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000124354 2024-04-18T14:44:15.707 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:44:15.707 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T14:44:15.707 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:44:15.707 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:15.708 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:15.708 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "MOSDECSubOpWrite(3.6s2 72/70 ECSubWrite(tid=259, reqid=client.4559.0:721, at_version=72'107, trim_to=0'0, roll_forward_to=72'104))", 2024-04-18T14:44:15.708 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-04-18T14:44:11.442548+0000", 2024-04-18T14:44:15.708 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 4.2343776489999998, 2024-04-18T14:44:15.708 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0037940119999999998, 2024-04-18T14:44:15.708 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-04-18T14:44:15.708 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "reached pg", 2024-04-18T14:44:15.708 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-04-18T14:44:15.708 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:15.708 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-04-18T14:44:15.708 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:11.442548+0000", 2024-04-18T14:44:15.708 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:44:15.708 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:15.708 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:15.708 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-04-18T14:44:15.709 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:11.442548+0000", 2024-04-18T14:44:15.709 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:44:15.709 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:15.709 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:15.709 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-04-18T14:44:15.709 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:11.442547+0000", 2024-04-18T14:44:15.709 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 4294967295.9999986 2024-04-18T14:44:15.709 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:15.709 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:15.709 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-04-18T14:44:15.709 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:11.442582+0000", 2024-04-18T14:44:15.709 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.4858999999999999e-05 2024-04-18T14:44:15.709 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:15.709 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:15.709 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-04-18T14:44:15.710 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:11.442611+0000", 2024-04-18T14:44:15.710 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.9232999999999999e-05 2024-04-18T14:44:15.710 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:15.710 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:15.710 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-04-18T14:44:15.710 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:11.442627+0000", 2024-04-18T14:44:15.710 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.6643e-05 2024-04-18T14:44:15.710 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:15.710 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:15.710 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-04-18T14:44:15.710 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:11.442730+0000", 2024-04-18T14:44:15.711 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000102304 2024-04-18T14:44:15.711 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:15.711 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:15.711 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_started", 2024-04-18T14:44:15.711 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:11.442834+0000", 2024-04-18T14:44:15.711 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000104805 2024-04-18T14:44:15.711 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:15.711 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:15.711 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_committed", 2024-04-18T14:44:15.711 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:11.446301+0000", 2024-04-18T14:44:15.711 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.003466514 2024-04-18T14:44:15.711 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:15.711 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:15.711 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-04-18T14:44:15.711 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:11.446342+0000", 2024-04-18T14:44:15.711 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 4.1114e-05 2024-04-18T14:44:15.712 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:44:15.712 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T14:44:15.712 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:44:15.712 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:15.712 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:15.712 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "MOSDECSubOpWrite(3.as2 72/70 ECSubWrite(tid=91, reqid=client.4559.0:729, at_version=72'61, trim_to=0'0, roll_forward_to=0'0))", 2024-04-18T14:44:15.712 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-04-18T14:44:11.733799+0000", 2024-04-18T14:44:15.712 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 3.9431267399999999, 2024-04-18T14:44:15.712 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.003155794, 2024-04-18T14:44:15.712 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-04-18T14:44:15.712 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "reached pg", 2024-04-18T14:44:15.712 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-04-18T14:44:15.712 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:15.712 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-04-18T14:44:15.712 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:11.733799+0000", 2024-04-18T14:44:15.713 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:44:15.713 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:15.713 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:15.713 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-04-18T14:44:15.713 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:11.733799+0000", 2024-04-18T14:44:15.713 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:44:15.713 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:15.713 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:15.713 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-04-18T14:44:15.713 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:11.733799+0000", 2024-04-18T14:44:15.713 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 4294967295.9999995 2024-04-18T14:44:15.713 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:15.713 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:15.713 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-04-18T14:44:15.713 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:11.734064+0000", 2024-04-18T14:44:15.713 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00026549800000000003 2024-04-18T14:44:15.714 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:15.714 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:15.714 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-04-18T14:44:15.714 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:11.734094+0000", 2024-04-18T14:44:15.714 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.9442e-05 2024-04-18T14:44:15.714 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:15.714 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:15.714 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-04-18T14:44:15.714 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:11.734108+0000", 2024-04-18T14:44:15.714 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.4902999999999999e-05 2024-04-18T14:44:15.714 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:15.714 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:15.714 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-04-18T14:44:15.714 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:11.734237+0000", 2024-04-18T14:44:15.714 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00012845099999999999 2024-04-18T14:44:15.715 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:15.715 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:15.715 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_started", 2024-04-18T14:44:15.715 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:11.734266+0000", 2024-04-18T14:44:15.715 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.9026e-05 2024-04-18T14:44:15.715 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:15.715 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:15.715 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_committed", 2024-04-18T14:44:15.715 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:11.736890+0000", 2024-04-18T14:44:15.715 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.002624309 2024-04-18T14:44:15.715 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:15.715 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:15.715 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-04-18T14:44:15.715 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:11.736955+0000", 2024-04-18T14:44:15.715 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 6.4535000000000005e-05 2024-04-18T14:44:15.715 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:44:15.716 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T14:44:15.716 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:44:15.716 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:15.716 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:15.716 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "MOSDECSubOpWrite(3.8s6 72/71 ECSubWrite(tid=174, reqid=client.4559.0:730, at_version=72'119, trim_to=0'0, roll_forward_to=0'0))", 2024-04-18T14:44:15.716 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-04-18T14:44:11.745841+0000", 2024-04-18T14:44:15.716 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 3.9310848160000003, 2024-04-18T14:44:15.716 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0035880220000000002, 2024-04-18T14:44:15.716 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-04-18T14:44:15.716 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "reached pg", 2024-04-18T14:44:15.716 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-04-18T14:44:15.716 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:15.716 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-04-18T14:44:15.716 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:11.745841+0000", 2024-04-18T14:44:15.716 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:44:15.716 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:15.717 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:15.717 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-04-18T14:44:15.717 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:11.745841+0000", 2024-04-18T14:44:15.717 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:44:15.717 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:15.717 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:15.717 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-04-18T14:44:15.717 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:11.745839+0000", 2024-04-18T14:44:15.717 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 4294967295.9999981 2024-04-18T14:44:15.717 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:15.717 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:15.717 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-04-18T14:44:15.717 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:11.746271+0000", 2024-04-18T14:44:15.717 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00043190399999999999 2024-04-18T14:44:15.717 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:15.717 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:15.718 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-04-18T14:44:15.718 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:11.746351+0000", 2024-04-18T14:44:15.718 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 7.9862000000000002e-05 2024-04-18T14:44:15.718 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:15.718 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:15.718 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-04-18T14:44:15.718 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:11.746395+0000", 2024-04-18T14:44:15.718 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 4.4351999999999998e-05 2024-04-18T14:44:15.718 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:15.718 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:15.718 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-04-18T14:44:15.718 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:11.746537+0000", 2024-04-18T14:44:15.718 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000141454 2024-04-18T14:44:15.719 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:15.719 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:15.719 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_started", 2024-04-18T14:44:15.719 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:11.746554+0000", 2024-04-18T14:44:15.719 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.7906000000000001e-05 2024-04-18T14:44:15.719 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:15.719 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:15.719 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_committed", 2024-04-18T14:44:15.719 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:11.749375+0000", 2024-04-18T14:44:15.719 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.002820239 2024-04-18T14:44:15.719 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:15.719 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:15.719 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-04-18T14:44:15.719 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:11.749429+0000", 2024-04-18T14:44:15.719 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 5.4234999999999998e-05 2024-04-18T14:44:15.719 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:44:15.720 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T14:44:15.720 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:44:15.720 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:15.720 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:15.720 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "MOSDECSubOpWrite(3.8s6 72/71 ECSubWrite(tid=176, reqid=client.4559.0:731, at_version=72'120, trim_to=0'0, roll_forward_to=72'119))", 2024-04-18T14:44:15.720 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-04-18T14:44:11.753383+0000", 2024-04-18T14:44:15.720 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 3.923543209, 2024-04-18T14:44:15.720 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0041179479999999997, 2024-04-18T14:44:15.720 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-04-18T14:44:15.720 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "reached pg", 2024-04-18T14:44:15.720 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-04-18T14:44:15.720 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:15.720 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-04-18T14:44:15.720 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:11.753383+0000", 2024-04-18T14:44:15.720 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:44:15.721 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:15.721 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:15.721 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-04-18T14:44:15.721 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:11.753383+0000", 2024-04-18T14:44:15.721 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:44:15.722 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:15.722 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:15.722 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-04-18T14:44:15.722 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:11.753381+0000", 2024-04-18T14:44:15.722 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 4294967295.9999981 2024-04-18T14:44:15.722 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:15.722 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:15.722 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-04-18T14:44:15.722 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:11.753867+0000", 2024-04-18T14:44:15.722 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00048608000000000001 2024-04-18T14:44:15.722 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:15.722 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:15.723 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-04-18T14:44:15.723 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:11.753898+0000", 2024-04-18T14:44:15.723 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.0709e-05 2024-04-18T14:44:15.723 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:15.723 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:15.723 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-04-18T14:44:15.723 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:11.753920+0000", 2024-04-18T14:44:15.723 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.2237000000000001e-05 2024-04-18T14:44:15.723 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:15.723 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:15.723 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-04-18T14:44:15.723 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:11.754054+0000", 2024-04-18T14:44:15.723 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000134134 2024-04-18T14:44:15.723 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:15.723 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:15.724 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_started", 2024-04-18T14:44:15.724 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:11.754083+0000", 2024-04-18T14:44:15.724 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.8659000000000001e-05 2024-04-18T14:44:15.724 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:15.724 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:15.724 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_committed", 2024-04-18T14:44:15.724 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:11.757432+0000", 2024-04-18T14:44:15.724 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.003349491 2024-04-18T14:44:15.724 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:15.724 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:15.724 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-04-18T14:44:15.724 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:11.757500+0000", 2024-04-18T14:44:15.724 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 6.8394999999999998e-05 2024-04-18T14:44:15.724 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:44:15.724 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T14:44:15.725 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:44:15.725 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:15.725 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:15.725 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "MOSDECSubOpRead(3.6s2 72/70 ECSubRead(tid=262, to_read={3:6cb0c218:::smithi13430248-40:head=0,1155072,0}, subchunks={3:6cb0c218:::smithi13430248-40:head=[0,1]}, attrs_to_read=))", 2024-04-18T14:44:15.725 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-04-18T14:44:11.753894+0000", 2024-04-18T14:44:15.725 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 3.9230318529999999, 2024-04-18T14:44:15.725 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0039924640000000003, 2024-04-18T14:44:15.725 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-04-18T14:44:15.725 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "reached pg", 2024-04-18T14:44:15.725 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-04-18T14:44:15.725 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:15.725 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-04-18T14:44:15.725 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:11.753894+0000", 2024-04-18T14:44:15.725 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:44:15.725 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:15.726 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:15.726 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-04-18T14:44:15.726 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:11.753894+0000", 2024-04-18T14:44:15.726 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:44:15.726 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:15.726 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:15.726 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-04-18T14:44:15.726 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:11.753892+0000", 2024-04-18T14:44:15.726 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 4294967295.9999981 2024-04-18T14:44:15.726 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:15.726 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:15.726 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-04-18T14:44:15.726 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:11.753916+0000", 2024-04-18T14:44:15.726 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.4337000000000001e-05 2024-04-18T14:44:15.726 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:15.727 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:15.727 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-04-18T14:44:15.727 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:11.753950+0000", 2024-04-18T14:44:15.727 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.4136e-05 2024-04-18T14:44:15.727 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:15.727 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:15.727 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-04-18T14:44:15.727 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:11.753976+0000", 2024-04-18T14:44:15.727 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.5863e-05 2024-04-18T14:44:15.727 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:15.727 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:15.727 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-04-18T14:44:15.727 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:11.754146+0000", 2024-04-18T14:44:15.727 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00016937899999999999 2024-04-18T14:44:15.728 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:15.728 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:15.728 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-04-18T14:44:15.728 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:11.757886+0000", 2024-04-18T14:44:15.728 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0037407130000000001 2024-04-18T14:44:15.728 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:44:15.728 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T14:44:15.728 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:44:15.728 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:15.728 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:15.728 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "MOSDECSubOpRead(3.6s2 72/70 ECSubRead(tid=263, to_read={3:6cb0c218:::smithi13430248-40:head=0,1155072,0}, subchunks={3:6cb0c218:::smithi13430248-40:head=[0,1]}, attrs_to_read=))", 2024-04-18T14:44:15.728 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-04-18T14:44:11.754555+0000", 2024-04-18T14:44:15.728 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 3.9223704000000001, 2024-04-18T14:44:15.728 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0039194989999999999, 2024-04-18T14:44:15.728 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-04-18T14:44:15.728 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "reached pg", 2024-04-18T14:44:15.729 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-04-18T14:44:15.729 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:15.729 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-04-18T14:44:15.729 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:11.754555+0000", 2024-04-18T14:44:15.729 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:44:15.729 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:15.729 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:15.729 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-04-18T14:44:15.729 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:11.754555+0000", 2024-04-18T14:44:15.729 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:44:15.729 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:15.729 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:15.729 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-04-18T14:44:15.729 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:11.754554+0000", 2024-04-18T14:44:15.730 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 4294967295.9999981 2024-04-18T14:44:15.730 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:15.730 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:15.730 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-04-18T14:44:15.730 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:11.754576+0000", 2024-04-18T14:44:15.730 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.1979000000000001e-05 2024-04-18T14:44:15.730 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:15.730 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:15.730 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-04-18T14:44:15.730 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:11.754612+0000", 2024-04-18T14:44:15.730 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.6575999999999997e-05 2024-04-18T14:44:15.730 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:15.730 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:15.730 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-04-18T14:44:15.731 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:11.754638+0000", 2024-04-18T14:44:15.731 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.6270000000000001e-05 2024-04-18T14:44:15.731 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:15.731 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:15.731 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-04-18T14:44:15.731 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:11.757992+0000", 2024-04-18T14:44:15.731 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0033533270000000001 2024-04-18T14:44:15.731 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:15.731 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:15.731 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-04-18T14:44:15.731 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:11.758475+0000", 2024-04-18T14:44:15.731 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00048313000000000002 2024-04-18T14:44:15.731 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:44:15.731 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T14:44:15.731 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:44:15.732 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:15.732 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:15.732 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "MOSDECSubOpRead(3.6s2 72/70 ECSubRead(tid=264, to_read={3:6cb0c218:::smithi13430248-40:head=0,1155072,0}, subchunks={3:6cb0c218:::smithi13430248-40:head=[0,1]}, attrs_to_read=))", 2024-04-18T14:44:15.732 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-04-18T14:44:11.755017+0000", 2024-04-18T14:44:15.732 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 3.9219085959999997, 2024-04-18T14:44:15.732 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.003790711, 2024-04-18T14:44:15.732 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-04-18T14:44:15.732 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "reached pg", 2024-04-18T14:44:15.732 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-04-18T14:44:15.732 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:15.732 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-04-18T14:44:15.732 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:11.755017+0000", 2024-04-18T14:44:15.732 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:44:15.732 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:15.732 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:15.733 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-04-18T14:44:15.733 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:11.755017+0000", 2024-04-18T14:44:15.733 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:44:15.733 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:15.733 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:15.733 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-04-18T14:44:15.733 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:11.755016+0000", 2024-04-18T14:44:15.733 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 4294967295.9999986 2024-04-18T14:44:15.733 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:15.733 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:15.733 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-04-18T14:44:15.733 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:11.755036+0000", 2024-04-18T14:44:15.733 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.0610000000000001e-05 2024-04-18T14:44:15.733 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:15.733 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:15.734 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-04-18T14:44:15.734 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:11.755059+0000", 2024-04-18T14:44:15.734 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.2388999999999999e-05 2024-04-18T14:44:15.734 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:15.734 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:15.734 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-04-18T14:44:15.734 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:11.755072+0000", 2024-04-18T14:44:15.734 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.3397000000000001e-05 2024-04-18T14:44:15.734 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:15.734 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:15.734 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-04-18T14:44:15.734 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:11.758532+0000", 2024-04-18T14:44:15.734 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0034597949999999999 2024-04-18T14:44:15.734 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:15.734 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:15.735 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-04-18T14:44:15.735 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:11.758808+0000", 2024-04-18T14:44:15.735 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00027604399999999997 2024-04-18T14:44:15.735 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:44:15.735 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T14:44:15.735 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:44:15.735 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:15.735 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:15.735 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "MOSDECSubOpRead(3.as2 76/70 ECSubRead(tid=93, to_read={3:577932fb:::smithi13430248-41:head=0,606208,0}, subchunks={3:577932fb:::smithi13430248-41:head=[0,1]}, attrs_to_read=))", 2024-04-18T14:44:15.735 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-04-18T14:44:15.403125+0000", 2024-04-18T14:44:15.735 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 0.27380106599999998, 2024-04-18T14:44:15.735 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0042770330000000004, 2024-04-18T14:44:15.735 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-04-18T14:44:15.735 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "reached pg", 2024-04-18T14:44:15.735 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-04-18T14:44:15.736 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:15.736 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-04-18T14:44:15.736 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:15.403125+0000", 2024-04-18T14:44:15.736 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:44:15.736 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:15.736 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:15.736 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-04-18T14:44:15.736 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:15.403125+0000", 2024-04-18T14:44:15.736 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:44:15.736 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:15.736 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:15.736 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-04-18T14:44:15.736 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:15.403124+0000", 2024-04-18T14:44:15.736 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 4294967295.9999995 2024-04-18T14:44:15.736 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:15.736 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:15.737 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-04-18T14:44:15.737 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:15.403130+0000", 2024-04-18T14:44:15.737 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 6.0870000000000003e-06 2024-04-18T14:44:15.737 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:15.737 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:15.737 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-04-18T14:44:15.737 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:15.403144+0000", 2024-04-18T14:44:15.737 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.3642000000000001e-05 2024-04-18T14:44:15.737 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:15.737 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:15.737 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-04-18T14:44:15.737 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:15.403156+0000", 2024-04-18T14:44:15.737 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.1564e-05 2024-04-18T14:44:15.737 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:15.737 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:15.737 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-04-18T14:44:15.738 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:15.403238+0000", 2024-04-18T14:44:15.738 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 8.2023999999999999e-05 2024-04-18T14:44:15.738 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:15.738 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:15.738 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-04-18T14:44:15.738 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:15.407402+0000", 2024-04-18T14:44:15.738 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.004163997 2024-04-18T14:44:15.738 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:44:15.738 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T14:44:15.738 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:44:15.738 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:15.738 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:15.738 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "MOSDECSubOpRead(3.as2 76/70 ECSubRead(tid=94, to_read={3:504bbe78:::smithi13430248-37:head=0,688128,0}, subchunks={3:504bbe78:::smithi13430248-37:head=[0,1]}, attrs_to_read=))", 2024-04-18T14:44:15.738 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-04-18T14:44:15.404704+0000", 2024-04-18T14:44:15.738 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 0.272222199, 2024-04-18T14:44:15.739 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0040554689999999999, 2024-04-18T14:44:15.739 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-04-18T14:44:15.739 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "reached pg", 2024-04-18T14:44:15.739 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-04-18T14:44:15.739 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:15.739 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-04-18T14:44:15.739 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:15.404704+0000", 2024-04-18T14:44:15.739 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:44:15.739 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:15.739 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:15.740 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-04-18T14:44:15.740 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:15.404704+0000", 2024-04-18T14:44:15.740 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:44:15.740 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:15.740 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:15.740 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-04-18T14:44:15.740 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:15.404703+0000", 2024-04-18T14:44:15.740 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 4294967295.999999 2024-04-18T14:44:15.740 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:15.740 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:15.740 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-04-18T14:44:15.740 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:15.404714+0000", 2024-04-18T14:44:15.740 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.0869999999999999e-05 2024-04-18T14:44:15.740 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:15.740 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:15.741 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-04-18T14:44:15.741 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:15.404728+0000", 2024-04-18T14:44:15.741 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.4395e-05 2024-04-18T14:44:15.741 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:15.741 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:15.741 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-04-18T14:44:15.741 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:15.404738+0000", 2024-04-18T14:44:15.741 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.0068000000000001e-05 2024-04-18T14:44:15.741 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:15.741 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:15.741 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-04-18T14:44:15.742 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:15.407537+0000", 2024-04-18T14:44:15.742 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0027984519999999999 2024-04-18T14:44:15.742 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:15.742 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:15.742 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-04-18T14:44:15.742 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:15.408759+0000", 2024-04-18T14:44:15.742 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0012224270000000001 2024-04-18T14:44:15.742 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:44:15.742 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T14:44:15.742 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:44:15.742 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:15.742 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:15.742 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "MOSDECSubOpWrite(3.8s6 76/73 ECSubWrite(tid=185, reqid=client.4559.0:785, at_version=76'125, trim_to=0'0, roll_forward_to=0'0))", 2024-04-18T14:44:15.742 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-04-18T14:44:15.424827+0000", 2024-04-18T14:44:15.742 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 0.25209858600000001, 2024-04-18T14:44:15.743 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0048489049999999997, 2024-04-18T14:44:15.743 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-04-18T14:44:15.743 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "reached pg", 2024-04-18T14:44:15.743 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-04-18T14:44:15.743 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:15.743 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-04-18T14:44:15.743 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:15.424827+0000", 2024-04-18T14:44:15.743 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:44:15.743 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:15.743 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:15.743 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-04-18T14:44:15.743 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:15.424827+0000", 2024-04-18T14:44:15.743 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:44:15.743 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:15.743 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:15.743 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-04-18T14:44:15.744 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:15.424827+0000", 2024-04-18T14:44:15.744 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 4294967296 2024-04-18T14:44:15.744 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:15.744 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:15.744 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-04-18T14:44:15.744 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:15.425487+0000", 2024-04-18T14:44:15.744 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00066001299999999998 2024-04-18T14:44:15.744 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:15.744 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:15.744 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-04-18T14:44:15.744 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:15.425510+0000", 2024-04-18T14:44:15.744 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.3240000000000001e-05 2024-04-18T14:44:15.744 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:15.744 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:15.744 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-04-18T14:44:15.744 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:15.425532+0000", 2024-04-18T14:44:15.745 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.1801e-05 2024-04-18T14:44:15.745 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:15.745 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:15.745 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-04-18T14:44:15.745 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:15.425687+0000", 2024-04-18T14:44:15.745 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00015502800000000001 2024-04-18T14:44:15.745 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:15.745 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:15.745 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_started", 2024-04-18T14:44:15.745 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:15.425702+0000", 2024-04-18T14:44:15.745 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.4953999999999999e-05 2024-04-18T14:44:15.745 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:15.745 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:15.745 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_committed", 2024-04-18T14:44:15.745 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:15.429647+0000", 2024-04-18T14:44:15.746 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0039448670000000003 2024-04-18T14:44:15.746 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:15.746 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:15.746 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-04-18T14:44:15.746 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:15.429676+0000", 2024-04-18T14:44:15.746 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.9179e-05 2024-04-18T14:44:15.746 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:44:15.746 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T14:44:15.746 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:44:15.746 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:15.746 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:15.746 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "MOSDECSubOpWrite(3.es2 76/70 ECSubWrite(tid=92, reqid=client.4559.0:782, at_version=76'72, trim_to=0'0, roll_forward_to=0'0))", 2024-04-18T14:44:15.746 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-04-18T14:44:15.426827+0000", 2024-04-18T14:44:15.746 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 0.25009899600000002, 2024-04-18T14:44:15.747 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0036641389999999999, 2024-04-18T14:44:15.747 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-04-18T14:44:15.747 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "reached pg", 2024-04-18T14:44:15.747 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-04-18T14:44:15.747 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:15.747 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-04-18T14:44:15.747 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:15.426827+0000", 2024-04-18T14:44:15.747 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:44:15.747 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:15.747 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:15.747 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-04-18T14:44:15.747 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:15.426827+0000", 2024-04-18T14:44:15.747 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:44:15.747 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:15.748 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:15.748 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-04-18T14:44:15.748 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:15.426826+0000", 2024-04-18T14:44:15.748 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 4294967295.999999 2024-04-18T14:44:15.748 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:15.748 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:15.748 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-04-18T14:44:15.748 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:15.428477+0000", 2024-04-18T14:44:15.748 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0016513890000000001 2024-04-18T14:44:15.748 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:15.748 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:15.748 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-04-18T14:44:15.748 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:15.428496+0000", 2024-04-18T14:44:15.748 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.8970999999999998e-05 2024-04-18T14:44:15.748 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:15.749 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:15.749 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-04-18T14:44:15.749 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:15.428530+0000", 2024-04-18T14:44:15.749 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.4050000000000001e-05 2024-04-18T14:44:15.749 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:15.749 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:15.749 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-04-18T14:44:15.749 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:15.428594+0000", 2024-04-18T14:44:15.749 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 6.3643e-05 2024-04-18T14:44:15.749 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:15.749 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:15.749 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_started", 2024-04-18T14:44:15.749 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:15.428602+0000", 2024-04-18T14:44:15.749 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 8.0620000000000001e-06 2024-04-18T14:44:15.749 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:15.750 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:15.750 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_committed", 2024-04-18T14:44:15.750 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:15.430457+0000", 2024-04-18T14:44:15.750 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0018550319999999999 2024-04-18T14:44:15.750 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:15.750 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:15.750 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-04-18T14:44:15.750 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:15.430491+0000", 2024-04-18T14:44:15.750 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.3821e-05 2024-04-18T14:44:15.750 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:44:15.750 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T14:44:15.750 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:44:15.750 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:15.750 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:15.751 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "MOSDECSubOpWrite(3.8s6 76/73 ECSubWrite(tid=193, reqid=client.4559.0:792, at_version=0'0, trim_to=0'0, roll_forward_to=76'132))", 2024-04-18T14:44:15.751 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-04-18T14:44:15.471962+0000", 2024-04-18T14:44:15.751 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 0.204964229, 2024-04-18T14:44:15.751 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0034300089999999999, 2024-04-18T14:44:15.751 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-04-18T14:44:15.751 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "reached pg", 2024-04-18T14:44:15.751 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-04-18T14:44:15.751 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:15.751 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-04-18T14:44:15.751 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:15.471962+0000", 2024-04-18T14:44:15.751 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:44:15.751 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:15.751 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:15.751 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-04-18T14:44:15.751 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:15.471962+0000", 2024-04-18T14:44:15.752 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:44:15.752 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:15.752 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:15.752 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-04-18T14:44:15.752 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:15.471961+0000", 2024-04-18T14:44:15.752 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 4294967295.999999 2024-04-18T14:44:15.752 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:15.752 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:15.752 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-04-18T14:44:15.752 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:15.471976+0000", 2024-04-18T14:44:15.752 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.5840000000000001e-05 2024-04-18T14:44:15.752 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:15.752 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:15.752 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-04-18T14:44:15.752 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:15.471996+0000", 2024-04-18T14:44:15.752 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.9470000000000002e-05 2024-04-18T14:44:15.753 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:15.753 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:15.753 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-04-18T14:44:15.753 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:15.472005+0000", 2024-04-18T14:44:15.753 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 9.1589999999999999e-06 2024-04-18T14:44:15.753 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:15.753 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:15.753 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-04-18T14:44:15.753 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:15.472074+0000", 2024-04-18T14:44:15.753 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 6.9189000000000005e-05 2024-04-18T14:44:15.753 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:15.753 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:15.753 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_started", 2024-04-18T14:44:15.753 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:15.472082+0000", 2024-04-18T14:44:15.753 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 7.8660000000000006e-06 2024-04-18T14:44:15.754 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:15.754 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:15.754 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_committed", 2024-04-18T14:44:15.754 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:15.475370+0000", 2024-04-18T14:44:15.754 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0032880990000000001 2024-04-18T14:44:15.754 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:15.754 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:15.754 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-04-18T14:44:15.754 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:15.475392+0000", 2024-04-18T14:44:15.754 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.1311e-05 2024-04-18T14:44:15.754 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:44:15.754 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T14:44:15.754 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:44:15.754 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:15.754 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:15.755 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "MOSDECSubOpWrite(3.8s6 76/73 ECSubWrite(tid=198, reqid=client.4559.0:804, at_version=76'136, trim_to=0'0, roll_forward_to=76'133))", 2024-04-18T14:44:15.755 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-04-18T14:44:15.601704+0000", 2024-04-18T14:44:15.755 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 0.075221822999999993, 2024-04-18T14:44:15.755 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0034085489999999999, 2024-04-18T14:44:15.755 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-04-18T14:44:15.755 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "reached pg", 2024-04-18T14:44:15.755 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-04-18T14:44:15.755 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:15.755 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-04-18T14:44:15.755 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:15.601704+0000", 2024-04-18T14:44:15.755 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:44:15.755 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:15.755 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:15.755 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-04-18T14:44:15.755 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:15.601704+0000", 2024-04-18T14:44:15.756 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:44:15.756 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:15.756 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:15.756 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-04-18T14:44:15.756 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:15.601703+0000", 2024-04-18T14:44:15.756 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 4294967295.999999 2024-04-18T14:44:15.756 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:15.756 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:15.756 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-04-18T14:44:15.756 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:15.601758+0000", 2024-04-18T14:44:15.756 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 5.5065999999999998e-05 2024-04-18T14:44:15.756 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:15.756 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:15.756 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-04-18T14:44:15.756 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:15.601774+0000", 2024-04-18T14:44:15.757 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.5664000000000001e-05 2024-04-18T14:44:15.757 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:15.757 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:15.757 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-04-18T14:44:15.757 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:15.601786+0000", 2024-04-18T14:44:15.757 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.2641e-05 2024-04-18T14:44:15.757 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:15.757 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:15.757 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-04-18T14:44:15.757 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:15.601833+0000", 2024-04-18T14:44:15.757 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 4.6977000000000001e-05 2024-04-18T14:44:15.757 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:15.757 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:15.757 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_started", 2024-04-18T14:44:15.758 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:15.601840+0000", 2024-04-18T14:44:15.758 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 6.7510000000000002e-06 2024-04-18T14:44:15.758 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:15.758 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:15.758 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_committed", 2024-04-18T14:44:15.758 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:15.605075+0000", 2024-04-18T14:44:15.758 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0032350230000000001 2024-04-18T14:44:15.758 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:15.758 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:15.758 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-04-18T14:44:15.758 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:15.605112+0000", 2024-04-18T14:44:15.758 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.7466999999999999e-05 2024-04-18T14:44:15.758 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:44:15.758 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T14:44:15.759 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:44:15.759 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:44:15.759 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T14:44:15.759 INFO:teuthology.orchestra.run.smithi096.stdout:} 2024-04-18T14:44:15.761 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-04-18T14:44:15.762 INFO:tasks.rados.rados.0.smithi134.stdout:322: writing smithi13430248-44 from 5259264 to 5931008 tid 2 2024-04-18T14:44:15.762 INFO:tasks.rados.rados.0.smithi134.stdout:322: writing smithi13430248-44 from 5931008 to 6733824 tid 3 2024-04-18T14:44:15.762 INFO:tasks.rados.rados.0.smithi134.stdout:322: writing smithi13430248-44 from 6733824 to 6815744 tid 4 2024-04-18T14:44:15.762 INFO:tasks.rados.rados.0.smithi134.stdout:323: snap_create 2024-04-18T14:44:15.763 INFO:tasks.rados.rados.0.smithi134.stdout:update_object_version oid 49 v 103 (ObjNum 48 snap 0 seq_num 48) dirty exists 2024-04-18T14:44:15.763 INFO:tasks.rados.rados.0.smithi134.stdout:318: finishing copy_from racing read to smithi13430248-46 2024-04-18T14:44:15.763 INFO:tasks.rados.rados.0.smithi134.stdout:318: finishing copy_from to smithi13430248-46 2024-04-18T14:44:15.763 INFO:tasks.rados.rados.0.smithi134.stdout:update_object_version oid 46 v 61 (ObjNum 103 snap 21 seq_num 103) dirty exists 2024-04-18T14:44:15.763 INFO:tasks.rados.rados.0.smithi134.stdout:319: finishing write tid 1 to smithi13430248-35 2024-04-18T14:44:15.763 INFO:tasks.rados.rados.0.smithi134.stdout:319: finishing write tid 2 to smithi13430248-35 2024-04-18T14:44:15.763 INFO:tasks.rados.rados.0.smithi134.stdout:319: finishing write tid 3 to smithi13430248-35 2024-04-18T14:44:15.763 INFO:tasks.rados.rados.0.smithi134.stdout:319: finishing write tid 4 to smithi13430248-35 2024-04-18T14:44:15.763 INFO:tasks.rados.rados.0.smithi134.stdout:319: finishing write tid 5 to smithi13430248-35 2024-04-18T14:44:15.763 INFO:tasks.rados.rados.0.smithi134.stdout:319: finishing write tid 6 to smithi13430248-35 2024-04-18T14:44:15.763 INFO:tasks.rados.rados.0.smithi134.stdout:319: oid 35 updating version 0 to 136 2024-04-18T14:44:15.763 INFO:tasks.rados.rados.0.smithi134.stdout:319: oid 35 updating version 136 to 137 2024-04-18T14:44:15.763 INFO:tasks.rados.rados.0.smithi134.stdout:319: oid 35 version 137 is already newer than 135 2024-04-18T14:44:15.763 INFO:tasks.rados.rados.0.smithi134.stdout:319: oid 35 version 137 is already newer than 134 2024-04-18T14:44:15.763 INFO:tasks.rados.rados.0.smithi134.stdout:319: oid 35 version 137 is already newer than 133 2024-04-18T14:44:15.764 INFO:tasks.rados.rados.0.smithi134.stdout:update_object_version oid 35 v 137 (ObjNum 127 snap 29 seq_num 127) dirty exists 2024-04-18T14:44:15.764 INFO:tasks.rados.rados.0.smithi134.stdout:319: left oid 35 (ObjNum 127 snap 29 seq_num 127) 2024-04-18T14:44:15.764 INFO:tasks.rados.rados.0.smithi134.stdout:320: finishing write tid 1 to smithi13430248-12 2024-04-18T14:44:15.764 INFO:tasks.rados.rados.0.smithi134.stdout:320: finishing write tid 2 to smithi13430248-12 2024-04-18T14:44:15.764 INFO:tasks.rados.rados.0.smithi134.stdout:320: finishing write tid 3 to smithi13430248-12 2024-04-18T14:44:15.764 INFO:tasks.rados.rados.0.smithi134.stdout:320: finishing write tid 4 to smithi13430248-12 2024-04-18T14:44:15.764 INFO:tasks.rados.rados.0.smithi134.stdout:320: finishing write tid 5 to smithi13430248-12 2024-04-18T14:44:15.764 INFO:tasks.rados.rados.0.smithi134.stdout:320: finishing write tid 6 to smithi13430248-12 2024-04-18T14:44:15.764 INFO:tasks.rados.rados.0.smithi134.stdout:320: oid 12 updating version 0 to 131 2024-04-18T14:44:15.764 INFO:tasks.rados.rados.0.smithi134.stdout:320: oid 12 updating version 131 to 135 2024-04-18T14:44:15.764 INFO:tasks.rados.rados.0.smithi134.stdout:320: oid 12 version 135 is already newer than 132 2024-04-18T14:44:15.764 INFO:tasks.rados.rados.0.smithi134.stdout:320: oid 12 version 135 is already newer than 134 2024-04-18T14:44:15.764 INFO:tasks.rados.rados.0.smithi134.stdout:320: oid 12 version 135 is already newer than 133 2024-04-18T14:44:15.764 INFO:tasks.rados.rados.0.smithi134.stdout:update_object_version oid 12 v 135 (ObjNum 128 snap 29 seq_num 128) dirty exists 2024-04-18T14:44:15.764 INFO:tasks.rados.rados.0.smithi134.stdout:320: left oid 12 (ObjNum 128 snap 29 seq_num 128) 2024-04-18T14:44:15.765 INFO:tasks.rados.rados.0.smithi134.stdout:321: finishing write tid 1 to smithi13430248-28 2024-04-18T14:44:15.765 INFO:tasks.rados.rados.0.smithi134.stdout:321: finishing write tid 2 to smithi13430248-28 2024-04-18T14:44:15.765 INFO:tasks.rados.rados.0.smithi134.stdout:321: finishing write tid 3 to smithi13430248-28 2024-04-18T14:44:15.765 INFO:tasks.rados.rados.0.smithi134.stdout:321: finishing write tid 4 to smithi13430248-28 2024-04-18T14:44:15.765 INFO:tasks.rados.rados.0.smithi134.stdout:321: finishing write tid 5 to smithi13430248-28 2024-04-18T14:44:15.765 INFO:tasks.rados.rados.0.smithi134.stdout:321: finishing write tid 6 to smithi13430248-28 2024-04-18T14:44:15.765 INFO:tasks.rados.rados.0.smithi134.stdout:321: oid 28 updating version 0 to 76 2024-04-18T14:44:15.765 INFO:tasks.rados.rados.0.smithi134.stdout:321: oid 28 version 76 is already newer than 75 2024-04-18T14:44:15.765 INFO:tasks.rados.rados.0.smithi134.stdout:321: oid 28 updating version 76 to 77 2024-04-18T14:44:15.765 INFO:tasks.rados.rados.0.smithi134.stdout:321: oid 28 version 77 is already newer than 74 2024-04-18T14:44:15.765 INFO:tasks.rados.rados.0.smithi134.stdout:321: oid 28 updating version 77 to 78 2024-04-18T14:44:15.765 INFO:tasks.rados.rados.0.smithi134.stdout:update_object_version oid 28 v 78 (ObjNum 129 snap 29 seq_num 129) dirty exists 2024-04-18T14:44:15.765 INFO:tasks.rados.rados.0.smithi134.stdout:321: left oid 28 (ObjNum 129 snap 29 seq_num 129) 2024-04-18T14:44:15.765 INFO:tasks.rados.rados.0.smithi134.stdout:322: finishing write tid 1 to smithi13430248-44 2024-04-18T14:44:15.765 INFO:tasks.rados.rados.0.smithi134.stdout:322: finishing write tid 2 to smithi13430248-44 2024-04-18T14:44:15.765 INFO:tasks.rados.rados.0.smithi134.stdout:322: finishing write tid 3 to smithi13430248-44 2024-04-18T14:44:15.766 INFO:tasks.rados.rados.0.smithi134.stdout:322: finishing write tid 4 to smithi13430248-44 2024-04-18T14:44:15.766 INFO:tasks.rados.rados.0.smithi134.stdout:322: finishing write tid 5 to smithi13430248-44 2024-04-18T14:44:15.766 INFO:tasks.rados.rados.0.smithi134.stdout:322: finishing write tid 6 to smithi13430248-44 2024-04-18T14:44:15.766 INFO:tasks.rados.rados.0.smithi134.stdout:322: oid 44 updating version 0 to 42 2024-04-18T14:44:15.766 INFO:tasks.rados.rados.0.smithi134.stdout:322: oid 44 updating version 42 to 45 2024-04-18T14:44:15.766 INFO:tasks.rados.rados.0.smithi134.stdout:322: oid 44 version 45 is already newer than 44 2024-04-18T14:44:15.766 INFO:tasks.rados.rados.0.smithi134.stdout:322: oid 44 updating version 45 to 46 2024-04-18T14:44:15.766 INFO:tasks.rados.rados.0.smithi134.stdout:322: oid 44 version 46 is already newer than 43 2024-04-18T14:44:15.766 INFO:tasks.rados.rados.0.smithi134.stdout:update_object_version oid 44 v 46 (ObjNum 130 snap 29 seq_num 130) dirty exists 2024-04-18T14:44:15.766 INFO:tasks.rados.rados.0.smithi134.stdout:322: left oid 44 (ObjNum 130 snap 29 seq_num 130) 2024-04-18T14:44:15.767 INFO:tasks.ceph.osd.8.smithi086.stderr:2024-04-18T14:44:15.757+0000 7f29f7b9d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 8 (PID: 24958) UID: 0 2024-04-18T14:44:15.861 INFO:tasks.ceph.osd.5.smithi096.stderr:2024-04-18T14:44:15.857+0000 7fc33f25b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 24889) UID: 0 2024-04-18T14:44:15.890 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2024-04-18T14:44:15.890 INFO:teuthology.orchestra.run.smithi096.stdout: "ops": [], 2024-04-18T14:44:15.890 INFO:teuthology.orchestra.run.smithi096.stdout: "num_ops": 0 2024-04-18T14:44:15.890 INFO:teuthology.orchestra.run.smithi096.stdout:} 2024-04-18T14:44:15.904 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-04-18T14:44:15.991 INFO:tasks.ceph.osd.13.smithi096.stderr:2024-04-18T14:44:15.989+0000 7f7e72fad640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 13 (PID: 24893) UID: 0 2024-04-18T14:44:16.063 INFO:tasks.ceph.osd.14.smithi119.stderr:2024-04-18T14:44:16.066+0000 7f180f599640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 14 (PID: 24900) UID: 0 2024-04-18T14:44:16.069 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2024-04-18T14:44:16.070 INFO:teuthology.orchestra.run.smithi096.stdout: "ops": [], 2024-04-18T14:44:16.070 INFO:teuthology.orchestra.run.smithi096.stdout: "complaint_time": 30, 2024-04-18T14:44:16.070 INFO:teuthology.orchestra.run.smithi096.stdout: "num_blocked_ops": 0 2024-04-18T14:44:16.070 INFO:teuthology.orchestra.run.smithi096.stdout:} 2024-04-18T14:44:16.084 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-04-18T14:44:16.171 INFO:tasks.ceph.osd.1.smithi096.stderr:2024-04-18T14:44:16.169+0000 7f56a7a98640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 24887) UID: 0 2024-04-18T14:44:16.254 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2024-04-18T14:44:16.255 INFO:teuthology.orchestra.run.smithi096.stdout: "size": 20, 2024-04-18T14:44:16.255 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 600, 2024-04-18T14:44:16.255 INFO:teuthology.orchestra.run.smithi096.stdout: "ops": [ 2024-04-18T14:44:16.255 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:16.255 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4559.0:250 3.8s0 3:1aa3fae8:::smithi13430248-32:head [delete] snapc 8=[8,7,4,2] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e41)", 2024-04-18T14:44:16.255 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-04-18T14:43:40.758415+0000", 2024-04-18T14:44:16.255 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 35.494996407000002, 2024-04-18T14:44:16.255 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.019264455999999999, 2024-04-18T14:44:16.255 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-04-18T14:44:16.255 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T14:44:16.255 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-04-18T14:44:16.255 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4559", 2024-04-18T14:44:16.255 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "172.21.15.134:0/3113589487", 2024-04-18T14:44:16.255 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 250 2024-04-18T14:44:16.256 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:16.256 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-04-18T14:44:16.256 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:16.256 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-04-18T14:44:16.256 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:40.758415+0000", 2024-04-18T14:44:16.256 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:44:16.256 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:16.256 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:16.256 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-04-18T14:44:16.256 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:40.758415+0000", 2024-04-18T14:44:16.256 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:44:16.256 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:16.256 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:16.256 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-04-18T14:44:16.256 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:40.758413+0000", 2024-04-18T14:44:16.257 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 4294967295.9999971 2024-04-18T14:44:16.257 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:16.257 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:16.257 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-04-18T14:44:16.257 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:40.758426+0000", 2024-04-18T14:44:16.257 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.3286e-05 2024-04-18T14:44:16.257 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:16.257 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:16.257 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-04-18T14:44:16.257 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:40.758452+0000", 2024-04-18T14:44:16.257 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.6016e-05 2024-04-18T14:44:16.257 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:16.257 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:16.257 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-04-18T14:44:16.257 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:40.758470+0000", 2024-04-18T14:44:16.258 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.8465999999999999e-05 2024-04-18T14:44:16.258 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:16.258 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:16.258 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-04-18T14:44:16.258 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:40.758631+0000", 2024-04-18T14:44:16.258 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000160929 2024-04-18T14:44:16.258 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:16.258 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:16.258 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op must wait for map", 2024-04-18T14:44:16.258 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:40.758652+0000", 2024-04-18T14:44:16.258 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.0494999999999999e-05 2024-04-18T14:44:16.258 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:16.258 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:16.258 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-04-18T14:44:16.259 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:40.762268+0000", 2024-04-18T14:44:16.259 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.003616265 2024-04-18T14:44:16.259 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:16.259 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:16.259 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-04-18T14:44:16.259 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:40.762418+0000", 2024-04-18T14:44:16.259 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00014972 2024-04-18T14:44:16.259 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:16.259 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:16.259 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_started", 2024-04-18T14:44:16.259 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:40.764042+0000", 2024-04-18T14:44:16.259 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.001624611 2024-04-18T14:44:16.259 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:16.259 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:16.260 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_committed", 2024-04-18T14:44:16.260 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:40.769066+0000", 2024-04-18T14:44:16.260 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0050236009999999999 2024-04-18T14:44:16.260 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:16.260 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:16.260 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-04-18T14:44:16.260 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:40.777434+0000", 2024-04-18T14:44:16.260 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0083685059999999995 2024-04-18T14:44:16.260 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:16.260 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:16.260 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-04-18T14:44:16.260 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:40.777680+0000", 2024-04-18T14:44:16.261 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00024547499999999999 2024-04-18T14:44:16.261 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:44:16.261 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T14:44:16.261 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:44:16.261 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:16.261 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:16.261 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4559.0:384 3.8s0 3:106507f9:::smithi13430248-8:head [read 0~2228224,checksum] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-04-18T14:44:16.261 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-04-18T14:43:50.414088+0000", 2024-04-18T14:44:16.262 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 25.839323897, 2024-04-18T14:44:16.262 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.014292908999999999, 2024-04-18T14:44:16.262 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-04-18T14:44:16.262 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "started", 2024-04-18T14:44:16.262 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-04-18T14:44:16.262 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4559", 2024-04-18T14:44:16.262 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "172.21.15.134:0/3113589487", 2024-04-18T14:44:16.262 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 384 2024-04-18T14:44:16.262 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:16.262 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-04-18T14:44:16.262 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:16.262 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-04-18T14:44:16.262 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:50.414088+0000", 2024-04-18T14:44:16.262 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:44:16.263 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:16.263 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:16.263 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-04-18T14:44:16.263 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:50.414088+0000", 2024-04-18T14:44:16.263 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:44:16.263 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:16.263 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:16.263 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-04-18T14:44:16.263 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:50.414087+0000", 2024-04-18T14:44:16.263 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 4294967295.999999 2024-04-18T14:44:16.263 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:16.263 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:16.263 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-04-18T14:44:16.263 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:50.414094+0000", 2024-04-18T14:44:16.264 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 7.4229999999999999e-06 2024-04-18T14:44:16.264 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:16.264 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:16.264 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-04-18T14:44:16.264 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:50.414116+0000", 2024-04-18T14:44:16.264 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.1699999999999999e-05 2024-04-18T14:44:16.264 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:16.264 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:16.264 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-04-18T14:44:16.264 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:50.414134+0000", 2024-04-18T14:44:16.264 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.7662000000000001e-05 2024-04-18T14:44:16.264 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:16.264 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:16.265 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-04-18T14:44:16.265 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:50.420027+0000", 2024-04-18T14:44:16.265 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0058936429999999996 2024-04-18T14:44:16.265 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:16.265 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:16.265 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-04-18T14:44:16.265 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:50.420289+0000", 2024-04-18T14:44:16.265 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00026191700000000002 2024-04-18T14:44:16.265 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:16.265 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:16.265 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-04-18T14:44:16.265 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:50.428381+0000", 2024-04-18T14:44:16.265 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0080917279999999994 2024-04-18T14:44:16.265 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:44:16.266 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T14:44:16.266 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:44:16.266 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:16.266 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:16.266 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4559.0:511 3.8s0 3:1890b7c2:::smithi13430248-36:head [append 0~0] snapc 19=[19,16,14,13,11,f,b,a,7,2] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-18T14:44:16.266 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-04-18T14:43:56.576521+0000", 2024-04-18T14:44:16.266 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 19.676890582999999, 2024-04-18T14:44:16.266 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.015922446999999999, 2024-04-18T14:44:16.266 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-04-18T14:44:16.266 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T14:44:16.266 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-04-18T14:44:16.266 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4559", 2024-04-18T14:44:16.266 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "172.21.15.134:0/3113589487", 2024-04-18T14:44:16.266 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 511 2024-04-18T14:44:16.266 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:16.267 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-04-18T14:44:16.267 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:16.267 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-04-18T14:44:16.267 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:56.576521+0000", 2024-04-18T14:44:16.267 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:44:16.267 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:16.267 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:16.267 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-04-18T14:44:16.267 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:56.576521+0000", 2024-04-18T14:44:16.267 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:44:16.268 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:16.268 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:16.268 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-04-18T14:44:16.268 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:56.576520+0000", 2024-04-18T14:44:16.268 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 4294967295.999999 2024-04-18T14:44:16.268 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:16.268 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:16.268 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-04-18T14:44:16.268 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:56.576526+0000", 2024-04-18T14:44:16.268 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 5.4e-06 2024-04-18T14:44:16.268 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:16.268 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:16.268 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-04-18T14:44:16.268 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:56.576537+0000", 2024-04-18T14:44:16.269 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.092e-05 2024-04-18T14:44:16.269 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:16.269 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:16.269 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-04-18T14:44:16.269 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:56.576545+0000", 2024-04-18T14:44:16.269 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 8.1359999999999997e-06 2024-04-18T14:44:16.269 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:16.269 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:16.269 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-04-18T14:44:16.269 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:56.582916+0000", 2024-04-18T14:44:16.269 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0063709309999999998 2024-04-18T14:44:16.269 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:16.269 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:16.270 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-04-18T14:44:16.270 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:56.583218+0000", 2024-04-18T14:44:16.270 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00030191700000000002 2024-04-18T14:44:16.270 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:16.270 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:16.270 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_started", 2024-04-18T14:44:16.270 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:56.584150+0000", 2024-04-18T14:44:16.270 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00093191499999999996 2024-04-18T14:44:16.270 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:16.270 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:16.270 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_committed", 2024-04-18T14:44:16.270 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:56.585463+0000", 2024-04-18T14:44:16.270 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.001313423 2024-04-18T14:44:16.271 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:16.271 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:16.271 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-04-18T14:44:16.271 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:56.592328+0000", 2024-04-18T14:44:16.271 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0068650860000000003 2024-04-18T14:44:16.271 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:16.271 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:16.271 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-04-18T14:44:16.271 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:56.592444+0000", 2024-04-18T14:44:16.271 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000115526 2024-04-18T14:44:16.271 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:44:16.271 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T14:44:16.271 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:44:16.271 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:16.271 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:16.272 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4559.0:627 3.8s0 3:1d392465:::smithi13430248-23:head [append 0~688128] snapc 22=[22,1e,1d,1c,1a,16,14,13,11,a,2] ondisk+write+known_if_redirected+supports_pool_eio e66)", 2024-04-18T14:44:16.272 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-04-18T14:44:05.406491+0000", 2024-04-18T14:44:16.272 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 10.846920594, 2024-04-18T14:44:16.272 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.013545857999999999, 2024-04-18T14:44:16.272 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-04-18T14:44:16.272 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T14:44:16.272 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-04-18T14:44:16.272 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4559", 2024-04-18T14:44:16.272 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "172.21.15.134:0/3113589487", 2024-04-18T14:44:16.272 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 627 2024-04-18T14:44:16.272 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:16.272 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-04-18T14:44:16.272 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:16.272 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-04-18T14:44:16.273 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:05.406491+0000", 2024-04-18T14:44:16.273 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:44:16.273 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:16.273 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:16.273 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-04-18T14:44:16.273 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:05.406491+0000", 2024-04-18T14:44:16.273 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:44:16.273 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:16.273 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:16.273 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-04-18T14:44:16.273 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:05.406488+0000", 2024-04-18T14:44:16.273 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 4294967295.9999971 2024-04-18T14:44:16.273 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:16.274 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:16.274 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-04-18T14:44:16.274 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:05.407775+0000", 2024-04-18T14:44:16.274 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0012864879999999999 2024-04-18T14:44:16.274 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:16.274 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:16.274 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-04-18T14:44:16.274 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:05.407820+0000", 2024-04-18T14:44:16.274 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 4.5349000000000002e-05 2024-04-18T14:44:16.274 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:16.274 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:16.274 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-04-18T14:44:16.274 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:05.407844+0000", 2024-04-18T14:44:16.274 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.3655e-05 2024-04-18T14:44:16.275 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:16.275 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:16.275 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-04-18T14:44:16.275 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:05.407986+0000", 2024-04-18T14:44:16.275 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000141901 2024-04-18T14:44:16.275 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:16.275 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:16.275 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-04-18T14:44:16.275 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:05.408312+0000", 2024-04-18T14:44:16.275 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00032621800000000003 2024-04-18T14:44:16.275 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:16.275 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:16.275 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_started", 2024-04-18T14:44:16.276 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:05.410801+0000", 2024-04-18T14:44:16.276 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0024885749999999998 2024-04-18T14:44:16.276 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:16.276 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:16.276 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_committed", 2024-04-18T14:44:16.276 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:05.416630+0000", 2024-04-18T14:44:16.276 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0058294189999999997 2024-04-18T14:44:16.276 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:16.276 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:16.276 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-04-18T14:44:16.276 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:05.419837+0000", 2024-04-18T14:44:16.276 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0032072569999999998 2024-04-18T14:44:16.276 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:16.276 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:16.277 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-04-18T14:44:16.277 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:05.420037+0000", 2024-04-18T14:44:16.277 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00019979199999999999 2024-04-18T14:44:16.277 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:44:16.277 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T14:44:16.277 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:44:16.277 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:16.277 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:16.277 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4559.0:630 3.8s0 3:1d392465:::smithi13430248-23:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e66)", 2024-04-18T14:44:16.277 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-04-18T14:44:05.412180+0000", 2024-04-18T14:44:16.277 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 10.841231480999999, 2024-04-18T14:44:16.277 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.013698691000000001, 2024-04-18T14:44:16.277 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-04-18T14:44:16.278 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "started", 2024-04-18T14:44:16.278 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-04-18T14:44:16.278 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4559", 2024-04-18T14:44:16.278 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "172.21.15.134:0/3113589487", 2024-04-18T14:44:16.278 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 630 2024-04-18T14:44:16.278 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:16.278 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-04-18T14:44:16.278 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:16.278 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-04-18T14:44:16.278 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:05.412180+0000", 2024-04-18T14:44:16.278 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:44:16.278 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:16.278 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:16.279 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-04-18T14:44:16.279 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:05.412180+0000", 2024-04-18T14:44:16.279 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:44:16.279 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:16.279 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:16.279 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-04-18T14:44:16.279 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:05.412179+0000", 2024-04-18T14:44:16.279 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 4294967295.9999986 2024-04-18T14:44:16.279 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:16.279 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:16.279 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-04-18T14:44:16.279 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:05.412186+0000", 2024-04-18T14:44:16.279 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 7.3270000000000003e-06 2024-04-18T14:44:16.279 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:16.280 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:16.280 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-04-18T14:44:16.280 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:05.412206+0000", 2024-04-18T14:44:16.280 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.9862999999999999e-05 2024-04-18T14:44:16.280 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:16.280 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:16.280 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-04-18T14:44:16.280 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:05.412221+0000", 2024-04-18T14:44:16.280 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.5193e-05 2024-04-18T14:44:16.280 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:16.280 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:16.280 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-04-18T14:44:16.280 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:05.421284+0000", 2024-04-18T14:44:16.280 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0090628819999999995 2024-04-18T14:44:16.280 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:16.281 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:16.281 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for rw locks", 2024-04-18T14:44:16.281 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:05.421444+0000", 2024-04-18T14:44:16.281 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0001596 2024-04-18T14:44:16.281 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:16.281 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:16.281 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-04-18T14:44:16.281 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:05.423535+0000", 2024-04-18T14:44:16.281 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0020910479999999999 2024-04-18T14:44:16.281 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:16.281 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:16.281 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-04-18T14:44:16.281 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:05.423693+0000", 2024-04-18T14:44:16.281 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00015754199999999999 2024-04-18T14:44:16.281 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:16.281 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:16.282 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-04-18T14:44:16.282 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:05.425879+0000", 2024-04-18T14:44:16.282 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00218658 2024-04-18T14:44:16.282 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:44:16.282 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T14:44:16.282 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:44:16.282 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:16.282 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:16.282 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4559.0:655 3.8s0 3:1aa3fae8:::smithi13430248-32:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e67)", 2024-04-18T14:44:16.282 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-04-18T14:44:06.440253+0000", 2024-04-18T14:44:16.282 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 9.8131589409999993, 2024-04-18T14:44:16.282 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.013765484, 2024-04-18T14:44:16.282 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-04-18T14:44:16.282 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "started", 2024-04-18T14:44:16.283 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-04-18T14:44:16.283 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4559", 2024-04-18T14:44:16.283 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "172.21.15.134:0/3113589487", 2024-04-18T14:44:16.283 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 655 2024-04-18T14:44:16.283 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:16.283 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-04-18T14:44:16.283 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:16.283 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-04-18T14:44:16.283 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:06.440253+0000", 2024-04-18T14:44:16.283 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:44:16.283 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:16.284 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:16.284 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-04-18T14:44:16.284 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:06.440253+0000", 2024-04-18T14:44:16.284 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:44:16.284 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:16.284 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:16.284 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-04-18T14:44:16.284 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:06.440252+0000", 2024-04-18T14:44:16.284 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 4294967295.9999986 2024-04-18T14:44:16.284 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:16.284 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:16.284 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-04-18T14:44:16.284 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:06.440259+0000", 2024-04-18T14:44:16.285 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 7.1760000000000004e-06 2024-04-18T14:44:16.285 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:16.285 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:16.285 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-04-18T14:44:16.285 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:06.440278+0000", 2024-04-18T14:44:16.285 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.9619999999999998e-05 2024-04-18T14:44:16.285 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:16.285 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:16.285 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-04-18T14:44:16.285 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:06.440293+0000", 2024-04-18T14:44:16.285 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.4486e-05 2024-04-18T14:44:16.285 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:16.285 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:16.285 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-04-18T14:44:16.286 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:06.448355+0000", 2024-04-18T14:44:16.286 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0080625160000000005 2024-04-18T14:44:16.286 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:16.286 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:16.286 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for rw locks", 2024-04-18T14:44:16.286 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:06.448504+0000", 2024-04-18T14:44:16.286 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000148806 2024-04-18T14:44:16.286 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:16.286 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:16.286 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-04-18T14:44:16.287 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:06.450564+0000", 2024-04-18T14:44:16.287 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0020598579999999999 2024-04-18T14:44:16.287 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:16.287 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:16.287 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-04-18T14:44:16.287 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:06.450826+0000", 2024-04-18T14:44:16.287 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000262074 2024-04-18T14:44:16.287 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:16.287 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:16.287 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-04-18T14:44:16.287 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:06.454018+0000", 2024-04-18T14:44:16.287 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.003192271 2024-04-18T14:44:16.287 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:44:16.287 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T14:44:16.288 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:44:16.288 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:16.288 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:16.288 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4559.0:700 3.8s0 3:1890b7c2:::smithi13430248-36:head [read 0~2277376,checksum,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e71)", 2024-04-18T14:44:16.288 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-04-18T14:44:10.450791+0000", 2024-04-18T14:44:16.288 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 5.8026212059999995, 2024-04-18T14:44:16.288 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.0036317619999999, 2024-04-18T14:44:16.288 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-04-18T14:44:16.288 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "started", 2024-04-18T14:44:16.288 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-04-18T14:44:16.288 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4559", 2024-04-18T14:44:16.288 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "172.21.15.134:0/3113589487", 2024-04-18T14:44:16.288 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 700 2024-04-18T14:44:16.289 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:16.289 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-04-18T14:44:16.289 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:16.289 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-04-18T14:44:16.289 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:10.450791+0000", 2024-04-18T14:44:16.289 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:44:16.289 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:16.289 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:16.289 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-04-18T14:44:16.289 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:10.450791+0000", 2024-04-18T14:44:16.289 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:44:16.290 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:16.290 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:16.290 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-04-18T14:44:16.290 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:10.450787+0000", 2024-04-18T14:44:16.290 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 4294967295.9999962 2024-04-18T14:44:16.290 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:16.290 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:16.290 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-04-18T14:44:16.290 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:10.450809+0000", 2024-04-18T14:44:16.290 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.1659e-05 2024-04-18T14:44:16.290 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:16.291 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:16.291 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-04-18T14:44:16.291 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:10.450863+0000", 2024-04-18T14:44:16.291 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 5.4095999999999998e-05 2024-04-18T14:44:16.291 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:16.291 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:16.291 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-04-18T14:44:16.291 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:10.450888+0000", 2024-04-18T14:44:16.291 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.5425000000000001e-05 2024-04-18T14:44:16.291 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:16.291 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:16.291 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-04-18T14:44:16.291 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:10.451094+0000", 2024-04-18T14:44:16.292 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000205892 2024-04-18T14:44:16.292 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:16.292 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:16.292 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for peered", 2024-04-18T14:44:16.292 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:10.451100+0000", 2024-04-18T14:44:16.292 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 6.4250000000000003e-06 2024-04-18T14:44:16.292 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:16.292 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:16.292 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-04-18T14:44:16.292 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:11.441774+0000", 2024-04-18T14:44:16.292 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.99067378399999995 2024-04-18T14:44:16.292 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:16.292 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:16.292 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-04-18T14:44:16.292 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:11.442482+0000", 2024-04-18T14:44:16.293 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000707561 2024-04-18T14:44:16.293 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:16.293 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:16.293 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-04-18T14:44:16.293 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:11.454422+0000", 2024-04-18T14:44:16.293 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.011940749000000001 2024-04-18T14:44:16.293 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:44:16.293 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T14:44:16.293 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:44:16.293 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:16.293 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:16.293 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4559.0:701 3.8s0 3:1890b7c2:::smithi13430248-36:head [read 0~2277376,checksum] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e71)", 2024-04-18T14:44:16.293 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-04-18T14:44:10.450921+0000", 2024-04-18T14:44:16.294 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 5.802490938, 2024-04-18T14:44:16.294 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.0086094160000001, 2024-04-18T14:44:16.294 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-04-18T14:44:16.294 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "started", 2024-04-18T14:44:16.294 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-04-18T14:44:16.294 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4559", 2024-04-18T14:44:16.294 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "172.21.15.134:0/3113589487", 2024-04-18T14:44:16.294 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 701 2024-04-18T14:44:16.294 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:16.294 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-04-18T14:44:16.294 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:16.294 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-04-18T14:44:16.295 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:10.450921+0000", 2024-04-18T14:44:16.295 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:44:16.295 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:16.295 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:16.295 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-04-18T14:44:16.295 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:10.450921+0000", 2024-04-18T14:44:16.295 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:44:16.295 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:16.295 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:16.295 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-04-18T14:44:16.295 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:10.450919+0000", 2024-04-18T14:44:16.295 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 4294967295.9999986 2024-04-18T14:44:16.295 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:16.295 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:16.296 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-04-18T14:44:16.296 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:10.450939+0000", 2024-04-18T14:44:16.296 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.9378999999999999e-05 2024-04-18T14:44:16.296 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:16.296 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:16.296 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-04-18T14:44:16.296 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:10.450961+0000", 2024-04-18T14:44:16.296 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.2537000000000001e-05 2024-04-18T14:44:16.296 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:16.296 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:16.296 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-04-18T14:44:16.296 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:10.450978+0000", 2024-04-18T14:44:16.296 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.6432000000000001e-05 2024-04-18T14:44:16.296 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:16.296 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:16.297 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-04-18T14:44:16.297 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:10.451427+0000", 2024-04-18T14:44:16.297 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00044940099999999999 2024-04-18T14:44:16.297 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:16.297 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:16.297 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for peered", 2024-04-18T14:44:16.297 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:10.451432+0000", 2024-04-18T14:44:16.297 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 5.293e-06 2024-04-18T14:44:16.297 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:16.297 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:16.297 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-04-18T14:44:16.297 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:11.449104+0000", 2024-04-18T14:44:16.297 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.99767109700000001 2024-04-18T14:44:16.298 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:16.298 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:16.298 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-04-18T14:44:16.298 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:11.449872+0000", 2024-04-18T14:44:16.298 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00076860399999999999 2024-04-18T14:44:16.298 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:16.298 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:16.298 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-04-18T14:44:16.298 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:11.459530+0000", 2024-04-18T14:44:16.298 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0096582000000000005 2024-04-18T14:44:16.298 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:44:16.298 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T14:44:16.298 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:44:16.298 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:16.299 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:16.299 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4559.0:702 3.8s0 3:1890b7c2:::smithi13430248-36:head [read 0~2277376,checksum] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e71)", 2024-04-18T14:44:16.299 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-04-18T14:44:10.451254+0000", 2024-04-18T14:44:16.299 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 5.8021574759999996, 2024-04-18T14:44:16.299 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.017487407, 2024-04-18T14:44:16.299 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-04-18T14:44:16.299 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "started", 2024-04-18T14:44:16.299 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-04-18T14:44:16.299 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4559", 2024-04-18T14:44:16.299 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "172.21.15.134:0/3113589487", 2024-04-18T14:44:16.299 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 702 2024-04-18T14:44:16.299 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:16.299 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-04-18T14:44:16.299 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:16.300 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-04-18T14:44:16.300 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:10.451254+0000", 2024-04-18T14:44:16.300 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:44:16.300 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:16.300 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:16.300 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-04-18T14:44:16.300 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:10.451254+0000", 2024-04-18T14:44:16.300 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:44:16.300 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:16.300 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:16.300 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-04-18T14:44:16.300 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:10.451252+0000", 2024-04-18T14:44:16.300 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 4294967295.9999981 2024-04-18T14:44:16.300 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:16.301 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:16.301 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-04-18T14:44:16.301 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:10.451266+0000", 2024-04-18T14:44:16.301 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.3416e-05 2024-04-18T14:44:16.301 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:16.301 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:16.301 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-04-18T14:44:16.301 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:10.451294+0000", 2024-04-18T14:44:16.301 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.8016000000000001e-05 2024-04-18T14:44:16.301 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:16.301 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:16.301 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-04-18T14:44:16.301 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:10.451314+0000", 2024-04-18T14:44:16.302 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.0533000000000001e-05 2024-04-18T14:44:16.302 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:16.302 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:16.302 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-04-18T14:44:16.302 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:10.451543+0000", 2024-04-18T14:44:16.302 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00022914499999999999 2024-04-18T14:44:16.302 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:16.302 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:16.302 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for peered", 2024-04-18T14:44:16.302 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:10.451548+0000", 2024-04-18T14:44:16.302 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 4.4259999999999996e-06 2024-04-18T14:44:16.302 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:16.302 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:16.302 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-04-18T14:44:16.303 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:11.459742+0000", 2024-04-18T14:44:16.303 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.0081943200000001 2024-04-18T14:44:16.303 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:16.303 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:16.303 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-04-18T14:44:16.303 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:11.460043+0000", 2024-04-18T14:44:16.303 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00030079 2024-04-18T14:44:16.303 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:16.303 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:16.303 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-04-18T14:44:16.303 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:11.468742+0000", 2024-04-18T14:44:16.303 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0086989040000000004 2024-04-18T14:44:16.303 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:44:16.303 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T14:44:16.303 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:44:16.304 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:16.304 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:16.304 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(osd.6.22:3 3.8s0 3:1d392465:::smithi13430248-23:head [assert-version v101,copy-get max 8388608] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e72)", 2024-04-18T14:44:16.304 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-04-18T14:44:11.397780+0000", 2024-04-18T14:44:16.304 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 4.8556314270000005, 2024-04-18T14:44:16.304 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.073837854999999994, 2024-04-18T14:44:16.304 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-04-18T14:44:16.304 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "started", 2024-04-18T14:44:16.304 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-04-18T14:44:16.304 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:16.304 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-04-18T14:44:16.304 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:11.397780+0000", 2024-04-18T14:44:16.304 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:44:16.305 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:16.305 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:16.305 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-04-18T14:44:16.305 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:11.397780+0000", 2024-04-18T14:44:16.305 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:44:16.305 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:16.305 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:16.305 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-04-18T14:44:16.305 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:11.397778+0000", 2024-04-18T14:44:16.305 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 4294967295.9999971 2024-04-18T14:44:16.305 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:16.305 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:16.305 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-04-18T14:44:16.306 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:11.397806+0000", 2024-04-18T14:44:16.306 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.8742999999999999e-05 2024-04-18T14:44:16.306 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:16.306 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:16.306 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-04-18T14:44:16.306 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:11.397850+0000", 2024-04-18T14:44:16.306 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 4.3081999999999998e-05 2024-04-18T14:44:16.306 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:16.306 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:16.306 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-04-18T14:44:16.306 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:11.397881+0000", 2024-04-18T14:44:16.306 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.1463e-05 2024-04-18T14:44:16.306 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:16.306 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:16.307 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-04-18T14:44:16.307 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:11.410976+0000", 2024-04-18T14:44:16.307 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.013094814999999999 2024-04-18T14:44:16.307 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:16.307 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:16.307 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for peered", 2024-04-18T14:44:16.307 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:11.410985+0000", 2024-04-18T14:44:16.307 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 9.2599999999999994e-06 2024-04-18T14:44:16.307 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:16.307 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:16.307 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-04-18T14:44:16.307 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:11.462636+0000", 2024-04-18T14:44:16.307 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.051650790000000002 2024-04-18T14:44:16.308 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:16.308 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:16.308 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-04-18T14:44:16.308 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:11.463037+0000", 2024-04-18T14:44:16.308 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00040085700000000001 2024-04-18T14:44:16.308 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:16.308 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:16.308 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-04-18T14:44:16.308 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:11.471618+0000", 2024-04-18T14:44:16.308 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0085816109999999994 2024-04-18T14:44:16.308 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:44:16.308 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T14:44:16.308 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:44:16.309 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:16.309 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:16.309 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4559.0:731 3.8s0 3:106507f9:::smithi13430248-8:head [append 0~802816] snapc 27=[27,26,23,22,1e,1c,1a,16,14,13,11,2] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-04-18T14:44:16.309 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-04-18T14:44:11.747486+0000", 2024-04-18T14:44:16.309 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 4.5059260779999999, 2024-04-18T14:44:16.309 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.018250124999999999, 2024-04-18T14:44:16.309 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-04-18T14:44:16.309 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T14:44:16.309 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-04-18T14:44:16.309 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4559", 2024-04-18T14:44:16.309 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "172.21.15.134:0/3113589487", 2024-04-18T14:44:16.309 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 731 2024-04-18T14:44:16.309 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:16.310 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-04-18T14:44:16.310 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:16.310 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-04-18T14:44:16.310 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:11.747486+0000", 2024-04-18T14:44:16.310 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:44:16.310 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:16.310 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:16.310 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-04-18T14:44:16.310 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:11.747486+0000", 2024-04-18T14:44:16.310 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:44:16.310 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:16.310 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:16.310 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-04-18T14:44:16.310 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:11.747478+0000", 2024-04-18T14:44:16.311 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 4294967295.9999924 2024-04-18T14:44:16.311 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:16.311 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:16.311 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-04-18T14:44:16.311 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:11.749760+0000", 2024-04-18T14:44:16.311 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.002281543 2024-04-18T14:44:16.311 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:16.311 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:16.311 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-04-18T14:44:16.311 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:11.749786+0000", 2024-04-18T14:44:16.311 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.6112e-05 2024-04-18T14:44:16.311 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:16.312 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:16.312 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-04-18T14:44:16.312 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:11.749806+0000", 2024-04-18T14:44:16.312 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.0630000000000001e-05 2024-04-18T14:44:16.312 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:16.312 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:16.312 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-04-18T14:44:16.312 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:11.751125+0000", 2024-04-18T14:44:16.312 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0013190960000000001 2024-04-18T14:44:16.312 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:16.312 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:16.312 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-04-18T14:44:16.312 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:11.751316+0000", 2024-04-18T14:44:16.313 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00019024299999999999 2024-04-18T14:44:16.313 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:16.313 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:16.313 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_started", 2024-04-18T14:44:16.313 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:11.753188+0000", 2024-04-18T14:44:16.313 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0018724080000000001 2024-04-18T14:44:16.313 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:16.313 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:16.313 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_committed", 2024-04-18T14:44:16.313 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:11.764924+0000", 2024-04-18T14:44:16.313 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.011736384000000001 2024-04-18T14:44:16.313 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:16.313 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:16.313 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-04-18T14:44:16.314 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:11.765239+0000", 2024-04-18T14:44:16.314 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00031480599999999999 2024-04-18T14:44:16.314 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:16.314 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:16.314 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-04-18T14:44:16.314 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:11.765736+0000", 2024-04-18T14:44:16.314 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00049669999999999998 2024-04-18T14:44:16.314 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:44:16.314 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T14:44:16.314 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:44:16.314 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:16.314 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:16.315 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4559.0:732 3.8s0 3:106507f9:::smithi13430248-8:head [append 0~720896] snapc 27=[27,26,23,22,1e,1c,1a,16,14,13,11,2] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-04-18T14:44:16.315 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-04-18T14:44:11.752856+0000", 2024-04-18T14:44:16.315 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 4.5005560859999996, 2024-04-18T14:44:16.315 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.034769960000000003, 2024-04-18T14:44:16.315 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-04-18T14:44:16.315 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T14:44:16.315 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-04-18T14:44:16.315 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4559", 2024-04-18T14:44:16.315 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "172.21.15.134:0/3113589487", 2024-04-18T14:44:16.315 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 732 2024-04-18T14:44:16.315 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:16.316 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-04-18T14:44:16.316 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:16.316 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-04-18T14:44:16.316 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:11.752856+0000", 2024-04-18T14:44:16.316 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:44:16.316 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:16.316 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:16.316 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-04-18T14:44:16.316 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:11.752856+0000", 2024-04-18T14:44:16.316 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:44:16.316 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:16.316 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:16.316 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-04-18T14:44:16.316 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:11.752853+0000", 2024-04-18T14:44:16.317 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 4294967295.9999976 2024-04-18T14:44:16.317 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:16.317 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:16.317 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-04-18T14:44:16.317 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:11.754831+0000", 2024-04-18T14:44:16.317 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.001977946 2024-04-18T14:44:16.317 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:16.317 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:16.317 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-04-18T14:44:16.317 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:11.754865+0000", 2024-04-18T14:44:16.317 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.3756e-05 2024-04-18T14:44:16.317 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:16.317 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:16.317 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-04-18T14:44:16.317 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:11.754885+0000", 2024-04-18T14:44:16.318 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.0213000000000001e-05 2024-04-18T14:44:16.318 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:16.318 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:16.318 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-04-18T14:44:16.318 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:11.757505+0000", 2024-04-18T14:44:16.318 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0026195319999999999 2024-04-18T14:44:16.318 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:16.318 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:16.318 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-04-18T14:44:16.318 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:11.757878+0000", 2024-04-18T14:44:16.318 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000372689 2024-04-18T14:44:16.318 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:16.318 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:16.319 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_started", 2024-04-18T14:44:16.319 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:11.760371+0000", 2024-04-18T14:44:16.319 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0024931950000000001 2024-04-18T14:44:16.319 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:16.319 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:16.319 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_committed", 2024-04-18T14:44:16.319 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:11.764926+0000", 2024-04-18T14:44:16.319 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0045554460000000003 2024-04-18T14:44:16.319 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:16.319 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:16.319 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-04-18T14:44:16.319 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:11.786971+0000", 2024-04-18T14:44:16.319 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.022044956000000001 2024-04-18T14:44:16.319 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:16.319 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:16.320 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-04-18T14:44:16.320 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:11.787626+0000", 2024-04-18T14:44:16.320 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00065465399999999996 2024-04-18T14:44:16.320 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:44:16.320 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T14:44:16.320 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:44:16.320 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:16.320 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:16.320 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4559.0:733 3.8s0 3:106507f9:::smithi13430248-8:head [append 0~32768] snapc 27=[27,26,23,22,1e,1c,1a,16,14,13,11,2] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-04-18T14:44:16.320 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-04-18T14:44:11.754908+0000", 2024-04-18T14:44:16.320 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 4.4985035819999997, 2024-04-18T14:44:16.320 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.033340726000000001, 2024-04-18T14:44:16.320 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-04-18T14:44:16.320 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T14:44:16.321 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-04-18T14:44:16.321 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4559", 2024-04-18T14:44:16.321 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "172.21.15.134:0/3113589487", 2024-04-18T14:44:16.321 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 733 2024-04-18T14:44:16.321 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:16.321 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-04-18T14:44:16.321 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:16.321 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-04-18T14:44:16.321 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:11.754908+0000", 2024-04-18T14:44:16.321 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:44:16.321 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:16.321 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:16.321 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-04-18T14:44:16.322 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:11.754908+0000", 2024-04-18T14:44:16.322 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:44:16.322 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:16.322 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:16.322 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-04-18T14:44:16.322 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:11.754906+0000", 2024-04-18T14:44:16.322 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 4294967295.9999981 2024-04-18T14:44:16.322 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:16.322 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:16.322 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-04-18T14:44:16.322 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:11.754962+0000", 2024-04-18T14:44:16.322 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 5.5418999999999999e-05 2024-04-18T14:44:16.322 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:16.322 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:16.323 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-04-18T14:44:16.323 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:11.754984+0000", 2024-04-18T14:44:16.323 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.2523000000000001e-05 2024-04-18T14:44:16.323 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:16.323 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:16.323 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-04-18T14:44:16.323 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:11.755008+0000", 2024-04-18T14:44:16.323 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.4309000000000001e-05 2024-04-18T14:44:16.323 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:16.323 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:16.323 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-04-18T14:44:16.323 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:11.762184+0000", 2024-04-18T14:44:16.323 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0071758949999999998 2024-04-18T14:44:16.323 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:16.324 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:16.324 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-04-18T14:44:16.324 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:11.762387+0000", 2024-04-18T14:44:16.324 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000202895 2024-04-18T14:44:16.324 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:16.324 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:16.324 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_started", 2024-04-18T14:44:16.324 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:11.763696+0000", 2024-04-18T14:44:16.324 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.001308743 2024-04-18T14:44:16.324 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:16.324 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:16.324 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_committed", 2024-04-18T14:44:16.324 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:11.765944+0000", 2024-04-18T14:44:16.324 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0022475910000000002 2024-04-18T14:44:16.324 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:16.324 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:16.325 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-04-18T14:44:16.325 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:11.787875+0000", 2024-04-18T14:44:16.325 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.021931062000000001 2024-04-18T14:44:16.325 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:16.325 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:16.325 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-04-18T14:44:16.325 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:11.788249+0000", 2024-04-18T14:44:16.325 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00037438899999999998 2024-04-18T14:44:16.325 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:44:16.325 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T14:44:16.325 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:44:16.326 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:16.326 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:16.326 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4559.0:734 3.8s0 3:106507f9:::smithi13430248-8:head [setxattr _header (56) in=7b] snapc 27=[27,26,23,22,1e,1c,1a,16,14,13,11,2] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-04-18T14:44:16.326 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-04-18T14:44:11.755024+0000", 2024-04-18T14:44:16.326 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 4.498388201, 2024-04-18T14:44:16.326 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.034074383999999999, 2024-04-18T14:44:16.326 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-04-18T14:44:16.326 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T14:44:16.326 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-04-18T14:44:16.326 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4559", 2024-04-18T14:44:16.326 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "172.21.15.134:0/3113589487", 2024-04-18T14:44:16.326 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 734 2024-04-18T14:44:16.327 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:16.327 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-04-18T14:44:16.327 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:16.327 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-04-18T14:44:16.327 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:11.755024+0000", 2024-04-18T14:44:16.327 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:44:16.327 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:16.327 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:16.327 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-04-18T14:44:16.327 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:11.755024+0000", 2024-04-18T14:44:16.327 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:44:16.327 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:16.327 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:16.328 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-04-18T14:44:16.328 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:11.755022+0000", 2024-04-18T14:44:16.328 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 4294967295.9999986 2024-04-18T14:44:16.328 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:16.328 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:16.328 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-04-18T14:44:16.328 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:11.755031+0000", 2024-04-18T14:44:16.328 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 8.884e-06 2024-04-18T14:44:16.328 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:16.328 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:16.328 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-04-18T14:44:16.328 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:11.755049+0000", 2024-04-18T14:44:16.329 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.8372e-05 2024-04-18T14:44:16.329 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:16.329 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:16.329 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-04-18T14:44:16.329 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:11.755064+0000", 2024-04-18T14:44:16.329 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.418e-05 2024-04-18T14:44:16.329 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:16.329 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:16.329 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-04-18T14:44:16.329 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:11.766259+0000", 2024-04-18T14:44:16.329 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.011195208 2024-04-18T14:44:16.329 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:16.329 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:16.329 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-04-18T14:44:16.330 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:11.766455+0000", 2024-04-18T14:44:16.330 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00019597899999999999 2024-04-18T14:44:16.330 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:16.330 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:16.330 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_started", 2024-04-18T14:44:16.330 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:11.767454+0000", 2024-04-18T14:44:16.330 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00099949299999999995 2024-04-18T14:44:16.330 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:16.330 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:16.330 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_committed", 2024-04-18T14:44:16.330 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:11.770568+0000", 2024-04-18T14:44:16.330 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0031138419999999999 2024-04-18T14:44:16.331 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:16.331 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:16.331 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-04-18T14:44:16.331 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:11.788575+0000", 2024-04-18T14:44:16.331 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.018006501000000001 2024-04-18T14:44:16.331 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:16.331 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:16.331 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-04-18T14:44:16.331 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:11.789098+0000", 2024-04-18T14:44:16.331 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00052342199999999995 2024-04-18T14:44:16.331 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:44:16.331 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T14:44:16.331 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:44:16.331 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:16.332 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:16.332 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4559.0:735 3.8s0 3:106507f9:::smithi13430248-8:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e72)", 2024-04-18T14:44:16.332 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-04-18T14:44:11.755076+0000", 2024-04-18T14:44:16.332 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 4.4983359490000003, 2024-04-18T14:44:16.332 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.041597215, 2024-04-18T14:44:16.332 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-04-18T14:44:16.332 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "started", 2024-04-18T14:44:16.332 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-04-18T14:44:16.332 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4559", 2024-04-18T14:44:16.332 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "172.21.15.134:0/3113589487", 2024-04-18T14:44:16.332 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 735 2024-04-18T14:44:16.333 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:16.333 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-04-18T14:44:16.333 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:16.333 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-04-18T14:44:16.333 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:11.755076+0000", 2024-04-18T14:44:16.333 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:44:16.333 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:16.333 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:16.333 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-04-18T14:44:16.333 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:11.755076+0000", 2024-04-18T14:44:16.333 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:44:16.333 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:16.334 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:16.334 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-04-18T14:44:16.334 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:11.755075+0000", 2024-04-18T14:44:16.334 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 4294967295.9999986 2024-04-18T14:44:16.334 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:16.334 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:16.334 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-04-18T14:44:16.334 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:11.755081+0000", 2024-04-18T14:44:16.334 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 6.7569999999999998e-06 2024-04-18T14:44:16.334 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:16.334 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:16.334 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-04-18T14:44:16.334 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:11.755100+0000", 2024-04-18T14:44:16.335 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.8902e-05 2024-04-18T14:44:16.335 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:16.335 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:16.335 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-04-18T14:44:16.335 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:11.755114+0000", 2024-04-18T14:44:16.335 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.3664e-05 2024-04-18T14:44:16.335 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:16.335 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:16.335 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-04-18T14:44:16.335 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:11.768447+0000", 2024-04-18T14:44:16.335 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.013333024000000001 2024-04-18T14:44:16.335 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:16.336 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:16.336 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for rw locks", 2024-04-18T14:44:16.336 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:11.768656+0000", 2024-04-18T14:44:16.336 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00020867499999999999 2024-04-18T14:44:16.336 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:16.336 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:16.336 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-04-18T14:44:16.336 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:11.789996+0000", 2024-04-18T14:44:16.336 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.021340391 2024-04-18T14:44:16.336 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:16.336 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:16.336 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-04-18T14:44:16.336 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:11.790290+0000", 2024-04-18T14:44:16.336 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00029385400000000002 2024-04-18T14:44:16.337 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:16.337 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:16.337 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-04-18T14:44:16.337 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:11.796673+0000", 2024-04-18T14:44:16.337 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0063831679999999998 2024-04-18T14:44:16.337 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:44:16.337 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T14:44:16.337 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:44:16.337 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:16.337 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:16.337 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4559.0:736 3.8s0 3:1890b7c2:::smithi13430248-36:head [read 0~2277376,checksum,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e72)", 2024-04-18T14:44:16.337 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-04-18T14:44:11.755127+0000", 2024-04-18T14:44:16.338 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 4.4982850399999998, 2024-04-18T14:44:16.338 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.02301605, 2024-04-18T14:44:16.338 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-04-18T14:44:16.338 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "started", 2024-04-18T14:44:16.338 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-04-18T14:44:16.338 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4559", 2024-04-18T14:44:16.338 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "172.21.15.134:0/3113589487", 2024-04-18T14:44:16.338 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 736 2024-04-18T14:44:16.338 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:16.338 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-04-18T14:44:16.338 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:16.338 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-04-18T14:44:16.338 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:11.755127+0000", 2024-04-18T14:44:16.339 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:44:16.339 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:16.339 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:16.339 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-04-18T14:44:16.339 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:11.755127+0000", 2024-04-18T14:44:16.339 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:44:16.339 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:16.339 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:16.339 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-04-18T14:44:16.339 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:11.755126+0000", 2024-04-18T14:44:16.339 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 4294967295.999999 2024-04-18T14:44:16.339 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:16.340 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:16.340 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-04-18T14:44:16.340 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:11.755133+0000", 2024-04-18T14:44:16.340 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 7.7729999999999999e-06 2024-04-18T14:44:16.340 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:16.340 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:16.340 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-04-18T14:44:16.340 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:11.755151+0000", 2024-04-18T14:44:16.340 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.7235999999999999e-05 2024-04-18T14:44:16.340 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:16.340 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:16.340 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-04-18T14:44:16.340 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:11.755164+0000", 2024-04-18T14:44:16.341 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.325e-05 2024-04-18T14:44:16.341 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:16.341 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:16.341 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-04-18T14:44:16.341 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:11.768749+0000", 2024-04-18T14:44:16.341 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.013585372 2024-04-18T14:44:16.341 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:16.341 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:16.341 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-04-18T14:44:16.341 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:11.768912+0000", 2024-04-18T14:44:16.341 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00016301600000000001 2024-04-18T14:44:16.341 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:16.341 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:16.341 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-04-18T14:44:16.342 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:11.778143+0000", 2024-04-18T14:44:16.342 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0092305289999999995 2024-04-18T14:44:16.342 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:44:16.342 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T14:44:16.342 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:44:16.342 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:16.342 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:16.342 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4559.0:737 3.8s0 3:1890b7c2:::smithi13430248-36:head [read 0~2277376,checksum] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e72)", 2024-04-18T14:44:16.342 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-04-18T14:44:11.755176+0000", 2024-04-18T14:44:16.342 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 4.498235771, 2024-04-18T14:44:16.342 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.028686533, 2024-04-18T14:44:16.343 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-04-18T14:44:16.343 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "started", 2024-04-18T14:44:16.343 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-04-18T14:44:16.343 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4559", 2024-04-18T14:44:16.343 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "172.21.15.134:0/3113589487", 2024-04-18T14:44:16.343 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 737 2024-04-18T14:44:16.343 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:16.343 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-04-18T14:44:16.343 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:16.343 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-04-18T14:44:16.343 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:11.755176+0000", 2024-04-18T14:44:16.343 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:44:16.344 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:16.344 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:16.344 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-04-18T14:44:16.344 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:11.755176+0000", 2024-04-18T14:44:16.344 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:44:16.344 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:16.344 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:16.344 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-04-18T14:44:16.344 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:11.755175+0000", 2024-04-18T14:44:16.344 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 4294967295.999999 2024-04-18T14:44:16.344 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:16.344 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:16.344 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-04-18T14:44:16.345 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:11.755183+0000", 2024-04-18T14:44:16.345 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 8.0260000000000007e-06 2024-04-18T14:44:16.345 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:16.345 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:16.345 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-04-18T14:44:16.345 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:11.755200+0000", 2024-04-18T14:44:16.345 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.6963e-05 2024-04-18T14:44:16.345 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:16.345 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:16.345 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-04-18T14:44:16.345 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:11.755213+0000", 2024-04-18T14:44:16.345 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.254e-05 2024-04-18T14:44:16.345 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:16.345 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:16.345 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-04-18T14:44:16.346 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:11.769617+0000", 2024-04-18T14:44:16.346 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.014404597999999999 2024-04-18T14:44:16.346 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:16.346 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:16.346 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-04-18T14:44:16.346 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:11.769882+0000", 2024-04-18T14:44:16.346 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00026468500000000002 2024-04-18T14:44:16.346 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:16.346 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:16.346 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-04-18T14:44:16.346 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:11.783863+0000", 2024-04-18T14:44:16.346 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.013980853999999999 2024-04-18T14:44:16.346 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:44:16.346 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T14:44:16.347 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:44:16.347 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:16.347 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:16.347 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4559.0:738 3.8s0 3:1890b7c2:::smithi13430248-36:head [read 0~2277376,checksum] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e72)", 2024-04-18T14:44:16.347 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-04-18T14:44:11.755225+0000", 2024-04-18T14:44:16.347 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 4.4981864680000001, 2024-04-18T14:44:16.347 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.031362080000000001, 2024-04-18T14:44:16.347 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-04-18T14:44:16.347 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "started", 2024-04-18T14:44:16.347 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-04-18T14:44:16.347 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4559", 2024-04-18T14:44:16.347 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "172.21.15.134:0/3113589487", 2024-04-18T14:44:16.347 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 738 2024-04-18T14:44:16.347 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:16.347 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-04-18T14:44:16.348 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:16.348 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-04-18T14:44:16.348 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:11.755225+0000", 2024-04-18T14:44:16.348 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:44:16.348 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:16.348 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:16.348 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-04-18T14:44:16.348 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:11.755225+0000", 2024-04-18T14:44:16.348 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:44:16.348 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:16.348 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:16.348 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-04-18T14:44:16.348 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:11.755225+0000", 2024-04-18T14:44:16.348 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 4294967295.999999 2024-04-18T14:44:16.349 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:16.349 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:16.349 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-04-18T14:44:16.349 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:11.755231+0000", 2024-04-18T14:44:16.349 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 6.8329999999999996e-06 2024-04-18T14:44:16.349 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:16.349 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:16.349 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-04-18T14:44:16.349 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:11.755249+0000", 2024-04-18T14:44:16.349 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.7652999999999999e-05 2024-04-18T14:44:16.349 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:16.349 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:16.349 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-04-18T14:44:16.350 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:11.755262+0000", 2024-04-18T14:44:16.350 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.3397000000000001e-05 2024-04-18T14:44:16.350 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:16.350 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:16.350 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-04-18T14:44:16.350 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:11.773359+0000", 2024-04-18T14:44:16.350 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.018096847999999999 2024-04-18T14:44:16.350 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:16.350 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:16.350 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-04-18T14:44:16.350 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:11.773569+0000", 2024-04-18T14:44:16.350 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000209903 2024-04-18T14:44:16.350 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:16.351 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:16.351 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-04-18T14:44:16.351 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:11.786587+0000", 2024-04-18T14:44:16.351 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.01301835 2024-04-18T14:44:16.351 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:44:16.351 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T14:44:16.351 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:44:16.351 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:16.351 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:16.351 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4559.0:785 3.8s0 3:17e457c8:::smithi13430248-35:head [copy-from ver 61] snapc 2b=[2b,2a,29,28,27,26,23,22,1e,1c,1a,16,14,13,11,2] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-18T14:44:16.351 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-04-18T14:44:15.392614+0000", 2024-04-18T14:44:16.351 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 0.860798328, 2024-04-18T14:44:16.351 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.043019109999999999, 2024-04-18T14:44:16.351 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-04-18T14:44:16.352 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T14:44:16.352 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-04-18T14:44:16.352 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4559", 2024-04-18T14:44:16.352 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "172.21.15.134:0/3113589487", 2024-04-18T14:44:16.352 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 785 2024-04-18T14:44:16.352 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:16.352 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-04-18T14:44:16.352 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:16.352 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-04-18T14:44:16.352 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:15.392614+0000", 2024-04-18T14:44:16.352 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:44:16.352 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:16.352 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:16.353 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-04-18T14:44:16.353 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:15.392614+0000", 2024-04-18T14:44:16.353 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:44:16.353 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:16.353 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:16.353 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-04-18T14:44:16.353 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:15.392611+0000", 2024-04-18T14:44:16.353 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 4294967295.9999976 2024-04-18T14:44:16.353 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:16.353 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:16.353 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-04-18T14:44:16.353 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:15.392625+0000", 2024-04-18T14:44:16.353 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.3746e-05 2024-04-18T14:44:16.353 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:16.353 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:16.354 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-04-18T14:44:16.354 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:15.392655+0000", 2024-04-18T14:44:16.354 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.0552999999999997e-05 2024-04-18T14:44:16.354 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:16.354 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:16.354 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-04-18T14:44:16.354 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:15.392683+0000", 2024-04-18T14:44:16.354 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.7325999999999999e-05 2024-04-18T14:44:16.354 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:16.354 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:16.354 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-04-18T14:44:16.354 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:15.392764+0000", 2024-04-18T14:44:16.355 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 8.0920000000000005e-05 2024-04-18T14:44:16.355 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:16.355 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:16.355 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-04-18T14:44:16.355 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:15.393007+0000", 2024-04-18T14:44:16.355 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00024368799999999999 2024-04-18T14:44:16.355 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:16.355 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:16.355 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_started", 2024-04-18T14:44:16.355 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:15.424538+0000", 2024-04-18T14:44:16.355 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.031530184000000003 2024-04-18T14:44:16.355 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:16.356 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:16.356 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_committed", 2024-04-18T14:44:16.356 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:15.428083+0000", 2024-04-18T14:44:16.356 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.003545145 2024-04-18T14:44:16.356 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:16.356 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:16.356 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-04-18T14:44:16.356 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:15.435530+0000", 2024-04-18T14:44:16.356 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0074477129999999999 2024-04-18T14:44:16.356 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:16.356 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:16.356 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-04-18T14:44:16.356 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:15.435633+0000", 2024-04-18T14:44:16.357 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000102305 2024-04-18T14:44:16.357 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:44:16.357 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T14:44:16.357 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:44:16.357 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:16.357 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:16.357 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4559.0:786 3.8s0 3:17e457c8:::smithi13430248-35:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e76)", 2024-04-18T14:44:16.357 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-04-18T14:44:15.392702+0000", 2024-04-18T14:44:16.357 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 0.86071014700000004, 2024-04-18T14:44:16.357 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.035125588999999999, 2024-04-18T14:44:16.357 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-04-18T14:44:16.357 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "started", 2024-04-18T14:44:16.357 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-04-18T14:44:16.357 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4559", 2024-04-18T14:44:16.358 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "172.21.15.134:0/3113589487", 2024-04-18T14:44:16.358 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 786 2024-04-18T14:44:16.358 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:16.358 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-04-18T14:44:16.358 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:16.358 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-04-18T14:44:16.358 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:15.392702+0000", 2024-04-18T14:44:16.358 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:44:16.358 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:16.358 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:16.358 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-04-18T14:44:16.358 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:15.392702+0000", 2024-04-18T14:44:16.359 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:44:16.359 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:16.359 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:16.359 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-04-18T14:44:16.359 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:15.392701+0000", 2024-04-18T14:44:16.359 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 4294967295.999999 2024-04-18T14:44:16.359 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:16.359 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:16.359 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-04-18T14:44:16.359 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:15.392706+0000", 2024-04-18T14:44:16.359 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 5.2630000000000003e-06 2024-04-18T14:44:16.360 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:16.360 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:16.360 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-04-18T14:44:16.360 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:15.392718+0000", 2024-04-18T14:44:16.360 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.1736000000000001e-05 2024-04-18T14:44:16.360 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:16.360 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:16.360 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-04-18T14:44:16.360 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:15.392726+0000", 2024-04-18T14:44:16.360 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 8.0900000000000005e-06 2024-04-18T14:44:16.360 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:16.360 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:16.360 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-04-18T14:44:16.361 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:15.393241+0000", 2024-04-18T14:44:16.361 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00051566299999999997 2024-04-18T14:44:16.361 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:16.361 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:16.361 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for blocked object", 2024-04-18T14:44:16.361 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:15.393332+0000", 2024-04-18T14:44:16.361 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 9.0167999999999995e-05 2024-04-18T14:44:16.361 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:16.362 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:16.362 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-04-18T14:44:16.362 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:15.427577+0000", 2024-04-18T14:44:16.362 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.034245167 2024-04-18T14:44:16.362 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:16.362 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:16.362 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-04-18T14:44:16.362 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:15.427703+0000", 2024-04-18T14:44:16.362 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00012610900000000001 2024-04-18T14:44:16.362 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:16.362 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:16.362 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-04-18T14:44:16.362 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:15.427827+0000", 2024-04-18T14:44:16.363 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00012443900000000001 2024-04-18T14:44:16.363 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:44:16.363 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T14:44:16.363 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:44:16.363 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:44:16.363 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T14:44:16.363 INFO:teuthology.orchestra.run.smithi096.stdout:} 2024-04-18T14:44:16.365 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.9.asok dump_ops_in_flight 2024-04-18T14:44:16.365 INFO:tasks.ceph.osd.6.smithi119.stderr:2024-04-18T14:44:16.366+0000 7fb7cb8bd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 24896) UID: 0 2024-04-18T14:44:16.410 INFO:tasks.thrashosds.thrasher:Setting full ratio back to .95 2024-04-18T14:44:16.410 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set-full-ratio .95 2024-04-18T14:44:16.412 INFO:tasks.rados.rados.0.smithi134.stdout:316: done (7 left) 2024-04-18T14:44:16.412 INFO:tasks.rados.rados.0.smithi134.stdout:317: done (6 left) 2024-04-18T14:44:16.412 INFO:tasks.rados.rados.0.smithi134.stdout:318: done (5 left) 2024-04-18T14:44:16.412 INFO:tasks.rados.rados.0.smithi134.stdout:319: done (4 left) 2024-04-18T14:44:16.412 INFO:tasks.rados.rados.0.smithi134.stdout:320: done (3 left) 2024-04-18T14:44:16.412 INFO:tasks.rados.rados.0.smithi134.stdout:321: done (2 left) 2024-04-18T14:44:16.412 INFO:tasks.rados.rados.0.smithi134.stdout:322: done (1 left) 2024-04-18T14:44:16.412 INFO:tasks.rados.rados.0.smithi134.stdout:323: done (0 left) 2024-04-18T14:44:16.412 INFO:tasks.rados.rados.0.smithi134.stdout:324: read oid 43 snap 29 2024-04-18T14:44:16.412 INFO:tasks.rados.rados.0.smithi134.stdout:324: expect (ObjNum 122 snap 25 seq_num 122) 2024-04-18T14:44:16.412 INFO:tasks.rados.rados.0.smithi134.stdout:325: copy_from oid 24 from oid 13 current snap is 30 2024-04-18T14:44:16.412 INFO:tasks.rados.rados.0.smithi134.stdout:326: rollback oid 42 current snap is 30 2024-04-18T14:44:16.413 INFO:tasks.rados.rados.0.smithi134.stdout:rollback oid 42 to 25 2024-04-18T14:44:16.413 INFO:tasks.rados.rados.0.smithi134.stdout:327: setattr oid 18 current snap is 30 2024-04-18T14:44:16.413 INFO:tasks.rados.rados.0.smithi134.stdout:append oid 34 current snap is 30 2024-04-18T14:44:16.414 INFO:tasks.rados.rados.0.smithi134.stdout:328: seq_num 131 ranges {557056=655360,1212416=425984,1638400=638976,2277376=491520} 2024-04-18T14:44:16.420 INFO:tasks.rados.rados.0.smithi134.stdout:328: writing smithi13430248-34 from 557056 to 1212416 tid 1 2024-04-18T14:44:16.423 INFO:tasks.rados.rados.0.smithi134.stdout:328: writing smithi13430248-34 from 1212416 to 1638400 tid 2 2024-04-18T14:44:16.428 INFO:tasks.rados.rados.0.smithi134.stdout:328: writing smithi13430248-34 from 1638400 to 2277376 tid 3 2024-04-18T14:44:16.431 INFO:tasks.rados.rados.0.smithi134.stdout:328: writing smithi13430248-34 from 2277376 to 2768896 tid 4 2024-04-18T14:44:16.432 INFO:tasks.rados.rados.0.smithi134.stdout:329: read oid 27 snap -1 2024-04-18T14:44:16.432 INFO:tasks.rados.rados.0.smithi134.stdout:329: expect (ObjNum 123 snap 25 seq_num 123) 2024-04-18T14:44:16.432 INFO:tasks.rados.rados.0.smithi134.stdout:330: rollback oid 40 current snap is 30 2024-04-18T14:44:16.432 INFO:tasks.rados.rados.0.smithi134.stdout:rollback oid 40 to 13 2024-04-18T14:44:16.432 INFO:tasks.rados.rados.0.smithi134.stdout:331: read oid 44 snap -1 2024-04-18T14:44:16.432 INFO:tasks.rados.rados.0.smithi134.stdout:331: expect (ObjNum 130 snap 29 seq_num 130) 2024-04-18T14:44:16.432 INFO:tasks.rados.rados.0.smithi134.stdout:332: snap_remove snap 14 2024-04-18T14:44:16.465 INFO:tasks.ceph.osd.3.smithi134.stderr:2024-04-18T14:44:16.468+0000 7fe7a4443640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25211) UID: 0 2024-04-18T14:44:16.547 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2024-04-18T14:44:16.547 INFO:teuthology.orchestra.run.smithi096.stdout: "ops": [], 2024-04-18T14:44:16.548 INFO:teuthology.orchestra.run.smithi096.stdout: "num_ops": 0 2024-04-18T14:44:16.548 INFO:teuthology.orchestra.run.smithi096.stdout:} 2024-04-18T14:44:16.561 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.9.asok dump_blocked_ops 2024-04-18T14:44:16.566 INFO:tasks.ceph.osd.2.smithi119.stderr:2024-04-18T14:44:16.566+0000 7fcbd30c0640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 24894) UID: 0 2024-04-18T14:44:16.667 INFO:tasks.ceph.osd.14.smithi119.stderr:2024-04-18T14:44:16.670+0000 7f180f599640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 14 (PID: 24900) UID: 0 2024-04-18T14:44:16.682 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2024-04-18T14:44:16.682 INFO:teuthology.orchestra.run.smithi096.stdout: "ops": [], 2024-04-18T14:44:16.682 INFO:teuthology.orchestra.run.smithi096.stdout: "complaint_time": 30, 2024-04-18T14:44:16.682 INFO:teuthology.orchestra.run.smithi096.stdout: "num_blocked_ops": 0 2024-04-18T14:44:16.682 INFO:teuthology.orchestra.run.smithi096.stdout:} 2024-04-18T14:44:16.696 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.9.asok dump_historic_ops 2024-04-18T14:44:16.769 INFO:tasks.ceph.osd.9.smithi096.stderr:2024-04-18T14:44:16.769+0000 7fa2c1cbf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 9 (PID: 24891) UID: 0 2024-04-18T14:44:16.820 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2024-04-18T14:44:16.820 INFO:teuthology.orchestra.run.smithi096.stdout: "size": 20, 2024-04-18T14:44:16.820 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 600, 2024-04-18T14:44:16.820 INFO:teuthology.orchestra.run.smithi096.stdout: "ops": [ 2024-04-18T14:44:16.820 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:16.820 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "MOSDECSubOpWrite(3.4s3 46/30 ECSubWrite(tid=28, reqid=client.4559.0:323, at_version=46'5, trim_to=0'0, roll_forward_to=33'2))", 2024-04-18T14:44:16.820 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-04-18T14:43:45.380885+0000", 2024-04-18T14:44:16.820 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 31.438695215999999, 2024-04-18T14:44:16.820 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0058591219999999996, 2024-04-18T14:44:16.820 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-04-18T14:44:16.820 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "reached pg", 2024-04-18T14:44:16.820 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-04-18T14:44:16.821 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:16.821 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-04-18T14:44:16.821 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:45.380885+0000", 2024-04-18T14:44:16.821 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:44:16.821 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:16.821 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:16.821 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-04-18T14:44:16.821 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:45.380885+0000", 2024-04-18T14:44:16.821 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:44:16.821 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:16.821 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:16.821 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-04-18T14:44:16.821 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:45.380883+0000", 2024-04-18T14:44:16.821 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 4294967295.9999981 2024-04-18T14:44:16.821 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:16.822 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:16.822 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-04-18T14:44:16.822 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:45.380934+0000", 2024-04-18T14:44:16.822 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 5.0426999999999997e-05 2024-04-18T14:44:16.822 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:16.822 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:16.822 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-04-18T14:44:16.822 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:45.380966+0000", 2024-04-18T14:44:16.822 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.2431999999999997e-05 2024-04-18T14:44:16.822 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:16.822 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:16.822 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-04-18T14:44:16.822 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:45.380988+0000", 2024-04-18T14:44:16.822 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.1645999999999999e-05 2024-04-18T14:44:16.822 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:16.823 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:16.823 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-04-18T14:44:16.823 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:45.381323+0000", 2024-04-18T14:44:16.823 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00033546999999999998 2024-04-18T14:44:16.823 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:16.823 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:16.823 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_started", 2024-04-18T14:44:16.823 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:45.381349+0000", 2024-04-18T14:44:16.823 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.5539000000000001e-05 2024-04-18T14:44:16.823 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:16.823 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:16.823 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_committed", 2024-04-18T14:44:16.823 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:45.386680+0000", 2024-04-18T14:44:16.823 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0053314729999999998 2024-04-18T14:44:16.823 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:16.823 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:16.824 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-04-18T14:44:16.824 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:45.386744+0000", 2024-04-18T14:44:16.824 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 6.4014000000000001e-05 2024-04-18T14:44:16.824 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:44:16.824 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T14:44:16.824 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:44:16.824 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:16.824 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:16.824 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "MOSDECSubOpWrite(3.4s3 46/30 ECSubWrite(tid=29, reqid=client.4559.0:324, at_version=46'6, trim_to=0'0, roll_forward_to=33'2))", 2024-04-18T14:44:16.824 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-04-18T14:43:45.381244+0000", 2024-04-18T14:44:16.824 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 31.438335983999998, 2024-04-18T14:44:16.824 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0055443180000000003, 2024-04-18T14:44:16.824 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-04-18T14:44:16.824 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "reached pg", 2024-04-18T14:44:16.824 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-04-18T14:44:16.825 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:16.825 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-04-18T14:44:16.825 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:45.381244+0000", 2024-04-18T14:44:16.825 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:44:16.825 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:16.825 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:16.825 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-04-18T14:44:16.825 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:45.381244+0000", 2024-04-18T14:44:16.825 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:44:16.825 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:16.825 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:16.825 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-04-18T14:44:16.825 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:45.381243+0000", 2024-04-18T14:44:16.825 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 4294967295.999999 2024-04-18T14:44:16.825 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:16.825 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:16.826 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-04-18T14:44:16.826 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:45.381285+0000", 2024-04-18T14:44:16.826 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 4.1878000000000001e-05 2024-04-18T14:44:16.826 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:16.826 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:16.826 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-04-18T14:44:16.826 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:45.381315+0000", 2024-04-18T14:44:16.826 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.9949000000000001e-05 2024-04-18T14:44:16.826 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:16.826 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:16.826 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-04-18T14:44:16.826 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:45.381341+0000", 2024-04-18T14:44:16.826 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.5995000000000001e-05 2024-04-18T14:44:16.826 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:16.826 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:16.827 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-04-18T14:44:16.827 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:45.382666+0000", 2024-04-18T14:44:16.827 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00132537 2024-04-18T14:44:16.827 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:16.827 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:16.827 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_started", 2024-04-18T14:44:16.827 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:45.382694+0000", 2024-04-18T14:44:16.827 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.7838999999999999e-05 2024-04-18T14:44:16.827 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:16.827 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:16.827 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_committed", 2024-04-18T14:44:16.827 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:45.386755+0000", 2024-04-18T14:44:16.827 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0040607439999999998 2024-04-18T14:44:16.827 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:16.827 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:16.827 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-04-18T14:44:16.828 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:45.386789+0000", 2024-04-18T14:44:16.828 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.3668999999999999e-05 2024-04-18T14:44:16.828 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:44:16.828 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T14:44:16.828 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:44:16.828 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:16.828 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:16.828 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "MOSDECSubOpWrite(3.6s6 46/30 ECSubWrite(tid=67, reqid=osd.14.0:67, at_version=46'23, trim_to=0'0, roll_forward_to=45'21))", 2024-04-18T14:44:16.828 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-04-18T14:43:45.385486+0000", 2024-04-18T14:44:16.828 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 31.434094167000001, 2024-04-18T14:44:16.828 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0065151990000000002, 2024-04-18T14:44:16.828 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-04-18T14:44:16.829 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "reached pg", 2024-04-18T14:44:16.829 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-04-18T14:44:16.829 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:16.829 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-04-18T14:44:16.829 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:45.385486+0000", 2024-04-18T14:44:16.829 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:44:16.829 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:16.829 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:16.829 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-04-18T14:44:16.829 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:45.385486+0000", 2024-04-18T14:44:16.829 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:44:16.829 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:16.829 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:16.831 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-04-18T14:44:16.831 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:45.385486+0000", 2024-04-18T14:44:16.831 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 4294967295.9999995 2024-04-18T14:44:16.831 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:16.831 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:16.831 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-04-18T14:44:16.831 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:45.385539+0000", 2024-04-18T14:44:16.831 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 5.3910999999999999e-05 2024-04-18T14:44:16.831 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:16.832 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:16.832 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-04-18T14:44:16.832 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:45.385567+0000", 2024-04-18T14:44:16.832 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.7285999999999999e-05 2024-04-18T14:44:16.832 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:16.832 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:16.832 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-04-18T14:44:16.832 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:45.385587+0000", 2024-04-18T14:44:16.832 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.0378999999999999e-05 2024-04-18T14:44:16.832 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:16.832 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:16.832 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-04-18T14:44:16.832 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:45.385746+0000", 2024-04-18T14:44:16.832 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000158834 2024-04-18T14:44:16.833 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:16.833 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:16.833 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_started", 2024-04-18T14:44:16.833 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:45.385771+0000", 2024-04-18T14:44:16.833 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.4695e-05 2024-04-18T14:44:16.833 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:16.833 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:16.833 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_committed", 2024-04-18T14:44:16.833 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:45.391957+0000", 2024-04-18T14:44:16.833 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0061861349999999997 2024-04-18T14:44:16.833 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:16.833 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:16.833 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-04-18T14:44:16.833 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:45.392001+0000", 2024-04-18T14:44:16.833 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 4.4561999999999998e-05 2024-04-18T14:44:16.834 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:44:16.834 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T14:44:16.834 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:44:16.834 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:16.834 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:16.834 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "MOSDECSubOpWrite(3.es1 46/30 ECSubWrite(tid=26, reqid=osd.8.0:26, at_version=46'17, trim_to=0'0, roll_forward_to=45'15))", 2024-04-18T14:44:16.834 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-04-18T14:43:45.388207+0000", 2024-04-18T14:44:16.834 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 31.431372958000001, 2024-04-18T14:44:16.834 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.007465396, 2024-04-18T14:44:16.834 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-04-18T14:44:16.834 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "reached pg", 2024-04-18T14:44:16.834 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-04-18T14:44:16.834 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:16.834 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-04-18T14:44:16.835 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:45.388207+0000", 2024-04-18T14:44:16.835 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:44:16.835 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:16.835 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:16.835 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-04-18T14:44:16.835 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:45.388207+0000", 2024-04-18T14:44:16.835 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:44:16.835 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:16.835 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:16.835 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-04-18T14:44:16.835 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:45.388206+0000", 2024-04-18T14:44:16.835 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 4294967295.9999986 2024-04-18T14:44:16.835 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:16.835 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:16.835 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-04-18T14:44:16.836 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:45.388263+0000", 2024-04-18T14:44:16.836 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 5.7234999999999997e-05 2024-04-18T14:44:16.836 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:16.836 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:16.836 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-04-18T14:44:16.836 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:45.388288+0000", 2024-04-18T14:44:16.836 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.5079000000000002e-05 2024-04-18T14:44:16.836 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:16.836 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:16.836 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-04-18T14:44:16.836 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:45.388310+0000", 2024-04-18T14:44:16.836 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.1155e-05 2024-04-18T14:44:16.836 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:16.836 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:16.836 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-04-18T14:44:16.837 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:45.388425+0000", 2024-04-18T14:44:16.837 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000115562 2024-04-18T14:44:16.837 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:16.837 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:16.837 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_started", 2024-04-18T14:44:16.837 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:45.388451+0000", 2024-04-18T14:44:16.837 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.5619e-05 2024-04-18T14:44:16.837 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:16.837 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:16.837 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_committed", 2024-04-18T14:44:16.837 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:45.395613+0000", 2024-04-18T14:44:16.837 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0071626850000000002 2024-04-18T14:44:16.837 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:16.837 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:16.837 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-04-18T14:44:16.838 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:45.395673+0000", 2024-04-18T14:44:16.838 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 5.9274000000000002e-05 2024-04-18T14:44:16.838 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:44:16.838 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T14:44:16.838 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:44:16.838 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:16.838 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:16.838 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "MOSDECSubOpWrite(3.6s6 57/30 ECSubWrite(tid=139, reqid=client.4559.0:505, at_version=57'50, trim_to=0'0, roll_forward_to=54'48))", 2024-04-18T14:44:16.838 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-04-18T14:43:56.552057+0000", 2024-04-18T14:44:16.838 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 20.267523421, 2024-04-18T14:44:16.838 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0060446579999999996, 2024-04-18T14:44:16.838 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-04-18T14:44:16.838 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "reached pg", 2024-04-18T14:44:16.839 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-04-18T14:44:16.839 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:16.839 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-04-18T14:44:16.839 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:56.552057+0000", 2024-04-18T14:44:16.839 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:44:16.839 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:16.839 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:16.839 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-04-18T14:44:16.839 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:56.552057+0000", 2024-04-18T14:44:16.839 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:44:16.839 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:16.839 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:16.839 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-04-18T14:44:16.839 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:56.552055+0000", 2024-04-18T14:44:16.839 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 4294967295.9999986 2024-04-18T14:44:16.840 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:16.840 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:16.840 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-04-18T14:44:16.840 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:56.552099+0000", 2024-04-18T14:44:16.840 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 4.3812e-05 2024-04-18T14:44:16.840 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:16.840 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:16.840 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-04-18T14:44:16.840 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:56.552122+0000", 2024-04-18T14:44:16.840 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.3195999999999999e-05 2024-04-18T14:44:16.840 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:16.840 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:16.840 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-04-18T14:44:16.840 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:56.552136+0000", 2024-04-18T14:44:16.840 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.396e-05 2024-04-18T14:44:16.841 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:16.841 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:16.841 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-04-18T14:44:16.841 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:56.552261+0000", 2024-04-18T14:44:16.841 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00012490600000000001 2024-04-18T14:44:16.841 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:16.841 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:16.841 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_started", 2024-04-18T14:44:16.841 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:56.552288+0000", 2024-04-18T14:44:16.841 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.6418999999999999e-05 2024-04-18T14:44:16.841 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:16.841 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:16.841 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_committed", 2024-04-18T14:44:16.841 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:56.558043+0000", 2024-04-18T14:44:16.841 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00575495 2024-04-18T14:44:16.841 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:16.842 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:16.842 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-04-18T14:44:16.842 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:56.558102+0000", 2024-04-18T14:44:16.842 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 5.9052000000000003e-05 2024-04-18T14:44:16.842 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:44:16.842 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T14:44:16.842 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:44:16.842 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:16.842 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:16.842 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "MOSDECSubOpWrite(3.es1 57/30 ECSubWrite(tid=48, reqid=client.4559.0:514, at_version=57'36, trim_to=0'0, roll_forward_to=57'34))", 2024-04-18T14:44:16.842 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-04-18T14:43:56.586506+0000", 2024-04-18T14:44:16.842 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 20.233074763000001, 2024-04-18T14:44:16.842 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0052921649999999997, 2024-04-18T14:44:16.843 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-04-18T14:44:16.843 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "reached pg", 2024-04-18T14:44:16.843 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-04-18T14:44:16.843 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:16.843 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-04-18T14:44:16.843 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:56.586506+0000", 2024-04-18T14:44:16.843 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:44:16.843 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:16.843 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:16.843 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-04-18T14:44:16.843 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:56.586506+0000", 2024-04-18T14:44:16.843 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:44:16.843 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:16.843 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:16.843 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-04-18T14:44:16.844 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:56.586498+0000", 2024-04-18T14:44:16.844 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 4294967295.9999928 2024-04-18T14:44:16.844 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:16.844 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:16.844 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-04-18T14:44:16.844 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:56.587838+0000", 2024-04-18T14:44:16.844 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0013397649999999999 2024-04-18T14:44:16.844 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:16.844 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:16.844 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-04-18T14:44:16.844 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:56.587868+0000", 2024-04-18T14:44:16.844 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.9748999999999999e-05 2024-04-18T14:44:16.844 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:16.844 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:16.844 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-04-18T14:44:16.845 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:56.587888+0000", 2024-04-18T14:44:16.845 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.0193000000000001e-05 2024-04-18T14:44:16.845 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:16.845 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:16.845 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-04-18T14:44:16.845 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:56.588015+0000", 2024-04-18T14:44:16.845 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000127556 2024-04-18T14:44:16.845 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:16.845 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:16.845 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_started", 2024-04-18T14:44:16.845 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:56.588042+0000", 2024-04-18T14:44:16.845 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.6928999999999999e-05 2024-04-18T14:44:16.845 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:16.845 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:16.845 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_committed", 2024-04-18T14:44:16.846 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:56.591744+0000", 2024-04-18T14:44:16.846 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0037020429999999999 2024-04-18T14:44:16.846 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:16.846 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:16.846 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-04-18T14:44:16.846 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:56.591798+0000", 2024-04-18T14:44:16.846 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 5.3276000000000003e-05 2024-04-18T14:44:16.846 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:44:16.846 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T14:44:16.846 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:44:16.846 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:16.846 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:16.846 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "MOSDECSubOpWrite(3.1s2 63/30 ECSubWrite(tid=56, reqid=osd.6.0:56, at_version=63'37, trim_to=0'0, roll_forward_to=59'35))", 2024-04-18T14:44:16.846 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-04-18T14:44:02.385571+0000", 2024-04-18T14:44:16.847 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 14.434009237, 2024-04-18T14:44:16.847 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0084711279999999996, 2024-04-18T14:44:16.847 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-04-18T14:44:16.847 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "reached pg", 2024-04-18T14:44:16.847 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-04-18T14:44:16.847 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:16.847 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-04-18T14:44:16.847 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:02.385571+0000", 2024-04-18T14:44:16.847 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:44:16.847 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:16.847 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:16.847 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-04-18T14:44:16.847 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:02.385571+0000", 2024-04-18T14:44:16.847 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:44:16.847 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:16.847 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:16.848 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-04-18T14:44:16.848 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:02.385570+0000", 2024-04-18T14:44:16.848 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 4294967295.9999995 2024-04-18T14:44:16.848 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:16.848 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:16.848 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-04-18T14:44:16.848 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:02.385640+0000", 2024-04-18T14:44:16.848 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 6.9232000000000004e-05 2024-04-18T14:44:16.848 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:16.848 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:16.848 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-04-18T14:44:16.848 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:02.385669+0000", 2024-04-18T14:44:16.848 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.9390000000000002e-05 2024-04-18T14:44:16.848 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:16.849 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:16.849 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-04-18T14:44:16.849 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:02.385692+0000", 2024-04-18T14:44:16.849 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.3096999999999999e-05 2024-04-18T14:44:16.849 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:16.849 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:16.849 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-04-18T14:44:16.849 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:02.386245+0000", 2024-04-18T14:44:16.849 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00055288899999999998 2024-04-18T14:44:16.849 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:16.849 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:16.849 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_started", 2024-04-18T14:44:16.849 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:02.386271+0000", 2024-04-18T14:44:16.849 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.5757000000000001e-05 2024-04-18T14:44:16.849 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:16.850 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:16.850 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_committed", 2024-04-18T14:44:16.850 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:02.393982+0000", 2024-04-18T14:44:16.850 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0077113340000000002 2024-04-18T14:44:16.850 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:16.850 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:16.850 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-04-18T14:44:16.850 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:02.394042+0000", 2024-04-18T14:44:16.850 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 6.0118999999999998e-05 2024-04-18T14:44:16.850 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:44:16.850 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T14:44:16.850 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:44:16.850 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:16.850 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:16.851 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "MOSDECSubOpWrite(3.es1 63/30 ECSubWrite(tid=55, reqid=osd.8.0:55, at_version=63'44, trim_to=0'0, roll_forward_to=59'42))", 2024-04-18T14:44:16.851 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-04-18T14:44:02.386150+0000", 2024-04-18T14:44:16.851 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 14.433430551000001, 2024-04-18T14:44:16.851 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.010214071, 2024-04-18T14:44:16.851 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-04-18T14:44:16.851 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "reached pg", 2024-04-18T14:44:16.851 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-04-18T14:44:16.851 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:16.851 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-04-18T14:44:16.851 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:02.386150+0000", 2024-04-18T14:44:16.851 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:44:16.851 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:16.851 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:16.852 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-04-18T14:44:16.852 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:02.386150+0000", 2024-04-18T14:44:16.852 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:44:16.852 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:16.852 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:16.852 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-04-18T14:44:16.852 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:02.386149+0000", 2024-04-18T14:44:16.852 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 4294967295.9999995 2024-04-18T14:44:16.852 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:16.852 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:16.852 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-04-18T14:44:16.852 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:02.386210+0000", 2024-04-18T14:44:16.852 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 6.1183e-05 2024-04-18T14:44:16.852 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:16.852 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:16.853 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-04-18T14:44:16.853 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:02.386238+0000", 2024-04-18T14:44:16.853 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.7764e-05 2024-04-18T14:44:16.853 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:16.853 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:16.853 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-04-18T14:44:16.853 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:02.386270+0000", 2024-04-18T14:44:16.853 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.1636e-05 2024-04-18T14:44:16.853 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:16.853 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:16.853 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-04-18T14:44:16.853 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:02.387227+0000", 2024-04-18T14:44:16.853 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00095727799999999999 2024-04-18T14:44:16.853 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:16.853 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:16.854 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_started", 2024-04-18T14:44:16.854 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:02.387250+0000", 2024-04-18T14:44:16.854 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.2954000000000001e-05 2024-04-18T14:44:16.854 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:16.854 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:16.854 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_committed", 2024-04-18T14:44:16.854 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:02.396288+0000", 2024-04-18T14:44:16.854 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0090381650000000008 2024-04-18T14:44:16.854 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:16.854 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:16.854 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-04-18T14:44:16.854 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:02.396364+0000", 2024-04-18T14:44:16.854 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 7.5760999999999995e-05 2024-04-18T14:44:16.854 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:44:16.854 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T14:44:16.855 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:44:16.855 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:16.855 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:16.855 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "MOSDECSubOpWrite(3.7s2 63/30 ECSubWrite(tid=160, reqid=osd.14.0:160, at_version=63'68, trim_to=0'0, roll_forward_to=60'65))", 2024-04-18T14:44:16.855 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-04-18T14:44:02.387766+0000", 2024-04-18T14:44:16.855 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 14.431814446000001, 2024-04-18T14:44:16.855 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0076261669999999997, 2024-04-18T14:44:16.855 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-04-18T14:44:16.855 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "reached pg", 2024-04-18T14:44:16.855 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-04-18T14:44:16.855 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:16.855 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-04-18T14:44:16.855 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:02.387766+0000", 2024-04-18T14:44:16.855 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:44:16.855 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:16.856 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:16.856 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-04-18T14:44:16.856 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:02.387766+0000", 2024-04-18T14:44:16.856 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:44:16.856 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:16.856 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:16.856 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-04-18T14:44:16.856 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:02.387765+0000", 2024-04-18T14:44:16.856 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 4294967295.999999 2024-04-18T14:44:16.856 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:16.856 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:16.856 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-04-18T14:44:16.856 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:02.387827+0000", 2024-04-18T14:44:16.856 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 6.1971999999999996e-05 2024-04-18T14:44:16.856 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:16.856 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:16.857 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-04-18T14:44:16.857 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:02.387862+0000", 2024-04-18T14:44:16.857 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.4808999999999998e-05 2024-04-18T14:44:16.857 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:16.857 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:16.857 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-04-18T14:44:16.857 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:02.387884+0000", 2024-04-18T14:44:16.857 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.2510999999999998e-05 2024-04-18T14:44:16.857 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:16.857 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:16.857 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-04-18T14:44:16.857 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:02.388094+0000", 2024-04-18T14:44:16.857 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00020960600000000001 2024-04-18T14:44:16.857 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:16.857 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:16.858 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_started", 2024-04-18T14:44:16.858 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:02.388165+0000", 2024-04-18T14:44:16.858 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 7.0912000000000001e-05 2024-04-18T14:44:16.858 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:16.858 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:16.858 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_committed", 2024-04-18T14:44:16.858 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:02.395322+0000", 2024-04-18T14:44:16.858 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0071578249999999996 2024-04-18T14:44:16.858 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:16.858 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:16.858 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-04-18T14:44:16.858 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:02.395392+0000", 2024-04-18T14:44:16.858 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 6.9654999999999996e-05 2024-04-18T14:44:16.858 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:44:16.859 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T14:44:16.859 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:44:16.859 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:16.859 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:16.859 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "MOSDECSubOpWrite(3.6s6 63/30 ECSubWrite(tid=161, reqid=client.4559.0:582, at_version=63'58, trim_to=0'0, roll_forward_to=59'56))", 2024-04-18T14:44:16.859 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-04-18T14:44:02.387923+0000", 2024-04-18T14:44:16.859 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 14.431657348, 2024-04-18T14:44:16.859 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.011185921999999999, 2024-04-18T14:44:16.859 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-04-18T14:44:16.859 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "reached pg", 2024-04-18T14:44:16.859 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-04-18T14:44:16.859 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:16.860 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-04-18T14:44:16.860 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:02.387923+0000", 2024-04-18T14:44:16.860 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:44:16.860 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:16.860 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:16.860 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-04-18T14:44:16.860 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:02.387923+0000", 2024-04-18T14:44:16.860 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:44:16.860 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:16.860 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:16.860 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-04-18T14:44:16.861 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:02.387922+0000", 2024-04-18T14:44:16.861 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 4294967295.999999 2024-04-18T14:44:16.861 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:16.861 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:16.861 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-04-18T14:44:16.861 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:02.387983+0000", 2024-04-18T14:44:16.861 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 6.0983000000000002e-05 2024-04-18T14:44:16.861 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:16.861 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:16.861 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-04-18T14:44:16.861 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:02.388007+0000", 2024-04-18T14:44:16.861 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.3890999999999999e-05 2024-04-18T14:44:16.861 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:16.861 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:16.861 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-04-18T14:44:16.862 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:02.388025+0000", 2024-04-18T14:44:16.862 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.7541e-05 2024-04-18T14:44:16.862 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:16.862 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:16.862 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-04-18T14:44:16.862 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:02.388609+0000", 2024-04-18T14:44:16.862 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00058442900000000002 2024-04-18T14:44:16.862 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:16.862 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:16.862 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_started", 2024-04-18T14:44:16.862 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:02.388633+0000", 2024-04-18T14:44:16.862 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.3683e-05 2024-04-18T14:44:16.862 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:16.862 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:16.863 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_committed", 2024-04-18T14:44:16.863 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:02.398974+0000", 2024-04-18T14:44:16.863 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.010341474 2024-04-18T14:44:16.863 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:16.863 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:16.863 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-04-18T14:44:16.863 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:02.399109+0000", 2024-04-18T14:44:16.863 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000134778 2024-04-18T14:44:16.863 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:44:16.863 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T14:44:16.863 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:44:16.863 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:16.863 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:16.863 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "MOSDECSubOpWrite(3.7s2 63/30 ECSubWrite(tid=162, reqid=osd.14.0:162, at_version=63'70, trim_to=0'0, roll_forward_to=60'65))", 2024-04-18T14:44:16.864 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-04-18T14:44:02.388041+0000", 2024-04-18T14:44:16.864 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 14.431539001999999, 2024-04-18T14:44:16.864 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.011181602000000001, 2024-04-18T14:44:16.864 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-04-18T14:44:16.864 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "reached pg", 2024-04-18T14:44:16.864 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-04-18T14:44:16.864 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:16.864 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-04-18T14:44:16.864 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:02.388041+0000", 2024-04-18T14:44:16.864 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:44:16.864 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:16.864 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:16.864 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-04-18T14:44:16.864 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:02.388041+0000", 2024-04-18T14:44:16.864 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:44:16.865 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:16.865 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:16.865 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-04-18T14:44:16.865 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:02.388040+0000", 2024-04-18T14:44:16.865 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 4294967295.999999 2024-04-18T14:44:16.865 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:16.865 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:16.865 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-04-18T14:44:16.865 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:02.388077+0000", 2024-04-18T14:44:16.865 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.6965000000000003e-05 2024-04-18T14:44:16.865 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:16.865 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:16.865 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-04-18T14:44:16.865 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:02.388091+0000", 2024-04-18T14:44:16.866 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.4005000000000001e-05 2024-04-18T14:44:16.866 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:16.866 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:16.866 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-04-18T14:44:16.866 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:02.388103+0000", 2024-04-18T14:44:16.866 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.2069000000000001e-05 2024-04-18T14:44:16.866 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:16.866 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:16.866 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-04-18T14:44:16.866 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:02.390027+0000", 2024-04-18T14:44:16.866 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.001923679 2024-04-18T14:44:16.866 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:16.866 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:16.866 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_started", 2024-04-18T14:44:16.867 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:02.390129+0000", 2024-04-18T14:44:16.867 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000101828 2024-04-18T14:44:16.867 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:16.867 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:16.867 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_committed", 2024-04-18T14:44:16.867 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:02.399089+0000", 2024-04-18T14:44:16.867 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0089604279999999994 2024-04-18T14:44:16.867 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:16.867 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:16.867 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-04-18T14:44:16.867 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:02.399223+0000", 2024-04-18T14:44:16.867 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000133604 2024-04-18T14:44:16.867 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:44:16.867 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T14:44:16.868 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:44:16.868 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:16.868 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:16.868 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "MOSDECSubOpWrite(3.1s2 63/30 ECSubWrite(tid=57, reqid=osd.6.0:57, at_version=63'39, trim_to=0'0, roll_forward_to=59'35))", 2024-04-18T14:44:16.868 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-04-18T14:44:02.388136+0000", 2024-04-18T14:44:16.868 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 14.431444345999999, 2024-04-18T14:44:16.868 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.01102156, 2024-04-18T14:44:16.868 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-04-18T14:44:16.868 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "reached pg", 2024-04-18T14:44:16.868 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-04-18T14:44:16.868 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:16.868 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-04-18T14:44:16.868 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:02.388136+0000", 2024-04-18T14:44:16.868 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:44:16.868 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:16.868 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:16.869 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-04-18T14:44:16.869 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:02.388136+0000", 2024-04-18T14:44:16.869 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:44:16.869 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:16.869 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:16.869 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-04-18T14:44:16.869 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:02.388134+0000", 2024-04-18T14:44:16.869 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 4294967295.9999986 2024-04-18T14:44:16.869 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:16.869 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:16.869 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-04-18T14:44:16.869 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:02.388191+0000", 2024-04-18T14:44:16.869 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 5.6224000000000002e-05 2024-04-18T14:44:16.869 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:16.870 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:16.870 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-04-18T14:44:16.870 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:02.388219+0000", 2024-04-18T14:44:16.870 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.8572999999999999e-05 2024-04-18T14:44:16.870 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:16.870 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:16.870 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-04-18T14:44:16.870 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:02.388239+0000", 2024-04-18T14:44:16.870 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.9344e-05 2024-04-18T14:44:16.870 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:16.870 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:16.870 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-04-18T14:44:16.870 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:02.388411+0000", 2024-04-18T14:44:16.871 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000172277 2024-04-18T14:44:16.871 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:16.871 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:16.871 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_started", 2024-04-18T14:44:16.871 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:02.388435+0000", 2024-04-18T14:44:16.871 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.4297000000000001e-05 2024-04-18T14:44:16.871 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:16.871 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:16.871 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_committed", 2024-04-18T14:44:16.871 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:02.399045+0000", 2024-04-18T14:44:16.871 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.010609379 2024-04-18T14:44:16.871 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:16.871 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:16.871 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-04-18T14:44:16.871 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:02.399158+0000", 2024-04-18T14:44:16.872 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00011299299999999999 2024-04-18T14:44:16.872 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:44:16.872 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T14:44:16.872 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:44:16.872 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:16.872 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:16.872 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "MOSDECSubOpWrite(3.es1 63/30 ECSubWrite(tid=56, reqid=osd.8.0:56, at_version=63'46, trim_to=0'0, roll_forward_to=59'42))", 2024-04-18T14:44:16.872 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-04-18T14:44:02.388191+0000", 2024-04-18T14:44:16.872 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 14.431389646, 2024-04-18T14:44:16.872 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0082288799999999992, 2024-04-18T14:44:16.872 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-04-18T14:44:16.872 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "reached pg", 2024-04-18T14:44:16.872 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-04-18T14:44:16.872 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:16.873 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-04-18T14:44:16.873 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:02.388191+0000", 2024-04-18T14:44:16.873 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:44:16.873 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:16.873 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:16.873 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-04-18T14:44:16.873 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:02.388191+0000", 2024-04-18T14:44:16.873 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:44:16.873 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:16.873 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:16.873 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-04-18T14:44:16.873 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:02.388190+0000", 2024-04-18T14:44:16.873 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 4294967295.999999 2024-04-18T14:44:16.873 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:16.873 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:16.874 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-04-18T14:44:16.874 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:02.388228+0000", 2024-04-18T14:44:16.874 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.8121999999999999e-05 2024-04-18T14:44:16.874 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:16.874 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:16.874 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-04-18T14:44:16.874 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:02.388248+0000", 2024-04-18T14:44:16.874 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.9724e-05 2024-04-18T14:44:16.874 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:16.874 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:16.874 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-04-18T14:44:16.874 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:02.388262+0000", 2024-04-18T14:44:16.874 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.4202000000000001e-05 2024-04-18T14:44:16.874 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:16.874 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:16.874 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-04-18T14:44:16.875 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:02.388796+0000", 2024-04-18T14:44:16.875 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00053393099999999997 2024-04-18T14:44:16.875 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:16.875 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:16.875 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_started", 2024-04-18T14:44:16.875 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:02.388818+0000", 2024-04-18T14:44:16.875 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.2450999999999999e-05 2024-04-18T14:44:16.875 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:16.875 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:16.875 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_committed", 2024-04-18T14:44:16.875 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:02.396383+0000", 2024-04-18T14:44:16.875 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0075645640000000002 2024-04-18T14:44:16.875 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:16.875 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:16.876 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-04-18T14:44:16.876 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:02.396420+0000", 2024-04-18T14:44:16.876 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.6888999999999999e-05 2024-04-18T14:44:16.876 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:44:16.876 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T14:44:16.876 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:44:16.876 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:16.876 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:16.876 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "MOSDECSubOpWrite(3.6s6 63/30 ECSubWrite(tid=163, reqid=osd.14.0:163, at_version=63'60, trim_to=0'0, roll_forward_to=59'56))", 2024-04-18T14:44:16.876 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-04-18T14:44:02.391896+0000", 2024-04-18T14:44:16.876 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 14.427684761, 2024-04-18T14:44:16.876 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0081183950000000005, 2024-04-18T14:44:16.876 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-04-18T14:44:16.876 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "reached pg", 2024-04-18T14:44:16.877 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-04-18T14:44:16.877 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:16.877 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-04-18T14:44:16.877 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:02.391896+0000", 2024-04-18T14:44:16.877 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:44:16.877 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:16.877 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:16.877 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-04-18T14:44:16.877 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:02.391896+0000", 2024-04-18T14:44:16.877 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:44:16.877 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:16.877 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:16.877 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-04-18T14:44:16.877 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:02.391894+0000", 2024-04-18T14:44:16.877 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 4294967295.9999986 2024-04-18T14:44:16.878 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:16.878 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:16.878 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-04-18T14:44:16.878 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:02.391946+0000", 2024-04-18T14:44:16.878 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 5.1823999999999997e-05 2024-04-18T14:44:16.878 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:16.878 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:16.878 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-04-18T14:44:16.878 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:02.391986+0000", 2024-04-18T14:44:16.878 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 4.0234999999999997e-05 2024-04-18T14:44:16.878 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:16.878 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:16.878 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-04-18T14:44:16.878 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:02.392007+0000", 2024-04-18T14:44:16.879 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.0560999999999998e-05 2024-04-18T14:44:16.879 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:16.879 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:16.879 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-04-18T14:44:16.879 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:02.394241+0000", 2024-04-18T14:44:16.879 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.002233886 2024-04-18T14:44:16.879 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:16.879 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:16.879 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_started", 2024-04-18T14:44:16.879 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:02.394266+0000", 2024-04-18T14:44:16.879 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.5086999999999999e-05 2024-04-18T14:44:16.879 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:16.879 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:16.879 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_committed", 2024-04-18T14:44:16.879 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:02.399962+0000", 2024-04-18T14:44:16.879 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0056963880000000001 2024-04-18T14:44:16.880 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:16.880 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:16.880 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-04-18T14:44:16.880 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:02.400014+0000", 2024-04-18T14:44:16.880 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 5.1963999999999999e-05 2024-04-18T14:44:16.880 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:44:16.880 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T14:44:16.880 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:44:16.880 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:16.880 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:16.880 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "MOSDECSubOpWrite(3.6s6 67/30 ECSubWrite(tid=193, reqid=client.4559.0:656, at_version=67'78, trim_to=0'0, roll_forward_to=66'76))", 2024-04-18T14:44:16.880 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-04-18T14:44:06.458785+0000", 2024-04-18T14:44:16.880 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 10.360795177, 2024-04-18T14:44:16.880 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0090892390000000007, 2024-04-18T14:44:16.881 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-04-18T14:44:16.881 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "reached pg", 2024-04-18T14:44:16.881 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-04-18T14:44:16.881 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:16.881 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-04-18T14:44:16.881 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:06.458785+0000", 2024-04-18T14:44:16.881 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:44:16.881 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:16.881 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:16.881 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-04-18T14:44:16.881 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:06.458785+0000", 2024-04-18T14:44:16.881 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:44:16.881 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:16.881 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:16.881 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-04-18T14:44:16.881 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:06.458785+0000", 2024-04-18T14:44:16.882 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 4294967295.9999995 2024-04-18T14:44:16.882 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:16.882 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:16.882 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-04-18T14:44:16.882 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:06.459441+0000", 2024-04-18T14:44:16.882 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00065652799999999997 2024-04-18T14:44:16.882 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:16.882 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:16.882 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-04-18T14:44:16.882 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:06.459480+0000", 2024-04-18T14:44:16.882 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.9189e-05 2024-04-18T14:44:16.882 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:16.882 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:16.883 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-04-18T14:44:16.883 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:06.459529+0000", 2024-04-18T14:44:16.883 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 4.8195999999999997e-05 2024-04-18T14:44:16.883 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:16.883 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:16.883 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-04-18T14:44:16.883 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:06.459642+0000", 2024-04-18T14:44:16.883 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000113051 2024-04-18T14:44:16.883 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:16.883 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:16.883 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_started", 2024-04-18T14:44:16.883 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:06.459659+0000", 2024-04-18T14:44:16.883 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.7452000000000002e-05 2024-04-18T14:44:16.883 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:16.883 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:16.884 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_committed", 2024-04-18T14:44:16.884 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:06.467817+0000", 2024-04-18T14:44:16.884 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0081580739999999995 2024-04-18T14:44:16.884 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:16.884 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:16.884 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-04-18T14:44:16.884 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:06.467874+0000", 2024-04-18T14:44:16.884 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 5.7129000000000001e-05 2024-04-18T14:44:16.884 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:44:16.884 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T14:44:16.884 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:44:16.884 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:16.884 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:16.884 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "MOSDECSubOpWrite(3.6s6 67/30 ECSubWrite(tid=194, reqid=client.4559.0:657, at_version=67'79, trim_to=0'0, roll_forward_to=66'76))", 2024-04-18T14:44:16.884 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-04-18T14:44:06.464215+0000", 2024-04-18T14:44:16.884 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 10.355365165, 2024-04-18T14:44:16.885 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0056290460000000004, 2024-04-18T14:44:16.885 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-04-18T14:44:16.885 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "reached pg", 2024-04-18T14:44:16.885 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-04-18T14:44:16.885 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:16.885 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-04-18T14:44:16.885 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:06.464215+0000", 2024-04-18T14:44:16.885 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:44:16.885 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:16.885 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:16.885 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-04-18T14:44:16.885 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:06.464215+0000", 2024-04-18T14:44:16.885 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:44:16.885 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:16.886 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:16.886 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-04-18T14:44:16.886 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:06.464214+0000", 2024-04-18T14:44:16.886 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 4294967295.9999986 2024-04-18T14:44:16.886 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:16.886 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:16.886 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-04-18T14:44:16.886 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:06.464576+0000", 2024-04-18T14:44:16.886 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000362254 2024-04-18T14:44:16.886 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:16.886 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:16.886 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-04-18T14:44:16.886 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:06.464608+0000", 2024-04-18T14:44:16.886 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.2526e-05 2024-04-18T14:44:16.886 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:16.887 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:16.887 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-04-18T14:44:16.887 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:06.464631+0000", 2024-04-18T14:44:16.887 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.2266999999999999e-05 2024-04-18T14:44:16.887 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:16.887 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:16.887 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-04-18T14:44:16.887 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:06.464764+0000", 2024-04-18T14:44:16.887 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00013320699999999999 2024-04-18T14:44:16.887 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:16.887 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:16.887 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_started", 2024-04-18T14:44:16.887 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:06.464796+0000", 2024-04-18T14:44:16.888 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.2394999999999997e-05 2024-04-18T14:44:16.888 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:16.888 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:16.888 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_committed", 2024-04-18T14:44:16.888 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:06.469796+0000", 2024-04-18T14:44:16.888 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0049994310000000004 2024-04-18T14:44:16.888 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:16.888 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:16.888 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-04-18T14:44:16.888 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:06.469844+0000", 2024-04-18T14:44:16.888 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 4.8548999999999999e-05 2024-04-18T14:44:16.888 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:44:16.888 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T14:44:16.888 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:44:16.889 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:16.889 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:16.889 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "MOSDECSubOpWrite(3.6s6 72/70 ECSubWrite(tid=257, reqid=client.4559.0:719, at_version=72'105, trim_to=0'0, roll_forward_to=71'101))", 2024-04-18T14:44:16.889 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-04-18T14:44:11.436452+0000", 2024-04-18T14:44:16.889 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 5.3831279299999997, 2024-04-18T14:44:16.889 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0063112819999999997, 2024-04-18T14:44:16.889 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-04-18T14:44:16.889 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "reached pg", 2024-04-18T14:44:16.889 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-04-18T14:44:16.889 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:16.889 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-04-18T14:44:16.889 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:11.436452+0000", 2024-04-18T14:44:16.889 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:44:16.889 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:16.889 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:16.890 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-04-18T14:44:16.890 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:11.436452+0000", 2024-04-18T14:44:16.890 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:44:16.890 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:16.890 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:16.890 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-04-18T14:44:16.890 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:11.436451+0000", 2024-04-18T14:44:16.890 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 4294967295.9999981 2024-04-18T14:44:16.890 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:16.890 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:16.890 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-04-18T14:44:16.890 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:11.436807+0000", 2024-04-18T14:44:16.890 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00035655600000000001 2024-04-18T14:44:16.891 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:16.891 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:16.891 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-04-18T14:44:16.891 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:11.436845+0000", 2024-04-18T14:44:16.891 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.7846000000000003e-05 2024-04-18T14:44:16.891 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:16.891 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:16.891 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-04-18T14:44:16.893 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:11.436868+0000", 2024-04-18T14:44:16.893 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.3368999999999999e-05 2024-04-18T14:44:16.893 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:16.893 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:16.893 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-04-18T14:44:16.893 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:11.437042+0000", 2024-04-18T14:44:16.894 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00017379 2024-04-18T14:44:16.894 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:16.894 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:16.894 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_started", 2024-04-18T14:44:16.894 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:11.437070+0000", 2024-04-18T14:44:16.894 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.7413e-05 2024-04-18T14:44:16.894 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:16.894 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:16.894 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_committed", 2024-04-18T14:44:16.894 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:11.442621+0000", 2024-04-18T14:44:16.894 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0055510849999999999 2024-04-18T14:44:16.894 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:16.894 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:16.894 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-04-18T14:44:16.895 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:11.442764+0000", 2024-04-18T14:44:16.895 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00014302 2024-04-18T14:44:16.895 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:44:16.895 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T14:44:16.895 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:44:16.895 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:16.895 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:16.895 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "MOSDECSubOpWrite(3.1s2 72/30 ECSubWrite(tid=77, reqid=client.4559.0:715, at_version=72'62, trim_to=0'0, roll_forward_to=71'59))", 2024-04-18T14:44:16.895 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-04-18T14:44:11.488201+0000", 2024-04-18T14:44:16.895 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 5.3313794019999996, 2024-04-18T14:44:16.895 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0096875209999999993, 2024-04-18T14:44:16.895 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-04-18T14:44:16.895 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "reached pg", 2024-04-18T14:44:16.895 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-04-18T14:44:16.895 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:16.895 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-04-18T14:44:16.896 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:11.488201+0000", 2024-04-18T14:44:16.896 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:44:16.896 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:16.896 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:16.896 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-04-18T14:44:16.896 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:11.488201+0000", 2024-04-18T14:44:16.896 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:44:16.896 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:16.896 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:16.896 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-04-18T14:44:16.896 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:11.488200+0000", 2024-04-18T14:44:16.896 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 4294967295.9999995 2024-04-18T14:44:16.896 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:16.896 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:16.896 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-04-18T14:44:16.897 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:11.491078+0000", 2024-04-18T14:44:16.897 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0028773779999999999 2024-04-18T14:44:16.897 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:16.897 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:16.897 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-04-18T14:44:16.897 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:11.491113+0000", 2024-04-18T14:44:16.897 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.5271000000000002e-05 2024-04-18T14:44:16.897 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:16.897 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:16.897 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-04-18T14:44:16.897 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:11.491134+0000", 2024-04-18T14:44:16.897 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.1299000000000001e-05 2024-04-18T14:44:16.897 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:16.897 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:16.897 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-04-18T14:44:16.897 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:11.491278+0000", 2024-04-18T14:44:16.898 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000143721 2024-04-18T14:44:16.898 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:16.898 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:16.898 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_started", 2024-04-18T14:44:16.898 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:11.491303+0000", 2024-04-18T14:44:16.898 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.5040000000000001e-05 2024-04-18T14:44:16.898 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:16.898 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:16.898 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_committed", 2024-04-18T14:44:16.898 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:11.497836+0000", 2024-04-18T14:44:16.898 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0065333960000000003 2024-04-18T14:44:16.898 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:16.898 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:16.898 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-04-18T14:44:16.898 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:11.497888+0000", 2024-04-18T14:44:16.899 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 5.2065999999999999e-05 2024-04-18T14:44:16.899 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:44:16.899 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T14:44:16.899 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:44:16.899 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:16.899 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:16.899 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "MOSDECSubOpWrite(3.7s2 76/30 ECSubWrite(tid=269, reqid=client.4559.0:799, at_version=76'99, trim_to=0'0, roll_forward_to=76'97))", 2024-04-18T14:44:16.899 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-04-18T14:44:15.585721+0000", 2024-04-18T14:44:16.899 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 1.233859032, 2024-04-18T14:44:16.899 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0060814149999999997, 2024-04-18T14:44:16.899 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-04-18T14:44:16.899 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "reached pg", 2024-04-18T14:44:16.899 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-04-18T14:44:16.899 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:16.899 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-04-18T14:44:16.899 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:15.585721+0000", 2024-04-18T14:44:16.900 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:44:16.900 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:16.900 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:16.900 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-04-18T14:44:16.900 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:15.585721+0000", 2024-04-18T14:44:16.900 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:44:16.900 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:16.900 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:16.900 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-04-18T14:44:16.900 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:15.585720+0000", 2024-04-18T14:44:16.900 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 4294967295.999999 2024-04-18T14:44:16.900 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:16.900 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:16.900 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-04-18T14:44:16.900 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:15.586835+0000", 2024-04-18T14:44:16.901 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0011145879999999999 2024-04-18T14:44:16.901 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:16.901 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:16.901 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-04-18T14:44:16.901 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:15.586859+0000", 2024-04-18T14:44:16.901 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.4074999999999999e-05 2024-04-18T14:44:16.901 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:16.901 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:16.901 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-04-18T14:44:16.901 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:15.586871+0000", 2024-04-18T14:44:16.901 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.2320000000000001e-05 2024-04-18T14:44:16.901 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:16.901 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:16.901 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-04-18T14:44:16.902 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:15.586957+0000", 2024-04-18T14:44:16.902 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 8.5574000000000004e-05 2024-04-18T14:44:16.902 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:16.902 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:16.902 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_started", 2024-04-18T14:44:16.902 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:15.586971+0000", 2024-04-18T14:44:16.902 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.4756999999999999e-05 2024-04-18T14:44:16.902 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:16.902 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:16.903 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_committed", 2024-04-18T14:44:16.903 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:15.591764+0000", 2024-04-18T14:44:16.903 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0047927239999999999 2024-04-18T14:44:16.903 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:16.903 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:16.903 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-04-18T14:44:16.903 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:15.591803+0000", 2024-04-18T14:44:16.903 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.8566000000000003e-05 2024-04-18T14:44:16.903 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:44:16.903 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T14:44:16.903 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:44:16.903 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:16.903 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:16.903 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "MOSDECSubOpWrite(3.1s2 77/30 ECSubWrite(tid=83, reqid=client.4559.0:829, at_version=77'68, trim_to=0'0, roll_forward_to=76'66))", 2024-04-18T14:44:16.903 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-04-18T14:44:16.460362+0000", 2024-04-18T14:44:16.904 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 0.35921805600000001, 2024-04-18T14:44:16.904 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0072338990000000002, 2024-04-18T14:44:16.904 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-04-18T14:44:16.904 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "reached pg", 2024-04-18T14:44:16.904 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-04-18T14:44:16.904 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:16.904 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-04-18T14:44:16.904 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:16.460362+0000", 2024-04-18T14:44:16.904 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:44:16.904 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:16.904 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:16.904 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-04-18T14:44:16.904 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:16.460362+0000", 2024-04-18T14:44:16.904 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:44:16.905 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:16.905 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:16.905 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-04-18T14:44:16.905 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:16.460362+0000", 2024-04-18T14:44:16.905 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 4294967295.9999995 2024-04-18T14:44:16.905 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:16.905 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:16.905 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-04-18T14:44:16.905 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:16.463074+0000", 2024-04-18T14:44:16.905 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0027117769999999999 2024-04-18T14:44:16.905 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:16.905 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:16.905 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-04-18T14:44:16.905 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:16.463118+0000", 2024-04-18T14:44:16.905 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 4.4438999999999999e-05 2024-04-18T14:44:16.905 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:16.906 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:16.906 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-04-18T14:44:16.906 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:16.463146+0000", 2024-04-18T14:44:16.906 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.7589999999999998e-05 2024-04-18T14:44:16.906 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:16.906 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:16.906 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-04-18T14:44:16.906 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:16.463244+0000", 2024-04-18T14:44:16.906 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 9.8109999999999994e-05 2024-04-18T14:44:16.906 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:16.906 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:16.906 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_started", 2024-04-18T14:44:16.906 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:16.463261+0000", 2024-04-18T14:44:16.906 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.7351e-05 2024-04-18T14:44:16.906 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:16.907 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:16.907 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_committed", 2024-04-18T14:44:16.907 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:16.467556+0000", 2024-04-18T14:44:16.907 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0042951049999999996 2024-04-18T14:44:16.907 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:16.907 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:16.907 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-04-18T14:44:16.907 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:16.467596+0000", 2024-04-18T14:44:16.907 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.9858999999999999e-05 2024-04-18T14:44:16.907 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:44:16.907 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T14:44:16.907 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:44:16.907 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:44:16.907 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T14:44:16.907 INFO:teuthology.orchestra.run.smithi096.stdout:} 2024-04-18T14:44:16.909 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.13.asok dump_ops_in_flight 2024-04-18T14:44:16.909 INFO:tasks.ceph.osd.3.smithi134.stderr:2024-04-18T14:44:16.912+0000 7fe7a4443640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25211) UID: 0 2024-04-18T14:44:17.010 INFO:tasks.ceph.osd.13.smithi096.stderr:2024-04-18T14:44:17.009+0000 7f7e72fad640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 13 (PID: 24893) UID: 0 2024-04-18T14:44:17.074 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2024-04-18T14:44:17.074 INFO:teuthology.orchestra.run.smithi096.stdout: "ops": [], 2024-04-18T14:44:17.074 INFO:teuthology.orchestra.run.smithi096.stdout: "num_ops": 0 2024-04-18T14:44:17.075 INFO:teuthology.orchestra.run.smithi096.stdout:} 2024-04-18T14:44:17.088 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.13.asok dump_blocked_ops 2024-04-18T14:44:17.111 INFO:tasks.ceph.osd.10.smithi119.stderr:2024-04-18T14:44:17.110+0000 7f6f24c12640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 10 (PID: 24898) UID: 0 2024-04-18T14:44:17.212 INFO:tasks.ceph.osd.13.smithi096.stderr:2024-04-18T14:44:17.209+0000 7f7e72fad640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 13 (PID: 24893) UID: 0 2024-04-18T14:44:17.252 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2024-04-18T14:44:17.252 INFO:teuthology.orchestra.run.smithi096.stdout: "ops": [], 2024-04-18T14:44:17.252 INFO:teuthology.orchestra.run.smithi096.stdout: "complaint_time": 30, 2024-04-18T14:44:17.252 INFO:teuthology.orchestra.run.smithi096.stdout: "num_blocked_ops": 0 2024-04-18T14:44:17.252 INFO:teuthology.orchestra.run.smithi096.stdout:} 2024-04-18T14:44:17.266 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.13.asok dump_historic_ops 2024-04-18T14:44:17.313 INFO:tasks.ceph.osd.4.smithi086.stderr:2024-04-18T14:44:17.313+0000 7f0c4c462640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 24956) UID: 0 2024-04-18T14:44:17.382 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-18T14:44:17.412 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-04-18T14:44:17.414 INFO:tasks.ceph.osd.13.smithi096.stderr:2024-04-18T14:44:17.413+0000 7f7e72fad640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 13 (PID: 24893) UID: 0 2024-04-18T14:44:17.416 INFO:teuthology.orchestra.run.smithi086.stderr:osd set-full-ratio 0.95 2024-04-18T14:44:17.418 INFO:tasks.rados.rados.0.smithi134.stdout:332: done (8 left) 2024-04-18T14:44:17.418 INFO:tasks.rados.rados.0.smithi134.stdout:333: snap_remove snap 0 2024-04-18T14:44:17.448 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2024-04-18T14:44:17.448 INFO:teuthology.orchestra.run.smithi096.stdout: "size": 20, 2024-04-18T14:44:17.448 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 600, 2024-04-18T14:44:17.448 INFO:teuthology.orchestra.run.smithi096.stdout: "ops": [ 2024-04-18T14:44:17.448 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:17.448 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4212.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-18T14:44:17.448 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-04-18T14:43:19.321281+0000", 2024-04-18T14:44:17.448 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 58.125471417999997, 2024-04-18T14:44:17.448 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.0074994820000001, 2024-04-18T14:44:17.448 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-04-18T14:44:17.449 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T14:44:17.449 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-04-18T14:44:17.449 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4212", 2024-04-18T14:44:17.449 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "172.21.15.134:0/3325451476", 2024-04-18T14:44:17.449 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 1 2024-04-18T14:44:17.449 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:17.449 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-04-18T14:44:17.449 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:17.449 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-04-18T14:44:17.449 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:19.321281+0000", 2024-04-18T14:44:17.449 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:44:17.449 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:17.449 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:17.449 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-04-18T14:44:17.449 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:19.321281+0000", 2024-04-18T14:44:17.450 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:44:17.450 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:17.450 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:17.450 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-04-18T14:44:17.450 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:19.321279+0000", 2024-04-18T14:44:17.450 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 4294967295.9999971 2024-04-18T14:44:17.450 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:17.450 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:17.450 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-04-18T14:44:17.450 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:19.321299+0000", 2024-04-18T14:44:17.450 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.0098e-05 2024-04-18T14:44:17.450 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:17.450 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:17.451 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-04-18T14:44:17.451 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:19.321342+0000", 2024-04-18T14:44:17.451 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 4.3146000000000003e-05 2024-04-18T14:44:17.451 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:17.451 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:17.451 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-04-18T14:44:17.451 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:19.321367+0000", 2024-04-18T14:44:17.451 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.5318000000000001e-05 2024-04-18T14:44:17.451 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:17.451 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:17.451 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-04-18T14:44:17.451 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:19.321511+0000", 2024-04-18T14:44:17.451 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000143981 2024-04-18T14:44:17.451 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:17.452 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:17.452 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for peered", 2024-04-18T14:44:17.452 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:19.321560+0000", 2024-04-18T14:44:17.452 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 4.8279999999999999e-05 2024-04-18T14:44:17.452 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:17.452 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:17.452 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-04-18T14:44:17.452 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.324154+0000", 2024-04-18T14:44:17.452 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.0025947829999999 2024-04-18T14:44:17.452 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:17.452 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:17.452 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-04-18T14:44:17.452 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.324558+0000", 2024-04-18T14:44:17.452 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00040310999999999998 2024-04-18T14:44:17.453 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:17.453 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:17.453 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for subops from 0", 2024-04-18T14:44:17.453 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.325049+0000", 2024-04-18T14:44:17.453 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00049149000000000003 2024-04-18T14:44:17.453 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:17.453 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:17.453 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_commit_rec", 2024-04-18T14:44:17.453 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.326473+0000", 2024-04-18T14:44:17.453 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.001423517 2024-04-18T14:44:17.453 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:17.453 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:17.453 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-04-18T14:44:17.453 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.328533+0000", 2024-04-18T14:44:17.454 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0020606779999999998 2024-04-18T14:44:17.454 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:17.454 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:17.454 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-04-18T14:44:17.454 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.328679+0000", 2024-04-18T14:44:17.454 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00014585800000000001 2024-04-18T14:44:17.454 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:17.454 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:17.454 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-04-18T14:44:17.454 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.328781+0000", 2024-04-18T14:44:17.454 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000101872 2024-04-18T14:44:17.454 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:44:17.454 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T14:44:17.454 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:44:17.454 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:17.455 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:17.455 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4212.0:110 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-04-18T14:44:17.455 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-04-18T14:43:20.700822+0000", 2024-04-18T14:44:17.455 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 56.745930624000003, 2024-04-18T14:44:17.455 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.021022381999999999, 2024-04-18T14:44:17.455 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-04-18T14:44:17.455 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T14:44:17.455 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-04-18T14:44:17.455 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4212", 2024-04-18T14:44:17.455 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "172.21.15.134:0/3325451476", 2024-04-18T14:44:17.455 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 110 2024-04-18T14:44:17.455 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:17.455 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-04-18T14:44:17.455 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:17.455 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-04-18T14:44:17.456 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.700822+0000", 2024-04-18T14:44:17.456 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:44:17.456 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:17.456 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:17.456 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-04-18T14:44:17.456 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.700822+0000", 2024-04-18T14:44:17.456 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:44:17.456 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:17.456 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:17.456 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-04-18T14:44:17.456 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.700821+0000", 2024-04-18T14:44:17.456 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 4294967295.999999 2024-04-18T14:44:17.456 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:17.456 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:17.456 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-04-18T14:44:17.457 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.700828+0000", 2024-04-18T14:44:17.457 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 6.9269999999999999e-06 2024-04-18T14:44:17.457 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:17.457 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:17.457 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-04-18T14:44:17.457 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.700839+0000", 2024-04-18T14:44:17.457 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.0702e-05 2024-04-18T14:44:17.457 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:17.457 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:17.457 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-04-18T14:44:17.457 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.700847+0000", 2024-04-18T14:44:17.457 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 7.6020000000000002e-06 2024-04-18T14:44:17.457 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:17.457 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:17.457 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-04-18T14:44:17.458 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.709488+0000", 2024-04-18T14:44:17.458 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0086410080000000004 2024-04-18T14:44:17.458 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:17.458 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:17.458 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-04-18T14:44:17.458 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.709751+0000", 2024-04-18T14:44:17.458 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000263272 2024-04-18T14:44:17.458 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:17.458 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:17.458 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for subops from 0", 2024-04-18T14:44:17.458 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.710106+0000", 2024-04-18T14:44:17.458 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000355037 2024-04-18T14:44:17.458 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:17.458 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:17.458 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-04-18T14:44:17.459 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.714026+0000", 2024-04-18T14:44:17.459 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0039202860000000003 2024-04-18T14:44:17.459 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:17.459 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:17.459 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_commit_rec", 2024-04-18T14:44:17.459 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.721600+0000", 2024-04-18T14:44:17.459 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0075740879999999997 2024-04-18T14:44:17.459 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:17.459 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:17.459 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-04-18T14:44:17.459 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.721740+0000", 2024-04-18T14:44:17.459 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00013932500000000001 2024-04-18T14:44:17.459 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:17.459 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:17.459 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-04-18T14:44:17.459 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.721845+0000", 2024-04-18T14:44:17.460 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000104992 2024-04-18T14:44:17.460 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:44:17.460 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T14:44:17.460 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:44:17.460 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:17.460 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:17.460 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4212.0:111 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-04-18T14:44:17.460 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-04-18T14:43:20.700855+0000", 2024-04-18T14:44:17.460 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 56.745897739999997, 2024-04-18T14:44:17.460 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.021347998, 2024-04-18T14:44:17.460 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-04-18T14:44:17.460 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T14:44:17.460 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-04-18T14:44:17.460 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4212", 2024-04-18T14:44:17.460 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "172.21.15.134:0/3325451476", 2024-04-18T14:44:17.461 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 111 2024-04-18T14:44:17.461 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:17.461 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-04-18T14:44:17.461 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:17.461 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-04-18T14:44:17.461 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.700855+0000", 2024-04-18T14:44:17.461 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:44:17.461 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:17.461 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:17.461 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-04-18T14:44:17.461 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.700855+0000", 2024-04-18T14:44:17.461 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:44:17.461 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:17.461 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:17.462 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-04-18T14:44:17.462 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.700854+0000", 2024-04-18T14:44:17.462 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 4294967295.999999 2024-04-18T14:44:17.462 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:17.462 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:17.462 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-04-18T14:44:17.462 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.700860+0000", 2024-04-18T14:44:17.462 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 5.7189999999999998e-06 2024-04-18T14:44:17.462 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:17.462 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:17.462 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-04-18T14:44:17.462 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.700869+0000", 2024-04-18T14:44:17.462 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 8.9889999999999998e-06 2024-04-18T14:44:17.462 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:17.462 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:17.463 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-04-18T14:44:17.463 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.700876+0000", 2024-04-18T14:44:17.463 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 7.0430000000000002e-06 2024-04-18T14:44:17.463 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:17.463 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:17.463 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-04-18T14:44:17.463 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.711224+0000", 2024-04-18T14:44:17.463 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.010347897 2024-04-18T14:44:17.463 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:17.463 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:17.463 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-04-18T14:44:17.463 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.711463+0000", 2024-04-18T14:44:17.463 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00023920699999999999 2024-04-18T14:44:17.463 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:17.463 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:17.463 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for subops from 0", 2024-04-18T14:44:17.464 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.711805+0000", 2024-04-18T14:44:17.464 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00034209600000000001 2024-04-18T14:44:17.464 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:17.464 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:17.464 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-04-18T14:44:17.464 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.715645+0000", 2024-04-18T14:44:17.464 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.003839309 2024-04-18T14:44:17.464 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:17.464 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:17.464 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_commit_rec", 2024-04-18T14:44:17.464 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.721971+0000", 2024-04-18T14:44:17.464 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0063267729999999999 2024-04-18T14:44:17.464 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:17.464 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:17.465 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-04-18T14:44:17.465 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.722107+0000", 2024-04-18T14:44:17.465 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00013514500000000001 2024-04-18T14:44:17.465 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:17.465 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:17.465 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-04-18T14:44:17.465 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.722203+0000", 2024-04-18T14:44:17.465 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 9.6545999999999993e-05 2024-04-18T14:44:17.465 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:44:17.465 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T14:44:17.465 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:44:17.465 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:17.465 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:17.465 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4212.0:112 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-04-18T14:44:17.465 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-04-18T14:43:20.700902+0000", 2024-04-18T14:44:17.466 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 56.745850597, 2024-04-18T14:44:17.466 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.021658816000000001, 2024-04-18T14:44:17.466 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-04-18T14:44:17.466 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T14:44:17.466 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-04-18T14:44:17.466 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4212", 2024-04-18T14:44:17.466 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "172.21.15.134:0/3325451476", 2024-04-18T14:44:17.466 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 112 2024-04-18T14:44:17.466 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:17.466 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-04-18T14:44:17.466 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:17.466 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-04-18T14:44:17.466 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.700902+0000", 2024-04-18T14:44:17.466 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:44:17.466 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:17.467 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:17.467 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-04-18T14:44:17.467 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.700902+0000", 2024-04-18T14:44:17.467 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:44:17.467 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:17.467 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:17.467 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-04-18T14:44:17.467 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.700901+0000", 2024-04-18T14:44:17.467 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 4294967295.999999 2024-04-18T14:44:17.467 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:17.467 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:17.467 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-04-18T14:44:17.467 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.701003+0000", 2024-04-18T14:44:17.467 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000102205 2024-04-18T14:44:17.467 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:17.467 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:17.468 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-04-18T14:44:17.468 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.701016+0000", 2024-04-18T14:44:17.468 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.2908000000000001e-05 2024-04-18T14:44:17.468 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:17.468 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:17.468 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-04-18T14:44:17.468 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.701025+0000", 2024-04-18T14:44:17.468 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 8.7229999999999993e-06 2024-04-18T14:44:17.468 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:17.468 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:17.468 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-04-18T14:44:17.468 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.712558+0000", 2024-04-18T14:44:17.468 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.011533181 2024-04-18T14:44:17.468 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:17.468 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:17.468 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-04-18T14:44:17.469 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.712690+0000", 2024-04-18T14:44:17.469 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00013159200000000001 2024-04-18T14:44:17.469 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:17.469 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:17.469 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for subops from 0", 2024-04-18T14:44:17.469 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.712895+0000", 2024-04-18T14:44:17.469 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000205126 2024-04-18T14:44:17.469 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:17.469 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:17.469 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-04-18T14:44:17.469 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.721499+0000", 2024-04-18T14:44:17.469 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0086041469999999995 2024-04-18T14:44:17.469 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:17.470 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:17.470 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_commit_rec", 2024-04-18T14:44:17.470 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.722336+0000", 2024-04-18T14:44:17.470 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00083725200000000003 2024-04-18T14:44:17.470 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:17.470 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:17.470 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-04-18T14:44:17.470 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.722461+0000", 2024-04-18T14:44:17.470 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00012457899999999999 2024-04-18T14:44:17.470 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:17.470 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:17.470 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-04-18T14:44:17.470 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.722561+0000", 2024-04-18T14:44:17.470 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000100066 2024-04-18T14:44:17.470 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:44:17.471 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T14:44:17.471 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:44:17.471 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:17.471 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:17.471 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4212.0:113 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-04-18T14:44:17.471 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-04-18T14:43:20.701035+0000", 2024-04-18T14:44:17.471 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 56.745717411000001, 2024-04-18T14:44:17.471 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.021756507000000001, 2024-04-18T14:44:17.471 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-04-18T14:44:17.471 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T14:44:17.471 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-04-18T14:44:17.471 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4212", 2024-04-18T14:44:17.471 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "172.21.15.134:0/3325451476", 2024-04-18T14:44:17.471 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 113 2024-04-18T14:44:17.471 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:17.472 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-04-18T14:44:17.472 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:17.472 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-04-18T14:44:17.472 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.701035+0000", 2024-04-18T14:44:17.472 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:44:17.472 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:17.472 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:17.472 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-04-18T14:44:17.472 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.701035+0000", 2024-04-18T14:44:17.472 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:44:17.472 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:17.472 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:17.472 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-04-18T14:44:17.472 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.701035+0000", 2024-04-18T14:44:17.472 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 4294967295.999999 2024-04-18T14:44:17.472 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:17.473 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:17.473 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-04-18T14:44:17.473 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.701041+0000", 2024-04-18T14:44:17.473 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 6.0290000000000002e-06 2024-04-18T14:44:17.473 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:17.473 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:17.473 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-04-18T14:44:17.473 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.701050+0000", 2024-04-18T14:44:17.473 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 9.0299999999999999e-06 2024-04-18T14:44:17.473 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:17.473 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:17.473 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-04-18T14:44:17.473 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.701057+0000", 2024-04-18T14:44:17.473 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 6.9550000000000003e-06 2024-04-18T14:44:17.474 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:17.474 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:17.474 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-04-18T14:44:17.474 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.714308+0000", 2024-04-18T14:44:17.474 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.013251281 2024-04-18T14:44:17.474 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:17.474 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:17.474 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-04-18T14:44:17.474 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.714542+0000", 2024-04-18T14:44:17.474 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00023440000000000001 2024-04-18T14:44:17.474 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:17.474 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:17.474 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for subops from 0", 2024-04-18T14:44:17.474 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.714898+0000", 2024-04-18T14:44:17.474 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00035589500000000001 2024-04-18T14:44:17.475 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:17.475 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:17.475 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-04-18T14:44:17.475 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.721874+0000", 2024-04-18T14:44:17.475 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0069761620000000002 2024-04-18T14:44:17.475 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:17.475 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:17.475 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_commit_rec", 2024-04-18T14:44:17.475 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.722665+0000", 2024-04-18T14:44:17.475 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00079023299999999999 2024-04-18T14:44:17.475 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:17.475 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:17.475 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-04-18T14:44:17.475 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.722737+0000", 2024-04-18T14:44:17.476 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 7.2156999999999994e-05 2024-04-18T14:44:17.476 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:17.476 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:17.476 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-04-18T14:44:17.476 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.722792+0000", 2024-04-18T14:44:17.476 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 5.5095e-05 2024-04-18T14:44:17.476 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:44:17.476 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T14:44:17.476 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:44:17.476 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:17.476 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:17.476 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4212.0:114 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-04-18T14:44:17.476 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-04-18T14:43:20.701065+0000", 2024-04-18T14:44:17.476 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 56.745687750000002, 2024-04-18T14:44:17.476 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.022072597999999999, 2024-04-18T14:44:17.477 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-04-18T14:44:17.477 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T14:44:17.477 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-04-18T14:44:17.477 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4212", 2024-04-18T14:44:17.477 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "172.21.15.134:0/3325451476", 2024-04-18T14:44:17.477 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 114 2024-04-18T14:44:17.477 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:17.477 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-04-18T14:44:17.477 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:17.477 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-04-18T14:44:17.477 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.701065+0000", 2024-04-18T14:44:17.477 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:44:17.477 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:17.477 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:17.477 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-04-18T14:44:17.478 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.701065+0000", 2024-04-18T14:44:17.478 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:44:17.478 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:17.478 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:17.478 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-04-18T14:44:17.478 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.701064+0000", 2024-04-18T14:44:17.478 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 4294967295.9999995 2024-04-18T14:44:17.478 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:17.478 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:17.478 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-04-18T14:44:17.478 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.701070+0000", 2024-04-18T14:44:17.478 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 5.6400000000000002e-06 2024-04-18T14:44:17.478 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:17.478 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:17.479 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-04-18T14:44:17.479 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.701079+0000", 2024-04-18T14:44:17.479 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 8.9590000000000001e-06 2024-04-18T14:44:17.479 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:17.479 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:17.479 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-04-18T14:44:17.479 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.701086+0000", 2024-04-18T14:44:17.479 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 6.8499999999999996e-06 2024-04-18T14:44:17.479 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:17.480 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:17.480 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-04-18T14:44:17.480 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.715764+0000", 2024-04-18T14:44:17.480 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.01467833 2024-04-18T14:44:17.480 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:17.480 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:17.480 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-04-18T14:44:17.480 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.715902+0000", 2024-04-18T14:44:17.480 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00013763499999999999 2024-04-18T14:44:17.480 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:17.480 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:17.480 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for subops from 0", 2024-04-18T14:44:17.480 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.716201+0000", 2024-04-18T14:44:17.480 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00029946200000000001 2024-04-18T14:44:17.481 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:17.481 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:17.481 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-04-18T14:44:17.481 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.721892+0000", 2024-04-18T14:44:17.481 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0056902680000000001 2024-04-18T14:44:17.481 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:17.481 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:17.481 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_commit_rec", 2024-04-18T14:44:17.481 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.722918+0000", 2024-04-18T14:44:17.481 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0010263130000000001 2024-04-18T14:44:17.481 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:17.481 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:17.481 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-04-18T14:44:17.481 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.723034+0000", 2024-04-18T14:44:17.482 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000116481 2024-04-18T14:44:17.482 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:17.482 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:17.482 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-04-18T14:44:17.482 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.723138+0000", 2024-04-18T14:44:17.482 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000103274 2024-04-18T14:44:17.482 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:44:17.482 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T14:44:17.482 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:44:17.482 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:17.482 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:17.482 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4212.0:115 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-04-18T14:44:17.483 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-04-18T14:43:20.701238+0000", 2024-04-18T14:44:17.483 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 56.745514354999997, 2024-04-18T14:44:17.483 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.02214089, 2024-04-18T14:44:17.483 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-04-18T14:44:17.483 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T14:44:17.483 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-04-18T14:44:17.483 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4212", 2024-04-18T14:44:17.483 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "172.21.15.134:0/3325451476", 2024-04-18T14:44:17.483 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 115 2024-04-18T14:44:17.483 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:17.483 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-04-18T14:44:17.483 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:17.483 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-04-18T14:44:17.483 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.701238+0000", 2024-04-18T14:44:17.484 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:44:17.484 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:17.484 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:17.484 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-04-18T14:44:17.484 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.701238+0000", 2024-04-18T14:44:17.484 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:44:17.484 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:17.484 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:17.484 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-04-18T14:44:17.484 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.701237+0000", 2024-04-18T14:44:17.484 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 4294967295.9999986 2024-04-18T14:44:17.484 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:17.484 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:17.484 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-04-18T14:44:17.485 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.701377+0000", 2024-04-18T14:44:17.485 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000139849 2024-04-18T14:44:17.485 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:17.485 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:17.485 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-04-18T14:44:17.485 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.701392+0000", 2024-04-18T14:44:17.485 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.5322e-05 2024-04-18T14:44:17.485 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:17.485 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:17.485 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-04-18T14:44:17.485 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.701401+0000", 2024-04-18T14:44:17.485 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 8.9430000000000006e-06 2024-04-18T14:44:17.485 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:17.485 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:17.485 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-04-18T14:44:17.486 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.719830+0000", 2024-04-18T14:44:17.486 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.018429009999999999 2024-04-18T14:44:17.486 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:17.486 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:17.486 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-04-18T14:44:17.486 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.720057+0000", 2024-04-18T14:44:17.486 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00022700500000000001 2024-04-18T14:44:17.486 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:17.486 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:17.486 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for subops from 0", 2024-04-18T14:44:17.486 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.720408+0000", 2024-04-18T14:44:17.486 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00035086399999999999 2024-04-18T14:44:17.486 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:17.486 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:17.487 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-04-18T14:44:17.487 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.723171+0000", 2024-04-18T14:44:17.487 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.002762708 2024-04-18T14:44:17.487 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:17.487 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:17.487 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_commit_rec", 2024-04-18T14:44:17.487 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.723264+0000", 2024-04-18T14:44:17.487 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 9.2888999999999998e-05 2024-04-18T14:44:17.487 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:17.487 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:17.487 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-04-18T14:44:17.487 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.723329+0000", 2024-04-18T14:44:17.487 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 6.5394000000000004e-05 2024-04-18T14:44:17.487 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:17.487 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:17.488 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-04-18T14:44:17.488 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.723379+0000", 2024-04-18T14:44:17.488 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 5.0126000000000001e-05 2024-04-18T14:44:17.488 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:44:17.488 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T14:44:17.488 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:44:17.488 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:17.488 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:17.488 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4212.0:116 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-04-18T14:44:17.488 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-04-18T14:43:20.701416+0000", 2024-04-18T14:44:17.488 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 56.745337079000002, 2024-04-18T14:44:17.488 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.024681692000000002, 2024-04-18T14:44:17.488 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-04-18T14:44:17.488 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T14:44:17.489 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-04-18T14:44:17.489 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4212", 2024-04-18T14:44:17.489 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "172.21.15.134:0/3325451476", 2024-04-18T14:44:17.489 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 116 2024-04-18T14:44:17.489 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:17.489 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-04-18T14:44:17.489 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:17.489 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-04-18T14:44:17.489 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.701416+0000", 2024-04-18T14:44:17.489 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:44:17.489 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:17.489 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:17.489 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-04-18T14:44:17.489 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.701416+0000", 2024-04-18T14:44:17.490 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:44:17.490 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:17.490 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:17.490 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-04-18T14:44:17.490 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.701415+0000", 2024-04-18T14:44:17.490 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 4294967295.999999 2024-04-18T14:44:17.490 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:17.490 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:17.490 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-04-18T14:44:17.490 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.701434+0000", 2024-04-18T14:44:17.490 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.9258000000000001e-05 2024-04-18T14:44:17.490 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:17.490 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:17.491 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-04-18T14:44:17.491 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.701445+0000", 2024-04-18T14:44:17.491 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.0485999999999999e-05 2024-04-18T14:44:17.491 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:17.491 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:17.491 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-04-18T14:44:17.491 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.701452+0000", 2024-04-18T14:44:17.491 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 7.9060000000000002e-06 2024-04-18T14:44:17.491 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:17.491 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:17.491 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-04-18T14:44:17.491 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.723471+0000", 2024-04-18T14:44:17.492 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.022019047 2024-04-18T14:44:17.492 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:17.492 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:17.492 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-04-18T14:44:17.492 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.723697+0000", 2024-04-18T14:44:17.492 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000225634 2024-04-18T14:44:17.492 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:17.492 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:17.492 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for subops from 0", 2024-04-18T14:44:17.492 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.724053+0000", 2024-04-18T14:44:17.492 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000355798 2024-04-18T14:44:17.492 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:17.492 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:17.492 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_commit_rec", 2024-04-18T14:44:17.493 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.725675+0000", 2024-04-18T14:44:17.493 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.001622264 2024-04-18T14:44:17.493 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:17.493 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:17.493 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-04-18T14:44:17.493 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.725879+0000", 2024-04-18T14:44:17.493 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00020390299999999999 2024-04-18T14:44:17.493 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:17.493 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:17.493 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-04-18T14:44:17.493 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.725994+0000", 2024-04-18T14:44:17.493 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000115158 2024-04-18T14:44:17.493 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:17.493 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:17.493 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-04-18T14:44:17.494 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.726097+0000", 2024-04-18T14:44:17.494 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000103231 2024-04-18T14:44:17.494 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:44:17.494 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T14:44:17.494 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:44:17.494 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:17.494 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:17.494 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4212.0:117 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-04-18T14:44:17.494 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-04-18T14:43:20.701462+0000", 2024-04-18T14:44:17.494 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 56.745291246000001, 2024-04-18T14:44:17.494 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.025118439999999999, 2024-04-18T14:44:17.494 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-04-18T14:44:17.494 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T14:44:17.494 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-04-18T14:44:17.494 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4212", 2024-04-18T14:44:17.495 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "172.21.15.134:0/3325451476", 2024-04-18T14:44:17.495 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 117 2024-04-18T14:44:17.495 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:17.495 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-04-18T14:44:17.495 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:17.495 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-04-18T14:44:17.495 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.701462+0000", 2024-04-18T14:44:17.495 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:44:17.495 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:17.495 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:17.495 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-04-18T14:44:17.495 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.701462+0000", 2024-04-18T14:44:17.495 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:44:17.495 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:17.495 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:17.496 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-04-18T14:44:17.496 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.701461+0000", 2024-04-18T14:44:17.496 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 4294967295.9999995 2024-04-18T14:44:17.496 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:17.496 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:17.496 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-04-18T14:44:17.496 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.701468+0000", 2024-04-18T14:44:17.496 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 6.6630000000000004e-06 2024-04-18T14:44:17.496 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:17.496 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:17.496 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-04-18T14:44:17.496 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.701478+0000", 2024-04-18T14:44:17.496 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.0796e-05 2024-04-18T14:44:17.496 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:17.496 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:17.496 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-04-18T14:44:17.497 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.701486+0000", 2024-04-18T14:44:17.497 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 7.3490000000000003e-06 2024-04-18T14:44:17.497 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:17.497 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:17.497 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-04-18T14:44:17.497 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.724772+0000", 2024-04-18T14:44:17.497 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.023286554000000001 2024-04-18T14:44:17.497 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:17.497 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:17.497 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-04-18T14:44:17.497 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.724901+0000", 2024-04-18T14:44:17.497 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00012827499999999999 2024-04-18T14:44:17.497 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:17.498 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:17.498 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for subops from 0", 2024-04-18T14:44:17.498 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.725102+0000", 2024-04-18T14:44:17.498 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000201471 2024-04-18T14:44:17.498 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:17.498 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:17.498 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_commit_rec", 2024-04-18T14:44:17.498 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.726349+0000", 2024-04-18T14:44:17.498 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.001247061 2024-04-18T14:44:17.498 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:17.498 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:17.498 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-04-18T14:44:17.499 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.726373+0000", 2024-04-18T14:44:17.499 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.4207999999999999e-05 2024-04-18T14:44:17.499 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:17.499 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:17.499 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-04-18T14:44:17.499 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.726488+0000", 2024-04-18T14:44:17.499 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000115118 2024-04-18T14:44:17.499 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:17.499 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:17.499 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-04-18T14:44:17.499 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.726580+0000", 2024-04-18T14:44:17.499 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 9.1612000000000003e-05 2024-04-18T14:44:17.499 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:44:17.499 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T14:44:17.499 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:44:17.499 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:17.500 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:17.500 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4212.0:164 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-04-18T14:44:17.500 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-04-18T14:43:21.039689+0000", 2024-04-18T14:44:17.500 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 56.407063575000002, 2024-04-18T14:44:17.500 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.020243589999999999, 2024-04-18T14:44:17.500 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-04-18T14:44:17.500 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T14:44:17.500 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-04-18T14:44:17.500 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4212", 2024-04-18T14:44:17.500 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "172.21.15.134:0/3325451476", 2024-04-18T14:44:17.500 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 164 2024-04-18T14:44:17.500 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:17.500 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-04-18T14:44:17.500 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:17.500 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-04-18T14:44:17.501 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:21.039689+0000", 2024-04-18T14:44:17.501 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:44:17.501 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:17.501 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:17.501 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-04-18T14:44:17.501 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:21.039689+0000", 2024-04-18T14:44:17.501 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:44:17.501 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:17.501 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:17.501 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-04-18T14:44:17.501 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:21.039689+0000", 2024-04-18T14:44:17.501 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 4294967295.9999995 2024-04-18T14:44:17.501 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:17.501 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:17.501 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-04-18T14:44:17.502 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:21.039773+0000", 2024-04-18T14:44:17.502 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 8.4040000000000002e-05 2024-04-18T14:44:17.502 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:17.502 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:17.502 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-04-18T14:44:17.502 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:21.039783+0000", 2024-04-18T14:44:17.502 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.0786e-05 2024-04-18T14:44:17.502 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:17.502 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:17.502 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-04-18T14:44:17.502 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:21.039791+0000", 2024-04-18T14:44:17.502 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 7.8320000000000006e-06 2024-04-18T14:44:17.502 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:17.503 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:17.503 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-04-18T14:44:17.503 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:21.056266+0000", 2024-04-18T14:44:17.503 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.016474586999999999 2024-04-18T14:44:17.503 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:17.503 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:17.503 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-04-18T14:44:17.503 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:21.056394+0000", 2024-04-18T14:44:17.503 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00012773299999999999 2024-04-18T14:44:17.503 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:17.503 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:17.503 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for subops from 0", 2024-04-18T14:44:17.503 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:21.056584+0000", 2024-04-18T14:44:17.503 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00019052500000000001 2024-04-18T14:44:17.504 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:17.504 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:17.504 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_commit_rec", 2024-04-18T14:44:17.504 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:21.059718+0000", 2024-04-18T14:44:17.504 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0031340999999999999 2024-04-18T14:44:17.504 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:17.504 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:17.504 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-04-18T14:44:17.504 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:21.059746+0000", 2024-04-18T14:44:17.504 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.7447999999999999e-05 2024-04-18T14:44:17.504 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:17.504 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:17.504 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-04-18T14:44:17.504 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:21.059876+0000", 2024-04-18T14:44:17.504 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00013080599999999999 2024-04-18T14:44:17.505 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:17.505 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:17.505 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-04-18T14:44:17.505 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:21.059933+0000", 2024-04-18T14:44:17.505 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 5.6372999999999997e-05 2024-04-18T14:44:17.505 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:44:17.505 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T14:44:17.505 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:44:17.505 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:17.505 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:17.505 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4212.0:165 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-04-18T14:44:17.505 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-04-18T14:43:21.039800+0000", 2024-04-18T14:44:17.505 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 56.406952373999999, 2024-04-18T14:44:17.505 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.022777954, 2024-04-18T14:44:17.506 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-04-18T14:44:17.506 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T14:44:17.506 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-04-18T14:44:17.506 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4212", 2024-04-18T14:44:17.506 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "172.21.15.134:0/3325451476", 2024-04-18T14:44:17.506 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 165 2024-04-18T14:44:17.506 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:17.506 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-04-18T14:44:17.506 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:17.506 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-04-18T14:44:17.506 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:21.039800+0000", 2024-04-18T14:44:17.506 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:44:17.506 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:17.506 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:17.507 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-04-18T14:44:17.507 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:21.039800+0000", 2024-04-18T14:44:17.507 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:44:17.507 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:17.507 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:17.507 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-04-18T14:44:17.507 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:21.039800+0000", 2024-04-18T14:44:17.507 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 4294967295.999999 2024-04-18T14:44:17.507 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:17.507 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:17.507 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-04-18T14:44:17.507 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:21.039806+0000", 2024-04-18T14:44:17.507 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 6.263e-06 2024-04-18T14:44:17.508 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:17.508 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:17.508 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-04-18T14:44:17.508 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:21.039815+0000", 2024-04-18T14:44:17.508 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 9.0790000000000007e-06 2024-04-18T14:44:17.508 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:17.508 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:17.508 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-04-18T14:44:17.508 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:21.039822+0000", 2024-04-18T14:44:17.508 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 6.9929999999999998e-06 2024-04-18T14:44:17.508 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:17.508 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:17.508 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-04-18T14:44:17.508 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:21.058092+0000", 2024-04-18T14:44:17.508 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.018269884 2024-04-18T14:44:17.508 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:17.509 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:17.509 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-04-18T14:44:17.509 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:21.058307+0000", 2024-04-18T14:44:17.509 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00021547600000000001 2024-04-18T14:44:17.509 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:17.509 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:17.509 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for subops from 0", 2024-04-18T14:44:17.509 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:21.058667+0000", 2024-04-18T14:44:17.509 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00035945500000000001 2024-04-18T14:44:17.509 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:17.509 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:17.509 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_commit_rec", 2024-04-18T14:44:17.509 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:21.060393+0000", 2024-04-18T14:44:17.509 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0017262619999999999 2024-04-18T14:44:17.509 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:17.510 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:17.510 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-04-18T14:44:17.510 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:21.062336+0000", 2024-04-18T14:44:17.510 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.001943078 2024-04-18T14:44:17.510 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:17.510 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:17.510 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-04-18T14:44:17.510 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:21.062471+0000", 2024-04-18T14:44:17.510 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00013455300000000001 2024-04-18T14:44:17.510 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:17.510 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:17.510 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-04-18T14:44:17.510 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:21.062578+0000", 2024-04-18T14:44:17.510 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00010770800000000001 2024-04-18T14:44:17.511 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:44:17.511 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T14:44:17.511 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:44:17.511 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:17.511 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:17.511 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4212.0:187 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-04-18T14:44:17.511 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-04-18T14:43:21.211285+0000", 2024-04-18T14:44:17.511 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 56.235467442000001, 2024-04-18T14:44:17.511 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.022261811999999999, 2024-04-18T14:44:17.511 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-04-18T14:44:17.511 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T14:44:17.511 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-04-18T14:44:17.511 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4212", 2024-04-18T14:44:17.511 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "172.21.15.134:0/3325451476", 2024-04-18T14:44:17.511 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 187 2024-04-18T14:44:17.512 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:17.512 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-04-18T14:44:17.512 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:17.512 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-04-18T14:44:17.512 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:21.211285+0000", 2024-04-18T14:44:17.512 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:44:17.512 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:17.512 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:17.512 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-04-18T14:44:17.512 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:21.211285+0000", 2024-04-18T14:44:17.512 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:44:17.512 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:17.512 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:17.513 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-04-18T14:44:17.513 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:21.211285+0000", 2024-04-18T14:44:17.513 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 4294967295.9999995 2024-04-18T14:44:17.513 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:17.513 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:17.513 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-04-18T14:44:17.513 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:21.211290+0000", 2024-04-18T14:44:17.513 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 5.6999999999999996e-06 2024-04-18T14:44:17.513 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:17.513 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:17.513 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-04-18T14:44:17.513 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:21.211300+0000", 2024-04-18T14:44:17.513 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 9.0890000000000006e-06 2024-04-18T14:44:17.513 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:17.513 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:17.514 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-04-18T14:44:17.514 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:21.211306+0000", 2024-04-18T14:44:17.514 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 6.8029999999999999e-06 2024-04-18T14:44:17.514 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:17.514 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:17.514 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-04-18T14:44:17.514 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:21.228301+0000", 2024-04-18T14:44:17.514 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.016994598999999999 2024-04-18T14:44:17.514 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:17.514 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:17.514 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-04-18T14:44:17.514 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:21.228558+0000", 2024-04-18T14:44:17.514 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00025666600000000001 2024-04-18T14:44:17.514 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:17.514 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:17.515 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for subops from 0", 2024-04-18T14:44:17.515 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:21.228844+0000", 2024-04-18T14:44:17.515 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00028685700000000001 2024-04-18T14:44:17.515 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:17.515 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:17.515 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-04-18T14:44:17.515 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:21.233311+0000", 2024-04-18T14:44:17.515 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0044661400000000004 2024-04-18T14:44:17.515 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:17.515 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:17.515 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_commit_rec", 2024-04-18T14:44:17.515 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:21.233386+0000", 2024-04-18T14:44:17.515 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 7.5184000000000004e-05 2024-04-18T14:44:17.515 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:17.515 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:17.516 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-04-18T14:44:17.516 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:21.233457+0000", 2024-04-18T14:44:17.516 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 7.0914999999999994e-05 2024-04-18T14:44:17.516 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:17.516 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:17.516 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-04-18T14:44:17.516 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:21.233547+0000", 2024-04-18T14:44:17.516 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 9.0486000000000001e-05 2024-04-18T14:44:17.516 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:44:17.516 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T14:44:17.516 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:44:17.516 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:17.516 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:17.516 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4212.0:188 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-04-18T14:44:17.516 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-04-18T14:43:21.211314+0000", 2024-04-18T14:44:17.516 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 56.235438694000003, 2024-04-18T14:44:17.517 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.022928674999999999, 2024-04-18T14:44:17.517 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-04-18T14:44:17.517 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T14:44:17.517 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-04-18T14:44:17.517 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4212", 2024-04-18T14:44:17.517 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "172.21.15.134:0/3325451476", 2024-04-18T14:44:17.517 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 188 2024-04-18T14:44:17.517 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:17.517 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-04-18T14:44:17.517 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:17.517 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-04-18T14:44:17.517 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:21.211314+0000", 2024-04-18T14:44:17.517 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:44:17.517 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:17.518 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:17.518 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-04-18T14:44:17.518 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:21.211314+0000", 2024-04-18T14:44:17.518 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:44:17.518 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:17.518 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:17.518 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-04-18T14:44:17.518 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:21.211314+0000", 2024-04-18T14:44:17.518 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 4294967295.9999995 2024-04-18T14:44:17.518 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:17.518 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:17.518 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-04-18T14:44:17.518 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:21.211413+0000", 2024-04-18T14:44:17.518 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 9.9754999999999996e-05 2024-04-18T14:44:17.518 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:17.519 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:17.519 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-04-18T14:44:17.519 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:21.211425+0000", 2024-04-18T14:44:17.519 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.1259e-05 2024-04-18T14:44:17.519 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:17.519 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:17.519 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-04-18T14:44:17.519 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:21.211435+0000", 2024-04-18T14:44:17.519 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 9.9990000000000003e-06 2024-04-18T14:44:17.519 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:17.519 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:17.519 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-04-18T14:44:17.519 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:21.230726+0000", 2024-04-18T14:44:17.519 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.019291490000000001 2024-04-18T14:44:17.520 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:17.520 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:17.520 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-04-18T14:44:17.520 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:21.230855+0000", 2024-04-18T14:44:17.520 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000129102 2024-04-18T14:44:17.520 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:17.520 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:17.520 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for subops from 0", 2024-04-18T14:44:17.520 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:21.231049+0000", 2024-04-18T14:44:17.520 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00019388900000000001 2024-04-18T14:44:17.520 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:17.520 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:17.520 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-04-18T14:44:17.520 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:21.233333+0000", 2024-04-18T14:44:17.520 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0022836309999999999 2024-04-18T14:44:17.521 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:17.521 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:17.521 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_commit_rec", 2024-04-18T14:44:17.521 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:21.234118+0000", 2024-04-18T14:44:17.521 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00078523999999999998 2024-04-18T14:44:17.521 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:17.521 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:17.521 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-04-18T14:44:17.521 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:21.234191+0000", 2024-04-18T14:44:17.521 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 7.3028000000000006e-05 2024-04-18T14:44:17.521 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:17.521 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:17.521 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-04-18T14:44:17.521 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:21.234243+0000", 2024-04-18T14:44:17.521 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 5.1898999999999999e-05 2024-04-18T14:44:17.521 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:44:17.522 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T14:44:17.522 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:44:17.522 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:17.522 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:17.522 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4212.0:189 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-04-18T14:44:17.522 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-04-18T14:43:21.211444+0000", 2024-04-18T14:44:17.522 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 56.235308750999998, 2024-04-18T14:44:17.522 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.023955757000000001, 2024-04-18T14:44:17.522 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-04-18T14:44:17.522 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T14:44:17.522 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-04-18T14:44:17.522 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4212", 2024-04-18T14:44:17.522 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "172.21.15.134:0/3325451476", 2024-04-18T14:44:17.522 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 189 2024-04-18T14:44:17.522 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:17.523 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-04-18T14:44:17.523 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:17.523 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-04-18T14:44:17.523 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:21.211444+0000", 2024-04-18T14:44:17.523 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:44:17.523 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:17.523 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:17.523 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-04-18T14:44:17.523 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:21.211444+0000", 2024-04-18T14:44:17.523 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:44:17.523 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:17.523 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:17.523 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-04-18T14:44:17.523 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:21.211443+0000", 2024-04-18T14:44:17.523 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 4294967295.999999 2024-04-18T14:44:17.524 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:17.524 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:17.524 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-04-18T14:44:17.524 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:21.211450+0000", 2024-04-18T14:44:17.524 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 6.28e-06 2024-04-18T14:44:17.524 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:17.524 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:17.524 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-04-18T14:44:17.524 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:21.211459+0000", 2024-04-18T14:44:17.524 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 9.132e-06 2024-04-18T14:44:17.524 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:17.524 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:17.524 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-04-18T14:44:17.524 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:21.211466+0000", 2024-04-18T14:44:17.524 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 6.8530000000000003e-06 2024-04-18T14:44:17.524 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:17.525 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:17.525 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-04-18T14:44:17.525 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:21.231986+0000", 2024-04-18T14:44:17.525 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.020520218 2024-04-18T14:44:17.525 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:17.525 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:17.525 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-04-18T14:44:17.525 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:21.232208+0000", 2024-04-18T14:44:17.525 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000222208 2024-04-18T14:44:17.525 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:17.525 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:17.525 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for subops from 0", 2024-04-18T14:44:17.525 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:21.232551+0000", 2024-04-18T14:44:17.525 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00034289999999999999 2024-04-18T14:44:17.526 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:17.526 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:17.526 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-04-18T14:44:17.526 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:21.233981+0000", 2024-04-18T14:44:17.526 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0014303390000000001 2024-04-18T14:44:17.526 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:17.526 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:17.526 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_commit_rec", 2024-04-18T14:44:17.526 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:21.235295+0000", 2024-04-18T14:44:17.526 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0013134189999999999 2024-04-18T14:44:17.526 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:17.526 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:17.526 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-04-18T14:44:17.527 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:21.235354+0000", 2024-04-18T14:44:17.527 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 5.8928000000000002e-05 2024-04-18T14:44:17.527 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:17.527 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:17.527 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-04-18T14:44:17.527 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:21.235400+0000", 2024-04-18T14:44:17.527 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 4.6273999999999998e-05 2024-04-18T14:44:17.527 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:44:17.527 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T14:44:17.527 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:44:17.527 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:17.527 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:17.527 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4559.0:560 3.3s0 3:c95aa19c:::smithi13430248-26:head [copy-from ver 48] snapc 1d=[1d,1c,1a,19,16,14,13,11,b,a,7,2] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2024-04-18T14:44:17.527 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-04-18T14:44:00.380761+0000", 2024-04-18T14:44:17.527 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 17.065991929999999, 2024-04-18T14:44:17.528 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.023909372000000002, 2024-04-18T14:44:17.528 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-04-18T14:44:17.528 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T14:44:17.528 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-04-18T14:44:17.528 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4559", 2024-04-18T14:44:17.528 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "172.21.15.134:0/3113589487", 2024-04-18T14:44:17.528 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 560 2024-04-18T14:44:17.528 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:17.528 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-04-18T14:44:17.528 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:17.528 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-04-18T14:44:17.528 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:00.380761+0000", 2024-04-18T14:44:17.528 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:44:17.528 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:17.528 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:17.528 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-04-18T14:44:17.529 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:00.380761+0000", 2024-04-18T14:44:17.529 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:44:17.529 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:17.529 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:17.529 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-04-18T14:44:17.529 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:00.380756+0000", 2024-04-18T14:44:17.529 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 4294967295.9999957 2024-04-18T14:44:17.529 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:17.529 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:17.529 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-04-18T14:44:17.529 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:00.380778+0000", 2024-04-18T14:44:17.529 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.1319999999999999e-05 2024-04-18T14:44:17.529 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:17.529 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:17.529 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-04-18T14:44:17.530 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:00.380813+0000", 2024-04-18T14:44:17.530 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.5648999999999997e-05 2024-04-18T14:44:17.530 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:17.530 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:17.530 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-04-18T14:44:17.530 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:00.380841+0000", 2024-04-18T14:44:17.530 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.7189999999999999e-05 2024-04-18T14:44:17.530 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:17.530 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:17.530 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-04-18T14:44:17.530 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:00.380990+0000", 2024-04-18T14:44:17.530 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00014950799999999999 2024-04-18T14:44:17.530 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:17.531 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:17.531 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op must wait for map", 2024-04-18T14:44:17.531 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:00.381015+0000", 2024-04-18T14:44:17.531 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.4760999999999999e-05 2024-04-18T14:44:17.531 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:17.531 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:17.531 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-04-18T14:44:17.531 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:00.384807+0000", 2024-04-18T14:44:17.531 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0037916069999999998 2024-04-18T14:44:17.531 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:17.531 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:17.531 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-04-18T14:44:17.531 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:00.385079+0000", 2024-04-18T14:44:17.531 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000272296 2024-04-18T14:44:17.532 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:17.532 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:17.532 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_started", 2024-04-18T14:44:17.532 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:00.398546+0000", 2024-04-18T14:44:17.532 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.013467451 2024-04-18T14:44:17.532 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:17.532 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:17.532 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_committed", 2024-04-18T14:44:17.532 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:00.401693+0000", 2024-04-18T14:44:17.532 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0031470199999999999 2024-04-18T14:44:17.532 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:17.532 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:17.532 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-04-18T14:44:17.533 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:00.404555+0000", 2024-04-18T14:44:17.533 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0028617030000000002 2024-04-18T14:44:17.533 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:17.533 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:17.533 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-04-18T14:44:17.533 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:00.404670+0000", 2024-04-18T14:44:17.533 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000115312 2024-04-18T14:44:17.533 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:44:17.533 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T14:44:17.533 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:44:17.533 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:17.533 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:17.533 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4559.0:709 3.2s0 3:42079eea:::smithi13430248-44:head [read 0~4620288,checksum,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e72)", 2024-04-18T14:44:17.534 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-04-18T14:44:11.388746+0000", 2024-04-18T14:44:17.534 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 6.0580068520000001, 2024-04-18T14:44:17.534 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.023104972000000001, 2024-04-18T14:44:17.534 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-04-18T14:44:17.534 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "started", 2024-04-18T14:44:17.534 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-04-18T14:44:17.534 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4559", 2024-04-18T14:44:17.534 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "172.21.15.134:0/3113589487", 2024-04-18T14:44:17.534 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 709 2024-04-18T14:44:17.534 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:17.534 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-04-18T14:44:17.534 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:17.534 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-04-18T14:44:17.535 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:11.388746+0000", 2024-04-18T14:44:17.535 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:44:17.535 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:17.535 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:17.535 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-04-18T14:44:17.535 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:11.388746+0000", 2024-04-18T14:44:17.535 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:44:17.535 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:17.535 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:17.535 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-04-18T14:44:17.535 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:11.388742+0000", 2024-04-18T14:44:17.535 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 4294967295.9999962 2024-04-18T14:44:17.535 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:17.535 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:17.536 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-04-18T14:44:17.536 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:11.388762+0000", 2024-04-18T14:44:17.536 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.035e-05 2024-04-18T14:44:17.536 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:17.536 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:17.536 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-04-18T14:44:17.536 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:11.388810+0000", 2024-04-18T14:44:17.536 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 4.7615999999999999e-05 2024-04-18T14:44:17.536 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:17.536 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:17.536 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-04-18T14:44:17.536 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:11.388835+0000", 2024-04-18T14:44:17.536 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.5038999999999999e-05 2024-04-18T14:44:17.536 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:17.537 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:17.537 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-04-18T14:44:17.537 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:11.388952+0000", 2024-04-18T14:44:17.537 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000117351 2024-04-18T14:44:17.537 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:17.537 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:17.537 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op must wait for map", 2024-04-18T14:44:17.537 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:11.388966+0000", 2024-04-18T14:44:17.537 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.3334e-05 2024-04-18T14:44:17.537 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:17.537 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:17.537 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-04-18T14:44:17.537 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:11.393030+0000", 2024-04-18T14:44:17.537 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.004064855 2024-04-18T14:44:17.538 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:17.538 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:17.538 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-04-18T14:44:17.538 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:11.393277+0000", 2024-04-18T14:44:17.538 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00024683499999999999 2024-04-18T14:44:17.538 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:17.538 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:17.538 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-04-18T14:44:17.538 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:11.411851+0000", 2024-04-18T14:44:17.538 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.018573638999999999 2024-04-18T14:44:17.538 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:44:17.538 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T14:44:17.538 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:44:17.538 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:17.539 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:17.539 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4559.0:710 3.2s0 3:42079eea:::smithi13430248-44:head [read 0~4620288,checksum] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e72)", 2024-04-18T14:44:17.539 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-04-18T14:44:11.388868+0000", 2024-04-18T14:44:17.539 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 6.0578850070000003, 2024-04-18T14:44:17.539 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.027186416000000001, 2024-04-18T14:44:17.539 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-04-18T14:44:17.539 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "started", 2024-04-18T14:44:17.539 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-04-18T14:44:17.539 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4559", 2024-04-18T14:44:17.539 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "172.21.15.134:0/3113589487", 2024-04-18T14:44:17.539 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 710 2024-04-18T14:44:17.539 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:17.539 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-04-18T14:44:17.539 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:17.540 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-04-18T14:44:17.540 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:11.388868+0000", 2024-04-18T14:44:17.540 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:44:17.540 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:17.540 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:17.540 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-04-18T14:44:17.540 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:11.388868+0000", 2024-04-18T14:44:17.540 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:44:17.540 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:17.540 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:17.540 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-04-18T14:44:17.540 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:11.388866+0000", 2024-04-18T14:44:17.540 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 4294967295.9999986 2024-04-18T14:44:17.540 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:17.540 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:17.541 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-04-18T14:44:17.541 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:11.388876+0000", 2024-04-18T14:44:17.541 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 9.9690000000000006e-06 2024-04-18T14:44:17.541 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:17.541 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:17.541 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-04-18T14:44:17.541 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:11.388891+0000", 2024-04-18T14:44:17.541 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.4663e-05 2024-04-18T14:44:17.541 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:17.541 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:17.541 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-04-18T14:44:17.541 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:11.388907+0000", 2024-04-18T14:44:17.541 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.575e-05 2024-04-18T14:44:17.541 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:17.542 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:17.542 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-04-18T14:44:17.542 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:11.389121+0000", 2024-04-18T14:44:17.542 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00021439899999999999 2024-04-18T14:44:17.542 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:17.542 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:17.542 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting_for_map not empty", 2024-04-18T14:44:17.542 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:11.389141+0000", 2024-04-18T14:44:17.542 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.0273000000000001e-05 2024-04-18T14:44:17.542 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:17.542 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:17.542 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-04-18T14:44:17.542 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:11.394165+0000", 2024-04-18T14:44:17.542 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0050239619999999999 2024-04-18T14:44:17.542 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:17.543 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:17.543 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-04-18T14:44:17.543 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:11.394408+0000", 2024-04-18T14:44:17.543 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00024312199999999999 2024-04-18T14:44:17.543 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:17.543 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:17.543 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-04-18T14:44:17.543 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:11.416054+0000", 2024-04-18T14:44:17.543 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.021645818000000001 2024-04-18T14:44:17.543 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:44:17.543 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T14:44:17.543 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:44:17.543 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:17.543 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:17.543 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4559.0:711 3.2s0 3:42079eea:::smithi13430248-44:head [read 0~4620288,checksum] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e72)", 2024-04-18T14:44:17.544 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-04-18T14:44:11.388928+0000", 2024-04-18T14:44:17.544 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 6.0578249260000003, 2024-04-18T14:44:17.544 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.030877597999999999, 2024-04-18T14:44:17.544 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-04-18T14:44:17.544 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "started", 2024-04-18T14:44:17.544 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-04-18T14:44:17.544 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4559", 2024-04-18T14:44:17.544 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "172.21.15.134:0/3113589487", 2024-04-18T14:44:17.544 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 711 2024-04-18T14:44:17.544 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:17.544 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-04-18T14:44:17.544 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:17.544 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-04-18T14:44:17.544 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:11.388928+0000", 2024-04-18T14:44:17.545 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:44:17.545 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:17.545 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:17.545 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-04-18T14:44:17.545 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:11.388928+0000", 2024-04-18T14:44:17.545 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:44:17.545 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:17.545 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:17.545 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-04-18T14:44:17.545 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:11.388927+0000", 2024-04-18T14:44:17.545 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 4294967295.9999986 2024-04-18T14:44:17.545 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:17.545 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:17.545 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-04-18T14:44:17.546 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:11.388935+0000", 2024-04-18T14:44:17.546 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 8.2330000000000006e-06 2024-04-18T14:44:17.546 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:17.546 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:17.546 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-04-18T14:44:17.546 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:11.388955+0000", 2024-04-18T14:44:17.546 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.9910000000000001e-05 2024-04-18T14:44:17.546 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:17.546 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:17.546 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-04-18T14:44:17.546 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:11.388970+0000", 2024-04-18T14:44:17.546 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.4986e-05 2024-04-18T14:44:17.546 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:17.546 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:17.547 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-04-18T14:44:17.547 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:11.389243+0000", 2024-04-18T14:44:17.547 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000272964 2024-04-18T14:44:17.547 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:17.547 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:17.547 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting_for_map not empty", 2024-04-18T14:44:17.547 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:11.389262+0000", 2024-04-18T14:44:17.547 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.9337000000000001e-05 2024-04-18T14:44:17.547 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:17.547 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:17.547 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-04-18T14:44:17.547 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:11.395125+0000", 2024-04-18T14:44:17.547 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0058632650000000003 2024-04-18T14:44:17.547 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:17.547 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:17.548 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-04-18T14:44:17.548 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:11.395390+0000", 2024-04-18T14:44:17.548 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00026478100000000001 2024-04-18T14:44:17.548 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:17.548 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:17.548 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-04-18T14:44:17.548 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:11.419806+0000", 2024-04-18T14:44:17.548 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.024415527999999999 2024-04-18T14:44:17.548 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:44:17.548 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T14:44:17.548 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:44:17.548 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:17.548 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:17.548 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4559.0:848 3.2s0 3:42079eea:::smithi13430248-44:head [read 0~6815744,checksum] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e77)", 2024-04-18T14:44:17.548 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-04-18T14:44:16.434969+0000", 2024-04-18T14:44:17.549 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 1.0117833869999999, 2024-04-18T14:44:17.549 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.024318681000000002, 2024-04-18T14:44:17.549 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-04-18T14:44:17.549 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "started", 2024-04-18T14:44:17.549 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-04-18T14:44:17.549 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4559", 2024-04-18T14:44:17.549 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "172.21.15.134:0/3113589487", 2024-04-18T14:44:17.549 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 848 2024-04-18T14:44:17.549 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:17.549 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-04-18T14:44:17.549 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:17.549 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-04-18T14:44:17.549 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:16.434969+0000", 2024-04-18T14:44:17.549 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:44:17.549 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:17.550 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:17.550 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-04-18T14:44:17.550 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:16.434969+0000", 2024-04-18T14:44:17.550 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:44:17.550 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:17.550 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:17.550 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-04-18T14:44:17.550 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:16.434968+0000", 2024-04-18T14:44:17.550 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 4294967295.9999981 2024-04-18T14:44:17.550 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:17.550 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:17.550 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-04-18T14:44:17.550 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:16.434980+0000", 2024-04-18T14:44:17.550 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.1736000000000001e-05 2024-04-18T14:44:17.551 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:17.551 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:17.551 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-04-18T14:44:17.551 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:16.435001+0000", 2024-04-18T14:44:17.551 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.107e-05 2024-04-18T14:44:17.551 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:17.551 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:17.551 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-04-18T14:44:17.551 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:16.435012+0000", 2024-04-18T14:44:17.551 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.1603000000000001e-05 2024-04-18T14:44:17.551 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:17.551 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:17.551 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-04-18T14:44:17.551 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:16.435514+0000", 2024-04-18T14:44:17.551 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00050183400000000005 2024-04-18T14:44:17.551 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:17.552 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:17.552 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-04-18T14:44:17.552 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:16.435650+0000", 2024-04-18T14:44:17.552 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00013549699999999999 2024-04-18T14:44:17.552 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:17.552 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:17.552 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-04-18T14:44:17.552 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:16.459288+0000", 2024-04-18T14:44:17.552 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.023638624 2024-04-18T14:44:17.552 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:44:17.552 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T14:44:17.552 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:44:17.552 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:17.552 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:17.552 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4559.0:849 3.2s0 3:42079eea:::smithi13430248-44:head [read 0~6815744,checksum] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e77)", 2024-04-18T14:44:17.552 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-04-18T14:44:16.435027+0000", 2024-04-18T14:44:17.553 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 1.011726275, 2024-04-18T14:44:17.553 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.029968542000000001, 2024-04-18T14:44:17.553 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-04-18T14:44:17.553 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "started", 2024-04-18T14:44:17.553 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-04-18T14:44:17.553 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4559", 2024-04-18T14:44:17.553 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "172.21.15.134:0/3113589487", 2024-04-18T14:44:17.553 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 849 2024-04-18T14:44:17.553 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:17.553 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-04-18T14:44:17.553 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:17.553 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-04-18T14:44:17.553 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:16.435027+0000", 2024-04-18T14:44:17.553 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:44:17.553 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:17.554 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:17.554 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-04-18T14:44:17.554 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:16.435027+0000", 2024-04-18T14:44:17.554 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:44:17.554 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:17.554 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:17.554 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-04-18T14:44:17.554 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:16.435025+0000", 2024-04-18T14:44:17.554 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 4294967295.9999986 2024-04-18T14:44:17.554 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:17.554 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:17.554 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-04-18T14:44:17.554 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:16.435039+0000", 2024-04-18T14:44:17.554 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.3910000000000001e-05 2024-04-18T14:44:17.554 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:17.554 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:17.555 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-04-18T14:44:17.555 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:16.435060+0000", 2024-04-18T14:44:17.555 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.1143000000000001e-05 2024-04-18T14:44:17.555 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:17.555 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:17.555 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-04-18T14:44:17.555 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:16.435068+0000", 2024-04-18T14:44:17.555 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 8.0029999999999994e-06 2024-04-18T14:44:17.555 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:17.555 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:17.555 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-04-18T14:44:17.555 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:16.435919+0000", 2024-04-18T14:44:17.555 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00085065 2024-04-18T14:44:17.555 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:17.555 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:17.555 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-04-18T14:44:17.556 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:16.435992+0000", 2024-04-18T14:44:17.556 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 7.3201000000000006e-05 2024-04-18T14:44:17.556 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:17.556 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:17.556 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-04-18T14:44:17.556 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:16.464995+0000", 2024-04-18T14:44:17.556 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.029002910999999999 2024-04-18T14:44:17.556 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:44:17.556 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T14:44:17.556 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:44:17.556 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:44:17.556 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T14:44:17.556 INFO:teuthology.orchestra.run.smithi096.stdout:} 2024-04-18T14:44:17.558 INFO:teuthology.orchestra.run.smithi086.stdout:osd.0: {} 2024-04-18T14:44:17.559 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-18T14:44:17.559 INFO:teuthology.orchestra.run.smithi086.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-18T14:44:17.560 INFO:tasks.ceph.osd.3.smithi134.stderr:2024-04-18T14:44:17.560+0000 7fe7a4443640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25211) UID: 0 2024-04-18T14:44:17.572 INFO:teuthology.orchestra.run.smithi086.stdout:osd.1: {} 2024-04-18T14:44:17.572 INFO:teuthology.orchestra.run.smithi086.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-18T14:44:17.590 INFO:teuthology.orchestra.run.smithi086.stdout:osd.2: {} 2024-04-18T14:44:17.590 INFO:teuthology.orchestra.run.smithi086.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-18T14:44:17.610 INFO:teuthology.orchestra.run.smithi086.stdout:osd.3: {} 2024-04-18T14:44:17.610 INFO:teuthology.orchestra.run.smithi086.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-18T14:44:17.627 INFO:teuthology.orchestra.run.smithi086.stdout:osd.4: {} 2024-04-18T14:44:17.628 INFO:teuthology.orchestra.run.smithi086.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-18T14:44:17.647 INFO:teuthology.orchestra.run.smithi086.stdout:osd.5: {} 2024-04-18T14:44:17.647 INFO:teuthology.orchestra.run.smithi086.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-18T14:44:17.658 INFO:tasks.ceph.osd.11.smithi134.stderr:2024-04-18T14:44:17.664+0000 7f2d36f12640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 11 (PID: 25216) UID: 0 2024-04-18T14:44:17.666 INFO:teuthology.orchestra.run.smithi086.stdout:osd.6: {} 2024-04-18T14:44:17.666 INFO:teuthology.orchestra.run.smithi086.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-18T14:44:17.685 INFO:teuthology.orchestra.run.smithi086.stdout:osd.7: {} 2024-04-18T14:44:17.686 INFO:teuthology.orchestra.run.smithi086.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-18T14:44:17.687 INFO:teuthology.orchestra.run.smithi119.stdout:ERROR: (22) Invalid argument 2024-04-18T14:44:17.687 INFO:teuthology.orchestra.run.smithi119.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T14:44:17.701 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-18T14:44:17.702 INFO:teuthology.orchestra.run.smithi086.stdout:osd.8: {} 2024-04-18T14:44:17.702 INFO:teuthology.orchestra.run.smithi086.stderr:osd.8: osd_enable_op_tracker = '' 2024-04-18T14:44:17.721 INFO:teuthology.orchestra.run.smithi086.stdout:osd.9: {} 2024-04-18T14:44:17.721 INFO:teuthology.orchestra.run.smithi086.stderr:osd.9: osd_enable_op_tracker = '' 2024-04-18T14:44:17.740 INFO:teuthology.orchestra.run.smithi086.stdout:osd.10: {} 2024-04-18T14:44:17.740 INFO:teuthology.orchestra.run.smithi086.stderr:osd.10: osd_enable_op_tracker = '' 2024-04-18T14:44:17.759 INFO:teuthology.orchestra.run.smithi086.stdout:osd.11: {} 2024-04-18T14:44:17.760 INFO:teuthology.orchestra.run.smithi086.stderr:osd.11: osd_enable_op_tracker = '' 2024-04-18T14:44:17.760 INFO:tasks.ceph.osd.0.smithi086.stderr:2024-04-18T14:44:17.757+0000 7f7cdfd78640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 24953) UID: 0 2024-04-18T14:44:17.775 INFO:teuthology.orchestra.run.smithi086.stdout:osd.12: {} 2024-04-18T14:44:17.775 INFO:teuthology.orchestra.run.smithi086.stderr:osd.12: osd_enable_op_tracker = '' 2024-04-18T14:44:17.795 INFO:teuthology.orchestra.run.smithi086.stdout:osd.13: {} 2024-04-18T14:44:17.795 INFO:teuthology.orchestra.run.smithi086.stderr:osd.13: osd_enable_op_tracker = '' 2024-04-18T14:44:17.812 INFO:teuthology.orchestra.run.smithi086.stdout:osd.14: {} 2024-04-18T14:44:17.812 INFO:teuthology.orchestra.run.smithi086.stderr:osd.14: osd_enable_op_tracker = '' 2024-04-18T14:44:17.815 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-18T14:44:17.813+0000 7f097d2c8640 0 -- 172.21.15.86:0/3438262772 >> [v2:172.21.15.134:6808/25223,v1:172.21.15.134:6812/25223] conn(0x7f097821e760 msgr2=0x7f0978220b70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-04-18T14:44:17.818 INFO:teuthology.orchestra.run.smithi119.stdout:ERROR: (22) Invalid argument 2024-04-18T14:44:17.819 INFO:teuthology.orchestra.run.smithi119.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T14:44:17.833 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-18T14:44:17.835 INFO:teuthology.orchestra.run.smithi086.stdout:osd.15: {} 2024-04-18T14:44:17.835 INFO:teuthology.orchestra.run.smithi086.stderr:osd.15: osd_enable_op_tracker = '' 2024-04-18T14:44:17.860 INFO:tasks.ceph.osd.7.smithi134.stderr:2024-04-18T14:44:17.864+0000 7fd7de549640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25213) UID: 0 2024-04-18T14:44:17.952 INFO:teuthology.orchestra.run.smithi119.stdout:ERROR: (22) Invalid argument 2024-04-18T14:44:17.953 INFO:teuthology.orchestra.run.smithi119.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T14:44:17.961 INFO:tasks.ceph.osd.5.smithi096.stderr:2024-04-18T14:44:17.961+0000 7fc33f25b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 24889) UID: 0 2024-04-18T14:44:17.966 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-04-18T14:44:18.063 INFO:tasks.ceph.osd.15.smithi134.stderr:2024-04-18T14:44:18.068+0000 7f08e6a51640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 15 (PID: 25218) UID: 0 2024-04-18T14:44:18.086 INFO:teuthology.orchestra.run.smithi119.stdout:ERROR: (22) Invalid argument 2024-04-18T14:44:18.086 INFO:teuthology.orchestra.run.smithi119.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T14:44:18.100 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-04-18T14:44:18.164 INFO:tasks.ceph.osd.14.smithi119.stderr:2024-04-18T14:44:18.166+0000 7f180f599640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 14 (PID: 24900) UID: 0 2024-04-18T14:44:18.216 INFO:teuthology.orchestra.run.smithi119.stdout:ERROR: (22) Invalid argument 2024-04-18T14:44:18.216 INFO:teuthology.orchestra.run.smithi119.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T14:44:18.230 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-04-18T14:44:18.265 INFO:tasks.ceph.osd.0.smithi086.stderr:2024-04-18T14:44:18.261+0000 7f7cdfd78640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 24953) UID: 0 2024-04-18T14:44:18.366 INFO:tasks.ceph.osd.15.smithi134.stderr:2024-04-18T14:44:18.368+0000 7f08e6a51640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 15 (PID: 25218) UID: 0 2024-04-18T14:44:18.394 INFO:teuthology.orchestra.run.smithi119.stdout:ERROR: (22) Invalid argument 2024-04-18T14:44:18.394 INFO:teuthology.orchestra.run.smithi119.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T14:44:18.408 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.10.asok dump_ops_in_flight 2024-04-18T14:44:18.424 INFO:teuthology.orchestra.run.smithi086.stderr:nodeep-scrub is set 2024-04-18T14:44:18.428 INFO:tasks.rados.rados.0.smithi134.stdout:333: done (8 left) 2024-04-18T14:44:18.429 INFO:tasks.rados.rados.0.smithi134.stdout:334: read oid 30 snap -1 2024-04-18T14:44:18.429 INFO:tasks.rados.rados.0.smithi134.stdout:334: expect (ObjNum 87 snap 17 seq_num 87) 2024-04-18T14:44:18.429 INFO:tasks.rados.rados.0.smithi134.stdout:append oid 29 current snap is 30 2024-04-18T14:44:18.429 INFO:tasks.rados.rados.0.smithi134.stdout:335: seq_num 132 ranges {0=671744,671744=573440,1245184=753664,1998848=229376} 2024-04-18T14:44:18.433 INFO:tasks.rados.rados.0.smithi134.stdout:335: writing smithi13430248-29 from 0 to 671744 tid 1 2024-04-18T14:44:18.438 INFO:tasks.rados.rados.0.smithi134.stdout:335: writing smithi13430248-29 from 671744 to 1245184 tid 2 2024-04-18T14:44:18.443 INFO:tasks.rados.rados.0.smithi134.stdout:335: writing smithi13430248-29 from 1245184 to 1998848 tid 3 2024-04-18T14:44:18.445 INFO:tasks.rados.rados.0.smithi134.stdout:335: writing smithi13430248-29 from 1998848 to 2228224 tid 4 2024-04-18T14:44:18.445 INFO:tasks.rados.rados.0.smithi134.stdout:336: copy_from oid 38 from oid 37 current snap is 30 2024-04-18T14:44:18.445 INFO:tasks.rados.rados.0.smithi134.stdout:326: finishing rollback tid 0 to smithi13430248-42 2024-04-18T14:44:18.445 INFO:tasks.rados.rados.0.smithi134.stdout:324: expect (ObjNum 122 snap 25 seq_num 122) 2024-04-18T14:44:18.468 INFO:tasks.ceph.osd.9.smithi096.stderr:2024-04-18T14:44:18.469+0000 7fa2c1cbf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 9 (PID: 24891) UID: 0 2024-04-18T14:44:18.525 INFO:tasks.rados.rados.0.smithi134.stdout:326: finishing rollback tid 1 to smithi13430248-42 2024-04-18T14:44:18.525 INFO:tasks.rados.rados.0.smithi134.stdout:326: finishing rollback tid 2 to smithi13430248-42 2024-04-18T14:44:18.525 INFO:tasks.rados.rados.0.smithi134.stdout:update_object_version oid 42 v 53 (ObjNum 161 snap 0 seq_num 1) dirty exists 2024-04-18T14:44:18.525 INFO:tasks.rados.rados.0.smithi134.stdout:328: finishing write tid 1 to smithi13430248-34 2024-04-18T14:44:18.525 INFO:tasks.rados.rados.0.smithi134.stdout:update_object_version oid 18 v 54 (ObjNum 44 snap 0 seq_num 44) dirty exists 2024-04-18T14:44:18.525 INFO:tasks.rados.rados.0.smithi134.stdout:328: finishing write tid 2 to smithi13430248-34 2024-04-18T14:44:18.525 INFO:tasks.rados.rados.0.smithi134.stdout:324: done (10 left) 2024-04-18T14:44:18.525 INFO:tasks.rados.rados.0.smithi134.stdout:326: done (9 left) 2024-04-18T14:44:18.525 INFO:tasks.rados.rados.0.smithi134.stdout:327: done (8 left) 2024-04-18T14:44:18.525 INFO:tasks.rados.rados.0.smithi134.stdout:337: snap_remove snap 22 2024-04-18T14:44:18.556 INFO:teuthology.orchestra.run.smithi119.stdout:ERROR: (22) Invalid argument 2024-04-18T14:44:18.556 INFO:teuthology.orchestra.run.smithi119.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T14:44:18.568 INFO:tasks.ceph.osd.5.smithi096.stderr:2024-04-18T14:44:18.569+0000 7fc33f25b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 24889) UID: 0 2024-04-18T14:44:18.570 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.10.asok dump_blocked_ops 2024-04-18T14:44:18.669 INFO:tasks.ceph.osd.5.smithi096.stderr:2024-04-18T14:44:18.669+0000 7fc33f25b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 24889) UID: 0 2024-04-18T14:44:18.687 INFO:teuthology.orchestra.run.smithi119.stdout:ERROR: (22) Invalid argument 2024-04-18T14:44:18.688 INFO:teuthology.orchestra.run.smithi119.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T14:44:18.702 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.10.asok dump_historic_ops 2024-04-18T14:44:18.770 INFO:tasks.ceph.osd.11.smithi134.stderr:2024-04-18T14:44:18.772+0000 7f2d36f12640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 11 (PID: 25216) UID: 0 2024-04-18T14:44:18.827 INFO:teuthology.orchestra.run.smithi119.stdout:ERROR: (22) Invalid argument 2024-04-18T14:44:18.827 INFO:teuthology.orchestra.run.smithi119.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T14:44:18.841 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.14.asok dump_ops_in_flight 2024-04-18T14:44:18.870 INFO:tasks.ceph.osd.15.smithi134.stderr:2024-04-18T14:44:18.876+0000 7f08e6a51640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 15 (PID: 25218) UID: 0 2024-04-18T14:44:18.962 INFO:teuthology.orchestra.run.smithi119.stdout:ERROR: (22) Invalid argument 2024-04-18T14:44:18.962 INFO:teuthology.orchestra.run.smithi119.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T14:44:18.971 INFO:tasks.ceph.osd.1.smithi096.stderr:2024-04-18T14:44:18.973+0000 7f56a7a98640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 24887) UID: 0 2024-04-18T14:44:18.977 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.14.asok dump_blocked_ops 2024-04-18T14:44:19.072 INFO:tasks.ceph.osd.11.smithi134.stderr:2024-04-18T14:44:19.076+0000 7f2d36f12640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 11 (PID: 25216) UID: 0 2024-04-18T14:44:19.093 INFO:teuthology.orchestra.run.smithi119.stdout:ERROR: (22) Invalid argument 2024-04-18T14:44:19.093 INFO:teuthology.orchestra.run.smithi119.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T14:44:19.109 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.14.asok dump_historic_ops 2024-04-18T14:44:19.173 INFO:tasks.ceph.osd.13.smithi096.stderr:2024-04-18T14:44:19.173+0000 7f7e72fad640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 13 (PID: 24893) UID: 0 2024-04-18T14:44:19.231 INFO:teuthology.orchestra.run.smithi119.stdout:ERROR: (22) Invalid argument 2024-04-18T14:44:19.231 INFO:teuthology.orchestra.run.smithi119.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T14:44:19.245 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-04-18T14:44:19.291 INFO:tasks.ceph.osd.7.smithi134.stderr:2024-04-18T14:44:19.296+0000 7fd7de549640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25213) UID: 0 2024-04-18T14:44:19.375 INFO:tasks.ceph.osd.12.smithi086.stderr:2024-04-18T14:44:19.373+0000 7f6904968640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 12 (PID: 24960) UID: 0 2024-04-18T14:44:19.376 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-04-18T14:44:19.376 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T14:44:19.389 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-04-18T14:44:19.435 INFO:tasks.rados.rados.0.smithi134.stdout:337: done (8 left) 2024-04-18T14:44:19.435 INFO:tasks.rados.rados.0.smithi134.stdout:append oid 49 current snap is 30 2024-04-18T14:44:19.435 INFO:tasks.rados.rados.0.smithi134.stdout:338: seq_num 133 ranges {819200=688128,1507328=720896,2228224=475136,2703360=360448} 2024-04-18T14:44:19.449 INFO:tasks.rados.rados.0.smithi134.stdout:338: writing smithi13430248-49 from 819200 to 1507328 tid 1 2024-04-18T14:44:19.454 INFO:tasks.rados.rados.0.smithi134.stdout:338: writing smithi13430248-49 from 1507328 to 2228224 tid 2 2024-04-18T14:44:19.457 INFO:tasks.rados.rados.0.smithi134.stdout:338: writing smithi13430248-49 from 2228224 to 2703360 tid 3 2024-04-18T14:44:19.460 INFO:tasks.rados.rados.0.smithi134.stdout:338: writing smithi13430248-49 from 2703360 to 3063808 tid 4 2024-04-18T14:44:19.460 INFO:tasks.rados.rados.0.smithi134.stdout:339: setattr oid 7 current snap is 30 2024-04-18T14:44:19.460 INFO:tasks.rados.rados.0.smithi134.stdout:330: finishing rollback tid 0 to smithi13430248-40 2024-04-18T14:44:19.460 INFO:tasks.rados.rados.0.smithi134.stdout:330: finishing rollback tid 1 to smithi13430248-40 2024-04-18T14:44:19.460 INFO:tasks.rados.rados.0.smithi134.stdout:328: finishing write tid 3 to smithi13430248-34 2024-04-18T14:44:19.460 INFO:tasks.rados.rados.0.smithi134.stdout:328: finishing write tid 4 to smithi13430248-34 2024-04-18T14:44:19.460 INFO:tasks.rados.rados.0.smithi134.stdout:328: finishing write tid 5 to smithi13430248-34 2024-04-18T14:44:19.460 INFO:tasks.rados.rados.0.smithi134.stdout:330: finishing rollback tid 2 to smithi13430248-40 2024-04-18T14:44:19.460 INFO:tasks.rados.rados.0.smithi134.stdout:update_object_version oid 40 v 111 (ObjNum 47 snap 0 seq_num 47) dirty exists 2024-04-18T14:44:19.460 INFO:tasks.rados.rados.0.smithi134.stdout:328: finishing write tid 6 to smithi13430248-34 2024-04-18T14:44:19.460 INFO:tasks.rados.rados.0.smithi134.stdout:328: oid 34 updating version 0 to 52 2024-04-18T14:44:19.461 INFO:tasks.rados.rados.0.smithi134.stdout:328: oid 34 version 52 is already newer than 51 2024-04-18T14:44:19.461 INFO:tasks.rados.rados.0.smithi134.stdout:328: oid 34 updating version 52 to 54 2024-04-18T14:44:19.461 INFO:tasks.rados.rados.0.smithi134.stdout:328: oid 34 version 54 is already newer than 53 2024-04-18T14:44:19.461 INFO:tasks.rados.rados.0.smithi134.stdout:328: oid 34 version 54 is already newer than 50 2024-04-18T14:44:19.461 INFO:tasks.rados.rados.0.smithi134.stdout:update_object_version oid 34 v 54 (ObjNum 131 snap 30 seq_num 131) dirty exists 2024-04-18T14:44:19.461 INFO:tasks.rados.rados.0.smithi134.stdout:328: left oid 34 (ObjNum 131 snap 30 seq_num 131) 2024-04-18T14:44:19.461 INFO:tasks.rados.rados.0.smithi134.stdout:329: expect (ObjNum 123 snap 25 seq_num 123) 2024-04-18T14:44:19.476 INFO:tasks.ceph.osd.9.smithi096.stderr:2024-04-18T14:44:19.477+0000 7fa2c1cbf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 9 (PID: 24891) UID: 0 2024-04-18T14:44:19.555 INFO:tasks.rados.rados.0.smithi134.stdout:325: finishing copy_from racing read to smithi13430248-24 2024-04-18T14:44:19.555 INFO:tasks.rados.rados.0.smithi134.stdout:325: finishing copy_from to smithi13430248-24 2024-04-18T14:44:19.555 INFO:tasks.rados.rados.0.smithi134.stdout:update_object_version oid 24 v 81 (ObjNum 111 snap 23 seq_num 111) dirty exists 2024-04-18T14:44:19.555 INFO:tasks.rados.rados.0.smithi134.stdout:331: expect (ObjNum 130 snap 29 seq_num 130) 2024-04-18T14:44:19.573 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-04-18T14:44:19.573 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T14:44:19.578 INFO:tasks.ceph.osd.5.smithi096.stderr:2024-04-18T14:44:19.577+0000 7fc33f25b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 24889) UID: 0 2024-04-18T14:44:19.587 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-04-18T14:44:19.678 INFO:tasks.ceph.osd.13.smithi096.stderr:2024-04-18T14:44:19.677+0000 7f7e72fad640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 13 (PID: 24893) UID: 0 2024-04-18T14:44:19.755 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-04-18T14:44:19.755 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T14:44:19.769 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-04-18T14:44:19.814 INFO:tasks.ceph.osd.15.smithi134.stderr:2024-04-18T14:44:19.820+0000 7f08e6a51640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 15 (PID: 25218) UID: 0 2024-04-18T14:44:19.854 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-18T14:44:19.890 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-04-18T14:44:19.890 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T14:44:19.899 INFO:tasks.ceph.osd.4.smithi086.stderr:2024-04-18T14:44:19.897+0000 7f0c4c462640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 24956) UID: 0 2024-04-18T14:44:19.901 INFO:tasks.rados.rados.0.smithi134.stdout:335: finishing write tid 1 to smithi13430248-29 2024-04-18T14:44:19.901 INFO:tasks.rados.rados.0.smithi134.stdout:335: finishing write tid 2 to smithi13430248-29 2024-04-18T14:44:19.901 INFO:tasks.rados.rados.0.smithi134.stdout:335: finishing write tid 3 to smithi13430248-29 2024-04-18T14:44:19.901 INFO:tasks.rados.rados.0.smithi134.stdout:335: finishing write tid 4 to smithi13430248-29 2024-04-18T14:44:19.901 INFO:tasks.rados.rados.0.smithi134.stdout:335: finishing write tid 5 to smithi13430248-29 2024-04-18T14:44:19.901 INFO:tasks.rados.rados.0.smithi134.stdout:334: expect (ObjNum 87 snap 17 seq_num 87) 2024-04-18T14:44:19.905 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-04-18T14:44:19.968 INFO:tasks.rados.rados.0.smithi134.stdout:335: finishing write tid 6 to smithi13430248-29 2024-04-18T14:44:19.968 INFO:tasks.rados.rados.0.smithi134.stdout:335: oid 29 updating version 0 to 57 2024-04-18T14:44:19.969 INFO:tasks.rados.rados.0.smithi134.stdout:335: oid 29 updating version 57 to 58 2024-04-18T14:44:19.969 INFO:tasks.rados.rados.0.smithi134.stdout:335: oid 29 updating version 58 to 59 2024-04-18T14:44:19.969 INFO:tasks.rados.rados.0.smithi134.stdout:335: oid 29 version 59 is already newer than 55 2024-04-18T14:44:19.969 INFO:tasks.rados.rados.0.smithi134.stdout:335: oid 29 version 59 is already newer than 56 2024-04-18T14:44:19.969 INFO:tasks.rados.rados.0.smithi134.stdout:update_object_version oid 29 v 59 (ObjNum 132 snap 30 seq_num 132) dirty exists 2024-04-18T14:44:19.969 INFO:tasks.rados.rados.0.smithi134.stdout:335: left oid 29 (ObjNum 132 snap 30 seq_num 132) 2024-04-18T14:44:19.970 INFO:tasks.rados.rados.0.smithi134.stdout:336: finishing copy_from racing read to smithi13430248-38 2024-04-18T14:44:19.971 INFO:tasks.rados.rados.0.smithi134.stdout:336: finishing copy_from to smithi13430248-38 2024-04-18T14:44:19.971 INFO:tasks.rados.rados.0.smithi134.stdout:update_object_version oid 38 v 32 (ObjNum 75 snap 15 seq_num 75) dirty exists 2024-04-18T14:44:19.971 INFO:tasks.rados.rados.0.smithi134.stdout:338: finishing write tid 1 to smithi13430248-49 2024-04-18T14:44:19.971 INFO:tasks.rados.rados.0.smithi134.stdout:338: finishing write tid 2 to smithi13430248-49 2024-04-18T14:44:19.971 INFO:tasks.rados.rados.0.smithi134.stdout:338: finishing write tid 3 to smithi13430248-49 2024-04-18T14:44:19.972 INFO:tasks.rados.rados.0.smithi134.stdout:338: finishing write tid 4 to smithi13430248-49 2024-04-18T14:44:19.972 INFO:tasks.rados.rados.0.smithi134.stdout:338: finishing write tid 5 to smithi13430248-49 2024-04-18T14:44:19.972 INFO:tasks.rados.rados.0.smithi134.stdout:338: finishing write tid 6 to smithi13430248-49 2024-04-18T14:44:19.973 INFO:tasks.rados.rados.0.smithi134.stdout:338: oid 49 updating version 0 to 104 2024-04-18T14:44:19.973 INFO:tasks.rados.rados.0.smithi134.stdout:338: oid 49 updating version 104 to 105 2024-04-18T14:44:19.973 INFO:tasks.rados.rados.0.smithi134.stdout:338: oid 49 updating version 105 to 106 2024-04-18T14:44:19.973 INFO:tasks.rados.rados.0.smithi134.stdout:338: oid 49 updating version 106 to 108 2024-04-18T14:44:19.973 INFO:tasks.rados.rados.0.smithi134.stdout:338: oid 49 version 108 is already newer than 107 2024-04-18T14:44:19.973 INFO:tasks.rados.rados.0.smithi134.stdout:update_object_version oid 49 v 108 (ObjNum 133 snap 30 seq_num 133) dirty exists 2024-04-18T14:44:19.974 INFO:tasks.rados.rados.0.smithi134.stdout:338: left oid 49 (ObjNum 133 snap 30 seq_num 133) 2024-04-18T14:44:19.974 INFO:tasks.rados.rados.0.smithi134.stdout:update_object_version oid 7 v 168 (ObjNum 129 snap 0 seq_num 2055181280) dirty exists 2024-04-18T14:44:19.974 INFO:tasks.rados.rados.0.smithi134.stdout:325: done (9 left) 2024-04-18T14:44:19.974 INFO:tasks.rados.rados.0.smithi134.stdout:328: done (8 left) 2024-04-18T14:44:19.974 INFO:tasks.rados.rados.0.smithi134.stdout:329: done (7 left) 2024-04-18T14:44:19.974 INFO:tasks.rados.rados.0.smithi134.stdout:330: done (6 left) 2024-04-18T14:44:19.975 INFO:tasks.rados.rados.0.smithi134.stdout:331: done (5 left) 2024-04-18T14:44:19.975 INFO:tasks.rados.rados.0.smithi134.stdout:334: done (4 left) 2024-04-18T14:44:19.975 INFO:tasks.rados.rados.0.smithi134.stdout:335: done (3 left) 2024-04-18T14:44:19.975 INFO:tasks.rados.rados.0.smithi134.stdout:336: done (2 left) 2024-04-18T14:44:19.975 INFO:tasks.rados.rados.0.smithi134.stdout:338: done (1 left) 2024-04-18T14:44:19.975 INFO:tasks.rados.rados.0.smithi134.stdout:339: done (0 left) 2024-04-18T14:44:19.976 INFO:tasks.rados.rados.0.smithi134.stdout:340: copy_from oid 43 from oid 3 current snap is 30 2024-04-18T14:44:19.976 INFO:tasks.rados.rados.0.smithi134.stdout:341: read oid 47 snap 13 2024-04-18T14:44:19.976 INFO:tasks.rados.rados.0.smithi134.stdout:341: expect (ObjNum 46 snap 0 seq_num 46) 2024-04-18T14:44:19.976 INFO:tasks.rados.rados.0.smithi134.stdout:append oid 13 current snap is 30 2024-04-18T14:44:19.977 INFO:tasks.rados.rados.0.smithi134.stdout:342: seq_num 134 ranges {2621440=704512,3325952=475136,3801088=573440,4374528=507904} 2024-04-18T14:44:19.981 INFO:tasks.ceph.osd.14.smithi119.stderr:2024-04-18T14:44:19.982+0000 7f180f599640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 14 (PID: 24900) UID: 0 2024-04-18T14:44:19.990 INFO:tasks.rados.rados.0.smithi134.stdout:342: writing smithi13430248-13 from 2621440 to 3325952 tid 1 2024-04-18T14:44:19.993 INFO:tasks.rados.rados.0.smithi134.stdout:342: writing smithi13430248-13 from 3325952 to 3801088 tid 2 2024-04-18T14:44:19.997 INFO:tasks.rados.rados.0.smithi134.stdout:342: writing smithi13430248-13 from 3801088 to 4374528 tid 3 2024-04-18T14:44:20.002 INFO:tasks.rados.rados.0.smithi134.stdout:342: writing smithi13430248-13 from 4374528 to 4882432 tid 4 2024-04-18T14:44:20.002 INFO:tasks.rados.rados.0.smithi134.stdout:343: snap_create 2024-04-18T14:44:20.003 INFO:tasks.rados.rados.0.smithi134.stdout:341: expect (ObjNum 46 snap 0 seq_num 46) 2024-04-18T14:44:20.016 INFO:teuthology.orchestra.run.smithi086.stdout:osd.0: {} 2024-04-18T14:44:20.016 INFO:teuthology.orchestra.run.smithi086.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-18T14:44:20.023 INFO:tasks.rados.rados.0.smithi134.stdout:340: finishing copy_from racing read to smithi13430248-43 2024-04-18T14:44:20.023 INFO:tasks.rados.rados.0.smithi134.stdout:340: finishing copy_from to smithi13430248-43 2024-04-18T14:44:20.023 INFO:tasks.rados.rados.0.smithi134.stdout:update_object_version oid 43 v 32 (ObjNum 75 snap 15 seq_num 75) dirty exists 2024-04-18T14:44:20.023 INFO:tasks.rados.rados.0.smithi134.stdout:342: finishing write tid 1 to smithi13430248-13 2024-04-18T14:44:20.023 INFO:tasks.rados.rados.0.smithi134.stdout:342: finishing write tid 2 to smithi13430248-13 2024-04-18T14:44:20.023 INFO:tasks.rados.rados.0.smithi134.stdout:342: finishing write tid 3 to smithi13430248-13 2024-04-18T14:44:20.024 INFO:tasks.rados.rados.0.smithi134.stdout:342: finishing write tid 4 to smithi13430248-13 2024-04-18T14:44:20.024 INFO:tasks.rados.rados.0.smithi134.stdout:342: finishing write tid 5 to smithi13430248-13 2024-04-18T14:44:20.024 INFO:tasks.rados.rados.0.smithi134.stdout:342: finishing write tid 6 to smithi13430248-13 2024-04-18T14:44:20.024 INFO:tasks.rados.rados.0.smithi134.stdout:342: oid 13 updating version 0 to 137 2024-04-18T14:44:20.024 INFO:tasks.rados.rados.0.smithi134.stdout:342: oid 13 version 137 is already newer than 135 2024-04-18T14:44:20.024 INFO:tasks.rados.rados.0.smithi134.stdout:342: oid 13 version 137 is already newer than 136 2024-04-18T14:44:20.024 INFO:tasks.rados.rados.0.smithi134.stdout:342: oid 13 version 137 is already newer than 134 2024-04-18T14:44:20.024 INFO:tasks.rados.rados.0.smithi134.stdout:342: oid 13 version 137 is already newer than 133 2024-04-18T14:44:20.024 INFO:tasks.rados.rados.0.smithi134.stdout:update_object_version oid 13 v 137 (ObjNum 134 snap 30 seq_num 134) dirty exists 2024-04-18T14:44:20.024 INFO:tasks.rados.rados.0.smithi134.stdout:342: left oid 13 (ObjNum 134 snap 30 seq_num 134) 2024-04-18T14:44:20.035 INFO:teuthology.orchestra.run.smithi086.stdout:osd.1: {} 2024-04-18T14:44:20.035 INFO:teuthology.orchestra.run.smithi086.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-18T14:44:20.054 INFO:teuthology.orchestra.run.smithi086.stdout:osd.2: {} 2024-04-18T14:44:20.055 INFO:teuthology.orchestra.run.smithi086.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-18T14:44:20.074 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-04-18T14:44:20.074 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T14:44:20.075 INFO:teuthology.orchestra.run.smithi086.stdout:osd.3: {} 2024-04-18T14:44:20.075 INFO:teuthology.orchestra.run.smithi086.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-18T14:44:20.081 INFO:tasks.ceph.osd.3.smithi134.stderr:2024-04-18T14:44:20.084+0000 7fe7a4443640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25211) UID: 0 2024-04-18T14:44:20.087 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-04-18T14:44:20.095 INFO:teuthology.orchestra.run.smithi086.stdout:osd.4: {} 2024-04-18T14:44:20.095 INFO:teuthology.orchestra.run.smithi086.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-18T14:44:20.117 INFO:teuthology.orchestra.run.smithi086.stdout:osd.5: {} 2024-04-18T14:44:20.117 INFO:teuthology.orchestra.run.smithi086.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-18T14:44:20.138 INFO:teuthology.orchestra.run.smithi086.stdout:osd.6: {} 2024-04-18T14:44:20.138 INFO:teuthology.orchestra.run.smithi086.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-18T14:44:20.158 INFO:teuthology.orchestra.run.smithi086.stdout:osd.7: {} 2024-04-18T14:44:20.159 INFO:teuthology.orchestra.run.smithi086.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-18T14:44:20.177 INFO:teuthology.orchestra.run.smithi086.stdout:osd.8: {} 2024-04-18T14:44:20.178 INFO:teuthology.orchestra.run.smithi086.stderr:osd.8: osd_enable_op_tracker = '' 2024-04-18T14:44:20.182 INFO:tasks.ceph.osd.1.smithi096.stderr:2024-04-18T14:44:20.181+0000 7f56a7a98640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 24887) UID: 0 2024-04-18T14:44:20.199 INFO:teuthology.orchestra.run.smithi086.stdout:osd.9: {} 2024-04-18T14:44:20.199 INFO:teuthology.orchestra.run.smithi086.stderr:osd.9: osd_enable_op_tracker = '' 2024-04-18T14:44:20.220 INFO:teuthology.orchestra.run.smithi086.stdout:osd.10: {} 2024-04-18T14:44:20.221 INFO:teuthology.orchestra.run.smithi086.stderr:osd.10: osd_enable_op_tracker = '' 2024-04-18T14:44:20.239 INFO:teuthology.orchestra.run.smithi086.stdout:osd.11: {} 2024-04-18T14:44:20.240 INFO:teuthology.orchestra.run.smithi086.stderr:osd.11: osd_enable_op_tracker = '' 2024-04-18T14:44:20.250 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-04-18T14:44:20.250 INFO:teuthology.orchestra.run.smithi134.stdout: "size": 20, 2024-04-18T14:44:20.250 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 600, 2024-04-18T14:44:20.250 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [ 2024-04-18T14:44:20.250 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:20.250 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "MOSDECSubOpWrite(3.5s4 46/30 ECSubWrite(tid=14, reqid=osd.15.0:13, at_version=0'0, trim_to=0'0, roll_forward_to=46'12))", 2024-04-18T14:44:20.250 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T14:43:45.391429+0000", 2024-04-18T14:44:20.250 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 34.862226896000003, 2024-04-18T14:44:20.250 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.010693606, 2024-04-18T14:44:20.251 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T14:44:20.251 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-04-18T14:44:20.251 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T14:44:20.251 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:20.251 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T14:44:20.251 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:45.391429+0000", 2024-04-18T14:44:20.251 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:44:20.251 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:20.251 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:20.251 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T14:44:20.251 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:45.391429+0000", 2024-04-18T14:44:20.251 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:44:20.251 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:20.251 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:20.251 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T14:44:20.252 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:45.391427+0000", 2024-04-18T14:44:20.252 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999981 2024-04-18T14:44:20.252 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:20.252 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:20.252 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T14:44:20.252 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:45.391458+0000", 2024-04-18T14:44:20.252 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.04e-05 2024-04-18T14:44:20.252 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:20.252 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:20.252 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T14:44:20.252 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:45.391489+0000", 2024-04-18T14:44:20.252 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.1424000000000003e-05 2024-04-18T14:44:20.252 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:20.252 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:20.252 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T14:44:20.253 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:45.391514+0000", 2024-04-18T14:44:20.253 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.4740999999999999e-05 2024-04-18T14:44:20.253 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:20.253 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:20.253 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T14:44:20.254 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:45.392451+0000", 2024-04-18T14:44:20.254 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000937227 2024-04-18T14:44:20.254 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:20.254 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:20.254 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_started", 2024-04-18T14:44:20.254 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:45.392476+0000", 2024-04-18T14:44:20.254 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.4797e-05 2024-04-18T14:44:20.254 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:20.254 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:20.254 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_committed", 2024-04-18T14:44:20.255 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:45.402059+0000", 2024-04-18T14:44:20.255 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0095835150000000008 2024-04-18T14:44:20.255 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:20.255 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:20.255 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T14:44:20.255 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:45.402123+0000", 2024-04-18T14:44:20.255 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.3307999999999998e-05 2024-04-18T14:44:20.255 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:44:20.255 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T14:44:20.255 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:44:20.255 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:20.255 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:20.255 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4559.0:495 3.ds0 3:be45a49b:::smithi13430248-50:head [copy-from ver 48] snapc 19=[19,16,14,13,11,f,b,a,7,2] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-18T14:44:20.255 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T14:43:56.541633+0000", 2024-04-18T14:44:20.255 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 23.712023439999999, 2024-04-18T14:44:20.255 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.020360488999999999, 2024-04-18T14:44:20.256 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T14:44:20.256 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T14:44:20.256 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-18T14:44:20.256 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4559", 2024-04-18T14:44:20.256 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/3113589487", 2024-04-18T14:44:20.256 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 495 2024-04-18T14:44:20.256 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:20.256 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T14:44:20.256 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:20.256 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T14:44:20.256 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:56.541633+0000", 2024-04-18T14:44:20.256 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:44:20.256 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:20.256 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:20.256 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T14:44:20.257 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:56.541633+0000", 2024-04-18T14:44:20.257 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:44:20.257 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:20.257 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:20.257 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T14:44:20.257 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:56.541631+0000", 2024-04-18T14:44:20.257 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999981 2024-04-18T14:44:20.257 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:20.257 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:20.257 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T14:44:20.257 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:56.541641+0000", 2024-04-18T14:44:20.257 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0414999999999999e-05 2024-04-18T14:44:20.257 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:20.257 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:20.257 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T14:44:20.258 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:56.541658+0000", 2024-04-18T14:44:20.258 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6626e-05 2024-04-18T14:44:20.258 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:20.258 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:20.258 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T14:44:20.258 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:56.541670+0000", 2024-04-18T14:44:20.258 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2354000000000001e-05 2024-04-18T14:44:20.258 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:20.258 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:20.258 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T14:44:20.258 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:56.541716+0000", 2024-04-18T14:44:20.258 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.5736999999999999e-05 2024-04-18T14:44:20.258 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:20.258 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:20.259 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T14:44:20.259 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:56.541792+0000", 2024-04-18T14:44:20.259 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.6038999999999995e-05 2024-04-18T14:44:20.259 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:20.259 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:20.259 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_started", 2024-04-18T14:44:20.259 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:56.551821+0000", 2024-04-18T14:44:20.259 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.010029222000000001 2024-04-18T14:44:20.259 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:20.259 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:20.259 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_committed", 2024-04-18T14:44:20.259 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:56.555036+0000", 2024-04-18T14:44:20.259 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0032150519999999999 2024-04-18T14:44:20.260 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:20.260 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:20.260 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T14:44:20.260 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:56.561911+0000", 2024-04-18T14:44:20.260 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.006874425 2024-04-18T14:44:20.260 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:20.260 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:20.260 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T14:44:20.260 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:56.561993+0000", 2024-04-18T14:44:20.260 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.2414000000000001e-05 2024-04-18T14:44:20.260 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:44:20.261 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T14:44:20.261 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:44:20.261 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:20.261 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:20.261 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4559.0:496 3.ds0 3:be45a49b:::smithi13430248-50:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e57)", 2024-04-18T14:44:20.261 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T14:43:56.541687+0000", 2024-04-18T14:44:20.261 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 23.711969510999999, 2024-04-18T14:44:20.261 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.013225494000000001, 2024-04-18T14:44:20.261 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T14:44:20.261 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-04-18T14:44:20.261 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-18T14:44:20.262 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4559", 2024-04-18T14:44:20.262 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/3113589487", 2024-04-18T14:44:20.262 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 496 2024-04-18T14:44:20.262 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:20.262 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T14:44:20.262 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:20.262 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T14:44:20.263 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:56.541687+0000", 2024-04-18T14:44:20.263 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:44:20.264 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:20.264 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:20.264 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T14:44:20.264 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:56.541687+0000", 2024-04-18T14:44:20.264 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:44:20.264 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:20.264 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:20.264 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T14:44:20.264 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:56.541686+0000", 2024-04-18T14:44:20.264 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-04-18T14:44:20.264 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:20.264 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:20.264 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T14:44:20.264 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:56.541691+0000", 2024-04-18T14:44:20.264 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.6879999999999998e-06 2024-04-18T14:44:20.265 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:20.265 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:20.265 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T14:44:20.265 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:56.541700+0000", 2024-04-18T14:44:20.265 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.5999999999999996e-06 2024-04-18T14:44:20.265 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:20.265 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:20.265 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T14:44:20.265 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:56.541708+0000", 2024-04-18T14:44:20.265 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.3490000000000003e-06 2024-04-18T14:44:20.265 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:20.265 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:20.265 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T14:44:20.265 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:56.541934+0000", 2024-04-18T14:44:20.265 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00022686399999999999 2024-04-18T14:44:20.266 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:20.266 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:20.266 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for blocked object", 2024-04-18T14:44:20.266 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:56.541985+0000", 2024-04-18T14:44:20.266 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.0426000000000001e-05 2024-04-18T14:44:20.266 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:20.266 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:20.266 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T14:44:20.266 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:56.554624+0000", 2024-04-18T14:44:20.266 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.012639091999999999 2024-04-18T14:44:20.266 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:20.266 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:20.266 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T14:44:20.266 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:56.554762+0000", 2024-04-18T14:44:20.267 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00013839000000000001 2024-04-18T14:44:20.267 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:20.267 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:20.267 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T14:44:20.267 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:56.554912+0000", 2024-04-18T14:44:20.267 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00014976200000000001 2024-04-18T14:44:20.267 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:44:20.267 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T14:44:20.267 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:44:20.267 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:20.267 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:20.267 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4559.0:619 3.ds0 3:b48f58f5:::smithi13430248-34:head [read 0~557056,checksum,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e66)", 2024-04-18T14:44:20.267 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T14:44:05.386939+0000", 2024-04-18T14:44:20.268 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 14.866716910999999, 2024-04-18T14:44:20.268 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.011158332999999999, 2024-04-18T14:44:20.268 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T14:44:20.268 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-04-18T14:44:20.268 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-18T14:44:20.268 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4559", 2024-04-18T14:44:20.268 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/3113589487", 2024-04-18T14:44:20.268 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 619 2024-04-18T14:44:20.268 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:20.268 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T14:44:20.268 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:20.268 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T14:44:20.268 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:05.386939+0000", 2024-04-18T14:44:20.268 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:44:20.269 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:20.269 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:20.269 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T14:44:20.270 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:05.386939+0000", 2024-04-18T14:44:20.270 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:44:20.270 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:20.270 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:20.270 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T14:44:20.270 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:05.386936+0000", 2024-04-18T14:44:20.270 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999967 2024-04-18T14:44:20.270 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:20.270 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:20.270 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T14:44:20.270 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:05.386953+0000", 2024-04-18T14:44:20.270 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.7606999999999999e-05 2024-04-18T14:44:20.271 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:20.271 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:20.271 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T14:44:20.271 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:05.386996+0000", 2024-04-18T14:44:20.271 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.2599999999999999e-05 2024-04-18T14:44:20.271 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:20.271 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:20.271 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T14:44:20.271 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:05.387014+0000", 2024-04-18T14:44:20.271 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8583000000000001e-05 2024-04-18T14:44:20.271 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:20.271 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:20.271 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T14:44:20.271 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:05.387138+0000", 2024-04-18T14:44:20.272 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000123075 2024-04-18T14:44:20.272 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:20.272 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:20.272 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op must wait for map", 2024-04-18T14:44:20.272 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:05.387150+0000", 2024-04-18T14:44:20.272 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2442999999999999e-05 2024-04-18T14:44:20.272 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:20.272 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:20.272 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T14:44:20.272 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:05.391814+0000", 2024-04-18T14:44:20.272 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0046638039999999997 2024-04-18T14:44:20.272 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:20.272 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:20.272 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T14:44:20.273 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:05.392076+0000", 2024-04-18T14:44:20.273 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000261971 2024-04-18T14:44:20.273 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:20.273 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:20.273 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T14:44:20.273 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:05.398097+0000", 2024-04-18T14:44:20.273 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.006021747 2024-04-18T14:44:20.273 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:44:20.273 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T14:44:20.273 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:44:20.273 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:20.273 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:20.273 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4559.0:620 3.ds0 3:b48f58f5:::smithi13430248-34:head [read 0~557056,checksum] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e66)", 2024-04-18T14:44:20.273 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T14:44:05.387040+0000", 2024-04-18T14:44:20.274 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 14.866616442, 2024-04-18T14:44:20.274 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.011816439999999999, 2024-04-18T14:44:20.274 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T14:44:20.274 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-04-18T14:44:20.274 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-18T14:44:20.274 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4559", 2024-04-18T14:44:20.274 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/3113589487", 2024-04-18T14:44:20.274 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 620 2024-04-18T14:44:20.274 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:20.274 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T14:44:20.274 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:20.274 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T14:44:20.274 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:05.387040+0000", 2024-04-18T14:44:20.274 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:44:20.275 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:20.275 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:20.275 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T14:44:20.275 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:05.387040+0000", 2024-04-18T14:44:20.275 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:44:20.275 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:20.275 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:20.275 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T14:44:20.275 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:05.387039+0000", 2024-04-18T14:44:20.275 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-18T14:44:20.275 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:20.275 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:20.275 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T14:44:20.275 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:05.387045+0000", 2024-04-18T14:44:20.275 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.5760000000000002e-06 2024-04-18T14:44:20.276 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:20.276 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:20.276 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T14:44:20.276 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:05.387057+0000", 2024-04-18T14:44:20.276 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1714e-05 2024-04-18T14:44:20.276 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:20.276 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:20.276 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T14:44:20.276 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:05.387065+0000", 2024-04-18T14:44:20.276 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.7800000000000001e-06 2024-04-18T14:44:20.276 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:20.276 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:20.276 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T14:44:20.276 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:05.387302+0000", 2024-04-18T14:44:20.277 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00023728399999999999 2024-04-18T14:44:20.277 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:20.277 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:20.277 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting_for_map not empty", 2024-04-18T14:44:20.277 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:05.387323+0000", 2024-04-18T14:44:20.277 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.1330000000000001e-05 2024-04-18T14:44:20.277 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:20.277 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:20.277 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T14:44:20.277 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:05.393386+0000", 2024-04-18T14:44:20.277 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0060623500000000002 2024-04-18T14:44:20.277 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:20.277 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:20.277 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T14:44:20.278 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:05.393566+0000", 2024-04-18T14:44:20.278 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000180135 2024-04-18T14:44:20.278 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:20.278 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:20.278 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T14:44:20.278 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:05.398856+0000", 2024-04-18T14:44:20.278 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.005290271 2024-04-18T14:44:20.278 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:44:20.278 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T14:44:20.278 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:44:20.278 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:20.278 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:20.278 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4559.0:621 3.ds0 3:b48f58f5:::smithi13430248-34:head [read 0~557056,checksum] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e66)", 2024-04-18T14:44:20.278 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T14:44:05.387116+0000", 2024-04-18T14:44:20.278 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 14.866539685999999, 2024-04-18T14:44:20.279 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.012593152, 2024-04-18T14:44:20.279 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T14:44:20.279 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-04-18T14:44:20.279 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-18T14:44:20.279 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4559", 2024-04-18T14:44:20.279 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/3113589487", 2024-04-18T14:44:20.279 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 621 2024-04-18T14:44:20.279 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:20.279 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T14:44:20.279 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:20.279 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T14:44:20.279 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:05.387116+0000", 2024-04-18T14:44:20.279 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:44:20.279 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:20.279 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:20.280 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T14:44:20.280 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:05.387116+0000", 2024-04-18T14:44:20.280 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:44:20.280 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:20.280 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:20.280 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T14:44:20.280 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:05.387116+0000", 2024-04-18T14:44:20.280 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-18T14:44:20.280 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:20.280 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:20.280 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T14:44:20.280 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:05.387121+0000", 2024-04-18T14:44:20.280 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.0560000000000004e-06 2024-04-18T14:44:20.280 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:20.280 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:20.281 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T14:44:20.281 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:05.387131+0000", 2024-04-18T14:44:20.281 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0573e-05 2024-04-18T14:44:20.281 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:20.281 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:20.281 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T14:44:20.281 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:05.387139+0000", 2024-04-18T14:44:20.281 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.8539999999999997e-06 2024-04-18T14:44:20.281 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:20.281 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:20.281 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T14:44:20.281 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:05.387377+0000", 2024-04-18T14:44:20.281 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00023790500000000001 2024-04-18T14:44:20.281 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:20.282 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:20.282 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting_for_map not empty", 2024-04-18T14:44:20.282 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:05.387387+0000", 2024-04-18T14:44:20.282 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.7489999999999993e-06 2024-04-18T14:44:20.282 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:20.282 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:20.282 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T14:44:20.282 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:05.394286+0000", 2024-04-18T14:44:20.282 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0068987500000000004 2024-04-18T14:44:20.282 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:20.282 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:20.282 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T14:44:20.282 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:05.394424+0000", 2024-04-18T14:44:20.282 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000138629 2024-04-18T14:44:20.283 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:20.283 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:20.283 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T14:44:20.283 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:05.399710+0000", 2024-04-18T14:44:20.283 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0052853919999999999 2024-04-18T14:44:20.283 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:44:20.283 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T14:44:20.283 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:44:20.283 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:20.283 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:20.283 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4559.0:835 3.ds0 3:b48f58f5:::smithi13430248-34:head [append 0~655360] snapc 2c=[2c,2b,2a,29,28,27,26,23,22,1e,1c,1a,16,14,13,11,2] ondisk+write+known_if_redirected+supports_pool_eio e77)", 2024-04-18T14:44:20.283 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T14:44:16.426808+0000", 2024-04-18T14:44:20.283 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 3.8268476580000002, 2024-04-18T14:44:20.283 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.025524121, 2024-04-18T14:44:20.283 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T14:44:20.284 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T14:44:20.284 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-18T14:44:20.284 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4559", 2024-04-18T14:44:20.284 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/3113589487", 2024-04-18T14:44:20.284 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 835 2024-04-18T14:44:20.284 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:20.284 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T14:44:20.284 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:20.284 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T14:44:20.284 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:16.426808+0000", 2024-04-18T14:44:20.284 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:44:20.284 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:20.284 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:20.284 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T14:44:20.285 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:16.426808+0000", 2024-04-18T14:44:20.285 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:44:20.285 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:20.285 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:20.285 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T14:44:20.285 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:16.426805+0000", 2024-04-18T14:44:20.285 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999967 2024-04-18T14:44:20.285 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:20.285 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:20.285 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T14:44:20.285 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:16.427815+0000", 2024-04-18T14:44:20.285 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0010096059999999999 2024-04-18T14:44:20.285 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:20.285 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:20.285 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T14:44:20.286 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:16.427845+0000", 2024-04-18T14:44:20.286 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.995e-05 2024-04-18T14:44:20.286 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:20.286 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:20.286 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T14:44:20.286 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:16.427860+0000", 2024-04-18T14:44:20.286 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5139e-05 2024-04-18T14:44:20.286 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:20.286 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:20.286 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T14:44:20.286 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:16.427998+0000", 2024-04-18T14:44:20.286 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00013767900000000001 2024-04-18T14:44:20.286 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:20.286 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:20.287 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op must wait for map", 2024-04-18T14:44:20.287 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:16.428016+0000", 2024-04-18T14:44:20.287 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.842e-05 2024-04-18T14:44:20.287 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:20.287 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:20.287 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T14:44:20.287 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:16.430294+0000", 2024-04-18T14:44:20.287 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0022780389999999999 2024-04-18T14:44:20.287 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:20.287 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:20.287 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T14:44:20.287 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:16.430559+0000", 2024-04-18T14:44:20.287 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00026499800000000001 2024-04-18T14:44:20.287 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:20.287 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:20.288 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_started", 2024-04-18T14:44:20.288 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:16.433355+0000", 2024-04-18T14:44:20.288 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.002795498 2024-04-18T14:44:20.288 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:20.288 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:20.288 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_committed", 2024-04-18T14:44:20.288 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:16.445845+0000", 2024-04-18T14:44:20.288 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.012489892000000001 2024-04-18T14:44:20.288 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:20.288 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:20.288 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T14:44:20.288 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:16.452227+0000", 2024-04-18T14:44:20.288 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0063820659999999996 2024-04-18T14:44:20.288 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:20.288 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:20.289 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T14:44:20.289 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:16.452333+0000", 2024-04-18T14:44:20.289 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000105944 2024-04-18T14:44:20.289 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:44:20.289 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T14:44:20.289 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:44:20.289 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:20.289 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:20.289 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4559.0:836 3.ds0 3:b48f58f5:::smithi13430248-34:head [append 0~425984] snapc 2c=[2c,2b,2a,29,28,27,26,23,22,1e,1c,1a,16,14,13,11,2] ondisk+write+known_if_redirected+supports_pool_eio e77)", 2024-04-18T14:44:20.289 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T14:44:16.430117+0000", 2024-04-18T14:44:20.289 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 3.8235389899999999, 2024-04-18T14:44:20.289 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.027905771999999999, 2024-04-18T14:44:20.289 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T14:44:20.289 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T14:44:20.290 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-18T14:44:20.290 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4559", 2024-04-18T14:44:20.290 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/3113589487", 2024-04-18T14:44:20.290 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 836 2024-04-18T14:44:20.290 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:20.290 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T14:44:20.290 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:20.290 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T14:44:20.290 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:16.430117+0000", 2024-04-18T14:44:20.290 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:44:20.290 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:20.290 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:20.290 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T14:44:20.290 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:16.430117+0000", 2024-04-18T14:44:20.290 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:44:20.291 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:20.291 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:20.291 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T14:44:20.291 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:16.430114+0000", 2024-04-18T14:44:20.291 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999967 2024-04-18T14:44:20.291 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:20.291 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:20.291 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T14:44:20.291 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:16.430717+0000", 2024-04-18T14:44:20.291 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00060351199999999995 2024-04-18T14:44:20.291 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:20.291 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:20.291 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T14:44:20.291 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:16.430744+0000", 2024-04-18T14:44:20.292 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.6777000000000001e-05 2024-04-18T14:44:20.292 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:20.292 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:20.292 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T14:44:20.292 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:16.430763+0000", 2024-04-18T14:44:20.292 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8756000000000001e-05 2024-04-18T14:44:20.292 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:20.292 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:20.292 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T14:44:20.292 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:16.441380+0000", 2024-04-18T14:44:20.292 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.010617549 2024-04-18T14:44:20.292 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:20.292 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:20.292 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T14:44:20.292 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:16.441465+0000", 2024-04-18T14:44:20.293 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.4324000000000001e-05 2024-04-18T14:44:20.293 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:20.293 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:20.293 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_started", 2024-04-18T14:44:20.293 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:16.442099+0000", 2024-04-18T14:44:20.293 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00063493000000000002 2024-04-18T14:44:20.293 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:20.293 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:20.293 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_committed", 2024-04-18T14:44:20.293 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:16.452126+0000", 2024-04-18T14:44:20.293 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.010026352000000001 2024-04-18T14:44:20.293 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:20.293 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:20.293 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T14:44:20.293 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:16.457933+0000", 2024-04-18T14:44:20.294 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0058070530000000004 2024-04-18T14:44:20.294 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:20.294 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:20.294 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T14:44:20.294 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:16.458023+0000", 2024-04-18T14:44:20.294 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.9982999999999995e-05 2024-04-18T14:44:20.294 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:44:20.294 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T14:44:20.294 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:44:20.294 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:20.294 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:20.294 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4559.0:837 3.ds0 3:b48f58f5:::smithi13430248-34:head [append 0~638976] snapc 2c=[2c,2b,2a,29,28,27,26,23,22,1e,1c,1a,16,14,13,11,2] ondisk+write+known_if_redirected+supports_pool_eio e77)", 2024-04-18T14:44:20.294 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T14:44:16.434604+0000", 2024-04-18T14:44:20.295 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 3.8190521520000003, 2024-04-18T14:44:20.295 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.024529546999999999, 2024-04-18T14:44:20.295 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T14:44:20.295 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T14:44:20.295 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-18T14:44:20.295 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4559", 2024-04-18T14:44:20.295 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/3113589487", 2024-04-18T14:44:20.295 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 837 2024-04-18T14:44:20.295 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:20.295 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T14:44:20.295 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:20.295 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T14:44:20.295 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:16.434604+0000", 2024-04-18T14:44:20.295 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:44:20.295 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:20.296 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:20.296 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T14:44:20.296 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:16.434604+0000", 2024-04-18T14:44:20.296 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:44:20.296 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:20.296 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:20.296 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T14:44:20.296 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:16.434600+0000", 2024-04-18T14:44:20.296 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999962 2024-04-18T14:44:20.296 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:20.296 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:20.296 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T14:44:20.296 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:16.435508+0000", 2024-04-18T14:44:20.296 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00090795899999999996 2024-04-18T14:44:20.297 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:20.297 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:20.297 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T14:44:20.297 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:16.435559+0000", 2024-04-18T14:44:20.297 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.0476999999999998e-05 2024-04-18T14:44:20.297 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:20.297 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:20.297 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T14:44:20.297 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:16.435584+0000", 2024-04-18T14:44:20.297 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.5150000000000001e-05 2024-04-18T14:44:20.297 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:20.297 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:20.297 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T14:44:20.297 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:16.446186+0000", 2024-04-18T14:44:20.297 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.010602227000000001 2024-04-18T14:44:20.298 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:20.298 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:20.298 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T14:44:20.298 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:16.446281+0000", 2024-04-18T14:44:20.298 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.5111999999999993e-05 2024-04-18T14:44:20.298 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:20.298 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:20.298 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_started", 2024-04-18T14:44:20.298 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:16.447320+0000", 2024-04-18T14:44:20.298 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0010388929999999999 2024-04-18T14:44:20.298 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:20.298 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:20.298 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_committed", 2024-04-18T14:44:20.298 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:16.452436+0000", 2024-04-18T14:44:20.298 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0051162200000000003 2024-04-18T14:44:20.299 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:20.299 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:20.299 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T14:44:20.299 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:16.459045+0000", 2024-04-18T14:44:20.299 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0066085520000000002 2024-04-18T14:44:20.299 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:20.299 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:20.299 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T14:44:20.299 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:16.459133+0000", 2024-04-18T14:44:20.299 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.8579999999999996e-05 2024-04-18T14:44:20.299 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:44:20.299 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T14:44:20.299 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:44:20.299 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:20.299 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:20.300 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4559.0:838 3.ds0 3:b48f58f5:::smithi13430248-34:head [append 0~491520] snapc 2c=[2c,2b,2a,29,28,27,26,23,22,1e,1c,1a,16,14,13,11,2] ondisk+write+known_if_redirected+supports_pool_eio e77)", 2024-04-18T14:44:20.300 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T14:44:16.439528+0000", 2024-04-18T14:44:20.300 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 3.8141281769999997, 2024-04-18T14:44:20.300 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.019833301000000001, 2024-04-18T14:44:20.300 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T14:44:20.300 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T14:44:20.300 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-18T14:44:20.300 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4559", 2024-04-18T14:44:20.300 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/3113589487", 2024-04-18T14:44:20.300 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 838 2024-04-18T14:44:20.300 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:20.300 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T14:44:20.300 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:20.300 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T14:44:20.300 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:16.439528+0000", 2024-04-18T14:44:20.300 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:44:20.301 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:20.301 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:20.301 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T14:44:20.301 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:16.439528+0000", 2024-04-18T14:44:20.301 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:44:20.301 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:20.301 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:20.301 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T14:44:20.301 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:16.439525+0000", 2024-04-18T14:44:20.301 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999967 2024-04-18T14:44:20.301 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:20.301 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:20.301 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T14:44:20.301 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:16.440383+0000", 2024-04-18T14:44:20.301 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00085854900000000001 2024-04-18T14:44:20.302 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:20.302 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:20.302 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T14:44:20.302 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:16.440419+0000", 2024-04-18T14:44:20.302 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.5859999999999999e-05 2024-04-18T14:44:20.302 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:20.302 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:20.302 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T14:44:20.302 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:16.440439+0000", 2024-04-18T14:44:20.302 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0137e-05 2024-04-18T14:44:20.302 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:20.302 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:20.303 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T14:44:20.303 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:16.448171+0000", 2024-04-18T14:44:20.303 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0077320069999999999 2024-04-18T14:44:20.303 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:20.303 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:20.303 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T14:44:20.303 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:16.448648+0000", 2024-04-18T14:44:20.303 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00047709599999999999 2024-04-18T14:44:20.303 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:20.303 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:20.303 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_started", 2024-04-18T14:44:20.303 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:16.450492+0000", 2024-04-18T14:44:20.303 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0018442689999999999 2024-04-18T14:44:20.303 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:20.304 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:20.304 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_committed", 2024-04-18T14:44:20.304 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:16.455811+0000", 2024-04-18T14:44:20.304 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0053188310000000004 2024-04-18T14:44:20.304 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:20.304 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:20.304 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T14:44:20.304 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:16.459281+0000", 2024-04-18T14:44:20.304 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0034693979999999998 2024-04-18T14:44:20.304 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:20.304 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:20.304 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T14:44:20.304 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:16.459361+0000", 2024-04-18T14:44:20.304 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.0500000000000005e-05 2024-04-18T14:44:20.304 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:44:20.305 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T14:44:20.305 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:44:20.305 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:20.305 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:20.305 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4559.0:839 3.ds0 3:b48f58f5:::smithi13430248-34:head [setxattr _header (57) in=7b] snapc 2c=[2c,2b,2a,29,28,27,26,23,22,1e,1c,1a,16,14,13,11,2] ondisk+write+known_if_redirected+supports_pool_eio e77)", 2024-04-18T14:44:20.305 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T14:44:16.440463+0000", 2024-04-18T14:44:20.305 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 3.8131933939999998, 2024-04-18T14:44:20.305 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.019173315, 2024-04-18T14:44:20.305 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T14:44:20.305 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T14:44:20.305 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-18T14:44:20.305 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4559", 2024-04-18T14:44:20.305 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/3113589487", 2024-04-18T14:44:20.305 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 839 2024-04-18T14:44:20.305 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:20.306 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T14:44:20.306 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:20.306 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T14:44:20.306 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:16.440463+0000", 2024-04-18T14:44:20.306 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:44:20.306 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:20.306 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:20.306 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T14:44:20.306 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:16.440463+0000", 2024-04-18T14:44:20.306 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:44:20.306 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:20.306 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:20.306 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T14:44:20.306 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:16.440460+0000", 2024-04-18T14:44:20.307 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999971 2024-04-18T14:44:20.307 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:20.307 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:20.307 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T14:44:20.307 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:16.440471+0000", 2024-04-18T14:44:20.307 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0644e-05 2024-04-18T14:44:20.307 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:20.307 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:20.307 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T14:44:20.307 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:16.440490+0000", 2024-04-18T14:44:20.307 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.9412999999999999e-05 2024-04-18T14:44:20.307 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:20.307 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:20.307 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T14:44:20.308 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:16.440503+0000", 2024-04-18T14:44:20.308 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3046e-05 2024-04-18T14:44:20.308 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:20.308 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:20.308 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T14:44:20.308 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:16.452489+0000", 2024-04-18T14:44:20.308 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.011986 2024-04-18T14:44:20.308 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:20.308 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:20.308 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T14:44:20.308 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:16.452596+0000", 2024-04-18T14:44:20.308 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000107364 2024-04-18T14:44:20.308 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:20.308 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:20.308 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_started", 2024-04-18T14:44:20.309 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:16.453079+0000", 2024-04-18T14:44:20.309 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000482795 2024-04-18T14:44:20.309 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:20.309 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:20.309 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_committed", 2024-04-18T14:44:20.309 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:16.456561+0000", 2024-04-18T14:44:20.309 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0034814030000000001 2024-04-18T14:44:20.309 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:20.309 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:20.309 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T14:44:20.309 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:16.459523+0000", 2024-04-18T14:44:20.309 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0029628089999999998 2024-04-18T14:44:20.309 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:20.309 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:20.310 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T14:44:20.310 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:16.459636+0000", 2024-04-18T14:44:20.310 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00011254799999999999 2024-04-18T14:44:20.310 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:44:20.310 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T14:44:20.310 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:44:20.310 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:20.310 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:20.310 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4559.0:840 3.ds0 3:b48f58f5:::smithi13430248-34:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e77)", 2024-04-18T14:44:20.310 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T14:44:16.440515+0000", 2024-04-18T14:44:20.310 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 3.813140905, 2024-04-18T14:44:20.310 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.023015104000000002, 2024-04-18T14:44:20.310 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T14:44:20.311 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-04-18T14:44:20.311 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-18T14:44:20.311 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4559", 2024-04-18T14:44:20.311 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/3113589487", 2024-04-18T14:44:20.311 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 840 2024-04-18T14:44:20.311 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:20.311 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T14:44:20.311 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:20.311 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T14:44:20.311 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:16.440515+0000", 2024-04-18T14:44:20.311 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:44:20.311 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:20.311 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:20.311 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T14:44:20.311 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:16.440515+0000", 2024-04-18T14:44:20.312 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:44:20.312 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:20.312 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:20.312 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T14:44:20.312 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:16.440514+0000", 2024-04-18T14:44:20.312 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999986 2024-04-18T14:44:20.312 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:20.312 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:20.312 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T14:44:20.312 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:16.440521+0000", 2024-04-18T14:44:20.312 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.1799999999999999e-06 2024-04-18T14:44:20.312 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:20.312 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:20.312 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T14:44:20.313 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:16.440539+0000", 2024-04-18T14:44:20.313 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.772e-05 2024-04-18T14:44:20.313 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:20.313 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:20.313 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T14:44:20.313 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:16.440551+0000", 2024-04-18T14:44:20.313 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1756000000000001e-05 2024-04-18T14:44:20.313 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:20.313 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:20.313 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T14:44:20.313 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:16.453734+0000", 2024-04-18T14:44:20.313 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.013183924 2024-04-18T14:44:20.313 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:20.313 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:20.313 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for rw locks", 2024-04-18T14:44:20.313 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:16.453990+0000", 2024-04-18T14:44:20.314 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00025553499999999999 2024-04-18T14:44:20.314 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:20.314 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:20.314 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T14:44:20.314 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:16.460366+0000", 2024-04-18T14:44:20.314 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0063763680000000003 2024-04-18T14:44:20.314 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:20.314 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:20.314 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T14:44:20.314 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:16.460521+0000", 2024-04-18T14:44:20.314 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000155017 2024-04-18T14:44:20.314 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:20.314 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:20.314 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T14:44:20.315 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:16.463530+0000", 2024-04-18T14:44:20.315 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0030089100000000001 2024-04-18T14:44:20.315 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:44:20.315 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T14:44:20.315 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:44:20.315 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:20.315 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:20.315 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "MOSDECSubOpWrite(3.bs5 78/70 ECSubWrite(tid=94, reqid=osd.10.0:94, at_version=78'42, trim_to=0'0, roll_forward_to=77'40))", 2024-04-18T14:44:20.315 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T14:44:17.430108+0000", 2024-04-18T14:44:20.315 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 2.8235482159999998, 2024-04-18T14:44:20.315 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.016214016000000001, 2024-04-18T14:44:20.315 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T14:44:20.315 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-04-18T14:44:20.315 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T14:44:20.315 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:20.315 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T14:44:20.316 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:17.430108+0000", 2024-04-18T14:44:20.316 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:44:20.316 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:20.316 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:20.316 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T14:44:20.316 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:17.430108+0000", 2024-04-18T14:44:20.316 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:44:20.316 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:20.316 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:20.316 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T14:44:20.316 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:17.430107+0000", 2024-04-18T14:44:20.316 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-04-18T14:44:20.316 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:20.316 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:20.316 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T14:44:20.317 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:17.430142+0000", 2024-04-18T14:44:20.317 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.5249000000000001e-05 2024-04-18T14:44:20.317 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:20.317 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:20.317 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T14:44:20.317 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:17.430158+0000", 2024-04-18T14:44:20.317 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5610000000000001e-05 2024-04-18T14:44:20.317 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:20.317 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:20.317 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T14:44:20.317 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:17.430167+0000", 2024-04-18T14:44:20.317 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.9870000000000005e-06 2024-04-18T14:44:20.317 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:20.317 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:20.317 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T14:44:20.318 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:17.430286+0000", 2024-04-18T14:44:20.318 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000119484 2024-04-18T14:44:20.318 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:20.318 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:20.318 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_started", 2024-04-18T14:44:20.318 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:17.430310+0000", 2024-04-18T14:44:20.318 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.3487000000000001e-05 2024-04-18T14:44:20.318 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:20.318 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:20.318 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_committed", 2024-04-18T14:44:20.318 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:17.446265+0000", 2024-04-18T14:44:20.318 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.015954601999999998 2024-04-18T14:44:20.318 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:20.319 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:20.319 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T14:44:20.319 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:17.446322+0000", 2024-04-18T14:44:20.319 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.7293000000000002e-05 2024-04-18T14:44:20.319 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:44:20.319 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T14:44:20.319 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:44:20.319 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:20.319 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:20.319 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "MOSDECSubOpWrite(3.6s5 78/70 ECSubWrite(tid=276, reqid=osd.14.0:276, at_version=78'113, trim_to=0'0, roll_forward_to=77'111))", 2024-04-18T14:44:20.319 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T14:44:17.431171+0000", 2024-04-18T14:44:20.319 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 2.822484588, 2024-04-18T14:44:20.319 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.016763452000000002, 2024-04-18T14:44:20.319 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T14:44:20.320 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-04-18T14:44:20.320 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T14:44:20.320 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:20.320 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T14:44:20.320 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:17.431171+0000", 2024-04-18T14:44:20.320 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:44:20.320 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:20.320 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:20.320 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T14:44:20.320 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:17.431171+0000", 2024-04-18T14:44:20.320 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:44:20.320 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:20.320 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:20.320 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T14:44:20.321 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:17.431171+0000", 2024-04-18T14:44:20.321 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-18T14:44:20.321 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:20.321 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:20.321 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T14:44:20.321 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:17.431201+0000", 2024-04-18T14:44:20.321 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.0716000000000002e-05 2024-04-18T14:44:20.321 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:20.321 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:20.321 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T14:44:20.321 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:17.431222+0000", 2024-04-18T14:44:20.321 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0891999999999999e-05 2024-04-18T14:44:20.321 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:20.321 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:20.321 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T14:44:20.322 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:17.431235+0000", 2024-04-18T14:44:20.322 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2666999999999999e-05 2024-04-18T14:44:20.322 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:20.322 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:20.322 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T14:44:20.322 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:17.431356+0000", 2024-04-18T14:44:20.322 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000121032 2024-04-18T14:44:20.322 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:20.322 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:20.322 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_started", 2024-04-18T14:44:20.322 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:17.431409+0000", 2024-04-18T14:44:20.322 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.3523000000000002e-05 2024-04-18T14:44:20.322 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:20.322 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:20.323 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_committed", 2024-04-18T14:44:20.323 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:17.447880+0000", 2024-04-18T14:44:20.323 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.016470101000000001 2024-04-18T14:44:20.323 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:20.323 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:20.323 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T14:44:20.323 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:17.447935+0000", 2024-04-18T14:44:20.323 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.5343000000000002e-05 2024-04-18T14:44:20.323 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:44:20.323 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T14:44:20.323 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:44:20.323 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:20.323 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:20.323 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "MOSDECSubOpWrite(3.5s4 78/30 ECSubWrite(tid=41, reqid=osd.15.0:40, at_version=0'0, trim_to=0'0, roll_forward_to=78'34))", 2024-04-18T14:44:20.324 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T14:44:17.433051+0000", 2024-04-18T14:44:20.324 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 2.8206048670000001, 2024-04-18T14:44:20.324 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.015046253000000001, 2024-04-18T14:44:20.324 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T14:44:20.324 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-04-18T14:44:20.324 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T14:44:20.324 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:20.324 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T14:44:20.324 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:17.433051+0000", 2024-04-18T14:44:20.324 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:44:20.324 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:20.324 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:20.324 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T14:44:20.324 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:17.433051+0000", 2024-04-18T14:44:20.324 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:44:20.325 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:20.325 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:20.325 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T14:44:20.325 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:17.433050+0000", 2024-04-18T14:44:20.325 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999986 2024-04-18T14:44:20.325 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:20.325 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:20.325 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T14:44:20.325 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:17.433064+0000", 2024-04-18T14:44:20.325 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3548e-05 2024-04-18T14:44:20.325 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:20.325 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:20.325 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T14:44:20.325 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:17.433077+0000", 2024-04-18T14:44:20.325 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3108000000000001e-05 2024-04-18T14:44:20.326 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:20.326 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:20.326 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T14:44:20.326 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:17.433085+0000", 2024-04-18T14:44:20.326 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.755e-06 2024-04-18T14:44:20.326 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:20.326 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:20.326 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T14:44:20.326 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:17.433421+0000", 2024-04-18T14:44:20.326 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000335216 2024-04-18T14:44:20.326 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:20.326 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:20.326 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_started", 2024-04-18T14:44:20.326 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:17.433429+0000", 2024-04-18T14:44:20.326 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.405e-06 2024-04-18T14:44:20.327 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:20.327 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:20.327 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_committed", 2024-04-18T14:44:20.327 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:17.448064+0000", 2024-04-18T14:44:20.327 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.014634881000000001 2024-04-18T14:44:20.327 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:20.327 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:20.327 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T14:44:20.327 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:17.448097+0000", 2024-04-18T14:44:20.327 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.3532999999999999e-05 2024-04-18T14:44:20.327 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:44:20.327 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T14:44:20.327 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:44:20.327 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:20.327 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:20.328 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "MOSDECSubOpWrite(3.3s1 78/30 ECSubWrite(tid=282, reqid=osd.13.0:282, at_version=78'49, trim_to=0'0, roll_forward_to=69'47))", 2024-04-18T14:44:20.328 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T14:44:17.433192+0000", 2024-04-18T14:44:20.328 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 2.8204636139999999, 2024-04-18T14:44:20.328 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.014356789999999999, 2024-04-18T14:44:20.328 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T14:44:20.328 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-04-18T14:44:20.328 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T14:44:20.328 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:20.328 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T14:44:20.328 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:17.433192+0000", 2024-04-18T14:44:20.328 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:44:20.328 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:20.328 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:20.328 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T14:44:20.328 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:17.433192+0000", 2024-04-18T14:44:20.329 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:44:20.329 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:20.329 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:20.329 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T14:44:20.329 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:17.433192+0000", 2024-04-18T14:44:20.329 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967296 2024-04-18T14:44:20.329 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:20.329 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:20.329 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T14:44:20.329 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:17.433214+0000", 2024-04-18T14:44:20.329 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2189e-05 2024-04-18T14:44:20.329 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:20.329 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:20.329 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T14:44:20.329 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:17.433227+0000", 2024-04-18T14:44:20.330 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2167000000000001e-05 2024-04-18T14:44:20.330 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:20.330 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:20.330 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T14:44:20.330 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:17.433236+0000", 2024-04-18T14:44:20.330 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.4339999999999998e-06 2024-04-18T14:44:20.330 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:20.330 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:20.330 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T14:44:20.330 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:17.433297+0000", 2024-04-18T14:44:20.330 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.0577e-05 2024-04-18T14:44:20.330 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:20.330 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:20.330 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_started", 2024-04-18T14:44:20.330 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:17.433303+0000", 2024-04-18T14:44:20.331 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.2580000000000001e-06 2024-04-18T14:44:20.331 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:20.331 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:20.331 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_committed", 2024-04-18T14:44:20.331 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:17.447518+0000", 2024-04-18T14:44:20.331 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.014214625 2024-04-18T14:44:20.331 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:20.331 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:20.331 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T14:44:20.331 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:17.447549+0000", 2024-04-18T14:44:20.331 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.1717999999999997e-05 2024-04-18T14:44:20.331 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:44:20.331 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T14:44:20.331 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:44:20.331 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:20.331 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:20.332 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "MOSDECSubOpWrite(3.bs5 78/70 ECSubWrite(tid=95, reqid=osd.10.0:95, at_version=78'44, trim_to=0'0, roll_forward_to=77'40))", 2024-04-18T14:44:20.332 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T14:44:17.434144+0000", 2024-04-18T14:44:20.332 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 2.819512257, 2024-04-18T14:44:20.332 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.013711515000000001, 2024-04-18T14:44:20.332 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T14:44:20.332 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-04-18T14:44:20.332 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T14:44:20.332 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:20.332 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T14:44:20.332 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:17.434144+0000", 2024-04-18T14:44:20.332 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:44:20.332 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:20.332 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:20.332 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T14:44:20.332 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:17.434144+0000", 2024-04-18T14:44:20.333 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:44:20.333 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:20.333 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:20.333 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T14:44:20.333 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:17.434143+0000", 2024-04-18T14:44:20.333 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-18T14:44:20.333 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:20.333 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:20.333 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T14:44:20.333 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:17.434165+0000", 2024-04-18T14:44:20.333 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2215e-05 2024-04-18T14:44:20.333 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:20.333 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:20.333 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T14:44:20.333 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:17.434177+0000", 2024-04-18T14:44:20.334 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1422e-05 2024-04-18T14:44:20.334 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:20.334 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:20.334 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T14:44:20.334 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:17.434186+0000", 2024-04-18T14:44:20.334 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.0399999999999998e-06 2024-04-18T14:44:20.334 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:20.334 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:20.334 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T14:44:20.334 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:17.434294+0000", 2024-04-18T14:44:20.334 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000108613 2024-04-18T14:44:20.334 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:20.334 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:20.334 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_started", 2024-04-18T14:44:20.335 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:17.434318+0000", 2024-04-18T14:44:20.335 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.3606999999999999e-05 2024-04-18T14:44:20.335 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:20.335 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:20.335 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_committed", 2024-04-18T14:44:20.335 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:17.447831+0000", 2024-04-18T14:44:20.335 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.013513103 2024-04-18T14:44:20.335 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:20.335 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:20.335 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T14:44:20.335 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:17.447855+0000", 2024-04-18T14:44:20.335 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.4354000000000001e-05 2024-04-18T14:44:20.335 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:44:20.335 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T14:44:20.335 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:44:20.336 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:20.336 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:20.336 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "MOSDECSubOpWriteReply(3.ds0 77/30 ECSubWriteReply(tid=54, last_complete=78'49, committed=1, applied=1))", 2024-04-18T14:44:20.336 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T14:44:17.434801+0000", 2024-04-18T14:44:20.336 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 2.8188549419999998, 2024-04-18T14:44:20.336 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.012801692999999999, 2024-04-18T14:44:20.336 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T14:44:20.336 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-04-18T14:44:20.336 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T14:44:20.336 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:20.336 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T14:44:20.336 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:17.434801+0000", 2024-04-18T14:44:20.336 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:44:20.336 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:20.336 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:20.337 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T14:44:20.337 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:17.434801+0000", 2024-04-18T14:44:20.337 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:44:20.337 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:20.337 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:20.337 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T14:44:20.337 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:17.434800+0000", 2024-04-18T14:44:20.337 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-18T14:44:20.337 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:20.337 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:20.337 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T14:44:20.337 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:17.434807+0000", 2024-04-18T14:44:20.337 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.8929999999999999e-06 2024-04-18T14:44:20.337 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:20.337 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:20.338 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T14:44:20.338 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:17.434819+0000", 2024-04-18T14:44:20.338 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1996e-05 2024-04-18T14:44:20.338 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:20.338 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:20.338 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T14:44:20.338 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:17.434825+0000", 2024-04-18T14:44:20.338 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.1670000000000004e-06 2024-04-18T14:44:20.338 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:20.338 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:20.338 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T14:44:20.338 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:17.447582+0000", 2024-04-18T14:44:20.338 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.012756521999999999 2024-04-18T14:44:20.338 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:20.338 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:20.339 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T14:44:20.339 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:17.447603+0000", 2024-04-18T14:44:20.339 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.1183999999999999e-05 2024-04-18T14:44:20.339 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:44:20.339 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T14:44:20.339 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:44:20.339 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:20.339 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:20.339 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "MOSDECSubOpWriteReply(3.ds0 78/30 ECSubWriteReply(tid=54, last_complete=78'49, committed=1, applied=1))", 2024-04-18T14:44:20.339 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T14:44:17.436302+0000", 2024-04-18T14:44:20.339 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 2.8173537280000001, 2024-04-18T14:44:20.339 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.011353729999999999, 2024-04-18T14:44:20.339 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T14:44:20.339 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-04-18T14:44:20.340 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T14:44:20.340 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:20.340 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T14:44:20.340 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:17.436302+0000", 2024-04-18T14:44:20.340 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:44:20.340 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:20.340 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:20.340 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T14:44:20.340 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:17.436302+0000", 2024-04-18T14:44:20.340 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:44:20.340 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:20.340 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:20.340 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T14:44:20.340 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:17.436300+0000", 2024-04-18T14:44:20.340 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999981 2024-04-18T14:44:20.341 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:20.341 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:20.341 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T14:44:20.341 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:17.436332+0000", 2024-04-18T14:44:20.341 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.1946000000000002e-05 2024-04-18T14:44:20.341 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:20.341 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:20.341 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T14:44:20.341 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:17.436364+0000", 2024-04-18T14:44:20.341 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.2036000000000003e-05 2024-04-18T14:44:20.341 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:20.341 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:20.341 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T14:44:20.341 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:17.436384+0000", 2024-04-18T14:44:20.341 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0044e-05 2024-04-18T14:44:20.342 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:20.342 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:20.342 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T14:44:20.342 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:17.447631+0000", 2024-04-18T14:44:20.342 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.011246808 2024-04-18T14:44:20.342 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:20.342 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:20.342 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T14:44:20.342 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:17.447656+0000", 2024-04-18T14:44:20.342 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.4828999999999999e-05 2024-04-18T14:44:20.342 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:44:20.342 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T14:44:20.342 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:44:20.342 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:20.342 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:20.343 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "MOSDECSubOpWrite(3.6s5 78/70 ECSubWrite(tid=279, reqid=osd.14.0:279, at_version=78'115, trim_to=0'0, roll_forward_to=77'111))", 2024-04-18T14:44:20.343 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T14:44:17.437668+0000", 2024-04-18T14:44:20.343 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 2.8159883219999999, 2024-04-18T14:44:20.343 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.011143718, 2024-04-18T14:44:20.343 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T14:44:20.343 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-04-18T14:44:20.343 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T14:44:20.343 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:20.343 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T14:44:20.343 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:17.437668+0000", 2024-04-18T14:44:20.343 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:44:20.343 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:20.343 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:20.343 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T14:44:20.343 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:17.437668+0000", 2024-04-18T14:44:20.344 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:44:20.344 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:20.344 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:20.344 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T14:44:20.344 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:17.437666+0000", 2024-04-18T14:44:20.344 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999981 2024-04-18T14:44:20.344 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:20.344 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:20.344 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T14:44:20.344 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:17.437725+0000", 2024-04-18T14:44:20.344 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.9376000000000002e-05 2024-04-18T14:44:20.344 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:20.344 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:20.344 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T14:44:20.344 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:17.437758+0000", 2024-04-18T14:44:20.345 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.3012999999999997e-05 2024-04-18T14:44:20.345 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:20.345 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:20.345 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T14:44:20.345 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:17.437781+0000", 2024-04-18T14:44:20.345 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2606999999999999e-05 2024-04-18T14:44:20.345 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:20.345 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:20.345 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T14:44:20.345 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:17.446123+0000", 2024-04-18T14:44:20.345 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0083417409999999997 2024-04-18T14:44:20.345 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:20.345 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:20.345 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_started", 2024-04-18T14:44:20.345 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:17.446147+0000", 2024-04-18T14:44:20.346 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.4355999999999999e-05 2024-04-18T14:44:20.346 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:20.346 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:20.346 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_committed", 2024-04-18T14:44:20.346 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:17.448773+0000", 2024-04-18T14:44:20.346 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.002625503 2024-04-18T14:44:20.346 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:20.346 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:20.346 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T14:44:20.346 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:17.448811+0000", 2024-04-18T14:44:20.346 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.8909000000000003e-05 2024-04-18T14:44:20.346 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:44:20.346 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T14:44:20.346 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:44:20.347 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:44:20.347 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T14:44:20.347 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-04-18T14:44:20.348 INFO:teuthology.orchestra.run.smithi086.stdout:osd.12: {} 2024-04-18T14:44:20.348 INFO:teuthology.orchestra.run.smithi086.stderr:osd.12: osd_enable_op_tracker = '' 2024-04-18T14:44:20.349 INFO:teuthology.orchestra.run.smithi086.stdout:osd.13: {} 2024-04-18T14:44:20.349 INFO:teuthology.orchestra.run.smithi086.stderr:osd.13: osd_enable_op_tracker = '' 2024-04-18T14:44:20.349 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.11.asok dump_ops_in_flight 2024-04-18T14:44:20.350 INFO:teuthology.orchestra.run.smithi086.stdout:osd.14: {} 2024-04-18T14:44:20.350 INFO:teuthology.orchestra.run.smithi086.stderr:osd.14: osd_enable_op_tracker = '' 2024-04-18T14:44:20.351 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-18T14:44:20.297+0000 7ff5caaec640 0 -- 172.21.15.86:0/2331223598 >> [v2:172.21.15.134:6808/25223,v1:172.21.15.134:6812/25223] conn(0x7ff5c4223ce0 msgr2=0x7ff5c42260f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-04-18T14:44:20.351 INFO:teuthology.orchestra.run.smithi086.stdout:osd.15: {} 2024-04-18T14:44:20.352 INFO:teuthology.orchestra.run.smithi086.stderr:osd.15: osd_enable_op_tracker = '' 2024-04-18T14:44:20.352 INFO:tasks.ceph.osd.1.smithi096.stderr:2024-04-18T14:44:20.349+0000 7f56a7a98640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 24887) UID: 0 2024-04-18T14:44:20.443 INFO:tasks.rados.rados.0.smithi134.stdout:340: done (3 left) 2024-04-18T14:44:20.443 INFO:tasks.rados.rados.0.smithi134.stdout:341: done (2 left) 2024-04-18T14:44:20.443 INFO:tasks.rados.rados.0.smithi134.stdout:342: done (1 left) 2024-04-18T14:44:20.443 INFO:tasks.rados.rados.0.smithi134.stdout:343: done (0 left) 2024-04-18T14:44:20.443 INFO:tasks.rados.rados.0.smithi134.stdout:344: rmattr oid 14 current snap is 31 2024-04-18T14:44:20.443 INFO:tasks.rados.rados.0.smithi134.stdout:344: done (0 left) 2024-04-18T14:44:20.443 INFO:tasks.rados.rados.0.smithi134.stdout:345: read oid 42 snap 23 2024-04-18T14:44:20.443 INFO:tasks.rados.rados.0.smithi134.stdout:345: expect (ObjNum 2054929920 snap 22009 seq_num 2054475312) 2024-04-18T14:44:20.443 INFO:tasks.rados.rados.0.smithi134.stdout:append oid 36 current snap is 31 2024-04-18T14:44:20.443 INFO:tasks.rados.rados.0.smithi134.stdout:346: seq_num 135 ranges {2277376=720896,2998272=622592,3620864=688128,4308992=245760} 2024-04-18T14:44:20.449 INFO:tasks.ceph.osd.10.smithi119.stderr:2024-04-18T14:44:20.450+0000 7f6f24c12640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 10 (PID: 24898) UID: 0 2024-04-18T14:44:20.459 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-04-18T14:44:20.460 INFO:tasks.rados.rados.0.smithi134.stdout:346: writing smithi13430248-36 from 2277376 to 2998272 tid 1 2024-04-18T14:44:20.465 INFO:tasks.rados.rados.0.smithi134.stdout:346: writing smithi13430248-36 from 2998272 to 3620864 tid 2 2024-04-18T14:44:20.474 INFO:tasks.rados.rados.0.smithi134.stdout:346: writing smithi13430248-36 from 3620864 to 4308992 tid 3 2024-04-18T14:44:20.476 INFO:tasks.rados.rados.0.smithi134.stdout:346: writing smithi13430248-36 from 4308992 to 4554752 tid 4 2024-04-18T14:44:20.476 INFO:tasks.rados.rados.0.smithi134.stdout:347: rollback oid 50 current snap is 31 2024-04-18T14:44:20.477 INFO:tasks.rados.rados.0.smithi134.stdout:rollback oid 50 to 28 2024-04-18T14:44:20.477 INFO:tasks.rados.rados.0.smithi134.stdout:345: expect (ObjNum 2054929920 snap 22009 seq_num 2054475312) 2024-04-18T14:44:20.486 INFO:tasks.rados.rados.0.smithi134.stdout:346: finishing write tid 1 to smithi13430248-36 2024-04-18T14:44:20.486 INFO:tasks.rados.rados.0.smithi134.stdout:347: finishing rollback tid 1 to smithi13430248-50 2024-04-18T14:44:20.486 INFO:tasks.rados.rados.0.smithi134.stdout:update_object_version oid 50 v 49 (ObjNum 65 snap 0 seq_num 2029364144) dirty dne 2024-04-18T14:44:20.486 INFO:tasks.rados.rados.0.smithi134.stdout:346: finishing write tid 2 to smithi13430248-36 2024-04-18T14:44:20.486 INFO:tasks.rados.rados.0.smithi134.stdout:345: done (2 left) 2024-04-18T14:44:20.486 INFO:tasks.rados.rados.0.smithi134.stdout:347: done (1 left) 2024-04-18T14:44:20.486 INFO:tasks.rados.rados.0.smithi134.stdout:348: delete oid 38 current snap is 31 2024-04-18T14:44:20.487 INFO:tasks.rados.rados.0.smithi134.stdout:346: finishing write tid 3 to smithi13430248-36 2024-04-18T14:44:20.490 INFO:tasks.rados.rados.0.smithi134.stdout:346: finishing write tid 4 to smithi13430248-36 2024-04-18T14:44:20.491 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-04-18T14:44:20.491 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [], 2024-04-18T14:44:20.491 INFO:teuthology.orchestra.run.smithi134.stdout: "num_ops": 0 2024-04-18T14:44:20.491 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-04-18T14:44:20.493 INFO:tasks.rados.rados.0.smithi134.stdout:348: done (1 left) 2024-04-18T14:44:20.494 INFO:tasks.rados.rados.0.smithi134.stdout:349: copy_from oid 4 from oid 25 current snap is 31 2024-04-18T14:44:20.494 INFO:tasks.rados.rados.0.smithi134.stdout:346: finishing write tid 5 to smithi13430248-36 2024-04-18T14:44:20.494 INFO:tasks.rados.rados.0.smithi134.stdout:append oid 42 current snap is 31 2024-04-18T14:44:20.494 INFO:tasks.rados.rados.0.smithi134.stdout:350: seq_num 137 ranges {0=753664,753664=786432,1540096=655360,2195456=114688} 2024-04-18T14:44:20.501 INFO:tasks.rados.rados.0.smithi134.stdout:350: writing smithi13430248-42 from 0 to 753664 tid 1 2024-04-18T14:44:20.506 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.11.asok dump_blocked_ops 2024-04-18T14:44:20.508 INFO:tasks.rados.rados.0.smithi134.stdout:350: writing smithi13430248-42 from 753664 to 1540096 tid 2 2024-04-18T14:44:20.513 INFO:tasks.rados.rados.0.smithi134.stdout:350: writing smithi13430248-42 from 1540096 to 2195456 tid 3 2024-04-18T14:44:20.515 INFO:tasks.rados.rados.0.smithi134.stdout:350: writing smithi13430248-42 from 2195456 to 2310144 tid 4 2024-04-18T14:44:20.516 INFO:tasks.rados.rados.0.smithi134.stdout:351: rollback oid 22 current snap is 31 2024-04-18T14:44:20.516 INFO:tasks.rados.rados.0.smithi134.stdout:rollback oid 22 to 18 2024-04-18T14:44:20.516 INFO:tasks.rados.rados.0.smithi134.stdout:346: finishing write tid 6 to smithi13430248-36 2024-04-18T14:44:20.516 INFO:tasks.rados.rados.0.smithi134.stdout:346: oid 36 updating version 0 to 164 2024-04-18T14:44:20.516 INFO:tasks.rados.rados.0.smithi134.stdout:346: oid 36 version 164 is already newer than 163 2024-04-18T14:44:20.516 INFO:tasks.rados.rados.0.smithi134.stdout:346: oid 36 version 164 is already newer than 161 2024-04-18T14:44:20.516 INFO:tasks.rados.rados.0.smithi134.stdout:346: oid 36 updating version 164 to 165 2024-04-18T14:44:20.516 INFO:tasks.rados.rados.0.smithi134.stdout:346: oid 36 version 165 is already newer than 162 2024-04-18T14:44:20.516 INFO:tasks.rados.rados.0.smithi134.stdout:update_object_version oid 36 v 165 (ObjNum 135 snap 31 seq_num 135) dirty exists 2024-04-18T14:44:20.516 INFO:tasks.rados.rados.0.smithi134.stdout:346: left oid 36 (ObjNum 135 snap 31 seq_num 135) 2024-04-18T14:44:20.516 INFO:tasks.rados.rados.0.smithi134.stdout:346: done (3 left) 2024-04-18T14:44:20.516 INFO:tasks.rados.rados.0.smithi134.stdout:352: read oid 14 snap 28 2024-04-18T14:44:20.516 INFO:tasks.rados.rados.0.smithi134.stdout:352: expect (ObjNum 13 snap 0 seq_num 13) 2024-04-18T14:44:20.516 INFO:tasks.rados.rados.0.smithi134.stdout:353: read oid 37 snap 20 2024-04-18T14:44:20.517 INFO:tasks.rados.rados.0.smithi134.stdout:353: expect (ObjNum 75 snap 15 seq_num 75) 2024-04-18T14:44:20.517 INFO:tasks.rados.rados.0.smithi134.stdout:354: snap_remove snap 12 2024-04-18T14:44:20.550 INFO:tasks.ceph.osd.3.smithi134.stderr:2024-04-18T14:44:20.552+0000 7fe7a4443640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25211) UID: 0 2024-04-18T14:44:20.624 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-04-18T14:44:20.625 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [], 2024-04-18T14:44:20.625 INFO:teuthology.orchestra.run.smithi134.stdout: "complaint_time": 30, 2024-04-18T14:44:20.625 INFO:teuthology.orchestra.run.smithi134.stdout: "num_blocked_ops": 0 2024-04-18T14:44:20.625 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-04-18T14:44:20.638 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.11.asok dump_historic_ops 2024-04-18T14:44:20.651 INFO:tasks.ceph.osd.2.smithi119.stderr:2024-04-18T14:44:20.654+0000 7fcbd30c0640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 24894) UID: 0 2024-04-18T14:44:20.752 INFO:tasks.ceph.osd.4.smithi086.stderr:2024-04-18T14:44:20.749+0000 7f0c4c462640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 24956) UID: 0 2024-04-18T14:44:20.803 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-04-18T14:44:20.804 INFO:teuthology.orchestra.run.smithi134.stdout: "size": 20, 2024-04-18T14:44:20.804 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 600, 2024-04-18T14:44:20.804 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [ 2024-04-18T14:44:20.804 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:20.804 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4559.0:248 3.fs0 3:f85be22b:::smithi13430248-15:head [copy-from ver 10] snapc 8=[8,7,4,2] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-04-18T14:44:20.804 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T14:43:40.759371+0000", 2024-04-18T14:44:20.804 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 40.045857202999997, 2024-04-18T14:44:20.804 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.032405762999999997, 2024-04-18T14:44:20.804 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T14:44:20.804 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T14:44:20.804 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-18T14:44:20.804 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4559", 2024-04-18T14:44:20.804 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/3113589487", 2024-04-18T14:44:20.805 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 248 2024-04-18T14:44:20.805 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:20.805 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T14:44:20.805 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:20.805 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T14:44:20.805 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:40.759371+0000", 2024-04-18T14:44:20.805 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:44:20.805 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:20.805 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:20.805 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T14:44:20.805 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:40.759371+0000", 2024-04-18T14:44:20.805 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:44:20.805 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:20.805 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:20.805 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T14:44:20.806 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:40.759369+0000", 2024-04-18T14:44:20.806 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999971 2024-04-18T14:44:20.806 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:20.806 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:20.806 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T14:44:20.806 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:40.759383+0000", 2024-04-18T14:44:20.806 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.4307e-05 2024-04-18T14:44:20.806 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:20.806 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:20.806 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T14:44:20.806 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:40.759418+0000", 2024-04-18T14:44:20.806 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.5154000000000003e-05 2024-04-18T14:44:20.806 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:20.806 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:20.807 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T14:44:20.807 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:40.759440+0000", 2024-04-18T14:44:20.807 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2056999999999999e-05 2024-04-18T14:44:20.807 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:20.807 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:20.807 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T14:44:20.807 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:40.759512+0000", 2024-04-18T14:44:20.807 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.2267000000000005e-05 2024-04-18T14:44:20.807 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:20.807 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:20.807 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op must wait for map", 2024-04-18T14:44:20.807 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:40.759521+0000", 2024-04-18T14:44:20.807 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.6370000000000005e-06 2024-04-18T14:44:20.807 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:20.807 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:20.807 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T14:44:20.808 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:40.764362+0000", 2024-04-18T14:44:20.808 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0048409990000000003 2024-04-18T14:44:20.808 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:20.808 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:20.808 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T14:44:20.808 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:40.764642+0000", 2024-04-18T14:44:20.808 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00028021600000000002 2024-04-18T14:44:20.808 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:20.808 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:20.808 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_started", 2024-04-18T14:44:20.808 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:40.785675+0000", 2024-04-18T14:44:20.808 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.021032894999999999 2024-04-18T14:44:20.809 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:20.809 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:20.809 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_committed", 2024-04-18T14:44:20.809 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:40.789679+0000", 2024-04-18T14:44:20.809 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0040040939999999997 2024-04-18T14:44:20.809 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:20.809 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:20.809 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T14:44:20.810 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:40.791620+0000", 2024-04-18T14:44:20.810 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0019413430000000001 2024-04-18T14:44:20.810 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:20.810 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:20.810 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T14:44:20.810 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:40.791777+0000", 2024-04-18T14:44:20.810 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00015652999999999999 2024-04-18T14:44:20.810 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:44:20.810 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T14:44:20.810 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:44:20.810 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:20.810 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:20.810 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4559.0:249 3.fs0 3:f85be22b:::smithi13430248-15:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e41)", 2024-04-18T14:44:20.811 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T14:43:40.759469+0000", 2024-04-18T14:44:20.811 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 40.045759077, 2024-04-18T14:44:20.811 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.028934334999999999, 2024-04-18T14:44:20.811 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T14:44:20.811 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-04-18T14:44:20.811 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-18T14:44:20.811 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4559", 2024-04-18T14:44:20.811 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/3113589487", 2024-04-18T14:44:20.811 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 249 2024-04-18T14:44:20.811 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:20.811 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T14:44:20.811 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:20.811 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T14:44:20.811 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:40.759469+0000", 2024-04-18T14:44:20.811 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:44:20.812 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:20.812 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:20.812 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T14:44:20.812 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:40.759469+0000", 2024-04-18T14:44:20.812 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:44:20.812 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:20.812 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:20.812 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T14:44:20.812 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:40.759468+0000", 2024-04-18T14:44:20.812 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999981 2024-04-18T14:44:20.812 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:20.812 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:20.812 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T14:44:20.812 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:40.759476+0000", 2024-04-18T14:44:20.812 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.0069999999999997e-06 2024-04-18T14:44:20.812 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:20.813 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:20.813 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T14:44:20.813 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:40.759496+0000", 2024-04-18T14:44:20.813 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0287000000000001e-05 2024-04-18T14:44:20.813 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:20.813 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:20.813 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T14:44:20.813 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:40.759512+0000", 2024-04-18T14:44:20.813 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5843999999999999e-05 2024-04-18T14:44:20.813 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:20.813 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:20.814 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T14:44:20.814 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:40.759627+0000", 2024-04-18T14:44:20.814 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000115699 2024-04-18T14:44:20.814 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:20.814 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:20.814 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting_for_map not empty", 2024-04-18T14:44:20.814 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:40.759645+0000", 2024-04-18T14:44:20.814 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8063999999999998e-05 2024-04-18T14:44:20.814 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:20.814 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:20.814 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T14:44:20.814 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:40.765114+0000", 2024-04-18T14:44:20.814 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0054689079999999998 2024-04-18T14:44:20.814 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:20.814 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:20.815 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for blocked object", 2024-04-18T14:44:20.815 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:40.765242+0000", 2024-04-18T14:44:20.815 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00012731999999999999 2024-04-18T14:44:20.815 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:20.815 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:20.815 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T14:44:20.815 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:40.788026+0000", 2024-04-18T14:44:20.815 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.022784764999999998 2024-04-18T14:44:20.815 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:20.815 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:20.815 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T14:44:20.815 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:40.788178+0000", 2024-04-18T14:44:20.815 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000151819 2024-04-18T14:44:20.815 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:20.815 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:20.815 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T14:44:20.816 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:40.788404+0000", 2024-04-18T14:44:20.816 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000225479 2024-04-18T14:44:20.816 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:44:20.816 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T14:44:20.816 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:44:20.816 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:20.816 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:20.816 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4559.0:380 3.cs0 3:32b15d13:::smithi13430248-43:head [copy-from ver 12] snapc 13=[13,11,f,b,a,8,7,2] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-04-18T14:44:20.816 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T14:43:50.410989+0000", 2024-04-18T14:44:20.816 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 30.394239502000001, 2024-04-18T14:44:20.816 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.01842353, 2024-04-18T14:44:20.816 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T14:44:20.816 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T14:44:20.816 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-18T14:44:20.816 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4559", 2024-04-18T14:44:20.817 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/3113589487", 2024-04-18T14:44:20.817 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 380 2024-04-18T14:44:20.817 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:20.817 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T14:44:20.817 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:20.817 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T14:44:20.817 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:50.410989+0000", 2024-04-18T14:44:20.817 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:44:20.817 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:20.817 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:20.817 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T14:44:20.817 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:50.410989+0000", 2024-04-18T14:44:20.817 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:44:20.817 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:20.817 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:20.818 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T14:44:20.818 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:50.410987+0000", 2024-04-18T14:44:20.818 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999976 2024-04-18T14:44:20.818 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:20.818 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:20.818 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T14:44:20.818 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:50.410996+0000", 2024-04-18T14:44:20.818 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.4539999999999996e-06 2024-04-18T14:44:20.818 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:20.818 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:20.818 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T14:44:20.818 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:50.411013+0000", 2024-04-18T14:44:20.818 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6728999999999999e-05 2024-04-18T14:44:20.818 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:20.818 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:20.819 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T14:44:20.819 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:50.411022+0000", 2024-04-18T14:44:20.819 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.7770000000000008e-06 2024-04-18T14:44:20.819 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:20.819 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:20.819 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T14:44:20.819 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:50.411171+0000", 2024-04-18T14:44:20.819 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00014944900000000001 2024-04-18T14:44:20.819 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:20.819 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:20.819 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T14:44:20.819 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:50.411369+0000", 2024-04-18T14:44:20.819 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00019749000000000001 2024-04-18T14:44:20.819 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:20.819 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:20.820 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_started", 2024-04-18T14:44:20.820 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:50.419400+0000", 2024-04-18T14:44:20.820 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0080313759999999998 2024-04-18T14:44:20.820 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:20.820 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:20.820 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_committed", 2024-04-18T14:44:20.820 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:50.423023+0000", 2024-04-18T14:44:20.820 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.003622905 2024-04-18T14:44:20.820 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:20.820 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:20.820 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T14:44:20.820 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:50.429197+0000", 2024-04-18T14:44:20.820 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0061737709999999998 2024-04-18T14:44:20.820 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:20.820 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:20.821 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T14:44:20.821 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:50.429412+0000", 2024-04-18T14:44:20.821 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000215727 2024-04-18T14:44:20.821 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:44:20.821 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T14:44:20.821 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:44:20.821 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:20.821 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:20.821 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4559.0:574 3.cs0 3:32b15d13:::smithi13430248-43:head [append 0~0] snapc 1e=[1e,1d,1c,1a,19,16,14,13,11,b,a,7,2] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-04-18T14:44:20.821 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T14:44:01.409746+0000", 2024-04-18T14:44:20.821 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 19.395482261000002, 2024-04-18T14:44:20.821 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.017790594999999999, 2024-04-18T14:44:20.821 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T14:44:20.821 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T14:44:20.821 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-18T14:44:20.822 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4559", 2024-04-18T14:44:20.822 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/3113589487", 2024-04-18T14:44:20.822 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 574 2024-04-18T14:44:20.822 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:20.822 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T14:44:20.822 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:20.822 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T14:44:20.822 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:01.409746+0000", 2024-04-18T14:44:20.822 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:44:20.822 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:20.822 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:20.822 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T14:44:20.822 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:01.409746+0000", 2024-04-18T14:44:20.822 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:44:20.822 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:20.823 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:20.823 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T14:44:20.823 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:01.409745+0000", 2024-04-18T14:44:20.823 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-18T14:44:20.823 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:20.823 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:20.823 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T14:44:20.823 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:01.409751+0000", 2024-04-18T14:44:20.823 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.127e-06 2024-04-18T14:44:20.823 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:20.823 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:20.823 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T14:44:20.823 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:01.409772+0000", 2024-04-18T14:44:20.823 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0740000000000001e-05 2024-04-18T14:44:20.823 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:20.824 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:20.824 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T14:44:20.824 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:01.409785+0000", 2024-04-18T14:44:20.824 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3125999999999999e-05 2024-04-18T14:44:20.824 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:20.824 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:20.824 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T14:44:20.824 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:01.420898+0000", 2024-04-18T14:44:20.824 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.01111287 2024-04-18T14:44:20.824 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:20.824 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:20.824 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T14:44:20.824 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:01.421157+0000", 2024-04-18T14:44:20.824 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00025946699999999999 2024-04-18T14:44:20.824 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:20.824 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:20.825 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_started", 2024-04-18T14:44:20.825 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:01.422437+0000", 2024-04-18T14:44:20.825 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.001279156 2024-04-18T14:44:20.825 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:20.825 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:20.825 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_committed", 2024-04-18T14:44:20.825 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:01.426477+0000", 2024-04-18T14:44:20.825 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0040404200000000003 2024-04-18T14:44:20.825 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:20.825 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:20.825 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T14:44:20.825 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:01.426662+0000", 2024-04-18T14:44:20.825 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000184935 2024-04-18T14:44:20.825 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:20.825 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:20.825 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T14:44:20.826 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:01.427537+0000", 2024-04-18T14:44:20.826 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00087485099999999995 2024-04-18T14:44:20.826 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:44:20.826 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T14:44:20.826 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:44:20.826 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:20.826 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:20.826 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4559.0:742 3.cs0 3:32b15d13:::smithi13430248-43:head [append 0~507904] snapc 27=[27,26,23,22,1e,1c,1a,16,14,13,11,2] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-04-18T14:44:20.826 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T14:44:11.760334+0000", 2024-04-18T14:44:20.826 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 9.0448947919999991, 2024-04-18T14:44:20.826 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.024123056, 2024-04-18T14:44:20.826 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T14:44:20.826 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T14:44:20.826 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-18T14:44:20.826 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4559", 2024-04-18T14:44:20.827 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/3113589487", 2024-04-18T14:44:20.827 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 742 2024-04-18T14:44:20.827 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:20.827 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T14:44:20.827 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:20.827 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T14:44:20.827 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:11.760334+0000", 2024-04-18T14:44:20.827 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:44:20.827 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:20.827 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:20.827 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T14:44:20.827 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:11.760334+0000", 2024-04-18T14:44:20.827 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:44:20.827 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:20.827 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:20.828 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T14:44:20.828 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:11.760331+0000", 2024-04-18T14:44:20.828 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999976 2024-04-18T14:44:20.828 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:20.828 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:20.828 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T14:44:20.828 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:11.760560+0000", 2024-04-18T14:44:20.828 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00022863399999999999 2024-04-18T14:44:20.828 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:20.828 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:20.828 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T14:44:20.828 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:11.760588+0000", 2024-04-18T14:44:20.828 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.8586999999999999e-05 2024-04-18T14:44:20.828 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:20.828 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:20.828 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T14:44:20.829 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:11.760603+0000", 2024-04-18T14:44:20.829 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.4426999999999999e-05 2024-04-18T14:44:20.829 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:20.829 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:20.829 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T14:44:20.829 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:11.760687+0000", 2024-04-18T14:44:20.829 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.4305e-05 2024-04-18T14:44:20.829 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:20.829 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:20.829 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T14:44:20.829 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:11.760819+0000", 2024-04-18T14:44:20.829 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00013166799999999999 2024-04-18T14:44:20.829 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:20.829 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:20.829 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_started", 2024-04-18T14:44:20.829 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:11.762740+0000", 2024-04-18T14:44:20.830 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.001921542 2024-04-18T14:44:20.830 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:20.830 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:20.830 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_committed", 2024-04-18T14:44:20.830 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:11.765776+0000", 2024-04-18T14:44:20.830 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0030356929999999999 2024-04-18T14:44:20.830 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:20.830 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:20.830 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T14:44:20.830 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:11.784400+0000", 2024-04-18T14:44:20.830 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.018623701999999999 2024-04-18T14:44:20.830 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:20.830 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:20.830 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T14:44:20.830 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:11.784457+0000", 2024-04-18T14:44:20.831 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.6907999999999998e-05 2024-04-18T14:44:20.831 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:44:20.831 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T14:44:20.831 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:44:20.831 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:20.831 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:20.831 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4559.0:743 3.cs0 3:32b15d13:::smithi13430248-43:head [append 0~425984] snapc 27=[27,26,23,22,1e,1c,1a,16,14,13,11,2] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-04-18T14:44:20.831 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T14:44:11.763503+0000", 2024-04-18T14:44:20.831 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 9.0417257220000007, 2024-04-18T14:44:20.831 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.021263944999999999, 2024-04-18T14:44:20.831 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T14:44:20.831 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T14:44:20.831 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-18T14:44:20.831 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4559", 2024-04-18T14:44:20.831 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/3113589487", 2024-04-18T14:44:20.832 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 743 2024-04-18T14:44:20.832 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:20.832 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T14:44:20.832 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:20.832 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T14:44:20.832 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:11.763503+0000", 2024-04-18T14:44:20.832 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:44:20.832 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:20.832 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:20.832 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T14:44:20.832 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:11.763503+0000", 2024-04-18T14:44:20.832 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:44:20.832 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:20.832 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:20.832 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T14:44:20.832 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:11.763501+0000", 2024-04-18T14:44:20.833 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999981 2024-04-18T14:44:20.833 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:20.833 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:20.833 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T14:44:20.833 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:11.763749+0000", 2024-04-18T14:44:20.833 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000248361 2024-04-18T14:44:20.833 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:20.833 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:20.833 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T14:44:20.833 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:11.763764+0000", 2024-04-18T14:44:20.833 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.4278e-05 2024-04-18T14:44:20.833 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:20.833 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:20.833 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T14:44:20.833 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:11.763773+0000", 2024-04-18T14:44:20.833 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.7000000000000003e-06 2024-04-18T14:44:20.834 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:20.834 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:20.834 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T14:44:20.834 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:11.764026+0000", 2024-04-18T14:44:20.834 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00025268900000000001 2024-04-18T14:44:20.834 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:20.834 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:20.834 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T14:44:20.834 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:11.764198+0000", 2024-04-18T14:44:20.834 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00017181499999999999 2024-04-18T14:44:20.834 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:20.834 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:20.834 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_started", 2024-04-18T14:44:20.834 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:11.765226+0000", 2024-04-18T14:44:20.834 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.001028202 2024-04-18T14:44:20.835 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:20.835 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:20.835 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_committed", 2024-04-18T14:44:20.835 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:11.768730+0000", 2024-04-18T14:44:20.835 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.003504175 2024-04-18T14:44:20.835 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:20.835 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:20.835 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T14:44:20.835 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:11.784690+0000", 2024-04-18T14:44:20.836 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.015960050999999999 2024-04-18T14:44:20.836 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:20.836 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:20.836 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T14:44:20.836 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:11.784767+0000", 2024-04-18T14:44:20.836 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.6365999999999994e-05 2024-04-18T14:44:20.836 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:44:20.836 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T14:44:20.836 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:44:20.836 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:20.836 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:20.836 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4559.0:744 3.cs0 3:32b15d13:::smithi13430248-43:head [append 0~442368] snapc 27=[27,26,23,22,1e,1c,1a,16,14,13,11,2] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-04-18T14:44:20.836 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T14:44:11.766613+0000", 2024-04-18T14:44:20.837 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 9.0386157069999999, 2024-04-18T14:44:20.837 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.022415638000000002, 2024-04-18T14:44:20.837 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T14:44:20.837 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T14:44:20.837 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-18T14:44:20.837 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4559", 2024-04-18T14:44:20.837 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/3113589487", 2024-04-18T14:44:20.837 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 744 2024-04-18T14:44:20.837 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:20.837 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T14:44:20.837 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:20.837 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T14:44:20.837 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:11.766613+0000", 2024-04-18T14:44:20.837 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:44:20.837 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:20.838 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:20.838 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T14:44:20.838 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:11.766613+0000", 2024-04-18T14:44:20.838 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:44:20.838 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:20.838 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:20.838 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T14:44:20.838 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:11.766611+0000", 2024-04-18T14:44:20.838 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999986 2024-04-18T14:44:20.838 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:20.838 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:20.838 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T14:44:20.838 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:11.766825+0000", 2024-04-18T14:44:20.838 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000214286 2024-04-18T14:44:20.838 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:20.839 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:20.839 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T14:44:20.839 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:11.766839+0000", 2024-04-18T14:44:20.839 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3721e-05 2024-04-18T14:44:20.839 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:20.839 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:20.839 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T14:44:20.839 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:11.766847+0000", 2024-04-18T14:44:20.839 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.4880000000000001e-06 2024-04-18T14:44:20.839 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:20.839 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:20.839 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T14:44:20.839 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:11.766907+0000", 2024-04-18T14:44:20.839 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.0726000000000001e-05 2024-04-18T14:44:20.839 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:20.839 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:20.840 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T14:44:20.840 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:11.767093+0000", 2024-04-18T14:44:20.840 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000185355 2024-04-18T14:44:20.840 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:20.840 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:20.840 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_started", 2024-04-18T14:44:20.840 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:11.767963+0000", 2024-04-18T14:44:20.840 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00086985800000000005 2024-04-18T14:44:20.840 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:20.840 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:20.840 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_committed", 2024-04-18T14:44:20.840 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:11.770520+0000", 2024-04-18T14:44:20.840 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0025570929999999999 2024-04-18T14:44:20.840 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:20.840 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:20.841 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T14:44:20.841 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:11.788942+0000", 2024-04-18T14:44:20.841 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.018422706 2024-04-18T14:44:20.841 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:20.841 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:20.841 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T14:44:20.841 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:11.789028+0000", 2024-04-18T14:44:20.841 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.6018000000000002e-05 2024-04-18T14:44:20.841 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:44:20.841 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T14:44:20.841 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:44:20.841 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:20.841 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:20.841 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4559.0:745 3.cs0 3:32b15d13:::smithi13430248-43:head [append 0~540672] snapc 27=[27,26,23,22,1e,1c,1a,16,14,13,11,2] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-04-18T14:44:20.841 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T14:44:11.770451+0000", 2024-04-18T14:44:20.841 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 9.0347774170000008, 2024-04-18T14:44:20.842 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.024076914000000001, 2024-04-18T14:44:20.842 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T14:44:20.842 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T14:44:20.842 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-18T14:44:20.842 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4559", 2024-04-18T14:44:20.842 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/3113589487", 2024-04-18T14:44:20.842 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 745 2024-04-18T14:44:20.842 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:20.842 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T14:44:20.842 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:20.842 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T14:44:20.842 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:11.770451+0000", 2024-04-18T14:44:20.842 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:44:20.842 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:20.842 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:20.843 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T14:44:20.843 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:11.770451+0000", 2024-04-18T14:44:20.843 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:44:20.843 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:20.843 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:20.843 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T14:44:20.843 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:11.770450+0000", 2024-04-18T14:44:20.843 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-18T14:44:20.843 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:20.843 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:20.843 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T14:44:20.843 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:11.770664+0000", 2024-04-18T14:44:20.843 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00021399799999999999 2024-04-18T14:44:20.843 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:20.843 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:20.844 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T14:44:20.844 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:11.770678+0000", 2024-04-18T14:44:20.844 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.4402e-05 2024-04-18T14:44:20.844 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:20.844 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:20.844 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T14:44:20.844 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:11.770685+0000", 2024-04-18T14:44:20.844 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.7479999999999996e-06 2024-04-18T14:44:20.844 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:20.844 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:20.844 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T14:44:20.844 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:11.770746+0000", 2024-04-18T14:44:20.844 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.1278999999999994e-05 2024-04-18T14:44:20.844 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:20.844 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:20.845 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T14:44:20.845 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:11.770905+0000", 2024-04-18T14:44:20.845 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00015894600000000001 2024-04-18T14:44:20.845 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:20.845 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:20.845 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_started", 2024-04-18T14:44:20.845 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:11.772027+0000", 2024-04-18T14:44:20.845 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0011219369999999999 2024-04-18T14:44:20.845 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:20.845 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:20.845 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_committed", 2024-04-18T14:44:20.845 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:11.778260+0000", 2024-04-18T14:44:20.845 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0062322250000000001 2024-04-18T14:44:20.845 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:20.845 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:20.846 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T14:44:20.846 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:11.794464+0000", 2024-04-18T14:44:20.846 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.016204070000000001 2024-04-18T14:44:20.846 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:20.846 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:20.846 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T14:44:20.846 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:11.794528+0000", 2024-04-18T14:44:20.846 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.4369000000000007e-05 2024-04-18T14:44:20.846 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:44:20.846 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T14:44:20.846 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:44:20.846 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:20.846 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:20.846 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4559.0:746 3.cs0 3:32b15d13:::smithi13430248-43:head [append 0~147456] snapc 27=[27,26,23,22,1e,1c,1a,16,14,13,11,2] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-04-18T14:44:20.846 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T14:44:11.771460+0000", 2024-04-18T14:44:20.847 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 9.0337685190000006, 2024-04-18T14:44:20.847 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.024755577000000001, 2024-04-18T14:44:20.847 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T14:44:20.847 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T14:44:20.847 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-18T14:44:20.847 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4559", 2024-04-18T14:44:20.847 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/3113589487", 2024-04-18T14:44:20.847 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 746 2024-04-18T14:44:20.847 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:20.847 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T14:44:20.847 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:20.847 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T14:44:20.847 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:11.771460+0000", 2024-04-18T14:44:20.847 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:44:20.847 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:20.847 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:20.848 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T14:44:20.848 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:11.771460+0000", 2024-04-18T14:44:20.848 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:44:20.848 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:20.848 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:20.848 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T14:44:20.848 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:11.771459+0000", 2024-04-18T14:44:20.848 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999986 2024-04-18T14:44:20.848 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:20.848 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:20.848 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T14:44:20.848 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:11.771523+0000", 2024-04-18T14:44:20.848 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.436e-05 2024-04-18T14:44:20.848 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:20.848 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:20.849 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T14:44:20.849 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:11.771537+0000", 2024-04-18T14:44:20.849 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3621999999999999e-05 2024-04-18T14:44:20.849 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:20.849 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:20.849 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T14:44:20.849 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:11.771544+0000", 2024-04-18T14:44:20.849 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.6809999999999998e-06 2024-04-18T14:44:20.849 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:20.849 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:20.849 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T14:44:20.849 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:11.773345+0000", 2024-04-18T14:44:20.849 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.001800893 2024-04-18T14:44:20.849 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:20.849 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:20.850 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T14:44:20.850 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:11.773503+0000", 2024-04-18T14:44:20.850 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000157913 2024-04-18T14:44:20.850 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:20.850 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:20.850 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_started", 2024-04-18T14:44:20.850 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:11.774324+0000", 2024-04-18T14:44:20.850 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00082110099999999997 2024-04-18T14:44:20.850 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:20.850 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:20.850 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_committed", 2024-04-18T14:44:20.850 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:11.780169+0000", 2024-04-18T14:44:20.850 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0058448099999999998 2024-04-18T14:44:20.850 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:20.850 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:20.850 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T14:44:20.851 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:11.796153+0000", 2024-04-18T14:44:20.851 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.015983727 2024-04-18T14:44:20.851 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:20.851 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:20.851 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T14:44:20.851 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:11.796216+0000", 2024-04-18T14:44:20.851 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.2726999999999998e-05 2024-04-18T14:44:20.851 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:44:20.851 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T14:44:20.851 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:44:20.851 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:20.852 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:20.852 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4559.0:747 3.cs0 3:32b15d13:::smithi13430248-43:head [setxattr _header (57) in=7b] snapc 27=[27,26,23,22,1e,1c,1a,16,14,13,11,2] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-04-18T14:44:20.852 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T14:44:11.771566+0000", 2024-04-18T14:44:20.852 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 9.0336629439999996, 2024-04-18T14:44:20.852 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.02483633, 2024-04-18T14:44:20.852 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T14:44:20.852 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T14:44:20.852 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-18T14:44:20.852 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4559", 2024-04-18T14:44:20.852 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/3113589487", 2024-04-18T14:44:20.852 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 747 2024-04-18T14:44:20.852 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:20.852 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T14:44:20.852 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:20.852 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T14:44:20.852 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:11.771566+0000", 2024-04-18T14:44:20.853 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:44:20.853 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:20.853 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:20.853 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T14:44:20.853 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:11.771566+0000", 2024-04-18T14:44:20.853 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:44:20.853 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:20.853 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:20.853 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T14:44:20.853 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:11.771565+0000", 2024-04-18T14:44:20.853 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-18T14:44:20.853 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:20.853 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:20.853 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T14:44:20.853 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:11.771569+0000", 2024-04-18T14:44:20.853 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.3290000000000004e-06 2024-04-18T14:44:20.854 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:20.854 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:20.854 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T14:44:20.854 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:11.771578+0000", 2024-04-18T14:44:20.854 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.9779999999999994e-06 2024-04-18T14:44:20.854 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:20.854 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:20.854 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T14:44:20.854 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:11.771583+0000", 2024-04-18T14:44:20.854 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.3419999999999998e-06 2024-04-18T14:44:20.854 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:20.854 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:20.854 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T14:44:20.854 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:11.775090+0000", 2024-04-18T14:44:20.854 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.003506707 2024-04-18T14:44:20.855 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:20.855 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:20.855 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T14:44:20.855 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:11.775150+0000", 2024-04-18T14:44:20.855 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.9546999999999998e-05 2024-04-18T14:44:20.855 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:20.855 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:20.855 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_started", 2024-04-18T14:44:20.855 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:11.775435+0000", 2024-04-18T14:44:20.855 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00028518899999999998 2024-04-18T14:44:20.855 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:20.855 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:20.855 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_committed", 2024-04-18T14:44:20.855 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:11.780172+0000", 2024-04-18T14:44:20.855 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.004737191 2024-04-18T14:44:20.856 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:20.856 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:20.856 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T14:44:20.856 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:11.796320+0000", 2024-04-18T14:44:20.856 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.016147970000000001 2024-04-18T14:44:20.856 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:20.856 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:20.856 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T14:44:20.856 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:11.796402+0000", 2024-04-18T14:44:20.856 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.1878000000000004e-05 2024-04-18T14:44:20.856 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:44:20.856 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T14:44:20.856 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:44:20.856 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:20.856 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:20.857 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4559.0:748 3.cs0 3:32b15d13:::smithi13430248-43:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e72)", 2024-04-18T14:44:20.857 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T14:44:11.771611+0000", 2024-04-18T14:44:20.857 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 9.0336173800000008, 2024-04-18T14:44:20.857 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.029708281999999999, 2024-04-18T14:44:20.857 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T14:44:20.857 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-04-18T14:44:20.857 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-18T14:44:20.857 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4559", 2024-04-18T14:44:20.857 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/3113589487", 2024-04-18T14:44:20.857 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 748 2024-04-18T14:44:20.857 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:20.857 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T14:44:20.857 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:20.857 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T14:44:20.857 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:11.771611+0000", 2024-04-18T14:44:20.857 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:44:20.858 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:20.858 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:20.858 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T14:44:20.858 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:11.771611+0000", 2024-04-18T14:44:20.858 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:44:20.858 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:20.858 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:20.858 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T14:44:20.858 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:11.771611+0000", 2024-04-18T14:44:20.858 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-04-18T14:44:20.858 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:20.858 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:20.858 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T14:44:20.858 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:11.771613+0000", 2024-04-18T14:44:20.858 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.7520000000000001e-06 2024-04-18T14:44:20.858 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:20.859 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:20.859 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T14:44:20.859 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:11.771622+0000", 2024-04-18T14:44:20.859 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.9330000000000007e-06 2024-04-18T14:44:20.859 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:20.859 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:20.859 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T14:44:20.859 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:11.771627+0000", 2024-04-18T14:44:20.859 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.1080000000000001e-06 2024-04-18T14:44:20.859 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:20.859 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:20.859 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T14:44:20.859 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:11.775676+0000", 2024-04-18T14:44:20.859 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0040487199999999996 2024-04-18T14:44:20.859 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:20.860 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:20.860 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for rw locks", 2024-04-18T14:44:20.860 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:11.775776+0000", 2024-04-18T14:44:20.860 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.9429e-05 2024-04-18T14:44:20.860 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:20.860 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:20.860 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T14:44:20.860 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:11.796442+0000", 2024-04-18T14:44:20.860 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.020666753 2024-04-18T14:44:20.860 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:20.860 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:20.860 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T14:44:20.860 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:11.796503+0000", 2024-04-18T14:44:20.860 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.0285999999999998e-05 2024-04-18T14:44:20.860 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:20.860 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:20.861 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T14:44:20.861 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:11.801319+0000", 2024-04-18T14:44:20.861 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0048167590000000003 2024-04-18T14:44:20.861 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:44:20.861 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T14:44:20.861 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:44:20.861 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:20.861 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:20.861 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4559.0:758 3.cs0 3:328b7efa:::smithi13430248-27:head [append 0~524288] snapc 27=[27,26,23,22,1e,1c,1a,16,14,13,11,2] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-04-18T14:44:20.861 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T14:44:11.778300+0000", 2024-04-18T14:44:20.861 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 9.0269279929999993, 2024-04-18T14:44:20.861 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.020012121000000001, 2024-04-18T14:44:20.861 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T14:44:20.861 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T14:44:20.861 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-18T14:44:20.861 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4559", 2024-04-18T14:44:20.862 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/3113589487", 2024-04-18T14:44:20.862 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 758 2024-04-18T14:44:20.862 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:20.862 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T14:44:20.862 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:20.862 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T14:44:20.862 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:11.778300+0000", 2024-04-18T14:44:20.862 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:44:20.862 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:20.862 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:20.862 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T14:44:20.862 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:11.778300+0000", 2024-04-18T14:44:20.862 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:44:20.862 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:20.862 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:20.863 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T14:44:20.863 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:11.778299+0000", 2024-04-18T14:44:20.863 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999986 2024-04-18T14:44:20.863 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:20.863 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:20.863 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T14:44:20.863 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:11.778534+0000", 2024-04-18T14:44:20.863 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000234737 2024-04-18T14:44:20.863 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:20.863 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:20.863 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T14:44:20.863 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:11.778545+0000", 2024-04-18T14:44:20.863 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1405e-05 2024-04-18T14:44:20.863 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:20.863 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:20.863 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T14:44:20.864 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:11.778552+0000", 2024-04-18T14:44:20.864 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.348e-06 2024-04-18T14:44:20.864 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:20.864 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:20.864 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T14:44:20.864 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:11.778585+0000", 2024-04-18T14:44:20.864 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.2978999999999997e-05 2024-04-18T14:44:20.864 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:20.864 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:20.864 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T14:44:20.864 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:11.778640+0000", 2024-04-18T14:44:20.864 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.5686999999999997e-05 2024-04-18T14:44:20.864 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:20.864 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:20.864 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_started", 2024-04-18T14:44:20.865 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:11.779401+0000", 2024-04-18T14:44:20.865 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000760789 2024-04-18T14:44:20.865 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:20.865 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:20.865 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_committed", 2024-04-18T14:44:20.865 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:11.780533+0000", 2024-04-18T14:44:20.865 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0011324379999999999 2024-04-18T14:44:20.865 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:20.865 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:20.865 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T14:44:20.865 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:11.798268+0000", 2024-04-18T14:44:20.865 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.017734973000000001 2024-04-18T14:44:20.865 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:20.865 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:20.865 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T14:44:20.866 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:11.798313+0000", 2024-04-18T14:44:20.866 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.4153999999999998e-05 2024-04-18T14:44:20.866 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:44:20.866 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T14:44:20.866 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:44:20.866 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:20.866 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:20.866 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4559.0:759 3.cs0 3:328b7efa:::smithi13430248-27:head [append 0~573440] snapc 27=[27,26,23,22,1e,1c,1a,16,14,13,11,2] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-04-18T14:44:20.866 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T14:44:11.782249+0000", 2024-04-18T14:44:20.866 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 9.0229797059999992, 2024-04-18T14:44:20.866 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.016262858000000002, 2024-04-18T14:44:20.866 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T14:44:20.866 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T14:44:20.866 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-18T14:44:20.866 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4559", 2024-04-18T14:44:20.867 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/3113589487", 2024-04-18T14:44:20.867 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 759 2024-04-18T14:44:20.867 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:20.867 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T14:44:20.867 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:20.867 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T14:44:20.867 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:11.782249+0000", 2024-04-18T14:44:20.867 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:44:20.867 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:20.867 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:20.867 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T14:44:20.867 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:11.782249+0000", 2024-04-18T14:44:20.867 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:44:20.867 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:20.868 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:20.868 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T14:44:20.868 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:11.782247+0000", 2024-04-18T14:44:20.868 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999981 2024-04-18T14:44:20.868 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:20.868 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:20.868 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T14:44:20.868 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:11.782508+0000", 2024-04-18T14:44:20.868 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00026140199999999999 2024-04-18T14:44:20.868 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:20.868 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:20.868 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T14:44:20.869 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:11.782519+0000", 2024-04-18T14:44:20.869 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0821e-05 2024-04-18T14:44:20.869 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:20.869 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:20.869 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T14:44:20.869 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:11.782526+0000", 2024-04-18T14:44:20.869 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.0350000000000004e-06 2024-04-18T14:44:20.869 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:20.869 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:20.869 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T14:44:20.869 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:11.782567+0000", 2024-04-18T14:44:20.869 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.0932e-05 2024-04-18T14:44:20.869 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:20.869 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:20.869 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T14:44:20.870 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:11.782681+0000", 2024-04-18T14:44:20.870 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00011391300000000001 2024-04-18T14:44:20.870 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:20.870 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:20.870 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_started", 2024-04-18T14:44:20.870 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:11.783451+0000", 2024-04-18T14:44:20.870 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00076997999999999997 2024-04-18T14:44:20.870 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:20.870 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:20.870 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_committed", 2024-04-18T14:44:20.870 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:11.784891+0000", 2024-04-18T14:44:20.870 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0014397769999999999 2024-04-18T14:44:20.870 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:20.870 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:20.870 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T14:44:20.871 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:11.798447+0000", 2024-04-18T14:44:20.871 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.013556164000000001 2024-04-18T14:44:20.871 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:20.871 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:20.871 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T14:44:20.871 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:11.798512+0000", 2024-04-18T14:44:20.871 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.4597999999999994e-05 2024-04-18T14:44:20.871 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:44:20.871 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T14:44:20.871 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:44:20.871 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:20.871 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:20.871 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4559.0:763 3.cs0 3:328b7efa:::smithi13430248-27:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e72)", 2024-04-18T14:44:20.871 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T14:44:11.788759+0000", 2024-04-18T14:44:20.871 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 9.0164690499999995, 2024-04-18T14:44:20.872 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.016749151, 2024-04-18T14:44:20.872 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T14:44:20.872 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-04-18T14:44:20.872 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-18T14:44:20.872 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4559", 2024-04-18T14:44:20.872 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/3113589487", 2024-04-18T14:44:20.872 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 763 2024-04-18T14:44:20.872 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:20.872 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T14:44:20.872 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:20.872 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T14:44:20.872 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:11.788759+0000", 2024-04-18T14:44:20.872 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:44:20.872 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:20.872 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:20.873 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T14:44:20.873 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:11.788759+0000", 2024-04-18T14:44:20.873 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:44:20.873 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:20.873 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:20.873 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T14:44:20.873 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:11.788759+0000", 2024-04-18T14:44:20.873 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-04-18T14:44:20.873 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:20.873 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:20.873 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T14:44:20.873 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:11.788762+0000", 2024-04-18T14:44:20.873 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.0350000000000002e-06 2024-04-18T14:44:20.873 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:20.873 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:20.874 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T14:44:20.874 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:11.788769+0000", 2024-04-18T14:44:20.874 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.3889999999999999e-06 2024-04-18T14:44:20.874 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:20.874 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:20.874 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T14:44:20.874 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:11.788775+0000", 2024-04-18T14:44:20.874 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.3170000000000001e-06 2024-04-18T14:44:20.874 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:20.874 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:20.874 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T14:44:20.874 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:11.792473+0000", 2024-04-18T14:44:20.874 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0036981359999999999 2024-04-18T14:44:20.874 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:20.874 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:20.875 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for rw locks", 2024-04-18T14:44:20.875 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:11.792558+0000", 2024-04-18T14:44:20.875 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.5160000000000005e-05 2024-04-18T14:44:20.875 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:20.875 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:20.875 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T14:44:20.875 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:11.803855+0000", 2024-04-18T14:44:20.875 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.011296581 2024-04-18T14:44:20.875 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:20.875 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:20.875 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T14:44:20.875 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:11.803913+0000", 2024-04-18T14:44:20.875 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.8165999999999998e-05 2024-04-18T14:44:20.875 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:20.875 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:20.876 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T14:44:20.876 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:11.805509+0000", 2024-04-18T14:44:20.876 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.001595791 2024-04-18T14:44:20.876 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:44:20.876 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T14:44:20.876 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:44:20.876 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:20.876 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:20.876 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4559.0:827 3.cs0 3:32b15d13:::smithi13430248-43:2c [read 0~2162688,checksum] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e77)", 2024-04-18T14:44:20.876 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T14:44:16.417959+0000", 2024-04-18T14:44:20.876 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 4.3872690070000004, 2024-04-18T14:44:20.876 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.017431892000000001, 2024-04-18T14:44:20.876 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T14:44:20.876 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-04-18T14:44:20.876 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-18T14:44:20.876 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4559", 2024-04-18T14:44:20.877 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/3113589487", 2024-04-18T14:44:20.877 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 827 2024-04-18T14:44:20.877 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:20.877 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T14:44:20.877 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:20.877 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T14:44:20.877 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:16.417959+0000", 2024-04-18T14:44:20.877 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:44:20.877 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:20.877 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:20.877 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T14:44:20.877 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:16.417959+0000", 2024-04-18T14:44:20.877 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:44:20.877 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:20.877 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:20.877 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T14:44:20.878 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:16.417959+0000", 2024-04-18T14:44:20.878 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-18T14:44:20.878 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:20.878 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:20.878 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T14:44:20.878 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:16.417964+0000", 2024-04-18T14:44:20.878 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.7169999999999996e-06 2024-04-18T14:44:20.878 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:20.878 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:20.878 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T14:44:20.878 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:16.417976+0000", 2024-04-18T14:44:20.878 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2153e-05 2024-04-18T14:44:20.878 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:20.878 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:20.878 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T14:44:20.879 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:16.417990+0000", 2024-04-18T14:44:20.879 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3152999999999999e-05 2024-04-18T14:44:20.879 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:20.879 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:20.879 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T14:44:20.879 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:16.418088+0000", 2024-04-18T14:44:20.879 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.8505999999999995e-05 2024-04-18T14:44:20.879 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:20.879 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:20.879 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting_for_map not empty", 2024-04-18T14:44:20.879 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:16.418094+0000", 2024-04-18T14:44:20.879 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.7799999999999997e-06 2024-04-18T14:44:20.879 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:20.879 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:20.879 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T14:44:20.879 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:16.423161+0000", 2024-04-18T14:44:20.880 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.005067457 2024-04-18T14:44:20.880 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:20.880 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:20.880 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T14:44:20.880 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:16.423352+0000", 2024-04-18T14:44:20.880 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000191079 2024-04-18T14:44:20.880 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:20.880 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:20.880 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T14:44:20.880 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:16.435391+0000", 2024-04-18T14:44:20.880 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.012038946999999999 2024-04-18T14:44:20.880 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:44:20.880 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T14:44:20.880 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:44:20.880 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:20.881 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:20.881 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4559.0:828 3.cs0 3:32b15d13:::smithi13430248-43:2c [read 0~2162688,checksum] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e77)", 2024-04-18T14:44:20.881 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T14:44:16.418005+0000", 2024-04-18T14:44:20.881 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 4.3872238179999998, 2024-04-18T14:44:20.881 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.020409838999999999, 2024-04-18T14:44:20.881 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T14:44:20.881 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-04-18T14:44:20.881 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-18T14:44:20.881 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4559", 2024-04-18T14:44:20.881 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/3113589487", 2024-04-18T14:44:20.881 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 828 2024-04-18T14:44:20.881 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:20.881 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T14:44:20.881 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:20.881 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T14:44:20.882 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:16.418005+0000", 2024-04-18T14:44:20.882 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:44:20.882 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:20.882 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:20.882 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T14:44:20.882 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:16.418005+0000", 2024-04-18T14:44:20.882 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:44:20.882 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:20.882 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:20.882 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T14:44:20.882 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:16.418003+0000", 2024-04-18T14:44:20.882 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999986 2024-04-18T14:44:20.882 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:20.882 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:20.882 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T14:44:20.883 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:16.418010+0000", 2024-04-18T14:44:20.883 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.9569999999999996e-06 2024-04-18T14:44:20.883 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:20.883 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:20.883 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T14:44:20.883 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:16.418020+0000", 2024-04-18T14:44:20.883 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0216e-05 2024-04-18T14:44:20.883 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:20.883 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:20.883 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T14:44:20.883 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:16.418028+0000", 2024-04-18T14:44:20.883 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.6839999999999996e-06 2024-04-18T14:44:20.883 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:20.883 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:20.884 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T14:44:20.884 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:16.418163+0000", 2024-04-18T14:44:20.884 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00013478900000000001 2024-04-18T14:44:20.884 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:20.884 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:20.884 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting_for_map not empty", 2024-04-18T14:44:20.884 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:16.418173+0000", 2024-04-18T14:44:20.884 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0146000000000001e-05 2024-04-18T14:44:20.884 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:20.884 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:20.884 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T14:44:20.884 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:16.426079+0000", 2024-04-18T14:44:20.884 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0079063499999999995 2024-04-18T14:44:20.884 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:20.884 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:20.884 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T14:44:20.885 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:16.426180+0000", 2024-04-18T14:44:20.885 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00010063799999999999 2024-04-18T14:44:20.885 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:20.885 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:20.885 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T14:44:20.885 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:16.438414+0000", 2024-04-18T14:44:20.885 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.012234602000000001 2024-04-18T14:44:20.885 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:44:20.885 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T14:44:20.885 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:44:20.885 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:20.885 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:20.885 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4559.0:842 3.cs0 3:328b7efa:::smithi13430248-27:head [read 0~2523136,checksum] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e77)", 2024-04-18T14:44:20.885 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T14:44:16.443103+0000", 2024-04-18T14:44:20.885 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 4.3621251890000003, 2024-04-18T14:44:20.886 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.015944028999999998, 2024-04-18T14:44:20.886 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T14:44:20.886 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-04-18T14:44:20.886 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-18T14:44:20.886 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4559", 2024-04-18T14:44:20.886 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/3113589487", 2024-04-18T14:44:20.886 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 842 2024-04-18T14:44:20.886 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:20.886 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T14:44:20.886 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:20.886 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T14:44:20.886 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:16.443103+0000", 2024-04-18T14:44:20.886 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:44:20.886 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:20.886 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:20.886 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T14:44:20.887 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:16.443103+0000", 2024-04-18T14:44:20.887 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:44:20.887 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:20.887 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:20.887 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T14:44:20.887 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:16.443102+0000", 2024-04-18T14:44:20.887 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999986 2024-04-18T14:44:20.887 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:20.887 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:20.887 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T14:44:20.887 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:16.443115+0000", 2024-04-18T14:44:20.887 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3176999999999999e-05 2024-04-18T14:44:20.887 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:20.887 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:20.888 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T14:44:20.888 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:16.443133+0000", 2024-04-18T14:44:20.888 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.7586000000000001e-05 2024-04-18T14:44:20.888 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:20.888 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:20.888 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T14:44:20.888 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:16.443147+0000", 2024-04-18T14:44:20.888 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.438e-05 2024-04-18T14:44:20.888 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:20.888 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:20.888 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T14:44:20.888 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:16.443779+0000", 2024-04-18T14:44:20.888 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000632209 2024-04-18T14:44:20.888 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:20.889 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:20.889 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T14:44:20.889 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:16.443889+0000", 2024-04-18T14:44:20.889 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000109271 2024-04-18T14:44:20.889 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:20.889 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:20.889 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T14:44:20.889 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:16.459047+0000", 2024-04-18T14:44:20.889 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.015158713000000001 2024-04-18T14:44:20.889 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:44:20.889 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T14:44:20.889 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:44:20.889 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:20.889 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:20.889 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4559.0:843 3.cs0 3:328b7efa:::smithi13430248-27:head [read 0~2523136,checksum] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e77)", 2024-04-18T14:44:20.889 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T14:44:16.443160+0000", 2024-04-18T14:44:20.890 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 4.3620683700000003, 2024-04-18T14:44:20.890 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.019859727000000001, 2024-04-18T14:44:20.890 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T14:44:20.890 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-04-18T14:44:20.890 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-18T14:44:20.890 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4559", 2024-04-18T14:44:20.890 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/3113589487", 2024-04-18T14:44:20.890 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 843 2024-04-18T14:44:20.890 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:20.890 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T14:44:20.890 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:20.890 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T14:44:20.890 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:16.443160+0000", 2024-04-18T14:44:20.890 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:44:20.890 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:20.891 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:20.891 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T14:44:20.891 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:16.443160+0000", 2024-04-18T14:44:20.891 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:44:20.891 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:20.891 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:20.891 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T14:44:20.891 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:16.443159+0000", 2024-04-18T14:44:20.891 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999986 2024-04-18T14:44:20.891 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:20.891 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:20.891 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T14:44:20.891 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:16.443166+0000", 2024-04-18T14:44:20.891 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.9269999999999999e-06 2024-04-18T14:44:20.891 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:20.891 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:20.892 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T14:44:20.892 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:16.443183+0000", 2024-04-18T14:44:20.892 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.7082999999999999e-05 2024-04-18T14:44:20.892 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:20.892 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:20.892 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T14:44:20.892 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:16.443195+0000", 2024-04-18T14:44:20.892 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2333e-05 2024-04-18T14:44:20.892 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:20.892 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:20.892 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T14:44:20.892 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:16.447650+0000", 2024-04-18T14:44:20.892 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0044547989999999997 2024-04-18T14:44:20.892 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:20.892 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:20.892 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T14:44:20.893 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:16.447875+0000", 2024-04-18T14:44:20.893 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00022536799999999999 2024-04-18T14:44:20.893 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:20.893 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:20.893 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T14:44:20.893 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:16.463020+0000", 2024-04-18T14:44:20.893 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.015144427 2024-04-18T14:44:20.893 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:44:20.893 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T14:44:20.893 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:44:20.893 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:20.893 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:20.893 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4559.0:903 3.fs0 3:f96dd092:::smithi13430248-22:head [rollback 1c] snapc 30=[30,2c,2b,2a,29,28,27,26,22,1e,1c,1a,14,13,11] ondisk+write+known_if_redirected+supports_pool_eio e81)", 2024-04-18T14:44:20.893 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T14:44:20.520939+0000", 2024-04-18T14:44:20.893 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.28428913, 2024-04-18T14:44:20.893 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.016115050999999998, 2024-04-18T14:44:20.894 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T14:44:20.894 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T14:44:20.894 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-18T14:44:20.894 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4559", 2024-04-18T14:44:20.894 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/3113589487", 2024-04-18T14:44:20.894 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 903 2024-04-18T14:44:20.894 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:20.894 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T14:44:20.894 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:20.894 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T14:44:20.894 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:20.520939+0000", 2024-04-18T14:44:20.894 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:44:20.894 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:20.894 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:20.895 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T14:44:20.895 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:20.520939+0000", 2024-04-18T14:44:20.895 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:44:20.895 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:20.895 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:20.895 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T14:44:20.895 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:20.520939+0000", 2024-04-18T14:44:20.895 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-04-18T14:44:20.895 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:20.895 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:20.895 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T14:44:20.895 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:20.520942+0000", 2024-04-18T14:44:20.895 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.811e-06 2024-04-18T14:44:20.895 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:20.895 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:20.896 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T14:44:20.896 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:20.520952+0000", 2024-04-18T14:44:20.896 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.0720000000000006e-06 2024-04-18T14:44:20.896 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:20.896 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:20.896 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T14:44:20.896 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:20.520959+0000", 2024-04-18T14:44:20.896 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.4410000000000004e-06 2024-04-18T14:44:20.896 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:20.896 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:20.896 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T14:44:20.896 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:20.522735+0000", 2024-04-18T14:44:20.896 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0017760129999999999 2024-04-18T14:44:20.897 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:20.897 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:20.897 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T14:44:20.897 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:20.522864+0000", 2024-04-18T14:44:20.897 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00012851900000000001 2024-04-18T14:44:20.897 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:20.897 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:20.897 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_started", 2024-04-18T14:44:20.897 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:20.523500+0000", 2024-04-18T14:44:20.897 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000636588 2024-04-18T14:44:20.897 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:20.898 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:20.898 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_committed", 2024-04-18T14:44:20.898 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:20.525105+0000", 2024-04-18T14:44:20.898 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.001604538 2024-04-18T14:44:20.898 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:20.898 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:20.898 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T14:44:20.898 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:20.536969+0000", 2024-04-18T14:44:20.898 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.011863863000000001 2024-04-18T14:44:20.898 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:20.898 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:20.898 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T14:44:20.898 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:20.537054+0000", 2024-04-18T14:44:20.898 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.5847000000000007e-05 2024-04-18T14:44:20.899 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:44:20.899 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T14:44:20.899 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:44:20.899 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:20.899 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:20.899 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4559.0:904 3.fs0 3:f96dd092:::smithi13430248-22:head [append 0~0] snapc 30=[30,2c,2b,2a,29,28,27,26,22,1e,1c,1a,14,13,11] ondisk+write+known_if_redirected+supports_pool_eio e81)", 2024-04-18T14:44:20.899 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T14:44:20.521012+0000", 2024-04-18T14:44:20.899 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.284215999, 2024-04-18T14:44:20.899 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.016191146, 2024-04-18T14:44:20.899 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T14:44:20.899 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T14:44:20.899 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-18T14:44:20.899 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4559", 2024-04-18T14:44:20.899 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/3113589487", 2024-04-18T14:44:20.899 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 904 2024-04-18T14:44:20.900 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:20.900 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T14:44:20.900 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:20.900 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T14:44:20.900 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:20.521012+0000", 2024-04-18T14:44:20.900 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:44:20.900 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:20.900 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:20.900 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T14:44:20.900 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:20.521012+0000", 2024-04-18T14:44:20.900 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:44:20.900 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:20.900 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:20.900 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T14:44:20.900 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:20.521012+0000", 2024-04-18T14:44:20.901 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-18T14:44:20.901 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:20.901 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:20.901 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T14:44:20.901 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:20.521017+0000", 2024-04-18T14:44:20.901 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.6860000000000003e-06 2024-04-18T14:44:20.901 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:20.901 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:20.901 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T14:44:20.901 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:20.521031+0000", 2024-04-18T14:44:20.901 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.413e-05 2024-04-18T14:44:20.901 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:20.901 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:20.901 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T14:44:20.901 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:20.521048+0000", 2024-04-18T14:44:20.901 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6667000000000002e-05 2024-04-18T14:44:20.902 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:20.902 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:20.902 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T14:44:20.902 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:20.524021+0000", 2024-04-18T14:44:20.902 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0029729209999999999 2024-04-18T14:44:20.902 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:20.902 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:20.902 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T14:44:20.902 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:20.524135+0000", 2024-04-18T14:44:20.902 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000113853 2024-04-18T14:44:20.902 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:20.902 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:20.902 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_started", 2024-04-18T14:44:20.903 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:20.524794+0000", 2024-04-18T14:44:20.903 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00065951900000000001 2024-04-18T14:44:20.903 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:20.903 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:20.903 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_committed", 2024-04-18T14:44:20.903 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:20.526567+0000", 2024-04-18T14:44:20.903 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0017724710000000001 2024-04-18T14:44:20.903 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:20.903 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:20.903 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T14:44:20.903 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:20.537154+0000", 2024-04-18T14:44:20.903 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.010587376000000001 2024-04-18T14:44:20.903 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:20.903 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:20.904 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T14:44:20.904 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:20.537204+0000", 2024-04-18T14:44:20.904 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.9422999999999998e-05 2024-04-18T14:44:20.904 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:44:20.904 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T14:44:20.904 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:44:20.904 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:44:20.904 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T14:44:20.904 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-04-18T14:44:20.906 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.15.asok dump_ops_in_flight 2024-04-18T14:44:20.906 INFO:tasks.ceph.osd.0.smithi086.stderr:2024-04-18T14:44:20.905+0000 7f7cdfd78640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 24953) UID: 0 2024-04-18T14:44:21.007 INFO:tasks.ceph.osd.8.smithi086.stderr:2024-04-18T14:44:21.005+0000 7f29f7b9d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 8 (PID: 24958) UID: 0 2024-04-18T14:44:21.031 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-04-18T14:44:21.031 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [], 2024-04-18T14:44:21.031 INFO:teuthology.orchestra.run.smithi134.stdout: "num_ops": 0 2024-04-18T14:44:21.031 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-04-18T14:44:21.045 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.15.asok dump_blocked_ops 2024-04-18T14:44:21.108 INFO:tasks.ceph.osd.2.smithi119.stderr:2024-04-18T14:44:21.110+0000 7fcbd30c0640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 24894) UID: 0 2024-04-18T14:44:21.159 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-04-18T14:44:21.159 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [], 2024-04-18T14:44:21.159 INFO:teuthology.orchestra.run.smithi134.stdout: "complaint_time": 30, 2024-04-18T14:44:21.159 INFO:teuthology.orchestra.run.smithi134.stdout: "num_blocked_ops": 0 2024-04-18T14:44:21.159 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-04-18T14:44:21.173 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.15.asok dump_historic_ops 2024-04-18T14:44:21.218 INFO:tasks.ceph.osd.3.smithi134.stderr:2024-04-18T14:44:21.224+0000 7fe7a4443640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25211) UID: 0 2024-04-18T14:44:21.290 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-04-18T14:44:21.290 INFO:teuthology.orchestra.run.smithi134.stdout: "size": 20, 2024-04-18T14:44:21.290 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 600, 2024-04-18T14:44:21.290 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [ 2024-04-18T14:44:21.290 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:21.290 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4559.0:326 3.5s0 3:ae89639c:::smithi13430248-39:head [copy-from ver 42] snapc f=[f,b,a,8,7,2] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-04-18T14:44:21.290 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T14:43:46.376277+0000", 2024-04-18T14:44:21.290 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 34.917459391999998, 2024-04-18T14:44:21.290 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.025187043999999999, 2024-04-18T14:44:21.290 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T14:44:21.290 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T14:44:21.291 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-18T14:44:21.291 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4559", 2024-04-18T14:44:21.291 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/3113589487", 2024-04-18T14:44:21.291 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 326 2024-04-18T14:44:21.291 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:21.291 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T14:44:21.291 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:21.291 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T14:44:21.291 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:46.376277+0000", 2024-04-18T14:44:21.291 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:44:21.292 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:21.292 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:21.292 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T14:44:21.292 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:46.376277+0000", 2024-04-18T14:44:21.292 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:44:21.292 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:21.292 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:21.292 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T14:44:21.292 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:46.376274+0000", 2024-04-18T14:44:21.292 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999967 2024-04-18T14:44:21.292 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:21.292 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:21.292 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T14:44:21.292 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:46.376290+0000", 2024-04-18T14:44:21.292 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5639999999999999e-05 2024-04-18T14:44:21.293 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:21.293 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:21.293 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T14:44:21.293 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:46.376350+0000", 2024-04-18T14:44:21.293 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.0446999999999999e-05 2024-04-18T14:44:21.293 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:21.293 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:21.293 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T14:44:21.293 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:46.376368+0000", 2024-04-18T14:44:21.293 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.7677e-05 2024-04-18T14:44:21.293 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:21.293 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:21.293 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T14:44:21.293 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:46.376519+0000", 2024-04-18T14:44:21.293 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00015141300000000001 2024-04-18T14:44:21.294 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:21.294 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:21.294 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op must wait for map", 2024-04-18T14:44:21.294 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:46.376542+0000", 2024-04-18T14:44:21.294 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2833999999999999e-05 2024-04-18T14:44:21.294 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:21.294 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:21.294 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T14:44:21.294 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:46.380859+0000", 2024-04-18T14:44:21.294 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0043166309999999996 2024-04-18T14:44:21.294 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:21.294 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:21.294 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T14:44:21.294 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:46.381129+0000", 2024-04-18T14:44:21.295 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00027035200000000002 2024-04-18T14:44:21.295 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:21.295 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:21.295 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_started", 2024-04-18T14:44:21.295 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:46.394910+0000", 2024-04-18T14:44:21.295 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.013780621 2024-04-18T14:44:21.295 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:21.295 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:21.295 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_committed", 2024-04-18T14:44:21.295 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:46.398694+0000", 2024-04-18T14:44:21.295 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0037836419999999998 2024-04-18T14:44:21.295 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:21.295 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:21.295 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T14:44:21.295 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:46.401340+0000", 2024-04-18T14:44:21.296 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0026460899999999998 2024-04-18T14:44:21.296 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:21.296 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:21.296 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T14:44:21.296 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:46.401464+0000", 2024-04-18T14:44:21.296 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000124867 2024-04-18T14:44:21.296 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:44:21.296 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T14:44:21.296 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:44:21.296 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:21.296 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:21.296 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4559.0:327 3.5s0 3:ae89639c:::smithi13430248-39:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e47)", 2024-04-18T14:44:21.296 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T14:43:46.376390+0000", 2024-04-18T14:44:21.296 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 34.917346653999999, 2024-04-18T14:44:21.296 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.022295908999999999, 2024-04-18T14:44:21.297 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T14:44:21.297 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-04-18T14:44:21.297 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-18T14:44:21.297 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4559", 2024-04-18T14:44:21.297 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/3113589487", 2024-04-18T14:44:21.297 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 327 2024-04-18T14:44:21.297 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:21.297 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T14:44:21.297 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:21.297 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T14:44:21.297 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:46.376390+0000", 2024-04-18T14:44:21.297 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:44:21.297 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:21.297 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:21.297 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T14:44:21.298 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:46.376390+0000", 2024-04-18T14:44:21.298 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:44:21.298 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:21.298 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:21.298 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T14:44:21.298 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:46.376389+0000", 2024-04-18T14:44:21.298 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-18T14:44:21.298 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:21.298 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:21.298 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T14:44:21.298 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:46.376394+0000", 2024-04-18T14:44:21.298 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.3639999999999998e-06 2024-04-18T14:44:21.298 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:21.298 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:21.298 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T14:44:21.298 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:46.376406+0000", 2024-04-18T14:44:21.299 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2055999999999999e-05 2024-04-18T14:44:21.299 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:21.299 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:21.299 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T14:44:21.299 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:46.376417+0000", 2024-04-18T14:44:21.299 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0847e-05 2024-04-18T14:44:21.299 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:21.299 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:21.299 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T14:44:21.299 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:46.376676+0000", 2024-04-18T14:44:21.299 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00025870199999999998 2024-04-18T14:44:21.299 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:21.299 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:21.299 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting_for_map not empty", 2024-04-18T14:44:21.299 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:46.376688+0000", 2024-04-18T14:44:21.300 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1783000000000001e-05 2024-04-18T14:44:21.300 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:21.300 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:21.300 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T14:44:21.300 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:46.381511+0000", 2024-04-18T14:44:21.300 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0048235259999999999 2024-04-18T14:44:21.300 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:21.300 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:21.300 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for blocked object", 2024-04-18T14:44:21.300 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:46.381560+0000", 2024-04-18T14:44:21.300 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.9070999999999998e-05 2024-04-18T14:44:21.300 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:21.300 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:21.300 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T14:44:21.300 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:46.397940+0000", 2024-04-18T14:44:21.300 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.016379946999999999 2024-04-18T14:44:21.301 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:21.301 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:21.301 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T14:44:21.301 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:46.398249+0000", 2024-04-18T14:44:21.301 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00030838799999999999 2024-04-18T14:44:21.301 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:21.301 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:21.301 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T14:44:21.301 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:46.398686+0000", 2024-04-18T14:44:21.301 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00043738499999999999 2024-04-18T14:44:21.301 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:44:21.301 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T14:44:21.301 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:44:21.301 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:21.301 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:21.301 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "MOSDECSubOpWrite(3.6s3 63/30 ECSubWrite(tid=163, reqid=osd.14.0:163, at_version=63'60, trim_to=0'0, roll_forward_to=59'56))", 2024-04-18T14:44:21.302 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T14:44:02.394054+0000", 2024-04-18T14:44:21.302 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 18.899682542000001, 2024-04-18T14:44:21.302 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.012413759999999999, 2024-04-18T14:44:21.302 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T14:44:21.302 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-04-18T14:44:21.302 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T14:44:21.302 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:21.302 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T14:44:21.302 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:02.394054+0000", 2024-04-18T14:44:21.302 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:44:21.302 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:21.302 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:21.302 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T14:44:21.302 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:02.394054+0000", 2024-04-18T14:44:21.302 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:44:21.303 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:21.303 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:21.303 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T14:44:21.303 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:02.394053+0000", 2024-04-18T14:44:21.303 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999986 2024-04-18T14:44:21.303 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:21.303 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:21.303 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T14:44:21.303 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:02.394102+0000", 2024-04-18T14:44:21.303 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.9339999999999999e-05 2024-04-18T14:44:21.303 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:21.303 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:21.303 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T14:44:21.303 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:02.394130+0000", 2024-04-18T14:44:21.303 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.7749000000000001e-05 2024-04-18T14:44:21.304 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:21.304 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:21.304 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T14:44:21.304 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:02.394152+0000", 2024-04-18T14:44:21.304 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.1756999999999999e-05 2024-04-18T14:44:21.304 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:21.304 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:21.304 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T14:44:21.304 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:02.394337+0000", 2024-04-18T14:44:21.304 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000185625 2024-04-18T14:44:21.304 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:21.304 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:21.304 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_started", 2024-04-18T14:44:21.304 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:02.394362+0000", 2024-04-18T14:44:21.304 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.5007e-05 2024-04-18T14:44:21.305 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:21.305 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:21.305 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_committed", 2024-04-18T14:44:21.305 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:02.406408+0000", 2024-04-18T14:44:21.305 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.012045190000000001 2024-04-18T14:44:21.305 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:21.305 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:21.305 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T14:44:21.305 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:02.406468+0000", 2024-04-18T14:44:21.305 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.0472e-05 2024-04-18T14:44:21.305 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:44:21.305 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T14:44:21.305 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:44:21.305 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:21.305 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:21.306 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "MOSDECSubOpWrite(3.3s3 63/30 ECSubWrite(tid=231, reqid=osd.13.0:231, at_version=63'29, trim_to=0'0, roll_forward_to=61'27))", 2024-04-18T14:44:21.306 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T14:44:02.398339+0000", 2024-04-18T14:44:21.306 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 18.895397402, 2024-04-18T14:44:21.306 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.01375418, 2024-04-18T14:44:21.306 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T14:44:21.306 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-04-18T14:44:21.306 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T14:44:21.306 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:21.306 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T14:44:21.306 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:02.398339+0000", 2024-04-18T14:44:21.306 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:44:21.306 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:21.306 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:21.306 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T14:44:21.306 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:02.398339+0000", 2024-04-18T14:44:21.307 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:44:21.307 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:21.307 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:21.307 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T14:44:21.307 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:02.398339+0000", 2024-04-18T14:44:21.307 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-18T14:44:21.307 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:21.307 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:21.307 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T14:44:21.307 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:02.398392+0000", 2024-04-18T14:44:21.307 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.3430000000000002e-05 2024-04-18T14:44:21.307 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:21.307 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:21.307 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T14:44:21.307 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:02.398419+0000", 2024-04-18T14:44:21.307 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.6775999999999999e-05 2024-04-18T14:44:21.308 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:21.308 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:21.308 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T14:44:21.308 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:02.398441+0000", 2024-04-18T14:44:21.308 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.1710000000000001e-05 2024-04-18T14:44:21.308 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:21.308 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:21.308 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T14:44:21.308 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:02.398584+0000", 2024-04-18T14:44:21.308 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000143616 2024-04-18T14:44:21.308 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:21.308 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:21.308 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_started", 2024-04-18T14:44:21.308 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:02.398611+0000", 2024-04-18T14:44:21.308 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.6869e-05 2024-04-18T14:44:21.309 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:21.309 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:21.309 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_committed", 2024-04-18T14:44:21.309 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:02.412007+0000", 2024-04-18T14:44:21.309 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.013396379 2024-04-18T14:44:21.309 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:21.309 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:21.309 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T14:44:21.309 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:02.412094+0000", 2024-04-18T14:44:21.309 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.6130000000000004e-05 2024-04-18T14:44:21.309 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:44:21.309 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T14:44:21.309 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:44:21.309 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:21.309 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:21.310 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "MOSDECSubOpWrite(3.9s4 63/30 ECSubWrite(tid=118, reqid=osd.12.0:118, at_version=63'88, trim_to=0'0, roll_forward_to=62'86))", 2024-04-18T14:44:21.310 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T14:44:02.399133+0000", 2024-04-18T14:44:21.310 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 18.894603952000001, 2024-04-18T14:44:21.310 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.01333911, 2024-04-18T14:44:21.310 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T14:44:21.310 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-04-18T14:44:21.310 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T14:44:21.310 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:21.310 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T14:44:21.310 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:02.399133+0000", 2024-04-18T14:44:21.310 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:44:21.310 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:21.310 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:21.310 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T14:44:21.310 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:02.399133+0000", 2024-04-18T14:44:21.311 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:44:21.311 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:21.311 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:21.311 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T14:44:21.311 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:02.399132+0000", 2024-04-18T14:44:21.311 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999986 2024-04-18T14:44:21.311 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:21.311 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:21.311 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T14:44:21.311 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:02.399183+0000", 2024-04-18T14:44:21.311 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.0986000000000003e-05 2024-04-18T14:44:21.311 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:21.311 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:21.311 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T14:44:21.311 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:02.399215+0000", 2024-04-18T14:44:21.312 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.2094000000000001e-05 2024-04-18T14:44:21.312 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:21.312 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:21.312 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T14:44:21.312 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:02.399237+0000", 2024-04-18T14:44:21.312 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2028999999999999e-05 2024-04-18T14:44:21.312 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:21.312 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:21.312 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T14:44:21.312 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:02.399457+0000", 2024-04-18T14:44:21.312 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00022015899999999999 2024-04-18T14:44:21.312 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:21.312 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:21.312 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_started", 2024-04-18T14:44:21.312 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:02.399483+0000", 2024-04-18T14:44:21.312 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.6529e-05 2024-04-18T14:44:21.313 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:21.313 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:21.313 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_committed", 2024-04-18T14:44:21.313 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:02.412406+0000", 2024-04-18T14:44:21.313 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.012922593 2024-04-18T14:44:21.313 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:21.313 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:21.313 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T14:44:21.313 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:02.412472+0000", 2024-04-18T14:44:21.313 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.6045999999999998e-05 2024-04-18T14:44:21.313 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:44:21.313 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T14:44:21.313 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:44:21.313 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:21.313 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:21.314 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "MOSDECSubOpWrite(3.8s5 63/30 ECSubWrite(tid=99, reqid=osd.5.0:99, at_version=63'73, trim_to=0'0, roll_forward_to=59'70))", 2024-04-18T14:44:21.314 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T14:44:02.399425+0000", 2024-04-18T14:44:21.314 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 18.894311526999999, 2024-04-18T14:44:21.314 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.015057716000000001, 2024-04-18T14:44:21.314 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T14:44:21.314 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-04-18T14:44:21.314 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T14:44:21.314 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:21.314 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T14:44:21.314 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:02.399425+0000", 2024-04-18T14:44:21.314 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:44:21.314 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:21.314 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:21.314 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T14:44:21.314 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:02.399425+0000", 2024-04-18T14:44:21.315 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:44:21.315 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:21.315 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:21.315 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T14:44:21.315 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:02.399425+0000", 2024-04-18T14:44:21.315 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-04-18T14:44:21.315 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:21.315 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:21.315 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T14:44:21.315 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:02.399488+0000", 2024-04-18T14:44:21.315 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.3788999999999995e-05 2024-04-18T14:44:21.315 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:21.315 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:21.315 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T14:44:21.315 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:02.399521+0000", 2024-04-18T14:44:21.316 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.2243000000000003e-05 2024-04-18T14:44:21.316 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:21.316 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:21.316 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T14:44:21.316 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:02.399544+0000", 2024-04-18T14:44:21.316 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.336e-05 2024-04-18T14:44:21.316 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:21.316 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:21.316 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T14:44:21.316 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:02.399661+0000", 2024-04-18T14:44:21.316 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000117229 2024-04-18T14:44:21.316 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:21.316 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:21.316 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_started", 2024-04-18T14:44:21.316 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:02.399685+0000", 2024-04-18T14:44:21.316 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.3802999999999999e-05 2024-04-18T14:44:21.317 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:21.317 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:21.317 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_committed", 2024-04-18T14:44:21.317 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:02.414425+0000", 2024-04-18T14:44:21.317 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.014740379 2024-04-18T14:44:21.317 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:21.317 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:21.317 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T14:44:21.317 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:02.414483+0000", 2024-04-18T14:44:21.317 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.7596000000000002e-05 2024-04-18T14:44:21.317 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:44:21.317 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T14:44:21.317 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:44:21.317 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:21.317 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:21.318 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "MOSDECSubOpWrite(3.9s4 68/30 ECSubWrite(tid=141, reqid=osd.12.0:141, at_version=68'113, trim_to=0'0, roll_forward_to=67'111))", 2024-04-18T14:44:21.318 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T14:44:07.399101+0000", 2024-04-18T14:44:21.318 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 13.894636273, 2024-04-18T14:44:21.318 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.018196561999999999, 2024-04-18T14:44:21.318 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T14:44:21.318 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-04-18T14:44:21.318 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T14:44:21.318 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:21.318 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T14:44:21.318 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:07.399101+0000", 2024-04-18T14:44:21.318 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:44:21.318 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:21.318 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:21.318 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T14:44:21.318 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:07.399101+0000", 2024-04-18T14:44:21.319 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:44:21.319 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:21.319 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:21.319 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T14:44:21.319 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:07.399099+0000", 2024-04-18T14:44:21.319 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-18T14:44:21.319 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:21.319 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:21.319 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T14:44:21.319 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:07.399154+0000", 2024-04-18T14:44:21.319 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.4379999999999998e-05 2024-04-18T14:44:21.319 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:21.319 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:21.319 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T14:44:21.320 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:07.399182+0000", 2024-04-18T14:44:21.320 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.8013000000000001e-05 2024-04-18T14:44:21.320 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:21.320 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:21.320 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T14:44:21.320 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:07.399204+0000", 2024-04-18T14:44:21.320 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2082e-05 2024-04-18T14:44:21.320 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:21.320 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:21.320 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T14:44:21.320 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:07.399453+0000", 2024-04-18T14:44:21.320 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00024898200000000002 2024-04-18T14:44:21.320 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:21.320 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:21.320 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_started", 2024-04-18T14:44:21.321 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:07.399482+0000", 2024-04-18T14:44:21.321 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.8883000000000001e-05 2024-04-18T14:44:21.321 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:21.321 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:21.321 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_committed", 2024-04-18T14:44:21.321 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:07.417250+0000", 2024-04-18T14:44:21.321 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.017767921999999998 2024-04-18T14:44:21.321 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:21.321 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:21.321 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T14:44:21.321 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:07.417297+0000", 2024-04-18T14:44:21.321 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.7403e-05 2024-04-18T14:44:21.321 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:44:21.321 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T14:44:21.321 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:44:21.322 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:21.322 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:21.322 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "MOSDECSubOpWrite(3.9s4 68/30 ECSubWrite(tid=142, reqid=osd.12.0:142, at_version=68'115, trim_to=0'0, roll_forward_to=67'111))", 2024-04-18T14:44:21.322 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T14:44:07.399244+0000", 2024-04-18T14:44:21.322 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 13.894493224, 2024-04-18T14:44:21.322 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.024403233, 2024-04-18T14:44:21.322 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T14:44:21.322 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-04-18T14:44:21.322 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T14:44:21.322 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:21.322 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T14:44:21.322 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:07.399244+0000", 2024-04-18T14:44:21.322 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:44:21.322 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:21.322 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:21.323 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T14:44:21.323 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:07.399244+0000", 2024-04-18T14:44:21.323 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:44:21.323 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:21.323 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:21.323 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T14:44:21.323 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:07.399242+0000", 2024-04-18T14:44:21.323 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-18T14:44:21.323 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:21.323 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:21.323 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T14:44:21.323 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:07.399292+0000", 2024-04-18T14:44:21.323 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.9252999999999998e-05 2024-04-18T14:44:21.323 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:21.323 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:21.323 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T14:44:21.324 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:07.399313+0000", 2024-04-18T14:44:21.324 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.1645999999999999e-05 2024-04-18T14:44:21.324 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:21.324 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:21.324 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T14:44:21.324 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:07.399336+0000", 2024-04-18T14:44:21.324 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2646e-05 2024-04-18T14:44:21.325 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:21.325 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:21.325 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T14:44:21.325 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:07.408814+0000", 2024-04-18T14:44:21.325 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0094779540000000002 2024-04-18T14:44:21.325 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:21.325 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:21.325 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_started", 2024-04-18T14:44:21.325 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:07.408840+0000", 2024-04-18T14:44:21.325 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.6452999999999999e-05 2024-04-18T14:44:21.325 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:21.326 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:21.326 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_committed", 2024-04-18T14:44:21.326 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:07.423578+0000", 2024-04-18T14:44:21.326 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.014737811999999999 2024-04-18T14:44:21.326 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:21.326 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:21.326 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T14:44:21.326 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:07.423647+0000", 2024-04-18T14:44:21.326 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.8602000000000005e-05 2024-04-18T14:44:21.326 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:44:21.326 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T14:44:21.326 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:44:21.326 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:21.326 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:21.327 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "MOSDECSubOpWrite(3.3s3 68/30 ECSubWrite(tid=247, reqid=osd.13.0:247, at_version=68'41, trim_to=0'0, roll_forward_to=65'39))", 2024-04-18T14:44:21.327 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T14:44:07.400499+0000", 2024-04-18T14:44:21.327 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 13.893238071000001, 2024-04-18T14:44:21.327 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.023442557999999999, 2024-04-18T14:44:21.327 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T14:44:21.327 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-04-18T14:44:21.327 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T14:44:21.327 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:21.327 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T14:44:21.327 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:07.400499+0000", 2024-04-18T14:44:21.327 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:44:21.327 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:21.327 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:21.328 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T14:44:21.328 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:07.400499+0000", 2024-04-18T14:44:21.328 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:44:21.328 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:21.328 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:21.328 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T14:44:21.328 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:07.400497+0000", 2024-04-18T14:44:21.328 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999981 2024-04-18T14:44:21.328 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:21.328 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:21.328 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T14:44:21.328 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:07.400553+0000", 2024-04-18T14:44:21.328 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.6039999999999999e-05 2024-04-18T14:44:21.328 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:21.328 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:21.328 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T14:44:21.329 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:07.400584+0000", 2024-04-18T14:44:21.329 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.1622999999999999e-05 2024-04-18T14:44:21.329 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:21.329 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:21.329 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T14:44:21.329 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:07.400607+0000", 2024-04-18T14:44:21.329 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2223000000000001e-05 2024-04-18T14:44:21.329 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:21.329 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:21.329 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T14:44:21.329 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:07.400803+0000", 2024-04-18T14:44:21.329 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000196725 2024-04-18T14:44:21.329 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:21.329 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:21.329 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_started", 2024-04-18T14:44:21.330 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:07.400829+0000", 2024-04-18T14:44:21.330 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.6020000000000002e-05 2024-04-18T14:44:21.330 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:21.330 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:21.330 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_committed", 2024-04-18T14:44:21.330 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:07.423902+0000", 2024-04-18T14:44:21.330 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.023072397000000001 2024-04-18T14:44:21.330 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:21.330 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:21.330 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T14:44:21.330 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:07.423941+0000", 2024-04-18T14:44:21.330 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.9613000000000002e-05 2024-04-18T14:44:21.330 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:44:21.330 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T14:44:21.331 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:44:21.331 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:21.331 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:21.331 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "MOSDECSubOpWrite(3.8s5 68/30 ECSubWrite(tid=140, reqid=osd.5.0:140, at_version=68'109, trim_to=0'0, roll_forward_to=67'105))", 2024-04-18T14:44:21.331 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T14:44:07.400701+0000", 2024-04-18T14:44:21.331 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 13.893035625, 2024-04-18T14:44:21.331 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.023150075999999999, 2024-04-18T14:44:21.331 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T14:44:21.331 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-04-18T14:44:21.331 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T14:44:21.331 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:21.331 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T14:44:21.331 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:07.400701+0000", 2024-04-18T14:44:21.331 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:44:21.331 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:21.331 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:21.332 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T14:44:21.332 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:07.400701+0000", 2024-04-18T14:44:21.332 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:44:21.332 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:21.332 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:21.332 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T14:44:21.332 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:07.400700+0000", 2024-04-18T14:44:21.332 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-18T14:44:21.332 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:21.332 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:21.332 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T14:44:21.332 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:07.400736+0000", 2024-04-18T14:44:21.332 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.5836e-05 2024-04-18T14:44:21.332 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:21.332 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:21.332 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T14:44:21.333 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:07.400757+0000", 2024-04-18T14:44:21.333 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.1287000000000001e-05 2024-04-18T14:44:21.333 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:21.333 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:21.333 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T14:44:21.333 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:07.400775+0000", 2024-04-18T14:44:21.333 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.7533e-05 2024-04-18T14:44:21.333 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:21.333 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:21.333 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T14:44:21.333 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:07.403766+0000", 2024-04-18T14:44:21.333 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.002991367 2024-04-18T14:44:21.333 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:21.333 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:21.333 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_started", 2024-04-18T14:44:21.333 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:07.403794+0000", 2024-04-18T14:44:21.334 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.724e-05 2024-04-18T14:44:21.334 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:21.334 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:21.334 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_committed", 2024-04-18T14:44:21.334 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:07.423781+0000", 2024-04-18T14:44:21.334 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.019987340999999999 2024-04-18T14:44:21.334 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:21.334 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:21.334 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T14:44:21.334 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:07.423851+0000", 2024-04-18T14:44:21.334 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.0378999999999998e-05 2024-04-18T14:44:21.334 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:44:21.334 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T14:44:21.334 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:44:21.335 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:21.335 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:21.335 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "MOSDECSubOpWrite(3.2s4 68/30 ECSubWrite(tid=248, reqid=osd.13.0:248, at_version=68'39, trim_to=0'0, roll_forward_to=65'35))", 2024-04-18T14:44:21.335 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T14:44:07.401757+0000", 2024-04-18T14:44:21.335 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 13.89197998, 2024-04-18T14:44:21.335 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.024779440999999999, 2024-04-18T14:44:21.335 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T14:44:21.335 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-04-18T14:44:21.335 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T14:44:21.335 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:21.335 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T14:44:21.335 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:07.401757+0000", 2024-04-18T14:44:21.335 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:44:21.335 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:21.335 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:21.335 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T14:44:21.336 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:07.401757+0000", 2024-04-18T14:44:21.336 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:44:21.336 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:21.336 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:21.336 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T14:44:21.336 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:07.401755+0000", 2024-04-18T14:44:21.336 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999981 2024-04-18T14:44:21.336 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:21.336 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:21.336 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T14:44:21.336 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:07.401806+0000", 2024-04-18T14:44:21.336 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.0785999999999998e-05 2024-04-18T14:44:21.336 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:21.336 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:21.336 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T14:44:21.336 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:07.401839+0000", 2024-04-18T14:44:21.337 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.2663999999999998e-05 2024-04-18T14:44:21.337 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:21.337 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:21.337 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T14:44:21.337 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:07.401863+0000", 2024-04-18T14:44:21.337 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.41e-05 2024-04-18T14:44:21.337 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:21.337 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:21.337 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T14:44:21.337 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:07.403854+0000", 2024-04-18T14:44:21.337 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0019915200000000001 2024-04-18T14:44:21.337 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:21.337 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:21.337 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_started", 2024-04-18T14:44:21.337 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:07.403878+0000", 2024-04-18T14:44:21.337 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.3966999999999999e-05 2024-04-18T14:44:21.338 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:21.338 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:21.338 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_committed", 2024-04-18T14:44:21.338 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:07.426466+0000", 2024-04-18T14:44:21.338 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.022588177000000001 2024-04-18T14:44:21.338 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:21.338 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:21.338 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T14:44:21.338 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:07.426536+0000", 2024-04-18T14:44:21.338 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.9963999999999996e-05 2024-04-18T14:44:21.338 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:44:21.338 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T14:44:21.338 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:44:21.339 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:21.339 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:21.339 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "MOSDECSubOpWrite(3.3s3 68/30 ECSubWrite(tid=249, reqid=osd.13.0:249, at_version=68'43, trim_to=0'0, roll_forward_to=65'39))", 2024-04-18T14:44:21.339 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T14:44:07.402191+0000", 2024-04-18T14:44:21.339 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 13.891545624000001, 2024-04-18T14:44:21.339 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.029051054, 2024-04-18T14:44:21.339 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T14:44:21.339 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-04-18T14:44:21.339 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T14:44:21.339 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:21.339 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T14:44:21.339 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:07.402191+0000", 2024-04-18T14:44:21.340 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:44:21.340 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:21.340 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:21.340 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T14:44:21.340 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:07.402191+0000", 2024-04-18T14:44:21.340 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:44:21.340 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:21.340 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:21.340 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T14:44:21.340 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:07.402184+0000", 2024-04-18T14:44:21.340 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999933 2024-04-18T14:44:21.340 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:21.340 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:21.341 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T14:44:21.341 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:07.402242+0000", 2024-04-18T14:44:21.341 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.7689999999999998e-05 2024-04-18T14:44:21.341 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:21.341 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:21.341 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T14:44:21.341 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:07.402275+0000", 2024-04-18T14:44:21.341 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.3115999999999999e-05 2024-04-18T14:44:21.341 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:21.341 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:21.341 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T14:44:21.341 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:07.402303+0000", 2024-04-18T14:44:21.341 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.7710000000000001e-05 2024-04-18T14:44:21.341 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:21.341 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:21.341 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T14:44:21.341 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:07.410513+0000", 2024-04-18T14:44:21.342 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0082100230000000003 2024-04-18T14:44:21.342 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:21.342 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:21.342 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_started", 2024-04-18T14:44:21.342 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:07.410537+0000", 2024-04-18T14:44:21.342 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.4202999999999998e-05 2024-04-18T14:44:21.342 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:21.342 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:21.342 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_committed", 2024-04-18T14:44:21.342 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:07.431171+0000", 2024-04-18T14:44:21.342 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.02063361 2024-04-18T14:44:21.342 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:21.342 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:21.342 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T14:44:21.342 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:07.431242+0000", 2024-04-18T14:44:21.343 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.1454999999999999e-05 2024-04-18T14:44:21.343 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:44:21.343 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T14:44:21.343 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:44:21.343 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:21.343 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:21.343 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "MOSDECSubOpWrite(3.6s3 68/30 ECSubWrite(tid=204, reqid=osd.14.0:202, at_version=0'0, trim_to=0'0, roll_forward_to=68'85))", 2024-04-18T14:44:21.343 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T14:44:07.416670+0000", 2024-04-18T14:44:21.343 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 13.877066633, 2024-04-18T14:44:21.343 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.021911661999999998, 2024-04-18T14:44:21.343 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T14:44:21.343 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-04-18T14:44:21.343 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T14:44:21.343 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:21.343 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T14:44:21.344 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:07.416670+0000", 2024-04-18T14:44:21.344 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:44:21.344 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:21.344 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:21.344 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T14:44:21.344 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:07.416670+0000", 2024-04-18T14:44:21.344 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:44:21.344 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:21.344 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:21.344 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T14:44:21.344 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:07.416662+0000", 2024-04-18T14:44:21.344 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999919 2024-04-18T14:44:21.344 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:21.344 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:21.344 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T14:44:21.345 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:07.416699+0000", 2024-04-18T14:44:21.345 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.6726e-05 2024-04-18T14:44:21.345 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:21.345 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:21.345 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T14:44:21.345 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:07.416776+0000", 2024-04-18T14:44:21.345 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.7669999999999993e-05 2024-04-18T14:44:21.345 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:21.345 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:21.345 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T14:44:21.345 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:07.416800+0000", 2024-04-18T14:44:21.345 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.3949999999999999e-05 2024-04-18T14:44:21.345 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:21.345 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:21.345 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T14:44:21.345 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:07.416934+0000", 2024-04-18T14:44:21.346 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00013330199999999999 2024-04-18T14:44:21.346 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:21.346 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:21.346 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_started", 2024-04-18T14:44:21.346 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:07.416960+0000", 2024-04-18T14:44:21.346 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.5976e-05 2024-04-18T14:44:21.346 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:21.346 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:21.346 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_committed", 2024-04-18T14:44:21.346 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:07.438526+0000", 2024-04-18T14:44:21.346 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.021565937 2024-04-18T14:44:21.346 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:21.346 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:21.346 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T14:44:21.346 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:07.438582+0000", 2024-04-18T14:44:21.347 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.6190999999999998e-05 2024-04-18T14:44:21.347 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:44:21.347 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T14:44:21.347 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:44:21.347 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:21.347 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:21.347 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "MOSDECSubOpWrite(3.as5 68/30 ECSubWrite(tid=70, reqid=osd.3.0:70, at_version=68'55, trim_to=0'0, roll_forward_to=65'53))", 2024-04-18T14:44:21.347 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T14:44:07.417277+0000", 2024-04-18T14:44:21.347 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 13.876460016999999, 2024-04-18T14:44:21.347 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.013926294000000001, 2024-04-18T14:44:21.347 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T14:44:21.347 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-04-18T14:44:21.347 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T14:44:21.347 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:21.347 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T14:44:21.347 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:07.417277+0000", 2024-04-18T14:44:21.348 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:44:21.348 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:21.348 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:21.348 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T14:44:21.348 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:07.417277+0000", 2024-04-18T14:44:21.348 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:44:21.348 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:21.348 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:21.348 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T14:44:21.348 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:07.417276+0000", 2024-04-18T14:44:21.348 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-04-18T14:44:21.348 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:21.348 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:21.348 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T14:44:21.348 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:07.417331+0000", 2024-04-18T14:44:21.349 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.4605000000000003e-05 2024-04-18T14:44:21.349 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:21.349 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:21.349 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T14:44:21.349 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:07.417365+0000", 2024-04-18T14:44:21.349 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.4756999999999999e-05 2024-04-18T14:44:21.349 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:21.349 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:21.349 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T14:44:21.349 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:07.417389+0000", 2024-04-18T14:44:21.349 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.351e-05 2024-04-18T14:44:21.349 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:21.349 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:21.349 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T14:44:21.349 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:07.417536+0000", 2024-04-18T14:44:21.349 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00014692899999999999 2024-04-18T14:44:21.350 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:21.350 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:21.350 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_started", 2024-04-18T14:44:21.350 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:07.417563+0000", 2024-04-18T14:44:21.350 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.7330000000000001e-05 2024-04-18T14:44:21.350 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:21.350 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:21.350 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_committed", 2024-04-18T14:44:21.350 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:07.431137+0000", 2024-04-18T14:44:21.350 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.013573421 2024-04-18T14:44:21.350 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:21.350 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:21.350 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T14:44:21.350 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:07.431203+0000", 2024-04-18T14:44:21.351 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.6412e-05 2024-04-18T14:44:21.351 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:44:21.351 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T14:44:21.351 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:44:21.351 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:21.351 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:21.351 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "MOSDECSubOpWrite(3.as5 68/30 ECSubWrite(tid=71, reqid=osd.3.0:71, at_version=68'57, trim_to=0'0, roll_forward_to=65'53))", 2024-04-18T14:44:21.351 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T14:44:07.417427+0000", 2024-04-18T14:44:21.351 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 13.876309765, 2024-04-18T14:44:21.351 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.018224018000000002, 2024-04-18T14:44:21.351 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T14:44:21.351 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-04-18T14:44:21.351 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T14:44:21.351 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:21.351 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T14:44:21.351 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:07.417427+0000", 2024-04-18T14:44:21.352 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:44:21.352 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:21.352 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:21.352 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T14:44:21.352 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:07.417427+0000", 2024-04-18T14:44:21.352 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:44:21.352 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:21.352 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:21.352 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T14:44:21.352 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:07.417426+0000", 2024-04-18T14:44:21.352 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-18T14:44:21.352 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:21.352 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:21.352 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T14:44:21.352 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:07.417479+0000", 2024-04-18T14:44:21.352 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.2386000000000003e-05 2024-04-18T14:44:21.353 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:21.353 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:21.353 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T14:44:21.353 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:07.417501+0000", 2024-04-18T14:44:21.353 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2209999999999999e-05 2024-04-18T14:44:21.353 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:21.353 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:21.353 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T14:44:21.353 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:07.417520+0000", 2024-04-18T14:44:21.353 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.9473000000000001e-05 2024-04-18T14:44:21.353 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:21.353 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:21.353 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T14:44:21.353 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:07.420082+0000", 2024-04-18T14:44:21.353 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0025617029999999998 2024-04-18T14:44:21.354 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:21.354 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:21.354 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_started", 2024-04-18T14:44:21.354 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:07.420107+0000", 2024-04-18T14:44:21.354 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.4870000000000001e-05 2024-04-18T14:44:21.354 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:21.354 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:21.354 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_committed", 2024-04-18T14:44:21.354 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:07.435601+0000", 2024-04-18T14:44:21.354 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.015494459 2024-04-18T14:44:21.354 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:21.354 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:21.354 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T14:44:21.354 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:07.435651+0000", 2024-04-18T14:44:21.354 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.9756999999999998e-05 2024-04-18T14:44:21.355 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:44:21.355 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T14:44:21.355 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:44:21.355 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:21.355 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:21.355 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "MOSDECSubOpWrite(3.6s3 68/30 ECSubWrite(tid=206, reqid=osd.14.0:206, at_version=68'87, trim_to=0'0, roll_forward_to=68'85))", 2024-04-18T14:44:21.355 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T14:44:07.424265+0000", 2024-04-18T14:44:21.355 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 13.869471515000001, 2024-04-18T14:44:21.355 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.014356109000000001, 2024-04-18T14:44:21.355 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T14:44:21.355 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-04-18T14:44:21.355 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T14:44:21.355 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:21.355 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T14:44:21.355 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:07.424265+0000", 2024-04-18T14:44:21.356 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:44:21.356 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:21.356 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:21.356 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T14:44:21.356 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:07.424265+0000", 2024-04-18T14:44:21.356 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:44:21.356 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:21.356 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:21.356 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T14:44:21.356 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:07.424264+0000", 2024-04-18T14:44:21.356 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999986 2024-04-18T14:44:21.356 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:21.356 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:21.356 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T14:44:21.356 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:07.424334+0000", 2024-04-18T14:44:21.357 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.0506000000000006e-05 2024-04-18T14:44:21.357 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:21.357 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:21.357 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T14:44:21.357 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:07.424382+0000", 2024-04-18T14:44:21.357 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.7645999999999997e-05 2024-04-18T14:44:21.357 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:21.357 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:21.357 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T14:44:21.357 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:07.424403+0000", 2024-04-18T14:44:21.357 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0659999999999999e-05 2024-04-18T14:44:21.357 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:21.357 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:21.357 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T14:44:21.357 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:07.424533+0000", 2024-04-18T14:44:21.358 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000130512 2024-04-18T14:44:21.358 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:21.358 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:21.358 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_started", 2024-04-18T14:44:21.358 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:07.424554+0000", 2024-04-18T14:44:21.358 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0962999999999999e-05 2024-04-18T14:44:21.358 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:21.358 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:21.358 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_committed", 2024-04-18T14:44:21.358 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:07.438594+0000", 2024-04-18T14:44:21.358 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.01403977 2024-04-18T14:44:21.358 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:21.358 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:21.358 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T14:44:21.358 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:07.438621+0000", 2024-04-18T14:44:21.359 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.7642000000000001e-05 2024-04-18T14:44:21.359 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:44:21.359 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T14:44:21.359 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:44:21.359 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:21.359 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:21.359 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "MOSDECSubOpWrite(3.8s5 68/30 ECSubWrite(tid=141, reqid=osd.5.0:140, at_version=0'0, trim_to=0'0, roll_forward_to=68'109))", 2024-04-18T14:44:21.359 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T14:44:07.425416+0000", 2024-04-18T14:44:21.359 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 13.868320991000001, 2024-04-18T14:44:21.359 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.013482839999999999, 2024-04-18T14:44:21.359 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T14:44:21.359 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-04-18T14:44:21.359 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T14:44:21.359 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:21.359 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T14:44:21.360 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:07.425416+0000", 2024-04-18T14:44:21.360 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:44:21.360 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:21.360 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:21.360 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T14:44:21.360 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:07.425416+0000", 2024-04-18T14:44:21.360 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:44:21.360 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:21.360 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:21.360 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T14:44:21.360 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:07.425414+0000", 2024-04-18T14:44:21.360 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999981 2024-04-18T14:44:21.360 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:21.360 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:21.360 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T14:44:21.360 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:07.425444+0000", 2024-04-18T14:44:21.361 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.9655999999999999e-05 2024-04-18T14:44:21.361 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:21.361 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:21.361 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T14:44:21.361 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:07.425476+0000", 2024-04-18T14:44:21.361 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.269e-05 2024-04-18T14:44:21.361 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:21.361 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:21.361 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T14:44:21.361 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:07.425499+0000", 2024-04-18T14:44:21.361 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2543000000000001e-05 2024-04-18T14:44:21.361 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:21.361 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:21.361 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T14:44:21.361 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:07.425635+0000", 2024-04-18T14:44:21.361 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00013625900000000001 2024-04-18T14:44:21.362 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:21.362 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:21.362 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_started", 2024-04-18T14:44:21.362 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:07.425661+0000", 2024-04-18T14:44:21.362 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.6270000000000001e-05 2024-04-18T14:44:21.362 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:21.362 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:21.362 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_committed", 2024-04-18T14:44:21.362 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:07.438850+0000", 2024-04-18T14:44:21.362 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.013188356 2024-04-18T14:44:21.362 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:21.362 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:21.362 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T14:44:21.362 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:07.438899+0000", 2024-04-18T14:44:21.362 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.8939e-05 2024-04-18T14:44:21.363 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:44:21.363 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T14:44:21.363 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:44:21.363 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:21.363 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:21.363 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "MOSDECSubOpWrite(3.9s4 68/30 ECSubWrite(tid=144, reqid=osd.12.0:144, at_version=68'117, trim_to=0'0, roll_forward_to=68'115))", 2024-04-18T14:44:21.363 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T14:44:07.426009+0000", 2024-04-18T14:44:21.363 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 13.867728195, 2024-04-18T14:44:21.363 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.013679692, 2024-04-18T14:44:21.363 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T14:44:21.363 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-04-18T14:44:21.363 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T14:44:21.363 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:21.363 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T14:44:21.363 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:07.426009+0000", 2024-04-18T14:44:21.363 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:44:21.364 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:21.364 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:21.364 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T14:44:21.364 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:07.426009+0000", 2024-04-18T14:44:21.364 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:44:21.364 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:21.364 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:21.364 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T14:44:21.364 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:07.426007+0000", 2024-04-18T14:44:21.364 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999981 2024-04-18T14:44:21.364 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:21.364 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:21.364 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T14:44:21.364 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:07.426061+0000", 2024-04-18T14:44:21.364 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.4339000000000003e-05 2024-04-18T14:44:21.364 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:21.365 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:21.365 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T14:44:21.365 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:07.426118+0000", 2024-04-18T14:44:21.365 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.6815999999999999e-05 2024-04-18T14:44:21.365 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:21.365 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:21.365 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T14:44:21.365 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:07.426179+0000", 2024-04-18T14:44:21.365 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.0872999999999998e-05 2024-04-18T14:44:21.365 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:21.365 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:21.365 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T14:44:21.365 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:07.426488+0000", 2024-04-18T14:44:21.365 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00030968400000000001 2024-04-18T14:44:21.365 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:21.365 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:21.365 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_started", 2024-04-18T14:44:21.366 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:07.426515+0000", 2024-04-18T14:44:21.366 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.7140000000000001e-05 2024-04-18T14:44:21.366 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:21.366 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:21.366 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_committed", 2024-04-18T14:44:21.366 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:07.439616+0000", 2024-04-18T14:44:21.366 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.013100752 2024-04-18T14:44:21.366 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:21.366 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:21.366 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T14:44:21.366 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:07.439688+0000", 2024-04-18T14:44:21.366 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.2148000000000001e-05 2024-04-18T14:44:21.366 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:44:21.366 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T14:44:21.366 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:44:21.367 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:21.367 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:21.367 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "MOSDECSubOpWrite(3.9s4 68/30 ECSubWrite(tid=145, reqid=osd.12.0:145, at_version=68'119, trim_to=0'0, roll_forward_to=68'115))", 2024-04-18T14:44:21.367 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T14:44:07.426219+0000", 2024-04-18T14:44:21.367 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 13.867518251, 2024-04-18T14:44:21.367 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.014723042, 2024-04-18T14:44:21.367 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T14:44:21.367 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-04-18T14:44:21.367 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T14:44:21.367 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:21.367 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T14:44:21.367 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:07.426219+0000", 2024-04-18T14:44:21.367 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:44:21.367 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:21.367 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:21.367 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T14:44:21.368 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:07.426219+0000", 2024-04-18T14:44:21.368 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:44:21.368 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:21.368 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:21.368 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T14:44:21.368 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:07.426217+0000", 2024-04-18T14:44:21.368 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999986 2024-04-18T14:44:21.368 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:21.368 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:21.368 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T14:44:21.368 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:07.426276+0000", 2024-04-18T14:44:21.368 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.9104000000000002e-05 2024-04-18T14:44:21.368 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:21.368 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:21.368 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T14:44:21.369 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:07.426303+0000", 2024-04-18T14:44:21.369 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.6679e-05 2024-04-18T14:44:21.369 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:21.369 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:21.369 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T14:44:21.369 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:07.426322+0000", 2024-04-18T14:44:21.369 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.9242999999999999e-05 2024-04-18T14:44:21.369 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:21.369 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:21.369 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T14:44:21.369 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:07.435724+0000", 2024-04-18T14:44:21.369 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0094019150000000003 2024-04-18T14:44:21.369 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:21.369 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:21.369 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_started", 2024-04-18T14:44:21.369 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:07.435744+0000", 2024-04-18T14:44:21.370 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.9785000000000001e-05 2024-04-18T14:44:21.370 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:21.370 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:21.370 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_committed", 2024-04-18T14:44:21.370 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:07.440880+0000", 2024-04-18T14:44:21.370 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0051361219999999999 2024-04-18T14:44:21.370 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:21.370 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:21.370 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T14:44:21.370 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:07.440942+0000", 2024-04-18T14:44:21.370 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.1713999999999999e-05 2024-04-18T14:44:21.370 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:44:21.370 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T14:44:21.370 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:44:21.371 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:21.371 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:21.371 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4559.0:772 3.5s0 3:ae89639c:::smithi13430248-39:head [create,setxattr [mRaOP^iTabSYNZSRY^bT[tjWRnYaahmhaR]dQsN (1262) in=40b,setxattr NdS[Q`Ys[gRPNWtoZicj_iYlctZjtOTR (875) in=32b,setxattr m^bg`_t^^mfPhoRq`hZaih (875) in=22b,setxattr QSP`hlVUcRehtg`kXcaYbmZtgpdRmQa[pVq`_YPe (315) in=40b,setxattr ajaTlrOQanZ`lk[^nsfObkVfhlcrl[`QgYXZ_a]t (769) in=40b,setxattr cU\\QUerRg (875) in=9b,setxattr pnR\\aZVZSojanelblTcUh\\rUT^tdWs\\cdYhsr[XY (1575) in=40b,setxattr aqbTnohU_aoq[pYrd_qfondhhfVYdZNghWQRVs_e (1926) in=40b,setxattr nmNonb_SPsZrNeX^T^YRStm]_tpsYO^acoqtjsc[ (803) in=40b,setxattr eUSVNcSXoVsbhaWYjcsNtQ[r^cYQifrime_eaX]c (595) in=40b,setxattr anNRfWahTZa\\tOme\\nefYVlW_N`V\\hcjmVhNpZ[h (1226) in=40b,setxattr ZNaa^bfR]YRlUQqQeq\\nkcZ[[mt]YaRQibRreptZ (1121) in=40b,setxattr _P\\t`hZTlh[]\\dc]ZN]Sqrb[le`oRt\\ptYem_Zoh (10596) in=40b,setxattr PXXdYjNVs_UahTRTkfct[ZXbhdne]rronnd[qleR (13964) in=40b,setxattr TdqabrNtRPmeV\\UqinOkWl]oOONngehpSS (875) in=34b,setxattr Y__pUaN[YVk^tpVnUdiPgmRhSq_[XlRPTgasc]Nl (6736) in=40b,setxattr PhkRTP\\TpdSagUarch]\\^pVd^gbTcWTNQXTarkYZ (1259) in=40b,setxattr m_S\\^a[babQpshqNojaVm__OedgcioopVbf`UZjW (1717) in=40b,setxattr gS\\OStP]mjX_jcbPUj\\h_md]Umj]boXVUZZQQlsc (279) in=40b,setxattr YhZY[]pkaU`j`p]theotU`U]VhN_cqf^gbbqcTl] (421) in=40b] snapc 2b=[2b,2a,29,28,27,26,23,22,1e,1c,1a,16,14,13,11,2] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-18T14:44:21.371 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T14:44:15.391712+0000", 2024-04-18T14:44:21.371 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 5.9020248100000003, 2024-04-18T14:44:21.371 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.016922168000000001, 2024-04-18T14:44:21.371 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T14:44:21.371 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T14:44:21.371 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-18T14:44:21.371 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4559", 2024-04-18T14:44:21.371 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/3113589487", 2024-04-18T14:44:21.371 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 772 2024-04-18T14:44:21.371 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:21.371 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T14:44:21.371 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:21.371 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T14:44:21.372 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:15.391712+0000", 2024-04-18T14:44:21.372 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:44:21.372 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:21.372 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:21.372 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T14:44:21.372 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:15.391712+0000", 2024-04-18T14:44:21.372 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:44:21.372 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:21.372 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:21.372 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T14:44:21.372 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:15.391709+0000", 2024-04-18T14:44:21.372 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999971 2024-04-18T14:44:21.372 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:21.372 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:21.372 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T14:44:21.372 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:15.391847+0000", 2024-04-18T14:44:21.372 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00013765199999999999 2024-04-18T14:44:21.373 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:21.373 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:21.373 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T14:44:21.373 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:15.391893+0000", 2024-04-18T14:44:21.373 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.6213e-05 2024-04-18T14:44:21.373 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:21.373 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:21.373 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T14:44:21.373 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:15.391922+0000", 2024-04-18T14:44:21.373 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.8955999999999999e-05 2024-04-18T14:44:21.373 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:21.373 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:21.373 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T14:44:21.373 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:15.392051+0000", 2024-04-18T14:44:21.373 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00012886899999999999 2024-04-18T14:44:21.374 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:21.374 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:21.374 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op must wait for map", 2024-04-18T14:44:21.374 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:15.392062+0000", 2024-04-18T14:44:21.374 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1593999999999999e-05 2024-04-18T14:44:21.374 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:21.374 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:21.374 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T14:44:21.374 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:15.399006+0000", 2024-04-18T14:44:21.374 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0069434889999999997 2024-04-18T14:44:21.374 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:21.374 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:21.374 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T14:44:21.374 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:15.399332+0000", 2024-04-18T14:44:21.374 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00032655100000000001 2024-04-18T14:44:21.375 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:21.375 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:21.375 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_started", 2024-04-18T14:44:21.375 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:15.401477+0000", 2024-04-18T14:44:21.375 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0021447630000000001 2024-04-18T14:44:21.375 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:21.375 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:21.375 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_committed", 2024-04-18T14:44:21.375 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:15.405255+0000", 2024-04-18T14:44:21.375 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.003777837 2024-04-18T14:44:21.375 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:21.375 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:21.375 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T14:44:21.375 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:15.408438+0000", 2024-04-18T14:44:21.375 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0031828020000000002 2024-04-18T14:44:21.375 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:21.376 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:21.376 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T14:44:21.376 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:15.408634+0000", 2024-04-18T14:44:21.376 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00019642499999999999 2024-04-18T14:44:21.376 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:44:21.376 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T14:44:21.376 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:44:21.376 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:44:21.376 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T14:44:21.376 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-04-18T14:44:21.378 INFO:tasks.ceph.osd.11.smithi134.stderr:2024-04-18T14:44:21.380+0000 7f2d36f12640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 11 (PID: 25216) UID: 0 2024-04-18T14:44:21.378 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-18T14:44:21.448 INFO:teuthology.orchestra.run.smithi086.stderr:noscrub is unset 2024-04-18T14:44:21.450 INFO:tasks.rados.rados.0.smithi134.stdout:354: done (5 left) 2024-04-18T14:44:21.450 INFO:tasks.rados.rados.0.smithi134.stdout:355: rmattr oid 46 current snap is 31 2024-04-18T14:44:21.450 INFO:tasks.rados.rados.0.smithi134.stdout:350: finishing write tid 1 to smithi13430248-42 2024-04-18T14:44:21.450 INFO:tasks.rados.rados.0.smithi134.stdout:352: expect (ObjNum 13 snap 0 seq_num 13) 2024-04-18T14:44:21.469 INFO:tasks.rados.rados.0.smithi134.stdout:352: done (5 left) 2024-04-18T14:44:21.470 INFO:tasks.rados.rados.0.smithi134.stdout:append oid 6 current snap is 31 2024-04-18T14:44:21.470 INFO:tasks.rados.rados.0.smithi134.stdout:356: seq_num 138 ranges {0=770048,770048=540672,1310720=753664,2064384=262144} 2024-04-18T14:44:21.473 INFO:tasks.rados.rados.0.smithi134.stdout:356: writing smithi13430248-6 from 0 to 770048 tid 1 2024-04-18T14:44:21.478 INFO:tasks.rados.rados.0.smithi134.stdout:356: writing smithi13430248-6 from 770048 to 1310720 tid 2 2024-04-18T14:44:21.479 INFO:tasks.ceph.osd.8.smithi086.stderr:2024-04-18T14:44:21.477+0000 7f29f7b9d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 8 (PID: 24958) UID: 0 2024-04-18T14:44:21.483 INFO:tasks.rados.rados.0.smithi134.stdout:356: writing smithi13430248-6 from 1310720 to 2064384 tid 3 2024-04-18T14:44:21.485 INFO:tasks.rados.rados.0.smithi134.stdout:356: writing smithi13430248-6 from 2064384 to 2326528 tid 4 2024-04-18T14:44:21.485 INFO:tasks.rados.rados.0.smithi134.stdout:351: finishing rollback tid 0 to smithi13430248-22 2024-04-18T14:44:21.485 INFO:tasks.rados.rados.0.smithi134.stdout:353: expect (ObjNum 75 snap 15 seq_num 75) 2024-04-18T14:44:21.533 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-04-18T14:44:21.533 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [], 2024-04-18T14:44:21.533 INFO:teuthology.orchestra.run.smithi086.stdout: "num_ops": 0 2024-04-18T14:44:21.533 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-04-18T14:44:21.547 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-18T14:44:21.590 INFO:tasks.ceph.osd.4.smithi086.stderr:2024-04-18T14:44:21.589+0000 7f0c4c462640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 24956) UID: 0 2024-04-18T14:44:21.600 INFO:tasks.rados.rados.0.smithi134.stdout:350: finishing write tid 2 to smithi13430248-42 2024-04-18T14:44:21.600 INFO:tasks.rados.rados.0.smithi134.stdout:349: finishing copy_from racing read to smithi13430248-4 2024-04-18T14:44:21.600 INFO:tasks.rados.rados.0.smithi134.stdout:351: finishing rollback tid 1 to smithi13430248-22 2024-04-18T14:44:21.600 INFO:tasks.rados.rados.0.smithi134.stdout:351: finishing rollback tid 2 to smithi13430248-22 2024-04-18T14:44:21.600 INFO:tasks.rados.rados.0.smithi134.stdout:update_object_version oid 22 v 46 (ObjNum 21 snap 0 seq_num 21) dirty exists 2024-04-18T14:44:21.600 INFO:tasks.rados.rados.0.smithi134.stdout:350: finishing write tid 3 to smithi13430248-42 2024-04-18T14:44:21.600 INFO:tasks.rados.rados.0.smithi134.stdout:349: finishing copy_from to smithi13430248-4 2024-04-18T14:44:21.600 INFO:tasks.rados.rados.0.smithi134.stdout:update_object_version oid 4 v 80 (ObjNum 93 snap 18 seq_num 93) dirty exists 2024-04-18T14:44:21.600 INFO:tasks.rados.rados.0.smithi134.stdout:350: finishing write tid 4 to smithi13430248-42 2024-04-18T14:44:21.600 INFO:tasks.rados.rados.0.smithi134.stdout:350: finishing write tid 5 to smithi13430248-42 2024-04-18T14:44:21.600 INFO:tasks.rados.rados.0.smithi134.stdout:350: finishing write tid 6 to smithi13430248-42 2024-04-18T14:44:21.600 INFO:tasks.rados.rados.0.smithi134.stdout:350: oid 42 updating version 0 to 66 2024-04-18T14:44:21.601 INFO:tasks.rados.rados.0.smithi134.stdout:350: oid 42 version 66 is already newer than 63 2024-04-18T14:44:21.601 INFO:tasks.rados.rados.0.smithi134.stdout:350: oid 42 updating version 66 to 67 2024-04-18T14:44:21.601 INFO:tasks.rados.rados.0.smithi134.stdout:350: oid 42 version 67 is already newer than 65 2024-04-18T14:44:21.601 INFO:tasks.rados.rados.0.smithi134.stdout:350: oid 42 version 67 is already newer than 64 2024-04-18T14:44:21.601 INFO:tasks.rados.rados.0.smithi134.stdout:update_object_version oid 42 v 67 (ObjNum 137 snap 31 seq_num 137) dirty exists 2024-04-18T14:44:21.601 INFO:tasks.rados.rados.0.smithi134.stdout:350: left oid 42 (ObjNum 137 snap 31 seq_num 137) 2024-04-18T14:44:21.601 INFO:tasks.rados.rados.0.smithi134.stdout:update_object_version oid 46 v 121 (ObjNum 103 snap 21 seq_num 103) dirty exists 2024-04-18T14:44:21.601 INFO:tasks.rados.rados.0.smithi134.stdout:356: finishing write tid 1 to smithi13430248-6 2024-04-18T14:44:21.601 INFO:tasks.rados.rados.0.smithi134.stdout:356: finishing write tid 2 to smithi13430248-6 2024-04-18T14:44:21.601 INFO:tasks.rados.rados.0.smithi134.stdout:356: finishing write tid 3 to smithi13430248-6 2024-04-18T14:44:21.601 INFO:tasks.rados.rados.0.smithi134.stdout:356: finishing write tid 4 to smithi13430248-6 2024-04-18T14:44:21.601 INFO:tasks.rados.rados.0.smithi134.stdout:356: finishing write tid 5 to smithi13430248-6 2024-04-18T14:44:21.601 INFO:tasks.rados.rados.0.smithi134.stdout:356: finishing write tid 6 to smithi13430248-6 2024-04-18T14:44:21.601 INFO:tasks.rados.rados.0.smithi134.stdout:356: oid 6 updating version 0 to 104 2024-04-18T14:44:21.601 INFO:tasks.rados.rados.0.smithi134.stdout:356: oid 6 updating version 104 to 105 2024-04-18T14:44:21.601 INFO:tasks.rados.rados.0.smithi134.stdout:356: oid 6 version 105 is already newer than 102 2024-04-18T14:44:21.602 INFO:tasks.rados.rados.0.smithi134.stdout:356: oid 6 version 105 is already newer than 101 2024-04-18T14:44:21.602 INFO:tasks.rados.rados.0.smithi134.stdout:356: oid 6 version 105 is already newer than 103 2024-04-18T14:44:21.602 INFO:tasks.rados.rados.0.smithi134.stdout:update_object_version oid 6 v 105 (ObjNum 138 snap 31 seq_num 138) dirty exists 2024-04-18T14:44:21.602 INFO:tasks.rados.rados.0.smithi134.stdout:356: left oid 6 (ObjNum 138 snap 31 seq_num 138) 2024-04-18T14:44:21.602 INFO:tasks.rados.rados.0.smithi134.stdout:349: done (5 left) 2024-04-18T14:44:21.602 INFO:tasks.rados.rados.0.smithi134.stdout:350: done (4 left) 2024-04-18T14:44:21.602 INFO:tasks.rados.rados.0.smithi134.stdout:351: done (3 left) 2024-04-18T14:44:21.602 INFO:tasks.rados.rados.0.smithi134.stdout:353: done (2 left) 2024-04-18T14:44:21.602 INFO:tasks.rados.rados.0.smithi134.stdout:355: done (1 left) 2024-04-18T14:44:21.602 INFO:tasks.rados.rados.0.smithi134.stdout:356: done (0 left) 2024-04-18T14:44:21.602 INFO:tasks.rados.rados.0.smithi134.stdout:append oid 29 current snap is 31 2024-04-18T14:44:21.602 INFO:tasks.rados.rados.0.smithi134.stdout:357: seq_num 139 ranges {2228224=786432,3014656=688128,3702784=475136,4177920=393216} 2024-04-18T14:44:21.634 INFO:tasks.rados.rados.0.smithi134.stdout:357: writing smithi13430248-29 from 2228224 to 3014656 tid 1 2024-04-18T14:44:21.639 INFO:tasks.rados.rados.0.smithi134.stdout:357: writing smithi13430248-29 from 3014656 to 3702784 tid 2 2024-04-18T14:44:21.644 INFO:tasks.rados.rados.0.smithi134.stdout:357: writing smithi13430248-29 from 3702784 to 4177920 tid 3 2024-04-18T14:44:21.648 INFO:tasks.rados.rados.0.smithi134.stdout:357: writing smithi13430248-29 from 4177920 to 4571136 tid 4 2024-04-18T14:44:21.649 INFO:tasks.rados.rados.0.smithi134.stdout:358: rmattr oid 7 current snap is 31 2024-04-18T14:44:21.649 INFO:tasks.rados.rados.0.smithi134.stdout:357: finishing write tid 1 to smithi13430248-29 2024-04-18T14:44:21.649 INFO:tasks.rados.rados.0.smithi134.stdout:359: setattr oid 41 current snap is 31 2024-04-18T14:44:21.654 INFO:tasks.rados.rados.0.smithi134.stdout:append oid 8 current snap is 31 2024-04-18T14:44:21.654 INFO:tasks.rados.rados.0.smithi134.stdout:360: seq_num 140 ranges {4784128=802816,5586944=425984,6012928=720896,6733824=409600} 2024-04-18T14:44:21.662 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-04-18T14:44:21.662 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [], 2024-04-18T14:44:21.662 INFO:teuthology.orchestra.run.smithi086.stdout: "complaint_time": 30, 2024-04-18T14:44:21.662 INFO:teuthology.orchestra.run.smithi086.stdout: "num_blocked_ops": 0 2024-04-18T14:44:21.662 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-04-18T14:44:21.677 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-18T14:44:21.681 INFO:tasks.ceph.osd.2.smithi119.stderr:2024-04-18T14:44:21.682+0000 7fcbd30c0640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 24894) UID: 0 2024-04-18T14:44:21.687 INFO:tasks.rados.rados.0.smithi134.stdout:360: writing smithi13430248-8 from 4784128 to 5586944 tid 1 2024-04-18T14:44:21.689 INFO:tasks.rados.rados.0.smithi134.stdout:360: writing smithi13430248-8 from 5586944 to 6012928 tid 2 2024-04-18T14:44:21.694 INFO:tasks.rados.rados.0.smithi134.stdout:360: writing smithi13430248-8 from 6012928 to 6733824 tid 3 2024-04-18T14:44:21.696 INFO:tasks.rados.rados.0.smithi134.stdout:360: writing smithi13430248-8 from 6733824 to 7143424 tid 4 2024-04-18T14:44:21.696 INFO:tasks.rados.rados.0.smithi134.stdout:361: copy_from oid 32 from oid 25 current snap is 31 2024-04-18T14:44:21.696 INFO:tasks.rados.rados.0.smithi134.stdout:update_object_version oid 7 v 184 (ObjNum 33 snap 0 seq_num 2055391696) dirty exists 2024-04-18T14:44:21.696 INFO:tasks.rados.rados.0.smithi134.stdout:358: done (4 left) 2024-04-18T14:44:21.697 INFO:tasks.rados.rados.0.smithi134.stdout:362: snap_create 2024-04-18T14:44:21.697 INFO:tasks.rados.rados.0.smithi134.stdout:357: finishing write tid 2 to smithi13430248-29 2024-04-18T14:44:21.697 INFO:tasks.rados.rados.0.smithi134.stdout:357: finishing write tid 3 to smithi13430248-29 2024-04-18T14:44:21.697 INFO:tasks.rados.rados.0.smithi134.stdout:357: finishing write tid 4 to smithi13430248-29 2024-04-18T14:44:21.697 INFO:tasks.rados.rados.0.smithi134.stdout:357: finishing write tid 5 to smithi13430248-29 2024-04-18T14:44:21.697 INFO:tasks.rados.rados.0.smithi134.stdout:357: finishing write tid 6 to smithi13430248-29 2024-04-18T14:44:21.697 INFO:tasks.rados.rados.0.smithi134.stdout:357: oid 29 updating version 0 to 75 2024-04-18T14:44:21.698 INFO:tasks.rados.rados.0.smithi134.stdout:357: oid 29 version 75 is already newer than 74 2024-04-18T14:44:21.698 INFO:tasks.rados.rados.0.smithi134.stdout:357: oid 29 updating version 75 to 76 2024-04-18T14:44:21.698 INFO:tasks.rados.rados.0.smithi134.stdout:357: oid 29 updating version 76 to 77 2024-04-18T14:44:21.698 INFO:tasks.rados.rados.0.smithi134.stdout:357: oid 29 version 77 is already newer than 73 2024-04-18T14:44:21.698 INFO:tasks.rados.rados.0.smithi134.stdout:update_object_version oid 29 v 77 (ObjNum 139 snap 31 seq_num 139) dirty exists 2024-04-18T14:44:21.698 INFO:tasks.rados.rados.0.smithi134.stdout:357: left oid 29 (ObjNum 139 snap 31 seq_num 139) 2024-04-18T14:44:21.698 INFO:tasks.rados.rados.0.smithi134.stdout:update_object_version oid 41 v 83 (ObjNum 103 snap 21 seq_num 103) dirty exists 2024-04-18T14:44:21.700 INFO:tasks.rados.rados.0.smithi134.stdout:360: finishing write tid 1 to smithi13430248-8 2024-04-18T14:44:21.705 INFO:tasks.rados.rados.0.smithi134.stdout:360: finishing write tid 2 to smithi13430248-8 2024-04-18T14:44:21.709 INFO:tasks.rados.rados.0.smithi134.stdout:360: finishing write tid 3 to smithi13430248-8 2024-04-18T14:44:21.712 INFO:tasks.rados.rados.0.smithi134.stdout:360: finishing write tid 4 to smithi13430248-8 2024-04-18T14:44:21.713 INFO:tasks.rados.rados.0.smithi134.stdout:360: finishing write tid 5 to smithi13430248-8 2024-04-18T14:44:21.717 INFO:tasks.rados.rados.0.smithi134.stdout:360: finishing write tid 6 to smithi13430248-8 2024-04-18T14:44:21.717 INFO:tasks.rados.rados.0.smithi134.stdout:360: oid 8 updating version 0 to 178 2024-04-18T14:44:21.717 INFO:tasks.rados.rados.0.smithi134.stdout:360: oid 8 updating version 178 to 179 2024-04-18T14:44:21.717 INFO:tasks.rados.rados.0.smithi134.stdout:360: oid 8 version 179 is already newer than 176 2024-04-18T14:44:21.717 INFO:tasks.rados.rados.0.smithi134.stdout:360: oid 8 version 179 is already newer than 175 2024-04-18T14:44:21.717 INFO:tasks.rados.rados.0.smithi134.stdout:360: oid 8 version 179 is already newer than 177 2024-04-18T14:44:21.718 INFO:tasks.rados.rados.0.smithi134.stdout:update_object_version oid 8 v 179 (ObjNum 140 snap 31 seq_num 140) dirty exists 2024-04-18T14:44:21.718 INFO:tasks.rados.rados.0.smithi134.stdout:360: left oid 8 (ObjNum 140 snap 31 seq_num 140) 2024-04-18T14:44:21.738 INFO:tasks.rados.rados.0.smithi134.stdout:361: finishing copy_from racing read to smithi13430248-32 2024-04-18T14:44:21.743 INFO:tasks.rados.rados.0.smithi134.stdout:361: finishing copy_from to smithi13430248-32 2024-04-18T14:44:21.743 INFO:tasks.rados.rados.0.smithi134.stdout:update_object_version oid 32 v 80 (ObjNum 93 snap 18 seq_num 93) dirty exists 2024-04-18T14:44:21.782 INFO:tasks.ceph.osd.5.smithi096.stderr:2024-04-18T14:44:21.781+0000 7fc33f25b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 24889) UID: 0 2024-04-18T14:44:21.840 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-04-18T14:44:21.840 INFO:teuthology.orchestra.run.smithi086.stdout: "size": 20, 2024-04-18T14:44:21.840 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 600, 2024-04-18T14:44:21.841 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [ 2024-04-18T14:44:21.841 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:21.841 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(client.4212.0:110 1.0 e25/24 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 25'72, mlcod=25'67)", 2024-04-18T14:44:21.841 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-04-18T14:43:20.710157+0000", 2024-04-18T14:44:21.841 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 61.129170774000002, 2024-04-18T14:44:21.841 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0054967820000000004, 2024-04-18T14:44:21.841 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-04-18T14:44:21.841 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T14:44:21.841 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-04-18T14:44:21.841 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:21.841 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-04-18T14:44:21.841 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:20.710157+0000", 2024-04-18T14:44:21.841 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:44:21.841 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:21.841 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:21.841 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-04-18T14:44:21.842 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:20.710157+0000", 2024-04-18T14:44:21.842 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:44:21.842 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:21.842 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:21.842 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-04-18T14:44:21.842 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:20.710155+0000", 2024-04-18T14:44:21.842 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999976 2024-04-18T14:44:21.842 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:21.842 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:21.842 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-04-18T14:44:21.842 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:20.710177+0000", 2024-04-18T14:44:21.842 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.2002999999999999e-05 2024-04-18T14:44:21.842 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:21.842 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:21.843 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-04-18T14:44:21.843 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:20.710200+0000", 2024-04-18T14:44:21.843 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.2833999999999999e-05 2024-04-18T14:44:21.843 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:21.843 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:21.843 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-04-18T14:44:21.843 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:20.710221+0000", 2024-04-18T14:44:21.843 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.1576000000000001e-05 2024-04-18T14:44:21.843 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:21.843 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:21.843 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-04-18T14:44:21.843 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:20.710313+0000", 2024-04-18T14:44:21.843 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.2102999999999996e-05 2024-04-18T14:44:21.843 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:21.843 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:21.843 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-04-18T14:44:21.844 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:20.710349+0000", 2024-04-18T14:44:21.844 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.5488000000000003e-05 2024-04-18T14:44:21.844 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:21.844 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:21.844 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-04-18T14:44:21.844 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:20.715618+0000", 2024-04-18T14:44:21.844 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.005269625 2024-04-18T14:44:21.844 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:21.844 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:21.844 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-04-18T14:44:21.844 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:20.715654+0000", 2024-04-18T14:44:21.844 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.5722999999999997e-05 2024-04-18T14:44:21.844 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:44:21.844 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-04-18T14:44:21.844 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:44:21.845 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:21.845 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:21.845 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(client.4212.0:112 1.0 e25/24 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 25'74, mlcod=25'68)", 2024-04-18T14:44:21.845 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-04-18T14:43:20.712903+0000", 2024-04-18T14:44:21.845 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 61.126424761000003, 2024-04-18T14:44:21.845 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0055161020000000002, 2024-04-18T14:44:21.845 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-04-18T14:44:21.845 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T14:44:21.845 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-04-18T14:44:21.845 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:21.845 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-04-18T14:44:21.845 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:20.712903+0000", 2024-04-18T14:44:21.845 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:44:21.845 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:21.845 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:21.845 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-04-18T14:44:21.846 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:20.712903+0000", 2024-04-18T14:44:21.846 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:44:21.846 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:21.846 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:21.846 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-04-18T14:44:21.846 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:20.712902+0000", 2024-04-18T14:44:21.846 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-04-18T14:44:21.846 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:21.846 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:21.846 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-04-18T14:44:21.846 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:20.712992+0000", 2024-04-18T14:44:21.846 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.0004000000000001e-05 2024-04-18T14:44:21.846 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:21.846 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:21.847 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-04-18T14:44:21.847 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:20.713009+0000", 2024-04-18T14:44:21.847 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.6722e-05 2024-04-18T14:44:21.847 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:21.847 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:21.847 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-04-18T14:44:21.847 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:20.713019+0000", 2024-04-18T14:44:21.847 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.5359999999999998e-06 2024-04-18T14:44:21.847 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:21.847 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:21.847 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-04-18T14:44:21.847 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:20.713054+0000", 2024-04-18T14:44:21.847 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.5074999999999999e-05 2024-04-18T14:44:21.847 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:21.847 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:21.847 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-04-18T14:44:21.848 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:20.713068+0000", 2024-04-18T14:44:21.848 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.4032000000000001e-05 2024-04-18T14:44:21.848 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:21.848 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:21.848 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-04-18T14:44:21.848 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:20.718385+0000", 2024-04-18T14:44:21.848 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.005317113 2024-04-18T14:44:21.848 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:21.848 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:21.848 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-04-18T14:44:21.848 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:20.718419+0000", 2024-04-18T14:44:21.848 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.4567000000000003e-05 2024-04-18T14:44:21.848 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:44:21.848 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-04-18T14:44:21.848 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:44:21.848 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:21.849 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:21.849 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(client.4212.0:137 1.0 e25/24 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 25'95, mlcod=25'88)", 2024-04-18T14:44:21.849 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-04-18T14:43:20.881121+0000", 2024-04-18T14:44:21.849 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 60.958207455999997, 2024-04-18T14:44:21.849 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0068217629999999998, 2024-04-18T14:44:21.849 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-04-18T14:44:21.849 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T14:44:21.849 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-04-18T14:44:21.849 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:21.849 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-04-18T14:44:21.849 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:20.881121+0000", 2024-04-18T14:44:21.849 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:44:21.849 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:21.849 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:21.849 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-04-18T14:44:21.849 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:20.881121+0000", 2024-04-18T14:44:21.850 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:44:21.850 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:21.850 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:21.850 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-04-18T14:44:21.850 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:20.881120+0000", 2024-04-18T14:44:21.850 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-04-18T14:44:21.850 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:21.850 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:21.850 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-04-18T14:44:21.850 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:20.881248+0000", 2024-04-18T14:44:21.850 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000128668 2024-04-18T14:44:21.850 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:21.850 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:21.851 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-04-18T14:44:21.851 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:20.881265+0000", 2024-04-18T14:44:21.851 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.7241999999999999e-05 2024-04-18T14:44:21.851 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:21.851 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:21.851 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-04-18T14:44:21.851 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:20.881276+0000", 2024-04-18T14:44:21.851 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.0249e-05 2024-04-18T14:44:21.851 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:21.851 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:21.851 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-04-18T14:44:21.851 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:20.881354+0000", 2024-04-18T14:44:21.852 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.8721999999999996e-05 2024-04-18T14:44:21.852 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:21.852 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:21.852 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-04-18T14:44:21.852 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:20.881396+0000", 2024-04-18T14:44:21.852 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.1739999999999997e-05 2024-04-18T14:44:21.852 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:21.852 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:21.853 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-04-18T14:44:21.853 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:20.887866+0000", 2024-04-18T14:44:21.853 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0064697330000000001 2024-04-18T14:44:21.853 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:21.853 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:21.853 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-04-18T14:44:21.854 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:20.887942+0000", 2024-04-18T14:44:21.854 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.6542e-05 2024-04-18T14:44:21.854 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:44:21.854 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-04-18T14:44:21.854 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:44:21.854 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:21.854 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:21.854 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(client.4212.0:138 1.0 e25/24 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 25'96, mlcod=25'88)", 2024-04-18T14:44:21.854 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-04-18T14:43:20.882338+0000", 2024-04-18T14:44:21.854 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 60.956990142999999, 2024-04-18T14:44:21.854 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0064705229999999997, 2024-04-18T14:44:21.854 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-04-18T14:44:21.854 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T14:44:21.854 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-04-18T14:44:21.855 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:21.855 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-04-18T14:44:21.855 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:20.882338+0000", 2024-04-18T14:44:21.855 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:44:21.855 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:21.855 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:21.855 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-04-18T14:44:21.855 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:20.882338+0000", 2024-04-18T14:44:21.855 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:44:21.855 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:21.855 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:21.855 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-04-18T14:44:21.855 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:20.882337+0000", 2024-04-18T14:44:21.855 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999986 2024-04-18T14:44:21.855 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:21.855 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:21.856 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-04-18T14:44:21.856 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:20.882349+0000", 2024-04-18T14:44:21.856 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.2381999999999999e-05 2024-04-18T14:44:21.856 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:21.856 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:21.856 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-04-18T14:44:21.856 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:20.882373+0000", 2024-04-18T14:44:21.856 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.3935e-05 2024-04-18T14:44:21.856 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:21.856 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:21.856 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-04-18T14:44:21.856 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:20.882387+0000", 2024-04-18T14:44:21.856 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.4528999999999999e-05 2024-04-18T14:44:21.856 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:21.856 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:21.857 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-04-18T14:44:21.857 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:20.882482+0000", 2024-04-18T14:44:21.857 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.4930000000000001e-05 2024-04-18T14:44:21.857 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:21.857 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:21.857 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-04-18T14:44:21.857 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:20.882532+0000", 2024-04-18T14:44:21.857 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.0033e-05 2024-04-18T14:44:21.857 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:21.857 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:21.857 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-04-18T14:44:21.857 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:20.888732+0000", 2024-04-18T14:44:21.857 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0061996229999999996 2024-04-18T14:44:21.857 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:21.857 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:21.858 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-04-18T14:44:21.858 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:20.888809+0000", 2024-04-18T14:44:21.858 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.6470999999999993e-05 2024-04-18T14:44:21.858 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:44:21.858 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-04-18T14:44:21.858 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:44:21.858 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:21.858 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:21.858 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(client.4212.0:139 1.0 e25/24 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 25'97, mlcod=25'88)", 2024-04-18T14:44:21.858 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-04-18T14:43:20.883426+0000", 2024-04-18T14:44:21.858 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 60.955902176000002, 2024-04-18T14:44:21.858 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0054388659999999997, 2024-04-18T14:44:21.858 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-04-18T14:44:21.858 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T14:44:21.859 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-04-18T14:44:21.859 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:21.859 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-04-18T14:44:21.859 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:20.883426+0000", 2024-04-18T14:44:21.859 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:44:21.859 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:21.859 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:21.859 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-04-18T14:44:21.859 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:20.883426+0000", 2024-04-18T14:44:21.859 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:44:21.859 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:21.859 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:21.859 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-04-18T14:44:21.859 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:20.883425+0000", 2024-04-18T14:44:21.859 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999986 2024-04-18T14:44:21.860 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:21.860 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:21.860 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-04-18T14:44:21.860 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:20.883437+0000", 2024-04-18T14:44:21.860 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.1861999999999999e-05 2024-04-18T14:44:21.860 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:21.860 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:21.860 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-04-18T14:44:21.860 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:20.883461+0000", 2024-04-18T14:44:21.860 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.3995e-05 2024-04-18T14:44:21.860 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:21.860 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:21.860 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-04-18T14:44:21.860 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:20.883478+0000", 2024-04-18T14:44:21.860 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.7762e-05 2024-04-18T14:44:21.860 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:21.861 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:21.861 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-04-18T14:44:21.861 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:20.883572+0000", 2024-04-18T14:44:21.861 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.3586999999999997e-05 2024-04-18T14:44:21.861 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:21.861 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:21.861 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-04-18T14:44:21.861 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:20.883632+0000", 2024-04-18T14:44:21.861 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.0202999999999999e-05 2024-04-18T14:44:21.862 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:21.862 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:21.862 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-04-18T14:44:21.862 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:20.888815+0000", 2024-04-18T14:44:21.862 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0051830920000000003 2024-04-18T14:44:21.862 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:21.862 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:21.862 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-04-18T14:44:21.862 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:20.888865+0000", 2024-04-18T14:44:21.862 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.9660999999999998e-05 2024-04-18T14:44:21.862 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:44:21.862 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-04-18T14:44:21.862 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:44:21.862 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:21.862 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:21.863 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(client.4212.0:140 1.0 e25/24 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 25'98, mlcod=25'90)", 2024-04-18T14:44:21.863 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-04-18T14:43:20.884221+0000", 2024-04-18T14:44:21.863 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 60.955107061, 2024-04-18T14:44:21.863 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0069705119999999999, 2024-04-18T14:44:21.863 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-04-18T14:44:21.863 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T14:44:21.863 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-04-18T14:44:21.863 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:21.863 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-04-18T14:44:21.863 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:20.884221+0000", 2024-04-18T14:44:21.863 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:44:21.863 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:21.863 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:21.863 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-04-18T14:44:21.863 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:20.884221+0000", 2024-04-18T14:44:21.863 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:44:21.864 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:21.864 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:21.864 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-04-18T14:44:21.864 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:20.884219+0000", 2024-04-18T14:44:21.864 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999981 2024-04-18T14:44:21.864 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:21.864 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:21.864 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-04-18T14:44:21.864 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:20.884318+0000", 2024-04-18T14:44:21.864 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.9103000000000003e-05 2024-04-18T14:44:21.864 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:21.864 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:21.864 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-04-18T14:44:21.864 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:20.884342+0000", 2024-04-18T14:44:21.864 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.3864000000000001e-05 2024-04-18T14:44:21.864 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:21.865 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:21.865 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-04-18T14:44:21.865 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:20.884355+0000", 2024-04-18T14:44:21.865 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.2829e-05 2024-04-18T14:44:21.865 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:21.865 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:21.865 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-04-18T14:44:21.865 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:20.884446+0000", 2024-04-18T14:44:21.865 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.1328000000000004e-05 2024-04-18T14:44:21.865 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:21.865 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:21.865 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-04-18T14:44:21.865 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:20.884499+0000", 2024-04-18T14:44:21.865 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.2238999999999999e-05 2024-04-18T14:44:21.865 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:21.865 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:21.866 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-04-18T14:44:21.866 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:20.891116+0000", 2024-04-18T14:44:21.866 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0066174229999999999 2024-04-18T14:44:21.866 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:21.866 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:21.866 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-04-18T14:44:21.866 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:20.891192+0000", 2024-04-18T14:44:21.866 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.5542000000000003e-05 2024-04-18T14:44:21.866 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:44:21.866 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-04-18T14:44:21.866 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:44:21.866 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:21.866 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:21.866 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(client.4212.0:141 1.0 e25/24 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 25'99, mlcod=25'90)", 2024-04-18T14:44:21.866 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-04-18T14:43:20.885297+0000", 2024-04-18T14:44:21.867 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 60.954030725999999, 2024-04-18T14:44:21.867 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0085544120000000008, 2024-04-18T14:44:21.867 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-04-18T14:44:21.867 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T14:44:21.867 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-04-18T14:44:21.867 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:21.867 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-04-18T14:44:21.867 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:20.885297+0000", 2024-04-18T14:44:21.867 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:44:21.867 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:21.867 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:21.867 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-04-18T14:44:21.867 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:20.885297+0000", 2024-04-18T14:44:21.867 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:44:21.867 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:21.867 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:21.868 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-04-18T14:44:21.868 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:20.885296+0000", 2024-04-18T14:44:21.868 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999981 2024-04-18T14:44:21.868 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:21.868 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:21.868 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-04-18T14:44:21.868 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:20.885309+0000", 2024-04-18T14:44:21.868 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.3532e-05 2024-04-18T14:44:21.868 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:21.868 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:21.868 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-04-18T14:44:21.868 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:20.885334+0000", 2024-04-18T14:44:21.868 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.4360999999999999e-05 2024-04-18T14:44:21.868 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:21.868 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:21.869 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-04-18T14:44:21.869 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:20.885348+0000", 2024-04-18T14:44:21.869 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.4069e-05 2024-04-18T14:44:21.869 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:21.869 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:21.869 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-04-18T14:44:21.869 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:20.888020+0000", 2024-04-18T14:44:21.869 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0026719650000000001 2024-04-18T14:44:21.869 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:21.869 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:21.869 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-04-18T14:44:21.869 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:20.888077+0000", 2024-04-18T14:44:21.869 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.6938999999999998e-05 2024-04-18T14:44:21.869 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:21.869 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:21.869 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-04-18T14:44:21.870 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:20.893781+0000", 2024-04-18T14:44:21.870 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0057041399999999999 2024-04-18T14:44:21.870 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:21.870 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:21.870 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-04-18T14:44:21.870 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:20.893852+0000", 2024-04-18T14:44:21.870 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.1112000000000006e-05 2024-04-18T14:44:21.870 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:44:21.870 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-04-18T14:44:21.870 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:44:21.870 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:21.870 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:21.870 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(client.4212.0:203 1.0 e26/24 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 26'149, mlcod=25'145)", 2024-04-18T14:44:21.870 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-04-18T14:43:23.027038+0000", 2024-04-18T14:44:21.871 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 58.812290017999999, 2024-04-18T14:44:21.871 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0080089600000000007, 2024-04-18T14:44:21.871 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-04-18T14:44:21.871 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T14:44:21.871 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-04-18T14:44:21.871 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:21.871 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-04-18T14:44:21.871 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:23.027038+0000", 2024-04-18T14:44:21.871 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:44:21.871 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:21.871 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:21.871 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-04-18T14:44:21.871 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:23.027038+0000", 2024-04-18T14:44:21.871 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:44:21.871 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:21.872 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:21.872 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-04-18T14:44:21.872 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:23.027037+0000", 2024-04-18T14:44:21.872 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-04-18T14:44:21.872 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:21.872 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:21.872 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-04-18T14:44:21.872 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:23.027199+0000", 2024-04-18T14:44:21.872 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00016148000000000001 2024-04-18T14:44:21.872 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:21.872 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:21.872 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-04-18T14:44:21.872 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:23.027217+0000", 2024-04-18T14:44:21.872 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.7975e-05 2024-04-18T14:44:21.872 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:21.873 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:21.873 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-04-18T14:44:21.873 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:23.027226+0000", 2024-04-18T14:44:21.873 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.4579999999999999e-06 2024-04-18T14:44:21.873 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:21.873 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:21.873 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-04-18T14:44:21.873 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:23.027271+0000", 2024-04-18T14:44:21.873 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.5323e-05 2024-04-18T14:44:21.873 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:21.873 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:21.873 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-04-18T14:44:21.873 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:23.027291+0000", 2024-04-18T14:44:21.873 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.9264000000000001e-05 2024-04-18T14:44:21.873 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:21.874 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:21.874 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-04-18T14:44:21.874 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:23.034994+0000", 2024-04-18T14:44:21.874 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0077035519999999998 2024-04-18T14:44:21.874 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:21.874 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:21.874 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-04-18T14:44:21.874 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:23.035047+0000", 2024-04-18T14:44:21.874 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.2824000000000001e-05 2024-04-18T14:44:21.874 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:44:21.874 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-04-18T14:44:21.874 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:44:21.874 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:21.874 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:21.874 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(client.4212.0:204 1.0 e26/24 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 26'150, mlcod=25'145)", 2024-04-18T14:44:21.874 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-04-18T14:43:23.028329+0000", 2024-04-18T14:44:21.875 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 58.810999301000003, 2024-04-18T14:44:21.875 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.006743481, 2024-04-18T14:44:21.875 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-04-18T14:44:21.875 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T14:44:21.875 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-04-18T14:44:21.875 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:21.875 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-04-18T14:44:21.875 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:23.028329+0000", 2024-04-18T14:44:21.875 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:44:21.875 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:21.875 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:21.875 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-04-18T14:44:21.875 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:23.028329+0000", 2024-04-18T14:44:21.875 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:44:21.875 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:21.875 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:21.876 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-04-18T14:44:21.876 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:23.028328+0000", 2024-04-18T14:44:21.876 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-04-18T14:44:21.876 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:21.876 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:21.876 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-04-18T14:44:21.876 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:23.028337+0000", 2024-04-18T14:44:21.876 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.2399999999999996e-06 2024-04-18T14:44:21.876 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:21.876 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:21.876 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-04-18T14:44:21.876 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:23.028353+0000", 2024-04-18T14:44:21.876 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.6308999999999999e-05 2024-04-18T14:44:21.876 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:21.876 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:21.877 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-04-18T14:44:21.877 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:23.028362+0000", 2024-04-18T14:44:21.877 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.6910000000000003e-06 2024-04-18T14:44:21.877 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:21.877 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:21.877 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-04-18T14:44:21.877 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:23.028427+0000", 2024-04-18T14:44:21.877 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.4844000000000005e-05 2024-04-18T14:44:21.877 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:21.877 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:21.877 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-04-18T14:44:21.877 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:23.028453+0000", 2024-04-18T14:44:21.877 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.6259999999999999e-05 2024-04-18T14:44:21.877 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:21.877 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:21.877 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-04-18T14:44:21.878 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:23.035050+0000", 2024-04-18T14:44:21.878 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0065966740000000003 2024-04-18T14:44:21.878 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:21.878 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:21.878 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-04-18T14:44:21.878 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:23.035072+0000", 2024-04-18T14:44:21.878 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.2364000000000001e-05 2024-04-18T14:44:21.878 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:44:21.878 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-04-18T14:44:21.878 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:44:21.878 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:21.878 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:21.878 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(client.4212.0:205 1.0 e26/24 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 26'151, mlcod=26'146)", 2024-04-18T14:44:21.878 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-04-18T14:43:23.029545+0000", 2024-04-18T14:44:21.878 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 58.809782896999998, 2024-04-18T14:44:21.879 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0060327799999999997, 2024-04-18T14:44:21.879 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-04-18T14:44:21.879 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T14:44:21.879 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-04-18T14:44:21.879 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:21.879 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-04-18T14:44:21.879 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:23.029545+0000", 2024-04-18T14:44:21.879 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:44:21.879 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:21.879 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:21.879 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-04-18T14:44:21.879 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:23.029545+0000", 2024-04-18T14:44:21.879 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:44:21.879 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:21.879 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:21.879 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-04-18T14:44:21.880 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:23.029544+0000", 2024-04-18T14:44:21.880 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-04-18T14:44:21.880 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:21.880 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:21.880 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-04-18T14:44:21.880 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:23.029552+0000", 2024-04-18T14:44:21.880 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.5490000000000001e-06 2024-04-18T14:44:21.880 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:21.880 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:21.880 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-04-18T14:44:21.880 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:23.029567+0000", 2024-04-18T14:44:21.880 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.5211999999999999e-05 2024-04-18T14:44:21.880 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:21.880 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:21.880 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-04-18T14:44:21.880 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:23.029575+0000", 2024-04-18T14:44:21.881 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.1110000000000008e-06 2024-04-18T14:44:21.881 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:21.881 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:21.881 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-04-18T14:44:21.881 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:23.029616+0000", 2024-04-18T14:44:21.881 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.0756000000000001e-05 2024-04-18T14:44:21.881 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:21.881 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:21.881 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-04-18T14:44:21.881 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:23.029635+0000", 2024-04-18T14:44:21.881 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.9012e-05 2024-04-18T14:44:21.881 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:21.881 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:21.881 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-04-18T14:44:21.881 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:23.035542+0000", 2024-04-18T14:44:21.881 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0059065130000000004 2024-04-18T14:44:21.882 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:21.882 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:21.882 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-04-18T14:44:21.882 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:23.035578+0000", 2024-04-18T14:44:21.882 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.6477999999999999e-05 2024-04-18T14:44:21.882 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:44:21.882 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-04-18T14:44:21.882 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:44:21.882 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:21.882 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:21.882 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "MOSDECSubOpWrite(3.1s5 57/30 ECSubWrite(tid=39, reqid=client.4559.0:512, at_version=57'26, trim_to=0'0, roll_forward_to=53'24))", 2024-04-18T14:44:21.882 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-04-18T14:43:56.585652+0000", 2024-04-18T14:44:21.882 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 25.253675994000002, 2024-04-18T14:44:21.882 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0058697250000000001, 2024-04-18T14:44:21.882 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-04-18T14:44:21.883 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "reached pg", 2024-04-18T14:44:21.883 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-04-18T14:44:21.883 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:21.883 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-04-18T14:44:21.883 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:56.585652+0000", 2024-04-18T14:44:21.883 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:44:21.883 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:21.883 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:21.883 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-04-18T14:44:21.883 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:56.585652+0000", 2024-04-18T14:44:21.883 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:44:21.883 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:21.883 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:21.883 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-04-18T14:44:21.883 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:56.585651+0000", 2024-04-18T14:44:21.883 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999986 2024-04-18T14:44:21.884 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:21.884 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:21.884 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-04-18T14:44:21.884 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:56.586814+0000", 2024-04-18T14:44:21.884 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0011629089999999999 2024-04-18T14:44:21.884 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:21.884 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:21.884 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-04-18T14:44:21.884 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:56.586829+0000", 2024-04-18T14:44:21.884 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.5166e-05 2024-04-18T14:44:21.884 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:21.884 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:21.884 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-04-18T14:44:21.884 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:56.586838+0000", 2024-04-18T14:44:21.884 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.4949999999999997e-06 2024-04-18T14:44:21.884 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:21.885 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:21.885 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-04-18T14:44:21.885 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:56.586905+0000", 2024-04-18T14:44:21.885 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.6444000000000003e-05 2024-04-18T14:44:21.885 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:21.885 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:21.885 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_started", 2024-04-18T14:44:21.885 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:56.586918+0000", 2024-04-18T14:44:21.885 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.2872e-05 2024-04-18T14:44:21.885 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:21.885 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:21.885 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_committed", 2024-04-18T14:44:21.885 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:56.591494+0000", 2024-04-18T14:44:21.885 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0045764500000000001 2024-04-18T14:44:21.885 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:21.886 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:21.886 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-04-18T14:44:21.886 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:56.591522+0000", 2024-04-18T14:44:21.886 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.7783000000000001e-05 2024-04-18T14:44:21.886 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:44:21.886 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-04-18T14:44:21.886 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:44:21.886 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:21.886 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:21.886 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "MOSDECSubOpWrite(3.1s5 72/30 ECSubWrite(tid=77, reqid=client.4559.0:715, at_version=72'62, trim_to=0'0, roll_forward_to=71'59))", 2024-04-18T14:44:21.886 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-04-18T14:44:11.487455+0000", 2024-04-18T14:44:21.886 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 10.35187268, 2024-04-18T14:44:21.886 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0063709819999999999, 2024-04-18T14:44:21.886 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-04-18T14:44:21.886 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "reached pg", 2024-04-18T14:44:21.886 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-04-18T14:44:21.887 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:21.887 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-04-18T14:44:21.887 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:11.487455+0000", 2024-04-18T14:44:21.887 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:44:21.887 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:21.887 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:21.887 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-04-18T14:44:21.887 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:11.487455+0000", 2024-04-18T14:44:21.887 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:44:21.887 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:21.887 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:21.887 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-04-18T14:44:21.887 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:11.487447+0000", 2024-04-18T14:44:21.887 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999914 2024-04-18T14:44:21.887 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:21.888 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:21.888 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-04-18T14:44:21.888 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:11.490254+0000", 2024-04-18T14:44:21.888 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0028067790000000001 2024-04-18T14:44:21.888 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:21.888 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:21.888 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-04-18T14:44:21.888 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:11.490281+0000", 2024-04-18T14:44:21.888 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.7015000000000001e-05 2024-04-18T14:44:21.888 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:21.888 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:21.888 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-04-18T14:44:21.888 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:11.490295+0000", 2024-04-18T14:44:21.888 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.4149e-05 2024-04-18T14:44:21.888 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:21.888 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:21.889 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-04-18T14:44:21.889 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:11.490359+0000", 2024-04-18T14:44:21.889 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.4453000000000001e-05 2024-04-18T14:44:21.889 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:21.889 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:21.889 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_started", 2024-04-18T14:44:21.889 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:11.490369+0000", 2024-04-18T14:44:21.889 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.5089999999999999e-06 2024-04-18T14:44:21.889 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:21.889 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:21.889 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_committed", 2024-04-18T14:44:21.889 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:11.493777+0000", 2024-04-18T14:44:21.889 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0034086609999999999 2024-04-18T14:44:21.889 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:21.889 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:21.889 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-04-18T14:44:21.890 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:11.493826+0000", 2024-04-18T14:44:21.890 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.8977999999999998e-05 2024-04-18T14:44:21.890 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:44:21.890 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-04-18T14:44:21.890 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:44:21.890 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:21.890 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:21.890 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "MOSDECSubOpWrite(3.1s5 76/30 ECSubWrite(tid=79, reqid=client.4559.0:784, at_version=76'64, trim_to=0'0, roll_forward_to=72'62))", 2024-04-18T14:44:21.890 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-04-18T14:44:15.399171+0000", 2024-04-18T14:44:21.890 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 6.440157621, 2024-04-18T14:44:21.890 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0072492959999999997, 2024-04-18T14:44:21.890 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-04-18T14:44:21.890 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "reached pg", 2024-04-18T14:44:21.890 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-04-18T14:44:21.890 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:21.891 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-04-18T14:44:21.891 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:15.399171+0000", 2024-04-18T14:44:21.891 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:44:21.891 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:21.891 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:21.891 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-04-18T14:44:21.891 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:15.399171+0000", 2024-04-18T14:44:21.891 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:44:21.891 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:21.891 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:21.891 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-04-18T14:44:21.891 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:15.399170+0000", 2024-04-18T14:44:21.891 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-04-18T14:44:21.891 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:21.891 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:21.891 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-04-18T14:44:21.892 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:15.399769+0000", 2024-04-18T14:44:21.892 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00059920500000000001 2024-04-18T14:44:21.892 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:21.892 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:21.892 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-04-18T14:44:21.892 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:15.399790+0000", 2024-04-18T14:44:21.892 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.0795999999999999e-05 2024-04-18T14:44:21.892 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:21.892 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:21.892 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-04-18T14:44:21.892 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:15.399820+0000", 2024-04-18T14:44:21.892 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.0069999999999998e-05 2024-04-18T14:44:21.892 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:21.892 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:21.892 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-04-18T14:44:21.893 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:15.399926+0000", 2024-04-18T14:44:21.893 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00010624999999999999 2024-04-18T14:44:21.893 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:21.893 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:21.893 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_started", 2024-04-18T14:44:21.893 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:15.399941+0000", 2024-04-18T14:44:21.893 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.4426e-05 2024-04-18T14:44:21.893 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:21.893 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:21.893 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_committed", 2024-04-18T14:44:21.893 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:15.406374+0000", 2024-04-18T14:44:21.893 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0064329740000000002 2024-04-18T14:44:21.893 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:21.893 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:21.893 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-04-18T14:44:21.893 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:15.406420+0000", 2024-04-18T14:44:21.894 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.6211999999999997e-05 2024-04-18T14:44:21.894 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:44:21.894 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-04-18T14:44:21.894 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:44:21.894 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:21.894 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:21.894 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "MOSDECSubOpWrite(3.8s2 76/73 ECSubWrite(tid=185, reqid=client.4559.0:785, at_version=76'125, trim_to=0'0, roll_forward_to=0'0))", 2024-04-18T14:44:21.894 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-04-18T14:44:15.424206+0000", 2024-04-18T14:44:21.894 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 6.4151223079999999, 2024-04-18T14:44:21.894 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0090209420000000005, 2024-04-18T14:44:21.894 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-04-18T14:44:21.894 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "reached pg", 2024-04-18T14:44:21.894 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-04-18T14:44:21.894 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:21.895 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-04-18T14:44:21.895 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:15.424206+0000", 2024-04-18T14:44:21.895 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:44:21.895 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:21.895 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:21.895 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-04-18T14:44:21.895 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:15.424206+0000", 2024-04-18T14:44:21.895 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:44:21.895 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:21.895 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:21.895 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-04-18T14:44:21.895 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:15.424205+0000", 2024-04-18T14:44:21.895 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-04-18T14:44:21.895 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:21.895 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:21.896 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-04-18T14:44:21.896 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:15.426632+0000", 2024-04-18T14:44:21.896 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0024271029999999999 2024-04-18T14:44:21.896 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:21.896 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:21.896 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-04-18T14:44:21.896 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:15.426648+0000", 2024-04-18T14:44:21.896 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.5679999999999999e-05 2024-04-18T14:44:21.896 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:21.896 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:21.896 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-04-18T14:44:21.896 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:15.426660+0000", 2024-04-18T14:44:21.896 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.2123999999999999e-05 2024-04-18T14:44:21.896 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:21.896 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:21.896 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-04-18T14:44:21.897 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:15.426815+0000", 2024-04-18T14:44:21.897 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00015420700000000001 2024-04-18T14:44:21.897 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:21.897 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:21.897 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_started", 2024-04-18T14:44:21.897 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:15.426898+0000", 2024-04-18T14:44:21.897 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.3652000000000005e-05 2024-04-18T14:44:21.897 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:21.897 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:21.897 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_committed", 2024-04-18T14:44:21.897 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:15.433205+0000", 2024-04-18T14:44:21.897 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0063071309999999997 2024-04-18T14:44:21.897 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:21.897 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:21.897 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-04-18T14:44:21.897 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:15.433227+0000", 2024-04-18T14:44:21.898 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.1475e-05 2024-04-18T14:44:21.898 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:44:21.898 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-04-18T14:44:21.898 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:44:21.898 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:21.898 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:21.898 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "MOSDECSubOpWrite(3.ds2 77/30 ECSubWrite(tid=47, reqid=client.4559.0:835, at_version=77'43, trim_to=0'0, roll_forward_to=69'41))", 2024-04-18T14:44:21.898 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-04-18T14:44:16.432862+0000", 2024-04-18T14:44:21.898 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 5.4064662290000003, 2024-04-18T14:44:21.898 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0059332889999999996, 2024-04-18T14:44:21.898 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-04-18T14:44:21.898 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "reached pg", 2024-04-18T14:44:21.898 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-04-18T14:44:21.898 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:21.898 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-04-18T14:44:21.899 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:16.432862+0000", 2024-04-18T14:44:21.899 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:44:21.899 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:21.899 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:21.899 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-04-18T14:44:21.899 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:16.432862+0000", 2024-04-18T14:44:21.899 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:44:21.899 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:21.899 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:21.899 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-04-18T14:44:21.899 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:16.432862+0000", 2024-04-18T14:44:21.899 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967296 2024-04-18T14:44:21.899 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:21.899 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:21.899 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-04-18T14:44:21.900 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:16.434175+0000", 2024-04-18T14:44:21.900 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.001313102 2024-04-18T14:44:21.900 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:21.900 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:21.900 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-04-18T14:44:21.900 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:16.434206+0000", 2024-04-18T14:44:21.900 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.1322000000000003e-05 2024-04-18T14:44:21.900 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:21.900 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:21.900 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-04-18T14:44:21.900 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:16.434223+0000", 2024-04-18T14:44:21.900 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.6535999999999999e-05 2024-04-18T14:44:21.900 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:21.900 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:21.900 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-04-18T14:44:21.900 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:16.434352+0000", 2024-04-18T14:44:21.901 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000129498 2024-04-18T14:44:21.901 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:21.901 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:21.901 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_started", 2024-04-18T14:44:21.901 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:16.434377+0000", 2024-04-18T14:44:21.901 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.4956e-05 2024-04-18T14:44:21.901 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:21.901 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:21.901 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_committed", 2024-04-18T14:44:21.901 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:16.438759+0000", 2024-04-18T14:44:21.901 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0043819469999999998 2024-04-18T14:44:21.901 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:21.901 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:21.901 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-04-18T14:44:21.901 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:16.438795+0000", 2024-04-18T14:44:21.901 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.6143999999999998e-05 2024-04-18T14:44:21.902 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:44:21.902 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-04-18T14:44:21.902 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:44:21.902 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:21.902 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:21.902 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "MOSDECSubOpWrite(3.1s5 77/30 ECSubWrite(tid=83, reqid=client.4559.0:829, at_version=77'68, trim_to=0'0, roll_forward_to=76'66))", 2024-04-18T14:44:21.902 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-04-18T14:44:16.459404+0000", 2024-04-18T14:44:21.902 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 5.3799241069999999, 2024-04-18T14:44:21.902 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0060011409999999998, 2024-04-18T14:44:21.902 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-04-18T14:44:21.902 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "reached pg", 2024-04-18T14:44:21.902 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-04-18T14:44:21.902 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:21.902 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-04-18T14:44:21.902 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:16.459404+0000", 2024-04-18T14:44:21.903 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:44:21.903 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:21.903 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:21.903 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-04-18T14:44:21.903 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:16.459404+0000", 2024-04-18T14:44:21.903 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:44:21.903 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:21.903 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:21.903 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-04-18T14:44:21.903 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:16.459403+0000", 2024-04-18T14:44:21.903 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-04-18T14:44:21.903 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:21.903 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:21.903 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-04-18T14:44:21.903 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:16.460991+0000", 2024-04-18T14:44:21.904 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0015873199999999999 2024-04-18T14:44:21.904 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:21.904 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:21.904 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-04-18T14:44:21.904 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:16.461009+0000", 2024-04-18T14:44:21.904 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.7952999999999999e-05 2024-04-18T14:44:21.904 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:21.904 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:21.904 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-04-18T14:44:21.904 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:16.461018+0000", 2024-04-18T14:44:21.904 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.3859999999999996e-06 2024-04-18T14:44:21.904 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:21.904 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:21.904 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-04-18T14:44:21.904 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:16.461070+0000", 2024-04-18T14:44:21.904 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.1551999999999997e-05 2024-04-18T14:44:21.905 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:21.905 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:21.905 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_started", 2024-04-18T14:44:21.905 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:16.461075+0000", 2024-04-18T14:44:21.905 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.7919999999999998e-06 2024-04-18T14:44:21.905 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:21.905 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:21.905 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_committed", 2024-04-18T14:44:21.905 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:16.465369+0000", 2024-04-18T14:44:21.905 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0042938120000000001 2024-04-18T14:44:21.905 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:21.905 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:21.905 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-04-18T14:44:21.905 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:16.465405+0000", 2024-04-18T14:44:21.905 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.6041999999999998e-05 2024-04-18T14:44:21.905 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:44:21.906 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-04-18T14:44:21.906 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:44:21.906 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:21.906 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:21.906 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "MOSDECSubOpWrite(3.ds2 78/30 ECSubWrite(tid=55, reqid=osd.7.0:55, at_version=78'51, trim_to=0'0, roll_forward_to=77'47))", 2024-04-18T14:44:21.906 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-04-18T14:44:17.429425+0000", 2024-04-18T14:44:21.906 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 4.4099029679999999, 2024-04-18T14:44:21.906 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.007234491, 2024-04-18T14:44:21.906 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-04-18T14:44:21.906 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "reached pg", 2024-04-18T14:44:21.906 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-04-18T14:44:21.906 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:21.906 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-04-18T14:44:21.906 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:17.429425+0000", 2024-04-18T14:44:21.906 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:44:21.907 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:21.907 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:21.907 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-04-18T14:44:21.907 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:17.429425+0000", 2024-04-18T14:44:21.907 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:44:21.907 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:21.907 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:21.907 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-04-18T14:44:21.907 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:17.429424+0000", 2024-04-18T14:44:21.907 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-04-18T14:44:21.907 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:21.907 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:21.907 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-04-18T14:44:21.907 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:17.429500+0000", 2024-04-18T14:44:21.907 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.6341999999999995e-05 2024-04-18T14:44:21.908 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:21.908 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:21.908 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-04-18T14:44:21.908 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:17.429516+0000", 2024-04-18T14:44:21.908 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.5616000000000001e-05 2024-04-18T14:44:21.908 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:21.908 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:21.908 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-04-18T14:44:21.908 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:17.429526+0000", 2024-04-18T14:44:21.908 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.0244999999999999e-05 2024-04-18T14:44:21.908 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:21.908 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:21.908 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-04-18T14:44:21.908 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:17.429634+0000", 2024-04-18T14:44:21.908 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000108063 2024-04-18T14:44:21.908 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:21.909 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:21.909 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_started", 2024-04-18T14:44:21.909 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:17.429647+0000", 2024-04-18T14:44:21.909 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.2758000000000001e-05 2024-04-18T14:44:21.909 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:21.909 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:21.909 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_committed", 2024-04-18T14:44:21.909 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:17.436604+0000", 2024-04-18T14:44:21.909 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0069567320000000002 2024-04-18T14:44:21.909 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:21.909 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:21.909 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-04-18T14:44:21.909 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:17.436660+0000", 2024-04-18T14:44:21.909 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.5753e-05 2024-04-18T14:44:21.909 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:44:21.909 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-04-18T14:44:21.910 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:44:21.910 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:21.910 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:21.910 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "MOSDECSubOpWrite(3.8s2 78/73 ECSubWrite(tid=204, reqid=osd.5.0:203, at_version=0'0, trim_to=0'0, roll_forward_to=78'141))", 2024-04-18T14:44:21.910 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-04-18T14:44:17.430693+0000", 2024-04-18T14:44:21.910 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 4.4086350870000004, 2024-04-18T14:44:21.910 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0075421250000000002, 2024-04-18T14:44:21.910 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-04-18T14:44:21.910 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "reached pg", 2024-04-18T14:44:21.910 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-04-18T14:44:21.910 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:21.910 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-04-18T14:44:21.910 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:17.430693+0000", 2024-04-18T14:44:21.910 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:44:21.910 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:21.911 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:21.911 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-04-18T14:44:21.911 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:17.430693+0000", 2024-04-18T14:44:21.911 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:44:21.911 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:21.911 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:21.911 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-04-18T14:44:21.911 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:17.430692+0000", 2024-04-18T14:44:21.911 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-04-18T14:44:21.911 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:21.911 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:21.911 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-04-18T14:44:21.911 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:17.430706+0000", 2024-04-18T14:44:21.911 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.3910000000000001e-05 2024-04-18T14:44:21.911 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:21.911 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:21.912 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-04-18T14:44:21.912 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:17.430721+0000", 2024-04-18T14:44:21.912 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.4643e-05 2024-04-18T14:44:21.912 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:21.912 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:21.912 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-04-18T14:44:21.912 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:17.430730+0000", 2024-04-18T14:44:21.912 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.1220000000000001e-06 2024-04-18T14:44:21.912 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:21.912 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:21.912 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-04-18T14:44:21.912 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:17.430786+0000", 2024-04-18T14:44:21.912 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.6715000000000002e-05 2024-04-18T14:44:21.912 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:21.912 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:21.912 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_started", 2024-04-18T14:44:21.913 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:17.430797+0000", 2024-04-18T14:44:21.913 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.0762e-05 2024-04-18T14:44:21.913 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:21.913 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:21.913 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_committed", 2024-04-18T14:44:21.913 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:17.438205+0000", 2024-04-18T14:44:21.913 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0074078879999999996 2024-04-18T14:44:21.913 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:21.913 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:21.913 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-04-18T14:44:21.913 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:17.438235+0000", 2024-04-18T14:44:21.913 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.0148999999999999e-05 2024-04-18T14:44:21.913 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:44:21.913 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-04-18T14:44:21.913 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:44:21.913 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:21.914 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:21.914 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "MOSDECSubOpWrite(3.8s2 78/73 ECSubWrite(tid=205, reqid=osd.5.0:205, at_version=78'143, trim_to=0'0, roll_forward_to=78'141))", 2024-04-18T14:44:21.914 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-04-18T14:44:17.430749+0000", 2024-04-18T14:44:21.914 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 4.4085789179999999, 2024-04-18T14:44:21.914 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0086751180000000008, 2024-04-18T14:44:21.914 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-04-18T14:44:21.914 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "reached pg", 2024-04-18T14:44:21.914 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-04-18T14:44:21.914 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:21.914 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-04-18T14:44:21.914 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:17.430749+0000", 2024-04-18T14:44:21.914 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:44:21.914 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:21.914 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:21.914 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-04-18T14:44:21.915 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:17.430749+0000", 2024-04-18T14:44:21.915 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:44:21.915 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:21.915 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:21.915 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-04-18T14:44:21.915 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:17.430749+0000", 2024-04-18T14:44:21.915 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-04-18T14:44:21.915 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:21.915 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:21.915 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-04-18T14:44:21.915 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:17.430772+0000", 2024-04-18T14:44:21.915 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.2721000000000002e-05 2024-04-18T14:44:21.915 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:21.915 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:21.915 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-04-18T14:44:21.915 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:17.430780+0000", 2024-04-18T14:44:21.916 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.5080000000000005e-06 2024-04-18T14:44:21.916 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:21.916 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:21.916 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-04-18T14:44:21.916 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:17.430787+0000", 2024-04-18T14:44:21.916 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.6630000000000004e-06 2024-04-18T14:44:21.916 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:21.916 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:21.916 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-04-18T14:44:21.916 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:17.431083+0000", 2024-04-18T14:44:21.916 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00029602799999999999 2024-04-18T14:44:21.916 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:21.916 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:21.916 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_started", 2024-04-18T14:44:21.916 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:17.431092+0000", 2024-04-18T14:44:21.917 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.4269999999999997e-06 2024-04-18T14:44:21.917 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:21.917 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:21.917 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_committed", 2024-04-18T14:44:21.917 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:17.439385+0000", 2024-04-18T14:44:21.917 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0082926960000000004 2024-04-18T14:44:21.917 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:21.917 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:21.917 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-04-18T14:44:21.917 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:17.439424+0000", 2024-04-18T14:44:21.917 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.9486000000000001e-05 2024-04-18T14:44:21.917 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:44:21.917 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-04-18T14:44:21.917 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:44:21.917 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:21.917 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:21.918 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "MOSDECSubOpWrite(3.8s2 78/73 ECSubWrite(tid=206, reqid=osd.5.0:206, at_version=78'145, trim_to=0'0, roll_forward_to=78'141))", 2024-04-18T14:44:21.918 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-04-18T14:44:17.430793+0000", 2024-04-18T14:44:21.918 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 4.4085350490000001, 2024-04-18T14:44:21.918 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.010791795999999999, 2024-04-18T14:44:21.918 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-04-18T14:44:21.918 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "reached pg", 2024-04-18T14:44:21.918 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-04-18T14:44:21.918 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:21.918 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-04-18T14:44:21.918 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:17.430793+0000", 2024-04-18T14:44:21.918 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:44:21.918 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:21.918 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:21.918 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-04-18T14:44:21.918 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:17.430793+0000", 2024-04-18T14:44:21.919 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:44:21.919 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:21.919 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:21.919 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-04-18T14:44:21.919 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:17.430793+0000", 2024-04-18T14:44:21.919 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-04-18T14:44:21.919 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:21.919 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:21.919 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-04-18T14:44:21.919 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:17.430815+0000", 2024-04-18T14:44:21.919 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.2118000000000001e-05 2024-04-18T14:44:21.919 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:21.919 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:21.919 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-04-18T14:44:21.919 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:17.430822+0000", 2024-04-18T14:44:21.919 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.391e-06 2024-04-18T14:44:21.920 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:21.920 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:21.920 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-04-18T14:44:21.920 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:17.430828+0000", 2024-04-18T14:44:21.920 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.7810000000000002e-06 2024-04-18T14:44:21.920 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:21.920 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:21.920 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-04-18T14:44:21.920 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:17.433522+0000", 2024-04-18T14:44:21.920 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0026944680000000002 2024-04-18T14:44:21.920 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:21.920 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:21.920 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_started", 2024-04-18T14:44:21.920 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:17.433543+0000", 2024-04-18T14:44:21.920 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.0693999999999999e-05 2024-04-18T14:44:21.920 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:21.921 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:21.921 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_committed", 2024-04-18T14:44:21.921 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:17.441553+0000", 2024-04-18T14:44:21.921 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0080093360000000006 2024-04-18T14:44:21.921 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:21.921 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:21.921 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-04-18T14:44:21.921 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:17.441585+0000", 2024-04-18T14:44:21.921 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.2351999999999998e-05 2024-04-18T14:44:21.921 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:44:21.921 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-04-18T14:44:21.921 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:44:21.921 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:44:21.921 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-04-18T14:44:21.921 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-04-18T14:44:21.923 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-04-18T14:44:21.923 INFO:tasks.ceph.osd.15.smithi134.stderr:2024-04-18T14:44:21.928+0000 7f08e6a51640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 15 (PID: 25218) UID: 0 2024-04-18T14:44:22.025 INFO:tasks.ceph.osd.3.smithi134.stderr:2024-04-18T14:44:22.028+0000 7fe7a4443640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25211) UID: 0 2024-04-18T14:44:22.048 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-04-18T14:44:22.048 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [], 2024-04-18T14:44:22.048 INFO:teuthology.orchestra.run.smithi086.stdout: "num_ops": 0 2024-04-18T14:44:22.048 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-04-18T14:44:22.062 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-04-18T14:44:22.126 INFO:tasks.ceph.osd.15.smithi134.stderr:2024-04-18T14:44:22.128+0000 7f08e6a51640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 15 (PID: 25218) UID: 0 2024-04-18T14:44:22.180 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-04-18T14:44:22.180 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [], 2024-04-18T14:44:22.180 INFO:teuthology.orchestra.run.smithi086.stdout: "complaint_time": 30, 2024-04-18T14:44:22.180 INFO:teuthology.orchestra.run.smithi086.stdout: "num_blocked_ops": 0 2024-04-18T14:44:22.181 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-04-18T14:44:22.195 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-04-18T14:44:22.227 INFO:tasks.ceph.osd.5.smithi096.stderr:2024-04-18T14:44:22.229+0000 7fc33f25b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 24889) UID: 0 2024-04-18T14:44:22.315 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-04-18T14:44:22.316 INFO:teuthology.orchestra.run.smithi086.stdout: "size": 20, 2024-04-18T14:44:22.316 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 600, 2024-04-18T14:44:22.316 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [ 2024-04-18T14:44:22.316 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:22.316 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "MOSDECSubOpWrite(3.7s3 41/30 ECSubWrite(tid=50, reqid=osd.14.0:49, at_version=0'0, trim_to=0'0, roll_forward_to=41'17))", 2024-04-18T14:44:22.316 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-04-18T14:43:40.762947+0000", 2024-04-18T14:44:22.316 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 41.551602043999999, 2024-04-18T14:44:22.316 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0096923070000000007, 2024-04-18T14:44:22.316 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-04-18T14:44:22.316 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "reached pg", 2024-04-18T14:44:22.316 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-04-18T14:44:22.316 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:22.317 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-04-18T14:44:22.317 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:40.762947+0000", 2024-04-18T14:44:22.317 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:44:22.317 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:22.317 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:22.317 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-04-18T14:44:22.317 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:40.762947+0000", 2024-04-18T14:44:22.317 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:44:22.317 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:22.317 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:22.317 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-04-18T14:44:22.317 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:40.762946+0000", 2024-04-18T14:44:22.318 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999986 2024-04-18T14:44:22.318 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:22.318 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:22.318 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-04-18T14:44:22.318 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:40.762974+0000", 2024-04-18T14:44:22.318 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.8242000000000002e-05 2024-04-18T14:44:22.318 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:22.318 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:22.318 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-04-18T14:44:22.318 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:40.763004+0000", 2024-04-18T14:44:22.318 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.9932000000000001e-05 2024-04-18T14:44:22.319 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:22.319 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:22.319 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-04-18T14:44:22.319 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:40.763027+0000", 2024-04-18T14:44:22.319 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.2526000000000001e-05 2024-04-18T14:44:22.319 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:22.319 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:22.319 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-04-18T14:44:22.319 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:40.763080+0000", 2024-04-18T14:44:22.319 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.3529000000000002e-05 2024-04-18T14:44:22.319 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:22.319 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:22.319 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_started", 2024-04-18T14:44:22.320 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:40.763090+0000", 2024-04-18T14:44:22.320 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.7249999999999992e-06 2024-04-18T14:44:22.320 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:22.320 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:22.320 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_committed", 2024-04-18T14:44:22.320 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:40.772540+0000", 2024-04-18T14:44:22.320 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0094502969999999999 2024-04-18T14:44:22.320 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:22.320 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:22.320 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-04-18T14:44:22.320 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:40.772640+0000", 2024-04-18T14:44:22.320 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.9636000000000006e-05 2024-04-18T14:44:22.320 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:44:22.321 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-04-18T14:44:22.321 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:44:22.321 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:22.321 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:22.321 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "MOSDECSubOpWrite(3.8s3 41/30 ECSubWrite(tid=35, reqid=client.4559.0:250, at_version=41'18, trim_to=0'0, roll_forward_to=38'16))", 2024-04-18T14:44:22.321 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-04-18T14:43:40.763913+0000", 2024-04-18T14:44:22.321 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 41.550636599000001, 2024-04-18T14:44:22.322 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.011255968999999999, 2024-04-18T14:44:22.322 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-04-18T14:44:22.322 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "reached pg", 2024-04-18T14:44:22.322 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-04-18T14:44:22.322 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:22.322 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-04-18T14:44:22.322 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:40.763913+0000", 2024-04-18T14:44:22.322 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:44:22.322 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:22.322 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:22.322 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-04-18T14:44:22.322 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:40.763913+0000", 2024-04-18T14:44:22.323 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:44:22.323 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:22.323 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:22.323 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-04-18T14:44:22.323 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:40.763912+0000", 2024-04-18T14:44:22.323 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-04-18T14:44:22.323 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:22.323 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:22.323 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-04-18T14:44:22.323 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:40.763957+0000", 2024-04-18T14:44:22.323 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.4271999999999999e-05 2024-04-18T14:44:22.324 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:22.324 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:22.324 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-04-18T14:44:22.324 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:40.765627+0000", 2024-04-18T14:44:22.324 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.001670878 2024-04-18T14:44:22.324 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:22.324 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:22.324 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-04-18T14:44:22.324 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:40.765654+0000", 2024-04-18T14:44:22.324 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.6435999999999999e-05 2024-04-18T14:44:22.324 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:22.325 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:22.325 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-04-18T14:44:22.325 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:40.765722+0000", 2024-04-18T14:44:22.325 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.8376999999999999e-05 2024-04-18T14:44:22.325 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:22.325 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:22.325 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_started", 2024-04-18T14:44:22.325 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:40.765732+0000", 2024-04-18T14:44:22.325 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.4870000000000008e-06 2024-04-18T14:44:22.325 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:22.325 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:22.325 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_committed", 2024-04-18T14:44:22.325 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:40.775138+0000", 2024-04-18T14:44:22.326 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0094060670000000006 2024-04-18T14:44:22.326 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:22.326 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:22.326 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-04-18T14:44:22.326 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:40.775169+0000", 2024-04-18T14:44:22.326 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.1068999999999997e-05 2024-04-18T14:44:22.326 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:44:22.326 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-04-18T14:44:22.326 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:44:22.326 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:22.326 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:22.326 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "MOSDECSubOpWrite(3.cs4 41/30 ECSubWrite(tid=45, reqid=osd.11.0:45, at_version=41'22, trim_to=0'0, roll_forward_to=39'20))", 2024-04-18T14:44:22.326 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-04-18T14:43:40.764604+0000", 2024-04-18T14:44:22.327 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 41.549945078, 2024-04-18T14:44:22.327 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0073682449999999998, 2024-04-18T14:44:22.327 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-04-18T14:44:22.327 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "reached pg", 2024-04-18T14:44:22.327 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-04-18T14:44:22.327 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:22.327 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-04-18T14:44:22.327 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:40.764604+0000", 2024-04-18T14:44:22.327 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:44:22.327 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:22.327 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:22.327 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-04-18T14:44:22.328 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:40.764604+0000", 2024-04-18T14:44:22.328 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:44:22.328 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:22.328 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:22.328 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-04-18T14:44:22.328 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:40.764604+0000", 2024-04-18T14:44:22.328 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-04-18T14:44:22.328 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:22.328 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:22.329 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-04-18T14:44:22.329 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:40.764673+0000", 2024-04-18T14:44:22.329 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.9608000000000002e-05 2024-04-18T14:44:22.329 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:22.329 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:22.329 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-04-18T14:44:22.329 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:40.764714+0000", 2024-04-18T14:44:22.329 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.0794999999999998e-05 2024-04-18T14:44:22.329 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:22.329 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:22.329 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-04-18T14:44:22.329 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:40.764738+0000", 2024-04-18T14:44:22.329 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.3881999999999999e-05 2024-04-18T14:44:22.330 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:22.330 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:22.330 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-04-18T14:44:22.330 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:40.764809+0000", 2024-04-18T14:44:22.330 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.1100999999999996e-05 2024-04-18T14:44:22.330 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:22.330 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:22.330 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_started", 2024-04-18T14:44:22.331 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:40.764818+0000", 2024-04-18T14:44:22.331 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.0739999999999999e-06 2024-04-18T14:44:22.331 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:22.331 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:22.331 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_committed", 2024-04-18T14:44:22.331 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:40.771915+0000", 2024-04-18T14:44:22.331 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0070967479999999999 2024-04-18T14:44:22.331 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:22.331 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:22.331 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-04-18T14:44:22.332 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:40.771973+0000", 2024-04-18T14:44:22.332 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.7821000000000001e-05 2024-04-18T14:44:22.332 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:44:22.332 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-04-18T14:44:22.332 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:44:22.332 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:22.332 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:22.332 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "MOSDECSubOpWrite(3.cs4 41/30 ECSubWrite(tid=46, reqid=osd.11.0:46, at_version=41'24, trim_to=0'0, roll_forward_to=39'20))", 2024-04-18T14:44:22.332 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-04-18T14:43:40.764769+0000", 2024-04-18T14:44:22.332 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 41.549780497999997, 2024-04-18T14:44:22.332 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0098445330000000008, 2024-04-18T14:44:22.333 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-04-18T14:44:22.333 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "reached pg", 2024-04-18T14:44:22.333 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-04-18T14:44:22.333 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:22.333 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-04-18T14:44:22.333 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:40.764769+0000", 2024-04-18T14:44:22.333 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:44:22.333 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:22.333 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:22.333 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-04-18T14:44:22.334 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:40.764769+0000", 2024-04-18T14:44:22.334 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:44:22.334 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:22.334 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:22.334 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-04-18T14:44:22.334 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:40.764768+0000", 2024-04-18T14:44:22.334 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-04-18T14:44:22.334 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:22.334 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:22.334 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-04-18T14:44:22.334 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:40.764809+0000", 2024-04-18T14:44:22.335 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.0917999999999997e-05 2024-04-18T14:44:22.335 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:22.335 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:22.335 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-04-18T14:44:22.335 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:40.764861+0000", 2024-04-18T14:44:22.335 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.2088e-05 2024-04-18T14:44:22.335 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:22.335 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:22.335 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-04-18T14:44:22.335 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:40.764881+0000", 2024-04-18T14:44:22.335 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.0372000000000001e-05 2024-04-18T14:44:22.335 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:22.336 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:22.336 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-04-18T14:44:22.336 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:40.765246+0000", 2024-04-18T14:44:22.336 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00036430499999999999 2024-04-18T14:44:22.336 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:22.336 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:22.336 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_started", 2024-04-18T14:44:22.336 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:40.765271+0000", 2024-04-18T14:44:22.336 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.5083e-05 2024-04-18T14:44:22.336 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:22.336 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:22.336 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_committed", 2024-04-18T14:44:22.336 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:40.774586+0000", 2024-04-18T14:44:22.337 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0093148369999999994 2024-04-18T14:44:22.337 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:22.337 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:22.337 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-04-18T14:44:22.337 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:40.774613+0000", 2024-04-18T14:44:22.337 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.7803000000000001e-05 2024-04-18T14:44:22.337 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:44:22.337 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-04-18T14:44:22.337 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:44:22.337 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:22.337 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:22.337 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "MOSDECSubOpWrite(3.9s3 41/30 ECSubWrite(tid=41, reqid=osd.12.0:41, at_version=41'27, trim_to=0'0, roll_forward_to=38'24))", 2024-04-18T14:44:22.337 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-04-18T14:43:40.770088+0000", 2024-04-18T14:44:22.337 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 41.544461697999999, 2024-04-18T14:44:22.338 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0073282030000000001, 2024-04-18T14:44:22.338 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-04-18T14:44:22.338 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "reached pg", 2024-04-18T14:44:22.338 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-04-18T14:44:22.338 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:22.338 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-04-18T14:44:22.338 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:40.770088+0000", 2024-04-18T14:44:22.338 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:44:22.338 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:22.338 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:22.338 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-04-18T14:44:22.339 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:40.770088+0000", 2024-04-18T14:44:22.339 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:44:22.339 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:22.339 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:22.339 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-04-18T14:44:22.339 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:40.770087+0000", 2024-04-18T14:44:22.339 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-04-18T14:44:22.339 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:22.339 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:22.339 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-04-18T14:44:22.339 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:40.770161+0000", 2024-04-18T14:44:22.339 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.3917000000000004e-05 2024-04-18T14:44:22.340 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:22.340 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:22.340 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-04-18T14:44:22.340 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:40.770184+0000", 2024-04-18T14:44:22.340 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.3244e-05 2024-04-18T14:44:22.340 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:22.340 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:22.340 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-04-18T14:44:22.340 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:40.770202+0000", 2024-04-18T14:44:22.340 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.7997000000000001e-05 2024-04-18T14:44:22.340 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:22.340 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:22.341 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-04-18T14:44:22.341 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:40.770279+0000", 2024-04-18T14:44:22.341 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.7689999999999996e-05 2024-04-18T14:44:22.341 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:22.341 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:22.341 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_started", 2024-04-18T14:44:22.341 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:40.770288+0000", 2024-04-18T14:44:22.341 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.5609999999999999e-06 2024-04-18T14:44:22.341 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:22.341 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:22.342 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_committed", 2024-04-18T14:44:22.342 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:40.777381+0000", 2024-04-18T14:44:22.342 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0070933189999999998 2024-04-18T14:44:22.342 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:22.342 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:22.342 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-04-18T14:44:22.342 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:40.777416+0000", 2024-04-18T14:44:22.342 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.4649e-05 2024-04-18T14:44:22.343 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:44:22.343 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-04-18T14:44:22.343 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:44:22.343 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:22.343 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:22.343 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "MOSDECSubOpWrite(3.8s3 41/30 ECSubWrite(tid=36, reqid=osd.5.0:36, at_version=41'20, trim_to=0'0, roll_forward_to=38'16))", 2024-04-18T14:44:22.343 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-04-18T14:43:40.770246+0000", 2024-04-18T14:44:22.343 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 41.544303390000003, 2024-04-18T14:44:22.343 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0072291999999999999, 2024-04-18T14:44:22.343 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-04-18T14:44:22.343 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "reached pg", 2024-04-18T14:44:22.343 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-04-18T14:44:22.344 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:22.344 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-04-18T14:44:22.344 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:40.770246+0000", 2024-04-18T14:44:22.344 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:44:22.344 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:22.344 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:22.344 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-04-18T14:44:22.344 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:40.770246+0000", 2024-04-18T14:44:22.344 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:44:22.344 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:22.344 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:22.344 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-04-18T14:44:22.344 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:40.770245+0000", 2024-04-18T14:44:22.345 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-04-18T14:44:22.345 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:22.345 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:22.345 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-04-18T14:44:22.345 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:40.770279+0000", 2024-04-18T14:44:22.345 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.3759e-05 2024-04-18T14:44:22.345 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:22.345 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:22.345 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-04-18T14:44:22.345 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:40.770298+0000", 2024-04-18T14:44:22.345 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.9048000000000001e-05 2024-04-18T14:44:22.345 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:22.346 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:22.346 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-04-18T14:44:22.346 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:40.770313+0000", 2024-04-18T14:44:22.346 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.4934e-05 2024-04-18T14:44:22.346 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:22.346 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:22.346 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-04-18T14:44:22.346 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:40.770695+0000", 2024-04-18T14:44:22.346 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00038176900000000001 2024-04-18T14:44:22.346 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:22.346 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:22.346 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_started", 2024-04-18T14:44:22.346 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:40.770719+0000", 2024-04-18T14:44:22.347 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.3992e-05 2024-04-18T14:44:22.347 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:22.347 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:22.347 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_committed", 2024-04-18T14:44:22.347 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:40.777426+0000", 2024-04-18T14:44:22.347 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0067069989999999999 2024-04-18T14:44:22.347 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:22.347 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:22.347 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-04-18T14:44:22.347 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:40.777475+0000", 2024-04-18T14:44:22.347 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.9713999999999999e-05 2024-04-18T14:44:22.347 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:44:22.347 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-04-18T14:44:22.347 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:44:22.348 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:22.348 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:22.348 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "MOSDECSubOpWrite(3.9s3 57/30 ECSubWrite(tid=95, reqid=client.4559.0:507, at_version=57'71, trim_to=0'0, roll_forward_to=57'69))", 2024-04-18T14:44:22.348 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-04-18T14:43:56.586290+0000", 2024-04-18T14:44:22.348 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 25.728259224999999, 2024-04-18T14:44:22.348 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0074930279999999997, 2024-04-18T14:44:22.348 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-04-18T14:44:22.348 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "reached pg", 2024-04-18T14:44:22.348 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-04-18T14:44:22.348 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:22.348 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-04-18T14:44:22.348 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:56.586290+0000", 2024-04-18T14:44:22.348 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:44:22.349 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:22.349 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:22.349 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-04-18T14:44:22.349 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:56.586290+0000", 2024-04-18T14:44:22.349 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:44:22.349 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:22.349 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:22.349 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-04-18T14:44:22.349 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:56.586290+0000", 2024-04-18T14:44:22.349 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-04-18T14:44:22.349 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:22.349 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:22.349 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-04-18T14:44:22.350 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:56.586775+0000", 2024-04-18T14:44:22.350 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00048549599999999997 2024-04-18T14:44:22.350 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:22.350 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:22.350 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-04-18T14:44:22.350 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:56.586811+0000", 2024-04-18T14:44:22.350 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.5896000000000003e-05 2024-04-18T14:44:22.350 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:22.350 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:22.350 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-04-18T14:44:22.350 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:56.586821+0000", 2024-04-18T14:44:22.351 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.0137e-05 2024-04-18T14:44:22.351 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:22.351 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:22.351 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-04-18T14:44:22.351 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:56.586936+0000", 2024-04-18T14:44:22.351 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000114364 2024-04-18T14:44:22.351 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:22.351 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:22.351 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_started", 2024-04-18T14:44:22.351 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:56.586949+0000", 2024-04-18T14:44:22.351 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.3230999999999999e-05 2024-04-18T14:44:22.351 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:22.351 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:22.352 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_committed", 2024-04-18T14:44:22.352 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:56.593713+0000", 2024-04-18T14:44:22.352 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0067640729999999998 2024-04-18T14:44:22.352 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:22.352 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:22.352 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-04-18T14:44:22.352 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:56.593783+0000", 2024-04-18T14:44:22.352 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.0392e-05 2024-04-18T14:44:22.352 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:44:22.353 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-04-18T14:44:22.353 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:44:22.353 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:22.353 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:22.353 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "MOSDECSubOpWrite(3.es2 57/30 ECSubWrite(tid=48, reqid=client.4559.0:514, at_version=57'36, trim_to=0'0, roll_forward_to=57'34))", 2024-04-18T14:44:22.353 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-04-18T14:43:56.587880+0000", 2024-04-18T14:44:22.353 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 25.726668987, 2024-04-18T14:44:22.353 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0090015359999999992, 2024-04-18T14:44:22.353 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-04-18T14:44:22.353 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "reached pg", 2024-04-18T14:44:22.353 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-04-18T14:44:22.353 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:22.353 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-04-18T14:44:22.354 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:56.587880+0000", 2024-04-18T14:44:22.354 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:44:22.354 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:22.354 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:22.354 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-04-18T14:44:22.354 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:56.587880+0000", 2024-04-18T14:44:22.354 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:44:22.354 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:22.354 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:22.354 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-04-18T14:44:22.354 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:56.587879+0000", 2024-04-18T14:44:22.354 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-04-18T14:44:22.355 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:22.355 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:22.355 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-04-18T14:44:22.355 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:56.588227+0000", 2024-04-18T14:44:22.355 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00034732099999999999 2024-04-18T14:44:22.355 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:22.355 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:22.355 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-04-18T14:44:22.355 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:56.588240+0000", 2024-04-18T14:44:22.355 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.325e-05 2024-04-18T14:44:22.355 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:22.355 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:22.356 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-04-18T14:44:22.356 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:56.588250+0000", 2024-04-18T14:44:22.356 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.7629999999999995e-06 2024-04-18T14:44:22.356 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:22.356 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:22.356 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-04-18T14:44:22.356 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:56.588308+0000", 2024-04-18T14:44:22.356 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.8607000000000003e-05 2024-04-18T14:44:22.356 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:22.356 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:22.356 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_started", 2024-04-18T14:44:22.356 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:56.588320+0000", 2024-04-18T14:44:22.356 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.1106e-05 2024-04-18T14:44:22.357 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:22.357 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:22.357 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_committed", 2024-04-18T14:44:22.357 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:56.596850+0000", 2024-04-18T14:44:22.357 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0085302520000000003 2024-04-18T14:44:22.357 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:22.357 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:22.357 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-04-18T14:44:22.357 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:56.596882+0000", 2024-04-18T14:44:22.358 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.2221999999999997e-05 2024-04-18T14:44:22.358 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:44:22.358 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-04-18T14:44:22.358 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:44:22.358 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:22.358 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:22.358 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "MOSDECSubOpWrite(3.cs4 72/30 ECSubWrite(tid=195, reqid=client.4559.0:746, at_version=72'128, trim_to=0'0, roll_forward_to=71'122))", 2024-04-18T14:44:22.358 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-04-18T14:44:11.771434+0000", 2024-04-18T14:44:22.358 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 10.543115552, 2024-04-18T14:44:22.358 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0077363900000000001, 2024-04-18T14:44:22.358 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-04-18T14:44:22.359 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "reached pg", 2024-04-18T14:44:22.359 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-04-18T14:44:22.359 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:22.359 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-04-18T14:44:22.359 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:11.771434+0000", 2024-04-18T14:44:22.359 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:44:22.359 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:22.359 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:22.359 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-04-18T14:44:22.359 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:11.771434+0000", 2024-04-18T14:44:22.359 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:44:22.359 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:22.360 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:22.360 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-04-18T14:44:22.360 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:11.771433+0000", 2024-04-18T14:44:22.360 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-04-18T14:44:22.360 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:22.360 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:22.360 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-04-18T14:44:22.360 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:11.771467+0000", 2024-04-18T14:44:22.360 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.3407e-05 2024-04-18T14:44:22.360 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:22.360 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:22.360 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-04-18T14:44:22.361 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:11.771476+0000", 2024-04-18T14:44:22.361 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.8890000000000008e-06 2024-04-18T14:44:22.361 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:22.361 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:22.361 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-04-18T14:44:22.361 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:11.771481+0000", 2024-04-18T14:44:22.361 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.8309999999999997e-06 2024-04-18T14:44:22.361 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:22.361 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:22.361 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-04-18T14:44:22.361 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:11.771523+0000", 2024-04-18T14:44:22.361 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.1467999999999997e-05 2024-04-18T14:44:22.361 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:22.362 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:22.362 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_started", 2024-04-18T14:44:22.362 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:11.771529+0000", 2024-04-18T14:44:22.362 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.6640000000000003e-06 2024-04-18T14:44:22.362 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:22.362 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:22.362 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_committed", 2024-04-18T14:44:22.362 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:11.779135+0000", 2024-04-18T14:44:22.362 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0076061339999999996 2024-04-18T14:44:22.362 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:22.362 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:22.363 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-04-18T14:44:22.363 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:11.779170+0000", 2024-04-18T14:44:22.363 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.5621999999999999e-05 2024-04-18T14:44:22.363 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:44:22.363 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-04-18T14:44:22.363 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:44:22.363 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:22.363 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:22.363 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "MOSDECSubOpWrite(3.7s3 76/30 ECSubWrite(tid=269, reqid=client.4559.0:799, at_version=76'99, trim_to=0'0, roll_forward_to=76'97))", 2024-04-18T14:44:22.363 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-04-18T14:44:15.583848+0000", 2024-04-18T14:44:22.364 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 6.7307014580000004, 2024-04-18T14:44:22.364 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.010702559, 2024-04-18T14:44:22.364 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-04-18T14:44:22.364 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "reached pg", 2024-04-18T14:44:22.364 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-04-18T14:44:22.364 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:22.364 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-04-18T14:44:22.364 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:15.583848+0000", 2024-04-18T14:44:22.364 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:44:22.364 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:22.364 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:22.364 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-04-18T14:44:22.364 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:15.583848+0000", 2024-04-18T14:44:22.365 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:44:22.365 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:22.365 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:22.365 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-04-18T14:44:22.365 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:15.583846+0000", 2024-04-18T14:44:22.365 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999981 2024-04-18T14:44:22.365 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:22.365 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:22.365 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-04-18T14:44:22.365 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:15.584822+0000", 2024-04-18T14:44:22.365 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00097583900000000005 2024-04-18T14:44:22.365 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:22.365 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:22.365 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-04-18T14:44:22.366 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:15.584851+0000", 2024-04-18T14:44:22.366 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.8822e-05 2024-04-18T14:44:22.366 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:22.366 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:22.366 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-04-18T14:44:22.366 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:15.584866+0000", 2024-04-18T14:44:22.366 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.4996e-05 2024-04-18T14:44:22.366 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:22.366 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:22.366 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-04-18T14:44:22.366 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:15.585006+0000", 2024-04-18T14:44:22.366 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000139787 2024-04-18T14:44:22.367 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:22.367 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:22.367 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_started", 2024-04-18T14:44:22.367 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:15.585034+0000", 2024-04-18T14:44:22.367 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.7979000000000001e-05 2024-04-18T14:44:22.367 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:22.367 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:22.367 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_committed", 2024-04-18T14:44:22.367 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:15.594492+0000", 2024-04-18T14:44:22.367 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0094587409999999997 2024-04-18T14:44:22.367 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:22.367 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:22.368 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-04-18T14:44:22.368 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:15.594551+0000", 2024-04-18T14:44:22.368 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.8078000000000002e-05 2024-04-18T14:44:22.368 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:44:22.368 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-04-18T14:44:22.368 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:44:22.368 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:22.368 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:22.368 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "MOSDECSubOpWrite(3.8s3 78/73 ECSubWrite(tid=206, reqid=osd.5.0:206, at_version=78'145, trim_to=0'0, roll_forward_to=78'141))", 2024-04-18T14:44:22.369 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-04-18T14:44:17.430965+0000", 2024-04-18T14:44:22.369 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 4.8835844860000002, 2024-04-18T14:44:22.369 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.007553583, 2024-04-18T14:44:22.369 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-04-18T14:44:22.369 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "reached pg", 2024-04-18T14:44:22.369 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-04-18T14:44:22.369 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:22.369 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-04-18T14:44:22.369 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:17.430965+0000", 2024-04-18T14:44:22.369 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:44:22.370 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:22.370 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:22.370 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-04-18T14:44:22.370 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:17.430965+0000", 2024-04-18T14:44:22.370 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:44:22.370 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:22.370 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:22.370 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-04-18T14:44:22.370 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:17.430965+0000", 2024-04-18T14:44:22.371 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-04-18T14:44:22.371 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:22.371 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:22.371 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-04-18T14:44:22.371 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:17.430987+0000", 2024-04-18T14:44:22.371 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.2350000000000001e-05 2024-04-18T14:44:22.371 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:22.371 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:22.371 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-04-18T14:44:22.371 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:17.430995+0000", 2024-04-18T14:44:22.371 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.0539999999999995e-06 2024-04-18T14:44:22.371 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:22.372 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:22.372 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-04-18T14:44:22.372 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:17.431002+0000", 2024-04-18T14:44:22.372 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.6959999999999999e-06 2024-04-18T14:44:22.372 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:22.372 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:22.372 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-04-18T14:44:22.372 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:17.431905+0000", 2024-04-18T14:44:22.372 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00090345300000000003 2024-04-18T14:44:22.372 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:22.372 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:22.372 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_started", 2024-04-18T14:44:22.372 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:17.431920+0000", 2024-04-18T14:44:22.373 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.5164000000000001e-05 2024-04-18T14:44:22.373 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:22.373 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:22.373 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_committed", 2024-04-18T14:44:22.373 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:17.438407+0000", 2024-04-18T14:44:22.373 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0064864509999999998 2024-04-18T14:44:22.373 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:22.373 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:22.373 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-04-18T14:44:22.373 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:17.438519+0000", 2024-04-18T14:44:22.373 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00011172599999999999 2024-04-18T14:44:22.373 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:44:22.373 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-04-18T14:44:22.374 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:44:22.374 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:22.374 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:22.374 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "MOSDECSubOpWrite(3.9s3 78/73 ECSubWrite(tid=199, reqid=osd.12.0:199, at_version=78'141, trim_to=0'0, roll_forward_to=78'139))", 2024-04-18T14:44:22.374 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-04-18T14:44:17.474060+0000", 2024-04-18T14:44:22.374 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 4.8404892740000003, 2024-04-18T14:44:22.374 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0073534940000000003, 2024-04-18T14:44:22.374 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-04-18T14:44:22.374 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "reached pg", 2024-04-18T14:44:22.374 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-04-18T14:44:22.374 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:22.374 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-04-18T14:44:22.374 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:17.474060+0000", 2024-04-18T14:44:22.375 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:44:22.375 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:22.375 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:22.375 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-04-18T14:44:22.375 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:17.474060+0000", 2024-04-18T14:44:22.375 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:44:22.375 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:22.375 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:22.375 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-04-18T14:44:22.375 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:17.474060+0000", 2024-04-18T14:44:22.375 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-04-18T14:44:22.375 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:22.376 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:22.376 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-04-18T14:44:22.376 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:17.474086+0000", 2024-04-18T14:44:22.376 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.6169999999999998e-05 2024-04-18T14:44:22.376 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:22.376 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:22.376 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-04-18T14:44:22.376 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:17.474101+0000", 2024-04-18T14:44:22.376 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.4894e-05 2024-04-18T14:44:22.376 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:22.376 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:22.376 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-04-18T14:44:22.376 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:17.474109+0000", 2024-04-18T14:44:22.376 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.1249999999999993e-06 2024-04-18T14:44:22.377 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:22.377 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:22.377 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-04-18T14:44:22.377 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:17.474156+0000", 2024-04-18T14:44:22.377 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.7698000000000003e-05 2024-04-18T14:44:22.377 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:22.377 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:22.377 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_started", 2024-04-18T14:44:22.377 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:17.474167+0000", 2024-04-18T14:44:22.377 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.082e-05 2024-04-18T14:44:22.377 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:22.377 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:22.378 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_committed", 2024-04-18T14:44:22.378 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:17.481383+0000", 2024-04-18T14:44:22.378 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0072159620000000002 2024-04-18T14:44:22.378 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:22.378 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:22.378 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-04-18T14:44:22.378 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:17.481414+0000", 2024-04-18T14:44:22.378 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.0496000000000001e-05 2024-04-18T14:44:22.378 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:44:22.378 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-04-18T14:44:22.378 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:44:22.378 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:22.378 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:22.379 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "MOSDECSubOpWrite(3.9s3 78/73 ECSubWrite(tid=200, reqid=osd.12.0:200, at_version=78'143, trim_to=0'0, roll_forward_to=78'139))", 2024-04-18T14:44:22.379 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-04-18T14:44:17.474727+0000", 2024-04-18T14:44:22.379 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 4.8398225660000005, 2024-04-18T14:44:22.379 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.010103231000000001, 2024-04-18T14:44:22.379 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-04-18T14:44:22.379 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "reached pg", 2024-04-18T14:44:22.379 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-04-18T14:44:22.379 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:22.379 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-04-18T14:44:22.379 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:17.474727+0000", 2024-04-18T14:44:22.379 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:44:22.379 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:22.379 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:22.379 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-04-18T14:44:22.380 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:17.474727+0000", 2024-04-18T14:44:22.380 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:44:22.380 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:22.380 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:22.380 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-04-18T14:44:22.380 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:17.474726+0000", 2024-04-18T14:44:22.380 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-04-18T14:44:22.380 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:22.380 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:22.380 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-04-18T14:44:22.380 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:17.474744+0000", 2024-04-18T14:44:22.380 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.7419999999999999e-05 2024-04-18T14:44:22.380 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:22.381 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:22.381 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-04-18T14:44:22.381 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:17.474753+0000", 2024-04-18T14:44:22.381 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.6220000000000004e-06 2024-04-18T14:44:22.381 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:22.381 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:22.381 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-04-18T14:44:22.381 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:17.474761+0000", 2024-04-18T14:44:22.381 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.4379999999999998e-06 2024-04-18T14:44:22.381 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:22.381 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:22.381 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-04-18T14:44:22.381 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:17.475899+0000", 2024-04-18T14:44:22.381 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0011381830000000001 2024-04-18T14:44:22.382 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:22.382 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:22.382 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_started", 2024-04-18T14:44:22.382 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:17.475910+0000", 2024-04-18T14:44:22.382 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.1369000000000001e-05 2024-04-18T14:44:22.382 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:22.382 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:22.382 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_committed", 2024-04-18T14:44:22.382 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:17.484806+0000", 2024-04-18T14:44:22.382 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0088952909999999996 2024-04-18T14:44:22.382 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:22.382 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:22.383 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-04-18T14:44:22.383 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:17.484830+0000", 2024-04-18T14:44:22.383 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.4399000000000001e-05 2024-04-18T14:44:22.383 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:44:22.383 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-04-18T14:44:22.383 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:44:22.383 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:22.383 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:22.383 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "MOSDECSubOpWrite(3.cs4 82/30 ECSubWrite(tid=252, reqid=osd.11.0:252, at_version=82'172, trim_to=0'0, roll_forward_to=80'170))", 2024-04-18T14:44:22.383 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-04-18T14:44:21.467724+0000", 2024-04-18T14:44:22.383 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 0.84682522599999999, 2024-04-18T14:44:22.383 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0092317690000000008, 2024-04-18T14:44:22.383 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-04-18T14:44:22.384 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "reached pg", 2024-04-18T14:44:22.384 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-04-18T14:44:22.384 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:22.384 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-04-18T14:44:22.384 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:21.467724+0000", 2024-04-18T14:44:22.385 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:44:22.385 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:22.385 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:22.386 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-04-18T14:44:22.386 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:21.467724+0000", 2024-04-18T14:44:22.386 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:44:22.386 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:22.386 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:22.386 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-04-18T14:44:22.387 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:21.467724+0000", 2024-04-18T14:44:22.387 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967296 2024-04-18T14:44:22.387 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:22.387 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:22.387 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-04-18T14:44:22.387 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:21.467789+0000", 2024-04-18T14:44:22.387 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.5184999999999993e-05 2024-04-18T14:44:22.387 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:22.387 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:22.387 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-04-18T14:44:22.387 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:21.467803+0000", 2024-04-18T14:44:22.387 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.3953e-05 2024-04-18T14:44:22.388 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:22.388 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:22.388 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-04-18T14:44:22.388 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:21.467811+0000", 2024-04-18T14:44:22.388 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.1699999999999997e-06 2024-04-18T14:44:22.388 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:22.388 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:22.388 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-04-18T14:44:22.388 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:21.467875+0000", 2024-04-18T14:44:22.388 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.4123999999999998e-05 2024-04-18T14:44:22.388 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:22.388 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:22.388 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_started", 2024-04-18T14:44:22.389 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:21.467887+0000", 2024-04-18T14:44:22.389 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.1511999999999999e-05 2024-04-18T14:44:22.389 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:22.389 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:22.389 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_committed", 2024-04-18T14:44:22.389 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:21.476901+0000", 2024-04-18T14:44:22.389 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0090138249999999996 2024-04-18T14:44:22.389 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:22.389 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:22.389 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-04-18T14:44:22.389 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:21.476956+0000", 2024-04-18T14:44:22.389 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.5216000000000001e-05 2024-04-18T14:44:22.390 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:44:22.390 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-04-18T14:44:22.390 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:44:22.390 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:22.390 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:22.390 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "MOSDECSubOpWrite(3.2s3 82/70 ECSubWrite(tid=299, reqid=osd.13.0:299, at_version=82'58, trim_to=0'0, roll_forward_to=80'56))", 2024-04-18T14:44:22.390 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-04-18T14:44:21.468162+0000", 2024-04-18T14:44:22.390 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 0.84638761399999995, 2024-04-18T14:44:22.390 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0080591810000000003, 2024-04-18T14:44:22.390 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-04-18T14:44:22.390 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "reached pg", 2024-04-18T14:44:22.390 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-04-18T14:44:22.391 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:22.391 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-04-18T14:44:22.391 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:21.468162+0000", 2024-04-18T14:44:22.391 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:44:22.391 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:22.391 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:22.391 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-04-18T14:44:22.391 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:21.468162+0000", 2024-04-18T14:44:22.391 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:44:22.391 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:22.391 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:22.391 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-04-18T14:44:22.391 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:21.468162+0000", 2024-04-18T14:44:22.392 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-04-18T14:44:22.392 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:22.392 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:22.392 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-04-18T14:44:22.392 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:21.468185+0000", 2024-04-18T14:44:22.392 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.3459e-05 2024-04-18T14:44:22.392 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:22.392 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:22.392 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-04-18T14:44:22.392 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:21.468201+0000", 2024-04-18T14:44:22.392 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.5480000000000001e-05 2024-04-18T14:44:22.392 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:22.393 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:22.393 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-04-18T14:44:22.393 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:21.468210+0000", 2024-04-18T14:44:22.393 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.2539999999999998e-06 2024-04-18T14:44:22.393 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:22.393 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:22.393 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-04-18T14:44:22.393 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:21.468257+0000", 2024-04-18T14:44:22.393 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.6904999999999999e-05 2024-04-18T14:44:22.393 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:22.393 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:22.394 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_started", 2024-04-18T14:44:22.394 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:21.468266+0000", 2024-04-18T14:44:22.394 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.5040000000000008e-06 2024-04-18T14:44:22.394 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:22.394 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:22.394 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_committed", 2024-04-18T14:44:22.394 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:21.476176+0000", 2024-04-18T14:44:22.394 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.007909859 2024-04-18T14:44:22.394 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:22.394 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:22.394 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-04-18T14:44:22.394 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:21.476221+0000", 2024-04-18T14:44:22.395 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.4987000000000001e-05 2024-04-18T14:44:22.395 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:44:22.395 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-04-18T14:44:22.395 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:44:22.395 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:22.395 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:22.395 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "MOSDECSubOpWrite(3.7s3 82/30 ECSubWrite(tid=320, reqid=osd.14.0:320, at_version=82'123, trim_to=0'0, roll_forward_to=80'119))", 2024-04-18T14:44:22.395 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-04-18T14:44:21.468235+0000", 2024-04-18T14:44:22.395 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 0.84631487000000005, 2024-04-18T14:44:22.395 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.012586632, 2024-04-18T14:44:22.395 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-04-18T14:44:22.395 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "reached pg", 2024-04-18T14:44:22.396 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-04-18T14:44:22.396 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:22.396 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-04-18T14:44:22.396 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:21.468235+0000", 2024-04-18T14:44:22.396 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:44:22.396 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:22.396 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:22.396 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-04-18T14:44:22.396 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:21.468235+0000", 2024-04-18T14:44:22.396 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:44:22.396 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:22.397 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:22.397 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-04-18T14:44:22.397 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:21.468234+0000", 2024-04-18T14:44:22.397 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-04-18T14:44:22.397 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:22.397 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:22.397 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-04-18T14:44:22.397 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:21.468265+0000", 2024-04-18T14:44:22.397 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.1770000000000002e-05 2024-04-18T14:44:22.397 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:22.397 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:22.397 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-04-18T14:44:22.398 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:21.468278+0000", 2024-04-18T14:44:22.398 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.2816999999999999e-05 2024-04-18T14:44:22.398 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:22.398 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:22.398 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-04-18T14:44:22.398 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:21.468288+0000", 2024-04-18T14:44:22.398 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.5610000000000004e-06 2024-04-18T14:44:22.398 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:22.398 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:22.398 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-04-18T14:44:22.398 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:21.468345+0000", 2024-04-18T14:44:22.398 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.6768999999999998e-05 2024-04-18T14:44:22.399 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:22.399 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:22.399 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_started", 2024-04-18T14:44:22.399 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:21.468357+0000", 2024-04-18T14:44:22.399 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.2227e-05 2024-04-18T14:44:22.399 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:22.399 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:22.399 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_committed", 2024-04-18T14:44:22.399 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:21.480788+0000", 2024-04-18T14:44:22.399 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.012431548000000001 2024-04-18T14:44:22.399 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:22.399 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:22.400 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-04-18T14:44:22.400 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:21.480821+0000", 2024-04-18T14:44:22.400 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.2882000000000001e-05 2024-04-18T14:44:22.400 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:44:22.400 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-04-18T14:44:22.400 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:44:22.400 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:22.400 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:22.400 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "MOSDECSubOpWrite(3.3s4 82/30 ECSubWrite(tid=298, reqid=osd.13.0:298, at_version=82'59, trim_to=0'0, roll_forward_to=80'57))", 2024-04-18T14:44:22.400 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-04-18T14:44:21.469045+0000", 2024-04-18T14:44:22.400 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 0.84550462900000001, 2024-04-18T14:44:22.400 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0071991499999999996, 2024-04-18T14:44:22.401 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-04-18T14:44:22.401 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "reached pg", 2024-04-18T14:44:22.401 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-04-18T14:44:22.401 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:22.401 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-04-18T14:44:22.401 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:21.469045+0000", 2024-04-18T14:44:22.401 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:44:22.401 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:22.401 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:22.401 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-04-18T14:44:22.401 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:21.469045+0000", 2024-04-18T14:44:22.402 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:44:22.402 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:22.402 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:22.402 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-04-18T14:44:22.402 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:21.469044+0000", 2024-04-18T14:44:22.402 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-04-18T14:44:22.402 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:22.402 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:22.402 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-04-18T14:44:22.402 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:21.469068+0000", 2024-04-18T14:44:22.402 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.3575e-05 2024-04-18T14:44:22.403 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:22.403 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:22.403 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-04-18T14:44:22.403 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:21.469084+0000", 2024-04-18T14:44:22.403 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.6249999999999999e-05 2024-04-18T14:44:22.403 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:22.403 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:22.403 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-04-18T14:44:22.403 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:21.469092+0000", 2024-04-18T14:44:22.403 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.5220000000000007e-06 2024-04-18T14:44:22.403 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:22.403 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:22.404 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-04-18T14:44:22.404 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:21.469159+0000", 2024-04-18T14:44:22.404 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.6196000000000001e-05 2024-04-18T14:44:22.404 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:22.404 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:22.404 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_started", 2024-04-18T14:44:22.404 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:21.469174+0000", 2024-04-18T14:44:22.404 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.522e-05 2024-04-18T14:44:22.404 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:22.404 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:22.404 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_committed", 2024-04-18T14:44:22.405 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:21.476205+0000", 2024-04-18T14:44:22.405 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0070316939999999998 2024-04-18T14:44:22.405 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:22.405 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:22.405 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-04-18T14:44:22.405 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:21.476244+0000", 2024-04-18T14:44:22.405 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.8482000000000002e-05 2024-04-18T14:44:22.405 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:44:22.405 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-04-18T14:44:22.405 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:44:22.405 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:22.405 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:22.405 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "MOSDECSubOpWrite(3.2s3 82/70 ECSubWrite(tid=300, reqid=osd.13.0:300, at_version=82'60, trim_to=0'0, roll_forward_to=80'56))", 2024-04-18T14:44:22.406 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-04-18T14:44:21.470572+0000", 2024-04-18T14:44:22.406 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 0.84397738300000003, 2024-04-18T14:44:22.406 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0097274200000000005, 2024-04-18T14:44:22.406 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-04-18T14:44:22.406 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "reached pg", 2024-04-18T14:44:22.406 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-04-18T14:44:22.406 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:22.406 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-04-18T14:44:22.406 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:21.470572+0000", 2024-04-18T14:44:22.406 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:44:22.406 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:22.406 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:22.407 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-04-18T14:44:22.407 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:21.470572+0000", 2024-04-18T14:44:22.407 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:44:22.407 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:22.407 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:22.407 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-04-18T14:44:22.407 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:21.470571+0000", 2024-04-18T14:44:22.407 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-04-18T14:44:22.407 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:22.407 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:22.407 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-04-18T14:44:22.407 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:21.470598+0000", 2024-04-18T14:44:22.407 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.7412000000000001e-05 2024-04-18T14:44:22.408 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:22.408 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:22.408 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-04-18T14:44:22.408 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:21.470613+0000", 2024-04-18T14:44:22.408 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.4132e-05 2024-04-18T14:44:22.408 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:22.408 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:22.408 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-04-18T14:44:22.408 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:21.470622+0000", 2024-04-18T14:44:22.408 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.2769999999999994e-06 2024-04-18T14:44:22.408 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:22.408 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:22.408 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-04-18T14:44:22.409 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:21.470690+0000", 2024-04-18T14:44:22.409 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.7742000000000003e-05 2024-04-18T14:44:22.409 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:22.409 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:22.409 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_started", 2024-04-18T14:44:22.409 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:21.470706+0000", 2024-04-18T14:44:22.409 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.6696000000000001e-05 2024-04-18T14:44:22.409 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:22.409 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:22.409 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_committed", 2024-04-18T14:44:22.409 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:21.480260+0000", 2024-04-18T14:44:22.409 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0095535889999999995 2024-04-18T14:44:22.409 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:22.410 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:22.410 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-04-18T14:44:22.410 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:21.480299+0000", 2024-04-18T14:44:22.410 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.9665000000000001e-05 2024-04-18T14:44:22.410 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:44:22.410 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-04-18T14:44:22.410 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:44:22.410 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:22.410 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:22.410 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "MOSDECSubOpWrite(3.7s3 82/30 ECSubWrite(tid=322, reqid=osd.14.0:322, at_version=82'125, trim_to=0'0, roll_forward_to=80'119))", 2024-04-18T14:44:22.410 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-04-18T14:44:21.472019+0000", 2024-04-18T14:44:22.410 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 0.842530785, 2024-04-18T14:44:22.410 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0088263590000000006, 2024-04-18T14:44:22.411 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-04-18T14:44:22.411 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "reached pg", 2024-04-18T14:44:22.411 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-04-18T14:44:22.411 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:22.411 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-04-18T14:44:22.411 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:21.472019+0000", 2024-04-18T14:44:22.411 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:44:22.411 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:22.411 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:22.411 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-04-18T14:44:22.411 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:21.472019+0000", 2024-04-18T14:44:22.411 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:44:22.412 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:22.412 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:22.412 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-04-18T14:44:22.412 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:21.472018+0000", 2024-04-18T14:44:22.412 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-04-18T14:44:22.412 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:22.412 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:22.412 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-04-18T14:44:22.412 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:21.472040+0000", 2024-04-18T14:44:22.412 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.2648000000000001e-05 2024-04-18T14:44:22.412 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:22.413 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:22.413 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-04-18T14:44:22.413 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:21.472058+0000", 2024-04-18T14:44:22.413 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.7167999999999999e-05 2024-04-18T14:44:22.413 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:22.413 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:22.413 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-04-18T14:44:22.413 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:21.472069+0000", 2024-04-18T14:44:22.413 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.1489e-05 2024-04-18T14:44:22.413 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:22.413 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:22.413 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-04-18T14:44:22.414 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:21.472132+0000", 2024-04-18T14:44:22.414 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.3077999999999995e-05 2024-04-18T14:44:22.414 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:22.414 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:22.414 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_started", 2024-04-18T14:44:22.414 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:21.472146+0000", 2024-04-18T14:44:22.414 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.3705e-05 2024-04-18T14:44:22.414 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:22.414 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:22.414 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_committed", 2024-04-18T14:44:22.414 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:21.480830+0000", 2024-04-18T14:44:22.414 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0086840760000000006 2024-04-18T14:44:22.415 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:22.415 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:22.415 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-04-18T14:44:22.415 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:21.480845+0000", 2024-04-18T14:44:22.415 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.5105e-05 2024-04-18T14:44:22.415 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:44:22.415 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-04-18T14:44:22.415 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:44:22.415 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:22.415 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:22.415 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "MOSDECSubOpWrite(3.fs2 82/30 ECSubWrite(tid=255, reqid=osd.11.0:255, at_version=82'50, trim_to=0'0, roll_forward_to=81'46))", 2024-04-18T14:44:22.415 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-04-18T14:44:21.475377+0000", 2024-04-18T14:44:22.416 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 0.83917235400000001, 2024-04-18T14:44:22.416 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0077455650000000003, 2024-04-18T14:44:22.416 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-04-18T14:44:22.416 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "reached pg", 2024-04-18T14:44:22.416 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-04-18T14:44:22.416 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:22.416 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-04-18T14:44:22.416 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:21.475377+0000", 2024-04-18T14:44:22.416 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:44:22.416 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:22.416 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:22.417 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-04-18T14:44:22.417 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:21.475377+0000", 2024-04-18T14:44:22.417 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:44:22.417 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:22.417 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:22.417 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-04-18T14:44:22.417 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:21.475376+0000", 2024-04-18T14:44:22.417 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-04-18T14:44:22.417 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:22.417 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:22.417 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-04-18T14:44:22.417 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:21.475399+0000", 2024-04-18T14:44:22.418 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.2883000000000001e-05 2024-04-18T14:44:22.418 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:22.418 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:22.418 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-04-18T14:44:22.418 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:21.475413+0000", 2024-04-18T14:44:22.418 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.3679000000000001e-05 2024-04-18T14:44:22.418 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:22.418 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:22.418 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-04-18T14:44:22.418 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:21.475422+0000", 2024-04-18T14:44:22.418 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.9039999999999998e-06 2024-04-18T14:44:22.419 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:22.419 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:22.419 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-04-18T14:44:22.419 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:21.477078+0000", 2024-04-18T14:44:22.419 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.001656161 2024-04-18T14:44:22.419 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:22.419 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:22.419 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_started", 2024-04-18T14:44:22.419 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:21.477091+0000", 2024-04-18T14:44:22.419 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.3291e-05 2024-04-18T14:44:22.419 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:22.419 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:22.420 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_committed", 2024-04-18T14:44:22.420 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:21.483095+0000", 2024-04-18T14:44:22.420 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0060040459999999999 2024-04-18T14:44:22.420 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:22.420 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:22.420 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-04-18T14:44:22.420 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:21.483123+0000", 2024-04-18T14:44:22.420 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.7477000000000001e-05 2024-04-18T14:44:22.420 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:44:22.420 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-04-18T14:44:22.420 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:44:22.420 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:44:22.421 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-04-18T14:44:22.421 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-04-18T14:44:22.421 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-18T14:44:22.422 INFO:tasks.ceph.osd.14.smithi119.stderr:2024-04-18T14:44:22.426+0000 7f180f599640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 14 (PID: 24900) UID: 0 2024-04-18T14:44:22.423 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.8.asok dump_ops_in_flight 2024-04-18T14:44:22.458 INFO:tasks.rados.rados.0.smithi134.stdout:357: done (4 left) 2024-04-18T14:44:22.458 INFO:tasks.rados.rados.0.smithi134.stdout:359: done (3 left) 2024-04-18T14:44:22.458 INFO:tasks.rados.rados.0.smithi134.stdout:360: done (2 left) 2024-04-18T14:44:22.459 INFO:tasks.rados.rados.0.smithi134.stdout:361: done (1 left) 2024-04-18T14:44:22.459 INFO:tasks.rados.rados.0.smithi134.stdout:362: done (0 left) 2024-04-18T14:44:22.459 INFO:tasks.rados.rados.0.smithi134.stdout:363: rmattr oid 30 current snap is 32 2024-04-18T14:44:22.459 INFO:tasks.rados.rados.0.smithi134.stdout:append oid 42 current snap is 32 2024-04-18T14:44:22.459 INFO:tasks.rados.rados.0.smithi134.stdout:364: seq_num 141 ranges {2310144=425984,2736128=573440,3309568=425984,3735552=524288,4259840=425984} 2024-04-18T14:44:22.474 INFO:tasks.rados.rados.0.smithi134.stdout:364: writing smithi13430248-42 from 2310144 to 2736128 tid 1 2024-04-18T14:44:22.477 INFO:tasks.rados.rados.0.smithi134.stdout:364: writing smithi13430248-42 from 2736128 to 3309568 tid 2 2024-04-18T14:44:22.479 INFO:tasks.rados.rados.0.smithi134.stdout:364: writing smithi13430248-42 from 3309568 to 3735552 tid 3 2024-04-18T14:44:22.483 INFO:tasks.rados.rados.0.smithi134.stdout:364: writing smithi13430248-42 from 3735552 to 4259840 tid 4 2024-04-18T14:44:22.485 INFO:tasks.rados.rados.0.smithi134.stdout:364: writing smithi13430248-42 from 4259840 to 4685824 tid 5 2024-04-18T14:44:22.485 INFO:tasks.rados.rados.0.smithi134.stdout:365: snap_create 2024-04-18T14:44:22.485 INFO:tasks.rados.rados.0.smithi134.stdout:update_object_version oid 30 v 131 (ObjNum 87 snap 17 seq_num 87) dirty exists 2024-04-18T14:44:22.489 INFO:tasks.rados.rados.0.smithi134.stdout:364: finishing write tid 1 to smithi13430248-42 2024-04-18T14:44:22.497 INFO:tasks.rados.rados.0.smithi134.stdout:364: finishing write tid 2 to smithi13430248-42 2024-04-18T14:44:22.504 INFO:tasks.rados.rados.0.smithi134.stdout:364: finishing write tid 3 to smithi13430248-42 2024-04-18T14:44:22.505 INFO:tasks.rados.rados.0.smithi134.stdout:364: finishing write tid 4 to smithi13430248-42 2024-04-18T14:44:22.506 INFO:tasks.rados.rados.0.smithi134.stdout:364: finishing write tid 5 to smithi13430248-42 2024-04-18T14:44:22.506 INFO:tasks.rados.rados.0.smithi134.stdout:364: finishing write tid 6 to smithi13430248-42 2024-04-18T14:44:22.510 INFO:tasks.rados.rados.0.smithi134.stdout:364: finishing write tid 7 to smithi13430248-42 2024-04-18T14:44:22.510 INFO:tasks.rados.rados.0.smithi134.stdout:364: oid 42 updating version 0 to 82 2024-04-18T14:44:22.510 INFO:tasks.rados.rados.0.smithi134.stdout:364: oid 42 updating version 82 to 84 2024-04-18T14:44:22.510 INFO:tasks.rados.rados.0.smithi134.stdout:364: oid 42 version 84 is already newer than 83 2024-04-18T14:44:22.510 INFO:tasks.rados.rados.0.smithi134.stdout:364: oid 42 version 84 is already newer than 81 2024-04-18T14:44:22.510 INFO:tasks.rados.rados.0.smithi134.stdout:364: oid 42 version 84 is already newer than 80 2024-04-18T14:44:22.510 INFO:tasks.rados.rados.0.smithi134.stdout:364: oid 42 version 84 is already newer than 79 2024-04-18T14:44:22.510 INFO:tasks.rados.rados.0.smithi134.stdout:update_object_version oid 42 v 84 (ObjNum 141 snap 32 seq_num 141) dirty exists 2024-04-18T14:44:22.510 INFO:tasks.rados.rados.0.smithi134.stdout:364: left oid 42 (ObjNum 141 snap 32 seq_num 141) 2024-04-18T14:44:22.523 INFO:tasks.ceph.osd.6.smithi119.stderr:2024-04-18T14:44:22.526+0000 7fb7cb8bd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 24896) UID: 0 2024-04-18T14:44:22.559 INFO:tasks.thrashosds.thrasher:in_osds: [0, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 1] out_osds: [] dead_osds: [] live_osds: [0, 4, 8, 12, 1, 5, 9, 13, 2, 6, 10, 14, 3, 7, 11, 15] 2024-04-18T14:44:22.559 INFO:tasks.thrashosds.thrasher:choose_action: min_in 8 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-04-18T14:44:22.559 INFO:tasks.thrashosds.thrasher:primary_affinity 2024-04-18T14:44:22.560 INFO:tasks.thrashosds.thrasher:Setting osd 14 primary_affinity to 0.371234 2024-04-18T14:44:22.560 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 14 0.3712339898170709 2024-04-18T14:44:22.592 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-04-18T14:44:22.592 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [], 2024-04-18T14:44:22.592 INFO:teuthology.orchestra.run.smithi086.stdout: "num_ops": 0 2024-04-18T14:44:22.592 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-04-18T14:44:22.608 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.8.asok dump_blocked_ops 2024-04-18T14:44:22.610 INFO:teuthology.orchestra.run.smithi086.stdout:osd.0: {} 2024-04-18T14:44:22.611 INFO:teuthology.orchestra.run.smithi086.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-18T14:44:22.624 INFO:tasks.ceph.osd.10.smithi119.stderr:2024-04-18T14:44:22.626+0000 7f6f24c12640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 10 (PID: 24898) UID: 0 2024-04-18T14:44:22.631 INFO:teuthology.orchestra.run.smithi086.stdout:osd.1: {} 2024-04-18T14:44:22.631 INFO:teuthology.orchestra.run.smithi086.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-18T14:44:22.651 INFO:teuthology.orchestra.run.smithi086.stdout:osd.2: {} 2024-04-18T14:44:22.651 INFO:teuthology.orchestra.run.smithi086.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-18T14:44:22.671 INFO:teuthology.orchestra.run.smithi086.stdout:osd.3: {} 2024-04-18T14:44:22.671 INFO:teuthology.orchestra.run.smithi086.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-18T14:44:22.689 INFO:teuthology.orchestra.run.smithi086.stdout:osd.4: {} 2024-04-18T14:44:22.690 INFO:teuthology.orchestra.run.smithi086.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-18T14:44:22.709 INFO:teuthology.orchestra.run.smithi086.stdout:osd.5: {} 2024-04-18T14:44:22.710 INFO:teuthology.orchestra.run.smithi086.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-18T14:44:22.724 INFO:tasks.ceph.osd.2.smithi119.stderr:2024-04-18T14:44:22.726+0000 7fcbd30c0640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 24894) UID: 0 2024-04-18T14:44:22.727 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-04-18T14:44:22.727 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [], 2024-04-18T14:44:22.727 INFO:teuthology.orchestra.run.smithi086.stdout: "complaint_time": 30, 2024-04-18T14:44:22.727 INFO:teuthology.orchestra.run.smithi086.stdout: "num_blocked_ops": 0 2024-04-18T14:44:22.727 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-04-18T14:44:22.729 INFO:teuthology.orchestra.run.smithi086.stdout:osd.6: {} 2024-04-18T14:44:22.730 INFO:teuthology.orchestra.run.smithi086.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-18T14:44:22.741 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.8.asok dump_historic_ops 2024-04-18T14:44:22.750 INFO:teuthology.orchestra.run.smithi086.stdout:osd.7: {} 2024-04-18T14:44:22.750 INFO:teuthology.orchestra.run.smithi086.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-18T14:44:22.766 INFO:teuthology.orchestra.run.smithi086.stdout:osd.8: {} 2024-04-18T14:44:22.767 INFO:teuthology.orchestra.run.smithi086.stderr:osd.8: osd_enable_op_tracker = '' 2024-04-18T14:44:22.786 INFO:teuthology.orchestra.run.smithi086.stdout:osd.9: {} 2024-04-18T14:44:22.786 INFO:teuthology.orchestra.run.smithi086.stderr:osd.9: osd_enable_op_tracker = '' 2024-04-18T14:44:22.806 INFO:teuthology.orchestra.run.smithi086.stdout:osd.10: {} 2024-04-18T14:44:22.806 INFO:teuthology.orchestra.run.smithi086.stderr:osd.10: osd_enable_op_tracker = '' 2024-04-18T14:44:22.825 INFO:tasks.ceph.osd.14.smithi119.stderr:2024-04-18T14:44:22.826+0000 7f180f599640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 14 (PID: 24900) UID: 0 2024-04-18T14:44:22.826 INFO:teuthology.orchestra.run.smithi086.stdout:osd.11: {} 2024-04-18T14:44:22.826 INFO:teuthology.orchestra.run.smithi086.stderr:osd.11: osd_enable_op_tracker = '' 2024-04-18T14:44:22.842 INFO:teuthology.orchestra.run.smithi086.stdout:osd.12: {} 2024-04-18T14:44:22.842 INFO:teuthology.orchestra.run.smithi086.stderr:osd.12: osd_enable_op_tracker = '' 2024-04-18T14:44:22.862 INFO:teuthology.orchestra.run.smithi086.stdout:osd.13: {} 2024-04-18T14:44:22.862 INFO:teuthology.orchestra.run.smithi086.stderr:osd.13: osd_enable_op_tracker = '' 2024-04-18T14:44:22.863 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-18T14:44:22.861+0000 7ffa30cd4640 0 -- 172.21.15.86:0/2285883081 >> [v2:172.21.15.119:6808/24905,v1:172.21.15.119:6809/24905] conn(0x7ffa2c2211e0 msgr2=0x7ffa2c2235d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-04-18T14:44:22.864 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-04-18T14:44:22.864 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T14:44:22.878 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.12.asok dump_ops_in_flight 2024-04-18T14:44:22.963 INFO:tasks.ceph.osd.4.smithi086.stderr:2024-04-18T14:44:22.961+0000 7f0c4c462640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 24956) UID: 0 2024-04-18T14:44:23.027 INFO:tasks.ceph.osd.0.smithi086.stderr:2024-04-18T14:44:23.025+0000 7f7cdfd78640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 24953) UID: 0 2024-04-18T14:44:23.037 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-04-18T14:44:23.038 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T14:44:23.052 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.12.asok dump_blocked_ops 2024-04-18T14:44:23.087 INFO:teuthology.orchestra.run.smithi086.stdout:osd.14: {} 2024-04-18T14:44:23.087 INFO:teuthology.orchestra.run.smithi086.stderr:osd.14: osd_enable_op_tracker = '' 2024-04-18T14:44:23.107 INFO:teuthology.orchestra.run.smithi086.stdout:osd.15: {} 2024-04-18T14:44:23.107 INFO:teuthology.orchestra.run.smithi086.stderr:osd.15: osd_enable_op_tracker = '' 2024-04-18T14:44:23.171 INFO:tasks.ceph.osd.4.smithi086.stderr:2024-04-18T14:44:23.169+0000 7f0c4c462640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 24956) UID: 0 2024-04-18T14:44:23.202 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-04-18T14:44:23.202 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T14:44:23.215 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.12.asok dump_historic_ops 2024-04-18T14:44:23.228 INFO:tasks.ceph.osd.9.smithi096.stderr:2024-04-18T14:44:23.229+0000 7fa2c1cbf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 9 (PID: 24891) UID: 0 2024-04-18T14:44:23.329 INFO:tasks.ceph.osd.0.smithi086.stderr:2024-04-18T14:44:23.325+0000 7f7cdfd78640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 24953) UID: 0 2024-04-18T14:44:23.376 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-04-18T14:44:23.376 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T14:44:23.391 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-18T14:44:23.430 INFO:tasks.ceph.osd.6.smithi119.stderr:2024-04-18T14:44:23.430+0000 7fb7cb8bd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 24896) UID: 0 2024-04-18T14:44:23.462 INFO:teuthology.orchestra.run.smithi086.stderr:set osd.14 primary-affinity to 0.371234 (8243292) 2024-04-18T14:44:23.463 INFO:tasks.rados.rados.0.smithi134.stdout:363: done (2 left) 2024-04-18T14:44:23.463 INFO:tasks.rados.rados.0.smithi134.stdout:364: done (1 left) 2024-04-18T14:44:23.463 INFO:tasks.rados.rados.0.smithi134.stdout:365: done (0 left) 2024-04-18T14:44:23.463 INFO:tasks.rados.rados.0.smithi134.stdout:append oid 20 current snap is 33 2024-04-18T14:44:23.463 INFO:tasks.rados.rados.0.smithi134.stdout:366: seq_num 142 ranges {1425408=442368,1867776=720896,2588672=540672,3129344=688128} 2024-04-18T14:44:23.477 INFO:tasks.rados.rados.0.smithi134.stdout:366: writing smithi13430248-20 from 1425408 to 1867776 tid 1 2024-04-18T14:44:23.483 INFO:tasks.rados.rados.0.smithi134.stdout:366: writing smithi13430248-20 from 1867776 to 2588672 tid 2 2024-04-18T14:44:23.484 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-04-18T14:44:23.487 INFO:tasks.rados.rados.0.smithi134.stdout:366: writing smithi13430248-20 from 2588672 to 3129344 tid 3 2024-04-18T14:44:23.494 INFO:tasks.rados.rados.0.smithi134.stdout:366: writing smithi13430248-20 from 3129344 to 3817472 tid 4 2024-04-18T14:44:23.495 INFO:tasks.rados.rados.0.smithi134.stdout:367: read oid 16 snap -1 2024-04-18T14:44:23.495 INFO:tasks.rados.rados.0.smithi134.stdout:367: expect (ObjNum 98 snap 21 seq_num 98) 2024-04-18T14:44:23.495 INFO:tasks.rados.rados.0.smithi134.stdout:368: rollback oid 12 current snap is 33 2024-04-18T14:44:23.495 INFO:tasks.rados.rados.0.smithi134.stdout:rollback oid 12 to 27 2024-04-18T14:44:23.495 INFO:tasks.rados.rados.0.smithi134.stdout:append oid 6 current snap is 33 2024-04-18T14:44:23.495 INFO:tasks.rados.rados.0.smithi134.stdout:369: seq_num 143 ranges {2326528=458752,2785280=475136,3260416=655360,3915776=671744,4587520=147456} 2024-04-18T14:44:23.516 INFO:tasks.rados.rados.0.smithi134.stdout:369: writing smithi13430248-6 from 2326528 to 2785280 tid 1 2024-04-18T14:44:23.519 INFO:tasks.rados.rados.0.smithi134.stdout:369: writing smithi13430248-6 from 2785280 to 3260416 tid 2 2024-04-18T14:44:23.524 INFO:tasks.rados.rados.0.smithi134.stdout:369: writing smithi13430248-6 from 3260416 to 3915776 tid 3 2024-04-18T14:44:23.528 INFO:tasks.rados.rados.0.smithi134.stdout:369: writing smithi13430248-6 from 3915776 to 4587520 tid 4 2024-04-18T14:44:23.530 INFO:tasks.rados.rados.0.smithi134.stdout:369: writing smithi13430248-6 from 4587520 to 4734976 tid 5 2024-04-18T14:44:23.530 INFO:tasks.rados.rados.0.smithi134.stdout:append oid 37 current snap is 33 2024-04-18T14:44:23.530 INFO:tasks.rados.rados.0.smithi134.stdout:366: finishing write tid 1 to smithi13430248-20 2024-04-18T14:44:23.530 INFO:tasks.rados.rados.0.smithi134.stdout:370: seq_num 144 ranges {2752512=16384} 2024-04-18T14:44:23.531 INFO:tasks.ceph.osd.3.smithi134.stderr:2024-04-18T14:44:23.536+0000 7fe7a4443640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25211) UID: 0 2024-04-18T14:44:23.532 INFO:teuthology.orchestra.run.smithi096.stdout:ERROR: (22) Invalid argument 2024-04-18T14:44:23.533 INFO:teuthology.orchestra.run.smithi096.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T14:44:23.547 INFO:tasks.rados.rados.0.smithi134.stdout:370: writing smithi13430248-37 from 2752512 to 2768896 tid 1 2024-04-18T14:44:23.548 INFO:tasks.rados.rados.0.smithi134.stdout:371: delete oid 7 current snap is 33 2024-04-18T14:44:23.548 INFO:tasks.rados.rados.0.smithi134.stdout:366: finishing write tid 2 to smithi13430248-20 2024-04-18T14:44:23.548 INFO:tasks.rados.rados.0.smithi134.stdout:366: finishing write tid 3 to smithi13430248-20 2024-04-18T14:44:23.548 INFO:tasks.rados.rados.0.smithi134.stdout:366: finishing write tid 4 to smithi13430248-20 2024-04-18T14:44:23.548 INFO:tasks.rados.rados.0.smithi134.stdout:366: finishing write tid 5 to smithi13430248-20 2024-04-18T14:44:23.548 INFO:tasks.rados.rados.0.smithi134.stdout:368: finishing rollback tid 0 to smithi13430248-12 2024-04-18T14:44:23.548 INFO:tasks.rados.rados.0.smithi134.stdout:367: expect (ObjNum 98 snap 21 seq_num 98) 2024-04-18T14:44:23.549 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-18T14:44:23.632 INFO:tasks.ceph.osd.12.smithi086.stderr:2024-04-18T14:44:23.629+0000 7f6904968640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 12 (PID: 24960) UID: 0 2024-04-18T14:44:23.666 INFO:teuthology.orchestra.run.smithi096.stdout:ERROR: (22) Invalid argument 2024-04-18T14:44:23.666 INFO:teuthology.orchestra.run.smithi096.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T14:44:23.675 INFO:tasks.rados.rados.0.smithi134.stdout:368: finishing rollback tid 1 to smithi13430248-12 2024-04-18T14:44:23.675 INFO:tasks.rados.rados.0.smithi134.stdout:368: finishing rollback tid 2 to smithi13430248-12 2024-04-18T14:44:23.675 INFO:tasks.rados.rados.0.smithi134.stdout:update_object_version oid 12 v 177 (ObjNum 66 snap 9 seq_num 66) dirty exists 2024-04-18T14:44:23.675 INFO:tasks.rados.rados.0.smithi134.stdout:366: finishing write tid 6 to smithi13430248-20 2024-04-18T14:44:23.675 INFO:tasks.rados.rados.0.smithi134.stdout:366: oid 20 updating version 0 to 87 2024-04-18T14:44:23.675 INFO:tasks.rados.rados.0.smithi134.stdout:366: oid 20 version 87 is already newer than 85 2024-04-18T14:44:23.676 INFO:tasks.rados.rados.0.smithi134.stdout:366: oid 20 updating version 87 to 89 2024-04-18T14:44:23.676 INFO:tasks.rados.rados.0.smithi134.stdout:366: oid 20 version 89 is already newer than 88 2024-04-18T14:44:23.676 INFO:tasks.rados.rados.0.smithi134.stdout:366: oid 20 version 89 is already newer than 86 2024-04-18T14:44:23.676 INFO:tasks.rados.rados.0.smithi134.stdout:update_object_version oid 20 v 89 (ObjNum 142 snap 33 seq_num 142) dirty exists 2024-04-18T14:44:23.676 INFO:tasks.rados.rados.0.smithi134.stdout:366: left oid 20 (ObjNum 142 snap 33 seq_num 142) 2024-04-18T14:44:23.676 INFO:tasks.rados.rados.0.smithi134.stdout:369: finishing write tid 1 to smithi13430248-6 2024-04-18T14:44:23.676 INFO:tasks.rados.rados.0.smithi134.stdout:369: finishing write tid 2 to smithi13430248-6 2024-04-18T14:44:23.676 INFO:tasks.rados.rados.0.smithi134.stdout:369: finishing write tid 3 to smithi13430248-6 2024-04-18T14:44:23.676 INFO:tasks.rados.rados.0.smithi134.stdout:369: finishing write tid 4 to smithi13430248-6 2024-04-18T14:44:23.676 INFO:tasks.rados.rados.0.smithi134.stdout:369: finishing write tid 5 to smithi13430248-6 2024-04-18T14:44:23.676 INFO:tasks.rados.rados.0.smithi134.stdout:369: finishing write tid 6 to smithi13430248-6 2024-04-18T14:44:23.676 INFO:tasks.rados.rados.0.smithi134.stdout:369: finishing write tid 7 to smithi13430248-6 2024-04-18T14:44:23.676 INFO:tasks.rados.rados.0.smithi134.stdout:369: oid 6 updating version 0 to 110 2024-04-18T14:44:23.676 INFO:tasks.rados.rados.0.smithi134.stdout:369: oid 6 updating version 110 to 112 2024-04-18T14:44:23.677 INFO:tasks.rados.rados.0.smithi134.stdout:369: oid 6 version 112 is already newer than 108 2024-04-18T14:44:23.677 INFO:tasks.rados.rados.0.smithi134.stdout:369: oid 6 version 112 is already newer than 109 2024-04-18T14:44:23.677 INFO:tasks.rados.rados.0.smithi134.stdout:369: oid 6 version 112 is already newer than 107 2024-04-18T14:44:23.677 INFO:tasks.rados.rados.0.smithi134.stdout:369: oid 6 version 112 is already newer than 111 2024-04-18T14:44:23.677 INFO:tasks.rados.rados.0.smithi134.stdout:update_object_version oid 6 v 112 (ObjNum 143 snap 33 seq_num 143) dirty exists 2024-04-18T14:44:23.677 INFO:tasks.rados.rados.0.smithi134.stdout:369: left oid 6 (ObjNum 143 snap 33 seq_num 143) 2024-04-18T14:44:23.677 INFO:tasks.rados.rados.0.smithi134.stdout:370: finishing write tid 1 to smithi13430248-37 2024-04-18T14:44:23.677 INFO:tasks.rados.rados.0.smithi134.stdout:370: finishing write tid 2 to smithi13430248-37 2024-04-18T14:44:23.677 INFO:tasks.rados.rados.0.smithi134.stdout:370: finishing write tid 3 to smithi13430248-37 2024-04-18T14:44:23.677 INFO:tasks.rados.rados.0.smithi134.stdout:370: oid 37 updating version 0 to 91 2024-04-18T14:44:23.677 INFO:tasks.rados.rados.0.smithi134.stdout:370: oid 37 updating version 91 to 92 2024-04-18T14:44:23.677 INFO:tasks.rados.rados.0.smithi134.stdout:update_object_version oid 37 v 92 (ObjNum 144 snap 33 seq_num 144) dirty exists 2024-04-18T14:44:23.677 INFO:tasks.rados.rados.0.smithi134.stdout:370: left oid 37 (ObjNum 144 snap 33 seq_num 144) 2024-04-18T14:44:23.677 INFO:tasks.rados.rados.0.smithi134.stdout:366: done (5 left) 2024-04-18T14:44:23.677 INFO:tasks.rados.rados.0.smithi134.stdout:367: done (4 left) 2024-04-18T14:44:23.677 INFO:tasks.rados.rados.0.smithi134.stdout:368: done (3 left) 2024-04-18T14:44:23.678 INFO:tasks.rados.rados.0.smithi134.stdout:369: done (2 left) 2024-04-18T14:44:23.678 INFO:tasks.rados.rados.0.smithi134.stdout:370: done (1 left) 2024-04-18T14:44:23.678 INFO:tasks.rados.rados.0.smithi134.stdout:371: done (0 left) 2024-04-18T14:44:23.678 INFO:tasks.rados.rados.0.smithi134.stdout:372: copy_from oid 4 from oid 25 current snap is 33 2024-04-18T14:44:23.678 INFO:tasks.rados.rados.0.smithi134.stdout:373: read oid 49 snap -1 2024-04-18T14:44:23.678 INFO:tasks.rados.rados.0.smithi134.stdout:373: expect (ObjNum 133 snap 30 seq_num 133) 2024-04-18T14:44:23.678 INFO:tasks.rados.rados.0.smithi134.stdout:append oid 32 current snap is 33 2024-04-18T14:44:23.678 INFO:tasks.rados.rados.0.smithi134.stdout:374: seq_num 146 ranges {2949120=49152} 2024-04-18T14:44:23.681 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-18T14:44:23.700 INFO:tasks.rados.rados.0.smithi134.stdout:374: writing smithi13430248-32 from 2949120 to 2998272 tid 1 2024-04-18T14:44:23.700 INFO:tasks.rados.rados.0.smithi134.stdout:375: snap_remove snap 24 2024-04-18T14:44:23.733 INFO:tasks.ceph.osd.0.smithi086.stderr:2024-04-18T14:44:23.729+0000 7f7cdfd78640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 24953) UID: 0 2024-04-18T14:44:23.804 INFO:teuthology.orchestra.run.smithi096.stdout:ERROR: (22) Invalid argument 2024-04-18T14:44:23.805 INFO:teuthology.orchestra.run.smithi096.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T14:44:23.818 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-04-18T14:44:23.834 INFO:tasks.ceph.osd.11.smithi134.stderr:2024-04-18T14:44:23.840+0000 7f2d36f12640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 11 (PID: 25216) UID: 0 2024-04-18T14:44:23.935 INFO:tasks.ceph.osd.0.smithi086.stderr:2024-04-18T14:44:23.937+0000 7f7cdfd78640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 24953) UID: 0 2024-04-18T14:44:23.941 INFO:teuthology.orchestra.run.smithi096.stdout:ERROR: (22) Invalid argument 2024-04-18T14:44:23.941 INFO:teuthology.orchestra.run.smithi096.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T14:44:23.955 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-04-18T14:44:24.036 INFO:tasks.ceph.osd.14.smithi119.stderr:2024-04-18T14:44:24.038+0000 7f180f599640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 14 (PID: 24900) UID: 0 2024-04-18T14:44:24.070 INFO:teuthology.orchestra.run.smithi096.stdout:ERROR: (22) Invalid argument 2024-04-18T14:44:24.071 INFO:teuthology.orchestra.run.smithi096.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T14:44:24.084 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-04-18T14:44:24.137 INFO:tasks.ceph.osd.6.smithi119.stderr:2024-04-18T14:44:24.138+0000 7fb7cb8bd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 24896) UID: 0 2024-04-18T14:44:24.209 INFO:teuthology.orchestra.run.smithi096.stdout:ERROR: (22) Invalid argument 2024-04-18T14:44:24.209 INFO:teuthology.orchestra.run.smithi096.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T14:44:24.223 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.9.asok dump_ops_in_flight 2024-04-18T14:44:24.238 INFO:tasks.ceph.osd.2.smithi119.stderr:2024-04-18T14:44:24.242+0000 7fcbd30c0640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 24894) UID: 0 2024-04-18T14:44:24.339 INFO:tasks.ceph.osd.7.smithi134.stderr:2024-04-18T14:44:24.344+0000 7fd7de549640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25213) UID: 0 2024-04-18T14:44:24.342 INFO:teuthology.orchestra.run.smithi096.stdout:ERROR: (22) Invalid argument 2024-04-18T14:44:24.342 INFO:teuthology.orchestra.run.smithi096.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T14:44:24.357 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.9.asok dump_blocked_ops 2024-04-18T14:44:24.387 INFO:teuthology.orchestra.run.smithi086.stderr:nodeep-scrub is unset 2024-04-18T14:44:24.390 INFO:tasks.rados.rados.0.smithi134.stdout:375: done (3 left) 2024-04-18T14:44:24.390 INFO:tasks.rados.rados.0.smithi134.stdout:376: copy_from oid 16 from oid 15 current snap is 33 2024-04-18T14:44:24.390 INFO:tasks.rados.rados.0.smithi134.stdout:372: finishing copy_from racing read to smithi13430248-4 2024-04-18T14:44:24.391 INFO:tasks.rados.rados.0.smithi134.stdout:373: expect (ObjNum 133 snap 30 seq_num 133) 2024-04-18T14:44:24.439 INFO:tasks.ceph.osd.15.smithi134.stderr:2024-04-18T14:44:24.444+0000 7f08e6a51640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 15 (PID: 25218) UID: 0 2024-04-18T14:44:24.488 INFO:teuthology.orchestra.run.smithi096.stdout:ERROR: (22) Invalid argument 2024-04-18T14:44:24.488 INFO:teuthology.orchestra.run.smithi096.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T14:44:24.502 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.9.asok dump_historic_ops 2024-04-18T14:44:24.540 INFO:tasks.ceph.osd.6.smithi119.stderr:2024-04-18T14:44:24.542+0000 7fb7cb8bd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 24896) UID: 0 2024-04-18T14:44:24.544 INFO:tasks.rados.rados.0.smithi134.stdout:372: finishing copy_from to smithi13430248-4 2024-04-18T14:44:24.545 INFO:tasks.rados.rados.0.smithi134.stdout:update_object_version oid 4 v 80 (ObjNum 93 snap 18 seq_num 93) dirty exists 2024-04-18T14:44:24.545 INFO:tasks.rados.rados.0.smithi134.stdout:374: finishing write tid 1 to smithi13430248-32 2024-04-18T14:44:24.545 INFO:tasks.rados.rados.0.smithi134.stdout:374: finishing write tid 2 to smithi13430248-32 2024-04-18T14:44:24.545 INFO:tasks.rados.rados.0.smithi134.stdout:374: finishing write tid 3 to smithi13430248-32 2024-04-18T14:44:24.545 INFO:tasks.rados.rados.0.smithi134.stdout:374: oid 32 updating version 0 to 183 2024-04-18T14:44:24.545 INFO:tasks.rados.rados.0.smithi134.stdout:374: oid 32 updating version 183 to 184 2024-04-18T14:44:24.545 INFO:tasks.rados.rados.0.smithi134.stdout:update_object_version oid 32 v 184 (ObjNum 146 snap 33 seq_num 146) dirty exists 2024-04-18T14:44:24.545 INFO:tasks.rados.rados.0.smithi134.stdout:374: left oid 32 (ObjNum 146 snap 33 seq_num 146) 2024-04-18T14:44:24.545 INFO:tasks.rados.rados.0.smithi134.stdout:376: finishing copy_from racing read to smithi13430248-16 2024-04-18T14:44:24.545 INFO:tasks.rados.rados.0.smithi134.stdout:376: finishing copy_from to smithi13430248-16 2024-04-18T14:44:24.545 INFO:tasks.rados.rados.0.smithi134.stdout:update_object_version oid 16 v 22 (ObjNum 35 snap 0 seq_num 35) dirty exists 2024-04-18T14:44:24.545 INFO:tasks.rados.rados.0.smithi134.stdout:372: done (3 left) 2024-04-18T14:44:24.546 INFO:tasks.rados.rados.0.smithi134.stdout:373: done (2 left) 2024-04-18T14:44:24.546 INFO:tasks.rados.rados.0.smithi134.stdout:374: done (1 left) 2024-04-18T14:44:24.546 INFO:tasks.rados.rados.0.smithi134.stdout:376: done (0 left) 2024-04-18T14:44:24.546 INFO:tasks.rados.rados.0.smithi134.stdout:append oid 33 current snap is 33 2024-04-18T14:44:24.546 INFO:tasks.rados.rados.0.smithi134.stdout:377: seq_num 147 ranges {0=65536} 2024-04-18T14:44:24.546 INFO:tasks.rados.rados.0.smithi134.stdout:377: writing smithi13430248-33 from 0 to 65536 tid 1 2024-04-18T14:44:24.546 INFO:tasks.rados.rados.0.smithi134.stdout:378: copy_from oid 1 from oid 22 current snap is 33 2024-04-18T14:44:24.546 INFO:tasks.rados.rados.0.smithi134.stdout:379: delete oid 4 current snap is 33 2024-04-18T14:44:24.550 INFO:tasks.rados.rados.0.smithi134.stdout:379: done (2 left) 2024-04-18T14:44:24.550 INFO:tasks.rados.rados.0.smithi134.stdout:380: copy_from oid 11 from oid 14 current snap is 33 2024-04-18T14:44:24.550 INFO:tasks.rados.rados.0.smithi134.stdout:381: snap_create 2024-04-18T14:44:24.552 INFO:tasks.rados.rados.0.smithi134.stdout:377: finishing write tid 1 to smithi13430248-33 2024-04-18T14:44:24.554 INFO:tasks.rados.rados.0.smithi134.stdout:377: finishing write tid 2 to smithi13430248-33 2024-04-18T14:44:24.558 INFO:tasks.rados.rados.0.smithi134.stdout:378: finishing copy_from racing read to smithi13430248-1 2024-04-18T14:44:24.559 INFO:tasks.rados.rados.0.smithi134.stdout:377: finishing write tid 3 to smithi13430248-33 2024-04-18T14:44:24.559 INFO:tasks.rados.rados.0.smithi134.stdout:377: oid 33 updating version 0 to 186 2024-04-18T14:44:24.559 INFO:tasks.rados.rados.0.smithi134.stdout:377: oid 33 updating version 186 to 187 2024-04-18T14:44:24.559 INFO:tasks.rados.rados.0.smithi134.stdout:update_object_version oid 33 v 187 (ObjNum 147 snap 33 seq_num 147) dirty exists 2024-04-18T14:44:24.559 INFO:tasks.rados.rados.0.smithi134.stdout:377: left oid 33 (ObjNum 147 snap 33 seq_num 147) 2024-04-18T14:44:24.561 INFO:tasks.rados.rados.0.smithi134.stdout:378: finishing copy_from to smithi13430248-1 2024-04-18T14:44:24.561 INFO:tasks.rados.rados.0.smithi134.stdout:update_object_version oid 1 v 46 (ObjNum 21 snap 0 seq_num 21) dirty exists 2024-04-18T14:44:24.561 INFO:tasks.rados.rados.0.smithi134.stdout:380: finishing copy_from racing read to smithi13430248-11 2024-04-18T14:44:24.564 INFO:tasks.rados.rados.0.smithi134.stdout:380: finishing copy_from to smithi13430248-11 2024-04-18T14:44:24.564 INFO:tasks.rados.rados.0.smithi134.stdout:update_object_version oid 11 v 57 (ObjNum 13 snap 0 seq_num 13) dirty exists 2024-04-18T14:44:24.624 INFO:teuthology.orchestra.run.smithi096.stdout:ERROR: (22) Invalid argument 2024-04-18T14:44:24.624 INFO:teuthology.orchestra.run.smithi096.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T14:44:24.638 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.13.asok dump_ops_in_flight 2024-04-18T14:44:24.640 INFO:tasks.ceph.osd.13.smithi096.stderr:2024-04-18T14:44:24.641+0000 7f7e72fad640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 13 (PID: 24893) UID: 0 2024-04-18T14:44:24.741 INFO:tasks.ceph.osd.1.smithi096.stderr:2024-04-18T14:44:24.741+0000 7f56a7a98640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 24887) UID: 0 2024-04-18T14:44:24.758 INFO:teuthology.orchestra.run.smithi096.stdout:ERROR: (22) Invalid argument 2024-04-18T14:44:24.759 INFO:teuthology.orchestra.run.smithi096.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T14:44:24.773 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.13.asok dump_blocked_ops 2024-04-18T14:44:24.842 INFO:tasks.ceph.osd.11.smithi134.stderr:2024-04-18T14:44:24.848+0000 7f2d36f12640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 11 (PID: 25216) UID: 0 2024-04-18T14:44:24.938 INFO:teuthology.orchestra.run.smithi096.stdout:ERROR: (22) Invalid argument 2024-04-18T14:44:24.938 INFO:teuthology.orchestra.run.smithi096.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T14:44:24.943 INFO:tasks.ceph.osd.2.smithi119.stderr:2024-04-18T14:44:24.946+0000 7fcbd30c0640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 24894) UID: 0 2024-04-18T14:44:24.952 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.13.asok dump_historic_ops 2024-04-18T14:44:25.044 INFO:tasks.ceph.osd.9.smithi096.stderr:2024-04-18T14:44:25.045+0000 7fa2c1cbf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 9 (PID: 24891) UID: 0 2024-04-18T14:44:25.068 INFO:teuthology.orchestra.run.smithi096.stdout:ERROR: (22) Invalid argument 2024-04-18T14:44:25.068 INFO:teuthology.orchestra.run.smithi096.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T14:44:25.083 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-18T14:44:25.125 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-18T14:44:25.145 INFO:tasks.ceph.osd.14.smithi119.stderr:2024-04-18T14:44:25.146+0000 7f180f599640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 14 (PID: 24900) UID: 0 2024-04-18T14:44:25.214 INFO:teuthology.orchestra.run.smithi119.stdout:ERROR: (22) Invalid argument 2024-04-18T14:44:25.215 INFO:teuthology.orchestra.run.smithi119.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T14:44:25.229 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-18T14:44:25.271 INFO:tasks.ceph.osd.6.smithi119.stderr:2024-04-18T14:44:25.274+0000 7fb7cb8bd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 24896) UID: 0 2024-04-18T14:44:25.282 INFO:teuthology.orchestra.run.smithi086.stdout:osd.0: {} 2024-04-18T14:44:25.282 INFO:teuthology.orchestra.run.smithi086.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-18T14:44:25.301 INFO:teuthology.orchestra.run.smithi086.stdout:osd.1: {} 2024-04-18T14:44:25.302 INFO:teuthology.orchestra.run.smithi086.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-18T14:44:25.320 INFO:teuthology.orchestra.run.smithi086.stdout:osd.2: {} 2024-04-18T14:44:25.321 INFO:teuthology.orchestra.run.smithi086.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-18T14:44:25.342 INFO:teuthology.orchestra.run.smithi086.stdout:osd.3: {} 2024-04-18T14:44:25.342 INFO:teuthology.orchestra.run.smithi086.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-18T14:44:25.348 INFO:tasks.ceph.osd.1.smithi096.stderr:2024-04-18T14:44:25.349+0000 7f56a7a98640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 24887) UID: 0 2024-04-18T14:44:25.359 INFO:teuthology.orchestra.run.smithi086.stdout:osd.4: {} 2024-04-18T14:44:25.360 INFO:teuthology.orchestra.run.smithi086.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-18T14:44:25.380 INFO:teuthology.orchestra.run.smithi086.stdout:osd.5: {} 2024-04-18T14:44:25.381 INFO:teuthology.orchestra.run.smithi086.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-18T14:44:25.395 INFO:teuthology.orchestra.run.smithi119.stdout:{ 2024-04-18T14:44:25.395 INFO:teuthology.orchestra.run.smithi119.stdout: "ops": [], 2024-04-18T14:44:25.395 INFO:teuthology.orchestra.run.smithi119.stdout: "complaint_time": 30, 2024-04-18T14:44:25.395 INFO:teuthology.orchestra.run.smithi119.stdout: "num_blocked_ops": 0 2024-04-18T14:44:25.395 INFO:teuthology.orchestra.run.smithi119.stdout:} 2024-04-18T14:44:25.401 INFO:teuthology.orchestra.run.smithi086.stdout:osd.6: {} 2024-04-18T14:44:25.402 INFO:teuthology.orchestra.run.smithi086.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-18T14:44:25.409 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-18T14:44:25.423 INFO:teuthology.orchestra.run.smithi086.stdout:osd.7: {} 2024-04-18T14:44:25.423 INFO:teuthology.orchestra.run.smithi086.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-18T14:44:25.438 INFO:teuthology.orchestra.run.smithi086.stdout:osd.8: {} 2024-04-18T14:44:25.439 INFO:teuthology.orchestra.run.smithi086.stderr:osd.8: osd_enable_op_tracker = '' 2024-04-18T14:44:25.448 INFO:tasks.ceph.osd.7.smithi134.stderr:2024-04-18T14:44:25.452+0000 7fd7de549640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25213) UID: 0 2024-04-18T14:44:25.458 INFO:teuthology.orchestra.run.smithi086.stdout:osd.9: {} 2024-04-18T14:44:25.458 INFO:teuthology.orchestra.run.smithi086.stderr:osd.9: osd_enable_op_tracker = '' 2024-04-18T14:44:25.469 INFO:tasks.rados.rados.0.smithi134.stdout:377: done (3 left) 2024-04-18T14:44:25.470 INFO:tasks.rados.rados.0.smithi134.stdout:378: done (2 left) 2024-04-18T14:44:25.470 INFO:tasks.rados.rados.0.smithi134.stdout:380: done (1 left) 2024-04-18T14:44:25.470 INFO:tasks.rados.rados.0.smithi134.stdout:381: done (0 left) 2024-04-18T14:44:25.470 INFO:tasks.rados.rados.0.smithi134.stdout:382: setattr oid 44 current snap is 34 2024-04-18T14:44:25.476 INFO:teuthology.orchestra.run.smithi086.stdout:osd.10: {} 2024-04-18T14:44:25.476 INFO:teuthology.orchestra.run.smithi086.stderr:osd.10: osd_enable_op_tracker = '' 2024-04-18T14:44:25.478 INFO:tasks.rados.rados.0.smithi134.stdout:383: rollback oid 20 current snap is 34 2024-04-18T14:44:25.478 INFO:tasks.rados.rados.0.smithi134.stdout:rollback oid 20 to 25 2024-04-18T14:44:25.478 INFO:tasks.rados.rados.0.smithi134.stdout:384: rmattr oid 48 current snap is 34 2024-04-18T14:44:25.478 INFO:tasks.rados.rados.0.smithi134.stdout:384: done (2 left) 2024-04-18T14:44:25.478 INFO:tasks.rados.rados.0.smithi134.stdout:append oid 23 current snap is 34 2024-04-18T14:44:25.478 INFO:tasks.rados.rados.0.smithi134.stdout:385: seq_num 149 ranges {2523136=98304} 2024-04-18T14:44:25.503 INFO:teuthology.orchestra.run.smithi086.stdout:osd.11: {} 2024-04-18T14:44:25.503 INFO:teuthology.orchestra.run.smithi086.stderr:osd.11: osd_enable_op_tracker = '' 2024-04-18T14:44:25.520 INFO:teuthology.orchestra.run.smithi086.stdout:osd.12: {} 2024-04-18T14:44:25.520 INFO:teuthology.orchestra.run.smithi086.stderr:osd.12: osd_enable_op_tracker = '' 2024-04-18T14:44:25.522 INFO:tasks.rados.rados.0.smithi134.stdout:385: writing smithi13430248-23 from 2523136 to 2621440 tid 1 2024-04-18T14:44:25.522 INFO:tasks.rados.rados.0.smithi134.stdout:386: rollback oid 29 current snap is 34 2024-04-18T14:44:25.522 INFO:tasks.rados.rados.0.smithi134.stdout:rollback oid 29 to 27 2024-04-18T14:44:25.522 INFO:tasks.rados.rados.0.smithi134.stdout:383: finishing rollback tid 0 to smithi13430248-20 2024-04-18T14:44:25.522 INFO:tasks.rados.rados.0.smithi134.stdout:update_object_version oid 44 v 64 (ObjNum 130 snap 29 seq_num 130) dirty exists 2024-04-18T14:44:25.522 INFO:tasks.rados.rados.0.smithi134.stdout:383: finishing rollback tid 1 to smithi13430248-20 2024-04-18T14:44:25.522 INFO:tasks.rados.rados.0.smithi134.stdout:383: finishing rollback tid 2 to smithi13430248-20 2024-04-18T14:44:25.522 INFO:tasks.rados.rados.0.smithi134.stdout:update_object_version oid 20 v 104 (ObjNum 84 snap 15 seq_num 84) dirty exists 2024-04-18T14:44:25.522 INFO:tasks.rados.rados.0.smithi134.stdout:382: done (3 left) 2024-04-18T14:44:25.522 INFO:tasks.rados.rados.0.smithi134.stdout:383: done (2 left) 2024-04-18T14:44:25.522 INFO:tasks.rados.rados.0.smithi134.stdout:387: rollback oid 31 current snap is 34 2024-04-18T14:44:25.522 INFO:tasks.rados.rados.0.smithi134.stdout:rollback oid 31 to 33 2024-04-18T14:44:25.523 INFO:tasks.rados.rados.0.smithi134.stdout:388: copy_from oid 39 from oid 34 current snap is 34 2024-04-18T14:44:25.523 INFO:tasks.rados.rados.0.smithi134.stdout:389: snap_create 2024-04-18T14:44:25.535 INFO:tasks.rados.rados.0.smithi134.stdout:386: finishing rollback tid 0 to smithi13430248-29 2024-04-18T14:44:25.539 INFO:teuthology.orchestra.run.smithi119.stdout:{ 2024-04-18T14:44:25.539 INFO:teuthology.orchestra.run.smithi119.stdout: "size": 20, 2024-04-18T14:44:25.539 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 600, 2024-04-18T14:44:25.539 INFO:teuthology.orchestra.run.smithi119.stdout: "ops": [ 2024-04-18T14:44:25.539 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:25.539 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "MOSDECSubOpWrite(3.cs5 41/30 ECSubWrite(tid=45, reqid=osd.11.0:45, at_version=41'22, trim_to=0'0, roll_forward_to=39'20))", 2024-04-18T14:44:25.539 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-04-18T14:43:40.764595+0000", 2024-04-18T14:44:25.539 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 44.776970845000001, 2024-04-18T14:44:25.539 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.010712411999999999, 2024-04-18T14:44:25.539 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-04-18T14:44:25.539 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "reached pg", 2024-04-18T14:44:25.540 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-04-18T14:44:25.540 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:25.540 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-04-18T14:44:25.540 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:40.764595+0000", 2024-04-18T14:44:25.540 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:44:25.540 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:25.540 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:25.540 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-04-18T14:44:25.540 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:40.764595+0000", 2024-04-18T14:44:25.540 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:44:25.540 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:25.540 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:25.540 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-04-18T14:44:25.540 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:40.764594+0000", 2024-04-18T14:44:25.540 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4294967295.999999 2024-04-18T14:44:25.541 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:25.541 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:25.541 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-04-18T14:44:25.541 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:40.764660+0000", 2024-04-18T14:44:25.541 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 6.5122000000000004e-05 2024-04-18T14:44:25.541 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:25.541 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:25.541 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-04-18T14:44:25.541 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:40.764693+0000", 2024-04-18T14:44:25.541 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.3213999999999997e-05 2024-04-18T14:44:25.541 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:25.541 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:25.541 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-04-18T14:44:25.541 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:40.764715+0000", 2024-04-18T14:44:25.541 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.2580000000000001e-05 2024-04-18T14:44:25.541 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:25.542 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:25.542 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-04-18T14:44:25.542 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:40.764838+0000", 2024-04-18T14:44:25.542 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00012281299999999999 2024-04-18T14:44:25.542 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:25.542 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:25.543 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_started", 2024-04-18T14:44:25.543 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:40.764853+0000", 2024-04-18T14:44:25.543 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.5237e-05 2024-04-18T14:44:25.543 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:25.543 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:25.543 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_committed", 2024-04-18T14:44:25.543 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:40.775242+0000", 2024-04-18T14:44:25.543 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.010388807999999999 2024-04-18T14:44:25.543 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:25.543 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:25.543 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-04-18T14:44:25.543 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:40.775308+0000", 2024-04-18T14:44:25.543 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 6.5494999999999995e-05 2024-04-18T14:44:25.544 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:44:25.544 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-04-18T14:44:25.544 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:44:25.544 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:25.544 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:25.544 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "MOSDECSubOpWrite(3.cs5 41/30 ECSubWrite(tid=46, reqid=osd.11.0:46, at_version=41'24, trim_to=0'0, roll_forward_to=39'20))", 2024-04-18T14:44:25.544 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-04-18T14:43:40.765803+0000", 2024-04-18T14:44:25.544 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 44.775763095000002, 2024-04-18T14:44:25.544 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.010134018999999999, 2024-04-18T14:44:25.544 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-04-18T14:44:25.544 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "reached pg", 2024-04-18T14:44:25.544 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-04-18T14:44:25.544 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:25.544 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-04-18T14:44:25.544 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:40.765803+0000", 2024-04-18T14:44:25.544 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:44:25.545 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:25.545 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:25.545 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-04-18T14:44:25.545 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:40.765803+0000", 2024-04-18T14:44:25.545 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:44:25.545 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:25.545 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:25.545 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-04-18T14:44:25.545 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:40.765801+0000", 2024-04-18T14:44:25.545 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4294967295.9999981 2024-04-18T14:44:25.545 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:25.545 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:25.545 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-04-18T14:44:25.545 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:40.765857+0000", 2024-04-18T14:44:25.545 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 5.6385000000000003e-05 2024-04-18T14:44:25.545 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:25.546 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:25.546 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-04-18T14:44:25.546 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:40.765888+0000", 2024-04-18T14:44:25.546 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.0886999999999998e-05 2024-04-18T14:44:25.546 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:25.546 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:25.546 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-04-18T14:44:25.546 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:40.765910+0000", 2024-04-18T14:44:25.546 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.2084000000000001e-05 2024-04-18T14:44:25.546 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:25.546 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:25.546 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-04-18T14:44:25.546 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:40.767603+0000", 2024-04-18T14:44:25.546 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0016922409999999999 2024-04-18T14:44:25.546 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:25.546 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:25.547 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_started", 2024-04-18T14:44:25.547 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:40.767627+0000", 2024-04-18T14:44:25.547 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.4204000000000001e-05 2024-04-18T14:44:25.547 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:25.547 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:25.547 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_committed", 2024-04-18T14:44:25.547 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:40.775885+0000", 2024-04-18T14:44:25.547 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0082576769999999997 2024-04-18T14:44:25.547 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:25.547 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:25.547 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-04-18T14:44:25.547 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:40.775937+0000", 2024-04-18T14:44:25.547 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 5.2537999999999997e-05 2024-04-18T14:44:25.547 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:44:25.547 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-04-18T14:44:25.548 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:44:25.548 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:25.548 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:25.548 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "MOSDECSubOpWrite(3.cs5 72/30 ECSubWrite(tid=191, reqid=client.4559.0:742, at_version=72'124, trim_to=0'0, roll_forward_to=71'122))", 2024-04-18T14:44:25.548 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-04-18T14:44:11.762815+0000", 2024-04-18T14:44:25.548 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 13.778751554999999, 2024-04-18T14:44:25.548 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.016261212000000001, 2024-04-18T14:44:25.548 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-04-18T14:44:25.548 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "reached pg", 2024-04-18T14:44:25.548 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-04-18T14:44:25.548 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:25.548 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-04-18T14:44:25.548 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:11.762815+0000", 2024-04-18T14:44:25.548 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:44:25.548 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:25.548 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:25.548 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-04-18T14:44:25.549 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:11.762815+0000", 2024-04-18T14:44:25.549 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:44:25.549 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:25.549 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:25.549 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-04-18T14:44:25.549 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:11.762814+0000", 2024-04-18T14:44:25.549 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4294967295.9999995 2024-04-18T14:44:25.549 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:25.549 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:25.549 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-04-18T14:44:25.549 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:11.763613+0000", 2024-04-18T14:44:25.549 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00079931700000000002 2024-04-18T14:44:25.549 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:25.549 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:25.550 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-04-18T14:44:25.550 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:11.763662+0000", 2024-04-18T14:44:25.550 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4.9060000000000001e-05 2024-04-18T14:44:25.550 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:25.550 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:25.550 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-04-18T14:44:25.550 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:11.763694+0000", 2024-04-18T14:44:25.550 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.2209000000000003e-05 2024-04-18T14:44:25.550 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:25.550 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:25.550 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-04-18T14:44:25.550 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:11.763938+0000", 2024-04-18T14:44:25.550 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000243422 2024-04-18T14:44:25.550 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:25.550 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:25.550 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_started", 2024-04-18T14:44:25.551 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:11.763968+0000", 2024-04-18T14:44:25.551 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.0063e-05 2024-04-18T14:44:25.551 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:25.551 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:25.551 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_committed", 2024-04-18T14:44:25.551 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:11.779009+0000", 2024-04-18T14:44:25.551 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.015041381 2024-04-18T14:44:25.551 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:25.551 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:25.551 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-04-18T14:44:25.551 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:11.779076+0000", 2024-04-18T14:44:25.551 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 6.6463000000000004e-05 2024-04-18T14:44:25.551 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:44:25.551 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-04-18T14:44:25.551 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:44:25.552 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:25.552 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:25.552 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "MOSDECSubOpWrite(3.cs5 72/30 ECSubWrite(tid=192, reqid=client.4559.0:743, at_version=72'125, trim_to=0'0, roll_forward_to=71'122))", 2024-04-18T14:44:25.552 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-04-18T14:44:11.769193+0000", 2024-04-18T14:44:25.552 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 13.772373051000001, 2024-04-18T14:44:25.552 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0099247339999999993, 2024-04-18T14:44:25.552 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-04-18T14:44:25.552 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "reached pg", 2024-04-18T14:44:25.552 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-04-18T14:44:25.552 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:25.552 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-04-18T14:44:25.552 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:11.769193+0000", 2024-04-18T14:44:25.552 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:44:25.552 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:25.553 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:25.553 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-04-18T14:44:25.553 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:11.769193+0000", 2024-04-18T14:44:25.553 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:44:25.553 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:25.553 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:25.553 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-04-18T14:44:25.553 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:11.769191+0000", 2024-04-18T14:44:25.553 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4294967295.9999976 2024-04-18T14:44:25.553 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:25.553 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:25.553 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-04-18T14:44:25.553 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:11.769502+0000", 2024-04-18T14:44:25.553 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00031144199999999999 2024-04-18T14:44:25.553 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:25.554 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:25.554 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-04-18T14:44:25.554 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:11.769538+0000", 2024-04-18T14:44:25.554 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.5803000000000003e-05 2024-04-18T14:44:25.554 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:25.554 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:25.554 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-04-18T14:44:25.554 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:11.769560+0000", 2024-04-18T14:44:25.554 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.1892999999999999e-05 2024-04-18T14:44:25.554 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:25.554 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:25.554 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-04-18T14:44:25.554 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:11.770699+0000", 2024-04-18T14:44:25.554 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0011391509999999999 2024-04-18T14:44:25.554 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:25.555 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:25.555 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_started", 2024-04-18T14:44:25.555 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:11.770724+0000", 2024-04-18T14:44:25.555 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.4613e-05 2024-04-18T14:44:25.555 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:25.555 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:25.555 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_committed", 2024-04-18T14:44:25.555 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:11.779090+0000", 2024-04-18T14:44:25.555 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0083662690000000008 2024-04-18T14:44:25.555 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:25.555 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:25.555 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-04-18T14:44:25.555 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:11.779118+0000", 2024-04-18T14:44:25.555 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.7912999999999999e-05 2024-04-18T14:44:25.555 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:44:25.556 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-04-18T14:44:25.556 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:44:25.556 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:25.556 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:25.556 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "MOSDECSubOpWrite(3.cs5 72/30 ECSubWrite(tid=194, reqid=client.4559.0:745, at_version=72'127, trim_to=0'0, roll_forward_to=71'122))", 2024-04-18T14:44:25.556 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-04-18T14:44:11.772156+0000", 2024-04-18T14:44:25.556 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 13.769410583999999, 2024-04-18T14:44:25.556 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.011867262999999999, 2024-04-18T14:44:25.556 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-04-18T14:44:25.556 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "reached pg", 2024-04-18T14:44:25.556 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-04-18T14:44:25.556 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:25.556 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-04-18T14:44:25.556 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:11.772156+0000", 2024-04-18T14:44:25.556 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:44:25.556 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:25.557 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:25.557 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-04-18T14:44:25.557 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:11.772156+0000", 2024-04-18T14:44:25.557 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:44:25.557 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:25.557 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:25.557 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-04-18T14:44:25.557 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:11.772153+0000", 2024-04-18T14:44:25.557 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4294967295.9999976 2024-04-18T14:44:25.557 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:25.557 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:25.557 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-04-18T14:44:25.557 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:11.772782+0000", 2024-04-18T14:44:25.557 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00062876200000000005 2024-04-18T14:44:25.557 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:25.558 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:25.558 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-04-18T14:44:25.558 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:11.772816+0000", 2024-04-18T14:44:25.558 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.3800000000000002e-05 2024-04-18T14:44:25.558 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:25.558 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:25.558 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-04-18T14:44:25.558 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:11.772839+0000", 2024-04-18T14:44:25.558 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.3289999999999999e-05 2024-04-18T14:44:25.558 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:25.558 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:25.558 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-04-18T14:44:25.558 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:11.774492+0000", 2024-04-18T14:44:25.558 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.001652494 2024-04-18T14:44:25.558 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:25.559 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:25.559 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_started", 2024-04-18T14:44:25.559 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:11.774520+0000", 2024-04-18T14:44:25.559 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.8526000000000001e-05 2024-04-18T14:44:25.559 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:25.559 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:25.559 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_committed", 2024-04-18T14:44:25.559 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:11.783954+0000", 2024-04-18T14:44:25.559 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0094335749999999996 2024-04-18T14:44:25.559 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:25.559 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:25.559 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-04-18T14:44:25.559 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:11.784023+0000", 2024-04-18T14:44:25.559 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 6.9189000000000005e-05 2024-04-18T14:44:25.559 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:44:25.559 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-04-18T14:44:25.560 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:44:25.560 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:25.560 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:25.560 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "MOSDECSubOpWrite(3.cs5 72/30 ECSubWrite(tid=199, reqid=client.4559.0:760, at_version=72'133, trim_to=0'0, roll_forward_to=72'125))", 2024-04-18T14:44:25.560 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-04-18T14:44:11.787891+0000", 2024-04-18T14:44:25.560 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 13.753675134, 2024-04-18T14:44:25.560 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.010536894999999999, 2024-04-18T14:44:25.560 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-04-18T14:44:25.560 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "reached pg", 2024-04-18T14:44:25.560 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-04-18T14:44:25.560 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:25.560 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-04-18T14:44:25.561 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:11.787891+0000", 2024-04-18T14:44:25.561 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:44:25.561 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:25.561 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:25.561 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-04-18T14:44:25.561 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:11.787891+0000", 2024-04-18T14:44:25.561 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:44:25.561 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:25.561 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:25.561 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-04-18T14:44:25.561 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:11.787889+0000", 2024-04-18T14:44:25.561 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4294967295.9999976 2024-04-18T14:44:25.561 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:25.561 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:25.561 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-04-18T14:44:25.562 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:11.788406+0000", 2024-04-18T14:44:25.562 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00051784300000000004 2024-04-18T14:44:25.562 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:25.562 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:25.562 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-04-18T14:44:25.562 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:11.788451+0000", 2024-04-18T14:44:25.562 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4.4956999999999997e-05 2024-04-18T14:44:25.562 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:25.562 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:25.562 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-04-18T14:44:25.562 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:11.788477+0000", 2024-04-18T14:44:25.562 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.5383000000000001e-05 2024-04-18T14:44:25.562 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:25.562 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:25.562 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-04-18T14:44:25.563 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:11.788684+0000", 2024-04-18T14:44:25.563 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000207641 2024-04-18T14:44:25.563 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:25.563 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:25.563 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_started", 2024-04-18T14:44:25.563 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:11.788711+0000", 2024-04-18T14:44:25.563 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.6950000000000001e-05 2024-04-18T14:44:25.563 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:25.563 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:25.563 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_committed", 2024-04-18T14:44:25.564 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:11.798378+0000", 2024-04-18T14:44:25.564 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0096662390000000001 2024-04-18T14:44:25.564 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:25.564 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:25.564 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-04-18T14:44:25.564 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:11.798428+0000", 2024-04-18T14:44:25.564 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 5.0352000000000002e-05 2024-04-18T14:44:25.564 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:44:25.564 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-04-18T14:44:25.564 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:44:25.565 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:25.565 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:25.565 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "MOSDECSubOpWrite(3.cs5 72/30 ECSubWrite(tid=200, reqid=client.4559.0:761, at_version=72'134, trim_to=0'0, roll_forward_to=72'126))", 2024-04-18T14:44:25.565 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-04-18T14:44:11.790722+0000", 2024-04-18T14:44:25.565 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 13.750843909, 2024-04-18T14:44:25.565 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.01161918, 2024-04-18T14:44:25.565 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-04-18T14:44:25.565 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "reached pg", 2024-04-18T14:44:25.565 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-04-18T14:44:25.565 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:25.565 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-04-18T14:44:25.565 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:11.790722+0000", 2024-04-18T14:44:25.565 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:44:25.565 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:25.565 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:25.566 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-04-18T14:44:25.566 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:11.790722+0000", 2024-04-18T14:44:25.566 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:44:25.566 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:25.566 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:25.566 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-04-18T14:44:25.566 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:11.790720+0000", 2024-04-18T14:44:25.566 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4294967295.9999981 2024-04-18T14:44:25.566 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:25.566 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:25.566 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-04-18T14:44:25.566 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:11.791016+0000", 2024-04-18T14:44:25.566 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00029604799999999998 2024-04-18T14:44:25.566 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:25.566 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:25.567 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-04-18T14:44:25.567 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:11.791087+0000", 2024-04-18T14:44:25.567 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 7.1008999999999997e-05 2024-04-18T14:44:25.567 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:25.567 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:25.567 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-04-18T14:44:25.567 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:11.791117+0000", 2024-04-18T14:44:25.567 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.9485999999999999e-05 2024-04-18T14:44:25.567 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:25.567 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:25.567 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-04-18T14:44:25.567 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:11.795559+0000", 2024-04-18T14:44:25.568 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0044420500000000003 2024-04-18T14:44:25.568 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:25.568 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:25.568 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_started", 2024-04-18T14:44:25.568 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:11.795586+0000", 2024-04-18T14:44:25.568 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.6913000000000001e-05 2024-04-18T14:44:25.568 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:25.568 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:25.568 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_committed", 2024-04-18T14:44:25.568 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:11.802293+0000", 2024-04-18T14:44:25.568 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0067068190000000001 2024-04-18T14:44:25.568 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:25.568 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:25.568 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-04-18T14:44:25.569 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:11.802341+0000", 2024-04-18T14:44:25.569 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4.8897999999999998e-05 2024-04-18T14:44:25.569 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:44:25.569 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-04-18T14:44:25.569 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:44:25.569 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:25.569 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:25.569 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "MOSDECSubOpWrite(3.cs5 72/30 ECSubWrite(tid=201, reqid=client.4559.0:762, at_version=72'135, trim_to=0'0, roll_forward_to=72'126))", 2024-04-18T14:44:25.569 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-04-18T14:44:11.792333+0000", 2024-04-18T14:44:25.569 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 13.749232748000001, 2024-04-18T14:44:25.569 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.010364986, 2024-04-18T14:44:25.569 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-04-18T14:44:25.569 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "reached pg", 2024-04-18T14:44:25.569 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-04-18T14:44:25.569 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:25.569 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-04-18T14:44:25.570 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:11.792333+0000", 2024-04-18T14:44:25.570 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:44:25.570 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:25.570 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:25.570 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-04-18T14:44:25.570 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:11.792333+0000", 2024-04-18T14:44:25.570 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:44:25.570 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:25.570 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:25.570 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-04-18T14:44:25.570 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:11.792331+0000", 2024-04-18T14:44:25.570 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4294967295.9999981 2024-04-18T14:44:25.570 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:25.570 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:25.570 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-04-18T14:44:25.570 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:11.792428+0000", 2024-04-18T14:44:25.571 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 9.6309000000000002e-05 2024-04-18T14:44:25.571 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:25.571 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:25.571 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-04-18T14:44:25.571 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:11.792473+0000", 2024-04-18T14:44:25.571 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4.5729999999999998e-05 2024-04-18T14:44:25.571 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:25.571 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:25.571 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-04-18T14:44:25.571 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:11.792498+0000", 2024-04-18T14:44:25.571 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.4850000000000001e-05 2024-04-18T14:44:25.571 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:25.571 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:25.571 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-04-18T14:44:25.571 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:11.797919+0000", 2024-04-18T14:44:25.572 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0054206009999999997 2024-04-18T14:44:25.572 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:25.572 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:25.572 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_started", 2024-04-18T14:44:25.572 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:11.797943+0000", 2024-04-18T14:44:25.572 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.4394000000000001e-05 2024-04-18T14:44:25.572 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:25.572 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:25.572 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_committed", 2024-04-18T14:44:25.572 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:11.802665+0000", 2024-04-18T14:44:25.572 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0047213200000000002 2024-04-18T14:44:25.572 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:25.572 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:25.572 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-04-18T14:44:25.572 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:11.802698+0000", 2024-04-18T14:44:25.572 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.3794999999999997e-05 2024-04-18T14:44:25.573 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:44:25.573 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-04-18T14:44:25.573 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:44:25.573 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:25.573 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:25.573 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "MOSDECSubOpWrite(3.ds5 78/30 ECSubWrite(tid=54, reqid=osd.7.0:54, at_version=78'49, trim_to=0'0, roll_forward_to=77'47))", 2024-04-18T14:44:25.573 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-04-18T14:44:17.431379+0000", 2024-04-18T14:44:25.573 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 8.1101870369999993, 2024-04-18T14:44:25.573 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.011137813999999999, 2024-04-18T14:44:25.573 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-04-18T14:44:25.573 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "reached pg", 2024-04-18T14:44:25.573 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-04-18T14:44:25.573 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:25.573 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-04-18T14:44:25.573 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:17.431379+0000", 2024-04-18T14:44:25.574 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:44:25.574 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:25.574 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:25.574 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-04-18T14:44:25.574 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:17.431379+0000", 2024-04-18T14:44:25.574 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:44:25.574 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:25.574 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:25.574 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-04-18T14:44:25.574 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:17.431378+0000", 2024-04-18T14:44:25.574 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4294967295.9999995 2024-04-18T14:44:25.574 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:25.574 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:25.574 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-04-18T14:44:25.574 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:17.431437+0000", 2024-04-18T14:44:25.574 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 5.8817000000000003e-05 2024-04-18T14:44:25.575 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:25.575 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:25.575 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-04-18T14:44:25.575 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:17.431464+0000", 2024-04-18T14:44:25.575 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.6872999999999998e-05 2024-04-18T14:44:25.575 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:25.575 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:25.575 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-04-18T14:44:25.575 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:17.431487+0000", 2024-04-18T14:44:25.575 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.2753000000000001e-05 2024-04-18T14:44:25.575 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:25.575 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:25.575 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-04-18T14:44:25.575 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:17.431814+0000", 2024-04-18T14:44:25.575 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00032756799999999998 2024-04-18T14:44:25.575 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:25.576 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:25.576 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_started", 2024-04-18T14:44:25.576 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:17.431841+0000", 2024-04-18T14:44:25.576 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.6395999999999999e-05 2024-04-18T14:44:25.576 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:25.576 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:25.576 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_committed", 2024-04-18T14:44:25.576 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:17.442461+0000", 2024-04-18T14:44:25.576 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.010620095 2024-04-18T14:44:25.576 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:25.576 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:25.576 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-04-18T14:44:25.576 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:17.442517+0000", 2024-04-18T14:44:25.576 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 5.5976000000000001e-05 2024-04-18T14:44:25.576 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:44:25.576 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-04-18T14:44:25.577 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:44:25.577 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:25.577 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:25.577 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "MOSDECSubOpWrite(3.fs6 78/30 ECSubWrite(tid=212, reqid=osd.11.0:212, at_version=78'38, trim_to=0'0, roll_forward_to=68'36))", 2024-04-18T14:44:25.577 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-04-18T14:44:17.432648+0000", 2024-04-18T14:44:25.577 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 8.1089185770000007, 2024-04-18T14:44:25.577 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.015095374, 2024-04-18T14:44:25.577 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-04-18T14:44:25.577 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "reached pg", 2024-04-18T14:44:25.577 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-04-18T14:44:25.577 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:25.577 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-04-18T14:44:25.577 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:17.432648+0000", 2024-04-18T14:44:25.577 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:44:25.577 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:25.577 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:25.578 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-04-18T14:44:25.578 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:17.432648+0000", 2024-04-18T14:44:25.578 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:44:25.578 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:25.578 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:25.578 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-04-18T14:44:25.578 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:17.432647+0000", 2024-04-18T14:44:25.578 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4294967295.9999995 2024-04-18T14:44:25.578 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:25.578 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:25.578 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-04-18T14:44:25.578 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:17.432720+0000", 2024-04-18T14:44:25.578 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 7.2873000000000005e-05 2024-04-18T14:44:25.578 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:25.578 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:25.578 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-04-18T14:44:25.579 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:17.432748+0000", 2024-04-18T14:44:25.579 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.7603e-05 2024-04-18T14:44:25.579 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:25.579 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:25.579 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-04-18T14:44:25.579 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:17.432769+0000", 2024-04-18T14:44:25.579 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.1257e-05 2024-04-18T14:44:25.579 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:25.579 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:25.579 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-04-18T14:44:25.579 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:17.433122+0000", 2024-04-18T14:44:25.579 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00035333400000000002 2024-04-18T14:44:25.579 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:25.579 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:25.579 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_started", 2024-04-18T14:44:25.580 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:17.433146+0000", 2024-04-18T14:44:25.580 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.4372999999999999e-05 2024-04-18T14:44:25.580 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:25.580 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:25.580 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_committed", 2024-04-18T14:44:25.580 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:17.447680+0000", 2024-04-18T14:44:25.580 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.014533221000000001 2024-04-18T14:44:25.580 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:25.580 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:25.580 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-04-18T14:44:25.580 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:17.447743+0000", 2024-04-18T14:44:25.580 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 6.3243000000000004e-05 2024-04-18T14:44:25.580 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:44:25.580 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-04-18T14:44:25.580 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:44:25.581 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:25.581 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:25.581 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "MOSDECSubOpWrite(3.3s2 78/30 ECSubWrite(tid=282, reqid=osd.13.0:282, at_version=78'49, trim_to=0'0, roll_forward_to=69'47))", 2024-04-18T14:44:25.581 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-04-18T14:44:17.433192+0000", 2024-04-18T14:44:25.581 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 8.1083743649999995, 2024-04-18T14:44:25.581 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.016119607000000001, 2024-04-18T14:44:25.581 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-04-18T14:44:25.581 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "reached pg", 2024-04-18T14:44:25.581 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-04-18T14:44:25.581 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:25.581 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-04-18T14:44:25.581 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:17.433192+0000", 2024-04-18T14:44:25.581 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:44:25.581 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:25.581 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:25.581 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-04-18T14:44:25.582 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:17.433192+0000", 2024-04-18T14:44:25.582 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:44:25.582 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:25.582 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:25.582 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-04-18T14:44:25.582 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:17.433191+0000", 2024-04-18T14:44:25.582 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4294967295.9999995 2024-04-18T14:44:25.582 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:25.582 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:25.582 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-04-18T14:44:25.582 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:17.433246+0000", 2024-04-18T14:44:25.582 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 5.5040000000000002e-05 2024-04-18T14:44:25.582 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:25.582 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:25.583 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-04-18T14:44:25.583 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:17.433275+0000", 2024-04-18T14:44:25.583 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.9300000000000001e-05 2024-04-18T14:44:25.583 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:25.583 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:25.583 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-04-18T14:44:25.583 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:17.433299+0000", 2024-04-18T14:44:25.583 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.3159999999999998e-05 2024-04-18T14:44:25.583 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:25.583 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:25.583 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-04-18T14:44:25.583 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:17.433438+0000", 2024-04-18T14:44:25.583 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000139639 2024-04-18T14:44:25.583 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:25.583 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:25.583 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_started", 2024-04-18T14:44:25.583 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:17.433527+0000", 2024-04-18T14:44:25.584 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 8.8566000000000006e-05 2024-04-18T14:44:25.584 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:25.584 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:25.584 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_committed", 2024-04-18T14:44:25.584 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:17.449259+0000", 2024-04-18T14:44:25.584 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.015732286000000002 2024-04-18T14:44:25.584 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:25.584 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:25.584 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-04-18T14:44:25.584 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:17.449311+0000", 2024-04-18T14:44:25.584 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 5.2326e-05 2024-04-18T14:44:25.584 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:44:25.584 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-04-18T14:44:25.584 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:44:25.584 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:25.585 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:25.585 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "MOSDECSubOpWrite(3.ds5 78/30 ECSubWrite(tid=55, reqid=osd.7.0:55, at_version=78'51, trim_to=0'0, roll_forward_to=77'47))", 2024-04-18T14:44:25.585 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-04-18T14:44:17.433764+0000", 2024-04-18T14:44:25.585 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 8.1078019920000006, 2024-04-18T14:44:25.585 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.015455708, 2024-04-18T14:44:25.585 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-04-18T14:44:25.585 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "reached pg", 2024-04-18T14:44:25.585 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-04-18T14:44:25.585 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:25.585 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-04-18T14:44:25.585 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:17.433764+0000", 2024-04-18T14:44:25.585 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:44:25.585 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:25.585 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:25.585 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-04-18T14:44:25.585 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:17.433764+0000", 2024-04-18T14:44:25.586 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:44:25.586 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:25.586 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:25.586 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-04-18T14:44:25.586 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:17.433762+0000", 2024-04-18T14:44:25.586 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4294967295.9999981 2024-04-18T14:44:25.586 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:25.586 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:25.586 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-04-18T14:44:25.586 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:17.433815+0000", 2024-04-18T14:44:25.586 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 5.2250000000000003e-05 2024-04-18T14:44:25.586 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:25.586 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:25.586 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-04-18T14:44:25.586 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:17.433845+0000", 2024-04-18T14:44:25.586 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.0658999999999999e-05 2024-04-18T14:44:25.587 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:25.587 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:25.587 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-04-18T14:44:25.587 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:17.433867+0000", 2024-04-18T14:44:25.587 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.1647000000000001e-05 2024-04-18T14:44:25.587 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:25.587 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:25.587 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-04-18T14:44:25.587 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:17.435260+0000", 2024-04-18T14:44:25.587 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0013929019999999999 2024-04-18T14:44:25.587 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:25.587 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:25.587 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_started", 2024-04-18T14:44:25.587 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:17.435283+0000", 2024-04-18T14:44:25.587 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.2759999999999999e-05 2024-04-18T14:44:25.587 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:25.588 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:25.588 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_committed", 2024-04-18T14:44:25.588 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:17.449149+0000", 2024-04-18T14:44:25.588 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.013866208 2024-04-18T14:44:25.588 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:25.588 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:25.588 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-04-18T14:44:25.588 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:17.449220+0000", 2024-04-18T14:44:25.588 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 7.1038999999999995e-05 2024-04-18T14:44:25.588 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:44:25.588 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-04-18T14:44:25.588 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:44:25.588 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:25.588 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:25.588 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "MOSDECSubOpWrite(3.cs5 78/30 ECSubWrite(tid=213, reqid=osd.11.0:213, at_version=78'137, trim_to=0'0, roll_forward_to=72'135))", 2024-04-18T14:44:25.588 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-04-18T14:44:17.437110+0000", 2024-04-18T14:44:25.589 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 8.1044564880000003, 2024-04-18T14:44:25.589 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.012384162000000001, 2024-04-18T14:44:25.589 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-04-18T14:44:25.589 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "reached pg", 2024-04-18T14:44:25.589 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-04-18T14:44:25.589 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:25.589 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-04-18T14:44:25.589 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:17.437110+0000", 2024-04-18T14:44:25.589 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:44:25.589 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:25.589 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:25.589 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-04-18T14:44:25.589 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:17.437110+0000", 2024-04-18T14:44:25.589 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:44:25.589 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:25.589 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:25.590 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-04-18T14:44:25.590 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:17.437108+0000", 2024-04-18T14:44:25.590 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4294967295.9999981 2024-04-18T14:44:25.590 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:25.590 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:25.590 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-04-18T14:44:25.590 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:17.437165+0000", 2024-04-18T14:44:25.590 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 5.6901999999999998e-05 2024-04-18T14:44:25.590 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:25.590 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:25.590 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-04-18T14:44:25.590 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:17.437201+0000", 2024-04-18T14:44:25.590 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.6470000000000001e-05 2024-04-18T14:44:25.590 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:25.590 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:25.590 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-04-18T14:44:25.591 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:17.437227+0000", 2024-04-18T14:44:25.591 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.5397000000000001e-05 2024-04-18T14:44:25.591 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:25.591 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:25.591 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-04-18T14:44:25.591 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:17.437493+0000", 2024-04-18T14:44:25.591 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00026662799999999998 2024-04-18T14:44:25.591 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:25.591 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:25.591 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_started", 2024-04-18T14:44:25.591 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:17.437518+0000", 2024-04-18T14:44:25.591 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.4833000000000001e-05 2024-04-18T14:44:25.591 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:25.591 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:25.592 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_committed", 2024-04-18T14:44:25.592 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:17.449397+0000", 2024-04-18T14:44:25.592 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.011878882 2024-04-18T14:44:25.592 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:25.592 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:25.592 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-04-18T14:44:25.592 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:17.449494+0000", 2024-04-18T14:44:25.592 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 9.6753e-05 2024-04-18T14:44:25.592 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:44:25.592 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-04-18T14:44:25.592 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:44:25.592 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:25.592 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:25.592 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "MOSDECSubOpWrite(3.3s2 78/30 ECSubWrite(tid=284, reqid=osd.13.0:284, at_version=78'51, trim_to=0'0, roll_forward_to=69'47))", 2024-04-18T14:44:25.592 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-04-18T14:44:17.439146+0000", 2024-04-18T14:44:25.592 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 8.1024196570000004, 2024-04-18T14:44:25.593 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.015057528000000001, 2024-04-18T14:44:25.593 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-04-18T14:44:25.593 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "reached pg", 2024-04-18T14:44:25.593 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-04-18T14:44:25.593 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:25.593 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-04-18T14:44:25.593 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:17.439146+0000", 2024-04-18T14:44:25.593 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:44:25.593 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:25.593 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:25.593 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-04-18T14:44:25.593 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:17.439146+0000", 2024-04-18T14:44:25.593 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:44:25.593 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:25.594 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:25.594 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-04-18T14:44:25.594 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:17.439145+0000", 2024-04-18T14:44:25.594 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4294967295.9999981 2024-04-18T14:44:25.594 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:25.594 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:25.594 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-04-18T14:44:25.594 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:17.439198+0000", 2024-04-18T14:44:25.594 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 5.3229999999999997e-05 2024-04-18T14:44:25.594 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:25.594 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:25.594 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-04-18T14:44:25.594 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:17.439256+0000", 2024-04-18T14:44:25.594 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 5.8165999999999998e-05 2024-04-18T14:44:25.594 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:25.595 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:25.595 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-04-18T14:44:25.595 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:17.439278+0000", 2024-04-18T14:44:25.595 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.2079999999999999e-05 2024-04-18T14:44:25.595 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:25.595 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:25.595 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-04-18T14:44:25.595 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:17.444175+0000", 2024-04-18T14:44:25.595 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0048972119999999997 2024-04-18T14:44:25.595 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:25.595 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:25.595 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_started", 2024-04-18T14:44:25.595 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:17.444188+0000", 2024-04-18T14:44:25.595 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.3193000000000001e-05 2024-04-18T14:44:25.595 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:25.595 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:25.596 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_committed", 2024-04-18T14:44:25.596 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:17.454145+0000", 2024-04-18T14:44:25.596 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0099565839999999992 2024-04-18T14:44:25.596 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:25.596 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:25.596 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-04-18T14:44:25.596 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:17.454204+0000", 2024-04-18T14:44:25.596 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 5.8983000000000001e-05 2024-04-18T14:44:25.596 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:44:25.596 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-04-18T14:44:25.596 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:44:25.596 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:25.596 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:25.596 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "MOSDECSubOpWrite(3.cs5 78/30 ECSubWrite(tid=214, reqid=osd.11.0:214, at_version=78'139, trim_to=0'0, roll_forward_to=72'135))", 2024-04-18T14:44:25.596 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-04-18T14:44:17.440994+0000", 2024-04-18T14:44:25.596 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 8.1005718079999998, 2024-04-18T14:44:25.597 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.013372098000000001, 2024-04-18T14:44:25.597 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-04-18T14:44:25.597 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "reached pg", 2024-04-18T14:44:25.597 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-04-18T14:44:25.597 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:25.597 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-04-18T14:44:25.597 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:17.440994+0000", 2024-04-18T14:44:25.597 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:44:25.597 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:25.597 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:25.597 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-04-18T14:44:25.597 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:17.440994+0000", 2024-04-18T14:44:25.597 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:44:25.597 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:25.597 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:25.597 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-04-18T14:44:25.597 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:17.440992+0000", 2024-04-18T14:44:25.598 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4294967295.9999981 2024-04-18T14:44:25.598 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:25.598 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:25.598 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-04-18T14:44:25.598 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:17.441047+0000", 2024-04-18T14:44:25.598 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 5.4339000000000003e-05 2024-04-18T14:44:25.598 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:25.598 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:25.598 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-04-18T14:44:25.598 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:17.441083+0000", 2024-04-18T14:44:25.598 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.6276999999999998e-05 2024-04-18T14:44:25.598 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:25.598 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:25.599 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-04-18T14:44:25.599 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:17.441110+0000", 2024-04-18T14:44:25.599 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.667e-05 2024-04-18T14:44:25.599 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:25.599 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:25.599 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-04-18T14:44:25.599 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:17.443171+0000", 2024-04-18T14:44:25.599 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0020610839999999999 2024-04-18T14:44:25.599 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:25.599 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:25.599 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_started", 2024-04-18T14:44:25.599 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:17.443194+0000", 2024-04-18T14:44:25.600 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.3295999999999999e-05 2024-04-18T14:44:25.600 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:25.600 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:25.600 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_committed", 2024-04-18T14:44:25.600 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:17.454310+0000", 2024-04-18T14:44:25.600 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.011116035 2024-04-18T14:44:25.600 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:25.600 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:25.600 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-04-18T14:44:25.600 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:17.454366+0000", 2024-04-18T14:44:25.600 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 5.6242999999999997e-05 2024-04-18T14:44:25.600 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:44:25.600 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-04-18T14:44:25.600 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:44:25.600 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:25.601 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:25.601 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "MOSDECSubOpWrite(3.7s4 78/30 ECSubWrite(tid=277, reqid=osd.14.0:277, at_version=78'101, trim_to=0'0, roll_forward_to=76'99))", 2024-04-18T14:44:25.601 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-04-18T14:44:17.442246+0000", 2024-04-18T14:44:25.601 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 8.0993202800000006, 2024-04-18T14:44:25.601 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.011859102, 2024-04-18T14:44:25.601 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-04-18T14:44:25.601 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "reached pg", 2024-04-18T14:44:25.601 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-04-18T14:44:25.601 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:25.601 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-04-18T14:44:25.601 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:17.442246+0000", 2024-04-18T14:44:25.601 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:44:25.601 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:25.601 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:25.601 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-04-18T14:44:25.601 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:17.442246+0000", 2024-04-18T14:44:25.602 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:44:25.602 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:25.602 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:25.602 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-04-18T14:44:25.602 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:17.442245+0000", 2024-04-18T14:44:25.602 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4294967295.999999 2024-04-18T14:44:25.602 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:25.602 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:25.602 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-04-18T14:44:25.602 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:17.442304+0000", 2024-04-18T14:44:25.602 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 5.8523000000000002e-05 2024-04-18T14:44:25.602 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:25.602 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:25.602 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-04-18T14:44:25.602 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:17.442333+0000", 2024-04-18T14:44:25.603 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.9672999999999999e-05 2024-04-18T14:44:25.603 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:25.603 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:25.603 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-04-18T14:44:25.603 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:17.442355+0000", 2024-04-18T14:44:25.603 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.1330000000000001e-05 2024-04-18T14:44:25.603 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:25.603 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:25.603 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-04-18T14:44:25.603 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:17.442504+0000", 2024-04-18T14:44:25.603 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000149352 2024-04-18T14:44:25.603 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:25.603 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:25.603 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_started", 2024-04-18T14:44:25.603 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:17.442536+0000", 2024-04-18T14:44:25.604 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.1925999999999999e-05 2024-04-18T14:44:25.604 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:25.604 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:25.604 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_committed", 2024-04-18T14:44:25.604 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:17.454044+0000", 2024-04-18T14:44:25.604 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.011507842000000001 2024-04-18T14:44:25.604 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:25.604 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:25.604 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-04-18T14:44:25.604 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:17.454105+0000", 2024-04-18T14:44:25.604 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 6.1229999999999995e-05 2024-04-18T14:44:25.604 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:44:25.604 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-04-18T14:44:25.604 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:44:25.604 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:25.605 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:25.605 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "MOSDECSubOpWrite(3.7s4 78/30 ECSubWrite(tid=278, reqid=osd.14.0:278, at_version=78'103, trim_to=0'0, roll_forward_to=76'99))", 2024-04-18T14:44:25.605 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-04-18T14:44:17.442395+0000", 2024-04-18T14:44:25.605 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 8.0991712719999995, 2024-04-18T14:44:25.605 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.013060497000000001, 2024-04-18T14:44:25.605 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-04-18T14:44:25.605 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "reached pg", 2024-04-18T14:44:25.605 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-04-18T14:44:25.605 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:25.605 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-04-18T14:44:25.605 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:17.442395+0000", 2024-04-18T14:44:25.605 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:44:25.605 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:25.605 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:25.605 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-04-18T14:44:25.606 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:17.442395+0000", 2024-04-18T14:44:25.606 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:44:25.606 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:25.606 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:25.606 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-04-18T14:44:25.606 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:17.442394+0000", 2024-04-18T14:44:25.606 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4294967295.999999 2024-04-18T14:44:25.606 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:25.606 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:25.606 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-04-18T14:44:25.606 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:17.442444+0000", 2024-04-18T14:44:25.606 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 5.0025999999999998e-05 2024-04-18T14:44:25.606 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:25.606 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:25.606 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-04-18T14:44:25.607 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:17.442465+0000", 2024-04-18T14:44:25.607 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.1420000000000002e-05 2024-04-18T14:44:25.607 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:25.607 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:25.607 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-04-18T14:44:25.607 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:17.442482+0000", 2024-04-18T14:44:25.607 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.6759999999999999e-05 2024-04-18T14:44:25.607 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:25.607 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:25.607 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-04-18T14:44:25.607 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:17.447822+0000", 2024-04-18T14:44:25.607 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0053395919999999998 2024-04-18T14:44:25.607 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:25.607 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:25.607 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_started", 2024-04-18T14:44:25.607 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:17.447846+0000", 2024-04-18T14:44:25.608 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.3904e-05 2024-04-18T14:44:25.608 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:25.608 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:25.608 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_committed", 2024-04-18T14:44:25.608 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:17.455388+0000", 2024-04-18T14:44:25.608 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0075427180000000003 2024-04-18T14:44:25.608 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:25.608 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:25.608 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-04-18T14:44:25.608 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:17.455455+0000", 2024-04-18T14:44:25.608 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 6.6989999999999994e-05 2024-04-18T14:44:25.608 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:44:25.608 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-04-18T14:44:25.608 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:44:25.608 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:25.609 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:25.609 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "MOSDECSubOpWrite(3.7s4 82/30 ECSubWrite(tid=320, reqid=osd.14.0:320, at_version=82'123, trim_to=0'0, roll_forward_to=80'119))", 2024-04-18T14:44:25.609 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-04-18T14:44:21.473579+0000", 2024-04-18T14:44:25.609 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 4.0679873899999999, 2024-04-18T14:44:25.609 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0096503219999999994, 2024-04-18T14:44:25.609 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-04-18T14:44:25.609 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "reached pg", 2024-04-18T14:44:25.609 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-04-18T14:44:25.609 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:25.609 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-04-18T14:44:25.609 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:21.473579+0000", 2024-04-18T14:44:25.609 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:44:25.609 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:25.609 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:25.609 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-04-18T14:44:25.609 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:21.473579+0000", 2024-04-18T14:44:25.610 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:44:25.610 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:25.610 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:25.610 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-04-18T14:44:25.610 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:21.473577+0000", 2024-04-18T14:44:25.610 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4294967295.9999981 2024-04-18T14:44:25.610 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:25.610 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:25.610 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-04-18T14:44:25.610 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:21.473631+0000", 2024-04-18T14:44:25.610 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 5.3601999999999999e-05 2024-04-18T14:44:25.610 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:25.610 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:25.610 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-04-18T14:44:25.610 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:21.473664+0000", 2024-04-18T14:44:25.611 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.3274e-05 2024-04-18T14:44:25.611 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:25.611 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:25.611 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-04-18T14:44:25.611 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:21.473685+0000", 2024-04-18T14:44:25.611 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.1386000000000002e-05 2024-04-18T14:44:25.611 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:25.611 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:25.611 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-04-18T14:44:25.611 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:21.473871+0000", 2024-04-18T14:44:25.611 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00018613200000000001 2024-04-18T14:44:25.611 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:25.611 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:25.611 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_started", 2024-04-18T14:44:25.611 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:21.473898+0000", 2024-04-18T14:44:25.611 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.7013e-05 2024-04-18T14:44:25.611 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:25.611 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:25.612 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_committed", 2024-04-18T14:44:25.612 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:21.483199+0000", 2024-04-18T14:44:25.612 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0093007820000000005 2024-04-18T14:44:25.612 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:25.612 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:25.612 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-04-18T14:44:25.612 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:21.483229+0000", 2024-04-18T14:44:25.612 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.9955999999999999e-05 2024-04-18T14:44:25.612 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:44:25.612 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-04-18T14:44:25.612 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:44:25.612 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:25.612 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:25.612 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "MOSDECSubOpWrite(3.3s2 82/30 ECSubWrite(tid=298, reqid=osd.13.0:298, at_version=82'59, trim_to=0'0, roll_forward_to=80'57))", 2024-04-18T14:44:25.612 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-04-18T14:44:21.474373+0000", 2024-04-18T14:44:25.613 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 4.0671932599999998, 2024-04-18T14:44:25.613 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.010541801999999999, 2024-04-18T14:44:25.613 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-04-18T14:44:25.613 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "reached pg", 2024-04-18T14:44:25.613 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-04-18T14:44:25.613 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:25.613 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-04-18T14:44:25.613 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:21.474373+0000", 2024-04-18T14:44:25.613 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:44:25.613 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:25.613 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:25.613 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-04-18T14:44:25.613 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:21.474373+0000", 2024-04-18T14:44:25.613 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:44:25.613 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:25.613 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:25.614 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-04-18T14:44:25.614 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:21.474371+0000", 2024-04-18T14:44:25.614 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4294967295.9999981 2024-04-18T14:44:25.614 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:25.614 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:25.614 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-04-18T14:44:25.614 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:21.474426+0000", 2024-04-18T14:44:25.614 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 5.4633999999999999e-05 2024-04-18T14:44:25.614 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:25.614 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:25.614 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-04-18T14:44:25.614 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:21.474458+0000", 2024-04-18T14:44:25.614 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.1912999999999998e-05 2024-04-18T14:44:25.614 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:25.614 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:25.615 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-04-18T14:44:25.615 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:21.474479+0000", 2024-04-18T14:44:25.615 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.0856000000000002e-05 2024-04-18T14:44:25.615 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:25.615 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:25.615 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-04-18T14:44:25.615 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:21.474828+0000", 2024-04-18T14:44:25.615 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00034933400000000003 2024-04-18T14:44:25.615 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:25.615 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:25.615 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_started", 2024-04-18T14:44:25.615 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:21.474856+0000", 2024-04-18T14:44:25.615 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.7783000000000001e-05 2024-04-18T14:44:25.615 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:25.615 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:25.615 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_committed", 2024-04-18T14:44:25.616 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:21.484847+0000", 2024-04-18T14:44:25.616 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0099917840000000001 2024-04-18T14:44:25.616 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:25.616 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:25.616 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-04-18T14:44:25.616 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:21.484915+0000", 2024-04-18T14:44:25.616 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 6.7214999999999999e-05 2024-04-18T14:44:25.616 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:44:25.616 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-04-18T14:44:25.616 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:44:25.616 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:25.616 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:25.616 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "MOSDECSubOpWrite(3.7s4 82/30 ECSubWrite(tid=322, reqid=osd.14.0:322, at_version=82'125, trim_to=0'0, roll_forward_to=80'119))", 2024-04-18T14:44:25.616 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-04-18T14:44:21.475379+0000", 2024-04-18T14:44:25.616 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 4.0661870640000002, 2024-04-18T14:44:25.617 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.009771198, 2024-04-18T14:44:25.617 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-04-18T14:44:25.617 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "reached pg", 2024-04-18T14:44:25.617 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-04-18T14:44:25.617 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:25.617 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-04-18T14:44:25.617 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:21.475379+0000", 2024-04-18T14:44:25.617 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:44:25.617 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:25.617 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:25.617 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-04-18T14:44:25.617 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:21.475379+0000", 2024-04-18T14:44:25.617 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:44:25.617 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:25.617 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:25.618 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-04-18T14:44:25.618 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:21.475377+0000", 2024-04-18T14:44:25.618 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4294967295.9999981 2024-04-18T14:44:25.618 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:25.618 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:25.618 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-04-18T14:44:25.618 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:21.475429+0000", 2024-04-18T14:44:25.618 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 5.1940000000000001e-05 2024-04-18T14:44:25.618 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:25.618 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:25.618 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-04-18T14:44:25.618 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:21.475483+0000", 2024-04-18T14:44:25.618 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 5.3906000000000002e-05 2024-04-18T14:44:25.618 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:25.618 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:25.619 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-04-18T14:44:25.619 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:21.475508+0000", 2024-04-18T14:44:25.619 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.457e-05 2024-04-18T14:44:25.619 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:25.619 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:25.619 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-04-18T14:44:25.619 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:21.479350+0000", 2024-04-18T14:44:25.619 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.003841957 2024-04-18T14:44:25.619 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:25.619 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:25.619 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_started", 2024-04-18T14:44:25.619 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:21.479377+0000", 2024-04-18T14:44:25.619 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.7100000000000001e-05 2024-04-18T14:44:25.619 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:25.619 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:25.620 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_committed", 2024-04-18T14:44:25.620 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:21.485112+0000", 2024-04-18T14:44:25.620 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0057355430000000001 2024-04-18T14:44:25.620 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:25.620 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:25.620 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-04-18T14:44:25.620 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:21.485150+0000", 2024-04-18T14:44:25.620 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.8078999999999999e-05 2024-04-18T14:44:25.620 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:44:25.620 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-04-18T14:44:25.620 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:44:25.620 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:44:25.620 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-04-18T14:44:25.620 INFO:teuthology.orchestra.run.smithi119.stdout:} 2024-04-18T14:44:25.620 INFO:tasks.rados.rados.0.smithi134.stdout:385: finishing write tid 1 to smithi13430248-23 2024-04-18T14:44:25.621 INFO:tasks.rados.rados.0.smithi134.stdout:386: finishing rollback tid 1 to smithi13430248-29 2024-04-18T14:44:25.621 INFO:tasks.rados.rados.0.smithi134.stdout:386: finishing rollback tid 2 to smithi13430248-29 2024-04-18T14:44:25.621 INFO:tasks.rados.rados.0.smithi134.stdout:update_object_version oid 29 v 94 (ObjNum 28 snap 0 seq_num 28) dirty exists 2024-04-18T14:44:25.622 INFO:teuthology.orchestra.run.smithi086.stdout:osd.13: {} 2024-04-18T14:44:25.622 INFO:teuthology.orchestra.run.smithi086.stderr:osd.13: osd_enable_op_tracker = '' 2024-04-18T14:44:25.623 INFO:teuthology.orchestra.run.smithi086.stdout:osd.14: {} 2024-04-18T14:44:25.624 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-04-18T14:44:25.624 INFO:teuthology.orchestra.run.smithi086.stderr:osd.14: osd_enable_op_tracker = '' 2024-04-18T14:44:25.625 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-18T14:44:25.565+0000 7fcd1ad9d640 0 -- 172.21.15.86:0/1861086322 >> [v2:172.21.15.134:6808/25223,v1:172.21.15.134:6812/25223] conn(0x7fcd1c2214a0 msgr2=0x7fcd1c223890 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-04-18T14:44:25.625 INFO:tasks.rados.rados.0.smithi134.stdout:387: finishing rollback tid 0 to smithi13430248-31 2024-04-18T14:44:25.625 INFO:tasks.rados.rados.0.smithi134.stdout:385: finishing write tid 2 to smithi13430248-23 2024-04-18T14:44:25.625 INFO:tasks.rados.rados.0.smithi134.stdout:387: finishing rollback tid 1 to smithi13430248-31 2024-04-18T14:44:25.625 INFO:tasks.rados.rados.0.smithi134.stdout:387: finishing rollback tid 2 to smithi13430248-31 2024-04-18T14:44:25.625 INFO:tasks.rados.rados.0.smithi134.stdout:update_object_version oid 31 v 31 (ObjNum 116 snap 24 seq_num 116) dirty exists 2024-04-18T14:44:25.625 INFO:tasks.rados.rados.0.smithi134.stdout:385: finishing write tid 3 to smithi13430248-23 2024-04-18T14:44:25.625 INFO:tasks.rados.rados.0.smithi134.stdout:385: oid 23 updating version 0 to 195 2024-04-18T14:44:25.625 INFO:tasks.rados.rados.0.smithi134.stdout:385: oid 23 version 195 is already newer than 194 2024-04-18T14:44:25.625 INFO:tasks.rados.rados.0.smithi134.stdout:update_object_version oid 23 v 195 (ObjNum 149 snap 34 seq_num 149) dirty exists 2024-04-18T14:44:25.625 INFO:tasks.rados.rados.0.smithi134.stdout:385: left oid 23 (ObjNum 149 snap 34 seq_num 149) 2024-04-18T14:44:25.626 INFO:tasks.rados.rados.0.smithi134.stdout:388: finishing copy_from racing read to smithi13430248-39 2024-04-18T14:44:25.626 INFO:tasks.rados.rados.0.smithi134.stdout:388: finishing copy_from to smithi13430248-39 2024-04-18T14:44:25.626 INFO:tasks.rados.rados.0.smithi134.stdout:update_object_version oid 39 v 54 (ObjNum 131 snap 30 seq_num 131) dirty exists 2024-04-18T14:44:25.626 INFO:teuthology.orchestra.run.smithi086.stdout:osd.15: {} 2024-04-18T14:44:25.626 INFO:tasks.ceph.osd.3.smithi134.stderr:2024-04-18T14:44:25.628+0000 7fe7a4443640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25211) UID: 0 2024-04-18T14:44:25.627 INFO:teuthology.orchestra.run.smithi086.stderr:osd.15: osd_enable_op_tracker = '' 2024-04-18T14:44:25.723 INFO:tasks.ceph.osd.3.smithi134.stderr:2024-04-18T14:44:25.728+0000 7fe7a4443640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25211) UID: 0 2024-04-18T14:44:25.751 INFO:teuthology.orchestra.run.smithi119.stdout:{ 2024-04-18T14:44:25.752 INFO:teuthology.orchestra.run.smithi119.stdout: "ops": [], 2024-04-18T14:44:25.752 INFO:teuthology.orchestra.run.smithi119.stdout: "num_ops": 0 2024-04-18T14:44:25.752 INFO:teuthology.orchestra.run.smithi119.stdout:} 2024-04-18T14:44:25.766 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-04-18T14:44:25.824 INFO:tasks.ceph.osd.14.smithi119.stderr:2024-04-18T14:44:25.826+0000 7f180f599640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 14 (PID: 24900) UID: 0 2024-04-18T14:44:25.886 INFO:teuthology.orchestra.run.smithi119.stdout:{ 2024-04-18T14:44:25.886 INFO:teuthology.orchestra.run.smithi119.stdout: "ops": [], 2024-04-18T14:44:25.886 INFO:teuthology.orchestra.run.smithi119.stdout: "complaint_time": 30, 2024-04-18T14:44:25.886 INFO:teuthology.orchestra.run.smithi119.stdout: "num_blocked_ops": 0 2024-04-18T14:44:25.886 INFO:teuthology.orchestra.run.smithi119.stdout:} 2024-04-18T14:44:25.900 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-04-18T14:44:25.925 INFO:tasks.ceph.osd.9.smithi096.stderr:2024-04-18T14:44:25.925+0000 7fa2c1cbf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 9 (PID: 24891) UID: 0 2024-04-18T14:44:26.026 INFO:tasks.ceph.osd.1.smithi096.stderr:2024-04-18T14:44:26.025+0000 7f56a7a98640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 24887) UID: 0 2024-04-18T14:44:26.068 INFO:teuthology.orchestra.run.smithi119.stdout:{ 2024-04-18T14:44:26.068 INFO:teuthology.orchestra.run.smithi119.stdout: "size": 20, 2024-04-18T14:44:26.068 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 600, 2024-04-18T14:44:26.068 INFO:teuthology.orchestra.run.smithi119.stdout: "ops": [ 2024-04-18T14:44:26.068 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:26.068 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(client.4559.0:189 3.1s0 3:8de3c091:::smithi13430248-9:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e37)", 2024-04-18T14:44:26.068 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-04-18T14:43:36.761939+0000", 2024-04-18T14:44:26.069 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 49.308711934000002, 2024-04-18T14:44:26.069 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.018164527, 2024-04-18T14:44:26.069 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-04-18T14:44:26.069 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "started", 2024-04-18T14:44:26.069 INFO:teuthology.orchestra.run.smithi119.stdout: "client_info": { 2024-04-18T14:44:26.069 INFO:teuthology.orchestra.run.smithi119.stdout: "client": "client.4559", 2024-04-18T14:44:26.069 INFO:teuthology.orchestra.run.smithi119.stdout: "client_addr": "172.21.15.134:0/3113589487", 2024-04-18T14:44:26.069 INFO:teuthology.orchestra.run.smithi119.stdout: "tid": 189 2024-04-18T14:44:26.069 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:26.069 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-04-18T14:44:26.069 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:26.069 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-04-18T14:44:26.069 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:36.761939+0000", 2024-04-18T14:44:26.069 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:44:26.069 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:26.070 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:26.070 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-04-18T14:44:26.070 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:36.761939+0000", 2024-04-18T14:44:26.070 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:44:26.070 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:26.070 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:26.070 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-04-18T14:44:26.070 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:36.761938+0000", 2024-04-18T14:44:26.070 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4294967295.9999986 2024-04-18T14:44:26.070 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:26.070 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:26.070 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-04-18T14:44:26.070 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:36.761947+0000", 2024-04-18T14:44:26.070 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 9.2399999999999996e-06 2024-04-18T14:44:26.070 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:26.071 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:26.071 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-04-18T14:44:26.071 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:36.761967+0000", 2024-04-18T14:44:26.071 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.9956999999999999e-05 2024-04-18T14:44:26.071 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:26.071 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:26.071 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-04-18T14:44:26.071 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:36.761988+0000", 2024-04-18T14:44:26.071 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.1115e-05 2024-04-18T14:44:26.071 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:26.071 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:26.071 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-04-18T14:44:26.071 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:36.767166+0000", 2024-04-18T14:44:26.071 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0051778420000000002 2024-04-18T14:44:26.072 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:26.072 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:26.072 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for rw locks", 2024-04-18T14:44:26.072 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:36.767335+0000", 2024-04-18T14:44:26.072 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00016923099999999999 2024-04-18T14:44:26.072 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:26.072 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:26.072 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-04-18T14:44:26.072 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:36.775552+0000", 2024-04-18T14:44:26.072 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0082173460000000004 2024-04-18T14:44:26.072 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:26.072 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:26.072 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-04-18T14:44:26.072 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:36.775682+0000", 2024-04-18T14:44:26.072 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000129803 2024-04-18T14:44:26.073 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:26.073 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:26.073 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-04-18T14:44:26.073 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:36.780104+0000", 2024-04-18T14:44:26.073 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0044214129999999999 2024-04-18T14:44:26.073 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:44:26.073 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-04-18T14:44:26.073 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:44:26.073 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:26.073 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:26.073 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(client.4559.0:373 3.1s0 3:8de3c091:::smithi13430248-9:head [read 0~1409024,checksum] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-04-18T14:44:26.073 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-04-18T14:43:50.376336+0000", 2024-04-18T14:44:26.073 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 35.694315263999997, 2024-04-18T14:44:26.073 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.017062416, 2024-04-18T14:44:26.073 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-04-18T14:44:26.074 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "started", 2024-04-18T14:44:26.074 INFO:teuthology.orchestra.run.smithi119.stdout: "client_info": { 2024-04-18T14:44:26.074 INFO:teuthology.orchestra.run.smithi119.stdout: "client": "client.4559", 2024-04-18T14:44:26.074 INFO:teuthology.orchestra.run.smithi119.stdout: "client_addr": "172.21.15.134:0/3113589487", 2024-04-18T14:44:26.074 INFO:teuthology.orchestra.run.smithi119.stdout: "tid": 373 2024-04-18T14:44:26.074 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:26.074 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-04-18T14:44:26.074 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:26.074 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-04-18T14:44:26.074 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:50.376336+0000", 2024-04-18T14:44:26.074 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:44:26.074 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:26.074 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:26.074 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-04-18T14:44:26.075 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:50.376336+0000", 2024-04-18T14:44:26.075 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:44:26.075 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:26.075 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:26.075 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-04-18T14:44:26.075 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:50.376334+0000", 2024-04-18T14:44:26.075 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4294967295.9999986 2024-04-18T14:44:26.075 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:26.075 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:26.075 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-04-18T14:44:26.075 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:50.376344+0000", 2024-04-18T14:44:26.075 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 9.9939999999999995e-06 2024-04-18T14:44:26.075 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:26.075 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:26.075 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-04-18T14:44:26.075 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:50.376363+0000", 2024-04-18T14:44:26.076 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.9063e-05 2024-04-18T14:44:26.076 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:26.076 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:26.076 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-04-18T14:44:26.076 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:50.376379+0000", 2024-04-18T14:44:26.076 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.5153999999999999e-05 2024-04-18T14:44:26.076 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:26.076 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:26.076 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-04-18T14:44:26.076 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:50.376635+0000", 2024-04-18T14:44:26.076 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00025632600000000003 2024-04-18T14:44:26.076 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:26.076 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:26.076 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting_for_map not empty", 2024-04-18T14:44:26.076 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:50.376657+0000", 2024-04-18T14:44:26.076 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.1693999999999999e-05 2024-04-18T14:44:26.077 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:26.077 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:26.077 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-04-18T14:44:26.077 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:50.383261+0000", 2024-04-18T14:44:26.077 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0066047579999999996 2024-04-18T14:44:26.077 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:26.077 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:26.077 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-04-18T14:44:26.077 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:50.383496+0000", 2024-04-18T14:44:26.077 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00023489299999999999 2024-04-18T14:44:26.077 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:26.077 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:26.077 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-04-18T14:44:26.077 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:50.393398+0000", 2024-04-18T14:44:26.077 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0099019269999999996 2024-04-18T14:44:26.078 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:44:26.078 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-04-18T14:44:26.078 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:44:26.078 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:26.078 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:26.078 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(client.4559.0:374 3.1s0 3:8de3c091:::smithi13430248-9:head [read 0~1409024,checksum] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-04-18T14:44:26.078 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-04-18T14:43:50.376424+0000", 2024-04-18T14:44:26.078 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 35.694227546, 2024-04-18T14:44:26.078 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.018965715000000001, 2024-04-18T14:44:26.078 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-04-18T14:44:26.078 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "started", 2024-04-18T14:44:26.078 INFO:teuthology.orchestra.run.smithi119.stdout: "client_info": { 2024-04-18T14:44:26.078 INFO:teuthology.orchestra.run.smithi119.stdout: "client": "client.4559", 2024-04-18T14:44:26.078 INFO:teuthology.orchestra.run.smithi119.stdout: "client_addr": "172.21.15.134:0/3113589487", 2024-04-18T14:44:26.078 INFO:teuthology.orchestra.run.smithi119.stdout: "tid": 374 2024-04-18T14:44:26.079 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:26.079 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-04-18T14:44:26.079 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:26.079 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-04-18T14:44:26.079 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:50.376424+0000", 2024-04-18T14:44:26.079 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:44:26.079 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:26.079 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:26.079 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-04-18T14:44:26.079 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:50.376424+0000", 2024-04-18T14:44:26.079 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:44:26.079 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:26.079 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:26.079 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-04-18T14:44:26.079 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:50.376422+0000", 2024-04-18T14:44:26.080 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4294967295.9999986 2024-04-18T14:44:26.080 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:26.080 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:26.080 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-04-18T14:44:26.080 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:50.376430+0000", 2024-04-18T14:44:26.080 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 7.7610000000000007e-06 2024-04-18T14:44:26.080 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:26.080 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:26.080 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-04-18T14:44:26.080 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:50.376447+0000", 2024-04-18T14:44:26.080 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.734e-05 2024-04-18T14:44:26.080 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:26.080 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:26.080 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-04-18T14:44:26.080 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:50.376462+0000", 2024-04-18T14:44:26.080 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.4286e-05 2024-04-18T14:44:26.080 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:26.081 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:26.081 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-04-18T14:44:26.081 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:50.376723+0000", 2024-04-18T14:44:26.081 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000260914 2024-04-18T14:44:26.081 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:26.081 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:26.081 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting_for_map not empty", 2024-04-18T14:44:26.081 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:50.376743+0000", 2024-04-18T14:44:26.081 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.031e-05 2024-04-18T14:44:26.081 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:26.081 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:26.081 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-04-18T14:44:26.081 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:50.387572+0000", 2024-04-18T14:44:26.081 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.010829544 2024-04-18T14:44:26.081 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:26.082 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:26.082 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-04-18T14:44:26.082 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:50.387758+0000", 2024-04-18T14:44:26.082 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000185849 2024-04-18T14:44:26.082 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:26.082 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:26.082 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-04-18T14:44:26.082 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:50.395389+0000", 2024-04-18T14:44:26.082 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0076309810000000002 2024-04-18T14:44:26.082 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:44:26.082 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-04-18T14:44:26.082 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:44:26.082 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:26.082 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:26.082 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(client.4559.0:512 3.1s0 3:8edef92b:::smithi13430248-24:head [copy-from ver 13] snapc 19=[19,16,14,13,11,f,b,a,7,2] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-18T14:44:26.083 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-04-18T14:43:56.578477+0000", 2024-04-18T14:44:26.083 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 29.492173770000001, 2024-04-18T14:44:26.083 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.021126664, 2024-04-18T14:44:26.083 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-04-18T14:44:26.083 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T14:44:26.083 INFO:teuthology.orchestra.run.smithi119.stdout: "client_info": { 2024-04-18T14:44:26.083 INFO:teuthology.orchestra.run.smithi119.stdout: "client": "client.4559", 2024-04-18T14:44:26.083 INFO:teuthology.orchestra.run.smithi119.stdout: "client_addr": "172.21.15.134:0/3113589487", 2024-04-18T14:44:26.083 INFO:teuthology.orchestra.run.smithi119.stdout: "tid": 512 2024-04-18T14:44:26.083 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:26.083 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-04-18T14:44:26.083 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:26.083 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-04-18T14:44:26.083 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:56.578477+0000", 2024-04-18T14:44:26.083 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:44:26.084 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:26.084 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:26.084 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-04-18T14:44:26.084 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:56.578477+0000", 2024-04-18T14:44:26.084 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:44:26.084 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:26.084 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:26.084 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-04-18T14:44:26.084 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:56.578473+0000", 2024-04-18T14:44:26.084 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4294967295.9999962 2024-04-18T14:44:26.084 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:26.084 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:26.084 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-04-18T14:44:26.084 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:56.578491+0000", 2024-04-18T14:44:26.084 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.7784000000000001e-05 2024-04-18T14:44:26.085 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:26.085 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:26.085 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-04-18T14:44:26.085 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:56.578576+0000", 2024-04-18T14:44:26.085 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 8.5117000000000005e-05 2024-04-18T14:44:26.085 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:26.085 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:26.085 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-04-18T14:44:26.085 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:56.578601+0000", 2024-04-18T14:44:26.085 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.4581000000000001e-05 2024-04-18T14:44:26.085 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:26.085 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:26.085 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-04-18T14:44:26.085 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:56.578739+0000", 2024-04-18T14:44:26.085 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000138271 2024-04-18T14:44:26.085 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:26.086 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:26.086 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-04-18T14:44:26.086 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:56.578932+0000", 2024-04-18T14:44:26.086 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000192649 2024-04-18T14:44:26.086 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:26.086 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:26.086 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_started", 2024-04-18T14:44:26.086 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:56.587757+0000", 2024-04-18T14:44:26.086 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0088247970000000005 2024-04-18T14:44:26.086 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:26.086 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:26.086 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_committed", 2024-04-18T14:44:26.086 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:56.591615+0000", 2024-04-18T14:44:26.086 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.003858336 2024-04-18T14:44:26.086 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:26.087 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:26.087 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-04-18T14:44:26.087 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:56.599453+0000", 2024-04-18T14:44:26.087 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0078382509999999992 2024-04-18T14:44:26.087 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:26.087 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:26.087 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-04-18T14:44:26.087 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:56.599604+0000", 2024-04-18T14:44:26.087 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000150688 2024-04-18T14:44:26.087 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:44:26.087 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-04-18T14:44:26.087 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:44:26.087 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:26.087 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:26.087 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(client.4559.0:715 3.1s0 3:891e68bf:::smithi13430248-19:head [copy-from ver 101] snapc 27=[27,26,23,22,1e,1c,1a,16,14,13,11,2] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-04-18T14:44:26.088 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-04-18T14:44:11.391972+0000", 2024-04-18T14:44:26.088 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 14.678678736, 2024-04-18T14:44:26.088 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.10959126, 2024-04-18T14:44:26.088 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-04-18T14:44:26.088 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T14:44:26.088 INFO:teuthology.orchestra.run.smithi119.stdout: "client_info": { 2024-04-18T14:44:26.088 INFO:teuthology.orchestra.run.smithi119.stdout: "client": "client.4559", 2024-04-18T14:44:26.088 INFO:teuthology.orchestra.run.smithi119.stdout: "client_addr": "172.21.15.134:0/3113589487", 2024-04-18T14:44:26.088 INFO:teuthology.orchestra.run.smithi119.stdout: "tid": 715 2024-04-18T14:44:26.088 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:26.088 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-04-18T14:44:26.088 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:26.088 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-04-18T14:44:26.088 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:11.391972+0000", 2024-04-18T14:44:26.088 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:44:26.088 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:26.089 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:26.089 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-04-18T14:44:26.089 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:11.391972+0000", 2024-04-18T14:44:26.089 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:44:26.089 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:26.089 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:26.089 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-04-18T14:44:26.089 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:11.391969+0000", 2024-04-18T14:44:26.089 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4294967295.9999962 2024-04-18T14:44:26.089 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:26.089 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:26.089 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-04-18T14:44:26.089 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:11.391990+0000", 2024-04-18T14:44:26.089 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.1569999999999998e-05 2024-04-18T14:44:26.089 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:26.090 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:26.090 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-04-18T14:44:26.090 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:11.392024+0000", 2024-04-18T14:44:26.090 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.3200000000000001e-05 2024-04-18T14:44:26.090 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:26.090 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:26.090 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-04-18T14:44:26.090 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:11.392045+0000", 2024-04-18T14:44:26.090 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.1195999999999998e-05 2024-04-18T14:44:26.090 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:26.090 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:26.090 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-04-18T14:44:26.090 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:11.392225+0000", 2024-04-18T14:44:26.090 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000180509 2024-04-18T14:44:26.090 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:26.090 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:26.091 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "op must wait for map", 2024-04-18T14:44:26.091 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:11.392245+0000", 2024-04-18T14:44:26.091 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.9726999999999999e-05 2024-04-18T14:44:26.091 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:26.091 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:26.091 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-04-18T14:44:26.091 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:11.396476+0000", 2024-04-18T14:44:26.091 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0042315210000000002 2024-04-18T14:44:26.091 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:26.091 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:26.091 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-04-18T14:44:26.091 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:11.396790+0000", 2024-04-18T14:44:26.091 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00031320399999999998 2024-04-18T14:44:26.091 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:26.091 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:26.091 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_started", 2024-04-18T14:44:26.092 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:11.490642+0000", 2024-04-18T14:44:26.092 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.093852383999999997 2024-04-18T14:44:26.092 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:26.092 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:26.092 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_committed", 2024-04-18T14:44:26.092 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:11.497646+0000", 2024-04-18T14:44:26.092 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0070044160000000003 2024-04-18T14:44:26.092 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:26.092 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:26.092 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-04-18T14:44:26.092 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:11.501312+0000", 2024-04-18T14:44:26.092 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.003665462 2024-04-18T14:44:26.092 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:26.092 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:26.092 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-04-18T14:44:26.092 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:11.501564+0000", 2024-04-18T14:44:26.093 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00025167100000000002 2024-04-18T14:44:26.093 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:44:26.093 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-04-18T14:44:26.093 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:44:26.093 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:26.093 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:26.093 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(client.4559.0:716 3.1s0 3:891e68bf:::smithi13430248-19:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e72)", 2024-04-18T14:44:26.093 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-04-18T14:44:11.392082+0000", 2024-04-18T14:44:26.093 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 14.678568667, 2024-04-18T14:44:26.093 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.103574903, 2024-04-18T14:44:26.093 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-04-18T14:44:26.093 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "started", 2024-04-18T14:44:26.093 INFO:teuthology.orchestra.run.smithi119.stdout: "client_info": { 2024-04-18T14:44:26.093 INFO:teuthology.orchestra.run.smithi119.stdout: "client": "client.4559", 2024-04-18T14:44:26.093 INFO:teuthology.orchestra.run.smithi119.stdout: "client_addr": "172.21.15.134:0/3113589487", 2024-04-18T14:44:26.093 INFO:teuthology.orchestra.run.smithi119.stdout: "tid": 716 2024-04-18T14:44:26.094 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:26.094 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-04-18T14:44:26.094 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:26.094 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-04-18T14:44:26.094 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:11.392082+0000", 2024-04-18T14:44:26.094 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:44:26.094 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:26.094 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:26.094 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-04-18T14:44:26.094 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:11.392082+0000", 2024-04-18T14:44:26.094 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:44:26.094 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:26.094 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:26.094 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-04-18T14:44:26.094 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:11.392081+0000", 2024-04-18T14:44:26.095 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4294967295.9999986 2024-04-18T14:44:26.095 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:26.095 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:26.095 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-04-18T14:44:26.095 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:11.392089+0000", 2024-04-18T14:44:26.095 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 8.2859999999999999e-06 2024-04-18T14:44:26.095 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:26.095 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:26.095 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-04-18T14:44:26.095 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:11.392110+0000", 2024-04-18T14:44:26.095 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.0659999999999999e-05 2024-04-18T14:44:26.095 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:26.095 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:26.095 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-04-18T14:44:26.096 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:11.392125+0000", 2024-04-18T14:44:26.096 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.4793999999999999e-05 2024-04-18T14:44:26.096 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:26.096 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:26.096 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-04-18T14:44:26.096 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:11.392468+0000", 2024-04-18T14:44:26.096 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00034309 2024-04-18T14:44:26.096 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:26.096 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:26.096 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting_for_map not empty", 2024-04-18T14:44:26.096 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:11.392499+0000", 2024-04-18T14:44:26.096 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.1090000000000002e-05 2024-04-18T14:44:26.096 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:26.096 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:26.096 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-04-18T14:44:26.096 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:11.397266+0000", 2024-04-18T14:44:26.097 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0047675240000000004 2024-04-18T14:44:26.097 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:26.097 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:26.097 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for blocked object", 2024-04-18T14:44:26.097 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:11.397406+0000", 2024-04-18T14:44:26.097 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000139362 2024-04-18T14:44:26.097 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:26.097 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:26.097 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-04-18T14:44:26.097 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:11.495314+0000", 2024-04-18T14:44:26.097 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.097908712999999994 2024-04-18T14:44:26.098 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:26.098 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:26.098 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-04-18T14:44:26.098 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:11.495488+0000", 2024-04-18T14:44:26.098 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00017332200000000001 2024-04-18T14:44:26.098 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:26.098 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:26.098 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-04-18T14:44:26.098 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:11.495657+0000", 2024-04-18T14:44:26.098 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00016961799999999999 2024-04-18T14:44:26.098 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:44:26.098 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-04-18T14:44:26.098 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:44:26.098 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:26.098 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:26.099 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "MOSDECSubOpWrite(3.cs6 72/30 ECSubWrite(tid=191, reqid=client.4559.0:742, at_version=72'124, trim_to=0'0, roll_forward_to=71'122))", 2024-04-18T14:44:26.099 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-04-18T14:44:11.762989+0000", 2024-04-18T14:44:26.099 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 14.307662245, 2024-04-18T14:44:26.099 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.017483157999999999, 2024-04-18T14:44:26.099 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-04-18T14:44:26.099 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "reached pg", 2024-04-18T14:44:26.099 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-04-18T14:44:26.099 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:26.099 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-04-18T14:44:26.099 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:11.762989+0000", 2024-04-18T14:44:26.099 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:44:26.099 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:26.099 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:26.099 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-04-18T14:44:26.099 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:11.762989+0000", 2024-04-18T14:44:26.099 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:44:26.100 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:26.100 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:26.100 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-04-18T14:44:26.100 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:11.762986+0000", 2024-04-18T14:44:26.100 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4294967295.9999971 2024-04-18T14:44:26.100 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:26.100 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:26.100 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-04-18T14:44:26.100 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:11.766014+0000", 2024-04-18T14:44:26.100 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0030282529999999998 2024-04-18T14:44:26.100 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:26.100 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:26.100 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-04-18T14:44:26.100 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:11.766077+0000", 2024-04-18T14:44:26.100 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 6.2586e-05 2024-04-18T14:44:26.101 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:26.101 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:26.101 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-04-18T14:44:26.101 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:11.766102+0000", 2024-04-18T14:44:26.101 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.5386999999999999e-05 2024-04-18T14:44:26.101 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:26.101 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:26.101 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-04-18T14:44:26.101 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:11.766251+0000", 2024-04-18T14:44:26.101 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00014814599999999999 2024-04-18T14:44:26.101 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:26.101 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:26.101 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_started", 2024-04-18T14:44:26.101 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:11.766280+0000", 2024-04-18T14:44:26.101 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.9221999999999999e-05 2024-04-18T14:44:26.101 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:26.102 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:26.102 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_committed", 2024-04-18T14:44:26.102 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:11.780420+0000", 2024-04-18T14:44:26.102 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.014139898999999999 2024-04-18T14:44:26.102 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:26.102 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:26.102 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-04-18T14:44:26.102 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:11.780472+0000", 2024-04-18T14:44:26.102 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 5.2292e-05 2024-04-18T14:44:26.102 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:44:26.102 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-04-18T14:44:26.102 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:44:26.102 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:26.102 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:26.102 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(client.4559.0:784 3.1s0 3:891e68bf:::smithi13430248-19:head [rmxattr NXqthRdcT\\nYpra`^tP]gObbPnlZajaS`pNaeWSW in=40b,rmxattr RZgqTbskOQTtb`TrapV[kpfRhdestNfNfmVZfoPg in=40b,rmxattr WhheaoZ]ebRkV[bm[dSXUZd]Tc`jlnThbOrlYaXa in=40b,rmxattr _Y]RsTQW\\Xhe^mYeUN\\piag]YmYRNN_ml\\^q]Off in=40b,rmxattr re\\k]Zg[a\\QtVPdN]XaroaNhkr]pNRiXgOnTUW`q in=40b,rmxattr titWXmhVR_fW]j[bb^q`obYVe[XP\\sTjkc^TOfnp in=40b] snapc 2b=[2b,2a,29,28,27,26,23,22,1e,1c,1a,16,14,13,11,2] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-18T14:44:26.103 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-04-18T14:44:15.395463+0000", 2024-04-18T14:44:26.103 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 10.675187932, 2024-04-18T14:44:26.103 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.021046380999999999, 2024-04-18T14:44:26.103 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-04-18T14:44:26.103 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T14:44:26.103 INFO:teuthology.orchestra.run.smithi119.stdout: "client_info": { 2024-04-18T14:44:26.103 INFO:teuthology.orchestra.run.smithi119.stdout: "client": "client.4559", 2024-04-18T14:44:26.103 INFO:teuthology.orchestra.run.smithi119.stdout: "client_addr": "172.21.15.134:0/3113589487", 2024-04-18T14:44:26.103 INFO:teuthology.orchestra.run.smithi119.stdout: "tid": 784 2024-04-18T14:44:26.103 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:26.103 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-04-18T14:44:26.103 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:26.103 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-04-18T14:44:26.103 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:15.395463+0000", 2024-04-18T14:44:26.103 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:44:26.103 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:26.104 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:26.104 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-04-18T14:44:26.104 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:15.395463+0000", 2024-04-18T14:44:26.104 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:44:26.104 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:26.104 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:26.104 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-04-18T14:44:26.104 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:15.395461+0000", 2024-04-18T14:44:26.104 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4294967295.9999976 2024-04-18T14:44:26.104 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:26.104 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:26.104 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-04-18T14:44:26.104 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:15.395480+0000", 2024-04-18T14:44:26.104 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.9660000000000002e-05 2024-04-18T14:44:26.104 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:26.104 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:26.105 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-04-18T14:44:26.105 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:15.395514+0000", 2024-04-18T14:44:26.105 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.4106000000000002e-05 2024-04-18T14:44:26.105 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:26.105 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:26.105 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-04-18T14:44:26.105 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:15.395541+0000", 2024-04-18T14:44:26.105 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.635e-05 2024-04-18T14:44:26.105 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:26.105 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:26.105 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-04-18T14:44:26.105 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:15.395706+0000", 2024-04-18T14:44:26.105 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00016543800000000001 2024-04-18T14:44:26.105 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:26.105 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:26.105 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "op must wait for map", 2024-04-18T14:44:26.105 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:15.395731+0000", 2024-04-18T14:44:26.106 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.5137e-05 2024-04-18T14:44:26.106 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:26.106 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:26.106 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-04-18T14:44:26.106 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:15.400744+0000", 2024-04-18T14:44:26.106 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.005012865 2024-04-18T14:44:26.106 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:26.106 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:26.106 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-04-18T14:44:26.106 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:15.401013+0000", 2024-04-18T14:44:26.106 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00026928400000000001 2024-04-18T14:44:26.106 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:26.106 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:26.106 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_started", 2024-04-18T14:44:26.106 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:15.402872+0000", 2024-04-18T14:44:26.107 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0018588190000000001 2024-04-18T14:44:26.107 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:26.107 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:26.107 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_committed", 2024-04-18T14:44:26.107 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:15.409124+0000", 2024-04-18T14:44:26.107 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0062519589999999996 2024-04-18T14:44:26.107 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:26.107 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:26.107 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-04-18T14:44:26.107 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:15.416400+0000", 2024-04-18T14:44:26.107 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0072758909999999996 2024-04-18T14:44:26.107 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:26.107 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:26.107 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-04-18T14:44:26.107 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:15.416510+0000", 2024-04-18T14:44:26.107 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000109372 2024-04-18T14:44:26.108 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:44:26.108 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-04-18T14:44:26.108 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:44:26.108 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:26.108 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:26.108 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(client.4559.0:829 3.1s0 3:8edef92b:::smithi13430248-24:head [copy-from ver 81] snapc 2c=[2c,2b,2a,29,28,27,26,23,22,1e,1c,1a,16,14,13,11,2] ondisk+write+known_if_redirected+supports_pool_eio e77)", 2024-04-18T14:44:26.108 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-04-18T14:44:16.418052+0000", 2024-04-18T14:44:26.108 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 9.6525988910000002, 2024-04-18T14:44:26.108 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.053665807000000003, 2024-04-18T14:44:26.108 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-04-18T14:44:26.108 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T14:44:26.108 INFO:teuthology.orchestra.run.smithi119.stdout: "client_info": { 2024-04-18T14:44:26.108 INFO:teuthology.orchestra.run.smithi119.stdout: "client": "client.4559", 2024-04-18T14:44:26.108 INFO:teuthology.orchestra.run.smithi119.stdout: "client_addr": "172.21.15.134:0/3113589487", 2024-04-18T14:44:26.108 INFO:teuthology.orchestra.run.smithi119.stdout: "tid": 829 2024-04-18T14:44:26.108 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:26.109 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-04-18T14:44:26.109 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:26.109 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-04-18T14:44:26.109 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:16.418052+0000", 2024-04-18T14:44:26.109 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:44:26.109 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:26.109 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:26.109 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-04-18T14:44:26.109 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:16.418052+0000", 2024-04-18T14:44:26.109 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:44:26.109 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:26.109 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:26.109 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-04-18T14:44:26.109 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:16.418049+0000", 2024-04-18T14:44:26.109 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4294967295.9999971 2024-04-18T14:44:26.109 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:26.110 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:26.110 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-04-18T14:44:26.110 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:16.418066+0000", 2024-04-18T14:44:26.110 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.7079e-05 2024-04-18T14:44:26.110 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:26.110 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:26.110 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-04-18T14:44:26.110 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:16.418102+0000", 2024-04-18T14:44:26.110 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.5967000000000003e-05 2024-04-18T14:44:26.110 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:26.110 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:26.110 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-04-18T14:44:26.110 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:16.418123+0000", 2024-04-18T14:44:26.110 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.0343000000000002e-05 2024-04-18T14:44:26.110 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:26.110 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:26.111 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-04-18T14:44:26.111 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:16.418250+0000", 2024-04-18T14:44:26.111 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00012688599999999999 2024-04-18T14:44:26.111 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:26.111 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:26.111 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "op must wait for map", 2024-04-18T14:44:26.111 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:16.418266+0000", 2024-04-18T14:44:26.111 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.6237000000000001e-05 2024-04-18T14:44:26.111 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:26.111 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:26.111 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-04-18T14:44:26.111 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:16.423970+0000", 2024-04-18T14:44:26.111 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0057040789999999999 2024-04-18T14:44:26.111 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:26.111 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:26.111 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-04-18T14:44:26.112 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:16.424220+0000", 2024-04-18T14:44:26.112 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00025055500000000002 2024-04-18T14:44:26.112 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:26.112 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:26.112 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_started", 2024-04-18T14:44:26.112 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:16.462776+0000", 2024-04-18T14:44:26.112 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.038556020000000003 2024-04-18T14:44:26.112 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:26.112 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:26.112 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_committed", 2024-04-18T14:44:26.112 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:16.466730+0000", 2024-04-18T14:44:26.112 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0039531940000000002 2024-04-18T14:44:26.112 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:26.112 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:26.112 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-04-18T14:44:26.112 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:16.471627+0000", 2024-04-18T14:44:26.113 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0048974200000000004 2024-04-18T14:44:26.113 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:26.113 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:26.113 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-04-18T14:44:26.113 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:16.471718+0000", 2024-04-18T14:44:26.113 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 9.0983000000000006e-05 2024-04-18T14:44:26.113 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:44:26.113 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-04-18T14:44:26.113 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:44:26.113 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:26.113 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:26.113 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(client.4559.0:830 3.1s0 3:8edef92b:::smithi13430248-24:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e77)", 2024-04-18T14:44:26.113 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-04-18T14:44:16.418143+0000", 2024-04-18T14:44:26.113 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 9.6525085409999996, 2024-04-18T14:44:26.113 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.048579178000000001, 2024-04-18T14:44:26.113 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-04-18T14:44:26.114 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "started", 2024-04-18T14:44:26.114 INFO:teuthology.orchestra.run.smithi119.stdout: "client_info": { 2024-04-18T14:44:26.114 INFO:teuthology.orchestra.run.smithi119.stdout: "client": "client.4559", 2024-04-18T14:44:26.114 INFO:teuthology.orchestra.run.smithi119.stdout: "client_addr": "172.21.15.134:0/3113589487", 2024-04-18T14:44:26.114 INFO:teuthology.orchestra.run.smithi119.stdout: "tid": 830 2024-04-18T14:44:26.114 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:26.114 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-04-18T14:44:26.114 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:26.114 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-04-18T14:44:26.114 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:16.418143+0000", 2024-04-18T14:44:26.114 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:44:26.114 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:26.114 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:26.114 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-04-18T14:44:26.114 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:16.418143+0000", 2024-04-18T14:44:26.114 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:44:26.115 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:26.115 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:26.115 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-04-18T14:44:26.115 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:16.418141+0000", 2024-04-18T14:44:26.115 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4294967295.9999986 2024-04-18T14:44:26.115 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:26.115 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:26.115 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-04-18T14:44:26.115 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:16.418148+0000", 2024-04-18T14:44:26.115 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 6.9770000000000003e-06 2024-04-18T14:44:26.115 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:26.115 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:26.115 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-04-18T14:44:26.115 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:16.418168+0000", 2024-04-18T14:44:26.115 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.9303000000000001e-05 2024-04-18T14:44:26.115 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:26.116 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:26.116 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-04-18T14:44:26.116 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:16.418182+0000", 2024-04-18T14:44:26.116 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.4266e-05 2024-04-18T14:44:26.116 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:26.116 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:26.116 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-04-18T14:44:26.116 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:16.418380+0000", 2024-04-18T14:44:26.116 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00019845900000000001 2024-04-18T14:44:26.116 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:26.116 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:26.116 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting_for_map not empty", 2024-04-18T14:44:26.116 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:16.418396+0000", 2024-04-18T14:44:26.116 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.6047000000000001e-05 2024-04-18T14:44:26.116 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:26.116 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:26.117 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-04-18T14:44:26.117 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:16.424577+0000", 2024-04-18T14:44:26.117 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0061809819999999998 2024-04-18T14:44:26.117 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:26.117 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:26.117 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for blocked object", 2024-04-18T14:44:26.117 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:16.424694+0000", 2024-04-18T14:44:26.117 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000116669 2024-04-18T14:44:26.117 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:26.117 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:26.117 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-04-18T14:44:26.117 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:16.466297+0000", 2024-04-18T14:44:26.117 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.041603382000000001 2024-04-18T14:44:26.117 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:26.117 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:26.117 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-04-18T14:44:26.118 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:16.466508+0000", 2024-04-18T14:44:26.118 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00021091099999999999 2024-04-18T14:44:26.118 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:26.118 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:26.118 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-04-18T14:44:26.118 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:16.466722+0000", 2024-04-18T14:44:26.118 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000213489 2024-04-18T14:44:26.118 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:44:26.118 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-04-18T14:44:26.118 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:44:26.118 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:26.118 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:26.118 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "MOSDECSubOpWrite(3.5s1 78/30 ECSubWrite(tid=41, reqid=osd.15.0:40, at_version=0'0, trim_to=0'0, roll_forward_to=78'34))", 2024-04-18T14:44:26.118 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-04-18T14:44:17.432878+0000", 2024-04-18T14:44:26.118 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 8.6377735139999992, 2024-04-18T14:44:26.118 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.017425369, 2024-04-18T14:44:26.119 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-04-18T14:44:26.119 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "reached pg", 2024-04-18T14:44:26.119 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-04-18T14:44:26.119 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:26.119 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-04-18T14:44:26.119 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:17.432878+0000", 2024-04-18T14:44:26.119 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:44:26.119 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:26.119 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:26.119 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-04-18T14:44:26.119 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:17.432878+0000", 2024-04-18T14:44:26.119 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:44:26.119 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:26.119 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:26.119 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-04-18T14:44:26.119 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:17.432876+0000", 2024-04-18T14:44:26.120 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4294967295.9999981 2024-04-18T14:44:26.120 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:26.120 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:26.120 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-04-18T14:44:26.120 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:17.432905+0000", 2024-04-18T14:44:26.120 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.9606000000000001e-05 2024-04-18T14:44:26.120 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:26.120 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:26.120 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-04-18T14:44:26.120 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:17.432973+0000", 2024-04-18T14:44:26.120 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 6.8182999999999994e-05 2024-04-18T14:44:26.120 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:26.120 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:26.120 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-04-18T14:44:26.120 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:17.432997+0000", 2024-04-18T14:44:26.120 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.3652999999999999e-05 2024-04-18T14:44:26.121 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:26.121 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:26.121 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-04-18T14:44:26.121 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:17.433145+0000", 2024-04-18T14:44:26.121 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000147553 2024-04-18T14:44:26.121 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:26.121 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:26.121 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_started", 2024-04-18T14:44:26.121 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:17.433169+0000", 2024-04-18T14:44:26.121 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.4502999999999999e-05 2024-04-18T14:44:26.121 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:26.121 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:26.121 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_committed", 2024-04-18T14:44:26.121 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:17.450245+0000", 2024-04-18T14:44:26.121 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.017075705 2024-04-18T14:44:26.122 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:26.122 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:26.122 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-04-18T14:44:26.122 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:17.450303+0000", 2024-04-18T14:44:26.122 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 5.8192999999999997e-05 2024-04-18T14:44:26.122 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:44:26.122 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-04-18T14:44:26.122 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:44:26.122 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:26.122 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:26.122 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "MOSDECSubOpWrite(3.ds6 78/30 ECSubWrite(tid=55, reqid=osd.7.0:55, at_version=78'51, trim_to=0'0, roll_forward_to=77'47))", 2024-04-18T14:44:26.122 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-04-18T14:44:17.435783+0000", 2024-04-18T14:44:26.122 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 8.6348679070000003, 2024-04-18T14:44:26.122 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.019364541999999998, 2024-04-18T14:44:26.122 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-04-18T14:44:26.122 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "reached pg", 2024-04-18T14:44:26.123 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-04-18T14:44:26.123 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:26.123 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-04-18T14:44:26.123 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:17.435783+0000", 2024-04-18T14:44:26.123 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:44:26.123 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:26.123 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:26.123 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-04-18T14:44:26.123 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:17.435783+0000", 2024-04-18T14:44:26.123 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:44:26.123 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:26.123 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:26.123 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-04-18T14:44:26.123 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:17.435782+0000", 2024-04-18T14:44:26.123 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4294967295.9999986 2024-04-18T14:44:26.123 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:26.124 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:26.124 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-04-18T14:44:26.124 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:17.435838+0000", 2024-04-18T14:44:26.124 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 5.5553999999999997e-05 2024-04-18T14:44:26.124 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:26.124 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:26.124 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-04-18T14:44:26.124 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:17.435862+0000", 2024-04-18T14:44:26.124 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.4882999999999999e-05 2024-04-18T14:44:26.124 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:26.124 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:26.124 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-04-18T14:44:26.124 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:17.435882+0000", 2024-04-18T14:44:26.124 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.9949000000000002e-05 2024-04-18T14:44:26.124 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:26.124 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:26.125 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-04-18T14:44:26.125 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:17.447337+0000", 2024-04-18T14:44:26.125 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.011454489999999999 2024-04-18T14:44:26.125 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:26.125 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:26.125 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_started", 2024-04-18T14:44:26.125 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:17.447359+0000", 2024-04-18T14:44:26.125 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.2048999999999998e-05 2024-04-18T14:44:26.125 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:26.125 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:26.125 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_committed", 2024-04-18T14:44:26.125 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:17.455089+0000", 2024-04-18T14:44:26.125 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.007730247 2024-04-18T14:44:26.125 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:26.125 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:26.125 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-04-18T14:44:26.126 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:17.455148+0000", 2024-04-18T14:44:26.126 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 5.8573999999999999e-05 2024-04-18T14:44:26.126 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:44:26.126 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-04-18T14:44:26.126 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:44:26.126 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:26.126 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:26.126 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "MOSDECSubOpWrite(3.6s4 78/70 ECSubWrite(tid=279, reqid=osd.14.0:279, at_version=78'115, trim_to=0'0, roll_forward_to=77'111))", 2024-04-18T14:44:26.126 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-04-18T14:44:17.438052+0000", 2024-04-18T14:44:26.126 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 8.6325991940000009, 2024-04-18T14:44:26.126 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.016876472999999999, 2024-04-18T14:44:26.126 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-04-18T14:44:26.126 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "reached pg", 2024-04-18T14:44:26.126 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-04-18T14:44:26.126 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:26.126 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-04-18T14:44:26.127 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:17.438052+0000", 2024-04-18T14:44:26.127 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:44:26.127 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:26.127 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:26.127 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-04-18T14:44:26.127 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:17.438052+0000", 2024-04-18T14:44:26.127 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:44:26.127 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:26.127 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:26.127 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-04-18T14:44:26.127 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:17.438051+0000", 2024-04-18T14:44:26.127 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4294967295.999999 2024-04-18T14:44:26.127 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:26.127 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:26.127 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-04-18T14:44:26.127 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:17.438109+0000", 2024-04-18T14:44:26.128 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 5.7822000000000003e-05 2024-04-18T14:44:26.128 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:26.128 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:26.128 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-04-18T14:44:26.128 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:17.438134+0000", 2024-04-18T14:44:26.128 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.5086999999999999e-05 2024-04-18T14:44:26.128 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:26.128 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:26.128 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-04-18T14:44:26.128 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:17.438158+0000", 2024-04-18T14:44:26.128 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.423e-05 2024-04-18T14:44:26.128 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:26.128 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:26.128 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-04-18T14:44:26.128 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:17.444361+0000", 2024-04-18T14:44:26.128 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0062027649999999998 2024-04-18T14:44:26.129 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:26.129 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:26.129 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_started", 2024-04-18T14:44:26.129 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:17.444389+0000", 2024-04-18T14:44:26.129 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.8653000000000002e-05 2024-04-18T14:44:26.129 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:26.129 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:26.129 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_committed", 2024-04-18T14:44:26.129 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:17.454856+0000", 2024-04-18T14:44:26.129 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.010466667000000001 2024-04-18T14:44:26.129 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:26.129 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:26.129 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-04-18T14:44:26.129 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:17.454928+0000", 2024-04-18T14:44:26.129 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 7.2348999999999995e-05 2024-04-18T14:44:26.129 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:44:26.129 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-04-18T14:44:26.130 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:44:26.130 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:26.130 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:26.130 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "MOSDECSubOpWrite(3.9s6 78/73 ECSubWrite(tid=196, reqid=osd.12.0:196, at_version=78'137, trim_to=0'0, roll_forward_to=76'135))", 2024-04-18T14:44:26.130 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-04-18T14:44:17.439758+0000", 2024-04-18T14:44:26.130 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 8.6308928869999999, 2024-04-18T14:44:26.130 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.021813842, 2024-04-18T14:44:26.130 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-04-18T14:44:26.130 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "reached pg", 2024-04-18T14:44:26.130 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-04-18T14:44:26.130 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:26.130 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-04-18T14:44:26.130 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:17.439758+0000", 2024-04-18T14:44:26.130 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:44:26.131 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:26.131 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:26.131 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-04-18T14:44:26.131 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:17.439758+0000", 2024-04-18T14:44:26.131 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:44:26.131 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:26.131 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:26.131 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-04-18T14:44:26.131 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:17.439757+0000", 2024-04-18T14:44:26.131 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4294967295.999999 2024-04-18T14:44:26.131 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:26.131 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:26.131 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-04-18T14:44:26.131 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:17.439809+0000", 2024-04-18T14:44:26.131 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 5.1802999999999999e-05 2024-04-18T14:44:26.131 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:26.132 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:26.132 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-04-18T14:44:26.132 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:17.441594+0000", 2024-04-18T14:44:26.132 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0017843830000000001 2024-04-18T14:44:26.132 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:26.132 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:26.132 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-04-18T14:44:26.132 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:17.443883+0000", 2024-04-18T14:44:26.132 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0022896259999999999 2024-04-18T14:44:26.132 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:26.132 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:26.132 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-04-18T14:44:26.132 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:17.444024+0000", 2024-04-18T14:44:26.132 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00014086200000000001 2024-04-18T14:44:26.132 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:26.132 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:26.133 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_started", 2024-04-18T14:44:26.133 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:17.444049+0000", 2024-04-18T14:44:26.133 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.4479999999999999e-05 2024-04-18T14:44:26.133 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:26.133 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:26.133 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_committed", 2024-04-18T14:44:26.133 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:17.461512+0000", 2024-04-18T14:44:26.133 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.017463869 2024-04-18T14:44:26.133 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:26.133 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:26.133 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-04-18T14:44:26.133 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:17.461572+0000", 2024-04-18T14:44:26.133 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 5.9653e-05 2024-04-18T14:44:26.133 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:44:26.133 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-04-18T14:44:26.133 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:44:26.134 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:26.134 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:26.134 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "MOSDECSubOpWrite(3.9s6 78/73 ECSubWrite(tid=197, reqid=osd.12.0:197, at_version=78'139, trim_to=0'0, roll_forward_to=76'135))", 2024-04-18T14:44:26.134 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-04-18T14:44:17.446248+0000", 2024-04-18T14:44:26.134 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 8.6244026540000007, 2024-04-18T14:44:26.134 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.029710947000000001, 2024-04-18T14:44:26.134 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-04-18T14:44:26.134 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "reached pg", 2024-04-18T14:44:26.134 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-04-18T14:44:26.134 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:26.134 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-04-18T14:44:26.134 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:17.446248+0000", 2024-04-18T14:44:26.134 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:44:26.134 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:26.134 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:26.135 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-04-18T14:44:26.135 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:17.446248+0000", 2024-04-18T14:44:26.135 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:44:26.135 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:26.135 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:26.135 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-04-18T14:44:26.135 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:17.446247+0000", 2024-04-18T14:44:26.135 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4294967295.9999986 2024-04-18T14:44:26.135 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:26.135 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:26.135 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-04-18T14:44:26.135 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:17.446298+0000", 2024-04-18T14:44:26.135 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 5.1393000000000001e-05 2024-04-18T14:44:26.135 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:26.135 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:26.135 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-04-18T14:44:26.136 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:17.446332+0000", 2024-04-18T14:44:26.136 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.3735999999999997e-05 2024-04-18T14:44:26.136 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:26.136 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:26.136 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-04-18T14:44:26.136 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:17.446355+0000", 2024-04-18T14:44:26.136 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.2900000000000001e-05 2024-04-18T14:44:26.136 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:26.136 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:26.136 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-04-18T14:44:26.136 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:17.453739+0000", 2024-04-18T14:44:26.136 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0073842400000000002 2024-04-18T14:44:26.136 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:26.136 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:26.136 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_started", 2024-04-18T14:44:26.137 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:17.453761+0000", 2024-04-18T14:44:26.137 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.1593000000000001e-05 2024-04-18T14:44:26.137 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:26.137 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:26.137 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_committed", 2024-04-18T14:44:26.137 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:17.475913+0000", 2024-04-18T14:44:26.137 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.02215286 2024-04-18T14:44:26.137 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:26.137 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:26.137 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-04-18T14:44:26.137 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:17.475959+0000", 2024-04-18T14:44:26.137 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4.5884999999999999e-05 2024-04-18T14:44:26.138 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:44:26.138 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-04-18T14:44:26.138 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:44:26.138 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:26.138 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:26.138 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "MOSDECSubOpWrite(3.6s4 82/70 ECSubWrite(tid=321, reqid=osd.14.0:321, at_version=82'142, trim_to=0'0, roll_forward_to=81'138))", 2024-04-18T14:44:26.138 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-04-18T14:44:21.477877+0000", 2024-04-18T14:44:26.138 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 4.5927737999999998, 2024-04-18T14:44:26.138 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.019971691, 2024-04-18T14:44:26.138 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-04-18T14:44:26.138 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "reached pg", 2024-04-18T14:44:26.138 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-04-18T14:44:26.138 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:26.138 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-04-18T14:44:26.138 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:21.477877+0000", 2024-04-18T14:44:26.139 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:44:26.139 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:26.139 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:26.139 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-04-18T14:44:26.139 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:21.477877+0000", 2024-04-18T14:44:26.139 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:44:26.139 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:26.139 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:26.139 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-04-18T14:44:26.139 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:21.477876+0000", 2024-04-18T14:44:26.139 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4294967295.9999981 2024-04-18T14:44:26.139 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:26.139 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:26.139 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-04-18T14:44:26.139 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:21.477969+0000", 2024-04-18T14:44:26.139 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 9.3295999999999996e-05 2024-04-18T14:44:26.140 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:26.140 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:26.140 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-04-18T14:44:26.140 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:21.479499+0000", 2024-04-18T14:44:26.140 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.001530235 2024-04-18T14:44:26.140 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:26.140 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:26.140 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-04-18T14:44:26.140 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:21.479524+0000", 2024-04-18T14:44:26.140 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.5202999999999999e-05 2024-04-18T14:44:26.140 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:26.140 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:26.140 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-04-18T14:44:26.140 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:21.479661+0000", 2024-04-18T14:44:26.140 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000136336 2024-04-18T14:44:26.140 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:26.140 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:26.141 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_started", 2024-04-18T14:44:26.141 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:21.479689+0000", 2024-04-18T14:44:26.141 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.8670000000000002e-05 2024-04-18T14:44:26.141 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:26.141 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:26.141 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_committed", 2024-04-18T14:44:26.141 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:21.497787+0000", 2024-04-18T14:44:26.141 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.018097641000000001 2024-04-18T14:44:26.141 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:26.141 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:26.141 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-04-18T14:44:26.141 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:21.497849+0000", 2024-04-18T14:44:26.141 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 6.2056000000000004e-05 2024-04-18T14:44:26.141 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:44:26.141 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-04-18T14:44:26.141 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:44:26.142 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:26.142 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:26.142 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "MOSDECSubOpWrite(3.cs6 82/30 ECSubWrite(tid=253, reqid=osd.11.0:253, at_version=82'174, trim_to=0'0, roll_forward_to=80'170))", 2024-04-18T14:44:26.142 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-04-18T14:44:21.480257+0000", 2024-04-18T14:44:26.142 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 4.5903943309999997, 2024-04-18T14:44:26.142 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.017787084000000002, 2024-04-18T14:44:26.142 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-04-18T14:44:26.142 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "reached pg", 2024-04-18T14:44:26.142 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-04-18T14:44:26.142 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:26.142 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-04-18T14:44:26.142 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:21.480257+0000", 2024-04-18T14:44:26.142 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:44:26.142 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:26.142 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:26.143 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-04-18T14:44:26.143 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:21.480257+0000", 2024-04-18T14:44:26.143 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:44:26.143 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:26.143 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:26.143 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-04-18T14:44:26.143 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:21.480256+0000", 2024-04-18T14:44:26.143 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4294967295.999999 2024-04-18T14:44:26.143 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:26.143 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:26.144 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-04-18T14:44:26.144 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:21.480312+0000", 2024-04-18T14:44:26.144 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 5.6446000000000001e-05 2024-04-18T14:44:26.144 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:26.144 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:26.144 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-04-18T14:44:26.144 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:21.480336+0000", 2024-04-18T14:44:26.144 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.4394000000000001e-05 2024-04-18T14:44:26.144 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:26.144 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:26.144 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-04-18T14:44:26.145 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:21.480356+0000", 2024-04-18T14:44:26.145 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.0003000000000001e-05 2024-04-18T14:44:26.145 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:26.145 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:26.145 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-04-18T14:44:26.145 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:21.484298+0000", 2024-04-18T14:44:26.145 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0039411790000000004 2024-04-18T14:44:26.145 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:26.145 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:26.145 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_started", 2024-04-18T14:44:26.145 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:21.484322+0000", 2024-04-18T14:44:26.145 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.4773000000000002e-05 2024-04-18T14:44:26.145 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:26.145 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:26.145 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_committed", 2024-04-18T14:44:26.145 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:21.497997+0000", 2024-04-18T14:44:26.146 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.013675015 2024-04-18T14:44:26.146 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:26.146 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:26.146 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-04-18T14:44:26.146 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:21.498044+0000", 2024-04-18T14:44:26.146 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4.6397000000000003e-05 2024-04-18T14:44:26.146 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:44:26.146 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-04-18T14:44:26.146 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:44:26.146 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:26.146 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:26.146 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "MOSDECSubOpWrite(3.9s6 82/73 ECSubWrite(tid=222, reqid=osd.12.0:221, at_version=0'0, trim_to=0'0, roll_forward_to=82'169))", 2024-04-18T14:44:26.146 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-04-18T14:44:21.482905+0000", 2024-04-18T14:44:26.146 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 4.5877458740000003, 2024-04-18T14:44:26.146 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.019024836999999999, 2024-04-18T14:44:26.147 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-04-18T14:44:26.147 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "reached pg", 2024-04-18T14:44:26.147 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-04-18T14:44:26.147 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:26.147 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-04-18T14:44:26.147 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:21.482905+0000", 2024-04-18T14:44:26.147 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:44:26.147 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:26.147 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:26.147 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-04-18T14:44:26.147 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:21.482905+0000", 2024-04-18T14:44:26.147 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:44:26.147 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:26.147 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:26.147 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-04-18T14:44:26.147 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:21.482903+0000", 2024-04-18T14:44:26.148 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4294967295.9999981 2024-04-18T14:44:26.148 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:26.148 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:26.148 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-04-18T14:44:26.148 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:21.482932+0000", 2024-04-18T14:44:26.148 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.9130000000000001e-05 2024-04-18T14:44:26.148 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:26.148 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:26.148 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-04-18T14:44:26.148 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:21.482968+0000", 2024-04-18T14:44:26.148 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.5948999999999998e-05 2024-04-18T14:44:26.148 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:26.148 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:26.148 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-04-18T14:44:26.148 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:21.483015+0000", 2024-04-18T14:44:26.149 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4.6230000000000003e-05 2024-04-18T14:44:26.149 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:26.149 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:26.149 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-04-18T14:44:26.149 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:21.483213+0000", 2024-04-18T14:44:26.149 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00019806199999999999 2024-04-18T14:44:26.149 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:26.149 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:26.149 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_started", 2024-04-18T14:44:26.149 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:21.483237+0000", 2024-04-18T14:44:26.149 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.4613e-05 2024-04-18T14:44:26.149 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:26.149 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:26.149 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_committed", 2024-04-18T14:44:26.149 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:21.501866+0000", 2024-04-18T14:44:26.149 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.018628563000000001 2024-04-18T14:44:26.150 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:26.150 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:26.150 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-04-18T14:44:26.150 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:21.501930+0000", 2024-04-18T14:44:26.150 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 6.4157000000000003e-05 2024-04-18T14:44:26.150 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:44:26.150 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-04-18T14:44:26.150 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:44:26.150 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:26.150 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:26.150 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "MOSDECSubOpWrite(3.9s6 82/73 ECSubWrite(tid=223, reqid=osd.12.0:223, at_version=82'171, trim_to=0'0, roll_forward_to=82'169))", 2024-04-18T14:44:26.150 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-04-18T14:44:21.486232+0000", 2024-04-18T14:44:26.150 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 4.5844189740000001, 2024-04-18T14:44:26.150 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.017914118999999999, 2024-04-18T14:44:26.150 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-04-18T14:44:26.150 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "reached pg", 2024-04-18T14:44:26.151 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-04-18T14:44:26.151 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:26.151 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-04-18T14:44:26.151 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:21.486232+0000", 2024-04-18T14:44:26.151 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:44:26.151 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:26.151 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:26.151 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-04-18T14:44:26.151 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:21.486232+0000", 2024-04-18T14:44:26.151 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:44:26.151 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:26.151 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:26.151 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-04-18T14:44:26.151 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:21.486231+0000", 2024-04-18T14:44:26.151 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4294967295.999999 2024-04-18T14:44:26.151 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:26.152 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:26.152 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-04-18T14:44:26.152 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:21.486278+0000", 2024-04-18T14:44:26.152 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4.7197000000000002e-05 2024-04-18T14:44:26.152 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:26.152 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:26.152 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-04-18T14:44:26.152 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:21.486303+0000", 2024-04-18T14:44:26.152 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.5303000000000002e-05 2024-04-18T14:44:26.152 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:26.152 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:26.152 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-04-18T14:44:26.152 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:21.486330+0000", 2024-04-18T14:44:26.152 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.6196000000000001e-05 2024-04-18T14:44:26.152 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:26.152 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:26.153 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-04-18T14:44:26.153 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:21.494309+0000", 2024-04-18T14:44:26.153 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0079798089999999992 2024-04-18T14:44:26.153 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:26.153 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:26.153 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_started", 2024-04-18T14:44:26.153 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:21.494332+0000", 2024-04-18T14:44:26.153 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.2629999999999998e-05 2024-04-18T14:44:26.153 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:26.153 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:26.153 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_committed", 2024-04-18T14:44:26.153 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:21.504102+0000", 2024-04-18T14:44:26.153 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0097698339999999998 2024-04-18T14:44:26.153 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:26.153 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:26.153 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-04-18T14:44:26.154 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:21.504146+0000", 2024-04-18T14:44:26.154 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4.4310000000000001e-05 2024-04-18T14:44:26.154 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:44:26.154 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-04-18T14:44:26.154 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:44:26.154 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:26.154 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:26.154 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "MOSDECSubOpWrite(3.9s6 82/73 ECSubWrite(tid=224, reqid=osd.12.0:224, at_version=82'173, trim_to=0'0, roll_forward_to=82'169))", 2024-04-18T14:44:26.154 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-04-18T14:44:21.488203+0000", 2024-04-18T14:44:26.154 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 4.5824480789999997, 2024-04-18T14:44:26.154 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.017473570000000001, 2024-04-18T14:44:26.154 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-04-18T14:44:26.154 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "reached pg", 2024-04-18T14:44:26.154 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-04-18T14:44:26.154 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:26.155 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-04-18T14:44:26.155 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:21.488203+0000", 2024-04-18T14:44:26.155 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:44:26.155 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:26.155 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:26.155 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-04-18T14:44:26.155 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:21.488203+0000", 2024-04-18T14:44:26.155 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:44:26.155 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:26.155 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:26.155 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-04-18T14:44:26.155 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:21.488201+0000", 2024-04-18T14:44:26.155 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4294967295.9999986 2024-04-18T14:44:26.155 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:26.155 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:26.156 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-04-18T14:44:26.156 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:21.488254+0000", 2024-04-18T14:44:26.156 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 5.2136999999999999e-05 2024-04-18T14:44:26.156 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:26.156 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:26.156 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-04-18T14:44:26.156 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:21.488285+0000", 2024-04-18T14:44:26.156 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.1377000000000001e-05 2024-04-18T14:44:26.156 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:26.156 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:26.156 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-04-18T14:44:26.156 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:21.488307+0000", 2024-04-18T14:44:26.156 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.1729000000000002e-05 2024-04-18T14:44:26.156 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:26.156 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:26.156 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-04-18T14:44:26.157 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:21.497459+0000", 2024-04-18T14:44:26.157 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0091518529999999997 2024-04-18T14:44:26.157 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:26.157 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:26.157 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_started", 2024-04-18T14:44:26.157 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:21.497485+0000", 2024-04-18T14:44:26.157 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.6506999999999999e-05 2024-04-18T14:44:26.157 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:26.157 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:26.157 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_committed", 2024-04-18T14:44:26.157 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:21.505629+0000", 2024-04-18T14:44:26.157 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0081435970000000007 2024-04-18T14:44:26.157 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:26.157 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:26.157 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-04-18T14:44:26.157 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:21.505677+0000", 2024-04-18T14:44:26.158 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4.795e-05 2024-04-18T14:44:26.158 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:44:26.158 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-04-18T14:44:26.158 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:44:26.158 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:44:26.158 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-04-18T14:44:26.158 INFO:teuthology.orchestra.run.smithi119.stdout:} 2024-04-18T14:44:26.160 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.10.asok dump_ops_in_flight 2024-04-18T14:44:26.160 INFO:tasks.ceph.osd.10.smithi119.stderr:2024-04-18T14:44:26.162+0000 7f6f24c12640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 10 (PID: 24898) UID: 0 2024-04-18T14:44:26.260 INFO:tasks.ceph.osd.14.smithi119.stderr:2024-04-18T14:44:26.262+0000 7f180f599640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 14 (PID: 24900) UID: 0 2024-04-18T14:44:26.330 INFO:teuthology.orchestra.run.smithi119.stdout:{ 2024-04-18T14:44:26.330 INFO:teuthology.orchestra.run.smithi119.stdout: "ops": [], 2024-04-18T14:44:26.330 INFO:teuthology.orchestra.run.smithi119.stdout: "num_ops": 0 2024-04-18T14:44:26.330 INFO:teuthology.orchestra.run.smithi119.stdout:} 2024-04-18T14:44:26.345 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.10.asok dump_blocked_ops 2024-04-18T14:44:26.361 INFO:tasks.ceph.osd.15.smithi134.stderr:2024-04-18T14:44:26.364+0000 7f08e6a51640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 15 (PID: 25218) UID: 0 2024-04-18T14:44:26.423 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-04-18T14:44:26.461 INFO:tasks.ceph.osd.10.smithi119.stderr:2024-04-18T14:44:26.462+0000 7f6f24c12640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 10 (PID: 24898) UID: 0 2024-04-18T14:44:26.478 INFO:tasks.rados.rados.0.smithi134.stdout:385: done (4 left) 2024-04-18T14:44:26.478 INFO:tasks.rados.rados.0.smithi134.stdout:386: done (3 left) 2024-04-18T14:44:26.478 INFO:tasks.rados.rados.0.smithi134.stdout:387: done (2 left) 2024-04-18T14:44:26.478 INFO:tasks.rados.rados.0.smithi134.stdout:388: done (1 left) 2024-04-18T14:44:26.478 INFO:tasks.rados.rados.0.smithi134.stdout:389: done (0 left) 2024-04-18T14:44:26.478 INFO:tasks.rados.rados.0.smithi134.stdout:390: setattr oid 42 current snap is 35 2024-04-18T14:44:26.483 INFO:tasks.rados.rados.0.smithi134.stdout:391: setattr oid 24 current snap is 35 2024-04-18T14:44:26.490 INFO:tasks.rados.rados.0.smithi134.stdout:append oid 44 current snap is 35 2024-04-18T14:44:26.490 INFO:tasks.rados.rados.0.smithi134.stdout:392: seq_num 150 ranges {6815744=114688} 2024-04-18T14:44:26.510 INFO:teuthology.orchestra.run.smithi119.stdout:{ 2024-04-18T14:44:26.510 INFO:teuthology.orchestra.run.smithi119.stdout: "ops": [], 2024-04-18T14:44:26.510 INFO:teuthology.orchestra.run.smithi119.stdout: "complaint_time": 30, 2024-04-18T14:44:26.510 INFO:teuthology.orchestra.run.smithi119.stdout: "num_blocked_ops": 0 2024-04-18T14:44:26.510 INFO:teuthology.orchestra.run.smithi119.stdout:} 2024-04-18T14:44:26.524 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.10.asok dump_historic_ops 2024-04-18T14:44:26.562 INFO:tasks.ceph.osd.15.smithi134.stderr:2024-04-18T14:44:26.567+0000 7f08e6a51640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 15 (PID: 25218) UID: 0 2024-04-18T14:44:26.568 INFO:tasks.rados.rados.0.smithi134.stdout:392: writing smithi13430248-44 from 6815744 to 6930432 tid 1 2024-04-18T14:44:26.568 INFO:tasks.rados.rados.0.smithi134.stdout:393: snap_create 2024-04-18T14:44:26.568 INFO:tasks.rados.rados.0.smithi134.stdout:update_object_version oid 42 v 96 (ObjNum 141 snap 32 seq_num 141) dirty exists 2024-04-18T14:44:26.568 INFO:tasks.rados.rados.0.smithi134.stdout:update_object_version oid 24 v 114 (ObjNum 111 snap 23 seq_num 111) dirty exists 2024-04-18T14:44:26.578 INFO:tasks.rados.rados.0.smithi134.stdout:392: finishing write tid 1 to smithi13430248-44 2024-04-18T14:44:26.579 INFO:tasks.rados.rados.0.smithi134.stdout:392: finishing write tid 2 to smithi13430248-44 2024-04-18T14:44:26.583 INFO:tasks.rados.rados.0.smithi134.stdout:392: finishing write tid 3 to smithi13430248-44 2024-04-18T14:44:26.583 INFO:tasks.rados.rados.0.smithi134.stdout:392: oid 44 updating version 0 to 67 2024-04-18T14:44:26.583 INFO:tasks.rados.rados.0.smithi134.stdout:392: oid 44 version 67 is already newer than 66 2024-04-18T14:44:26.584 INFO:tasks.rados.rados.0.smithi134.stdout:update_object_version oid 44 v 67 (ObjNum 150 snap 35 seq_num 150) dirty exists 2024-04-18T14:44:26.584 INFO:tasks.rados.rados.0.smithi134.stdout:392: left oid 44 (ObjNum 150 snap 35 seq_num 150) 2024-04-18T14:44:26.664 INFO:tasks.ceph.osd.11.smithi134.stderr:2024-04-18T14:44:26.667+0000 7f2d36f12640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 11 (PID: 25216) UID: 0 2024-04-18T14:44:26.693 INFO:teuthology.orchestra.run.smithi119.stdout:{ 2024-04-18T14:44:26.693 INFO:teuthology.orchestra.run.smithi119.stdout: "size": 20, 2024-04-18T14:44:26.693 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 600, 2024-04-18T14:44:26.693 INFO:teuthology.orchestra.run.smithi119.stdout: "ops": [ 2024-04-18T14:44:26.693 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:26.693 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(client.4559.0:500 3.bs0 3:dcadfff4:::smithi13430248-18:head [copy-from ver 46] snapc 19=[19,16,14,13,11,f,b,a,7,2] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-18T14:44:26.693 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-04-18T14:43:56.549171+0000", 2024-04-18T14:44:26.693 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 30.143794725999999, 2024-04-18T14:44:26.694 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.029487076000000001, 2024-04-18T14:44:26.694 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-04-18T14:44:26.694 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T14:44:26.694 INFO:teuthology.orchestra.run.smithi119.stdout: "client_info": { 2024-04-18T14:44:26.694 INFO:teuthology.orchestra.run.smithi119.stdout: "client": "client.4559", 2024-04-18T14:44:26.694 INFO:teuthology.orchestra.run.smithi119.stdout: "client_addr": "172.21.15.134:0/3113589487", 2024-04-18T14:44:26.694 INFO:teuthology.orchestra.run.smithi119.stdout: "tid": 500 2024-04-18T14:44:26.694 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:26.694 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-04-18T14:44:26.694 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:26.694 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-04-18T14:44:26.694 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:56.549171+0000", 2024-04-18T14:44:26.695 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:44:26.695 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:26.695 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:26.695 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-04-18T14:44:26.695 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:56.549171+0000", 2024-04-18T14:44:26.695 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:44:26.695 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:26.695 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:26.695 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-04-18T14:44:26.695 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:56.549165+0000", 2024-04-18T14:44:26.695 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4294967295.9999948 2024-04-18T14:44:26.695 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:26.695 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:26.695 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-04-18T14:44:26.695 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:56.549189+0000", 2024-04-18T14:44:26.696 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.3450000000000001e-05 2024-04-18T14:44:26.696 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:26.696 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:26.696 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-04-18T14:44:26.696 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:56.549237+0000", 2024-04-18T14:44:26.696 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4.7843999999999998e-05 2024-04-18T14:44:26.696 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:26.696 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:26.696 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-04-18T14:44:26.696 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:56.549262+0000", 2024-04-18T14:44:26.696 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.5596999999999999e-05 2024-04-18T14:44:26.696 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:26.697 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:26.697 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-04-18T14:44:26.697 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:56.549423+0000", 2024-04-18T14:44:26.697 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00016087799999999999 2024-04-18T14:44:26.697 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:26.697 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:26.697 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-04-18T14:44:26.697 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:56.549715+0000", 2024-04-18T14:44:26.697 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00029231599999999998 2024-04-18T14:44:26.697 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:26.697 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:26.697 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_started", 2024-04-18T14:44:26.697 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:56.571279+0000", 2024-04-18T14:44:26.697 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.021564102000000002 2024-04-18T14:44:26.697 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:26.698 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:26.698 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_committed", 2024-04-18T14:44:26.698 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:56.575627+0000", 2024-04-18T14:44:26.698 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0043473380000000001 2024-04-18T14:44:26.698 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:26.698 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:26.698 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-04-18T14:44:26.699 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:56.578450+0000", 2024-04-18T14:44:26.699 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0028231189999999998 2024-04-18T14:44:26.699 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:26.699 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:26.699 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-04-18T14:44:26.699 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:56.578658+0000", 2024-04-18T14:44:26.699 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000207715 2024-04-18T14:44:26.699 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:44:26.699 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-04-18T14:44:26.699 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:44:26.699 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:26.699 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:26.700 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(client.4559.0:501 3.bs0 3:dcadfff4:::smithi13430248-18:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e57)", 2024-04-18T14:44:26.700 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-04-18T14:43:56.549295+0000", 2024-04-18T14:44:26.700 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 30.143670572000001, 2024-04-18T14:44:26.700 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.025687614000000001, 2024-04-18T14:44:26.700 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-04-18T14:44:26.700 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "started", 2024-04-18T14:44:26.700 INFO:teuthology.orchestra.run.smithi119.stdout: "client_info": { 2024-04-18T14:44:26.700 INFO:teuthology.orchestra.run.smithi119.stdout: "client": "client.4559", 2024-04-18T14:44:26.700 INFO:teuthology.orchestra.run.smithi119.stdout: "client_addr": "172.21.15.134:0/3113589487", 2024-04-18T14:44:26.700 INFO:teuthology.orchestra.run.smithi119.stdout: "tid": 501 2024-04-18T14:44:26.700 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:26.700 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-04-18T14:44:26.700 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:26.700 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-04-18T14:44:26.700 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:56.549295+0000", 2024-04-18T14:44:26.701 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:44:26.701 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:26.701 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:26.701 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-04-18T14:44:26.701 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:56.549295+0000", 2024-04-18T14:44:26.701 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:44:26.701 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:26.701 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:26.701 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-04-18T14:44:26.701 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:56.549293+0000", 2024-04-18T14:44:26.701 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4294967295.9999981 2024-04-18T14:44:26.701 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:26.701 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:26.701 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-04-18T14:44:26.701 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:56.549304+0000", 2024-04-18T14:44:26.702 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.1324e-05 2024-04-18T14:44:26.702 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:26.702 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:26.702 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-04-18T14:44:26.702 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:56.549332+0000", 2024-04-18T14:44:26.702 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.7603999999999999e-05 2024-04-18T14:44:26.702 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:26.702 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:26.702 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-04-18T14:44:26.702 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:56.549353+0000", 2024-04-18T14:44:26.702 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.173e-05 2024-04-18T14:44:26.702 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:26.702 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:26.702 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-04-18T14:44:26.702 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:56.550446+0000", 2024-04-18T14:44:26.703 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0010926569999999999 2024-04-18T14:44:26.703 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:26.703 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:26.703 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for blocked object", 2024-04-18T14:44:26.703 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:56.550593+0000", 2024-04-18T14:44:26.703 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00014672599999999999 2024-04-18T14:44:26.703 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:26.703 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:26.703 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-04-18T14:44:26.703 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:56.574447+0000", 2024-04-18T14:44:26.703 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.023853863999999999 2024-04-18T14:44:26.703 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:26.703 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:26.703 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-04-18T14:44:26.703 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:56.574708+0000", 2024-04-18T14:44:26.704 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00026138300000000001 2024-04-18T14:44:26.704 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:26.704 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:26.704 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-04-18T14:44:26.704 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:56.574982+0000", 2024-04-18T14:44:26.704 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00027428899999999999 2024-04-18T14:44:26.704 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:44:26.704 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-04-18T14:44:26.704 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:44:26.704 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:26.704 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:26.704 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(client.4559.0:752 3.bs0 3:dcadfff4:::smithi13430248-18:head [read 0~753664,checksum,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e72)", 2024-04-18T14:44:26.704 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-04-18T14:44:11.772183+0000", 2024-04-18T14:44:26.704 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 14.920782698, 2024-04-18T14:44:26.704 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.021279604000000001, 2024-04-18T14:44:26.705 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-04-18T14:44:26.705 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "started", 2024-04-18T14:44:26.705 INFO:teuthology.orchestra.run.smithi119.stdout: "client_info": { 2024-04-18T14:44:26.705 INFO:teuthology.orchestra.run.smithi119.stdout: "client": "client.4559", 2024-04-18T14:44:26.705 INFO:teuthology.orchestra.run.smithi119.stdout: "client_addr": "172.21.15.134:0/3113589487", 2024-04-18T14:44:26.705 INFO:teuthology.orchestra.run.smithi119.stdout: "tid": 752 2024-04-18T14:44:26.705 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:26.705 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-04-18T14:44:26.705 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:26.705 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-04-18T14:44:26.705 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:11.772183+0000", 2024-04-18T14:44:26.705 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:44:26.705 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:26.705 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:26.705 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-04-18T14:44:26.706 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:11.772183+0000", 2024-04-18T14:44:26.706 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:44:26.706 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:26.706 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:26.706 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-04-18T14:44:26.706 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:11.772179+0000", 2024-04-18T14:44:26.706 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4294967295.9999967 2024-04-18T14:44:26.706 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:26.706 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:26.706 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-04-18T14:44:26.706 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:11.772196+0000", 2024-04-18T14:44:26.706 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.6235999999999998e-05 2024-04-18T14:44:26.706 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:26.706 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:26.706 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-04-18T14:44:26.707 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:11.772231+0000", 2024-04-18T14:44:26.707 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.5389999999999998e-05 2024-04-18T14:44:26.707 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:26.707 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:26.707 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-04-18T14:44:26.707 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:11.772251+0000", 2024-04-18T14:44:26.707 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.997e-05 2024-04-18T14:44:26.707 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:26.707 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:26.707 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-04-18T14:44:26.707 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:11.772451+0000", 2024-04-18T14:44:26.707 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00019971499999999999 2024-04-18T14:44:26.707 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:26.707 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:26.708 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-04-18T14:44:26.708 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:11.773123+0000", 2024-04-18T14:44:26.708 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000672698 2024-04-18T14:44:26.708 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:26.708 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:26.708 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-04-18T14:44:26.708 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:11.793462+0000", 2024-04-18T14:44:26.708 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.020338878000000001 2024-04-18T14:44:26.708 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:44:26.708 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-04-18T14:44:26.708 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:44:26.708 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:26.708 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:26.708 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(client.4559.0:753 3.bs0 3:dcadfff4:::smithi13430248-18:head [read 0~753664,checksum] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e72)", 2024-04-18T14:44:26.709 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-04-18T14:44:11.772288+0000", 2024-04-18T14:44:26.709 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 14.920676931999999, 2024-04-18T14:44:26.709 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.022514890999999999, 2024-04-18T14:44:26.709 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-04-18T14:44:26.709 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "started", 2024-04-18T14:44:26.709 INFO:teuthology.orchestra.run.smithi119.stdout: "client_info": { 2024-04-18T14:44:26.709 INFO:teuthology.orchestra.run.smithi119.stdout: "client": "client.4559", 2024-04-18T14:44:26.710 INFO:teuthology.orchestra.run.smithi119.stdout: "client_addr": "172.21.15.134:0/3113589487", 2024-04-18T14:44:26.710 INFO:teuthology.orchestra.run.smithi119.stdout: "tid": 753 2024-04-18T14:44:26.710 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:26.710 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-04-18T14:44:26.710 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:26.710 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-04-18T14:44:26.710 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:11.772288+0000", 2024-04-18T14:44:26.710 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:44:26.710 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:26.710 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:26.710 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-04-18T14:44:26.710 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:11.772288+0000", 2024-04-18T14:44:26.710 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:44:26.710 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:26.710 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:26.711 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-04-18T14:44:26.711 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:11.772287+0000", 2024-04-18T14:44:26.711 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4294967295.9999986 2024-04-18T14:44:26.711 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:26.711 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:26.711 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-04-18T14:44:26.711 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:11.772296+0000", 2024-04-18T14:44:26.711 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 9.4460000000000007e-06 2024-04-18T14:44:26.711 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:26.711 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:26.711 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-04-18T14:44:26.711 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:11.772315+0000", 2024-04-18T14:44:26.711 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.9046999999999999e-05 2024-04-18T14:44:26.711 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:26.711 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:26.712 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-04-18T14:44:26.712 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:11.772331+0000", 2024-04-18T14:44:26.712 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.5017e-05 2024-04-18T14:44:26.712 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:26.712 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:26.712 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-04-18T14:44:26.712 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:11.774017+0000", 2024-04-18T14:44:26.712 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.001686833 2024-04-18T14:44:26.712 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:26.712 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:26.712 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-04-18T14:44:26.712 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:11.774237+0000", 2024-04-18T14:44:26.712 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000219325 2024-04-18T14:44:26.712 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:26.712 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:26.713 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-04-18T14:44:26.713 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:11.794803+0000", 2024-04-18T14:44:26.713 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.020566563 2024-04-18T14:44:26.713 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:44:26.713 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-04-18T14:44:26.713 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:44:26.713 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:26.713 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:26.713 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(client.4559.0:754 3.bs0 3:dcadfff4:::smithi13430248-18:head [read 0~753664,checksum] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e72)", 2024-04-18T14:44:26.713 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-04-18T14:44:11.772343+0000", 2024-04-18T14:44:26.713 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 14.920622165999999, 2024-04-18T14:44:26.713 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.023843545000000001, 2024-04-18T14:44:26.713 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-04-18T14:44:26.713 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "started", 2024-04-18T14:44:26.713 INFO:teuthology.orchestra.run.smithi119.stdout: "client_info": { 2024-04-18T14:44:26.714 INFO:teuthology.orchestra.run.smithi119.stdout: "client": "client.4559", 2024-04-18T14:44:26.714 INFO:teuthology.orchestra.run.smithi119.stdout: "client_addr": "172.21.15.134:0/3113589487", 2024-04-18T14:44:26.714 INFO:teuthology.orchestra.run.smithi119.stdout: "tid": 754 2024-04-18T14:44:26.714 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:26.714 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-04-18T14:44:26.714 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:26.714 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-04-18T14:44:26.714 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:11.772343+0000", 2024-04-18T14:44:26.714 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:44:26.714 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:26.714 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:26.714 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-04-18T14:44:26.714 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:11.772343+0000", 2024-04-18T14:44:26.714 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:44:26.714 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:26.715 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:26.715 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-04-18T14:44:26.715 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:11.772342+0000", 2024-04-18T14:44:26.715 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4294967295.9999986 2024-04-18T14:44:26.715 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:26.715 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:26.715 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-04-18T14:44:26.715 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:11.772350+0000", 2024-04-18T14:44:26.715 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 8.3329999999999997e-06 2024-04-18T14:44:26.715 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:26.715 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:26.715 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-04-18T14:44:26.715 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:11.772372+0000", 2024-04-18T14:44:26.716 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.1719999999999999e-05 2024-04-18T14:44:26.716 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:26.716 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:26.716 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-04-18T14:44:26.716 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:11.772391+0000", 2024-04-18T14:44:26.716 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.931e-05 2024-04-18T14:44:26.716 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:26.716 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:26.716 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-04-18T14:44:26.716 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:11.775073+0000", 2024-04-18T14:44:26.716 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.002681269 2024-04-18T14:44:26.716 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:26.716 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:26.716 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-04-18T14:44:26.716 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:11.775319+0000", 2024-04-18T14:44:26.717 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00024685499999999998 2024-04-18T14:44:26.717 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:26.717 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:26.717 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-04-18T14:44:26.717 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:11.796187+0000", 2024-04-18T14:44:26.717 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.020867281000000001 2024-04-18T14:44:26.717 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:44:26.717 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-04-18T14:44:26.717 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:44:26.717 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:26.717 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:26.717 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "MOSDECSubOpWrite(3.cs1 72/30 ECSubWrite(tid=194, reqid=client.4559.0:745, at_version=72'127, trim_to=0'0, roll_forward_to=71'122))", 2024-04-18T14:44:26.717 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-04-18T14:44:11.772576+0000", 2024-04-18T14:44:26.717 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 14.920389728, 2024-04-18T14:44:26.717 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.021027814999999998, 2024-04-18T14:44:26.717 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-04-18T14:44:26.718 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "reached pg", 2024-04-18T14:44:26.718 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-04-18T14:44:26.718 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:26.718 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-04-18T14:44:26.718 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:11.772576+0000", 2024-04-18T14:44:26.718 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:44:26.718 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:26.718 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:26.718 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-04-18T14:44:26.718 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:11.772576+0000", 2024-04-18T14:44:26.718 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:44:26.718 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:26.718 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:26.718 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-04-18T14:44:26.719 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:11.772574+0000", 2024-04-18T14:44:26.719 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4294967295.999999 2024-04-18T14:44:26.719 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:26.719 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:26.719 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-04-18T14:44:26.719 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:11.773149+0000", 2024-04-18T14:44:26.719 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000574959 2024-04-18T14:44:26.719 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:26.719 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:26.719 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-04-18T14:44:26.719 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:11.773179+0000", 2024-04-18T14:44:26.719 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.9706999999999999e-05 2024-04-18T14:44:26.719 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:26.719 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:26.719 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-04-18T14:44:26.719 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:11.773211+0000", 2024-04-18T14:44:26.720 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.1872999999999998e-05 2024-04-18T14:44:26.720 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:26.720 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:26.720 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-04-18T14:44:26.720 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:11.776258+0000", 2024-04-18T14:44:26.720 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0030471930000000001 2024-04-18T14:44:26.720 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:26.720 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:26.720 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_started", 2024-04-18T14:44:26.720 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:11.776283+0000", 2024-04-18T14:44:26.720 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.51e-05 2024-04-18T14:44:26.720 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:26.720 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:26.720 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_committed", 2024-04-18T14:44:26.720 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:11.792869+0000", 2024-04-18T14:44:26.720 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.016585842999999999 2024-04-18T14:44:26.721 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:26.721 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:26.721 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-04-18T14:44:26.721 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:11.793603+0000", 2024-04-18T14:44:26.721 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00073426000000000003 2024-04-18T14:44:26.721 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:44:26.721 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-04-18T14:44:26.721 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:44:26.721 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:26.721 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:26.721 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(client.4559.0:831 3.bs0 3:db6a9fd1:::smithi13430248-42:head [append 0~0] snapc 2c=[2c,2b,2a,29,28,27,26,23,22,1e,1c,1a,16,14,13,11,2] ondisk+write+known_if_redirected+supports_pool_eio e77)", 2024-04-18T14:44:26.721 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-04-18T14:44:16.418076+0000", 2024-04-18T14:44:26.721 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 10.274889643, 2024-04-18T14:44:26.721 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.024189622000000001, 2024-04-18T14:44:26.721 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-04-18T14:44:26.722 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T14:44:26.722 INFO:teuthology.orchestra.run.smithi119.stdout: "client_info": { 2024-04-18T14:44:26.722 INFO:teuthology.orchestra.run.smithi119.stdout: "client": "client.4559", 2024-04-18T14:44:26.722 INFO:teuthology.orchestra.run.smithi119.stdout: "client_addr": "172.21.15.134:0/3113589487", 2024-04-18T14:44:26.722 INFO:teuthology.orchestra.run.smithi119.stdout: "tid": 831 2024-04-18T14:44:26.722 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:26.722 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-04-18T14:44:26.722 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:26.722 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-04-18T14:44:26.722 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:16.418076+0000", 2024-04-18T14:44:26.722 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:44:26.722 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:26.722 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:26.722 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-04-18T14:44:26.722 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:16.418076+0000", 2024-04-18T14:44:26.723 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:44:26.723 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:26.723 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:26.723 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-04-18T14:44:26.723 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:16.418073+0000", 2024-04-18T14:44:26.723 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4294967295.9999971 2024-04-18T14:44:26.723 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:26.723 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:26.723 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-04-18T14:44:26.723 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:16.418086+0000", 2024-04-18T14:44:26.723 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.3434e-05 2024-04-18T14:44:26.723 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:26.723 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:26.723 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-04-18T14:44:26.723 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:16.418120+0000", 2024-04-18T14:44:26.724 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.3915999999999999e-05 2024-04-18T14:44:26.724 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:26.724 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:26.724 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-04-18T14:44:26.724 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:16.418136+0000", 2024-04-18T14:44:26.724 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.5733999999999999e-05 2024-04-18T14:44:26.724 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:26.724 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:26.724 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-04-18T14:44:26.724 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:16.418282+0000", 2024-04-18T14:44:26.724 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00014630200000000001 2024-04-18T14:44:26.724 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:26.724 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:26.724 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "op must wait for map", 2024-04-18T14:44:26.724 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:16.418302+0000", 2024-04-18T14:44:26.724 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.999e-05 2024-04-18T14:44:26.725 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:26.725 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:26.725 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-04-18T14:44:26.725 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:16.422082+0000", 2024-04-18T14:44:26.725 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0037797030000000001 2024-04-18T14:44:26.725 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:26.725 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:26.725 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-04-18T14:44:26.725 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:16.422343+0000", 2024-04-18T14:44:26.725 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00026110199999999998 2024-04-18T14:44:26.725 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:26.725 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:26.725 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_started", 2024-04-18T14:44:26.725 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:16.424455+0000", 2024-04-18T14:44:26.725 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0021116469999999999 2024-04-18T14:44:26.725 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:26.726 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:26.726 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_committed", 2024-04-18T14:44:26.726 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:16.431693+0000", 2024-04-18T14:44:26.726 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0072383179999999997 2024-04-18T14:44:26.726 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:26.726 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:26.726 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-04-18T14:44:26.726 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:16.442153+0000", 2024-04-18T14:44:26.726 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.010459883 2024-04-18T14:44:26.726 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:26.726 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:26.726 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-04-18T14:44:26.726 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:16.442265+0000", 2024-04-18T14:44:26.726 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000112423 2024-04-18T14:44:26.726 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:44:26.727 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-04-18T14:44:26.727 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:44:26.727 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:26.727 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:26.727 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(client.4559.0:832 3.bs0 3:db6a9fd1:::smithi13430248-42:head [rollback 28] snapc 2c=[2c,2b,2a,29,28,27,26,23,22,1e,1c,1a,16,14,13,11,2] ondisk+write+known_if_redirected+supports_pool_eio e77)", 2024-04-18T14:44:26.727 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-04-18T14:44:16.418165+0000", 2024-04-18T14:44:26.727 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 10.274800215999999, 2024-04-18T14:44:26.727 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.025706539, 2024-04-18T14:44:26.727 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-04-18T14:44:26.727 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T14:44:26.727 INFO:teuthology.orchestra.run.smithi119.stdout: "client_info": { 2024-04-18T14:44:26.727 INFO:teuthology.orchestra.run.smithi119.stdout: "client": "client.4559", 2024-04-18T14:44:26.727 INFO:teuthology.orchestra.run.smithi119.stdout: "client_addr": "172.21.15.134:0/3113589487", 2024-04-18T14:44:26.727 INFO:teuthology.orchestra.run.smithi119.stdout: "tid": 832 2024-04-18T14:44:26.727 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:26.727 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-04-18T14:44:26.728 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:26.728 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-04-18T14:44:26.728 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:16.418165+0000", 2024-04-18T14:44:26.728 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:44:26.728 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:26.728 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:26.728 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-04-18T14:44:26.728 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:16.418165+0000", 2024-04-18T14:44:26.728 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:44:26.728 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:26.728 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:26.728 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-04-18T14:44:26.728 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:16.418164+0000", 2024-04-18T14:44:26.728 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4294967295.9999986 2024-04-18T14:44:26.728 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:26.728 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:26.729 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-04-18T14:44:26.729 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:16.418171+0000", 2024-04-18T14:44:26.729 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 7.7030000000000006e-06 2024-04-18T14:44:26.729 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:26.729 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:26.729 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-04-18T14:44:26.729 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:16.418187+0000", 2024-04-18T14:44:26.729 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.5196e-05 2024-04-18T14:44:26.729 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:26.729 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:26.729 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-04-18T14:44:26.729 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:16.418201+0000", 2024-04-18T14:44:26.729 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.4426999999999999e-05 2024-04-18T14:44:26.729 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:26.729 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:26.729 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-04-18T14:44:26.730 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:16.418471+0000", 2024-04-18T14:44:26.730 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00026968100000000002 2024-04-18T14:44:26.730 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:26.730 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:26.730 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting_for_map not empty", 2024-04-18T14:44:26.730 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:16.418485+0000", 2024-04-18T14:44:26.730 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.384e-05 2024-04-18T14:44:26.730 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:26.730 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:26.730 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-04-18T14:44:26.730 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:16.426026+0000", 2024-04-18T14:44:26.730 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0075412420000000001 2024-04-18T14:44:26.730 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:26.730 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:26.730 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-04-18T14:44:26.731 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:16.426292+0000", 2024-04-18T14:44:26.731 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00026580799999999997 2024-04-18T14:44:26.731 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:26.731 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:26.731 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_started", 2024-04-18T14:44:26.731 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:16.427736+0000", 2024-04-18T14:44:26.731 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.001444299 2024-04-18T14:44:26.731 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:26.731 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:26.731 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_committed", 2024-04-18T14:44:26.731 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:16.443413+0000", 2024-04-18T14:44:26.731 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.015677023000000002 2024-04-18T14:44:26.731 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:26.731 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:26.731 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-04-18T14:44:26.731 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:16.443667+0000", 2024-04-18T14:44:26.732 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00025423200000000001 2024-04-18T14:44:26.732 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:26.732 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:26.732 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-04-18T14:44:26.732 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:16.443872+0000", 2024-04-18T14:44:26.732 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00020442799999999999 2024-04-18T14:44:26.732 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:44:26.732 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-04-18T14:44:26.732 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:44:26.732 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:26.732 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:26.732 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(client.4559.0:833 3.bs0 3:db6a9fd1:::smithi13430248-42:head [append 0~0] snapc 2c=[2c,2b,2a,29,28,27,26,23,22,1e,1c,1a,16,14,13,11,2] ondisk+write+known_if_redirected+supports_pool_eio e77)", 2024-04-18T14:44:26.732 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-04-18T14:44:16.418211+0000", 2024-04-18T14:44:26.732 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 10.274754550000001, 2024-04-18T14:44:26.732 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.028839912999999998, 2024-04-18T14:44:26.733 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-04-18T14:44:26.733 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T14:44:26.733 INFO:teuthology.orchestra.run.smithi119.stdout: "client_info": { 2024-04-18T14:44:26.733 INFO:teuthology.orchestra.run.smithi119.stdout: "client": "client.4559", 2024-04-18T14:44:26.733 INFO:teuthology.orchestra.run.smithi119.stdout: "client_addr": "172.21.15.134:0/3113589487", 2024-04-18T14:44:26.733 INFO:teuthology.orchestra.run.smithi119.stdout: "tid": 833 2024-04-18T14:44:26.733 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:26.733 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-04-18T14:44:26.733 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:26.733 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-04-18T14:44:26.733 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:16.418211+0000", 2024-04-18T14:44:26.733 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:44:26.733 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:26.733 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:26.733 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-04-18T14:44:26.734 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:16.418211+0000", 2024-04-18T14:44:26.734 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:44:26.734 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:26.734 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:26.734 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-04-18T14:44:26.734 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:16.418210+0000", 2024-04-18T14:44:26.734 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4294967295.999999 2024-04-18T14:44:26.734 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:26.734 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:26.734 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-04-18T14:44:26.734 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:16.418214+0000", 2024-04-18T14:44:26.734 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4.2069999999999997e-06 2024-04-18T14:44:26.734 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:26.734 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:26.734 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-04-18T14:44:26.735 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:16.418224+0000", 2024-04-18T14:44:26.735 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.0293e-05 2024-04-18T14:44:26.735 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:26.735 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:26.735 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-04-18T14:44:26.735 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:16.418236+0000", 2024-04-18T14:44:26.735 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.2013e-05 2024-04-18T14:44:26.735 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:26.735 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:26.735 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-04-18T14:44:26.735 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:16.418552+0000", 2024-04-18T14:44:26.735 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000315588 2024-04-18T14:44:26.735 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:26.735 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:26.735 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting_for_map not empty", 2024-04-18T14:44:26.736 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:16.418570+0000", 2024-04-18T14:44:26.736 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.7433000000000001e-05 2024-04-18T14:44:26.736 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:26.736 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:26.736 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-04-18T14:44:26.736 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:16.429228+0000", 2024-04-18T14:44:26.736 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.010658288 2024-04-18T14:44:26.736 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:26.736 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:26.736 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-04-18T14:44:26.736 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:16.429554+0000", 2024-04-18T14:44:26.737 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00032638799999999999 2024-04-18T14:44:26.737 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:26.737 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:26.737 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_started", 2024-04-18T14:44:26.737 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:16.430966+0000", 2024-04-18T14:44:26.737 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.001412155 2024-04-18T14:44:26.737 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:26.737 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:26.737 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_committed", 2024-04-18T14:44:26.737 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:16.443877+0000", 2024-04-18T14:44:26.737 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.012910585 2024-04-18T14:44:26.737 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:26.737 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:26.737 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-04-18T14:44:26.738 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:16.446997+0000", 2024-04-18T14:44:26.738 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0031195820000000001 2024-04-18T14:44:26.738 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:26.738 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:26.738 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-04-18T14:44:26.738 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:16.447051+0000", 2024-04-18T14:44:26.738 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 5.4128000000000001e-05 2024-04-18T14:44:26.738 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:44:26.738 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-04-18T14:44:26.738 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:44:26.738 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:26.738 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:26.738 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(client.4559.0:834 3.bs0 3:dcadfff4:::smithi13430248-18:head [create,setxattr dNUsaqXQnmoOacjgaaZfpahc]PsY[[^jr[mfmShe (1753) in=40b,setxattr UhZXihfNoSgtoiajmXpdpaatOO_osfRPX]dfPcbj (1402) in=40b,setxattr \\]laRbmfn\\dk`\\esn[fNmaPr^korOVtUiYPdahRO (12280) in=40b,setxattr Vagm[`fihbagdtlVtrbSm]^UoTXcPjQON\\rSgXk^ (979) in=40b,setxattr goVsYZbWtTdeOQVYnZPir\\hbhdQQajY[_V_XY[ol (15156) in=40b,setxattr ^c[^YW[aiRgh_`]YSgkatVaPRsZZsQdPrqWZbctd (1191) in=40b,setxattr OgdPUPaadgRTklVNW\\ogXRZ[p_jflTY\\Oimbb_TN (595) in=40b,setxattr []r[RfRaVkcRbmh[h[l^iPW[kT[Q\\mlR[pXOY\\]d (1399) in=40b,setxattr gYa_dgO]sWfWqTa[Pstqs`^]R_kq[q]\\r[cNeQhR (17824) in=40b,setxattr NaZYi]WN`_aO]rpafNNQgtqOXsZYVjTkRan_`jhq (1333) in=40b,setxattr UoOYda]]SYP[a_osbqNpe\\PXY`s_pT\\Zb_YmZh^a (1017) in=40b,setxattr aOmWhkZlNadlRZr]clkQ[nPOcakj]ejj_et\\j`dm (945) in=40b,setxattr emoSeZoh`tmrohOV\\nrt`[NbrgqWQdikW__ra (1717) in=37b,setxattr YfiZnafesiPTPntWensjSZSYUY]eY\\Xobt[aTjdS (978) in=40b,setxattr dgRdPcRUjonWQreiRQqlaYaX (1717) in=24b,setxattr UinOTnqZY`TacOnrakRl\\aY[sPrekhSNja]`oOX] (1649) in=40b,setxattr ]shh]XhSNhQapVgamYTN_knqlafT_PZ_gbh`gWhO (665) in=40b,setxattr QUfYSW`]^\\shZbnXROkUd^aYkerpSdRcncs]lknd (10104) in=40b,setxattr Nj\\geYaQaNsp`grl]adTQ[\\^WtoTgNSgjO\\ZPh^[ (1085) in=40b,setxattr ecNccamVWSj\\QcohQskdjYs`OZV\\XgQXdtfVlbgZ (1049) in=40b] snapc 2c=[2c,2b,2a,29,28,27,26,23,22,1e,1c,1a,16,14,13,11,2] ondisk+write+known_if_redirected+supports_pool_eio e77)", 2024-04-18T14:44:26.739 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-04-18T14:44:16.419827+0000", 2024-04-18T14:44:26.739 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 10.273138742, 2024-04-18T14:44:26.739 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.032986371, 2024-04-18T14:44:26.739 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-04-18T14:44:26.739 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T14:44:26.739 INFO:teuthology.orchestra.run.smithi119.stdout: "client_info": { 2024-04-18T14:44:26.739 INFO:teuthology.orchestra.run.smithi119.stdout: "client": "client.4559", 2024-04-18T14:44:26.739 INFO:teuthology.orchestra.run.smithi119.stdout: "client_addr": "172.21.15.134:0/3113589487", 2024-04-18T14:44:26.739 INFO:teuthology.orchestra.run.smithi119.stdout: "tid": 834 2024-04-18T14:44:26.739 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:26.739 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-04-18T14:44:26.739 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:26.739 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-04-18T14:44:26.739 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:16.419827+0000", 2024-04-18T14:44:26.739 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:44:26.740 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:26.740 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:26.740 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-04-18T14:44:26.740 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:16.419827+0000", 2024-04-18T14:44:26.740 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:44:26.740 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:26.740 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:26.740 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-04-18T14:44:26.740 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:16.419824+0000", 2024-04-18T14:44:26.740 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4294967295.9999976 2024-04-18T14:44:26.740 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:26.740 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:26.740 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-04-18T14:44:26.740 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:16.420266+0000", 2024-04-18T14:44:26.740 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00044168899999999999 2024-04-18T14:44:26.740 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:26.741 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:26.741 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-04-18T14:44:26.741 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:16.420298+0000", 2024-04-18T14:44:26.741 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.2286999999999998e-05 2024-04-18T14:44:26.741 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:26.741 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:26.741 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-04-18T14:44:26.741 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:16.420318+0000", 2024-04-18T14:44:26.741 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.0203e-05 2024-04-18T14:44:26.741 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:26.741 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:26.741 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-04-18T14:44:26.741 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:16.420431+0000", 2024-04-18T14:44:26.741 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000112546 2024-04-18T14:44:26.741 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:26.742 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:26.742 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting_for_map not empty", 2024-04-18T14:44:26.742 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:16.420441+0000", 2024-04-18T14:44:26.742 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.0053e-05 2024-04-18T14:44:26.742 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:26.742 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:26.742 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-04-18T14:44:26.742 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:16.432273+0000", 2024-04-18T14:44:26.742 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.011832596000000001 2024-04-18T14:44:26.742 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:26.742 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:26.742 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-04-18T14:44:26.742 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:16.432582+0000", 2024-04-18T14:44:26.742 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00030847399999999999 2024-04-18T14:44:26.742 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:26.742 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:26.743 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_started", 2024-04-18T14:44:26.743 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:16.435718+0000", 2024-04-18T14:44:26.743 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0031362130000000001 2024-04-18T14:44:26.743 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:26.743 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:26.743 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_committed", 2024-04-18T14:44:26.743 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:16.446433+0000", 2024-04-18T14:44:26.743 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.010715257000000001 2024-04-18T14:44:26.743 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:26.743 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:26.743 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-04-18T14:44:26.743 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:16.452730+0000", 2024-04-18T14:44:26.743 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0062969710000000002 2024-04-18T14:44:26.743 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:26.743 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:26.744 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-04-18T14:44:26.744 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:16.452813+0000", 2024-04-18T14:44:26.744 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 8.2502000000000004e-05 2024-04-18T14:44:26.744 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:44:26.744 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-04-18T14:44:26.744 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:44:26.744 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:26.744 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:26.744 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "MOSDECSubOpWrite(3.8s1 78/73 ECSubWrite(tid=206, reqid=osd.5.0:206, at_version=78'145, trim_to=0'0, roll_forward_to=78'141))", 2024-04-18T14:44:26.744 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-04-18T14:44:17.438934+0000", 2024-04-18T14:44:26.744 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 9.2540314800000001, 2024-04-18T14:44:26.744 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.025487961999999999, 2024-04-18T14:44:26.744 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-04-18T14:44:26.744 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "reached pg", 2024-04-18T14:44:26.744 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-04-18T14:44:26.744 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:26.745 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-04-18T14:44:26.745 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:17.438934+0000", 2024-04-18T14:44:26.745 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:44:26.745 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:26.745 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:26.745 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-04-18T14:44:26.745 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:17.438934+0000", 2024-04-18T14:44:26.745 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:44:26.745 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:26.745 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:26.745 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-04-18T14:44:26.745 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:17.438933+0000", 2024-04-18T14:44:26.745 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4294967295.999999 2024-04-18T14:44:26.745 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:26.745 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:26.746 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-04-18T14:44:26.746 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:17.438979+0000", 2024-04-18T14:44:26.746 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4.6289999999999999e-05 2024-04-18T14:44:26.746 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:26.746 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:26.746 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-04-18T14:44:26.746 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:17.439001+0000", 2024-04-18T14:44:26.746 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.2232999999999999e-05 2024-04-18T14:44:26.746 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:26.746 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:26.746 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-04-18T14:44:26.746 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:17.439019+0000", 2024-04-18T14:44:26.746 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.7496e-05 2024-04-18T14:44:26.746 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:26.747 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:26.747 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-04-18T14:44:26.747 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:17.450229+0000", 2024-04-18T14:44:26.747 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.011209714000000001 2024-04-18T14:44:26.747 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:26.747 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:26.747 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_started", 2024-04-18T14:44:26.747 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:17.450252+0000", 2024-04-18T14:44:26.747 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.3206000000000001e-05 2024-04-18T14:44:26.747 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:26.747 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:26.747 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_committed", 2024-04-18T14:44:26.747 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:17.464364+0000", 2024-04-18T14:44:26.747 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.014112102 2024-04-18T14:44:26.747 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:26.747 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:26.748 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-04-18T14:44:26.748 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:17.464422+0000", 2024-04-18T14:44:26.748 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 5.7877000000000002e-05 2024-04-18T14:44:26.748 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:44:26.748 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-04-18T14:44:26.748 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:44:26.748 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:26.748 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:26.748 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(client.4559.0:897 3.bs0 3:db6a9fd1:::smithi13430248-42:head [append 0~786432] snapc 30=[30,2c,2b,2a,29,28,27,26,22,1e,1c,1a,14,13,11] ondisk+write+known_if_redirected+supports_pool_eio e81)", 2024-04-18T14:44:26.748 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-04-18T14:44:20.514920+0000", 2024-04-18T14:44:26.748 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 6.1780452549999998, 2024-04-18T14:44:26.748 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.020096586, 2024-04-18T14:44:26.748 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-04-18T14:44:26.748 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T14:44:26.748 INFO:teuthology.orchestra.run.smithi119.stdout: "client_info": { 2024-04-18T14:44:26.749 INFO:teuthology.orchestra.run.smithi119.stdout: "client": "client.4559", 2024-04-18T14:44:26.749 INFO:teuthology.orchestra.run.smithi119.stdout: "client_addr": "172.21.15.134:0/3113589487", 2024-04-18T14:44:26.749 INFO:teuthology.orchestra.run.smithi119.stdout: "tid": 897 2024-04-18T14:44:26.749 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:26.749 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-04-18T14:44:26.749 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:26.749 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-04-18T14:44:26.749 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:20.514920+0000", 2024-04-18T14:44:26.749 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:44:26.749 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:26.749 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:26.749 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-04-18T14:44:26.749 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:20.514920+0000", 2024-04-18T14:44:26.749 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:44:26.749 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:26.750 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:26.750 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-04-18T14:44:26.750 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:20.514917+0000", 2024-04-18T14:44:26.750 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4294967295.9999967 2024-04-18T14:44:26.750 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:26.750 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:26.750 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-04-18T14:44:26.750 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:20.516303+0000", 2024-04-18T14:44:26.750 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.001386609 2024-04-18T14:44:26.750 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:26.750 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:26.750 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-04-18T14:44:26.750 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:20.516337+0000", 2024-04-18T14:44:26.750 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.3896000000000002e-05 2024-04-18T14:44:26.750 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:26.751 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:26.751 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-04-18T14:44:26.751 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:20.516362+0000", 2024-04-18T14:44:26.751 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.5126999999999998e-05 2024-04-18T14:44:26.751 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:26.751 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:26.751 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-04-18T14:44:26.751 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:20.516493+0000", 2024-04-18T14:44:26.751 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00013060200000000001 2024-04-18T14:44:26.751 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:26.751 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:26.751 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-04-18T14:44:26.751 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:20.516851+0000", 2024-04-18T14:44:26.751 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00035834400000000002 2024-04-18T14:44:26.751 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:26.751 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:26.752 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_started", 2024-04-18T14:44:26.752 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:20.519161+0000", 2024-04-18T14:44:26.752 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0023097460000000001 2024-04-18T14:44:26.752 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:26.752 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:26.752 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_committed", 2024-04-18T14:44:26.752 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:20.534286+0000", 2024-04-18T14:44:26.752 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.015125311000000001 2024-04-18T14:44:26.752 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:26.752 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:26.752 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-04-18T14:44:26.752 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:20.534855+0000", 2024-04-18T14:44:26.752 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000568776 2024-04-18T14:44:26.752 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:26.752 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:26.753 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-04-18T14:44:26.753 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:20.535017+0000", 2024-04-18T14:44:26.753 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00016141199999999999 2024-04-18T14:44:26.753 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:44:26.753 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-04-18T14:44:26.753 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:44:26.753 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:26.753 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:26.753 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(client.4559.0:901 3.bs0 3:db6a9fd1:::smithi13430248-42:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e81)", 2024-04-18T14:44:26.753 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-04-18T14:44:20.522015+0000", 2024-04-18T14:44:26.753 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 6.1709502059999997, 2024-04-18T14:44:26.753 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.022857404000000001, 2024-04-18T14:44:26.753 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-04-18T14:44:26.753 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "started", 2024-04-18T14:44:26.753 INFO:teuthology.orchestra.run.smithi119.stdout: "client_info": { 2024-04-18T14:44:26.753 INFO:teuthology.orchestra.run.smithi119.stdout: "client": "client.4559", 2024-04-18T14:44:26.754 INFO:teuthology.orchestra.run.smithi119.stdout: "client_addr": "172.21.15.134:0/3113589487", 2024-04-18T14:44:26.754 INFO:teuthology.orchestra.run.smithi119.stdout: "tid": 901 2024-04-18T14:44:26.754 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:26.754 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-04-18T14:44:26.754 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:26.754 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-04-18T14:44:26.754 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:20.522015+0000", 2024-04-18T14:44:26.754 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:44:26.754 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:26.754 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:26.754 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-04-18T14:44:26.754 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:20.522015+0000", 2024-04-18T14:44:26.754 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:44:26.754 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:26.754 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:26.755 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-04-18T14:44:26.755 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:20.522014+0000", 2024-04-18T14:44:26.755 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4294967295.9999986 2024-04-18T14:44:26.755 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:26.755 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:26.755 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-04-18T14:44:26.755 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:20.522020+0000", 2024-04-18T14:44:26.755 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 6.6429999999999998e-06 2024-04-18T14:44:26.755 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:26.755 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:26.755 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-04-18T14:44:26.755 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:20.522037+0000", 2024-04-18T14:44:26.755 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.6880000000000001e-05 2024-04-18T14:44:26.755 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:26.755 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:26.756 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-04-18T14:44:26.756 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:20.522108+0000", 2024-04-18T14:44:26.756 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 7.0842999999999999e-05 2024-04-18T14:44:26.756 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:26.756 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:26.756 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-04-18T14:44:26.756 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:20.535616+0000", 2024-04-18T14:44:26.756 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.013507823 2024-04-18T14:44:26.756 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:26.756 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:26.756 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for rw locks", 2024-04-18T14:44:26.756 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:20.535748+0000", 2024-04-18T14:44:26.756 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00013224499999999999 2024-04-18T14:44:26.756 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:26.756 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:26.756 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-04-18T14:44:26.757 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:20.542130+0000", 2024-04-18T14:44:26.757 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0063818310000000001 2024-04-18T14:44:26.757 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:26.757 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:26.757 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-04-18T14:44:26.757 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:20.542374+0000", 2024-04-18T14:44:26.757 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00024357 2024-04-18T14:44:26.757 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:26.757 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:26.757 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-04-18T14:44:26.757 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:20.544872+0000", 2024-04-18T14:44:26.757 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0024988390000000001 2024-04-18T14:44:26.757 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:44:26.757 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-04-18T14:44:26.757 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:44:26.758 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:26.758 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:26.758 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(client.4559.0:938 3.bs0 3:db6a9fd1:::smithi13430248-42:head [append 0~573440] snapc 32=[32,30,2c,2b,2a,29,28,27,26,22,1e,1c,1a,14,11] ondisk+write+known_if_redirected+supports_pool_eio e83)", 2024-04-18T14:44:26.758 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-04-18T14:44:22.483456+0000", 2024-04-18T14:44:26.758 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 4.2095096850000004, 2024-04-18T14:44:26.758 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.020000013000000001, 2024-04-18T14:44:26.758 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-04-18T14:44:26.758 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T14:44:26.758 INFO:teuthology.orchestra.run.smithi119.stdout: "client_info": { 2024-04-18T14:44:26.758 INFO:teuthology.orchestra.run.smithi119.stdout: "client": "client.4559", 2024-04-18T14:44:26.758 INFO:teuthology.orchestra.run.smithi119.stdout: "client_addr": "172.21.15.134:0/3113589487", 2024-04-18T14:44:26.758 INFO:teuthology.orchestra.run.smithi119.stdout: "tid": 938 2024-04-18T14:44:26.758 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:26.758 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-04-18T14:44:26.758 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:26.759 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-04-18T14:44:26.759 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:22.483456+0000", 2024-04-18T14:44:26.759 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:44:26.759 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:26.759 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:26.759 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-04-18T14:44:26.759 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:22.483456+0000", 2024-04-18T14:44:26.759 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:44:26.759 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:26.759 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:26.759 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-04-18T14:44:26.759 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:22.483453+0000", 2024-04-18T14:44:26.759 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4294967295.9999971 2024-04-18T14:44:26.759 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:26.759 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:26.759 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-04-18T14:44:26.760 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:22.484334+0000", 2024-04-18T14:44:26.760 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00088177399999999999 2024-04-18T14:44:26.760 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:26.760 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:26.760 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-04-18T14:44:26.760 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:22.484365+0000", 2024-04-18T14:44:26.760 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.0956e-05 2024-04-18T14:44:26.760 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:26.760 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:26.760 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-04-18T14:44:26.760 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:22.484380+0000", 2024-04-18T14:44:26.760 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.4742999999999999e-05 2024-04-18T14:44:26.760 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:26.761 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:26.761 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-04-18T14:44:26.761 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:22.489217+0000", 2024-04-18T14:44:26.761 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0048366930000000004 2024-04-18T14:44:26.761 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:26.761 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:26.761 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-04-18T14:44:26.761 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:22.489380+0000", 2024-04-18T14:44:26.761 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00016308499999999999 2024-04-18T14:44:26.761 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:26.761 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:26.761 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_started", 2024-04-18T14:44:26.761 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:22.491661+0000", 2024-04-18T14:44:26.762 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0022810230000000001 2024-04-18T14:44:26.762 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:26.762 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:26.762 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_committed", 2024-04-18T14:44:26.762 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:22.495660+0000", 2024-04-18T14:44:26.762 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0039995589999999998 2024-04-18T14:44:26.762 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:26.762 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:26.762 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-04-18T14:44:26.762 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:22.503296+0000", 2024-04-18T14:44:26.762 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0076351650000000002 2024-04-18T14:44:26.762 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:26.762 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:26.762 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-04-18T14:44:26.762 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:22.503456+0000", 2024-04-18T14:44:26.763 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00015996200000000001 2024-04-18T14:44:26.763 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:44:26.763 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-04-18T14:44:26.763 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:44:26.763 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:26.763 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:26.763 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(client.4559.0:939 3.bs0 3:db6a9fd1:::smithi13430248-42:head [append 0~425984] snapc 32=[32,30,2c,2b,2a,29,28,27,26,22,1e,1c,1a,14,11] ondisk+write+known_if_redirected+supports_pool_eio e83)", 2024-04-18T14:44:26.763 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-04-18T14:44:22.485855+0000", 2024-04-18T14:44:26.763 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 4.2071101999999998, 2024-04-18T14:44:26.763 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.024186401, 2024-04-18T14:44:26.763 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-04-18T14:44:26.763 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T14:44:26.763 INFO:teuthology.orchestra.run.smithi119.stdout: "client_info": { 2024-04-18T14:44:26.763 INFO:teuthology.orchestra.run.smithi119.stdout: "client": "client.4559", 2024-04-18T14:44:26.763 INFO:teuthology.orchestra.run.smithi119.stdout: "client_addr": "172.21.15.134:0/3113589487", 2024-04-18T14:44:26.764 INFO:teuthology.orchestra.run.smithi119.stdout: "tid": 939 2024-04-18T14:44:26.764 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:26.764 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-04-18T14:44:26.764 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:26.764 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-04-18T14:44:26.764 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:22.485855+0000", 2024-04-18T14:44:26.764 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:44:26.764 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:26.764 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:26.764 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-04-18T14:44:26.764 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:22.485855+0000", 2024-04-18T14:44:26.764 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:44:26.764 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:26.764 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:26.764 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-04-18T14:44:26.765 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:22.485839+0000", 2024-04-18T14:44:26.765 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4294967295.9999843 2024-04-18T14:44:26.765 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:26.765 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:26.765 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-04-18T14:44:26.765 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:22.486880+0000", 2024-04-18T14:44:26.765 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0010406020000000001 2024-04-18T14:44:26.765 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:26.765 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:26.765 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-04-18T14:44:26.765 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:22.486909+0000", 2024-04-18T14:44:26.765 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.8996000000000002e-05 2024-04-18T14:44:26.765 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:26.765 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:26.765 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-04-18T14:44:26.766 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:22.486929+0000", 2024-04-18T14:44:26.766 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.0013999999999998e-05 2024-04-18T14:44:26.766 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:26.766 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:26.766 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-04-18T14:44:26.766 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:22.495754+0000", 2024-04-18T14:44:26.766 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0088247519999999999 2024-04-18T14:44:26.766 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:26.766 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:26.766 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-04-18T14:44:26.766 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:22.496057+0000", 2024-04-18T14:44:26.766 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00030360100000000002 2024-04-18T14:44:26.766 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:26.766 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:26.766 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_started", 2024-04-18T14:44:26.767 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:22.497677+0000", 2024-04-18T14:44:26.767 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0016202009999999999 2024-04-18T14:44:26.769 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:26.769 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:26.769 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_committed", 2024-04-18T14:44:26.769 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:22.503479+0000", 2024-04-18T14:44:26.769 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0058013489999999999 2024-04-18T14:44:26.769 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:26.769 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:26.769 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-04-18T14:44:26.769 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:22.509817+0000", 2024-04-18T14:44:26.769 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0063383739999999999 2024-04-18T14:44:26.769 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:26.769 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:26.769 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-04-18T14:44:26.770 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:22.510041+0000", 2024-04-18T14:44:26.770 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00022433199999999999 2024-04-18T14:44:26.770 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:44:26.770 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-04-18T14:44:26.770 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:44:26.770 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:26.770 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:26.770 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(client.4559.0:940 3.bs0 3:db6a9fd1:::smithi13430248-42:head [append 0~524288] snapc 32=[32,30,2c,2b,2a,29,28,27,26,22,1e,1c,1a,14,11] ondisk+write+known_if_redirected+supports_pool_eio e83)", 2024-04-18T14:44:26.770 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-04-18T14:44:22.489469+0000", 2024-04-18T14:44:26.770 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 4.2034966239999996, 2024-04-18T14:44:26.770 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.021788469000000001, 2024-04-18T14:44:26.770 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-04-18T14:44:26.770 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T14:44:26.770 INFO:teuthology.orchestra.run.smithi119.stdout: "client_info": { 2024-04-18T14:44:26.771 INFO:teuthology.orchestra.run.smithi119.stdout: "client": "client.4559", 2024-04-18T14:44:26.771 INFO:teuthology.orchestra.run.smithi119.stdout: "client_addr": "172.21.15.134:0/3113589487", 2024-04-18T14:44:26.771 INFO:teuthology.orchestra.run.smithi119.stdout: "tid": 940 2024-04-18T14:44:26.771 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:26.771 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-04-18T14:44:26.771 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:26.771 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-04-18T14:44:26.771 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:22.489469+0000", 2024-04-18T14:44:26.771 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:44:26.771 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:26.771 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:26.771 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-04-18T14:44:26.771 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:22.489469+0000", 2024-04-18T14:44:26.771 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:44:26.771 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:26.771 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:26.772 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-04-18T14:44:26.775 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:22.489466+0000", 2024-04-18T14:44:26.775 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4294967295.9999971 2024-04-18T14:44:26.775 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:26.775 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:26.776 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-04-18T14:44:26.776 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:22.490637+0000", 2024-04-18T14:44:26.776 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.001171184 2024-04-18T14:44:26.776 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:26.776 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:26.776 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-04-18T14:44:26.777 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:22.490670+0000", 2024-04-18T14:44:26.777 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.3333000000000001e-05 2024-04-18T14:44:26.777 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:26.777 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:26.777 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-04-18T14:44:26.777 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:22.490688+0000", 2024-04-18T14:44:26.778 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.7957000000000001e-05 2024-04-18T14:44:26.778 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:26.778 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:26.778 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-04-18T14:44:26.778 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:22.499244+0000", 2024-04-18T14:44:26.778 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0085561839999999997 2024-04-18T14:44:26.779 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:26.779 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:26.779 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-04-18T14:44:26.779 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:22.499419+0000", 2024-04-18T14:44:26.779 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000175009 2024-04-18T14:44:26.779 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:26.780 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:26.780 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_started", 2024-04-18T14:44:26.780 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:22.501124+0000", 2024-04-18T14:44:26.780 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.001704807 2024-04-18T14:44:26.780 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:26.780 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:26.781 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_committed", 2024-04-18T14:44:26.781 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:22.510076+0000", 2024-04-18T14:44:26.781 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0089518440000000005 2024-04-18T14:44:26.781 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:26.781 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:26.781 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-04-18T14:44:26.782 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:22.511067+0000", 2024-04-18T14:44:26.782 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00099103600000000004 2024-04-18T14:44:26.782 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:26.782 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:26.782 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-04-18T14:44:26.782 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:22.511257+0000", 2024-04-18T14:44:26.783 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000189972 2024-04-18T14:44:26.783 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:44:26.783 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-04-18T14:44:26.783 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:44:26.783 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:26.783 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:26.784 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(client.4559.0:941 3.bs0 3:db6a9fd1:::smithi13430248-42:head [append 0~425984] snapc 32=[32,30,2c,2b,2a,29,28,27,26,22,1e,1c,1a,14,11] ondisk+write+known_if_redirected+supports_pool_eio e83)", 2024-04-18T14:44:26.784 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-04-18T14:44:22.492031+0000", 2024-04-18T14:44:26.784 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 4.2009338009999997, 2024-04-18T14:44:26.784 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.019998353, 2024-04-18T14:44:26.784 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-04-18T14:44:26.784 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T14:44:26.785 INFO:teuthology.orchestra.run.smithi119.stdout: "client_info": { 2024-04-18T14:44:26.785 INFO:teuthology.orchestra.run.smithi119.stdout: "client": "client.4559", 2024-04-18T14:44:26.785 INFO:teuthology.orchestra.run.smithi119.stdout: "client_addr": "172.21.15.134:0/3113589487", 2024-04-18T14:44:26.785 INFO:teuthology.orchestra.run.smithi119.stdout: "tid": 941 2024-04-18T14:44:26.785 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:26.785 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-04-18T14:44:26.786 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:26.786 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-04-18T14:44:26.786 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:22.492031+0000", 2024-04-18T14:44:26.786 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:44:26.786 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:26.787 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:26.787 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-04-18T14:44:26.787 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:22.492031+0000", 2024-04-18T14:44:26.787 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:44:26.787 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:26.787 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:26.787 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-04-18T14:44:26.788 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:22.492029+0000", 2024-04-18T14:44:26.788 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4294967295.9999971 2024-04-18T14:44:26.788 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:26.788 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:26.788 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-04-18T14:44:26.788 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:22.493235+0000", 2024-04-18T14:44:26.789 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0012064000000000001 2024-04-18T14:44:26.789 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:26.789 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:26.789 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-04-18T14:44:26.789 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:22.493268+0000", 2024-04-18T14:44:26.790 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.2583000000000003e-05 2024-04-18T14:44:26.790 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:26.790 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:26.790 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-04-18T14:44:26.790 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:22.493285+0000", 2024-04-18T14:44:26.790 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.7493999999999999e-05 2024-04-18T14:44:26.791 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:26.791 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:26.791 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-04-18T14:44:26.791 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:22.504183+0000", 2024-04-18T14:44:26.791 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.010898043 2024-04-18T14:44:26.791 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:26.792 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:26.792 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-04-18T14:44:26.792 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:22.504345+0000", 2024-04-18T14:44:26.792 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00016220500000000001 2024-04-18T14:44:26.792 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:26.792 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:26.793 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_started", 2024-04-18T14:44:26.793 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:22.505766+0000", 2024-04-18T14:44:26.793 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.001420583 2024-04-18T14:44:26.793 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:26.793 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:26.793 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_committed", 2024-04-18T14:44:26.794 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:22.510340+0000", 2024-04-18T14:44:26.794 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0045742710000000004 2024-04-18T14:44:26.794 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:26.794 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:26.794 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-04-18T14:44:26.794 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:22.511927+0000", 2024-04-18T14:44:26.795 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0015867679999999999 2024-04-18T14:44:26.795 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:26.795 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:26.795 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-04-18T14:44:26.795 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:22.512030+0000", 2024-04-18T14:44:26.795 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000102829 2024-04-18T14:44:26.796 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:44:26.796 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-04-18T14:44:26.796 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:44:26.796 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:26.796 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:26.796 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(client.4559.0:943 3.bs0 3:db6a9fd1:::smithi13430248-42:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e83)", 2024-04-18T14:44:26.797 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-04-18T14:44:22.493331+0000", 2024-04-18T14:44:26.797 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 4.1996342709999999, 2024-04-18T14:44:26.797 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.022422965, 2024-04-18T14:44:26.797 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-04-18T14:44:26.797 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "started", 2024-04-18T14:44:26.797 INFO:teuthology.orchestra.run.smithi119.stdout: "client_info": { 2024-04-18T14:44:26.798 INFO:teuthology.orchestra.run.smithi119.stdout: "client": "client.4559", 2024-04-18T14:44:26.798 INFO:teuthology.orchestra.run.smithi119.stdout: "client_addr": "172.21.15.134:0/3113589487", 2024-04-18T14:44:26.798 INFO:teuthology.orchestra.run.smithi119.stdout: "tid": 943 2024-04-18T14:44:26.798 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:26.798 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-04-18T14:44:26.798 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:26.799 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-04-18T14:44:26.799 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:22.493331+0000", 2024-04-18T14:44:26.799 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:44:26.799 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:26.799 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:26.799 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-04-18T14:44:26.800 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:22.493331+0000", 2024-04-18T14:44:26.800 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:44:26.800 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:26.800 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:26.800 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-04-18T14:44:26.800 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:22.493330+0000", 2024-04-18T14:44:26.801 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4294967295.999999 2024-04-18T14:44:26.801 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:26.801 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:26.801 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-04-18T14:44:26.801 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:22.493334+0000", 2024-04-18T14:44:26.801 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4.1529999999999999e-06 2024-04-18T14:44:26.802 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:26.802 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:26.802 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-04-18T14:44:26.802 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:22.493344+0000", 2024-04-18T14:44:26.802 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 9.9329999999999996e-06 2024-04-18T14:44:26.802 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:26.802 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:26.802 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-04-18T14:44:26.802 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:22.493352+0000", 2024-04-18T14:44:26.803 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 7.2969999999999998e-06 2024-04-18T14:44:26.803 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:26.803 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:26.803 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-04-18T14:44:26.803 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:22.513375+0000", 2024-04-18T14:44:26.803 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.020023446 2024-04-18T14:44:26.803 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:26.803 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:26.803 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-04-18T14:44:26.803 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:22.513593+0000", 2024-04-18T14:44:26.803 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000217505 2024-04-18T14:44:26.803 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:26.803 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:26.803 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-04-18T14:44:26.803 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:22.515754+0000", 2024-04-18T14:44:26.804 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0021613639999999998 2024-04-18T14:44:26.804 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:44:26.804 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-04-18T14:44:26.804 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:44:26.804 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:26.804 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:26.804 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(client.4559.0:999 3.4s0 3:253cfff6:::smithi13430248-31:head [rollback 35] snapc 35=[35,33,32,30,2c,2b,2a,29,28,26,22,1e,1c,1a,14,11] ondisk+write+known_if_redirected+supports_pool_eio e86)", 2024-04-18T14:44:26.804 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-04-18T14:44:25.528209+0000", 2024-04-18T14:44:26.804 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 1.1647559750000001, 2024-04-18T14:44:26.804 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.020374748000000002, 2024-04-18T14:44:26.804 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-04-18T14:44:26.804 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T14:44:26.804 INFO:teuthology.orchestra.run.smithi119.stdout: "client_info": { 2024-04-18T14:44:26.804 INFO:teuthology.orchestra.run.smithi119.stdout: "client": "client.4559", 2024-04-18T14:44:26.805 INFO:teuthology.orchestra.run.smithi119.stdout: "client_addr": "172.21.15.134:0/3113589487", 2024-04-18T14:44:26.805 INFO:teuthology.orchestra.run.smithi119.stdout: "tid": 999 2024-04-18T14:44:26.805 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:26.805 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-04-18T14:44:26.805 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:26.805 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-04-18T14:44:26.805 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:25.528209+0000", 2024-04-18T14:44:26.805 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:44:26.805 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:26.805 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:26.805 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-04-18T14:44:26.805 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:25.528209+0000", 2024-04-18T14:44:26.805 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:44:26.805 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:26.805 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:26.806 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-04-18T14:44:26.806 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:25.528208+0000", 2024-04-18T14:44:26.806 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4294967295.999999 2024-04-18T14:44:26.806 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:26.806 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:26.806 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-04-18T14:44:26.806 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:25.528215+0000", 2024-04-18T14:44:26.806 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 6.1770000000000003e-06 2024-04-18T14:44:26.806 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:26.806 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:26.806 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-04-18T14:44:26.806 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:25.528230+0000", 2024-04-18T14:44:26.807 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.5903e-05 2024-04-18T14:44:26.807 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:26.807 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:26.807 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-04-18T14:44:26.807 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:25.528245+0000", 2024-04-18T14:44:26.807 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.4932999999999999e-05 2024-04-18T14:44:26.807 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:26.807 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:26.807 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-04-18T14:44:26.807 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:25.528407+0000", 2024-04-18T14:44:26.807 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00016133900000000001 2024-04-18T14:44:26.807 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:26.807 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:26.807 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting_for_map not empty", 2024-04-18T14:44:26.807 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:25.528424+0000", 2024-04-18T14:44:26.808 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.7088999999999999e-05 2024-04-18T14:44:26.808 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:26.808 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:26.808 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-04-18T14:44:26.808 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:25.538739+0000", 2024-04-18T14:44:26.808 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.010315678 2024-04-18T14:44:26.808 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:26.808 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:26.808 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-04-18T14:44:26.808 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:25.539027+0000", 2024-04-18T14:44:26.808 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000287228 2024-04-18T14:44:26.808 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:26.808 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:26.808 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_started", 2024-04-18T14:44:26.808 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:25.540598+0000", 2024-04-18T14:44:26.809 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.001570945 2024-04-18T14:44:26.809 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:26.809 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:26.809 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_committed", 2024-04-18T14:44:26.809 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:25.548190+0000", 2024-04-18T14:44:26.809 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0075919380000000003 2024-04-18T14:44:26.809 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:26.809 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:26.809 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-04-18T14:44:26.809 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:25.548392+0000", 2024-04-18T14:44:26.809 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000202542 2024-04-18T14:44:26.809 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:26.809 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:26.809 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-04-18T14:44:26.809 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:25.548584+0000", 2024-04-18T14:44:26.810 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00019189899999999999 2024-04-18T14:44:26.810 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:44:26.810 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-04-18T14:44:26.810 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:44:26.810 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:26.810 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:26.810 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(client.4559.0:1000 3.4s0 3:253cfff6:::smithi13430248-31:head [append 0~0] snapc 35=[35,33,32,30,2c,2b,2a,29,28,26,22,1e,1c,1a,14,11] ondisk+write+known_if_redirected+supports_pool_eio e86)", 2024-04-18T14:44:26.810 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-04-18T14:44:25.528322+0000", 2024-04-18T14:44:26.810 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 1.1646428259999999, 2024-04-18T14:44:26.810 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.023230978999999999, 2024-04-18T14:44:26.810 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-04-18T14:44:26.810 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T14:44:26.810 INFO:teuthology.orchestra.run.smithi119.stdout: "client_info": { 2024-04-18T14:44:26.810 INFO:teuthology.orchestra.run.smithi119.stdout: "client": "client.4559", 2024-04-18T14:44:26.811 INFO:teuthology.orchestra.run.smithi119.stdout: "client_addr": "172.21.15.134:0/3113589487", 2024-04-18T14:44:26.811 INFO:teuthology.orchestra.run.smithi119.stdout: "tid": 1000 2024-04-18T14:44:26.811 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:26.811 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-04-18T14:44:26.811 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:26.811 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-04-18T14:44:26.811 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:25.528322+0000", 2024-04-18T14:44:26.811 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:44:26.811 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:26.811 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:26.811 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-04-18T14:44:26.811 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:25.528322+0000", 2024-04-18T14:44:26.811 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:44:26.811 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:26.812 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:26.812 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-04-18T14:44:26.812 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:25.528321+0000", 2024-04-18T14:44:26.812 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4294967295.9999986 2024-04-18T14:44:26.812 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:26.812 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:26.812 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-04-18T14:44:26.812 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:25.528331+0000", 2024-04-18T14:44:26.812 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.0149999999999999e-05 2024-04-18T14:44:26.812 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:26.812 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:26.812 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-04-18T14:44:26.812 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:25.528355+0000", 2024-04-18T14:44:26.813 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.3560000000000001e-05 2024-04-18T14:44:26.813 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:26.813 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:26.813 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-04-18T14:44:26.813 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:25.528372+0000", 2024-04-18T14:44:26.813 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.7405999999999999e-05 2024-04-18T14:44:26.813 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:26.813 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:26.813 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-04-18T14:44:26.813 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:25.528479+0000", 2024-04-18T14:44:26.813 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000107069 2024-04-18T14:44:26.813 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:26.813 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:26.813 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting_for_map not empty", 2024-04-18T14:44:26.813 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:25.528490+0000", 2024-04-18T14:44:26.814 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.0947e-05 2024-04-18T14:44:26.814 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:26.814 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:26.814 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-04-18T14:44:26.814 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:25.544895+0000", 2024-04-18T14:44:26.814 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.016404400999999999 2024-04-18T14:44:26.814 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:26.814 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:26.814 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-04-18T14:44:26.814 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:25.545212+0000", 2024-04-18T14:44:26.814 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00031769699999999998 2024-04-18T14:44:26.814 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:26.814 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:26.814 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_started", 2024-04-18T14:44:26.815 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:25.546437+0000", 2024-04-18T14:44:26.815 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0012249170000000001 2024-04-18T14:44:26.815 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:26.815 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:26.815 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_committed", 2024-04-18T14:44:26.815 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:25.550901+0000", 2024-04-18T14:44:26.815 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0044635899999999999 2024-04-18T14:44:26.815 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:26.815 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:26.815 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-04-18T14:44:26.815 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:25.551452+0000", 2024-04-18T14:44:26.815 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00055106199999999995 2024-04-18T14:44:26.815 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:26.815 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:26.815 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-04-18T14:44:26.816 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:25.551553+0000", 2024-04-18T14:44:26.816 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000101586 2024-04-18T14:44:26.816 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:44:26.816 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-04-18T14:44:26.816 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:44:26.816 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:44:26.816 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-04-18T14:44:26.816 INFO:teuthology.orchestra.run.smithi119.stdout:} 2024-04-18T14:44:26.818 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.14.asok dump_ops_in_flight 2024-04-18T14:44:26.819 INFO:tasks.ceph.osd.3.smithi134.stderr:2024-04-18T14:44:26.819+0000 7fe7a4443640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25211) UID: 0 2024-04-18T14:44:26.918 INFO:tasks.ceph.osd.1.smithi096.stderr:2024-04-18T14:44:26.917+0000 7f56a7a98640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 24887) UID: 0 2024-04-18T14:44:26.945 INFO:teuthology.orchestra.run.smithi119.stdout:{ 2024-04-18T14:44:26.945 INFO:teuthology.orchestra.run.smithi119.stdout: "ops": [], 2024-04-18T14:44:26.945 INFO:teuthology.orchestra.run.smithi119.stdout: "num_ops": 0 2024-04-18T14:44:26.945 INFO:teuthology.orchestra.run.smithi119.stdout:} 2024-04-18T14:44:26.959 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.14.asok dump_blocked_ops 2024-04-18T14:44:27.020 INFO:tasks.ceph.osd.0.smithi086.stderr:2024-04-18T14:44:27.017+0000 7f7cdfd78640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 24953) UID: 0 2024-04-18T14:44:27.082 INFO:teuthology.orchestra.run.smithi119.stdout:{ 2024-04-18T14:44:27.082 INFO:teuthology.orchestra.run.smithi119.stdout: "ops": [], 2024-04-18T14:44:27.082 INFO:teuthology.orchestra.run.smithi119.stdout: "complaint_time": 30, 2024-04-18T14:44:27.082 INFO:teuthology.orchestra.run.smithi119.stdout: "num_blocked_ops": 0 2024-04-18T14:44:27.082 INFO:teuthology.orchestra.run.smithi119.stdout:} 2024-04-18T14:44:27.096 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.14.asok dump_historic_ops 2024-04-18T14:44:27.120 INFO:tasks.ceph.osd.3.smithi134.stderr:2024-04-18T14:44:27.123+0000 7fe7a4443640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25211) UID: 0 2024-04-18T14:44:27.220 INFO:teuthology.orchestra.run.smithi119.stdout:{ 2024-04-18T14:44:27.220 INFO:teuthology.orchestra.run.smithi119.stdout: "size": 20, 2024-04-18T14:44:27.220 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 600, 2024-04-18T14:44:27.220 INFO:teuthology.orchestra.run.smithi119.stdout: "ops": [ 2024-04-18T14:44:27.220 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:27.220 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(client.4559.0:183 3.7s0 3:e3a0e00d:::smithi13430248-30:head [copy-from ver 12] snapc 4=[4,2] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-18T14:44:27.220 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-04-18T14:43:36.725584+0000", 2024-04-18T14:44:27.220 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 50.498035651000002, 2024-04-18T14:44:27.220 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.032002501000000003, 2024-04-18T14:44:27.220 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-04-18T14:44:27.221 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T14:44:27.221 INFO:teuthology.orchestra.run.smithi119.stdout: "client_info": { 2024-04-18T14:44:27.221 INFO:teuthology.orchestra.run.smithi119.stdout: "client": "client.4559", 2024-04-18T14:44:27.221 INFO:teuthology.orchestra.run.smithi119.stdout: "client_addr": "172.21.15.134:0/3113589487", 2024-04-18T14:44:27.221 INFO:teuthology.orchestra.run.smithi119.stdout: "tid": 183 2024-04-18T14:44:27.221 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:27.221 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-04-18T14:44:27.221 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:27.221 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-04-18T14:44:27.221 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:36.725584+0000", 2024-04-18T14:44:27.221 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:44:27.221 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:27.221 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:27.221 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-04-18T14:44:27.221 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:36.725584+0000", 2024-04-18T14:44:27.222 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:44:27.222 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:27.222 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:27.222 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-04-18T14:44:27.222 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:36.725582+0000", 2024-04-18T14:44:27.222 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4294967295.9999976 2024-04-18T14:44:27.222 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:27.222 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:27.222 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-04-18T14:44:27.222 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:36.725595+0000", 2024-04-18T14:44:27.222 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.325e-05 2024-04-18T14:44:27.222 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:27.222 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:27.222 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-04-18T14:44:27.222 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:36.725618+0000", 2024-04-18T14:44:27.223 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.2574000000000001e-05 2024-04-18T14:44:27.223 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:27.223 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:27.223 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-04-18T14:44:27.223 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:36.725633+0000", 2024-04-18T14:44:27.223 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.5197e-05 2024-04-18T14:44:27.223 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:27.223 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:27.223 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-04-18T14:44:27.223 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:36.725764+0000", 2024-04-18T14:44:27.223 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00013052300000000001 2024-04-18T14:44:27.223 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:27.223 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:27.223 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "op must wait for map", 2024-04-18T14:44:27.223 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:36.725784+0000", 2024-04-18T14:44:27.223 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.0111000000000001e-05 2024-04-18T14:44:27.224 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:27.224 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:27.224 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-04-18T14:44:27.224 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:36.731424+0000", 2024-04-18T14:44:27.224 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0056403479999999999 2024-04-18T14:44:27.224 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:27.224 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:27.224 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-04-18T14:44:27.224 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:36.731754+0000", 2024-04-18T14:44:27.224 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00032950200000000002 2024-04-18T14:44:27.224 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:27.224 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:27.224 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_started", 2024-04-18T14:44:27.224 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:36.748259+0000", 2024-04-18T14:44:27.224 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.016505701000000001 2024-04-18T14:44:27.225 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:27.225 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:27.225 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_committed", 2024-04-18T14:44:27.225 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:36.751859+0000", 2024-04-18T14:44:27.225 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.003599671 2024-04-18T14:44:27.225 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:27.225 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:27.225 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-04-18T14:44:27.225 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:36.757474+0000", 2024-04-18T14:44:27.225 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0056144810000000002 2024-04-18T14:44:27.225 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:27.225 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:27.225 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-04-18T14:44:27.225 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:36.757587+0000", 2024-04-18T14:44:27.225 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000113393 2024-04-18T14:44:27.226 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:44:27.226 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-04-18T14:44:27.226 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:44:27.226 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:27.226 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:27.226 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(client.4559.0:184 3.7s0 3:e3a0e00d:::smithi13430248-30:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e37)", 2024-04-18T14:44:27.226 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-04-18T14:43:36.725653+0000", 2024-04-18T14:44:27.226 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 50.497967170000003, 2024-04-18T14:44:27.226 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.025569002, 2024-04-18T14:44:27.226 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-04-18T14:44:27.226 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "started", 2024-04-18T14:44:27.226 INFO:teuthology.orchestra.run.smithi119.stdout: "client_info": { 2024-04-18T14:44:27.226 INFO:teuthology.orchestra.run.smithi119.stdout: "client": "client.4559", 2024-04-18T14:44:27.226 INFO:teuthology.orchestra.run.smithi119.stdout: "client_addr": "172.21.15.134:0/3113589487", 2024-04-18T14:44:27.226 INFO:teuthology.orchestra.run.smithi119.stdout: "tid": 184 2024-04-18T14:44:27.227 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:27.227 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-04-18T14:44:27.227 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:27.227 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-04-18T14:44:27.227 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:36.725653+0000", 2024-04-18T14:44:27.227 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:44:27.227 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:27.227 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:27.227 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-04-18T14:44:27.227 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:36.725653+0000", 2024-04-18T14:44:27.227 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:44:27.227 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:27.227 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:27.227 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-04-18T14:44:27.227 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:36.725652+0000", 2024-04-18T14:44:27.228 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4294967295.999999 2024-04-18T14:44:27.228 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:27.228 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:27.228 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-04-18T14:44:27.228 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:36.725657+0000", 2024-04-18T14:44:27.228 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4.5170000000000001e-06 2024-04-18T14:44:27.228 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:27.228 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:27.228 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-04-18T14:44:27.228 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:36.725670+0000", 2024-04-18T14:44:27.228 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.3536999999999999e-05 2024-04-18T14:44:27.228 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:27.228 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:27.228 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-04-18T14:44:27.228 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:36.725678+0000", 2024-04-18T14:44:27.229 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 8.2099999999999993e-06 2024-04-18T14:44:27.229 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:27.229 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:27.229 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-04-18T14:44:27.229 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:36.725920+0000", 2024-04-18T14:44:27.229 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00024127299999999999 2024-04-18T14:44:27.229 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:27.229 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:27.229 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting_for_map not empty", 2024-04-18T14:44:27.229 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:36.725937+0000", 2024-04-18T14:44:27.229 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.7011e-05 2024-04-18T14:44:27.229 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:27.229 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:27.229 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-04-18T14:44:27.229 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:36.732196+0000", 2024-04-18T14:44:27.229 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0062595209999999997 2024-04-18T14:44:27.230 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:27.230 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:27.230 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for blocked object", 2024-04-18T14:44:27.230 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:36.732319+0000", 2024-04-18T14:44:27.230 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000122977 2024-04-18T14:44:27.230 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:27.230 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:27.230 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-04-18T14:44:27.230 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:36.750655+0000", 2024-04-18T14:44:27.230 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.018336431 2024-04-18T14:44:27.230 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:27.230 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:27.230 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-04-18T14:44:27.230 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:36.750956+0000", 2024-04-18T14:44:27.230 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00030036800000000002 2024-04-18T14:44:27.230 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:27.231 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:27.231 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-04-18T14:44:27.231 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:36.751222+0000", 2024-04-18T14:44:27.231 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00026612000000000001 2024-04-18T14:44:27.231 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:44:27.231 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-04-18T14:44:27.231 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:44:27.231 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:27.231 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:27.231 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(client.4559.0:242 3.7s0 3:e2767c91:::smithi13430248-5:head [copy-from ver 2] snapc 8=[8,7,4,2] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-04-18T14:44:27.231 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-04-18T14:43:40.759272+0000", 2024-04-18T14:44:27.231 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 46.464348104000003, 2024-04-18T14:44:27.231 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.031013309999999999, 2024-04-18T14:44:27.231 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-04-18T14:44:27.231 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T14:44:27.231 INFO:teuthology.orchestra.run.smithi119.stdout: "client_info": { 2024-04-18T14:44:27.232 INFO:teuthology.orchestra.run.smithi119.stdout: "client": "client.4559", 2024-04-18T14:44:27.232 INFO:teuthology.orchestra.run.smithi119.stdout: "client_addr": "172.21.15.134:0/3113589487", 2024-04-18T14:44:27.232 INFO:teuthology.orchestra.run.smithi119.stdout: "tid": 242 2024-04-18T14:44:27.232 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:27.232 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-04-18T14:44:27.232 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:27.232 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-04-18T14:44:27.232 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:40.759272+0000", 2024-04-18T14:44:27.232 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:44:27.232 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:27.232 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:27.232 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-04-18T14:44:27.232 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:40.759272+0000", 2024-04-18T14:44:27.232 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:44:27.232 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:27.233 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:27.233 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-04-18T14:44:27.233 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:40.759269+0000", 2024-04-18T14:44:27.233 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4294967295.9999971 2024-04-18T14:44:27.233 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:27.233 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:27.233 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-04-18T14:44:27.233 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:40.759294+0000", 2024-04-18T14:44:27.233 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.5335999999999999e-05 2024-04-18T14:44:27.233 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:27.233 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:27.233 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-04-18T14:44:27.233 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:40.759330+0000", 2024-04-18T14:44:27.233 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.5531000000000003e-05 2024-04-18T14:44:27.233 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:27.234 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:27.234 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-04-18T14:44:27.234 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:40.759353+0000", 2024-04-18T14:44:27.234 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.3441000000000001e-05 2024-04-18T14:44:27.234 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:27.234 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:27.234 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-04-18T14:44:27.234 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:40.760398+0000", 2024-04-18T14:44:27.234 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00104484 2024-04-18T14:44:27.234 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:27.234 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:27.234 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-04-18T14:44:27.234 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:40.760662+0000", 2024-04-18T14:44:27.234 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00026342599999999998 2024-04-18T14:44:27.234 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:27.235 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:27.235 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_started", 2024-04-18T14:44:27.235 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:40.783559+0000", 2024-04-18T14:44:27.235 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.022896989 2024-04-18T14:44:27.235 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:27.235 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:27.235 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_committed", 2024-04-18T14:44:27.235 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:40.789488+0000", 2024-04-18T14:44:27.235 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0059289260000000002 2024-04-18T14:44:27.235 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:27.235 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:27.235 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-04-18T14:44:27.235 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:40.790079+0000", 2024-04-18T14:44:27.235 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00059128299999999996 2024-04-18T14:44:27.235 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:27.236 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:27.236 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-04-18T14:44:27.236 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:40.790285+0000", 2024-04-18T14:44:27.236 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000206448 2024-04-18T14:44:27.236 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:44:27.236 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-04-18T14:44:27.236 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:44:27.236 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:27.236 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:27.236 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(client.4559.0:243 3.7s0 3:e2767c91:::smithi13430248-5:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e41)", 2024-04-18T14:44:27.236 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-04-18T14:43:40.759392+0000", 2024-04-18T14:44:27.236 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 46.464227878999999, 2024-04-18T14:44:27.236 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.032366368, 2024-04-18T14:44:27.236 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-04-18T14:44:27.236 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "started", 2024-04-18T14:44:27.236 INFO:teuthology.orchestra.run.smithi119.stdout: "client_info": { 2024-04-18T14:44:27.237 INFO:teuthology.orchestra.run.smithi119.stdout: "client": "client.4559", 2024-04-18T14:44:27.237 INFO:teuthology.orchestra.run.smithi119.stdout: "client_addr": "172.21.15.134:0/3113589487", 2024-04-18T14:44:27.237 INFO:teuthology.orchestra.run.smithi119.stdout: "tid": 243 2024-04-18T14:44:27.237 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:27.237 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-04-18T14:44:27.237 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:27.237 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-04-18T14:44:27.237 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:40.759392+0000", 2024-04-18T14:44:27.237 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:44:27.237 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:27.237 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:27.237 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-04-18T14:44:27.237 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:40.759392+0000", 2024-04-18T14:44:27.237 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:44:27.237 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:27.237 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:27.238 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-04-18T14:44:27.238 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:40.759391+0000", 2024-04-18T14:44:27.238 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4294967295.9999986 2024-04-18T14:44:27.238 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:27.238 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:27.238 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-04-18T14:44:27.238 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:40.759400+0000", 2024-04-18T14:44:27.238 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 8.9770000000000006e-06 2024-04-18T14:44:27.238 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:27.238 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:27.238 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-04-18T14:44:27.238 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:40.759421+0000", 2024-04-18T14:44:27.238 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.1557e-05 2024-04-18T14:44:27.238 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:27.238 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:27.239 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-04-18T14:44:27.239 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:40.759438+0000", 2024-04-18T14:44:27.239 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.6663999999999998e-05 2024-04-18T14:44:27.239 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:27.239 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:27.239 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-04-18T14:44:27.239 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:40.761106+0000", 2024-04-18T14:44:27.239 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.001668367 2024-04-18T14:44:27.239 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:27.239 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:27.239 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for blocked object", 2024-04-18T14:44:27.239 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:40.761224+0000", 2024-04-18T14:44:27.239 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000117376 2024-04-18T14:44:27.239 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:27.239 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:27.239 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-04-18T14:44:27.240 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:40.791296+0000", 2024-04-18T14:44:27.240 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.030072040000000001 2024-04-18T14:44:27.240 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:27.240 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:27.240 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-04-18T14:44:27.240 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:40.791484+0000", 2024-04-18T14:44:27.240 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000188717 2024-04-18T14:44:27.240 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:27.240 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:27.240 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-04-18T14:44:27.240 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:40.791759+0000", 2024-04-18T14:44:27.240 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00027425000000000003 2024-04-18T14:44:27.240 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:44:27.240 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-04-18T14:44:27.240 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:44:27.240 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:27.241 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:27.241 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "MOSDECSubOpWrite(3.4s2 68/30 ECSubWrite(tid=63, reqid=osd.10.0:63, at_version=68'20, trim_to=0'0, roll_forward_to=65'18))", 2024-04-18T14:44:27.241 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-04-18T14:44:07.411065+0000", 2024-04-18T14:44:27.241 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 19.812554874, 2024-04-18T14:44:27.241 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.024750998, 2024-04-18T14:44:27.241 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-04-18T14:44:27.241 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "reached pg", 2024-04-18T14:44:27.241 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-04-18T14:44:27.241 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:27.241 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-04-18T14:44:27.241 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:07.411065+0000", 2024-04-18T14:44:27.241 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:44:27.241 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:27.241 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:27.241 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-04-18T14:44:27.241 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:07.411065+0000", 2024-04-18T14:44:27.242 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:44:27.242 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:27.242 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:27.242 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-04-18T14:44:27.242 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:07.411064+0000", 2024-04-18T14:44:27.242 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4294967295.999999 2024-04-18T14:44:27.242 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:27.242 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:27.242 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-04-18T14:44:27.242 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:07.411123+0000", 2024-04-18T14:44:27.242 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 5.8686e-05 2024-04-18T14:44:27.242 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:27.242 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:27.242 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-04-18T14:44:27.242 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:07.411151+0000", 2024-04-18T14:44:27.243 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.8056999999999999e-05 2024-04-18T14:44:27.243 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:27.243 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:27.243 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-04-18T14:44:27.243 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:07.411171+0000", 2024-04-18T14:44:27.243 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.0233000000000001e-05 2024-04-18T14:44:27.243 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:27.243 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:27.243 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-04-18T14:44:27.243 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:07.411295+0000", 2024-04-18T14:44:27.243 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000124012 2024-04-18T14:44:27.243 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:27.243 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:27.243 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_started", 2024-04-18T14:44:27.243 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:07.411321+0000", 2024-04-18T14:44:27.243 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.6069999999999999e-05 2024-04-18T14:44:27.244 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:27.244 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:27.244 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_committed", 2024-04-18T14:44:27.244 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:07.435757+0000", 2024-04-18T14:44:27.244 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.024435779000000001 2024-04-18T14:44:27.244 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:27.244 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:27.244 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-04-18T14:44:27.244 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:07.435816+0000", 2024-04-18T14:44:27.244 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 5.9256999999999999e-05 2024-04-18T14:44:27.244 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:44:27.244 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-04-18T14:44:27.244 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:44:27.244 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:27.244 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:27.245 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "MOSDECSubOpWrite(3.fs4 68/30 ECSubWrite(tid=165, reqid=osd.11.0:165, at_version=68'34, trim_to=0'0, roll_forward_to=65'32))", 2024-04-18T14:44:27.245 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-04-18T14:44:07.412419+0000", 2024-04-18T14:44:27.245 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 19.811201106999999, 2024-04-18T14:44:27.245 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.029301166, 2024-04-18T14:44:27.245 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-04-18T14:44:27.245 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "reached pg", 2024-04-18T14:44:27.245 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-04-18T14:44:27.245 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:27.245 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-04-18T14:44:27.245 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:07.412419+0000", 2024-04-18T14:44:27.246 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:44:27.246 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:27.246 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:27.247 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-04-18T14:44:27.247 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:07.412419+0000", 2024-04-18T14:44:27.247 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:44:27.247 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:27.247 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:27.247 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-04-18T14:44:27.247 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:07.412418+0000", 2024-04-18T14:44:27.247 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4294967295.999999 2024-04-18T14:44:27.247 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:27.247 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:27.247 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-04-18T14:44:27.247 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:07.412468+0000", 2024-04-18T14:44:27.247 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 5.0274e-05 2024-04-18T14:44:27.247 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:27.248 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:27.248 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-04-18T14:44:27.248 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:07.412493+0000", 2024-04-18T14:44:27.248 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.5052e-05 2024-04-18T14:44:27.248 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:27.248 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:27.248 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-04-18T14:44:27.248 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:07.412512+0000", 2024-04-18T14:44:27.248 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.8176999999999999e-05 2024-04-18T14:44:27.248 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:27.248 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:27.248 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-04-18T14:44:27.248 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:07.412620+0000", 2024-04-18T14:44:27.249 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000108429 2024-04-18T14:44:27.249 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:27.249 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:27.249 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_started", 2024-04-18T14:44:27.249 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:07.412646+0000", 2024-04-18T14:44:27.249 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.6310000000000001e-05 2024-04-18T14:44:27.250 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:27.250 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:27.250 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_committed", 2024-04-18T14:44:27.250 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:07.441671+0000", 2024-04-18T14:44:27.250 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.029024583999999999 2024-04-18T14:44:27.250 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:27.250 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:27.250 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-04-18T14:44:27.250 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:07.441720+0000", 2024-04-18T14:44:27.250 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4.9237000000000003e-05 2024-04-18T14:44:27.250 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:44:27.250 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-04-18T14:44:27.250 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:44:27.250 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:27.251 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:27.251 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "MOSDECSubOpWrite(3.fs4 68/30 ECSubWrite(tid=167, reqid=osd.11.0:167, at_version=68'36, trim_to=0'0, roll_forward_to=65'32))", 2024-04-18T14:44:27.251 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-04-18T14:44:07.413949+0000", 2024-04-18T14:44:27.251 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 19.809671032000001, 2024-04-18T14:44:27.251 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.02828085, 2024-04-18T14:44:27.251 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-04-18T14:44:27.251 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "reached pg", 2024-04-18T14:44:27.251 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-04-18T14:44:27.251 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:27.251 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-04-18T14:44:27.251 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:07.413949+0000", 2024-04-18T14:44:27.251 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:44:27.251 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:27.251 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:27.251 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-04-18T14:44:27.252 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:07.413949+0000", 2024-04-18T14:44:27.252 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:44:27.252 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:27.252 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:27.252 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-04-18T14:44:27.252 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:07.413947+0000", 2024-04-18T14:44:27.252 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4294967295.9999981 2024-04-18T14:44:27.252 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:27.252 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:27.252 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-04-18T14:44:27.252 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:07.414001+0000", 2024-04-18T14:44:27.252 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 5.3220000000000002e-05 2024-04-18T14:44:27.252 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:27.252 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:27.253 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-04-18T14:44:27.253 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:07.414034+0000", 2024-04-18T14:44:27.253 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.2985999999999999e-05 2024-04-18T14:44:27.253 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:27.253 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:27.253 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-04-18T14:44:27.253 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:07.414106+0000", 2024-04-18T14:44:27.253 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 7.2255999999999994e-05 2024-04-18T14:44:27.253 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:27.253 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:27.253 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-04-18T14:44:27.253 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:07.422158+0000", 2024-04-18T14:44:27.253 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0080523190000000005 2024-04-18T14:44:27.253 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:27.253 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:27.254 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_started", 2024-04-18T14:44:27.254 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:07.422185+0000", 2024-04-18T14:44:27.254 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.6928999999999999e-05 2024-04-18T14:44:27.254 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:27.254 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:27.254 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_committed", 2024-04-18T14:44:27.254 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:07.442178+0000", 2024-04-18T14:44:27.254 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.019992916999999999 2024-04-18T14:44:27.254 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:27.254 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:27.254 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-04-18T14:44:27.254 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:07.442230+0000", 2024-04-18T14:44:27.254 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 5.1990000000000002e-05 2024-04-18T14:44:27.254 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:44:27.254 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-04-18T14:44:27.255 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:44:27.255 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:27.255 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:27.255 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "MOSDECSubOpWriteReply(3.7s0 68/30 ECSubWriteReply(tid=203, last_complete=68'90, committed=1, applied=1))", 2024-04-18T14:44:27.255 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-04-18T14:44:07.417478+0000", 2024-04-18T14:44:27.255 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 19.806141838999999, 2024-04-18T14:44:27.255 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.023983576, 2024-04-18T14:44:27.255 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-04-18T14:44:27.255 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "reached pg", 2024-04-18T14:44:27.255 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-04-18T14:44:27.255 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:27.255 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-04-18T14:44:27.255 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:07.417478+0000", 2024-04-18T14:44:27.255 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:44:27.256 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:27.256 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:27.256 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-04-18T14:44:27.256 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:07.417478+0000", 2024-04-18T14:44:27.256 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:44:27.256 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:27.256 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:27.256 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-04-18T14:44:27.256 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:07.417477+0000", 2024-04-18T14:44:27.256 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4294967295.9999981 2024-04-18T14:44:27.256 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:27.256 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:27.256 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-04-18T14:44:27.256 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:07.417487+0000", 2024-04-18T14:44:27.256 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.076e-05 2024-04-18T14:44:27.257 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:27.257 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:27.257 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-04-18T14:44:27.257 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:07.417521+0000", 2024-04-18T14:44:27.257 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.3426999999999997e-05 2024-04-18T14:44:27.257 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:27.257 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:27.257 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-04-18T14:44:27.257 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:07.417541+0000", 2024-04-18T14:44:27.257 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.0296e-05 2024-04-18T14:44:27.257 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:27.257 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:27.257 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-04-18T14:44:27.257 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:07.441431+0000", 2024-04-18T14:44:27.257 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.023889924 2024-04-18T14:44:27.257 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:27.258 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:27.258 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-04-18T14:44:27.258 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:07.441462+0000", 2024-04-18T14:44:27.258 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.0892999999999997e-05 2024-04-18T14:44:27.258 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:44:27.258 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-04-18T14:44:27.258 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:44:27.258 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:27.258 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:27.258 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "MOSDECSubOpWriteReply(3.7s0 68/30 ECSubWriteReply(tid=203, last_complete=68'90, committed=1, applied=1))", 2024-04-18T14:44:27.258 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-04-18T14:44:07.418200+0000", 2024-04-18T14:44:27.258 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 19.805420441999999, 2024-04-18T14:44:27.258 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.023339612999999999, 2024-04-18T14:44:27.258 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-04-18T14:44:27.259 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "reached pg", 2024-04-18T14:44:27.259 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-04-18T14:44:27.259 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:27.259 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-04-18T14:44:27.259 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:07.418200+0000", 2024-04-18T14:44:27.259 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:44:27.259 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:27.259 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:27.259 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-04-18T14:44:27.259 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:07.418200+0000", 2024-04-18T14:44:27.259 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:44:27.259 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:27.259 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:27.259 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-04-18T14:44:27.259 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:07.418198+0000", 2024-04-18T14:44:27.260 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4294967295.9999981 2024-04-18T14:44:27.260 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:27.260 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:27.260 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-04-18T14:44:27.260 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:07.418211+0000", 2024-04-18T14:44:27.260 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.2993000000000001e-05 2024-04-18T14:44:27.260 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:27.260 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:27.260 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-04-18T14:44:27.260 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:07.418250+0000", 2024-04-18T14:44:27.260 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.8902999999999997e-05 2024-04-18T14:44:27.260 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:27.260 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:27.260 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-04-18T14:44:27.261 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:07.418270+0000", 2024-04-18T14:44:27.261 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.9749999999999999e-05 2024-04-18T14:44:27.261 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:27.261 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:27.261 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-04-18T14:44:27.261 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:07.441515+0000", 2024-04-18T14:44:27.261 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.023245717999999999 2024-04-18T14:44:27.261 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:27.261 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:27.261 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-04-18T14:44:27.261 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:07.441539+0000", 2024-04-18T14:44:27.261 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.3961999999999999e-05 2024-04-18T14:44:27.262 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:44:27.262 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-04-18T14:44:27.262 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:44:27.262 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:27.262 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:27.262 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(client.4559.0:739 3.6s0 3:6cb0c218:::smithi13430248-40:head [read 0~4620288,checksum,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e72)", 2024-04-18T14:44:27.262 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-04-18T14:44:11.755981+0000", 2024-04-18T14:44:27.262 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 15.46763949, 2024-04-18T14:44:27.262 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.047836126999999999, 2024-04-18T14:44:27.262 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-04-18T14:44:27.262 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "started", 2024-04-18T14:44:27.263 INFO:teuthology.orchestra.run.smithi119.stdout: "client_info": { 2024-04-18T14:44:27.263 INFO:teuthology.orchestra.run.smithi119.stdout: "client": "client.4559", 2024-04-18T14:44:27.263 INFO:teuthology.orchestra.run.smithi119.stdout: "client_addr": "172.21.15.134:0/3113589487", 2024-04-18T14:44:27.263 INFO:teuthology.orchestra.run.smithi119.stdout: "tid": 739 2024-04-18T14:44:27.263 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:27.263 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-04-18T14:44:27.263 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:27.263 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-04-18T14:44:27.263 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:11.755981+0000", 2024-04-18T14:44:27.263 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:44:27.263 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:27.263 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:27.264 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-04-18T14:44:27.264 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:11.755981+0000", 2024-04-18T14:44:27.264 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:44:27.264 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:27.264 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:27.264 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-04-18T14:44:27.264 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:11.755978+0000", 2024-04-18T14:44:27.264 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4294967295.9999976 2024-04-18T14:44:27.264 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:27.264 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:27.265 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-04-18T14:44:27.265 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:11.755990+0000", 2024-04-18T14:44:27.265 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.1939999999999999e-05 2024-04-18T14:44:27.265 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:27.265 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:27.265 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-04-18T14:44:27.265 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:11.756017+0000", 2024-04-18T14:44:27.265 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.6556000000000001e-05 2024-04-18T14:44:27.265 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:27.265 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:27.265 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-04-18T14:44:27.265 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:11.756030+0000", 2024-04-18T14:44:27.266 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.3634e-05 2024-04-18T14:44:27.266 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:27.266 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:27.266 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-04-18T14:44:27.266 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:11.756134+0000", 2024-04-18T14:44:27.266 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000103612 2024-04-18T14:44:27.266 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:27.266 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:27.266 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-04-18T14:44:27.266 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:11.756310+0000", 2024-04-18T14:44:27.266 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000176532 2024-04-18T14:44:27.267 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:27.267 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:27.267 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-04-18T14:44:27.267 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:11.803817+0000", 2024-04-18T14:44:27.267 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.047506449999999999 2024-04-18T14:44:27.267 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:44:27.267 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-04-18T14:44:27.267 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:44:27.267 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:27.267 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:27.267 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(client.4559.0:740 3.6s0 3:6cb0c218:::smithi13430248-40:head [read 0~4620288,checksum] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e72)", 2024-04-18T14:44:27.267 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-04-18T14:44:11.756052+0000", 2024-04-18T14:44:27.267 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 15.467568504000001, 2024-04-18T14:44:27.267 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.054222003999999997, 2024-04-18T14:44:27.268 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-04-18T14:44:27.268 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "started", 2024-04-18T14:44:27.268 INFO:teuthology.orchestra.run.smithi119.stdout: "client_info": { 2024-04-18T14:44:27.268 INFO:teuthology.orchestra.run.smithi119.stdout: "client": "client.4559", 2024-04-18T14:44:27.268 INFO:teuthology.orchestra.run.smithi119.stdout: "client_addr": "172.21.15.134:0/3113589487", 2024-04-18T14:44:27.268 INFO:teuthology.orchestra.run.smithi119.stdout: "tid": 740 2024-04-18T14:44:27.268 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:27.268 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-04-18T14:44:27.268 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:27.268 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-04-18T14:44:27.268 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:11.756052+0000", 2024-04-18T14:44:27.268 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:44:27.268 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:27.268 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:27.268 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-04-18T14:44:27.269 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:11.756052+0000", 2024-04-18T14:44:27.269 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:44:27.269 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:27.269 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:27.269 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-04-18T14:44:27.269 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:11.756050+0000", 2024-04-18T14:44:27.269 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4294967295.9999986 2024-04-18T14:44:27.269 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:27.269 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:27.269 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-04-18T14:44:27.269 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:11.756058+0000", 2024-04-18T14:44:27.269 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 7.9400000000000002e-06 2024-04-18T14:44:27.269 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:27.269 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:27.270 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-04-18T14:44:27.270 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:11.756087+0000", 2024-04-18T14:44:27.270 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.8799e-05 2024-04-18T14:44:27.270 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:27.270 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:27.270 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-04-18T14:44:27.270 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:11.756098+0000", 2024-04-18T14:44:27.270 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.1257000000000001e-05 2024-04-18T14:44:27.270 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:27.270 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:27.270 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-04-18T14:44:27.270 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:11.756813+0000", 2024-04-18T14:44:27.270 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00071503400000000003 2024-04-18T14:44:27.270 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:27.270 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:27.271 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-04-18T14:44:27.271 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:11.756990+0000", 2024-04-18T14:44:27.271 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000177162 2024-04-18T14:44:27.271 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:27.271 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:27.271 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-04-18T14:44:27.271 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:11.810274+0000", 2024-04-18T14:44:27.271 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.053283125000000001 2024-04-18T14:44:27.271 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:44:27.271 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-04-18T14:44:27.271 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:44:27.271 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:27.271 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:27.271 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(client.4559.0:741 3.6s0 3:6cb0c218:::smithi13430248-40:head [read 0~4620288,checksum] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e72)", 2024-04-18T14:44:27.271 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-04-18T14:44:11.756113+0000", 2024-04-18T14:44:27.272 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 15.467506991, 2024-04-18T14:44:27.272 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.058071340999999999, 2024-04-18T14:44:27.272 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-04-18T14:44:27.272 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "started", 2024-04-18T14:44:27.272 INFO:teuthology.orchestra.run.smithi119.stdout: "client_info": { 2024-04-18T14:44:27.272 INFO:teuthology.orchestra.run.smithi119.stdout: "client": "client.4559", 2024-04-18T14:44:27.272 INFO:teuthology.orchestra.run.smithi119.stdout: "client_addr": "172.21.15.134:0/3113589487", 2024-04-18T14:44:27.272 INFO:teuthology.orchestra.run.smithi119.stdout: "tid": 741 2024-04-18T14:44:27.272 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:27.272 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-04-18T14:44:27.272 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:27.272 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-04-18T14:44:27.272 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:11.756113+0000", 2024-04-18T14:44:27.272 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:44:27.272 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:27.273 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:27.273 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-04-18T14:44:27.273 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:11.756113+0000", 2024-04-18T14:44:27.273 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:44:27.273 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:27.273 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:27.273 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-04-18T14:44:27.273 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:11.756112+0000", 2024-04-18T14:44:27.273 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4294967295.999999 2024-04-18T14:44:27.273 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:27.273 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:27.273 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-04-18T14:44:27.273 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:11.756119+0000", 2024-04-18T14:44:27.273 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 7.4760000000000001e-06 2024-04-18T14:44:27.273 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:27.273 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:27.274 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-04-18T14:44:27.274 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:11.756137+0000", 2024-04-18T14:44:27.274 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.785e-05 2024-04-18T14:44:27.274 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:27.274 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:27.274 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-04-18T14:44:27.274 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:11.756152+0000", 2024-04-18T14:44:27.274 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.4917e-05 2024-04-18T14:44:27.274 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:27.274 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:27.274 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-04-18T14:44:27.274 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:11.757436+0000", 2024-04-18T14:44:27.274 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0012834299999999999 2024-04-18T14:44:27.274 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:27.275 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:27.275 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-04-18T14:44:27.275 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:11.757573+0000", 2024-04-18T14:44:27.275 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000137102 2024-04-18T14:44:27.275 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:27.275 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:27.275 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-04-18T14:44:27.275 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:11.814184+0000", 2024-04-18T14:44:27.275 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.056611692999999998 2024-04-18T14:44:27.275 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:44:27.275 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-04-18T14:44:27.275 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:44:27.275 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:27.275 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:27.275 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "MOSDECSubOpReadReply(3.6s0 72/70 ECSubReadReply(tid=262, attrs_read=0))", 2024-04-18T14:44:27.276 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-04-18T14:44:11.761136+0000", 2024-04-18T14:44:27.276 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 15.46248421, 2024-04-18T14:44:27.276 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.047821245999999998, 2024-04-18T14:44:27.276 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-04-18T14:44:27.276 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "reached pg", 2024-04-18T14:44:27.276 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-04-18T14:44:27.276 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:27.276 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-04-18T14:44:27.276 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:11.761136+0000", 2024-04-18T14:44:27.276 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:44:27.276 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:27.276 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:27.276 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-04-18T14:44:27.276 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:11.761136+0000", 2024-04-18T14:44:27.277 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:44:27.277 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:27.277 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:27.277 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-04-18T14:44:27.277 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:11.761135+0000", 2024-04-18T14:44:27.277 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4294967295.999999 2024-04-18T14:44:27.277 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:27.277 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:27.277 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-04-18T14:44:27.277 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:11.796983+0000", 2024-04-18T14:44:27.277 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.035847885000000003 2024-04-18T14:44:27.277 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:27.277 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:27.277 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-04-18T14:44:27.277 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:11.797014+0000", 2024-04-18T14:44:27.278 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.0700000000000001e-05 2024-04-18T14:44:27.278 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:27.278 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:27.278 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-04-18T14:44:27.278 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:11.797031+0000", 2024-04-18T14:44:27.278 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.7136e-05 2024-04-18T14:44:27.278 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:27.278 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:27.278 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-04-18T14:44:27.278 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:11.798153+0000", 2024-04-18T14:44:27.278 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.001122348 2024-04-18T14:44:27.278 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:27.278 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:27.278 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-04-18T14:44:27.278 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:11.808957+0000", 2024-04-18T14:44:27.279 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.010804123000000001 2024-04-18T14:44:27.279 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:44:27.279 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-04-18T14:44:27.279 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:44:27.279 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:27.279 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:27.279 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "MOSDECSubOpReadReply(3.6s0 72/70 ECSubReadReply(tid=264, attrs_read=0))", 2024-04-18T14:44:27.279 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-04-18T14:44:11.781826+0000", 2024-04-18T14:44:27.279 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 15.441794179, 2024-04-18T14:44:27.279 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.032528864999999997, 2024-04-18T14:44:27.279 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-04-18T14:44:27.279 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "reached pg", 2024-04-18T14:44:27.279 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-04-18T14:44:27.279 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:27.279 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-04-18T14:44:27.280 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:11.781826+0000", 2024-04-18T14:44:27.280 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:44:27.280 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:27.280 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:27.280 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-04-18T14:44:27.280 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:11.781826+0000", 2024-04-18T14:44:27.280 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:44:27.280 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:27.280 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:27.280 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-04-18T14:44:27.280 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:11.781825+0000", 2024-04-18T14:44:27.280 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4294967295.9999986 2024-04-18T14:44:27.280 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:27.280 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:27.280 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-04-18T14:44:27.280 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:11.809717+0000", 2024-04-18T14:44:27.281 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.02789206 2024-04-18T14:44:27.281 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:27.281 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:27.281 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-04-18T14:44:27.281 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:11.809749+0000", 2024-04-18T14:44:27.281 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.2772999999999999e-05 2024-04-18T14:44:27.281 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:27.281 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:27.281 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-04-18T14:44:27.281 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:11.809769+0000", 2024-04-18T14:44:27.281 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.9623000000000002e-05 2024-04-18T14:44:27.281 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:27.281 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:27.281 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-04-18T14:44:27.281 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:11.810656+0000", 2024-04-18T14:44:27.282 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00088651599999999995 2024-04-18T14:44:27.282 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:27.282 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:27.282 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-04-18T14:44:27.282 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:11.814355+0000", 2024-04-18T14:44:27.282 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0036992459999999998 2024-04-18T14:44:27.282 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:44:27.282 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-04-18T14:44:27.282 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:44:27.282 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:27.282 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:27.282 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(client.4559.0:799 3.7s0 3:ee42865b:::smithi13430248-46:head [copy-from ver 61] snapc 2b=[2b,2a,29,28,27,26,23,22,1e,1c,1a,16,14,13,11,2] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-18T14:44:27.282 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-04-18T14:44:15.568864+0000", 2024-04-18T14:44:27.282 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 11.654755697000001, 2024-04-18T14:44:27.283 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.029408185, 2024-04-18T14:44:27.283 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-04-18T14:44:27.283 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T14:44:27.283 INFO:teuthology.orchestra.run.smithi119.stdout: "client_info": { 2024-04-18T14:44:27.283 INFO:teuthology.orchestra.run.smithi119.stdout: "client": "client.4559", 2024-04-18T14:44:27.283 INFO:teuthology.orchestra.run.smithi119.stdout: "client_addr": "172.21.15.134:0/3113589487", 2024-04-18T14:44:27.283 INFO:teuthology.orchestra.run.smithi119.stdout: "tid": 799 2024-04-18T14:44:27.283 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:27.283 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-04-18T14:44:27.283 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:27.283 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-04-18T14:44:27.283 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:15.568864+0000", 2024-04-18T14:44:27.283 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:44:27.283 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:27.283 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:27.284 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-04-18T14:44:27.284 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:15.568864+0000", 2024-04-18T14:44:27.284 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:44:27.284 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:27.284 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:27.284 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-04-18T14:44:27.284 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:15.568863+0000", 2024-04-18T14:44:27.284 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4294967295.999999 2024-04-18T14:44:27.284 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:27.284 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:27.284 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-04-18T14:44:27.284 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:15.568871+0000", 2024-04-18T14:44:27.284 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 8.1499999999999999e-06 2024-04-18T14:44:27.284 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:27.284 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:27.284 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-04-18T14:44:27.285 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:15.568888+0000", 2024-04-18T14:44:27.285 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.6495999999999999e-05 2024-04-18T14:44:27.285 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:27.285 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:27.285 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-04-18T14:44:27.285 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:15.568906+0000", 2024-04-18T14:44:27.285 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.7773000000000001e-05 2024-04-18T14:44:27.285 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:27.285 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:27.285 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-04-18T14:44:27.285 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:15.569060+0000", 2024-04-18T14:44:27.285 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000154253 2024-04-18T14:44:27.285 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:27.285 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:27.285 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-04-18T14:44:27.286 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:15.569352+0000", 2024-04-18T14:44:27.286 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00029174399999999998 2024-04-18T14:44:27.286 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:27.286 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:27.286 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_started", 2024-04-18T14:44:27.286 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:15.586851+0000", 2024-04-18T14:44:27.286 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.017499486000000002 2024-04-18T14:44:27.286 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:27.286 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:27.286 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_committed", 2024-04-18T14:44:27.286 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:15.594173+0000", 2024-04-18T14:44:27.286 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0073216569999999996 2024-04-18T14:44:27.286 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:27.286 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:27.287 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-04-18T14:44:27.287 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:15.598149+0000", 2024-04-18T14:44:27.287 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0039762030000000002 2024-04-18T14:44:27.287 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:27.287 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:27.287 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-04-18T14:44:27.287 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:15.598273+0000", 2024-04-18T14:44:27.287 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00012354600000000001 2024-04-18T14:44:27.287 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:44:27.287 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-04-18T14:44:27.287 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:44:27.287 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:27.287 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:27.287 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(client.4559.0:800 3.7s0 3:ee42865b:::smithi13430248-46:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e76)", 2024-04-18T14:44:27.287 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-04-18T14:44:15.568946+0000", 2024-04-18T14:44:27.288 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 11.654673711000001, 2024-04-18T14:44:27.288 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.023785720999999999, 2024-04-18T14:44:27.288 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-04-18T14:44:27.288 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "started", 2024-04-18T14:44:27.288 INFO:teuthology.orchestra.run.smithi119.stdout: "client_info": { 2024-04-18T14:44:27.288 INFO:teuthology.orchestra.run.smithi119.stdout: "client": "client.4559", 2024-04-18T14:44:27.288 INFO:teuthology.orchestra.run.smithi119.stdout: "client_addr": "172.21.15.134:0/3113589487", 2024-04-18T14:44:27.288 INFO:teuthology.orchestra.run.smithi119.stdout: "tid": 800 2024-04-18T14:44:27.288 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:27.288 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-04-18T14:44:27.288 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:27.288 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-04-18T14:44:27.288 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:15.568946+0000", 2024-04-18T14:44:27.288 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:44:27.288 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:27.289 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:27.289 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-04-18T14:44:27.289 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:15.568946+0000", 2024-04-18T14:44:27.289 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:44:27.289 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:27.289 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:27.289 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-04-18T14:44:27.289 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:15.568945+0000", 2024-04-18T14:44:27.289 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4294967295.9999986 2024-04-18T14:44:27.289 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:27.289 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:27.289 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-04-18T14:44:27.289 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:15.568952+0000", 2024-04-18T14:44:27.289 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 7.5329999999999997e-06 2024-04-18T14:44:27.289 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:27.290 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:27.290 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-04-18T14:44:27.290 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:15.568971+0000", 2024-04-18T14:44:27.290 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.8397e-05 2024-04-18T14:44:27.290 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:27.290 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:27.290 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-04-18T14:44:27.290 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:15.568986+0000", 2024-04-18T14:44:27.290 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.484e-05 2024-04-18T14:44:27.290 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:27.290 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:27.290 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-04-18T14:44:27.290 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:15.569819+0000", 2024-04-18T14:44:27.290 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00083339299999999998 2024-04-18T14:44:27.291 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:27.291 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:27.291 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for blocked object", 2024-04-18T14:44:27.291 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:15.569959+0000", 2024-04-18T14:44:27.291 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00013939200000000001 2024-04-18T14:44:27.291 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:27.291 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:27.291 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-04-18T14:44:27.291 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:15.592207+0000", 2024-04-18T14:44:27.291 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.022248245999999999 2024-04-18T14:44:27.291 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:27.291 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:27.291 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-04-18T14:44:27.291 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:15.592473+0000", 2024-04-18T14:44:27.291 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00026622499999999998 2024-04-18T14:44:27.292 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:27.292 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:27.292 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-04-18T14:44:27.292 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:15.592732+0000", 2024-04-18T14:44:27.292 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00025914800000000001 2024-04-18T14:44:27.292 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:44:27.292 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-04-18T14:44:27.292 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:44:27.292 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:27.292 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:27.292 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(osd.6.22:4 3.6s0 3:67bcc71e:::smithi13430248-13:head [assert-version v81,copy-get max 8388608] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e77)", 2024-04-18T14:44:27.292 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-04-18T14:44:16.424597+0000", 2024-04-18T14:44:27.292 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 10.799023023, 2024-04-18T14:44:27.292 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.026918959999999999, 2024-04-18T14:44:27.293 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-04-18T14:44:27.293 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "started", 2024-04-18T14:44:27.293 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-04-18T14:44:27.293 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:27.293 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-04-18T14:44:27.293 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:16.424597+0000", 2024-04-18T14:44:27.293 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:44:27.293 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:27.293 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:27.293 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-04-18T14:44:27.293 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:16.424597+0000", 2024-04-18T14:44:27.293 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:44:27.293 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:27.293 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:27.293 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-04-18T14:44:27.294 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:16.424594+0000", 2024-04-18T14:44:27.294 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4294967295.9999971 2024-04-18T14:44:27.294 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:27.294 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:27.294 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-04-18T14:44:27.294 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:16.424616+0000", 2024-04-18T14:44:27.294 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.2204e-05 2024-04-18T14:44:27.294 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:27.294 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:27.294 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-04-18T14:44:27.294 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:16.424649+0000", 2024-04-18T14:44:27.294 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.2845999999999997e-05 2024-04-18T14:44:27.294 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:27.294 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:27.295 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-04-18T14:44:27.295 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:16.424670+0000", 2024-04-18T14:44:27.295 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.0760000000000001e-05 2024-04-18T14:44:27.295 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:27.295 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:27.295 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-04-18T14:44:27.295 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:16.424841+0000", 2024-04-18T14:44:27.295 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00017121200000000001 2024-04-18T14:44:27.295 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:27.295 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:27.295 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "op must wait for map", 2024-04-18T14:44:27.295 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:16.424859+0000", 2024-04-18T14:44:27.295 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.7592999999999999e-05 2024-04-18T14:44:27.295 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:27.296 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:27.296 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-04-18T14:44:27.296 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:16.431043+0000", 2024-04-18T14:44:27.296 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0061840330000000002 2024-04-18T14:44:27.296 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:27.296 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:27.296 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-04-18T14:44:27.296 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:16.431279+0000", 2024-04-18T14:44:27.296 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00023650099999999999 2024-04-18T14:44:27.296 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:27.296 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:27.296 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-04-18T14:44:27.296 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:16.451516+0000", 2024-04-18T14:44:27.296 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.020236771000000001 2024-04-18T14:44:27.297 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:44:27.297 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-04-18T14:44:27.297 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:44:27.297 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:27.297 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:27.297 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(client.4559.0:894 3.6s0 3:6c5ba706:::smithi13430248-4:head [copy-from ver 80] snapc 30=[30,2c,2b,2a,29,28,27,26,22,1e,1c,1a,14,13,11] ondisk+write+known_if_redirected+supports_pool_eio e81)", 2024-04-18T14:44:27.297 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-04-18T14:44:20.499598+0000", 2024-04-18T14:44:27.297 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 6.7240224980000001, 2024-04-18T14:44:27.297 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.041311764000000001, 2024-04-18T14:44:27.297 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-04-18T14:44:27.297 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T14:44:27.297 INFO:teuthology.orchestra.run.smithi119.stdout: "client_info": { 2024-04-18T14:44:27.297 INFO:teuthology.orchestra.run.smithi119.stdout: "client": "client.4559", 2024-04-18T14:44:27.297 INFO:teuthology.orchestra.run.smithi119.stdout: "client_addr": "172.21.15.134:0/3113589487", 2024-04-18T14:44:27.297 INFO:teuthology.orchestra.run.smithi119.stdout: "tid": 894 2024-04-18T14:44:27.298 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:27.298 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-04-18T14:44:27.298 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:27.298 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-04-18T14:44:27.298 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:20.499598+0000", 2024-04-18T14:44:27.298 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:44:27.298 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:27.298 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:27.298 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-04-18T14:44:27.298 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:20.499598+0000", 2024-04-18T14:44:27.298 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:44:27.298 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:27.298 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:27.298 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-04-18T14:44:27.298 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:20.499595+0000", 2024-04-18T14:44:27.299 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4294967295.9999971 2024-04-18T14:44:27.299 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:27.299 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:27.299 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-04-18T14:44:27.299 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:20.499610+0000", 2024-04-18T14:44:27.299 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.4836e-05 2024-04-18T14:44:27.299 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:27.299 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:27.299 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-04-18T14:44:27.299 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:20.499639+0000", 2024-04-18T14:44:27.299 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.9300000000000001e-05 2024-04-18T14:44:27.299 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:27.299 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:27.299 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-04-18T14:44:27.299 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:20.499652+0000", 2024-04-18T14:44:27.300 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.3383e-05 2024-04-18T14:44:27.300 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:27.300 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:27.300 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-04-18T14:44:27.300 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:20.499764+0000", 2024-04-18T14:44:27.300 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00011129999999999999 2024-04-18T14:44:27.300 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:27.300 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:27.300 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-04-18T14:44:27.300 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:20.501081+0000", 2024-04-18T14:44:27.300 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0013174930000000001 2024-04-18T14:44:27.300 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:27.300 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:27.300 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_started", 2024-04-18T14:44:27.300 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:20.528621+0000", 2024-04-18T14:44:27.301 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.027539599000000001 2024-04-18T14:44:27.301 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:27.301 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:27.301 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_committed", 2024-04-18T14:44:27.301 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:20.539815+0000", 2024-04-18T14:44:27.301 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.011194109000000001 2024-04-18T14:44:27.301 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:27.301 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:27.302 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-04-18T14:44:27.302 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:20.539993+0000", 2024-04-18T14:44:27.302 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00017821199999999999 2024-04-18T14:44:27.302 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:27.302 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:27.302 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-04-18T14:44:27.302 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:20.540909+0000", 2024-04-18T14:44:27.302 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00091628499999999997 2024-04-18T14:44:27.302 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:44:27.302 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-04-18T14:44:27.302 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:44:27.302 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:27.303 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:27.303 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(client.4559.0:895 3.6s0 3:6c5ba706:::smithi13430248-4:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e81)", 2024-04-18T14:44:27.303 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-04-18T14:44:20.499674+0000", 2024-04-18T14:44:27.303 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 6.7239460449999999, 2024-04-18T14:44:27.303 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.036387361, 2024-04-18T14:44:27.303 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-04-18T14:44:27.303 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "started", 2024-04-18T14:44:27.303 INFO:teuthology.orchestra.run.smithi119.stdout: "client_info": { 2024-04-18T14:44:27.303 INFO:teuthology.orchestra.run.smithi119.stdout: "client": "client.4559", 2024-04-18T14:44:27.303 INFO:teuthology.orchestra.run.smithi119.stdout: "client_addr": "172.21.15.134:0/3113589487", 2024-04-18T14:44:27.303 INFO:teuthology.orchestra.run.smithi119.stdout: "tid": 895 2024-04-18T14:44:27.303 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:27.303 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-04-18T14:44:27.303 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:27.303 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-04-18T14:44:27.304 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:20.499674+0000", 2024-04-18T14:44:27.304 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:44:27.304 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:27.304 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:27.304 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-04-18T14:44:27.304 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:20.499674+0000", 2024-04-18T14:44:27.304 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:44:27.304 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:27.304 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:27.304 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-04-18T14:44:27.304 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:20.499673+0000", 2024-04-18T14:44:27.304 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4294967295.999999 2024-04-18T14:44:27.305 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:27.305 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:27.305 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-04-18T14:44:27.305 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:20.499678+0000", 2024-04-18T14:44:27.305 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 5.1830000000000002e-06 2024-04-18T14:44:27.305 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:27.305 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:27.305 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-04-18T14:44:27.305 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:20.499692+0000", 2024-04-18T14:44:27.305 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.3862999999999999e-05 2024-04-18T14:44:27.305 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:27.305 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:27.305 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-04-18T14:44:27.306 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:20.499701+0000", 2024-04-18T14:44:27.306 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 8.9169999999999995e-06 2024-04-18T14:44:27.306 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:27.306 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:27.306 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-04-18T14:44:27.307 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:20.501567+0000", 2024-04-18T14:44:27.307 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0018663690000000001 2024-04-18T14:44:27.307 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:27.307 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:27.307 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for blocked object", 2024-04-18T14:44:27.307 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:20.501714+0000", 2024-04-18T14:44:27.307 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00014643300000000001 2024-04-18T14:44:27.307 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:27.307 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:27.307 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-04-18T14:44:27.307 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:20.535487+0000", 2024-04-18T14:44:27.307 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.033773034 2024-04-18T14:44:27.308 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:27.308 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:27.308 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-04-18T14:44:27.308 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:20.535775+0000", 2024-04-18T14:44:27.308 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00028772500000000001 2024-04-18T14:44:27.308 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:27.308 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:27.308 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-04-18T14:44:27.308 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:20.536061+0000", 2024-04-18T14:44:27.308 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00028691399999999998 2024-04-18T14:44:27.308 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:44:27.308 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-04-18T14:44:27.308 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:44:27.308 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:27.308 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:27.309 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(client.4559.0:912 3.7s0 3:ee42865b:::smithi13430248-46:head [rmxattr NdZr`e\\^kXiksh]\\XocenQrhYc]c`[proOfo`Pd^ in=40b,rmxattr [XmPqpoSg`fWjdlmQ_qabof]_WVcPaY[]k[ardgj in=40b,rmxattr \\hZXh`dT^W[c\\XodZZ_d\\QO\\\\[PVWthO_WVOPSQd in=40b,rmxattr `e\\rtQi]nmoP\\cm]oRYN`[]^qVUTsU^_oXm]h\\ec in=40b,rmxattr ctSOqNY_dUqTOjgXYjqgslgNRRPoT\\\\OXPPWrtt_ in=40b,rmxattr iRn][N_NY\\ZhmYdQ[[ptTP_NW^Z]_roZnOpcmR_Y in=40b,rmxattr qqUtZZ]ataUj_[pnh\\jVtU_dRpi^g[VPNeS`Y\\hk in=40b,rmxattr qsgedRfqdW]]cYbWOUgh^ZleaSQiteejr^afXbUj in=40b] snapc 30=[30,2c,2b,2a,29,28,27,26,22,1e,1c,1a,14,11] ondisk+write+known_if_redirected+supports_pool_eio e82)", 2024-04-18T14:44:27.309 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-04-18T14:44:21.456411+0000", 2024-04-18T14:44:27.309 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 5.7672091759999997, 2024-04-18T14:44:27.309 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.032929601000000003, 2024-04-18T14:44:27.309 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-04-18T14:44:27.309 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T14:44:27.309 INFO:teuthology.orchestra.run.smithi119.stdout: "client_info": { 2024-04-18T14:44:27.309 INFO:teuthology.orchestra.run.smithi119.stdout: "client": "client.4559", 2024-04-18T14:44:27.309 INFO:teuthology.orchestra.run.smithi119.stdout: "client_addr": "172.21.15.134:0/3113589487", 2024-04-18T14:44:27.309 INFO:teuthology.orchestra.run.smithi119.stdout: "tid": 912 2024-04-18T14:44:27.309 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:27.309 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-04-18T14:44:27.309 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:27.309 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-04-18T14:44:27.309 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:21.456411+0000", 2024-04-18T14:44:27.310 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:44:27.310 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:27.310 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:27.310 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-04-18T14:44:27.310 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:21.456411+0000", 2024-04-18T14:44:27.310 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:44:27.310 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:27.310 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:27.310 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-04-18T14:44:27.310 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:21.456408+0000", 2024-04-18T14:44:27.310 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4294967295.9999967 2024-04-18T14:44:27.310 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:27.310 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:27.310 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-04-18T14:44:27.310 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:21.456426+0000", 2024-04-18T14:44:27.311 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.8053000000000001e-05 2024-04-18T14:44:27.311 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:27.311 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:27.311 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-04-18T14:44:27.311 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:21.456462+0000", 2024-04-18T14:44:27.311 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.6327e-05 2024-04-18T14:44:27.311 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:27.311 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:27.311 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-04-18T14:44:27.311 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:21.456485+0000", 2024-04-18T14:44:27.311 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.2427000000000001e-05 2024-04-18T14:44:27.311 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:27.311 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:27.311 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-04-18T14:44:27.311 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:21.456656+0000", 2024-04-18T14:44:27.312 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00017180799999999999 2024-04-18T14:44:27.312 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:27.312 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:27.312 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "op must wait for map", 2024-04-18T14:44:27.312 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:21.456679+0000", 2024-04-18T14:44:27.312 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.2759999999999999e-05 2024-04-18T14:44:27.312 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:27.312 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:27.312 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-04-18T14:44:27.312 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:21.461652+0000", 2024-04-18T14:44:27.312 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0049729120000000003 2024-04-18T14:44:27.312 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:27.312 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:27.312 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-04-18T14:44:27.312 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:21.461941+0000", 2024-04-18T14:44:27.312 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00028901399999999998 2024-04-18T14:44:27.313 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:27.313 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:27.313 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_started", 2024-04-18T14:44:27.313 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:21.463937+0000", 2024-04-18T14:44:27.313 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.001995981 2024-04-18T14:44:27.313 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:27.313 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:27.313 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_committed", 2024-04-18T14:44:27.313 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:21.477181+0000", 2024-04-18T14:44:27.313 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.013244165 2024-04-18T14:44:27.313 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:27.313 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:27.313 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-04-18T14:44:27.313 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:21.489121+0000", 2024-04-18T14:44:27.314 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.011940159000000001 2024-04-18T14:44:27.314 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:27.314 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:27.314 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-04-18T14:44:27.314 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:21.489341+0000", 2024-04-18T14:44:27.314 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00021920199999999999 2024-04-18T14:44:27.314 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:44:27.314 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-04-18T14:44:27.314 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:44:27.314 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:44:27.314 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-04-18T14:44:27.314 INFO:teuthology.orchestra.run.smithi119.stdout:} 2024-04-18T14:44:27.316 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-04-18T14:44:27.316 INFO:tasks.ceph.osd.1.smithi096.stderr:2024-04-18T14:44:27.317+0000 7f56a7a98640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 24887) UID: 0 2024-04-18T14:44:27.417 INFO:tasks.ceph.osd.5.smithi096.stderr:2024-04-18T14:44:27.417+0000 7fc33f25b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 24889) UID: 0 2024-04-18T14:44:27.447 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-04-18T14:44:27.447 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [], 2024-04-18T14:44:27.447 INFO:teuthology.orchestra.run.smithi134.stdout: "num_ops": 0 2024-04-18T14:44:27.447 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-04-18T14:44:27.464 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-04-18T14:44:27.484 INFO:teuthology.orchestra.run.smithi086.stderr:noscrub is set 2024-04-18T14:44:27.486 INFO:tasks.rados.rados.0.smithi134.stdout:390: done (3 left) 2024-04-18T14:44:27.486 INFO:tasks.rados.rados.0.smithi134.stdout:391: done (2 left) 2024-04-18T14:44:27.486 INFO:tasks.rados.rados.0.smithi134.stdout:392: done (1 left) 2024-04-18T14:44:27.486 INFO:tasks.rados.rados.0.smithi134.stdout:393: done (0 left) 2024-04-18T14:44:27.486 INFO:tasks.rados.rados.0.smithi134.stdout:394: copy_from oid 31 from oid 35 current snap is 36 2024-04-18T14:44:27.486 INFO:tasks.rados.rados.0.smithi134.stdout:395: rollback oid 30 current snap is 36 2024-04-18T14:44:27.486 INFO:tasks.rados.rados.0.smithi134.stdout:rollback oid 30 to 35 2024-04-18T14:44:27.486 INFO:tasks.rados.rados.0.smithi134.stdout:396: read oid 7 snap -1 2024-04-18T14:44:27.486 INFO:tasks.rados.rados.0.smithi134.stdout:396: expect deleted 2024-04-18T14:44:27.486 INFO:tasks.rados.rados.0.smithi134.stdout:397: rollback oid 50 current snap is 36 2024-04-18T14:44:27.486 INFO:tasks.rados.rados.0.smithi134.stdout:rollback oid 50 to 26 2024-04-18T14:44:27.486 INFO:tasks.rados.rados.0.smithi134.stdout:398: read oid 42 snap -1 2024-04-18T14:44:27.486 INFO:tasks.rados.rados.0.smithi134.stdout:398: expect (ObjNum 141 snap 32 seq_num 141) 2024-04-18T14:44:27.487 INFO:tasks.rados.rados.0.smithi134.stdout:399: snap_create 2024-04-18T14:44:27.493 INFO:tasks.rados.rados.0.smithi134.stdout:397: finishing rollback tid 1 to smithi13430248-50 2024-04-18T14:44:27.493 INFO:tasks.rados.rados.0.smithi134.stdout:update_object_version oid 50 v 49 (ObjNum 49 snap 0 seq_num 7) dirty dne 2024-04-18T14:44:27.503 INFO:tasks.rados.rados.0.smithi134.stdout:395: finishing rollback tid 0 to smithi13430248-30 2024-04-18T14:44:27.504 INFO:tasks.rados.rados.0.smithi134.stdout:395: finishing rollback tid 1 to smithi13430248-30 2024-04-18T14:44:27.504 INFO:tasks.rados.rados.0.smithi134.stdout:395: finishing rollback tid 2 to smithi13430248-30 2024-04-18T14:44:27.504 INFO:tasks.rados.rados.0.smithi134.stdout:update_object_version oid 30 v 143 (ObjNum 87 snap 17 seq_num 87) dirty exists 2024-04-18T14:44:27.518 INFO:tasks.ceph.osd.6.smithi119.stderr:2024-04-18T14:44:27.518+0000 7fb7cb8bd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 24896) UID: 0 2024-04-18T14:44:27.536 INFO:tasks.rados.rados.0.smithi134.stdout:398: expect (ObjNum 141 snap 32 seq_num 141) 2024-04-18T14:44:27.586 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-04-18T14:44:27.586 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [], 2024-04-18T14:44:27.587 INFO:teuthology.orchestra.run.smithi134.stdout: "complaint_time": 30, 2024-04-18T14:44:27.587 INFO:teuthology.orchestra.run.smithi134.stdout: "num_blocked_ops": 0 2024-04-18T14:44:27.587 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-04-18T14:44:27.602 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-04-18T14:44:27.619 INFO:tasks.ceph.osd.0.smithi086.stderr:2024-04-18T14:44:27.617+0000 7f7cdfd78640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 24953) UID: 0 2024-04-18T14:44:27.628 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-18T14:44:27.720 INFO:tasks.ceph.osd.13.smithi096.stderr:2024-04-18T14:44:27.721+0000 7f7e72fad640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 13 (PID: 24893) UID: 0 2024-04-18T14:44:27.744 INFO:tasks.rados.rados.0.smithi134.stdout:394: finishing copy_from racing read to smithi13430248-31 2024-04-18T14:44:27.744 INFO:tasks.rados.rados.0.smithi134.stdout:394: finishing copy_from to smithi13430248-31 2024-04-18T14:44:27.744 INFO:tasks.rados.rados.0.smithi134.stdout:update_object_version oid 31 v 137 (ObjNum 127 snap 29 seq_num 127) dirty exists 2024-04-18T14:44:27.771 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-04-18T14:44:27.771 INFO:teuthology.orchestra.run.smithi134.stdout: "size": 20, 2024-04-18T14:44:27.771 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 600, 2024-04-18T14:44:27.771 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [ 2024-04-18T14:44:27.771 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:27.771 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4559.0:178 3.as0 3:504bbe78:::smithi13430248-37:head [append 0~507904] snapc 4=[4,3,2] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-04-18T14:44:27.772 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T14:43:35.731082+0000", 2024-04-18T14:44:27.772 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 52.042180610000003, 2024-04-18T14:44:27.772 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.015989092, 2024-04-18T14:44:27.772 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T14:44:27.772 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T14:44:27.772 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-18T14:44:27.772 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4559", 2024-04-18T14:44:27.772 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/3113589487", 2024-04-18T14:44:27.772 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 178 2024-04-18T14:44:27.772 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:27.772 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T14:44:27.772 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:27.772 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T14:44:27.772 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:35.731082+0000", 2024-04-18T14:44:27.772 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:44:27.772 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:27.773 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:27.773 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T14:44:27.773 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:35.731082+0000", 2024-04-18T14:44:27.773 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:44:27.773 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:27.773 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:27.773 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T14:44:27.773 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:35.731079+0000", 2024-04-18T14:44:27.773 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999971 2024-04-18T14:44:27.773 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:27.773 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:27.773 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T14:44:27.773 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:35.731663+0000", 2024-04-18T14:44:27.773 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00058377699999999995 2024-04-18T14:44:27.773 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:27.774 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:27.774 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T14:44:27.774 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:35.731697+0000", 2024-04-18T14:44:27.774 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.4578e-05 2024-04-18T14:44:27.774 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:27.774 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:27.774 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T14:44:27.774 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:35.731716+0000", 2024-04-18T14:44:27.774 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8413000000000001e-05 2024-04-18T14:44:27.774 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:27.774 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:27.774 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T14:44:27.774 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:35.731829+0000", 2024-04-18T14:44:27.775 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000113323 2024-04-18T14:44:27.775 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:27.775 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:27.775 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op must wait for map", 2024-04-18T14:44:27.775 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:35.731843+0000", 2024-04-18T14:44:27.775 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.4072e-05 2024-04-18T14:44:27.775 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:27.775 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:27.775 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T14:44:27.775 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:35.735773+0000", 2024-04-18T14:44:27.775 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0039293569999999996 2024-04-18T14:44:27.775 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:27.775 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:27.776 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T14:44:27.776 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:35.736021+0000", 2024-04-18T14:44:27.776 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00024879299999999997 2024-04-18T14:44:27.776 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:27.776 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:27.776 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_started", 2024-04-18T14:44:27.776 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:35.738679+0000", 2024-04-18T14:44:27.776 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0026578460000000002 2024-04-18T14:44:27.776 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:27.776 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:27.776 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_committed", 2024-04-18T14:44:27.777 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:35.745018+0000", 2024-04-18T14:44:27.777 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0063392070000000003 2024-04-18T14:44:27.777 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:27.777 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:27.777 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T14:44:27.777 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:35.746981+0000", 2024-04-18T14:44:27.777 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00196254 2024-04-18T14:44:27.777 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:27.777 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:27.777 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T14:44:27.777 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:35.747071+0000", 2024-04-18T14:44:27.777 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.0016e-05 2024-04-18T14:44:27.777 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:44:27.778 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T14:44:27.778 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:44:27.778 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:27.778 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:27.778 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4559.0:179 3.as0 3:504bbe78:::smithi13430248-37:head [append 0~376832] snapc 4=[4,3,2] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-04-18T14:44:27.778 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T14:43:35.735197+0000", 2024-04-18T14:44:27.778 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 52.038065793000001, 2024-04-18T14:44:27.778 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.013886849999999999, 2024-04-18T14:44:27.778 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T14:44:27.779 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T14:44:27.779 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-18T14:44:27.779 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4559", 2024-04-18T14:44:27.779 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/3113589487", 2024-04-18T14:44:27.779 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 179 2024-04-18T14:44:27.779 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:27.779 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T14:44:27.779 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:27.779 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T14:44:27.779 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:35.735197+0000", 2024-04-18T14:44:27.779 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:44:27.779 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:27.779 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:27.779 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T14:44:27.779 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:35.735197+0000", 2024-04-18T14:44:27.779 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:44:27.780 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:27.780 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:27.780 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T14:44:27.780 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:35.735193+0000", 2024-04-18T14:44:27.780 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999967 2024-04-18T14:44:27.780 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:27.780 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:27.780 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T14:44:27.780 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:35.735791+0000", 2024-04-18T14:44:27.780 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00059791 2024-04-18T14:44:27.780 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:27.780 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:27.780 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T14:44:27.780 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:35.735818+0000", 2024-04-18T14:44:27.780 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.6214e-05 2024-04-18T14:44:27.780 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:27.781 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:27.781 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T14:44:27.781 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:35.735834+0000", 2024-04-18T14:44:27.781 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6603999999999999e-05 2024-04-18T14:44:27.781 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:27.781 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:27.781 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T14:44:27.781 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:35.741060+0000", 2024-04-18T14:44:27.781 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0052256580000000002 2024-04-18T14:44:27.781 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:27.781 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:27.781 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T14:44:27.781 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:35.741402+0000", 2024-04-18T14:44:27.781 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00034264000000000001 2024-04-18T14:44:27.781 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:27.782 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:27.782 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_started", 2024-04-18T14:44:27.782 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:35.743027+0000", 2024-04-18T14:44:27.782 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0016244250000000001 2024-04-18T14:44:27.782 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:27.782 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:27.782 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_committed", 2024-04-18T14:44:27.782 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:35.746673+0000", 2024-04-18T14:44:27.782 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0036466189999999998 2024-04-18T14:44:27.783 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:27.783 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:27.783 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T14:44:27.783 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:35.749020+0000", 2024-04-18T14:44:27.783 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0023462439999999999 2024-04-18T14:44:27.783 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:27.783 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:27.783 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T14:44:27.784 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:35.749084+0000", 2024-04-18T14:44:27.784 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.3875999999999996e-05 2024-04-18T14:44:27.784 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:44:27.784 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T14:44:27.784 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:44:27.784 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:27.784 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:27.784 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4559.0:181 3.as0 3:504bbe78:::smithi13430248-37:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e36)", 2024-04-18T14:44:27.785 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T14:43:35.735904+0000", 2024-04-18T14:44:27.785 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 52.037358806, 2024-04-18T14:44:27.785 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.015807422000000002, 2024-04-18T14:44:27.785 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T14:44:27.785 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-04-18T14:44:27.785 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-18T14:44:27.785 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4559", 2024-04-18T14:44:27.785 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/3113589487", 2024-04-18T14:44:27.785 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 181 2024-04-18T14:44:27.785 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:27.785 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T14:44:27.785 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:27.785 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T14:44:27.786 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:35.735904+0000", 2024-04-18T14:44:27.786 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:44:27.786 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:27.786 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:27.786 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T14:44:27.786 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:35.735904+0000", 2024-04-18T14:44:27.786 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:44:27.786 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:27.786 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:27.786 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T14:44:27.786 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:35.735903+0000", 2024-04-18T14:44:27.786 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-18T14:44:27.786 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:27.786 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:27.787 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T14:44:27.787 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:35.735907+0000", 2024-04-18T14:44:27.787 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.1899999999999997e-06 2024-04-18T14:44:27.787 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:27.787 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:27.787 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T14:44:27.788 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:35.735920+0000", 2024-04-18T14:44:27.788 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2857000000000001e-05 2024-04-18T14:44:27.788 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:27.788 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:27.788 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T14:44:27.788 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:35.735927+0000", 2024-04-18T14:44:27.788 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.447e-06 2024-04-18T14:44:27.788 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:27.788 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:27.788 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T14:44:27.788 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:35.746529+0000", 2024-04-18T14:44:27.788 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.010601348 2024-04-18T14:44:27.789 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:27.789 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:27.789 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for rw locks", 2024-04-18T14:44:27.789 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:35.746655+0000", 2024-04-18T14:44:27.789 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000125823 2024-04-18T14:44:27.789 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:27.789 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:27.789 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T14:44:27.790 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:35.749858+0000", 2024-04-18T14:44:27.790 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0032038209999999999 2024-04-18T14:44:27.790 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:27.790 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:27.790 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T14:44:27.790 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:35.750001+0000", 2024-04-18T14:44:27.790 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000142602 2024-04-18T14:44:27.790 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:27.790 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:27.790 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T14:44:27.790 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:35.751711+0000", 2024-04-18T14:44:27.790 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0017101709999999999 2024-04-18T14:44:27.790 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:44:27.790 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T14:44:27.791 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:44:27.791 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:27.791 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:27.791 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4559.0:190 3.as0 3:5474a36d:::smithi13430248-11:head [delete] snapc 4=[4,2] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e37)", 2024-04-18T14:44:27.791 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T14:43:36.761006+0000", 2024-04-18T14:44:27.791 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 51.012256993999998, 2024-04-18T14:44:27.791 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.014529398000000001, 2024-04-18T14:44:27.791 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T14:44:27.791 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T14:44:27.791 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-18T14:44:27.791 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4559", 2024-04-18T14:44:27.791 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/3113589487", 2024-04-18T14:44:27.792 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 190 2024-04-18T14:44:27.792 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:27.792 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T14:44:27.792 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:27.792 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T14:44:27.792 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.761006+0000", 2024-04-18T14:44:27.792 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:44:27.792 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:27.792 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:27.792 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T14:44:27.792 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.761006+0000", 2024-04-18T14:44:27.792 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:44:27.792 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:27.792 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:27.792 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T14:44:27.793 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.761002+0000", 2024-04-18T14:44:27.793 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999967 2024-04-18T14:44:27.793 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:27.793 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:27.793 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T14:44:27.793 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.761018+0000", 2024-04-18T14:44:27.793 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5339999999999999e-05 2024-04-18T14:44:27.793 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:27.793 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:27.793 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T14:44:27.793 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.761058+0000", 2024-04-18T14:44:27.793 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.0197999999999997e-05 2024-04-18T14:44:27.793 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:27.793 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:27.793 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T14:44:27.793 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.761074+0000", 2024-04-18T14:44:27.794 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6646999999999998e-05 2024-04-18T14:44:27.794 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:27.794 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:27.794 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T14:44:27.794 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.761215+0000", 2024-04-18T14:44:27.794 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00014079399999999999 2024-04-18T14:44:27.794 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:27.794 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:27.794 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op must wait for map", 2024-04-18T14:44:27.794 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.761236+0000", 2024-04-18T14:44:27.794 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.105e-05 2024-04-18T14:44:27.794 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:27.794 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:27.794 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T14:44:27.795 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.765644+0000", 2024-04-18T14:44:27.795 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.004408159 2024-04-18T14:44:27.795 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:27.795 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:27.795 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T14:44:27.795 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.765818+0000", 2024-04-18T14:44:27.795 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00017385799999999999 2024-04-18T14:44:27.795 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:27.795 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:27.795 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_started", 2024-04-18T14:44:27.795 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.767388+0000", 2024-04-18T14:44:27.795 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0015693980000000001 2024-04-18T14:44:27.795 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:27.795 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:27.795 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_committed", 2024-04-18T14:44:27.796 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.774151+0000", 2024-04-18T14:44:27.796 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0067634050000000001 2024-04-18T14:44:27.796 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:27.796 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:27.796 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T14:44:27.796 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.775409+0000", 2024-04-18T14:44:27.796 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00125745 2024-04-18T14:44:27.796 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:27.796 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:27.796 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T14:44:27.796 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.775535+0000", 2024-04-18T14:44:27.796 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000126379 2024-04-18T14:44:27.796 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:44:27.796 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T14:44:27.796 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:44:27.796 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:27.797 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:27.797 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4559.0:244 3.as0 3:577932fb:::smithi13430248-41:head [read 0~688128,checksum,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-04-18T14:44:27.797 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T14:43:40.759326+0000", 2024-04-18T14:44:27.797 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 47.013936094999998, 2024-04-18T14:44:27.797 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.017168499, 2024-04-18T14:44:27.797 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T14:44:27.797 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-04-18T14:44:27.797 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-18T14:44:27.797 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4559", 2024-04-18T14:44:27.797 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/3113589487", 2024-04-18T14:44:27.797 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 244 2024-04-18T14:44:27.797 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:27.797 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T14:44:27.797 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:27.797 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T14:44:27.797 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:40.759326+0000", 2024-04-18T14:44:27.798 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:44:27.798 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:27.798 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:27.798 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T14:44:27.798 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:40.759326+0000", 2024-04-18T14:44:27.798 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:44:27.798 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:27.798 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:27.798 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T14:44:27.798 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:40.759323+0000", 2024-04-18T14:44:27.799 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999971 2024-04-18T14:44:27.799 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:27.799 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:27.799 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T14:44:27.799 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:40.759340+0000", 2024-04-18T14:44:27.799 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6344000000000001e-05 2024-04-18T14:44:27.799 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:27.799 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:27.799 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T14:44:27.799 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:40.759375+0000", 2024-04-18T14:44:27.800 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.5043999999999999e-05 2024-04-18T14:44:27.800 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:27.800 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:27.800 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T14:44:27.800 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:40.759392+0000", 2024-04-18T14:44:27.800 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6801000000000001e-05 2024-04-18T14:44:27.800 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:27.800 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:27.800 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T14:44:27.800 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:40.759518+0000", 2024-04-18T14:44:27.800 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00012620200000000001 2024-04-18T14:44:27.800 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:27.801 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:27.801 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op must wait for map", 2024-04-18T14:44:27.801 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:40.759537+0000", 2024-04-18T14:44:27.801 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.9670999999999999e-05 2024-04-18T14:44:27.801 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:27.801 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:27.801 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T14:44:27.801 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:40.764645+0000", 2024-04-18T14:44:27.801 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0051078240000000004 2024-04-18T14:44:27.801 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:27.801 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:27.801 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T14:44:27.801 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:40.764872+0000", 2024-04-18T14:44:27.802 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00022684499999999999 2024-04-18T14:44:27.802 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:27.802 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:27.802 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T14:44:27.802 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:40.776495+0000", 2024-04-18T14:44:27.802 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.011622791 2024-04-18T14:44:27.802 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:44:27.802 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T14:44:27.802 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:44:27.802 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:27.802 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:27.802 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4559.0:245 3.as0 3:577932fb:::smithi13430248-41:head [read 0~688128,checksum] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-04-18T14:44:27.802 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T14:43:40.759413+0000", 2024-04-18T14:44:27.802 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 47.013849383, 2024-04-18T14:44:27.803 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.017883375999999999, 2024-04-18T14:44:27.803 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T14:44:27.803 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-04-18T14:44:27.803 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-18T14:44:27.803 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4559", 2024-04-18T14:44:27.803 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/3113589487", 2024-04-18T14:44:27.803 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 245 2024-04-18T14:44:27.803 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:27.803 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T14:44:27.803 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:27.803 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T14:44:27.803 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:40.759413+0000", 2024-04-18T14:44:27.803 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:44:27.803 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:27.803 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:27.804 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T14:44:27.804 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:40.759413+0000", 2024-04-18T14:44:27.804 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:44:27.804 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:27.804 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:27.804 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T14:44:27.804 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:40.759412+0000", 2024-04-18T14:44:27.804 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999986 2024-04-18T14:44:27.804 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:27.804 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:27.804 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T14:44:27.804 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:40.759421+0000", 2024-04-18T14:44:27.804 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.3409999999999992e-06 2024-04-18T14:44:27.804 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:27.805 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:27.805 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T14:44:27.805 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:40.759440+0000", 2024-04-18T14:44:27.805 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8467000000000001e-05 2024-04-18T14:44:27.805 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:27.805 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:27.805 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T14:44:27.805 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:40.759454+0000", 2024-04-18T14:44:27.805 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.4113e-05 2024-04-18T14:44:27.805 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:27.805 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:27.805 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T14:44:27.805 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:40.759694+0000", 2024-04-18T14:44:27.805 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00023988199999999999 2024-04-18T14:44:27.805 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:27.806 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:27.806 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting_for_map not empty", 2024-04-18T14:44:27.806 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:40.759711+0000", 2024-04-18T14:44:27.806 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6988000000000001e-05 2024-04-18T14:44:27.806 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:27.806 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:27.806 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T14:44:27.806 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:40.766045+0000", 2024-04-18T14:44:27.806 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0063342169999999996 2024-04-18T14:44:27.806 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:27.806 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:27.806 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T14:44:27.806 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:40.766299+0000", 2024-04-18T14:44:27.806 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00025419199999999998 2024-04-18T14:44:27.806 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:27.807 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:27.807 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T14:44:27.807 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:40.777297+0000", 2024-04-18T14:44:27.807 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.010997536 2024-04-18T14:44:27.807 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:44:27.807 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T14:44:27.807 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:44:27.807 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:27.807 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:27.807 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4559.0:246 3.as0 3:577932fb:::smithi13430248-41:head [read 0~688128,checksum] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-04-18T14:44:27.807 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T14:43:40.759528+0000", 2024-04-18T14:44:27.807 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 47.013734206000002, 2024-04-18T14:44:27.807 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.019049244, 2024-04-18T14:44:27.807 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T14:44:27.807 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-04-18T14:44:27.808 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-18T14:44:27.808 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4559", 2024-04-18T14:44:27.808 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/3113589487", 2024-04-18T14:44:27.808 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 246 2024-04-18T14:44:27.808 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:27.808 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T14:44:27.808 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:27.808 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T14:44:27.808 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:40.759528+0000", 2024-04-18T14:44:27.808 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:44:27.808 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:27.809 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:27.809 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T14:44:27.809 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:40.759528+0000", 2024-04-18T14:44:27.809 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:44:27.809 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:27.809 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:27.809 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T14:44:27.809 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:40.759527+0000", 2024-04-18T14:44:27.809 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999986 2024-04-18T14:44:27.809 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:27.809 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:27.809 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T14:44:27.810 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:40.759536+0000", 2024-04-18T14:44:27.810 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.1540000000000008e-06 2024-04-18T14:44:27.810 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:27.810 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:27.810 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T14:44:27.810 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:40.759555+0000", 2024-04-18T14:44:27.810 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.9133000000000001e-05 2024-04-18T14:44:27.810 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:27.811 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:27.811 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T14:44:27.811 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:40.759570+0000", 2024-04-18T14:44:27.811 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5017999999999999e-05 2024-04-18T14:44:27.811 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:27.811 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:27.811 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T14:44:27.812 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:40.759776+0000", 2024-04-18T14:44:27.812 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000205577 2024-04-18T14:44:27.812 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:27.812 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:27.812 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting_for_map not empty", 2024-04-18T14:44:27.812 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:40.759792+0000", 2024-04-18T14:44:27.812 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6381000000000001e-05 2024-04-18T14:44:27.813 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:27.813 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:27.813 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T14:44:27.813 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:40.767014+0000", 2024-04-18T14:44:27.813 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0072223299999999999 2024-04-18T14:44:27.813 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:27.813 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:27.813 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T14:44:27.814 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:40.767254+0000", 2024-04-18T14:44:27.814 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00023931899999999999 2024-04-18T14:44:27.814 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:27.814 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:27.814 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T14:44:27.814 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:40.778578+0000", 2024-04-18T14:44:27.815 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.011323796000000001 2024-04-18T14:44:27.815 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:44:27.815 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T14:44:27.815 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:44:27.815 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:27.815 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:27.815 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4559.0:362 3.as0 3:5474a36d:::smithi13430248-11:head [append 0~0] snapc 13=[13,11,f,b,a,8,7,2] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-04-18T14:44:27.816 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T14:43:50.376205+0000", 2024-04-18T14:44:27.816 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 37.397057554, 2024-04-18T14:44:27.816 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.013968441, 2024-04-18T14:44:27.816 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T14:44:27.816 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T14:44:27.816 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-18T14:44:27.816 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4559", 2024-04-18T14:44:27.817 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/3113589487", 2024-04-18T14:44:27.817 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 362 2024-04-18T14:44:27.817 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:27.817 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T14:44:27.817 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:27.817 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T14:44:27.818 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:50.376205+0000", 2024-04-18T14:44:27.818 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:44:27.818 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:27.818 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:27.818 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T14:44:27.818 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:50.376205+0000", 2024-04-18T14:44:27.818 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:44:27.819 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:27.819 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:27.819 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T14:44:27.819 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:50.376202+0000", 2024-04-18T14:44:27.819 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999971 2024-04-18T14:44:27.819 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:27.819 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:27.820 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T14:44:27.820 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:50.376220+0000", 2024-04-18T14:44:27.820 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.7876999999999998e-05 2024-04-18T14:44:27.820 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:27.820 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:27.820 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T14:44:27.821 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:50.376256+0000", 2024-04-18T14:44:27.821 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.6384000000000003e-05 2024-04-18T14:44:27.821 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:27.821 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:27.821 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T14:44:27.821 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:50.376274+0000", 2024-04-18T14:44:27.821 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.7727000000000002e-05 2024-04-18T14:44:27.822 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:27.822 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:27.822 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T14:44:27.822 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:50.376445+0000", 2024-04-18T14:44:27.822 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000171046 2024-04-18T14:44:27.822 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:27.823 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:27.823 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op must wait for map", 2024-04-18T14:44:27.823 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:50.376460+0000", 2024-04-18T14:44:27.823 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.4620000000000001e-05 2024-04-18T14:44:27.823 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:27.823 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:27.823 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T14:44:27.823 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:50.381860+0000", 2024-04-18T14:44:27.823 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0054002199999999998 2024-04-18T14:44:27.823 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:27.824 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:27.824 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T14:44:27.824 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:50.382042+0000", 2024-04-18T14:44:27.824 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00018185900000000001 2024-04-18T14:44:27.824 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:27.824 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:27.824 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_started", 2024-04-18T14:44:27.824 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:50.383954+0000", 2024-04-18T14:44:27.824 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0019126530000000001 2024-04-18T14:44:27.824 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:27.824 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:27.825 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_committed", 2024-04-18T14:44:27.825 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:50.389758+0000", 2024-04-18T14:44:27.825 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.005803702 2024-04-18T14:44:27.825 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:27.825 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:27.825 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T14:44:27.825 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:50.390098+0000", 2024-04-18T14:44:27.825 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00033984400000000001 2024-04-18T14:44:27.825 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:27.825 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:27.825 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T14:44:27.825 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:50.390173+0000", 2024-04-18T14:44:27.825 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.5581999999999996e-05 2024-04-18T14:44:27.825 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:44:27.826 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T14:44:27.826 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:44:27.826 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:27.826 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:27.826 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4559.0:363 3.as0 3:5474a36d:::smithi13430248-11:head [rollback 7] snapc 13=[13,11,f,b,a,8,7,2] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-04-18T14:44:27.826 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T14:43:50.376296+0000", 2024-04-18T14:44:27.826 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 37.396966652000003, 2024-04-18T14:44:27.826 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.015443114000000001, 2024-04-18T14:44:27.826 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T14:44:27.826 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T14:44:27.826 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-18T14:44:27.826 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4559", 2024-04-18T14:44:27.826 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/3113589487", 2024-04-18T14:44:27.827 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 363 2024-04-18T14:44:27.827 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:27.827 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T14:44:27.827 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:27.827 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T14:44:27.827 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:50.376296+0000", 2024-04-18T14:44:27.827 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:44:27.827 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:27.827 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:27.827 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T14:44:27.827 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:50.376296+0000", 2024-04-18T14:44:27.827 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:44:27.827 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:27.827 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:27.827 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T14:44:27.827 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:50.376295+0000", 2024-04-18T14:44:27.828 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-18T14:44:27.828 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:27.828 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:27.828 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T14:44:27.828 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:50.376300+0000", 2024-04-18T14:44:27.828 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.7199999999999997e-06 2024-04-18T14:44:27.828 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:27.828 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:27.828 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T14:44:27.828 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:50.376333+0000", 2024-04-18T14:44:27.828 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.3315999999999997e-05 2024-04-18T14:44:27.828 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:27.828 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:27.828 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T14:44:27.829 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:50.376343+0000", 2024-04-18T14:44:27.829 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0346999999999999e-05 2024-04-18T14:44:27.829 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:27.829 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:27.829 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T14:44:27.829 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:50.376596+0000", 2024-04-18T14:44:27.829 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00025260099999999998 2024-04-18T14:44:27.829 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:27.829 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:27.829 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting_for_map not empty", 2024-04-18T14:44:27.829 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:50.376611+0000", 2024-04-18T14:44:27.829 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5594e-05 2024-04-18T14:44:27.829 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:27.830 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:27.830 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T14:44:27.830 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:50.385330+0000", 2024-04-18T14:44:27.830 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0087181299999999993 2024-04-18T14:44:27.830 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:27.830 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:27.830 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T14:44:27.830 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:50.385574+0000", 2024-04-18T14:44:27.830 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00024469699999999999 2024-04-18T14:44:27.830 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:27.830 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:27.830 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_started", 2024-04-18T14:44:27.830 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:50.386969+0000", 2024-04-18T14:44:27.830 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0013943639999999999 2024-04-18T14:44:27.830 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:27.831 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:27.831 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_committed", 2024-04-18T14:44:27.831 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:50.389892+0000", 2024-04-18T14:44:27.831 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0029229059999999999 2024-04-18T14:44:27.831 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:27.831 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:27.831 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T14:44:27.831 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:50.391671+0000", 2024-04-18T14:44:27.831 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0017797080000000001 2024-04-18T14:44:27.831 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:27.831 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:27.831 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T14:44:27.831 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:50.391739+0000", 2024-04-18T14:44:27.831 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.7756999999999995e-05 2024-04-18T14:44:27.831 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:44:27.832 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T14:44:27.832 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:44:27.832 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:27.832 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:27.832 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(osd.5.24:3 3.as0 3:577932fb:::smithi13430248-41:head [assert-version v61,copy-get max 8388608] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e76)", 2024-04-18T14:44:27.832 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T14:44:15.397713+0000", 2024-04-18T14:44:27.832 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 12.375549819, 2024-04-18T14:44:27.832 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.018961802, 2024-04-18T14:44:27.832 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T14:44:27.832 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-04-18T14:44:27.832 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T14:44:27.832 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:27.833 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T14:44:27.833 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:15.397713+0000", 2024-04-18T14:44:27.833 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:44:27.833 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:27.833 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:27.833 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T14:44:27.833 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:15.397713+0000", 2024-04-18T14:44:27.833 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:44:27.833 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:27.833 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:27.834 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T14:44:27.834 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:15.397709+0000", 2024-04-18T14:44:27.834 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999962 2024-04-18T14:44:27.834 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:27.834 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:27.834 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T14:44:27.834 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:15.397726+0000", 2024-04-18T14:44:27.834 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.7257000000000001e-05 2024-04-18T14:44:27.834 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:27.834 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:27.834 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T14:44:27.834 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:15.397758+0000", 2024-04-18T14:44:27.835 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.2066000000000001e-05 2024-04-18T14:44:27.835 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:27.835 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:27.835 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T14:44:27.835 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:15.397780+0000", 2024-04-18T14:44:27.835 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2047000000000001e-05 2024-04-18T14:44:27.835 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:27.835 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:27.835 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T14:44:27.835 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:15.397929+0000", 2024-04-18T14:44:27.835 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000148512 2024-04-18T14:44:27.835 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:27.835 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:27.835 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op must wait for map", 2024-04-18T14:44:27.835 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:15.397949+0000", 2024-04-18T14:44:27.836 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0089e-05 2024-04-18T14:44:27.836 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:27.836 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:27.836 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T14:44:27.836 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:15.404337+0000", 2024-04-18T14:44:27.836 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0063883309999999997 2024-04-18T14:44:27.836 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:27.836 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:27.836 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T14:44:27.836 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:15.404582+0000", 2024-04-18T14:44:27.836 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00024442099999999998 2024-04-18T14:44:27.836 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:27.836 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:27.836 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T14:44:27.836 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:15.416675+0000", 2024-04-18T14:44:27.837 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.012092696 2024-04-18T14:44:27.837 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:44:27.837 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T14:44:27.837 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:44:27.837 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:27.837 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:27.837 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(osd.8.23:2 3.as0 3:504bbe78:::smithi13430248-37:head [assert-version v32,copy-get max 8388608] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e76)", 2024-04-18T14:44:27.837 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T14:44:15.399336+0000", 2024-04-18T14:44:27.837 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 12.373926131999999, 2024-04-18T14:44:27.837 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.019313883, 2024-04-18T14:44:27.837 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T14:44:27.837 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-04-18T14:44:27.837 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T14:44:27.837 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:27.837 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T14:44:27.838 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:15.399336+0000", 2024-04-18T14:44:27.838 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:44:27.838 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:27.838 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:27.838 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T14:44:27.838 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:15.399336+0000", 2024-04-18T14:44:27.838 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:44:27.838 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:27.838 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:27.838 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T14:44:27.838 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:15.399334+0000", 2024-04-18T14:44:27.838 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999981 2024-04-18T14:44:27.838 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:27.838 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:27.839 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T14:44:27.839 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:15.399348+0000", 2024-04-18T14:44:27.839 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.4032999999999999e-05 2024-04-18T14:44:27.839 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:27.839 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:27.839 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T14:44:27.839 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:15.399377+0000", 2024-04-18T14:44:27.839 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.8430000000000001e-05 2024-04-18T14:44:27.839 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:27.839 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:27.840 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T14:44:27.840 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:15.399398+0000", 2024-04-18T14:44:27.840 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0786999999999999e-05 2024-04-18T14:44:27.840 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:27.840 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:27.840 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T14:44:27.840 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:15.399497+0000", 2024-04-18T14:44:27.840 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.9265999999999995e-05 2024-04-18T14:44:27.840 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:27.840 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:27.840 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op must wait for map", 2024-04-18T14:44:27.840 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:15.399515+0000", 2024-04-18T14:44:27.840 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8416000000000001e-05 2024-04-18T14:44:27.840 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:27.840 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:27.840 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T14:44:27.841 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:15.406474+0000", 2024-04-18T14:44:27.841 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0069583800000000001 2024-04-18T14:44:27.841 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:27.841 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:27.841 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T14:44:27.841 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:15.406675+0000", 2024-04-18T14:44:27.841 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00020107799999999999 2024-04-18T14:44:27.841 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:27.841 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:27.841 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T14:44:27.841 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:15.418650+0000", 2024-04-18T14:44:27.841 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.01197555 2024-04-18T14:44:27.841 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:44:27.841 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T14:44:27.841 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:44:27.842 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:27.842 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:27.842 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "MOSDECSubOpWriteReply(3.as0 82/70 ECSubWriteReply(tid=111, last_complete=82'77, committed=1, applied=1))", 2024-04-18T14:44:27.842 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T14:44:21.466330+0000", 2024-04-18T14:44:27.842 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 6.3069324140000003, 2024-04-18T14:44:27.842 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.014367962, 2024-04-18T14:44:27.842 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T14:44:27.842 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-04-18T14:44:27.842 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T14:44:27.842 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:27.842 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T14:44:27.842 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:21.466330+0000", 2024-04-18T14:44:27.842 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:44:27.842 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:27.843 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:27.843 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T14:44:27.843 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:21.466330+0000", 2024-04-18T14:44:27.843 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:44:27.843 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:27.843 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:27.843 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T14:44:27.843 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:21.466329+0000", 2024-04-18T14:44:27.843 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999986 2024-04-18T14:44:27.843 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:27.843 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:27.843 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T14:44:27.843 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:21.466338+0000", 2024-04-18T14:44:27.843 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.2720000000000003e-06 2024-04-18T14:44:27.843 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:27.844 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:27.844 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T14:44:27.844 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:21.466365+0000", 2024-04-18T14:44:27.844 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.7314999999999999e-05 2024-04-18T14:44:27.844 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:27.844 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:27.844 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T14:44:27.844 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:21.466378+0000", 2024-04-18T14:44:27.844 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2736e-05 2024-04-18T14:44:27.844 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:27.845 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:27.845 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T14:44:27.845 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:21.480669+0000", 2024-04-18T14:44:27.845 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.014291109999999999 2024-04-18T14:44:27.845 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:27.845 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:27.845 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T14:44:27.845 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:21.480698+0000", 2024-04-18T14:44:27.845 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.9047000000000002e-05 2024-04-18T14:44:27.845 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:44:27.845 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T14:44:27.845 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:44:27.845 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:27.845 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:27.846 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "MOSDECSubOpWriteReply(3.as0 82/70 ECSubWriteReply(tid=111, last_complete=82'77, committed=1, applied=1))", 2024-04-18T14:44:27.846 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T14:44:21.466700+0000", 2024-04-18T14:44:27.846 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 6.3065626669999997, 2024-04-18T14:44:27.846 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.014031893, 2024-04-18T14:44:27.846 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T14:44:27.846 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-04-18T14:44:27.846 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T14:44:27.846 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:27.846 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T14:44:27.846 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:21.466700+0000", 2024-04-18T14:44:27.846 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:44:27.847 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:27.847 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:27.847 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T14:44:27.847 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:21.466700+0000", 2024-04-18T14:44:27.847 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:44:27.847 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:27.847 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:27.848 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T14:44:27.848 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:21.466698+0000", 2024-04-18T14:44:27.848 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999981 2024-04-18T14:44:27.848 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:27.848 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:27.848 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T14:44:27.848 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:21.466712+0000", 2024-04-18T14:44:27.849 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.4086e-05 2024-04-18T14:44:27.849 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:27.849 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:27.849 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T14:44:27.849 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:21.466744+0000", 2024-04-18T14:44:27.849 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.1566000000000002e-05 2024-04-18T14:44:27.849 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:27.849 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:27.849 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T14:44:27.849 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:21.466767+0000", 2024-04-18T14:44:27.849 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.3873e-05 2024-04-18T14:44:27.849 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:27.849 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:27.849 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T14:44:27.849 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:21.480722+0000", 2024-04-18T14:44:27.850 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.013954599999999999 2024-04-18T14:44:27.850 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:27.850 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:27.850 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T14:44:27.850 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:21.480732+0000", 2024-04-18T14:44:27.850 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.7280000000000007e-06 2024-04-18T14:44:27.850 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:44:27.851 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T14:44:27.851 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:44:27.851 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:27.851 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:27.851 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "MOSDECSubOpWrite(3.2s2 82/70 ECSubWrite(tid=299, reqid=osd.13.0:299, at_version=82'58, trim_to=0'0, roll_forward_to=80'56))", 2024-04-18T14:44:27.851 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T14:44:21.471365+0000", 2024-04-18T14:44:27.851 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 6.3018971209999997, 2024-04-18T14:44:27.851 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.022502139000000001, 2024-04-18T14:44:27.851 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T14:44:27.851 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-04-18T14:44:27.851 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T14:44:27.851 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:27.851 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T14:44:27.851 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:21.471365+0000", 2024-04-18T14:44:27.851 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:44:27.852 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:27.852 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:27.852 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T14:44:27.852 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:21.471365+0000", 2024-04-18T14:44:27.852 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:44:27.852 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:27.852 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:27.852 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T14:44:27.852 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:21.471365+0000", 2024-04-18T14:44:27.852 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-18T14:44:27.852 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:27.852 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:27.852 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T14:44:27.852 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:21.471418+0000", 2024-04-18T14:44:27.852 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.3282999999999998e-05 2024-04-18T14:44:27.852 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:27.853 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:27.853 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T14:44:27.853 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:21.471448+0000", 2024-04-18T14:44:27.853 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.0514e-05 2024-04-18T14:44:27.853 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:27.853 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:27.853 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T14:44:27.853 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:21.471471+0000", 2024-04-18T14:44:27.853 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2909e-05 2024-04-18T14:44:27.853 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:27.853 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:27.853 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T14:44:27.853 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:21.480801+0000", 2024-04-18T14:44:27.853 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0093300699999999993 2024-04-18T14:44:27.854 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:27.854 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:27.854 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_started", 2024-04-18T14:44:27.854 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:21.480810+0000", 2024-04-18T14:44:27.854 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.816e-06 2024-04-18T14:44:27.854 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:27.854 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:27.854 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_committed", 2024-04-18T14:44:27.854 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:21.493808+0000", 2024-04-18T14:44:27.854 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.012997981 2024-04-18T14:44:27.854 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:27.854 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:27.854 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T14:44:27.854 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:21.493868+0000", 2024-04-18T14:44:27.855 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.9305999999999998e-05 2024-04-18T14:44:27.855 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:44:27.855 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T14:44:27.855 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:44:27.855 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:27.855 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:27.855 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "MOSDECSubOpWrite(3.2s2 82/70 ECSubWrite(tid=300, reqid=osd.13.0:300, at_version=82'60, trim_to=0'0, roll_forward_to=80'56))", 2024-04-18T14:44:27.855 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T14:44:21.474342+0000", 2024-04-18T14:44:27.855 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 6.2989202110000004, 2024-04-18T14:44:27.856 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.020703926000000001, 2024-04-18T14:44:27.856 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T14:44:27.856 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-04-18T14:44:27.856 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T14:44:27.856 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:27.856 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T14:44:27.856 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:21.474342+0000", 2024-04-18T14:44:27.856 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:44:27.856 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:27.856 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:27.856 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T14:44:27.856 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:21.474342+0000", 2024-04-18T14:44:27.856 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:44:27.856 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:27.856 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:27.856 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T14:44:27.857 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:21.474341+0000", 2024-04-18T14:44:27.857 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999986 2024-04-18T14:44:27.857 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:27.857 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:27.857 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T14:44:27.857 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:21.474395+0000", 2024-04-18T14:44:27.857 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.4237000000000003e-05 2024-04-18T14:44:27.857 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:27.857 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:27.857 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T14:44:27.857 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:21.474422+0000", 2024-04-18T14:44:27.857 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.6523e-05 2024-04-18T14:44:27.857 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:27.857 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:27.857 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T14:44:27.858 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:21.474443+0000", 2024-04-18T14:44:27.858 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.1667000000000001e-05 2024-04-18T14:44:27.858 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:27.858 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:27.858 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T14:44:27.858 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:21.483888+0000", 2024-04-18T14:44:27.858 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0094445190000000002 2024-04-18T14:44:27.858 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:27.858 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:27.858 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_started", 2024-04-18T14:44:27.858 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:21.483912+0000", 2024-04-18T14:44:27.858 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.4054e-05 2024-04-18T14:44:27.858 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:27.859 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:27.859 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_committed", 2024-04-18T14:44:27.859 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:21.494987+0000", 2024-04-18T14:44:27.859 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.011075234 2024-04-18T14:44:27.859 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:27.859 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:27.859 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T14:44:27.859 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:21.495046+0000", 2024-04-18T14:44:27.859 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.9212000000000002e-05 2024-04-18T14:44:27.859 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:44:27.859 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T14:44:27.859 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:44:27.859 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:27.859 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:27.859 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4559.0:926 3.as0 3:577932fb:::smithi13430248-41:head [create,setxattr ntQVt[arV\\sZ (12980) in=12b,setxattr cbiTQrXTtN[rcsXX]e`cSaeckYftjjZYtT\\Q^igZ (947) in=40b,setxattr Ncc_QolebZhUSbdoam]TtS[WPO`dcS`[mQ]`jeUq (13680) in=40b,setxattr aaW^bm`niOo[qYndkoRPSTsgTRVZsjTbdqNTWSbq (139) in=40b,setxattr ^mjiNm[Oc`m`tdgmetjcaYsTRWfVX[Y]OrieZYts (4560) in=40b,setxattr a_tYdUeqQ\\TlaV]SnRrNNZnbQiX\\r^ocf\\YnUjhY (15364) in=40b,setxattr mQh]P]enrma\\V`gdWlZagTV^ (12980) in=24b,setxattr tOhOYXahpesOiNUhkPgPbV`fUejZib__YUhaXTTR (1051) in=40b,setxattr ZZc]SnhtrtmognZg[mgTlar`PsaWsenZek`Qf`eY (1049) in=40b,setxattr hUURNtkOoXqXi]eatXq^SUacfR`Q]k[iiNgbi` (12980) in=38b,setxattr aQVfqQ[ifabWts (12980) in=14b,setxattr tY]sPTr\\QlZbSqcPigYORZQpfels`mkh^Pkner\\] (805) in=40b,setxattr \\RsX`is\\W_nOa_UaifQU[aaoOZRre^^RegbbOcqT (1891) in=40b,setxattr nqeolZZpfWUXqprf]\\PoS]lk_pef`^QpSreiVttQ (245) in=40b,setxattr \\OeXfOVSON\\t^bQb[lWXiXaYmVQXUcSqQnNh`j`t (4768) in=40b,setxattr eo^U[lhQUeVQ_Nc_bNdcfmXp_UQ`WXl_is_NkOfS (1577) in=40b,setxattr XUbk]peZmr_iot^gmY`pgm`eOnTpNT_SQd`aVj[e (1437) in=40b,setxattr XkXTUfbiTjaQaf\\fq[_\\antZOOTes[[ZYantUYqi (4560) in=40b,setxattr ab]YiQ (12980) in=6b,setxattr ZaSYU^RRVdSq_eaQfajUXsi\\ah^nfW_shiX]UlSd (14172) in=40b] snapc 30=[30,2c,2b,2a,29,28,27,26,22,1e,1c,1a,14,11] ondisk+write+known_if_redirected+supports_pool_eio e82)", 2024-04-18T14:44:27.860 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T14:44:21.660337+0000", 2024-04-18T14:44:27.860 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 6.1129258550000003, 2024-04-18T14:44:27.860 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.017051502999999999, 2024-04-18T14:44:27.860 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T14:44:27.860 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T14:44:27.860 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-18T14:44:27.860 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4559", 2024-04-18T14:44:27.860 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/3113589487", 2024-04-18T14:44:27.860 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 926 2024-04-18T14:44:27.860 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:27.861 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T14:44:27.861 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:27.861 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T14:44:27.861 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:21.660337+0000", 2024-04-18T14:44:27.861 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:44:27.861 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:27.862 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:27.862 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T14:44:27.862 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:21.660337+0000", 2024-04-18T14:44:27.862 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:44:27.862 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:27.862 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:27.862 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T14:44:27.863 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:21.660332+0000", 2024-04-18T14:44:27.863 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999952 2024-04-18T14:44:27.863 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:27.863 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:27.863 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T14:44:27.863 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:21.660566+0000", 2024-04-18T14:44:27.863 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00023413500000000001 2024-04-18T14:44:27.863 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:27.863 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:27.863 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T14:44:27.864 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:21.660602+0000", 2024-04-18T14:44:27.864 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.6117e-05 2024-04-18T14:44:27.864 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:27.864 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:27.864 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T14:44:27.864 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:21.660621+0000", 2024-04-18T14:44:27.864 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.9052999999999999e-05 2024-04-18T14:44:27.864 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:27.864 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:27.865 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T14:44:27.865 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:21.660751+0000", 2024-04-18T14:44:27.865 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000130099 2024-04-18T14:44:27.865 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:27.865 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:27.865 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T14:44:27.866 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:21.660959+0000", 2024-04-18T14:44:27.866 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000207918 2024-04-18T14:44:27.866 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:27.866 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:27.866 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_started", 2024-04-18T14:44:27.866 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:21.662984+0000", 2024-04-18T14:44:27.866 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0020243959999999999 2024-04-18T14:44:27.866 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:27.866 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:27.867 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_committed", 2024-04-18T14:44:27.867 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:21.669853+0000", 2024-04-18T14:44:27.867 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0068691480000000003 2024-04-18T14:44:27.867 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:27.867 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:27.867 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T14:44:27.867 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:21.677175+0000", 2024-04-18T14:44:27.867 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0073227370000000002 2024-04-18T14:44:27.867 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:27.867 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:27.867 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T14:44:27.867 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:21.677388+0000", 2024-04-18T14:44:27.867 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00021277399999999999 2024-04-18T14:44:27.867 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:44:27.868 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T14:44:27.868 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:44:27.868 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:27.868 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:27.868 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4559.0:989 3.as0 3:5dff433d:::smithi13430248-20:head [append 0~0] snapc 35=[35,33,32,30,2c,2b,2a,29,28,26,22,1e,1c,1a,14,11] ondisk+write+known_if_redirected+supports_pool_eio e86)", 2024-04-18T14:44:27.868 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T14:44:25.483824+0000", 2024-04-18T14:44:27.868 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 2.2894390119999999, 2024-04-18T14:44:27.868 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.020090190000000001, 2024-04-18T14:44:27.868 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T14:44:27.868 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T14:44:27.868 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-18T14:44:27.868 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4559", 2024-04-18T14:44:27.868 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/3113589487", 2024-04-18T14:44:27.869 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 989 2024-04-18T14:44:27.869 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:27.869 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T14:44:27.869 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:27.869 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T14:44:27.869 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:25.483824+0000", 2024-04-18T14:44:27.869 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:44:27.869 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:27.869 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:27.869 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T14:44:27.869 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:25.483824+0000", 2024-04-18T14:44:27.869 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:44:27.869 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:27.869 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:27.869 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T14:44:27.869 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:25.483816+0000", 2024-04-18T14:44:27.870 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999928 2024-04-18T14:44:27.870 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:27.870 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:27.870 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T14:44:27.870 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:25.483835+0000", 2024-04-18T14:44:27.870 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8597000000000002e-05 2024-04-18T14:44:27.870 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:27.870 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:27.870 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T14:44:27.870 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:25.483957+0000", 2024-04-18T14:44:27.870 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000121622 2024-04-18T14:44:27.870 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:27.870 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:27.871 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T14:44:27.871 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:25.483982+0000", 2024-04-18T14:44:27.871 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.5794000000000001e-05 2024-04-18T14:44:27.871 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:27.871 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:27.871 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T14:44:27.871 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:25.484127+0000", 2024-04-18T14:44:27.871 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00014492800000000001 2024-04-18T14:44:27.871 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:27.871 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:27.871 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op must wait for map", 2024-04-18T14:44:27.871 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:25.484152+0000", 2024-04-18T14:44:27.871 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.4992999999999999e-05 2024-04-18T14:44:27.872 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:27.872 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:27.872 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T14:44:27.872 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:25.488146+0000", 2024-04-18T14:44:27.872 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0039935789999999997 2024-04-18T14:44:27.872 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:27.872 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:27.872 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T14:44:27.872 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:25.488441+0000", 2024-04-18T14:44:27.872 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00029506500000000001 2024-04-18T14:44:27.872 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:27.872 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:27.872 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_started", 2024-04-18T14:44:27.872 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:25.491456+0000", 2024-04-18T14:44:27.873 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0030151029999999999 2024-04-18T14:44:27.873 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:27.873 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:27.873 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_committed", 2024-04-18T14:44:27.873 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:25.503493+0000", 2024-04-18T14:44:27.873 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.012037093 2024-04-18T14:44:27.873 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:27.873 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:27.873 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T14:44:27.873 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:25.503701+0000", 2024-04-18T14:44:27.873 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000207658 2024-04-18T14:44:27.873 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:27.873 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:27.873 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T14:44:27.874 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:25.503914+0000", 2024-04-18T14:44:27.874 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000212895 2024-04-18T14:44:27.874 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:44:27.874 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T14:44:27.874 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:44:27.874 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:27.874 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:27.874 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4559.0:990 3.as0 3:5dff433d:::smithi13430248-20:head [rollback 28] snapc 35=[35,33,32,30,2c,2b,2a,29,28,26,22,1e,1c,1a,14,11] ondisk+write+known_if_redirected+supports_pool_eio e86)", 2024-04-18T14:44:27.874 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T14:44:25.484013+0000", 2024-04-18T14:44:27.874 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 2.2892494000000001, 2024-04-18T14:44:27.874 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.026942089999999998, 2024-04-18T14:44:27.874 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T14:44:27.874 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T14:44:27.875 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-18T14:44:27.875 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4559", 2024-04-18T14:44:27.875 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/3113589487", 2024-04-18T14:44:27.875 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 990 2024-04-18T14:44:27.875 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:27.875 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T14:44:27.875 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:27.875 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T14:44:27.875 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:25.484013+0000", 2024-04-18T14:44:27.875 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:44:27.875 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:27.875 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:27.876 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T14:44:27.876 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:25.484013+0000", 2024-04-18T14:44:27.876 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:44:27.876 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:27.876 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:27.876 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T14:44:27.876 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:25.484012+0000", 2024-04-18T14:44:27.876 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999986 2024-04-18T14:44:27.876 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:27.876 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:27.876 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T14:44:27.876 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:25.484022+0000", 2024-04-18T14:44:27.877 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.893e-06 2024-04-18T14:44:27.877 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:27.877 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:27.877 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T14:44:27.877 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:25.484043+0000", 2024-04-18T14:44:27.877 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.1152999999999999e-05 2024-04-18T14:44:27.877 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:27.877 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:27.877 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T14:44:27.877 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:25.484059+0000", 2024-04-18T14:44:27.877 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6274e-05 2024-04-18T14:44:27.878 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:27.878 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:27.878 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T14:44:27.878 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:25.484364+0000", 2024-04-18T14:44:27.878 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00030465400000000001 2024-04-18T14:44:27.878 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:27.878 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:27.878 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting_for_map not empty", 2024-04-18T14:44:27.878 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:25.484387+0000", 2024-04-18T14:44:27.878 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.3393000000000001e-05 2024-04-18T14:44:27.878 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:27.878 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:27.878 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T14:44:27.878 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:25.498195+0000", 2024-04-18T14:44:27.879 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.013807873 2024-04-18T14:44:27.879 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:27.879 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:27.879 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T14:44:27.879 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:25.498531+0000", 2024-04-18T14:44:27.879 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00033602700000000003 2024-04-18T14:44:27.879 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:27.879 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:27.879 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_started", 2024-04-18T14:44:27.879 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:25.500741+0000", 2024-04-18T14:44:27.879 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.002210236 2024-04-18T14:44:27.879 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:27.879 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:27.880 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_committed", 2024-04-18T14:44:27.880 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:25.507887+0000", 2024-04-18T14:44:27.880 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0071463280000000004 2024-04-18T14:44:27.880 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:27.880 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:27.880 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T14:44:27.880 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:25.510857+0000", 2024-04-18T14:44:27.880 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0029694439999999999 2024-04-18T14:44:27.880 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:27.880 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:27.880 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T14:44:27.881 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:25.510955+0000", 2024-04-18T14:44:27.881 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.8351999999999996e-05 2024-04-18T14:44:27.881 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:44:27.881 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T14:44:27.881 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:44:27.881 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:27.881 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:27.881 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4559.0:991 3.as0 3:5dff433d:::smithi13430248-20:head [append 0~0] snapc 35=[35,33,32,30,2c,2b,2a,29,28,26,22,1e,1c,1a,14,11] ondisk+write+known_if_redirected+supports_pool_eio e86)", 2024-04-18T14:44:27.881 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T14:44:25.484131+0000", 2024-04-18T14:44:27.881 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 2.2891315510000001, 2024-04-18T14:44:27.882 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.029604319, 2024-04-18T14:44:27.882 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T14:44:27.882 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T14:44:27.882 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-18T14:44:27.882 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4559", 2024-04-18T14:44:27.882 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/3113589487", 2024-04-18T14:44:27.882 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 991 2024-04-18T14:44:27.882 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:27.883 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T14:44:27.883 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:27.883 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T14:44:27.883 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:25.484131+0000", 2024-04-18T14:44:27.883 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:44:27.883 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:27.883 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:27.883 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T14:44:27.883 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:25.484131+0000", 2024-04-18T14:44:27.884 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:44:27.884 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:27.884 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:27.884 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T14:44:27.884 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:25.484130+0000", 2024-04-18T14:44:27.884 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999986 2024-04-18T14:44:27.884 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:27.884 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:27.884 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T14:44:27.885 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:25.484138+0000", 2024-04-18T14:44:27.885 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.1000000000000004e-06 2024-04-18T14:44:27.885 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:27.885 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:27.885 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T14:44:27.885 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:25.484160+0000", 2024-04-18T14:44:27.885 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2203000000000001e-05 2024-04-18T14:44:27.885 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:27.885 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:27.886 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T14:44:27.886 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:25.484175+0000", 2024-04-18T14:44:27.886 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5153e-05 2024-04-18T14:44:27.886 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:27.886 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:27.886 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T14:44:27.886 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:25.484455+0000", 2024-04-18T14:44:27.886 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00028005800000000002 2024-04-18T14:44:27.887 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:27.887 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:27.887 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting_for_map not empty", 2024-04-18T14:44:27.887 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:25.484471+0000", 2024-04-18T14:44:27.887 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6133e-05 2024-04-18T14:44:27.887 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:27.887 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:27.888 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T14:44:27.888 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:25.504193+0000", 2024-04-18T14:44:27.888 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.019721127000000001 2024-04-18T14:44:27.888 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:27.888 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:27.888 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T14:44:27.888 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:25.504476+0000", 2024-04-18T14:44:27.888 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00028325399999999998 2024-04-18T14:44:27.888 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:27.889 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:27.889 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_started", 2024-04-18T14:44:27.889 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:25.505841+0000", 2024-04-18T14:44:27.889 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.001365277 2024-04-18T14:44:27.889 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:27.889 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:27.889 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_committed", 2024-04-18T14:44:27.889 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:25.511079+0000", 2024-04-18T14:44:27.889 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0052375249999999998 2024-04-18T14:44:27.890 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:27.890 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:27.890 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T14:44:27.890 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:25.511257+0000", 2024-04-18T14:44:27.890 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00017884199999999999 2024-04-18T14:44:27.890 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:27.890 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:27.890 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T14:44:27.891 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:25.513735+0000", 2024-04-18T14:44:27.891 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0024778970000000002 2024-04-18T14:44:27.891 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:44:27.891 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T14:44:27.891 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:44:27.891 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:27.891 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:27.891 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "MOSDECSubOpWrite(3.2s2 86/70 ECSubWrite(tid=306, reqid=client.4559.0:988, at_version=86'64, trim_to=0'0, roll_forward_to=85'62))", 2024-04-18T14:44:27.891 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T14:44:25.490874+0000", 2024-04-18T14:44:27.892 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 2.2823882370000002, 2024-04-18T14:44:27.892 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.019366142999999999, 2024-04-18T14:44:27.892 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T14:44:27.892 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-04-18T14:44:27.892 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T14:44:27.892 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:27.892 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T14:44:27.892 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:25.490874+0000", 2024-04-18T14:44:27.893 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:44:27.893 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:27.893 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:27.893 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T14:44:27.893 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:25.490874+0000", 2024-04-18T14:44:27.893 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:44:27.893 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:27.893 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:27.893 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T14:44:27.894 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:25.490874+0000", 2024-04-18T14:44:27.894 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-04-18T14:44:27.894 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:27.894 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:27.894 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T14:44:27.894 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:25.491185+0000", 2024-04-18T14:44:27.894 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00031147100000000001 2024-04-18T14:44:27.894 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:27.894 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:27.894 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T14:44:27.894 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:25.491217+0000", 2024-04-18T14:44:27.894 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.1906000000000003e-05 2024-04-18T14:44:27.895 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:27.895 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:27.895 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T14:44:27.895 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:25.491238+0000", 2024-04-18T14:44:27.895 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.1060000000000002e-05 2024-04-18T14:44:27.895 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:27.895 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:27.895 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T14:44:27.895 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:25.497435+0000", 2024-04-18T14:44:27.895 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0061966590000000002 2024-04-18T14:44:27.895 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:27.895 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:27.895 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_started", 2024-04-18T14:44:27.895 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:25.497471+0000", 2024-04-18T14:44:27.896 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.5806000000000002e-05 2024-04-18T14:44:27.896 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:27.896 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:27.896 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_committed", 2024-04-18T14:44:27.896 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:25.510188+0000", 2024-04-18T14:44:27.896 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.012717261000000001 2024-04-18T14:44:27.896 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:27.897 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:27.897 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T14:44:27.897 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:25.510240+0000", 2024-04-18T14:44:27.897 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.2580000000000001e-05 2024-04-18T14:44:27.897 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:44:27.897 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T14:44:27.898 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:44:27.898 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:44:27.898 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T14:44:27.898 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-04-18T14:44:27.900 INFO:teuthology.orchestra.run.smithi086.stdout:osd.0: {} 2024-04-18T14:44:27.900 INFO:teuthology.orchestra.run.smithi086.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-18T14:44:27.901 INFO:teuthology.orchestra.run.smithi086.stdout:osd.1: {} 2024-04-18T14:44:27.902 INFO:teuthology.orchestra.run.smithi086.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-18T14:44:27.902 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-04-18T14:44:27.903 INFO:tasks.ceph.osd.7.smithi134.stderr:2024-04-18T14:44:27.903+0000 7fd7de549640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25213) UID: 0 2024-04-18T14:44:27.904 INFO:teuthology.orchestra.run.smithi086.stdout:osd.2: {} 2024-04-18T14:44:27.904 INFO:teuthology.orchestra.run.smithi086.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-18T14:44:27.904 INFO:teuthology.orchestra.run.smithi086.stdout:osd.3: {} 2024-04-18T14:44:27.904 INFO:teuthology.orchestra.run.smithi086.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-18T14:44:27.905 INFO:teuthology.orchestra.run.smithi086.stdout:osd.4: {} 2024-04-18T14:44:27.905 INFO:teuthology.orchestra.run.smithi086.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-18T14:44:27.906 INFO:teuthology.orchestra.run.smithi086.stdout:osd.5: {} 2024-04-18T14:44:27.906 INFO:teuthology.orchestra.run.smithi086.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-18T14:44:27.907 INFO:teuthology.orchestra.run.smithi086.stdout:osd.6: {} 2024-04-18T14:44:27.907 INFO:teuthology.orchestra.run.smithi086.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-18T14:44:27.923 INFO:teuthology.orchestra.run.smithi086.stdout:osd.7: {} 2024-04-18T14:44:27.923 INFO:teuthology.orchestra.run.smithi086.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-18T14:44:27.942 INFO:teuthology.orchestra.run.smithi086.stdout:osd.8: {} 2024-04-18T14:44:27.942 INFO:teuthology.orchestra.run.smithi086.stderr:osd.8: osd_enable_op_tracker = '' 2024-04-18T14:44:27.961 INFO:teuthology.orchestra.run.smithi086.stdout:osd.9: {} 2024-04-18T14:44:27.961 INFO:teuthology.orchestra.run.smithi086.stderr:osd.9: osd_enable_op_tracker = '' 2024-04-18T14:44:27.982 INFO:teuthology.orchestra.run.smithi086.stdout:osd.10: {} 2024-04-18T14:44:27.982 INFO:teuthology.orchestra.run.smithi086.stderr:osd.10: osd_enable_op_tracker = '' 2024-04-18T14:44:28.000 INFO:teuthology.orchestra.run.smithi086.stdout:osd.11: {} 2024-04-18T14:44:28.001 INFO:teuthology.orchestra.run.smithi086.stderr:osd.11: osd_enable_op_tracker = '' 2024-04-18T14:44:28.001 INFO:tasks.ceph.osd.1.smithi096.stderr:2024-04-18T14:44:28.001+0000 7f56a7a98640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 24887) UID: 0 2024-04-18T14:44:28.019 INFO:teuthology.orchestra.run.smithi086.stdout:osd.12: {} 2024-04-18T14:44:28.020 INFO:teuthology.orchestra.run.smithi086.stderr:osd.12: osd_enable_op_tracker = '' 2024-04-18T14:44:28.040 INFO:teuthology.orchestra.run.smithi086.stdout:osd.13: {} 2024-04-18T14:44:28.040 INFO:teuthology.orchestra.run.smithi086.stderr:osd.13: osd_enable_op_tracker = '' 2024-04-18T14:44:28.060 INFO:teuthology.orchestra.run.smithi086.stdout:osd.14: {} 2024-04-18T14:44:28.060 INFO:teuthology.orchestra.run.smithi086.stderr:osd.14: osd_enable_op_tracker = '' 2024-04-18T14:44:28.060 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-18T14:44:28.057+0000 7f273ad9d640 0 -- 172.21.15.86:0/1335813578 >> [v2:172.21.15.134:6808/25223,v1:172.21.15.134:6812/25223] conn(0x7f273c224490 msgr2=0x7f273c226880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-04-18T14:44:28.068 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-04-18T14:44:28.069 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T14:44:28.083 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-04-18T14:44:28.130 INFO:tasks.ceph.osd.11.smithi134.stderr:2024-04-18T14:44:28.135+0000 7f2d36f12640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 11 (PID: 25216) UID: 0 2024-04-18T14:44:28.203 INFO:tasks.ceph.osd.10.smithi119.stderr:2024-04-18T14:44:28.206+0000 7f6f24c12640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 10 (PID: 24898) UID: 0 2024-04-18T14:44:28.204 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-04-18T14:44:28.204 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T14:44:28.219 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-04-18T14:44:28.283 INFO:teuthology.orchestra.run.smithi086.stdout:osd.15: {} 2024-04-18T14:44:28.283 INFO:teuthology.orchestra.run.smithi086.stderr:osd.15: osd_enable_op_tracker = '' 2024-04-18T14:44:28.304 INFO:tasks.ceph.osd.14.smithi119.stderr:2024-04-18T14:44:28.306+0000 7f180f599640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 14 (PID: 24900) UID: 0 2024-04-18T14:44:28.384 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-04-18T14:44:28.385 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T14:44:28.398 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.11.asok dump_ops_in_flight 2024-04-18T14:44:28.404 INFO:tasks.ceph.osd.1.smithi096.stderr:2024-04-18T14:44:28.405+0000 7f56a7a98640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 24887) UID: 0 2024-04-18T14:44:28.484 INFO:tasks.thrashosds.thrasher:in_osds: [0, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 1] out_osds: [] dead_osds: [] live_osds: [0, 4, 8, 12, 1, 5, 9, 13, 2, 6, 10, 14, 3, 7, 11, 15] 2024-04-18T14:44:28.484 INFO:tasks.thrashosds.thrasher:choose_action: min_in 8 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-04-18T14:44:28.484 INFO:tasks.thrashosds.thrasher:Growing pool unique_pool_0 2024-04-18T14:44:28.484 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-18T14:44:28.500 INFO:tasks.rados.rados.0.smithi134.stdout:394: done (5 left) 2024-04-18T14:44:28.500 INFO:tasks.rados.rados.0.smithi134.stdout:395: done (4 left) 2024-04-18T14:44:28.500 INFO:tasks.rados.rados.0.smithi134.stdout:396: done (3 left) 2024-04-18T14:44:28.500 INFO:tasks.rados.rados.0.smithi134.stdout:397: done (2 left) 2024-04-18T14:44:28.500 INFO:tasks.rados.rados.0.smithi134.stdout:398: done (1 left) 2024-04-18T14:44:28.500 INFO:tasks.rados.rados.0.smithi134.stdout:399: done (0 left) 2024-04-18T14:44:28.505 INFO:tasks.ceph.osd.6.smithi119.stderr:2024-04-18T14:44:28.506+0000 7fb7cb8bd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 24896) UID: 0 2024-04-18T14:44:28.509 INFO:tasks.rados.rados.0.smithi134.stderr:0 errors. 2024-04-18T14:44:28.509 INFO:tasks.rados.rados.0.smithi134.stderr: 2024-04-18T14:44:28.517 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-04-18T14:44:28.517 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T14:44:28.520 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-18T14:44:28.532 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.11.asok dump_blocked_ops 2024-04-18T14:44:28.606 INFO:tasks.ceph.osd.0.smithi086.stderr:2024-04-18T14:44:28.601+0000 7f7cdfd78640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 24953) UID: 0 2024-04-18T14:44:28.696 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-04-18T14:44:28.696 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T14:44:28.707 INFO:tasks.ceph.osd.7.smithi134.stderr:2024-04-18T14:44:28.711+0000 7fd7de549640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25213) UID: 0 2024-04-18T14:44:28.710 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.11.asok dump_historic_ops 2024-04-18T14:44:28.796 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-04-18T14:44:28.798 INFO:teuthology.orchestra.run.smithi086.stderr:dumped all 2024-04-18T14:44:28.809 INFO:tasks.ceph.osd.10.smithi119.stderr:2024-04-18T14:44:28.814+0000 7f6f24c12640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 10 (PID: 24898) UID: 0 2024-04-18T14:44:28.815 INFO:teuthology.orchestra.run.smithi086.stdout:{"pg_ready":true,"pg_map":{"version":113,"stamp":"2024-04-18T14:44:28.501724+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":166674976,"num_objects":164,"num_object_clones":112,"num_object_copies":1138,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":164,"num_whiteouts":7,"num_read":592,"num_read_kb":234833,"num_write":1107,"num_write_kb":177924,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":86,"num_bytes_recovered":78118912,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1734,"ondisk_log_size":1734,"up":130,"acting":130,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":130,"num_osds":16,"num_per_pool_osds":16,"num_per_pool_omap_osds":16,"kb":1509949440,"kb_used":809392,"kb_used_data":297556,"kb_used_omap":24,"kb_used_meta":511591,"kb_avail":1509140048,"statfs":{"total":1546188226560,"available":1545359409152,"internally_reserved":0,"allocated":304697344,"data_stored":461914524,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":25506,"internal_metadata":523869278},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":40,"apply_latency_ms":40,"commit_latency_ns":40000000,"apply_latency_ns":40000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":13336576,"num_objects":14,"num_object_clones":13,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":2,"num_read":20,"num_read_kb":30001,"num_write":66,"num_write_kb":15440,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.115506"},"pg_stats":[{"pgid":"3.f","version":"85'52","reported_seq":210,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-18T14:44:26.505896+0000","last_change":"2024-04-18T14:44:24.427623+0000","last_active":"2024-04-18T14:44:26.505896+0000","last_peered":"2024-04-18T14:44:26.505896+0000","last_clean":"2024-04-18T14:44:26.505896+0000","last_became_active":"2024-04-18T14:43:30.738648+0000","last_became_peered":"2024-04-18T14:43:30.738648+0000","last_unstale":"2024-04-18T14:44:26.505896+0000","last_undegraded":"2024-04-18T14:44:26.505896+0000","last_fullsized":"2024-04-18T14:44:26.505896+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T14:43:29.615264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T14:43:29.615264+0000","last_clean_scrub_stamp":"2024-04-18T14:43:29.615264+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T14:44:32.547784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.028230990000000001,"stat_sum":{"num_bytes":950272,"num_objects":4,"num_object_clones":2,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":4517,"num_write":11,"num_write_kb":1168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,12,4,13,14,10,2],"acting":[11,12,4,13,14,10,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[{"start":"13","length":"1"},{"start":"23","length":"1"},{"start":"27","length":"1"}]},{"pgid":"3.e","version":"84'112","reported_seq":288,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-18T14:44:23.540967+0000","last_change":"2024-04-18T14:44:21.477592+0000","last_active":"2024-04-18T14:44:23.540967+0000","last_peered":"2024-04-18T14:44:23.540967+0000","last_clean":"2024-04-18T14:44:23.540967+0000","last_became_active":"2024-04-18T14:44:10.416764+0000","last_became_peered":"2024-04-18T14:44:10.416764+0000","last_unstale":"2024-04-18T14:44:23.540967+0000","last_undegraded":"2024-04-18T14:44:23.540967+0000","last_fullsized":"2024-04-18T14:44:23.540967+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T14:43:29.615264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T14:43:29.615264+0000","last_clean_scrub_stamp":"2024-04-18T14:43:29.615264+0000","objects_scrubbed":0,"log_size":112,"log_dups_size":0,"ondisk_log_size":112,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T14:44:43.107561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.027533792000000001,"stat_sum":{"num_bytes":14123008,"num_objects":10,"num_object_clones":7,"num_object_copies":70,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":23,"num_read_kb":5723,"num_write":79,"num_write_kb":15152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":11,"num_bytes_recovered":5472256,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,1,11,2,0,3],"acting":[8,9,1,11,2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[{"start":"2","length":"1"},{"start":"13","length":"1"},{"start":"16","length":"1"},{"start":"23","length":"1"}]},{"pgid":"3.d","version":"82'62","reported_seq":202,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-18T14:44:22.489587+0000","last_change":"2024-04-18T14:44:21.507603+0000","last_active":"2024-04-18T14:44:22.489587+0000","last_peered":"2024-04-18T14:44:22.489587+0000","last_clean":"2024-04-18T14:44:22.489587+0000","last_became_active":"2024-04-18T14:43:30.735975+0000","last_became_peered":"2024-04-18T14:43:30.735975+0000","last_unstale":"2024-04-18T14:44:22.489587+0000","last_undegraded":"2024-04-18T14:44:22.489587+0000","last_fullsized":"2024-04-18T14:44:22.489587+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T14:43:29.615264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T14:43:29.615264+0000","last_clean_scrub_stamp":"2024-04-18T14:43:29.615264+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T14:44:53.155373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.032556712000000002,"stat_sum":{"num_bytes":4358144,"num_objects":7,"num_object_clones":5,"num_object_copies":49,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":1,"num_read":14,"num_read_kb":3269,"num_write":16,"num_write_kb":4256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,0,12,10,2,6],"acting":[7,3,0,12,10,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"2","length":"1"},{"start":"13","length":"1"},{"start":"16","length":"1"},{"start":"23","length":"1"}]},{"pgid":"3.c","version":"85'190","reported_seq":344,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-18T14:44:26.505899+0000","last_change":"2024-04-18T14:44:24.434702+0000","last_active":"2024-04-18T14:44:26.505899+0000","last_peered":"2024-04-18T14:44:26.505899+0000","last_clean":"2024-04-18T14:44:26.505899+0000","last_became_active":"2024-04-18T14:43:30.737285+0000","last_became_peered":"2024-04-18T14:43:30.737285+0000","last_unstale":"2024-04-18T14:44:26.505899+0000","last_undegraded":"2024-04-18T14:44:26.505899+0000","last_fullsized":"2024-04-18T14:44:26.505899+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T14:43:29.615264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T14:43:29.615264+0000","last_clean_scrub_stamp":"2024-04-18T14:43:29.615264+0000","objects_scrubbed":0,"log_size":190,"log_dups_size":0,"ondisk_log_size":190,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T14:44:34.651938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.036289460000000003,"stat_sum":{"num_bytes":19103744,"num_objects":21,"num_object_clones":15,"num_object_copies":147,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":1,"num_read":61,"num_read_kb":23582,"num_write":103,"num_write_kb":16848,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,10,14,12,4,2,6],"acting":[11,10,14,12,4,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[{"start":"13","length":"1"},{"start":"23","length":"1"},{"start":"27","length":"1"}]},{"pgid":"3.b","version":"87'96","reported_seq":278,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-18T14:44:27.530074+0000","last_change":"2024-04-18T14:44:24.439519+0000","last_active":"2024-04-18T14:44:27.530074+0000","last_peered":"2024-04-18T14:44:27.530074+0000","last_clean":"2024-04-18T14:44:27.530074+0000","last_became_active":"2024-04-18T14:44:10.413165+0000","last_became_peered":"2024-04-18T14:44:10.413165+0000","last_unstale":"2024-04-18T14:44:27.530074+0000","last_undegraded":"2024-04-18T14:44:27.530074+0000","last_fullsized":"2024-04-18T14:44:27.530074+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T14:43:29.615264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T14:43:29.615264+0000","last_clean_scrub_stamp":"2024-04-18T14:43:29.615264+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":0,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T14:44:57.226209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.045183559999999998,"stat_sum":{"num_bytes":11255808,"num_objects":14,"num_object_clones":11,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":24,"num_read_kb":16337,"num_write":122,"num_write_kb":11216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":3735552,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,6,1,9,8,7,14],"acting":[10,6,1,9,8,7,14],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[{"start":"13","length":"1"},{"start":"23","length":"1"},{"start":"27","length":"1"}]},{"pgid":"3.a","version":"84'92","reported_seq":272,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-18T14:44:23.563471+0000","last_change":"2024-04-18T14:44:21.512666+0000","last_active":"2024-04-18T14:44:23.563471+0000","last_peered":"2024-04-18T14:44:23.563471+0000","last_clean":"2024-04-18T14:44:23.563471+0000","last_became_active":"2024-04-18T14:44:10.417346+0000","last_became_peered":"2024-04-18T14:44:10.417346+0000","last_unstale":"2024-04-18T14:44:23.563471+0000","last_undegraded":"2024-04-18T14:44:23.563471+0000","last_fullsized":"2024-04-18T14:44:23.563471+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T14:43:29.615264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T14:43:29.615264+0000","last_clean_scrub_stamp":"2024-04-18T14:43:29.615264+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T14:44:30.191494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.053584856,"stat_sum":{"num_bytes":9699328,"num_objects":11,"num_object_clones":7,"num_object_copies":77,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":27,"num_read_kb":11053,"num_write":75,"num_write_kb":9792,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":10584064,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,9,8,15,11],"acting":[3,7,1,9,8,15,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"},{"start":"13","length":"1"},{"start":"16","length":"1"},{"start":"23","length":"1"}]},{"pgid":"3.9","version":"85'187","reported_seq":410,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-18T14:44:26.502667+0000","last_change":"2024-04-18T14:44:24.440087+0000","last_active":"2024-04-18T14:44:26.502667+0000","last_peered":"2024-04-18T14:44:26.502667+0000","last_clean":"2024-04-18T14:44:26.502667+0000","last_became_active":"2024-04-18T14:44:13.557905+0000","last_became_peered":"2024-04-18T14:44:13.557905+0000","last_unstale":"2024-04-18T14:44:26.502667+0000","last_undegraded":"2024-04-18T14:44:26.502667+0000","last_fullsized":"2024-04-18T14:44:26.502667+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T14:43:29.615264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T14:43:29.615264+0000","last_clean_scrub_stamp":"2024-04-18T14:43:29.615264+0000","objects_scrubbed":0,"log_size":187,"log_dups_size":0,"ondisk_log_size":187,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T14:44:36.314474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.040204142999999998,"stat_sum":{"num_bytes":19070976,"num_objects":17,"num_object_clones":11,"num_object_copies":119,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":1,"num_read":48,"num_read_kb":19701,"num_write":71,"num_write_kb":22608,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":18,"num_bytes_recovered":19070976,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[12,1,14,4,15,10,6],"acting":[12,1,14,4,15,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":12,"acting_primary":12,"purged_snaps":[{"start":"13","length":"1"},{"start":"23","length":"1"},{"start":"27","length":"1"}]},{"pgid":"3.8","version":"85'192","reported_seq":422,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-18T14:44:24.416324+0000","last_change":"2024-04-18T14:44:24.417398+0000","last_active":"2024-04-18T14:44:24.416324+0000","last_peered":"2024-04-18T14:44:24.416324+0000","last_clean":"2024-04-18T14:44:24.416324+0000","last_became_active":"2024-04-18T14:44:13.557985+0000","last_became_peered":"2024-04-18T14:44:13.557985+0000","last_unstale":"2024-04-18T14:44:24.416324+0000","last_undegraded":"2024-04-18T14:44:24.416324+0000","last_fullsized":"2024-04-18T14:44:24.416324+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T14:43:29.615264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T14:43:29.615264+0000","last_clean_scrub_stamp":"2024-04-18T14:43:29.615264+0000","objects_scrubbed":0,"log_size":192,"log_dups_size":0,"ondisk_log_size":192,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T14:44:30.625952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.033226977999999997,"stat_sum":{"num_bytes":27230208,"num_objects":17,"num_object_clones":11,"num_object_copies":119,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":74,"num_read_kb":36460,"num_write":89,"num_write_kb":27472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":17,"num_bytes_recovered":14991360,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,0,4,14,15,1],"acting":[5,10,0,4,14,15,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"13","length":"1"},{"start":"23","length":"1"},{"start":"27","length":"1"}]},{"pgid":"1.0","version":"26'157","reported_seq":264,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-18T14:44:23.630947+0000","last_change":"2024-04-18T14:43:20.323829+0000","last_active":"2024-04-18T14:44:23.630947+0000","last_peered":"2024-04-18T14:44:23.630947+0000","last_clean":"2024-04-18T14:44:23.630947+0000","last_became_active":"2024-04-18T14:43:20.323133+0000","last_became_peered":"2024-04-18T14:43:20.323133+0000","last_unstale":"2024-04-18T14:44:23.630947+0000","last_undegraded":"2024-04-18T14:44:23.630947+0000","last_fullsized":"2024-04-18T14:44:23.630947+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T14:43:18.296821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T14:43:18.296821+0000","last_clean_scrub_stamp":"2024-04-18T14:43:18.296821+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T14:44:25.445335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[13,0],"acting":[13,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":13,"acting_primary":13,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":79,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-18T14:44:23.471112+0000","last_change":"2024-04-18T14:44:23.449444+0000","last_active":"2024-04-18T14:44:23.471112+0000","last_peered":"2024-04-18T14:44:23.471112+0000","last_clean":"2024-04-18T14:44:23.471112+0000","last_became_active":"2024-04-18T14:43:21.327764+0000","last_became_peered":"2024-04-18T14:43:21.327764+0000","last_unstale":"2024-04-18T14:44:23.471112+0000","last_undegraded":"2024-04-18T14:44:23.471112+0000","last_fullsized":"2024-04-18T14:44:23.471112+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T14:44:23.449241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T14:43:20.303322+0000","last_clean_scrub_stamp":"2024-04-18T14:44:23.449241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T14:45:36.175611+0000","scrub_duration":0.0029048670000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,15],"acting":[5,15],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"85'62","reported_seq":237,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-18T14:44:24.419612+0000","last_change":"2024-04-18T14:44:24.420589+0000","last_active":"2024-04-18T14:44:24.419612+0000","last_peered":"2024-04-18T14:44:24.419612+0000","last_clean":"2024-04-18T14:44:24.419612+0000","last_became_active":"2024-04-18T14:44:10.415771+0000","last_became_peered":"2024-04-18T14:44:10.415771+0000","last_unstale":"2024-04-18T14:44:24.419612+0000","last_undegraded":"2024-04-18T14:44:24.419612+0000","last_fullsized":"2024-04-18T14:44:24.419612+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T14:43:29.615264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T14:43:29.615264+0000","last_clean_scrub_stamp":"2024-04-18T14:43:29.615264+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T14:44:50.487239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.018562775,"stat_sum":{"num_bytes":6848512,"num_objects":5,"num_object_clones":3,"num_object_copies":35,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":33609,"num_write":41,"num_write_kb":6688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":7307264,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[13,12,3,4,15,1,11],"acting":[13,12,3,4,15,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":13,"acting_primary":13,"purged_snaps":[{"start":"13","length":"1"},{"start":"23","length":"1"},{"start":"27","length":"1"}]},{"pgid":"2.0","version":"0'0","reported_seq":65,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-18T14:44:22.482283+0000","last_change":"2024-04-18T14:43:21.414881+0000","last_active":"2024-04-18T14:44:22.482283+0000","last_peered":"2024-04-18T14:44:22.482283+0000","last_clean":"2024-04-18T14:44:22.482283+0000","last_became_active":"2024-04-18T14:43:21.414060+0000","last_became_peered":"2024-04-18T14:43:21.414060+0000","last_unstale":"2024-04-18T14:44:22.482283+0000","last_undegraded":"2024-04-18T14:44:22.482283+0000","last_fullsized":"2024-04-18T14:44:22.482283+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T14:43:20.303322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T14:43:20.303322+0000","last_clean_scrub_stamp":"2024-04-18T14:43:20.303322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T14:44:26.835605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"87'114","reported_seq":266,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-18T14:44:26.511176+0000","last_change":"2024-04-18T14:44:24.446786+0000","last_active":"2024-04-18T14:44:26.511176+0000","last_peered":"2024-04-18T14:44:26.511176+0000","last_clean":"2024-04-18T14:44:26.511176+0000","last_became_active":"2024-04-18T14:43:30.746554+0000","last_became_peered":"2024-04-18T14:43:30.746554+0000","last_unstale":"2024-04-18T14:44:26.511176+0000","last_undegraded":"2024-04-18T14:44:26.511176+0000","last_fullsized":"2024-04-18T14:44:26.511176+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T14:43:29.615264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T14:43:29.615264+0000","last_clean_scrub_stamp":"2024-04-18T14:43:29.615264+0000","objects_scrubbed":0,"log_size":114,"log_dups_size":0,"ondisk_log_size":114,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T14:44:30.628320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.034244214000000002,"stat_sum":{"num_bytes":12238848,"num_objects":13,"num_object_clones":9,"num_object_copies":91,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":1,"num_read":36,"num_read_kb":25157,"num_write":74,"num_write_kb":12096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,11,9,5,12,0,13],"acting":[6,11,9,5,12,0,13],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"13","length":"1"},{"start":"23","length":"1"},{"start":"27","length":"1"}]},{"pgid":"2.1","version":"0'0","reported_seq":78,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-18T14:44:24.148269+0000","last_change":"2024-04-18T14:44:24.148269+0000","last_active":"2024-04-18T14:44:24.148269+0000","last_peered":"2024-04-18T14:44:24.148269+0000","last_clean":"2024-04-18T14:44:24.148269+0000","last_became_active":"2024-04-18T14:43:21.328534+0000","last_became_peered":"2024-04-18T14:43:21.328534+0000","last_unstale":"2024-04-18T14:44:24.148269+0000","last_undegraded":"2024-04-18T14:44:24.148269+0000","last_fullsized":"2024-04-18T14:44:24.148269+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T14:44:24.148141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T14:43:20.303322+0000","last_clean_scrub_stamp":"2024-04-18T14:44:24.148141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T14:45:30.466689+0000","scrub_duration":0.001593882,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[13,5],"acting":[13,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":13,"acting_primary":13,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":163,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-18T14:44:26.502492+0000","last_change":"2024-04-18T14:44:24.399739+0000","last_active":"2024-04-18T14:44:26.502492+0000","last_peered":"2024-04-18T14:44:26.502492+0000","last_clean":"2024-04-18T14:44:26.502492+0000","last_became_active":"2024-04-18T14:44:10.408892+0000","last_became_peered":"2024-04-18T14:44:10.408892+0000","last_unstale":"2024-04-18T14:44:26.502492+0000","last_undegraded":"2024-04-18T14:44:26.502492+0000","last_fullsized":"2024-04-18T14:44:26.502492+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T14:43:29.615264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T14:43:29.615264+0000","last_clean_scrub_stamp":"2024-04-18T14:43:29.615264+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T14:44:43.444986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010584290000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[12,11,15,1,5,0,6],"acting":[12,11,15,1,5,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":12,"acting_primary":12,"purged_snaps":[{"start":"13","length":"1"},{"start":"23","length":"1"},{"start":"27","length":"1"}]},{"pgid":"2.2","version":"0'0","reported_seq":65,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-18T14:44:22.482325+0000","last_change":"2024-04-18T14:43:21.465969+0000","last_active":"2024-04-18T14:44:22.482325+0000","last_peered":"2024-04-18T14:44:22.482325+0000","last_clean":"2024-04-18T14:44:22.482325+0000","last_became_active":"2024-04-18T14:43:21.465481+0000","last_became_peered":"2024-04-18T14:43:21.465481+0000","last_unstale":"2024-04-18T14:44:22.482325+0000","last_undegraded":"2024-04-18T14:44:22.482325+0000","last_fullsized":"2024-04-18T14:44:22.482325+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T14:43:20.303322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T14:43:20.303322+0000","last_clean_scrub_stamp":"2024-04-18T14:43:20.303322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T14:44:45.650560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10],"acting":[3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"82'61","reported_seq":205,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-18T14:44:24.402538+0000","last_change":"2024-04-18T14:44:24.402916+0000","last_active":"2024-04-18T14:44:24.402538+0000","last_peered":"2024-04-18T14:44:24.402538+0000","last_clean":"2024-04-18T14:44:24.402538+0000","last_became_active":"2024-04-18T14:43:30.737990+0000","last_became_peered":"2024-04-18T14:43:30.737990+0000","last_unstale":"2024-04-18T14:44:24.402538+0000","last_undegraded":"2024-04-18T14:44:24.402538+0000","last_fullsized":"2024-04-18T14:44:24.402538+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T14:43:29.615264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T14:43:29.615264+0000","last_clean_scrub_stamp":"2024-04-18T14:43:29.615264+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T14:44:56.230031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00063665300000000005,"stat_sum":{"num_bytes":3244032,"num_objects":6,"num_object_clones":4,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":13,"num_read_kb":379,"num_write":16,"num_write_kb":3456,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[13,7,2,15,4,5,3],"acting":[13,7,2,15,4,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":13,"acting_primary":13,"purged_snaps":[{"start":"13","length":"1"},{"start":"23","length":"1"},{"start":"27","length":"1"}]},{"pgid":"3.5","version":"82'40","reported_seq":184,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-18T14:44:22.459801+0000","last_change":"2024-04-18T14:44:21.501260+0000","last_active":"2024-04-18T14:44:22.459801+0000","last_peered":"2024-04-18T14:44:22.459801+0000","last_clean":"2024-04-18T14:44:22.459801+0000","last_became_active":"2024-04-18T14:43:30.653147+0000","last_became_peered":"2024-04-18T14:43:30.653147+0000","last_unstale":"2024-04-18T14:44:22.459801+0000","last_undegraded":"2024-04-18T14:44:22.459801+0000","last_fullsized":"2024-04-18T14:44:22.459801+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T14:43:29.615264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T14:43:29.615264+0000","last_clean_scrub_stamp":"2024-04-18T14:43:29.615264+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T14:44:48.289654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.031239925000000002,"stat_sum":{"num_bytes":3014656,"num_objects":3,"num_object_clones":2,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":10,"num_read_kb":1876,"num_write":33,"num_write_kb":4624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[15,6,14,13,7,11,8],"acting":[15,6,14,13,7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":15,"acting_primary":15,"purged_snaps":[{"start":"2","length":"1"},{"start":"13","length":"1"},{"start":"16","length":"1"},{"start":"23","length":"1"}]},{"pgid":"2.4","version":"0'0","reported_seq":71,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-18T14:44:26.499724+0000","last_change":"2024-04-18T14:43:21.348882+0000","last_active":"2024-04-18T14:44:26.499724+0000","last_peered":"2024-04-18T14:44:26.499724+0000","last_clean":"2024-04-18T14:44:26.499724+0000","last_became_active":"2024-04-18T14:43:21.348012+0000","last_became_peered":"2024-04-18T14:43:21.348012+0000","last_unstale":"2024-04-18T14:44:26.499724+0000","last_undegraded":"2024-04-18T14:44:26.499724+0000","last_fullsized":"2024-04-18T14:44:26.499724+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T14:43:20.303322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T14:43:20.303322+0000","last_clean_scrub_stamp":"2024-04-18T14:43:20.303322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T14:44:27.891832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,12],"acting":[6,12],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.4","version":"88'33","reported_seq":209,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-18T14:44:27.551810+0000","last_change":"2024-04-18T14:44:24.395228+0000","last_active":"2024-04-18T14:44:27.551810+0000","last_peered":"2024-04-18T14:44:27.551810+0000","last_clean":"2024-04-18T14:44:27.551810+0000","last_became_active":"2024-04-18T14:44:10.411493+0000","last_became_peered":"2024-04-18T14:44:10.411493+0000","last_unstale":"2024-04-18T14:44:27.551810+0000","last_undegraded":"2024-04-18T14:44:27.551810+0000","last_fullsized":"2024-04-18T14:44:27.551810+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T14:43:29.615264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T14:43:29.615264+0000","last_clean_scrub_stamp":"2024-04-18T14:43:29.615264+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T14:44:39.265728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0014429989999999999,"stat_sum":{"num_bytes":6520832,"num_objects":3,"num_object_clones":2,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":8,"num_read_kb":1491,"num_write":13,"num_write_kb":6864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":507904,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,12,14,1,6,11,13],"acting":[10,12,14,1,6,11,13],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[{"start":"13","length":"1"},{"start":"23","length":"1"},{"start":"27","length":"1"}]},{"pgid":"2.5","version":"0'0","reported_seq":67,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-18T14:44:22.471426+0000","last_change":"2024-04-18T14:43:21.423043+0000","last_active":"2024-04-18T14:44:22.471426+0000","last_peered":"2024-04-18T14:44:22.471426+0000","last_clean":"2024-04-18T14:44:22.471426+0000","last_became_active":"2024-04-18T14:43:21.422468+0000","last_became_peered":"2024-04-18T14:43:21.422468+0000","last_unstale":"2024-04-18T14:44:22.471426+0000","last_undegraded":"2024-04-18T14:44:22.471426+0000","last_fullsized":"2024-04-18T14:44:22.471426+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T14:43:20.303322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T14:43:20.303322+0000","last_clean_scrub_stamp":"2024-04-18T14:43:20.303322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T14:44:36.598607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2],"acting":[8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.7","version":"83'131","reported_seq":280,"reported_epoch":84,"state":"peering","last_fresh":"2024-04-18T14:44:23.467800+0000","last_change":"2024-04-18T14:44:23.467800+0000","last_active":"2024-04-18T14:44:23.467800+0000","last_peered":"2024-04-18T14:44:22.475891+0000","last_clean":"2024-04-18T14:44:22.475891+0000","last_became_active":"2024-04-18T14:43:30.747200+0000","last_became_peered":"2024-04-18T14:43:30.747200+0000","last_unstale":"2024-04-18T14:44:23.467800+0000","last_undegraded":"2024-04-18T14:44:23.467800+0000","last_fullsized":"2024-04-18T14:44:23.467800+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T14:43:29.615264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T14:43:29.615264+0000","last_clean_scrub_stamp":"2024-04-18T14:43:29.615264+0000","objects_scrubbed":0,"log_size":131,"log_dups_size":0,"ondisk_log_size":131,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T14:44:49.458743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.066260246999999994,"stat_sum":{"num_bytes":9748480,"num_objects":14,"num_object_clones":10,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":1,"num_read":50,"num_read_kb":35805,"num_write":107,"num_write_kb":10832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[14,8,9,4,2,5,11],"acting":[14,8,9,4,2,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[{"start":"2","length":"1"},{"start":"13","length":"1"},{"start":"16","length":"1"},{"start":"23","length":"1"}]},{"pgid":"2.6","version":"0'0","reported_seq":70,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-18T14:44:25.474630+0000","last_change":"2024-04-18T14:43:21.414621+0000","last_active":"2024-04-18T14:44:25.474630+0000","last_peered":"2024-04-18T14:44:25.474630+0000","last_clean":"2024-04-18T14:44:25.474630+0000","last_became_active":"2024-04-18T14:43:21.413906+0000","last_became_peered":"2024-04-18T14:43:21.413906+0000","last_unstale":"2024-04-18T14:44:25.474630+0000","last_undegraded":"2024-04-18T14:44:25.474630+0000","last_fullsized":"2024-04-18T14:44:25.474630+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T14:43:20.303322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T14:43:20.303322+0000","last_clean_scrub_stamp":"2024-04-18T14:43:20.303322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T14:44:28.448910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[14,0],"acting":[14,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":14,"acting_primary":14,"purged_snaps":[]},{"pgid":"3.6","version":"85'153","reported_seq":342,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-18T14:44:25.474641+0000","last_change":"2024-04-18T14:44:24.427189+0000","last_active":"2024-04-18T14:44:25.474641+0000","last_peered":"2024-04-18T14:44:25.474641+0000","last_clean":"2024-04-18T14:44:25.474641+0000","last_became_active":"2024-04-18T14:44:10.420748+0000","last_became_peered":"2024-04-18T14:44:10.420748+0000","last_unstale":"2024-04-18T14:44:25.474641+0000","last_undegraded":"2024-04-18T14:44:25.474641+0000","last_fullsized":"2024-04-18T14:44:25.474641+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T14:43:29.615264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T14:43:29.615264+0000","last_clean_scrub_stamp":"2024-04-18T14:43:29.615264+0000","objects_scrubbed":0,"log_size":153,"log_dups_size":0,"ondisk_log_size":153,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T14:44:55.595983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.033298451999999999,"stat_sum":{"num_bytes":18677760,"num_objects":17,"num_object_clones":13,"num_object_copies":119,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":2,"num_read":31,"num_read_kb":15756,"num_write":54,"num_write_kb":21392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":15,"num_bytes_recovered":16449536,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[14,13,1,15,6,7,9],"acting":[14,13,1,15,6,7,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":14,"acting_primary":14,"purged_snaps":[{"start":"13","length":"1"},{"start":"23","length":"1"},{"start":"27","length":"1"}]},{"pgid":"2.7","version":"0'0","reported_seq":77,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-18T14:44:22.508764+0000","last_change":"2024-04-18T14:44:22.508764+0000","last_active":"2024-04-18T14:44:22.508764+0000","last_peered":"2024-04-18T14:44:22.508764+0000","last_clean":"2024-04-18T14:44:22.508764+0000","last_became_active":"2024-04-18T14:43:21.328185+0000","last_became_peered":"2024-04-18T14:43:21.328185+0000","last_unstale":"2024-04-18T14:44:22.508764+0000","last_undegraded":"2024-04-18T14:44:22.508764+0000","last_fullsized":"2024-04-18T14:44:22.508764+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T14:44:22.508567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T14:43:20.303322+0000","last_clean_scrub_stamp":"2024-04-18T14:44:22.508567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T14:45:46.236519+0000","scrub_duration":0.0031913549999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[15,13],"acting":[15,13],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":15,"acting_primary":15,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":16,"stat_sum":{"num_bytes":166084608,"num_objects":162,"num_object_clones":112,"num_object_copies":1134,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":162,"num_whiteouts":7,"num_read":456,"num_read_kb":234715,"num_write":904,"num_write_kb":174464,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":86,"num_bytes_recovered":78118912,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":290209792,"data_stored":460226560,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1577,"ondisk_log_size":1577,"up":112,"acting":112,"num_store_stats":16},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":11},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1064960,"data_stored":1057856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":13,"up_from":24,"seq":103079215120,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":44084,"kb_used_data":12972,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94327756,"statfs":{"total":96636764160,"available":96591622144,"internally_reserved":0,"allocated":13283328,"data_stored":19442424,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,2,3,4,5,7,11,12,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Apr 18 14:44:21 2024","interfaces":[{"interface":"back","average":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"min":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":1.792,"5min":1.792,"15min":1.792},"last":0.81899999999999995},{"interface":"front","average":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"min":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":2.0600000000000001,"5min":2.0600000000000001,"15min":2.0600000000000001},"last":0.63700000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96599999999999997}]},{"osd":2,"last update":"Thu Apr 18 14:44:21 2024","interfaces":[{"interface":"back","average":{"1min":1.0389999999999999,"5min":1.0389999999999999,"15min":1.0389999999999999},"min":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"max":{"1min":1.974,"5min":1.974,"15min":1.974},"last":1.2749999999999999},{"interface":"front","average":{"1min":1,"5min":1,"15min":1},"min":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.9910000000000001,"5min":1.9910000000000001,"15min":1.9910000000000001},"last":1.212}]},{"osd":3,"last update":"Thu Apr 18 14:44:21 2024","interfaces":[{"interface":"back","average":{"1min":0.91500000000000004,"5min":0.91500000000000004,"15min":0.91500000000000004},"min":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"max":{"1min":1.2110000000000001,"5min":1.2110000000000001,"15min":1.2110000000000001},"last":1.044},{"interface":"front","average":{"1min":1.0489999999999999,"5min":1.0489999999999999,"15min":1.0489999999999999},"min":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":1.4430000000000001,"5min":1.4430000000000001,"15min":1.4430000000000001},"last":1.0900000000000001}]},{"osd":4,"last update":"Thu Apr 18 14:44:21 2024","interfaces":[{"interface":"back","average":{"1min":0.98099999999999998,"5min":0.98099999999999998,"15min":0.98099999999999998},"min":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.3919999999999999,"5min":1.3919999999999999,"15min":1.3919999999999999},"last":1.1499999999999999},{"interface":"front","average":{"1min":0.90100000000000002,"5min":0.90100000000000002,"15min":0.90100000000000002},"min":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":1.306,"5min":1.306,"15min":1.306},"last":0.93700000000000006}]},{"osd":5,"last update":"Thu Apr 18 14:44:21 2024","interfaces":[{"interface":"back","average":{"1min":0.96399999999999997,"5min":0.96399999999999997,"15min":0.96399999999999997},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":1.5860000000000001,"5min":1.5860000000000001,"15min":1.5860000000000001},"last":1.125},{"interface":"front","average":{"1min":1.0780000000000001,"5min":1.0780000000000001,"15min":1.0780000000000001},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.536,"5min":1.536,"15min":1.536},"last":1.298}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1950000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3220000000000001}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.369}]},{"osd":12,"last update":"Thu Apr 18 14:44:21 2024","interfaces":[{"interface":"back","average":{"1min":1.2709999999999999,"5min":1.2709999999999999,"15min":1.2709999999999999},"min":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"max":{"1min":1.911,"5min":1.911,"15min":1.911},"last":1.004},{"interface":"front","average":{"1min":1.3140000000000001,"5min":1.3140000000000001,"15min":1.3140000000000001},"min":{"1min":0.755,"5min":0.755,"15min":0.755},"max":{"1min":2.504,"5min":2.504,"15min":2.504},"last":1.478}]},{"osd":14,"last update":"Thu Apr 18 14:44:21 2024","interfaces":[{"interface":"back","average":{"1min":1.2909999999999999,"5min":1.2909999999999999,"15min":1.2909999999999999},"min":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"max":{"1min":3.6240000000000001,"5min":3.6240000000000001,"15min":3.6240000000000001},"last":1.3420000000000001},{"interface":"front","average":{"1min":1.357,"5min":1.357,"15min":1.357},"min":{"1min":0.627,"5min":0.627,"15min":0.627},"max":{"1min":2.1960000000000002,"5min":2.1960000000000002,"15min":2.1960000000000002},"last":1.4490000000000001}]},{"osd":15,"last update":"Thu Apr 18 14:44:21 2024","interfaces":[{"interface":"back","average":{"1min":1.3560000000000001,"5min":1.3560000000000001,"15min":1.3560000000000001},"min":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"max":{"1min":2.1080000000000001,"5min":2.1080000000000001,"15min":2.1080000000000001},"last":1.522},{"interface":"front","average":{"1min":1.26,"5min":1.26,"15min":1.26},"min":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"max":{"1min":1.8380000000000001,"5min":1.8380000000000001,"15min":1.8380000000000001},"last":1.423}]}]},{"osd":9,"up_from":24,"seq":103079215121,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51392,"kb_used_data":20276,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94320448,"statfs":{"total":96636764160,"available":96584138752,"internally_reserved":0,"allocated":20762624,"data_stored":32127192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1599,"internal_metadata":31848897},"hb_peers":[0,1,3,8,10,11,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Apr 18 14:44:20 2024","interfaces":[{"interface":"back","average":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":1.0429999999999999,"5min":1.0429999999999999,"15min":1.0429999999999999},"last":0.68799999999999994},{"interface":"front","average":{"1min":0.95199999999999996,"5min":0.95199999999999996,"15min":0.95199999999999996},"min":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"max":{"1min":1.6559999999999999,"5min":1.6559999999999999,"15min":1.6559999999999999},"last":0.60699999999999998}]},{"osd":1,"last update":"Thu Apr 18 14:44:20 2024","interfaces":[{"interface":"back","average":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"min":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":1.3200000000000001,"5min":1.3200000000000001,"15min":1.3200000000000001},"last":0.79400000000000004},{"interface":"front","average":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.2509999999999999,"5min":1.2509999999999999,"15min":1.2509999999999999},"last":0.65200000000000002}]},{"osd":3,"last update":"Thu Apr 18 14:44:20 2024","interfaces":[{"interface":"back","average":{"1min":1.032,"5min":1.032,"15min":1.032},"min":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"max":{"1min":1.5980000000000001,"5min":1.5980000000000001,"15min":1.5980000000000001},"last":1.115},{"interface":"front","average":{"1min":1.1539999999999999,"5min":1.1539999999999999,"15min":1.1539999999999999},"min":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"max":{"1min":1.722,"5min":1.722,"15min":1.722},"last":0.871}]},{"osd":8,"last update":"Thu Apr 18 14:44:20 2024","interfaces":[{"interface":"back","average":{"1min":0.94899999999999995,"5min":0.94899999999999995,"15min":0.94899999999999995},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":1.6899999999999999,"5min":1.6899999999999999,"15min":1.6899999999999999},"last":0.91500000000000004},{"interface":"front","average":{"1min":1.3380000000000001,"5min":1.3380000000000001,"15min":1.3380000000000001},"min":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"max":{"1min":5.4989999999999997,"5min":5.4989999999999997,"15min":5.4989999999999997},"last":0.83999999999999997}]},{"osd":10,"last update":"Thu Apr 18 14:44:20 2024","interfaces":[{"interface":"back","average":{"1min":1.196,"5min":1.196,"15min":1.196},"min":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"max":{"1min":1.5429999999999999,"5min":1.5429999999999999,"15min":1.5429999999999999},"last":1.089},{"interface":"front","average":{"1min":1.117,"5min":1.117,"15min":1.117},"min":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"max":{"1min":1.7689999999999999,"5min":1.7689999999999999,"15min":1.7689999999999999},"last":1.1950000000000001}]},{"osd":11,"last update":"Thu Apr 18 14:44:20 2024","interfaces":[{"interface":"back","average":{"1min":1.1279999999999999,"5min":1.1279999999999999,"15min":1.1279999999999999},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.849,"5min":1.849,"15min":1.849},"last":1.149},{"interface":"front","average":{"1min":1.2310000000000001,"5min":1.2310000000000001,"15min":1.2310000000000001},"min":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"max":{"1min":1.8109999999999999,"5min":1.8109999999999999,"15min":1.8109999999999999},"last":1.298}]},{"osd":12,"last update":"Thu Apr 18 14:44:20 2024","interfaces":[{"interface":"back","average":{"1min":1.2989999999999999,"5min":1.2989999999999999,"15min":1.2989999999999999},"min":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"max":{"1min":2.1560000000000001,"5min":2.1560000000000001,"15min":2.1560000000000001},"last":0.94299999999999995},{"interface":"front","average":{"1min":1.29,"5min":1.29,"15min":1.29},"min":{"1min":0.748,"5min":0.748,"15min":0.748},"max":{"1min":2.6930000000000001,"5min":2.6930000000000001,"15min":2.6930000000000001},"last":1.004}]},{"osd":13,"last update":"Thu Apr 18 14:44:20 2024","interfaces":[{"interface":"back","average":{"1min":1.4079999999999999,"5min":1.4079999999999999,"15min":1.4079999999999999},"min":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"max":{"1min":2.6030000000000002,"5min":2.6030000000000002,"15min":2.6030000000000002},"last":1.264},{"interface":"front","average":{"1min":1.4710000000000001,"5min":1.4710000000000001,"15min":1.4710000000000001},"min":{"1min":0.92100000000000004,"5min":0.92100000000000004,"15min":0.92100000000000004},"max":{"1min":2.472,"5min":2.472,"15min":2.472},"last":1.3620000000000001}]},{"osd":14,"last update":"Thu Apr 18 14:44:20 2024","interfaces":[{"interface":"back","average":{"1min":1.456,"5min":1.456,"15min":1.456},"min":{"1min":0.88400000000000001,"5min":0.88400000000000001,"15min":0.88400000000000001},"max":{"1min":2.3180000000000001,"5min":2.3180000000000001,"15min":2.3180000000000001},"last":1.4079999999999999},{"interface":"front","average":{"1min":1.5389999999999999,"5min":1.5389999999999999,"15min":1.5389999999999999},"min":{"1min":1.016,"5min":1.016,"15min":1.016},"max":{"1min":2.6549999999999998,"5min":2.6549999999999998,"15min":2.6549999999999998},"last":1.173}]},{"osd":15,"last update":"Thu Apr 18 14:44:20 2024","interfaces":[{"interface":"back","average":{"1min":1.4119999999999999,"5min":1.4119999999999999,"15min":1.4119999999999999},"min":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"max":{"1min":2.7789999999999999,"5min":2.7789999999999999,"15min":2.7789999999999999},"last":1.242},{"interface":"front","average":{"1min":1.4359999999999999,"5min":1.4359999999999999,"15min":1.4359999999999999},"min":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"max":{"1min":1.923,"5min":1.923,"15min":1.923},"last":1.4470000000000001}]}]},{"osd":5,"up_from":24,"seq":103079215122,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":44920,"kb_used_data":13804,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94326920,"statfs":{"total":96636764160,"available":96590766080,"internally_reserved":0,"allocated":14135296,"data_stored":21379288,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,3,4,6,10,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83399999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47799999999999998}]},{"osd":3,"last update":"Thu Apr 18 14:44:24 2024","interfaces":[{"interface":"back","average":{"1min":1.024,"5min":1.024,"15min":1.024},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":1.4650000000000001,"5min":1.4650000000000001,"15min":1.4650000000000001},"last":0.70699999999999996},{"interface":"front","average":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":0.94999999999999996},"min":{"1min":0.621,"5min":0.621,"15min":0.621},"max":{"1min":1.8460000000000001,"5min":1.8460000000000001,"15min":1.8460000000000001},"last":0.67200000000000004}]},{"osd":4,"last update":"Thu Apr 18 14:44:24 2024","interfaces":[{"interface":"back","average":{"1min":0.89400000000000002,"5min":0.89400000000000002,"15min":0.89400000000000002},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":1.968,"5min":1.968,"15min":1.968},"last":0.68500000000000005},{"interface":"front","average":{"1min":1.016,"5min":1.016,"15min":1.016},"min":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"max":{"1min":1.819,"5min":1.819,"15min":1.819},"last":0.66000000000000003}]},{"osd":6,"last update":"Thu Apr 18 14:44:24 2024","interfaces":[{"interface":"back","average":{"1min":1.0629999999999999,"5min":1.0629999999999999,"15min":1.0629999999999999},"min":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"max":{"1min":2.0760000000000001,"5min":2.0760000000000001,"15min":2.0760000000000001},"last":0.72999999999999998},{"interface":"front","average":{"1min":1.101,"5min":1.101,"15min":1.101},"min":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"max":{"1min":1.694,"5min":1.694,"15min":1.694},"last":0.80900000000000005}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2330000000000001}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96599999999999997}]},{"osd":10,"last update":"Thu Apr 18 14:44:24 2024","interfaces":[{"interface":"back","average":{"1min":1.232,"5min":1.232,"15min":1.232},"min":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"max":{"1min":2.2709999999999999,"5min":2.2709999999999999,"15min":2.2709999999999999},"last":0.78400000000000003},{"interface":"front","average":{"1min":1.2569999999999999,"5min":1.2569999999999999,"15min":1.2569999999999999},"min":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"max":{"1min":2.4470000000000001,"5min":2.4470000000000001,"15min":2.4470000000000001},"last":0.84899999999999998}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.256}]},{"osd":12,"last update":"Thu Apr 18 14:44:24 2024","interfaces":[{"interface":"back","average":{"1min":1.1140000000000001,"5min":1.1140000000000001,"15min":1.1140000000000001},"min":{"1min":0.625,"5min":0.625,"15min":0.625},"max":{"1min":1.728,"5min":1.728,"15min":1.728},"last":0.625},{"interface":"front","average":{"1min":1.339,"5min":1.339,"15min":1.339},"min":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"max":{"1min":2.008,"5min":2.008,"15min":2.008},"last":0.88500000000000001}]},{"osd":13,"last update":"Thu Apr 18 14:44:24 2024","interfaces":[{"interface":"back","average":{"1min":1.355,"5min":1.355,"15min":1.355},"min":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":2.5070000000000001,"5min":2.5070000000000001,"15min":2.5070000000000001},"last":0.53500000000000003},{"interface":"front","average":{"1min":1.2949999999999999,"5min":1.2949999999999999,"15min":1.2949999999999999},"min":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":2.992,"5min":2.992,"15min":2.992},"last":0.59699999999999998}]},{"osd":14,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97499999999999998}]},{"osd":15,"last update":"Thu Apr 18 14:44:24 2024","interfaces":[{"interface":"back","average":{"1min":1.486,"5min":1.486,"15min":1.486},"min":{"1min":0.879,"5min":0.879,"15min":0.879},"max":{"1min":2.415,"5min":2.415,"15min":2.415},"last":0.94099999999999995},{"interface":"front","average":{"1min":1.4470000000000001,"5min":1.4470000000000001,"15min":1.4470000000000001},"min":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"max":{"1min":2.7799999999999998,"5min":2.7799999999999998,"15min":2.7799999999999998},"last":0.92300000000000004}]}]},{"osd":14,"up_from":21,"seq":90194313234,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":77712,"kb_used_data":28544,"kb_used_omap":1,"kb_used_meta":49150,"kb_avail":94294128,"statfs":{"total":96636764160,"available":96557187072,"internally_reserved":0,"allocated":29229056,"data_stored":45029692,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":50330054},"hb_peers":[0,1,2,4,5,6,7,8,9,11,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Apr 18 14:44:21 2024","interfaces":[{"interface":"back","average":{"1min":0.96899999999999997,"5min":0.96899999999999997,"15min":0.96899999999999997},"min":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"max":{"1min":1.454,"5min":1.454,"15min":1.454},"last":0.71499999999999997},{"interface":"front","average":{"1min":1.0660000000000001,"5min":1.0660000000000001,"15min":1.0660000000000001},"min":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"max":{"1min":1.9390000000000001,"5min":1.9390000000000001,"15min":1.9390000000000001},"last":0.86699999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98099999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42599999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94499999999999995}]},{"osd":4,"last update":"Thu Apr 18 14:44:20 2024","interfaces":[{"interface":"back","average":{"1min":0.95099999999999996,"5min":0.95099999999999996,"15min":0.95099999999999996},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.296,"5min":1.296,"15min":1.296},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.97599999999999998,"5min":0.97599999999999998,"15min":0.97599999999999998},"min":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"max":{"1min":1.5129999999999999,"5min":1.5129999999999999,"15min":1.5129999999999999},"last":0.82699999999999996}]},{"osd":5,"last update":"Thu Apr 18 14:44:20 2024","interfaces":[{"interface":"back","average":{"1min":1.218,"5min":1.218,"15min":1.218},"min":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"max":{"1min":2.1269999999999998,"5min":2.1269999999999998,"15min":2.1269999999999998},"last":0.94799999999999995},{"interface":"front","average":{"1min":1.1679999999999999,"5min":1.1679999999999999,"15min":1.1679999999999999},"min":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"max":{"1min":1.5920000000000001,"5min":1.5920000000000001,"15min":1.5920000000000001},"last":0.60499999999999998}]},{"osd":6,"last update":"Thu Apr 18 14:44:20 2024","interfaces":[{"interface":"back","average":{"1min":0.94699999999999995,"5min":0.94699999999999995,"15min":0.94699999999999995},"min":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"max":{"1min":1.3160000000000001,"5min":1.3160000000000001,"15min":1.3160000000000001},"last":0.58899999999999997},{"interface":"front","average":{"1min":1.163,"5min":1.163,"15min":1.163},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":1.7689999999999999,"5min":1.7689999999999999,"15min":1.7689999999999999},"last":0.77800000000000002}]},{"osd":7,"last update":"Thu Apr 18 14:44:20 2024","interfaces":[{"interface":"back","average":{"1min":1.234,"5min":1.234,"15min":1.234},"min":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"max":{"1min":1.7529999999999999,"5min":1.7529999999999999,"15min":1.7529999999999999},"last":0.76500000000000001},{"interface":"front","average":{"1min":1.1759999999999999,"5min":1.1759999999999999,"15min":1.1759999999999999},"min":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"max":{"1min":1.587,"5min":1.587,"15min":1.587},"last":0.73099999999999998}]},{"osd":8,"last update":"Thu Apr 18 14:44:20 2024","interfaces":[{"interface":"back","average":{"1min":1.292,"5min":1.292,"15min":1.292},"min":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"max":{"1min":2.0569999999999999,"5min":2.0569999999999999,"15min":2.0569999999999999},"last":0.92400000000000004},{"interface":"front","average":{"1min":1.2509999999999999,"5min":1.2509999999999999,"15min":1.2509999999999999},"min":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"max":{"1min":1.8740000000000001,"5min":1.8740000000000001,"15min":1.8740000000000001},"last":0.79300000000000004}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0089999999999999}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4219999999999999}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83999999999999997}]},{"osd":12,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.016}]},{"osd":13,"last update":"Thu Apr 18 14:44:20 2024","interfaces":[{"interface":"back","average":{"1min":1.464,"5min":1.464,"15min":1.464},"min":{"1min":0.86799999999999999,"5min":0.86799999999999999,"15min":0.86799999999999999},"max":{"1min":1.8620000000000001,"5min":1.8620000000000001,"15min":1.8620000000000001},"last":0.84699999999999998},{"interface":"front","average":{"1min":1.5349999999999999,"5min":1.5349999999999999,"15min":1.5349999999999999},"min":{"1min":0.94299999999999995,"5min":0.94299999999999995,"15min":0.94299999999999995},"max":{"1min":2.452,"5min":2.452,"15min":2.452},"last":1.03}]},{"osd":15,"last update":"Thu Apr 18 14:44:20 2024","interfaces":[{"interface":"back","average":{"1min":1.5129999999999999,"5min":1.5129999999999999,"15min":1.5129999999999999},"min":{"1min":0.95699999999999996,"5min":0.95699999999999996,"15min":0.95699999999999996},"max":{"1min":2.2549999999999999,"5min":2.2549999999999999,"15min":2.2549999999999999},"last":0.93400000000000005},{"interface":"front","average":{"1min":1.476,"5min":1.476,"15min":1.476},"min":{"1min":0.89800000000000002,"5min":0.89800000000000002,"15min":0.89800000000000002},"max":{"1min":1.9550000000000001,"5min":1.9550000000000001,"15min":1.9550000000000001},"last":0.90800000000000003}]}]},{"osd":1,"up_from":24,"seq":103079215122,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":63000,"kb_used_data":31884,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94308840,"statfs":{"total":96636764160,"available":96572252160,"internally_reserved":0,"allocated":32649216,"data_stored":43369868,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,2,3,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Apr 18 14:44:25 2024","interfaces":[{"interface":"back","average":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":1.165,"5min":1.165,"15min":1.165},"last":0.67900000000000005},{"interface":"front","average":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"min":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":1.292,"5min":1.292,"15min":1.292},"last":0.79300000000000004}]},{"osd":2,"last update":"Thu Apr 18 14:44:25 2024","interfaces":[{"interface":"back","average":{"1min":0.93899999999999995,"5min":0.93899999999999995,"15min":0.93899999999999995},"min":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"max":{"1min":1.3180000000000001,"5min":1.3180000000000001,"15min":1.3180000000000001},"last":1.232},{"interface":"front","average":{"1min":0.95199999999999996,"5min":0.95199999999999996,"15min":0.95199999999999996},"min":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":1.345,"5min":1.345,"15min":1.345},"last":0.86599999999999999}]},{"osd":3,"last update":"Thu Apr 18 14:44:25 2024","interfaces":[{"interface":"back","average":{"1min":1.0760000000000001,"5min":1.0760000000000001,"15min":1.0760000000000001},"min":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":1.486,"5min":1.486,"15min":1.486},"last":1.1619999999999999},{"interface":"front","average":{"1min":1.1679999999999999,"5min":1.1679999999999999,"15min":1.1679999999999999},"min":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"max":{"1min":1.7789999999999999,"5min":1.7789999999999999,"15min":1.7789999999999999},"last":1.0509999999999999}]},{"osd":4,"last update":"Thu Apr 18 14:44:25 2024","interfaces":[{"interface":"back","average":{"1min":0.98299999999999998,"5min":0.98299999999999998,"15min":0.98299999999999998},"min":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"max":{"1min":1.728,"5min":1.728,"15min":1.728},"last":0.95799999999999996},{"interface":"front","average":{"1min":0.93700000000000006,"5min":0.93700000000000006,"15min":0.93700000000000006},"min":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"max":{"1min":1.6950000000000001,"5min":1.6950000000000001,"15min":1.6950000000000001},"last":1.1200000000000001}]},{"osd":5,"last update":"Thu Apr 18 14:44:25 2024","interfaces":[{"interface":"back","average":{"1min":1.0089999999999999,"5min":1.0089999999999999,"15min":1.0089999999999999},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":1.819,"5min":1.819,"15min":1.819},"last":0.98099999999999998},{"interface":"front","average":{"1min":1.083,"5min":1.083,"15min":1.083},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":1.841,"5min":1.841,"15min":1.841},"last":0.90100000000000002}]},{"osd":6,"last update":"Thu Apr 18 14:44:25 2024","interfaces":[{"interface":"back","average":{"1min":1.2529999999999999,"5min":1.2529999999999999,"15min":1.2529999999999999},"min":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"max":{"1min":2.3639999999999999,"5min":2.3639999999999999,"15min":2.3639999999999999},"last":1.3220000000000001},{"interface":"front","average":{"1min":1.1839999999999999,"5min":1.1839999999999999,"15min":1.1839999999999999},"min":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"max":{"1min":1.9419999999999999,"5min":1.9419999999999999,"15min":1.9419999999999999},"last":1.028}]},{"osd":7,"last update":"Thu Apr 18 14:44:25 2024","interfaces":[{"interface":"back","average":{"1min":1.2050000000000001,"5min":1.2050000000000001,"15min":1.2050000000000001},"min":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"max":{"1min":1.96,"5min":1.96,"15min":1.96},"last":0.93700000000000006},{"interface":"front","average":{"1min":1.2509999999999999,"5min":1.2509999999999999,"15min":1.2509999999999999},"min":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"max":{"1min":2.4399999999999999,"5min":2.4399999999999999,"15min":2.4399999999999999},"last":1.194}]},{"osd":8,"last update":"Thu Apr 18 14:44:25 2024","interfaces":[{"interface":"back","average":{"1min":1.2330000000000001,"5min":1.2330000000000001,"15min":1.2330000000000001},"min":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"max":{"1min":1.881,"5min":1.881,"15min":1.881},"last":0.83699999999999997},{"interface":"front","average":{"1min":1.26,"5min":1.26,"15min":1.26},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":2.5169999999999999,"5min":2.5169999999999999,"15min":2.5169999999999999},"last":1.087}]},{"osd":9,"last update":"Thu Apr 18 14:44:25 2024","interfaces":[{"interface":"back","average":{"1min":1.3280000000000001,"5min":1.3280000000000001,"15min":1.3280000000000001},"min":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":2.4780000000000002,"5min":2.4780000000000002,"15min":2.4780000000000002},"last":1.294},{"interface":"front","average":{"1min":1.3129999999999999,"5min":1.3129999999999999,"15min":1.3129999999999999},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":2.161,"5min":2.161,"15min":2.161},"last":0.74199999999999999}]},{"osd":10,"last update":"Thu Apr 18 14:44:25 2024","interfaces":[{"interface":"back","average":{"1min":1.407,"5min":1.407,"15min":1.407},"min":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"max":{"1min":2.625,"5min":2.625,"15min":2.625},"last":1.2669999999999999},{"interface":"front","average":{"1min":1.446,"5min":1.446,"15min":1.446},"min":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"max":{"1min":2.5529999999999999,"5min":2.5529999999999999,"15min":2.5529999999999999},"last":1.353}]}]},{"osd":2,"up_from":22,"seq":94489280530,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40272,"kb_used_data":13248,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94331568,"statfs":{"total":96636764160,"available":96595525632,"internally_reserved":0,"allocated":13565952,"data_stored":19161429,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,3,5,6,7,8,10,11,12,14],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Apr 18 14:44:22 2024","interfaces":[{"interface":"back","average":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"min":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"max":{"1min":1.175,"5min":1.175,"15min":1.175},"last":0.86199999999999999},{"interface":"front","average":{"1min":0.90900000000000003,"5min":0.90900000000000003,"15min":0.90900000000000003},"min":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"max":{"1min":1.3740000000000001,"5min":1.3740000000000001,"15min":1.3740000000000001},"last":0.97699999999999998}]},{"osd":3,"last update":"Thu Apr 18 14:44:22 2024","interfaces":[{"interface":"back","average":{"1min":1.0409999999999999,"5min":1.0409999999999999,"15min":1.0409999999999999},"min":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"max":{"1min":1.6830000000000001,"5min":1.6830000000000001,"15min":1.6830000000000001},"last":0.90300000000000002},{"interface":"front","average":{"1min":1.0700000000000001,"5min":1.0700000000000001,"15min":1.0700000000000001},"min":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"max":{"1min":1.8839999999999999,"5min":1.8839999999999999,"15min":1.8839999999999999},"last":0.94399999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96699999999999997}]},{"osd":5,"last update":"Thu Apr 18 14:44:22 2024","interfaces":[{"interface":"back","average":{"1min":0.98799999999999999,"5min":0.98799999999999999,"15min":0.98799999999999999},"min":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"max":{"1min":1.5469999999999999,"5min":1.5469999999999999,"15min":1.5469999999999999},"last":1.369},{"interface":"front","average":{"1min":0.92500000000000004,"5min":0.92500000000000004,"15min":0.92500000000000004},"min":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":1.333,"5min":1.333,"15min":1.333},"last":1.4079999999999999}]},{"osd":6,"last update":"Thu Apr 18 14:44:19 2024","interfaces":[{"interface":"back","average":{"1min":1.115,"5min":1.115,"15min":1.115},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":2.0529999999999999,"5min":2.0529999999999999,"15min":2.0529999999999999},"last":1.149},{"interface":"front","average":{"1min":1.089,"5min":1.089,"15min":1.089},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.8069999999999999,"5min":1.8069999999999999,"15min":1.8069999999999999},"last":1.0649999999999999}]},{"osd":7,"last update":"Thu Apr 18 14:44:22 2024","interfaces":[{"interface":"back","average":{"1min":1.165,"5min":1.165,"15min":1.165},"min":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"max":{"1min":2.012,"5min":2.012,"15min":2.012},"last":1.298},{"interface":"front","average":{"1min":1.2949999999999999,"5min":1.2949999999999999,"15min":1.2949999999999999},"min":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"max":{"1min":2.1419999999999999,"5min":2.1419999999999999,"15min":2.1419999999999999},"last":1.498}]},{"osd":8,"last update":"Thu Apr 18 14:44:22 2024","interfaces":[{"interface":"back","average":{"1min":1.224,"5min":1.224,"15min":1.224},"min":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"max":{"1min":1.988,"5min":1.988,"15min":1.988},"last":1.5309999999999999},{"interface":"front","average":{"1min":1.3120000000000001,"5min":1.3120000000000001,"15min":1.3120000000000001},"min":{"1min":0.84999999999999998,"5min":0.84999999999999998,"15min":0.84999999999999998},"max":{"1min":2.2240000000000002,"5min":2.2240000000000002,"15min":2.2240000000000002},"last":1.71}]},{"osd":10,"last update":"Thu Apr 18 14:44:19 2024","interfaces":[{"interface":"back","average":{"1min":1.365,"5min":1.365,"15min":1.365},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":2.319,"5min":2.319,"15min":2.319},"last":1.6060000000000001},{"interface":"front","average":{"1min":1.3879999999999999,"5min":1.3879999999999999,"15min":1.3879999999999999},"min":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"max":{"1min":2.27,"5min":2.27,"15min":2.27},"last":1.6599999999999999}]},{"osd":11,"last update":"Thu Apr 18 14:44:19 2024","interfaces":[{"interface":"back","average":{"1min":1.49,"5min":1.49,"15min":1.49},"min":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"max":{"1min":2.4950000000000001,"5min":2.4950000000000001,"15min":2.4950000000000001},"last":1.5840000000000001},{"interface":"front","average":{"1min":1.4590000000000001,"5min":1.4590000000000001,"15min":1.4590000000000001},"min":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"max":{"1min":2.411,"5min":2.411,"15min":2.411},"last":1.6299999999999999}]},{"osd":12,"last update":"Thu Apr 18 14:44:19 2024","interfaces":[{"interface":"back","average":{"1min":1.4910000000000001,"5min":1.4910000000000001,"15min":1.4910000000000001},"min":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":0.88500000000000001},"max":{"1min":2.2669999999999999,"5min":2.2669999999999999,"15min":2.2669999999999999},"last":1.4610000000000001},{"interface":"front","average":{"1min":1.514,"5min":1.514,"15min":1.514},"min":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"max":{"1min":2.3719999999999999,"5min":2.3719999999999999,"15min":2.3719999999999999},"last":1.74}]},{"osd":14,"last update":"Thu Apr 18 14:44:19 2024","interfaces":[{"interface":"back","average":{"1min":1.4390000000000001,"5min":1.4390000000000001,"15min":1.4390000000000001},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":2.3050000000000002,"5min":2.3050000000000002,"15min":2.3050000000000002},"last":1.7849999999999999},{"interface":"front","average":{"1min":1.5069999999999999,"5min":1.5069999999999999,"15min":1.5069999999999999},"min":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":2.4020000000000001,"5min":2.4020000000000001,"15min":2.4020000000000001},"last":1.5569999999999999}]}]},{"osd":15,"up_from":23,"seq":98784247826,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":52752,"kb_used_data":21632,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94319088,"statfs":{"total":96636764160,"available":96582746112,"internally_reserved":0,"allocated":22151168,"data_stored":32953414,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31848903},"hb_peers":[0,4,5,6,7,8,10,11,13,14],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Apr 18 14:44:19 2024","interfaces":[{"interface":"back","average":{"1min":0.94699999999999995,"5min":0.94699999999999995,"15min":0.94699999999999995},"min":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"max":{"1min":1.405,"5min":1.405,"15min":1.405},"last":0.69799999999999995},{"interface":"front","average":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"min":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":1.0569999999999999,"5min":1.0569999999999999,"15min":1.0569999999999999},"last":0.86399999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2050000000000001}]},{"osd":4,"last update":"Thu Apr 18 14:44:19 2024","interfaces":[{"interface":"back","average":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.85099999999999998},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.2669999999999999,"5min":1.2669999999999999,"15min":1.2669999999999999},"last":0.79600000000000004},{"interface":"front","average":{"1min":0.877,"5min":0.877,"15min":0.877},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.2410000000000001,"5min":1.2410000000000001,"15min":1.2410000000000001},"last":0.93500000000000005}]},{"osd":5,"last update":"Thu Apr 18 14:44:22 2024","interfaces":[{"interface":"back","average":{"1min":1.0209999999999999,"5min":1.0209999999999999,"15min":1.0209999999999999},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":2.0579999999999998,"5min":2.0579999999999998,"15min":2.0579999999999998},"last":1.038},{"interface":"front","average":{"1min":1.089,"5min":1.089,"15min":1.089},"min":{"1min":0.75,"5min":0.75,"15min":0.75},"max":{"1min":1.9259999999999999,"5min":1.9259999999999999,"15min":1.9259999999999999},"last":0.91500000000000004}]},{"osd":6,"last update":"Thu Apr 18 14:44:19 2024","interfaces":[{"interface":"back","average":{"1min":1.1379999999999999,"5min":1.1379999999999999,"15min":1.1379999999999999},"min":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"max":{"1min":1.8680000000000001,"5min":1.8680000000000001,"15min":1.8680000000000001},"last":1.224},{"interface":"front","average":{"1min":1.228,"5min":1.228,"15min":1.228},"min":{"1min":0.86499999999999999,"5min":0.86499999999999999,"15min":0.86499999999999999},"max":{"1min":1.79,"5min":1.79,"15min":1.79},"last":1.121}]},{"osd":7,"last update":"Thu Apr 18 14:44:19 2024","interfaces":[{"interface":"back","average":{"1min":1.0549999999999999,"5min":1.0549999999999999,"15min":1.0549999999999999},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":1.488,"5min":1.488,"15min":1.488},"last":1.0860000000000001},{"interface":"front","average":{"1min":1.1830000000000001,"5min":1.1830000000000001,"15min":1.1830000000000001},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":1.976,"5min":1.976,"15min":1.976},"last":1.355}]},{"osd":8,"last update":"Thu Apr 18 14:44:19 2024","interfaces":[{"interface":"back","average":{"1min":1.1879999999999999,"5min":1.1879999999999999,"15min":1.1879999999999999},"min":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"max":{"1min":2.004,"5min":2.004,"15min":2.004},"last":0.95999999999999996},{"interface":"front","average":{"1min":1.222,"5min":1.222,"15min":1.222},"min":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"max":{"1min":1.786,"5min":1.786,"15min":1.786},"last":1.1930000000000001}]},{"osd":10,"last update":"Thu Apr 18 14:44:19 2024","interfaces":[{"interface":"back","average":{"1min":1.3360000000000001,"5min":1.3360000000000001,"15min":1.3360000000000001},"min":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"max":{"1min":2.403,"5min":2.403,"15min":2.403},"last":1.1479999999999999},{"interface":"front","average":{"1min":1.331,"5min":1.331,"15min":1.331},"min":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"max":{"1min":2.2549999999999999,"5min":2.2549999999999999,"15min":2.2549999999999999},"last":1.004}]},{"osd":11,"last update":"Thu Apr 18 14:44:19 2024","interfaces":[{"interface":"back","average":{"1min":1.399,"5min":1.399,"15min":1.399},"min":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"max":{"1min":2.2109999999999999,"5min":2.2109999999999999,"15min":2.2109999999999999},"last":1.325},{"interface":"front","average":{"1min":1.4490000000000001,"5min":1.4490000000000001,"15min":1.4490000000000001},"min":{"1min":0.629,"5min":0.629,"15min":0.629},"max":{"1min":2.1589999999999998,"5min":2.1589999999999998,"15min":2.1589999999999998},"last":1.2909999999999999}]},{"osd":13,"last update":"Thu Apr 18 14:44:22 2024","interfaces":[{"interface":"back","average":{"1min":1.391,"5min":1.391,"15min":1.391},"min":{"1min":1.0109999999999999,"5min":1.0109999999999999,"15min":1.0109999999999999},"max":{"1min":1.9419999999999999,"5min":1.9419999999999999,"15min":1.9419999999999999},"last":1.1739999999999999},{"interface":"front","average":{"1min":1.387,"5min":1.387,"15min":1.387},"min":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"max":{"1min":1.8959999999999999,"5min":1.8959999999999999,"15min":1.8959999999999999},"last":1.2450000000000001}]},{"osd":14,"last update":"Thu Apr 18 14:44:19 2024","interfaces":[{"interface":"back","average":{"1min":1.4279999999999999,"5min":1.4279999999999999,"15min":1.4279999999999999},"min":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"max":{"1min":2.351,"5min":2.351,"15min":2.351},"last":1.4370000000000001},{"interface":"front","average":{"1min":1.454,"5min":1.454,"15min":1.454},"min":{"1min":0.84299999999999997,"5min":0.84299999999999997,"15min":0.84299999999999997},"max":{"1min":2.766,"5min":2.766,"15min":2.766},"last":1.3799999999999999}]}]},{"osd":4,"up_from":22,"seq":94489280529,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":52888,"kb_used_data":21772,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94318952,"statfs":{"total":96636764160,"available":96582606848,"internally_reserved":0,"allocated":22294528,"data_stored":37568009,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[2,3,5,6,10,11,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":2,"last update":"Thu Apr 18 14:44:20 2024","interfaces":[{"interface":"back","average":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":1.2330000000000001,"5min":1.2330000000000001,"15min":1.2330000000000001},"last":0.66800000000000004},{"interface":"front","average":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":1.306,"5min":1.306,"15min":1.306},"last":0.57399999999999995}]},{"osd":3,"last update":"Thu Apr 18 14:44:20 2024","interfaces":[{"interface":"back","average":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":1.1499999999999999,"5min":1.1499999999999999,"15min":1.1499999999999999},"last":0.68300000000000005},{"interface":"front","average":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":1.0169999999999999,"5min":1.0169999999999999,"15min":1.0169999999999999},"last":0.55700000000000005}]},{"osd":5,"last update":"Thu Apr 18 14:44:20 2024","interfaces":[{"interface":"back","average":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":1.0609999999999999,"5min":1.0609999999999999,"15min":1.0609999999999999},"last":0.54800000000000004},{"interface":"front","average":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":1.2190000000000001,"5min":1.2190000000000001,"15min":1.2190000000000001},"last":0.623}]},{"osd":6,"last update":"Thu Apr 18 14:44:20 2024","interfaces":[{"interface":"back","average":{"1min":0.84999999999999998,"5min":0.84999999999999998,"15min":0.84999999999999998},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":1.1930000000000001,"5min":1.1930000000000001,"15min":1.1930000000000001},"last":0.82099999999999995},{"interface":"front","average":{"1min":0.88,"5min":0.88,"15min":0.88},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.337,"5min":1.337,"15min":1.337},"last":0.58799999999999997}]},{"osd":10,"last update":"Thu Apr 18 14:44:20 2024","interfaces":[{"interface":"back","average":{"1min":0.876,"5min":0.876,"15min":0.876},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":1.49,"5min":1.49,"15min":1.49},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.90900000000000003,"5min":0.90900000000000003,"15min":0.90900000000000003},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.5700000000000001,"5min":1.5700000000000001,"15min":1.5700000000000001},"last":0.70099999999999996}]},{"osd":11,"last update":"Thu Apr 18 14:44:20 2024","interfaces":[{"interface":"back","average":{"1min":0.86499999999999999,"5min":0.86499999999999999,"15min":0.86499999999999999},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":1.2130000000000001,"5min":1.2130000000000001,"15min":1.2130000000000001},"last":0.39900000000000002},{"interface":"front","average":{"1min":0.90100000000000002,"5min":0.90100000000000002,"15min":0.90100000000000002},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.365,"5min":1.365,"15min":1.365},"last":0.51900000000000002}]},{"osd":12,"last update":"Thu Apr 18 14:44:20 2024","interfaces":[{"interface":"back","average":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":1.1879999999999999,"5min":1.1879999999999999,"15min":1.1879999999999999},"last":0.32900000000000001},{"interface":"front","average":{"1min":0.86099999999999999,"5min":0.86099999999999999,"15min":0.86099999999999999},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":1.2949999999999999,"5min":1.2949999999999999,"15min":1.2949999999999999},"last":0.35199999999999998}]},{"osd":13,"last update":"Thu Apr 18 14:44:20 2024","interfaces":[{"interface":"back","average":{"1min":0.95999999999999996,"5min":0.95999999999999996,"15min":0.95999999999999996},"min":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.4279999999999999,"5min":1.4279999999999999,"15min":1.4279999999999999},"last":0.65200000000000002},{"interface":"front","average":{"1min":0.89900000000000002,"5min":0.89900000000000002,"15min":0.89900000000000002},"min":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"max":{"1min":1.3360000000000001,"5min":1.3360000000000001,"15min":1.3360000000000001},"last":0.63700000000000001}]},{"osd":14,"last update":"Thu Apr 18 14:44:20 2024","interfaces":[{"interface":"back","average":{"1min":1.022,"5min":1.022,"15min":1.022},"min":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":1.4730000000000001,"5min":1.4730000000000001,"15min":1.4730000000000001},"last":0.81100000000000005},{"interface":"front","average":{"1min":1.0429999999999999,"5min":1.0429999999999999,"15min":1.0429999999999999},"min":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"max":{"1min":1.369,"5min":1.369,"15min":1.369},"last":0.53400000000000003}]},{"osd":15,"last update":"Thu Apr 18 14:44:20 2024","interfaces":[{"interface":"back","average":{"1min":1.016,"5min":1.016,"15min":1.016},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.5980000000000001,"5min":1.5980000000000001,"15min":1.5980000000000001},"last":0.79700000000000004},{"interface":"front","average":{"1min":1.02,"5min":1.02,"15min":1.02},"min":{"1min":0.624,"5min":0.624,"15min":0.624},"max":{"1min":1.5649999999999999,"5min":1.5649999999999999,"15min":1.5649999999999999},"last":0.71299999999999997}]}]},{"osd":6,"up_from":22,"seq":94489280529,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":54348,"kb_used_data":23224,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94317492,"statfs":{"total":96636764160,"available":96581111808,"internally_reserved":0,"allocated":23781376,"data_stored":35211580,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31848903},"hb_peers":[0,1,5,7,8,9,11,12,13,14],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47199999999999998}]},{"osd":1,"last update":"Thu Apr 18 14:44:19 2024","interfaces":[{"interface":"back","average":{"1min":1.0329999999999999,"5min":1.0329999999999999,"15min":1.0329999999999999},"min":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"max":{"1min":1.633,"5min":1.633,"15min":1.633},"last":0.877},{"interface":"front","average":{"1min":1.129,"5min":1.129,"15min":1.129},"min":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"max":{"1min":1.585,"5min":1.585,"15min":1.585},"last":1.1319999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95399999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86599999999999999}]},{"osd":5,"last update":"Thu Apr 18 14:44:19 2024","interfaces":[{"interface":"back","average":{"1min":0.96399999999999997,"5min":0.96399999999999997,"15min":0.96399999999999997},"min":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":1.627,"5min":1.627,"15min":1.627},"last":0.69399999999999995},{"interface":"front","average":{"1min":0.98199999999999998,"5min":0.98199999999999998,"15min":0.98199999999999998},"min":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"max":{"1min":1.246,"5min":1.246,"15min":1.246},"last":0.65100000000000002}]},{"osd":7,"last update":"Thu Apr 18 14:44:19 2024","interfaces":[{"interface":"back","average":{"1min":1.1399999999999999,"5min":1.1399999999999999,"15min":1.1399999999999999},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.5860000000000001,"5min":1.5860000000000001,"15min":1.5860000000000001},"last":1.052},{"interface":"front","average":{"1min":1.022,"5min":1.022,"15min":1.022},"min":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":1.482,"5min":1.482,"15min":1.482},"last":0.90900000000000003}]},{"osd":8,"last update":"Thu Apr 18 14:44:19 2024","interfaces":[{"interface":"back","average":{"1min":0.99299999999999999,"5min":0.99299999999999999,"15min":0.99299999999999999},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.3380000000000001,"5min":1.3380000000000001,"15min":1.3380000000000001},"last":0.58299999999999996},{"interface":"front","average":{"1min":1.163,"5min":1.163,"15min":1.163},"min":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"max":{"1min":1.673,"5min":1.673,"15min":1.673},"last":0.76000000000000001}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.03}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3240000000000001}]},{"osd":11,"last update":"Thu Apr 18 14:44:17 2024","interfaces":[{"interface":"back","average":{"1min":1.359,"5min":1.359,"15min":1.359},"min":{"1min":1.0229999999999999,"5min":1.0229999999999999,"15min":1.0229999999999999},"max":{"1min":2.3610000000000002,"5min":2.3610000000000002,"15min":2.3610000000000002},"last":0.98999999999999999},{"interface":"front","average":{"1min":1.1439999999999999,"5min":1.1439999999999999,"15min":1.1439999999999999},"min":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"max":{"1min":1.698,"5min":1.698,"15min":1.698},"last":0.84599999999999997}]},{"osd":12,"last update":"Thu Apr 18 14:44:17 2024","interfaces":[{"interface":"back","average":{"1min":1.1950000000000001,"5min":1.1950000000000001,"15min":1.1950000000000001},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.5189999999999999,"5min":1.5189999999999999,"15min":1.5189999999999999},"last":0.72599999999999998},{"interface":"front","average":{"1min":1.3400000000000001,"5min":1.3400000000000001,"15min":1.3400000000000001},"min":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"max":{"1min":2.1920000000000002,"5min":2.1920000000000002,"15min":2.1920000000000002},"last":0.93100000000000005}]},{"osd":13,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.095}]},{"osd":14,"last update":"Thu Apr 18 14:44:17 2024","interfaces":[{"interface":"back","average":{"1min":1.3280000000000001,"5min":1.3280000000000001,"15min":1.3280000000000001},"min":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"max":{"1min":1.8580000000000001,"5min":1.8580000000000001,"15min":1.8580000000000001},"last":1.1739999999999999},{"interface":"front","average":{"1min":1.347,"5min":1.347,"15min":1.347},"min":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":1.712,"5min":1.712,"15min":1.712},"last":1.073}]}]},{"osd":10,"up_from":22,"seq":94489280530,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":52288,"kb_used_data":21164,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94319552,"statfs":{"total":96636764160,"available":96583221248,"internally_reserved":0,"allocated":21671936,"data_stored":32720368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1599,"internal_metadata":31848897},"hb_peers":[1,6,7,8,9,11,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81899999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.371}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.117}]},{"osd":6,"last update":"Thu Apr 18 14:44:20 2024","interfaces":[{"interface":"back","average":{"1min":1.1830000000000001,"5min":1.1830000000000001,"15min":1.1830000000000001},"min":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"max":{"1min":3.9830000000000001,"5min":3.9830000000000001,"15min":3.9830000000000001},"last":0.39200000000000002},{"interface":"front","average":{"1min":1.0309999999999999,"5min":1.0309999999999999,"15min":1.0309999999999999},"min":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"max":{"1min":2.9420000000000002,"5min":2.9420000000000002,"15min":2.9420000000000002},"last":0.36099999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60799999999999998}]},{"osd":8,"last update":"Thu Apr 18 14:44:20 2024","interfaces":[{"interface":"back","average":{"1min":1.091,"5min":1.091,"15min":1.091},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":4.0439999999999996,"5min":4.0439999999999996,"15min":4.0439999999999996},"last":0.66800000000000004},{"interface":"front","average":{"1min":1.4390000000000001,"5min":1.4390000000000001,"15min":1.4390000000000001},"min":{"1min":0.89500000000000002,"5min":0.89500000000000002,"15min":0.89500000000000002},"max":{"1min":4.4900000000000002,"5min":4.4900000000000002,"15min":4.4900000000000002},"last":0.63400000000000001}]},{"osd":9,"last update":"Thu Apr 18 14:44:20 2024","interfaces":[{"interface":"back","average":{"1min":1.3580000000000001,"5min":1.3580000000000001,"15min":1.3580000000000001},"min":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"max":{"1min":3.8439999999999999,"5min":3.8439999999999999,"15min":3.8439999999999999},"last":0.56499999999999995},{"interface":"front","average":{"1min":1.361,"5min":1.361,"15min":1.361},"min":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"max":{"1min":4.2880000000000003,"5min":4.2880000000000003,"15min":4.2880000000000003},"last":0.70199999999999996}]},{"osd":11,"last update":"Thu Apr 18 14:44:20 2024","interfaces":[{"interface":"back","average":{"1min":1.4159999999999999,"5min":1.4159999999999999,"15min":1.4159999999999999},"min":{"1min":0.755,"5min":0.755,"15min":0.755},"max":{"1min":4.3399999999999999,"5min":4.3399999999999999,"15min":4.3399999999999999},"last":0.74399999999999999},{"interface":"front","average":{"1min":1.5740000000000001,"5min":1.5740000000000001,"15min":1.5740000000000001},"min":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"max":{"1min":4.4450000000000003,"5min":4.4450000000000003,"15min":4.4450000000000003},"last":0.72499999999999998}]},{"osd":12,"last update":"Thu Apr 18 14:44:20 2024","interfaces":[{"interface":"back","average":{"1min":1.3440000000000001,"5min":1.3440000000000001,"15min":1.3440000000000001},"min":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"max":{"1min":3.5539999999999998,"5min":3.5539999999999998,"15min":3.5539999999999998},"last":0.68700000000000006},{"interface":"front","average":{"1min":1.431,"5min":1.431,"15min":1.431},"min":{"1min":0.621,"5min":0.621,"15min":0.621},"max":{"1min":4.125,"5min":4.125,"15min":4.125},"last":0.61899999999999999}]},{"osd":13,"last update":"Thu Apr 18 14:44:20 2024","interfaces":[{"interface":"back","average":{"1min":1.71,"5min":1.71,"15min":1.71},"min":{"1min":1.1160000000000001,"5min":1.1160000000000001,"15min":1.1160000000000001},"max":{"1min":4.5359999999999996,"5min":4.5359999999999996,"15min":4.5359999999999996},"last":0.77100000000000002},{"interface":"front","average":{"1min":1.5429999999999999,"5min":1.5429999999999999,"15min":1.5429999999999999},"min":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.85599999999999998},"max":{"1min":4.0049999999999999,"5min":4.0049999999999999,"15min":4.0049999999999999},"last":0.755}]},{"osd":14,"last update":"Thu Apr 18 14:44:20 2024","interfaces":[{"interface":"back","average":{"1min":1.7090000000000001,"5min":1.7090000000000001,"15min":1.7090000000000001},"min":{"1min":1.073,"5min":1.073,"15min":1.073},"max":{"1min":4.3940000000000001,"5min":4.3940000000000001,"15min":4.3940000000000001},"last":0.5},{"interface":"front","average":{"1min":1.5680000000000001,"5min":1.5680000000000001,"15min":1.5680000000000001},"min":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"max":{"1min":3.73,"5min":3.73,"15min":3.73},"last":0.53800000000000003}]},{"osd":15,"last update":"Thu Apr 18 14:44:20 2024","interfaces":[{"interface":"back","average":{"1min":1.5629999999999999,"5min":1.5629999999999999,"15min":1.5629999999999999},"min":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":0.94999999999999996},"max":{"1min":4.1959999999999997,"5min":4.1959999999999997,"15min":4.1959999999999997},"last":0.78600000000000003},{"interface":"front","average":{"1min":1.802,"5min":1.802,"15min":1.802},"min":{"1min":1.1579999999999999,"5min":1.1579999999999999,"15min":1.1579999999999999},"max":{"1min":4.577,"5min":4.577,"15min":4.577},"last":0.80600000000000005}]}]},{"osd":11,"up_from":22,"seq":94489280530,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51704,"kb_used_data":20584,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94320136,"statfs":{"total":96636764160,"available":96583819264,"internally_reserved":0,"allocated":21078016,"data_stored":36920841,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31848901},"hb_peers":[2,4,5,6,8,10,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":2,"last update":"Thu Apr 18 14:44:18 2024","interfaces":[{"interface":"back","average":{"1min":0.93899999999999995,"5min":0.93899999999999995,"15min":0.93899999999999995},"min":{"1min":0.503,"5min":0.503,"15min":0.503},"max":{"1min":1.367,"5min":1.367,"15min":1.367},"last":1.028},{"interface":"front","average":{"1min":1.0229999999999999,"5min":1.0229999999999999,"15min":1.0229999999999999},"min":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":2.863,"5min":2.863,"15min":2.863},"last":0.80900000000000005}]},{"osd":4,"last update":"Thu Apr 18 14:44:18 2024","interfaces":[{"interface":"back","average":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"min":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":1.1259999999999999,"5min":1.1259999999999999,"15min":1.1259999999999999},"last":1.1339999999999999},{"interface":"front","average":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.129,"5min":1.129,"15min":1.129},"last":0.92300000000000004}]},{"osd":5,"last update":"Thu Apr 18 14:44:23 2024","interfaces":[{"interface":"back","average":{"1min":0.98999999999999999,"5min":0.98999999999999999,"15min":0.98999999999999999},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":1.5840000000000001,"5min":1.5840000000000001,"15min":1.5840000000000001},"last":1.2569999999999999},{"interface":"front","average":{"1min":0.97199999999999998,"5min":0.97199999999999998,"15min":0.97199999999999998},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.619,"5min":1.619,"15min":1.619},"last":0.873}]},{"osd":6,"last update":"Thu Apr 18 14:44:18 2024","interfaces":[{"interface":"back","average":{"1min":1.1319999999999999,"5min":1.1319999999999999,"15min":1.1319999999999999},"min":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"max":{"1min":2.9199999999999999,"5min":2.9199999999999999,"15min":2.9199999999999999},"last":1.159},{"interface":"front","average":{"1min":1,"5min":1,"15min":1},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.9510000000000001,"5min":1.9510000000000001,"15min":1.9510000000000001},"last":0.76900000000000002}]},{"osd":8,"last update":"Thu Apr 18 14:44:23 2024","interfaces":[{"interface":"back","average":{"1min":0.97799999999999998,"5min":0.97799999999999998,"15min":0.97799999999999998},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.452,"5min":1.452,"15min":1.452},"last":1.085},{"interface":"front","average":{"1min":1.006,"5min":1.006,"15min":1.006},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":1.383,"5min":1.383,"15min":1.383},"last":1.109}]},{"osd":10,"last update":"Thu Apr 18 14:44:18 2024","interfaces":[{"interface":"back","average":{"1min":1.234,"5min":1.234,"15min":1.234},"min":{"1min":0.745,"5min":0.745,"15min":0.745},"max":{"1min":2.774,"5min":2.774,"15min":2.774},"last":0.622},{"interface":"front","average":{"1min":1.105,"5min":1.105,"15min":1.105},"min":{"1min":0.627,"5min":0.627,"15min":0.627},"max":{"1min":1.6890000000000001,"5min":1.6890000000000001,"15min":1.6890000000000001},"last":0.94799999999999995}]},{"osd":12,"last update":"Thu Apr 18 14:44:18 2024","interfaces":[{"interface":"back","average":{"1min":1.1639999999999999,"5min":1.1639999999999999,"15min":1.1639999999999999},"min":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.6719999999999999,"5min":1.6719999999999999,"15min":1.6719999999999999},"last":0.83799999999999997},{"interface":"front","average":{"1min":1.2729999999999999,"5min":1.2729999999999999,"15min":1.2729999999999999},"min":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"max":{"1min":3.4169999999999998,"5min":3.4169999999999998,"15min":3.4169999999999998},"last":1.0569999999999999}]},{"osd":13,"last update":"Thu Apr 18 14:44:23 2024","interfaces":[{"interface":"back","average":{"1min":1.367,"5min":1.367,"15min":1.367},"min":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"max":{"1min":3.3239999999999998,"5min":3.3239999999999998,"15min":3.3239999999999998},"last":0.98499999999999999},{"interface":"front","average":{"1min":1.1639999999999999,"5min":1.1639999999999999,"15min":1.1639999999999999},"min":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"max":{"1min":1.746,"5min":1.746,"15min":1.746},"last":1.004}]},{"osd":14,"last update":"Thu Apr 18 14:44:18 2024","interfaces":[{"interface":"back","average":{"1min":1.1950000000000001,"5min":1.1950000000000001,"15min":1.1950000000000001},"min":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"max":{"1min":1.6619999999999999,"5min":1.6619999999999999,"15min":1.6619999999999999},"last":0.90400000000000003},{"interface":"front","average":{"1min":1.2450000000000001,"5min":1.2450000000000001,"15min":1.2450000000000001},"min":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"max":{"1min":1.7210000000000001,"5min":1.7210000000000001,"15min":1.7210000000000001},"last":1.1919999999999999}]},{"osd":15,"last update":"Thu Apr 18 14:44:23 2024","interfaces":[{"interface":"back","average":{"1min":1.284,"5min":1.284,"15min":1.284},"min":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"max":{"1min":1.851,"5min":1.851,"15min":1.851},"last":1.3049999999999999},{"interface":"front","average":{"1min":1.409,"5min":1.409,"15min":1.409},"min":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"max":{"1min":3.3769999999999998,"5min":3.3769999999999998,"15min":3.3769999999999998},"last":1.238}]}]},{"osd":12,"up_from":22,"seq":94489280530,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":48796,"kb_used_data":17680,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94323044,"statfs":{"total":96636764160,"available":96586797056,"internally_reserved":0,"allocated":18104320,"data_stored":28806665,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,3,4,5,6,10,11,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.621}]},{"osd":1,"last update":"Thu Apr 18 14:44:20 2024","interfaces":[{"interface":"back","average":{"1min":0.93999999999999995,"5min":0.93999999999999995,"15min":0.93999999999999995},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.5449999999999999,"5min":1.5449999999999999,"15min":1.5449999999999999},"last":0.76200000000000001},{"interface":"front","average":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":1.2649999999999999,"5min":1.2649999999999999,"15min":1.2649999999999999},"last":0.74399999999999999}]},{"osd":3,"last update":"Thu Apr 18 14:44:20 2024","interfaces":[{"interface":"back","average":{"1min":0.93999999999999995,"5min":0.93999999999999995,"15min":0.93999999999999995},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":1.4930000000000001,"5min":1.4930000000000001,"15min":1.4930000000000001},"last":0.81499999999999995},{"interface":"front","average":{"1min":0.91500000000000004,"5min":0.91500000000000004,"15min":0.91500000000000004},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.4319999999999999,"5min":1.4319999999999999,"15min":1.4319999999999999},"last":0.79500000000000004}]},{"osd":4,"last update":"Thu Apr 18 14:44:20 2024","interfaces":[{"interface":"back","average":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":1.383,"5min":1.383,"15min":1.383},"last":0.72299999999999998},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":1.335,"5min":1.335,"15min":1.335},"last":0.64200000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78200000000000003}]},{"osd":6,"last update":"Thu Apr 18 14:44:20 2024","interfaces":[{"interface":"back","average":{"1min":1.0289999999999999,"5min":1.0289999999999999,"15min":1.0289999999999999},"min":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":1.6060000000000001,"5min":1.6060000000000001,"15min":1.6060000000000001},"last":1.127},{"interface":"front","average":{"1min":1.0820000000000001,"5min":1.0820000000000001,"15min":1.0820000000000001},"min":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"max":{"1min":1.5620000000000001,"5min":1.5620000000000001,"15min":1.5620000000000001},"last":1.054}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1539999999999999}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4119999999999999}]},{"osd":10,"last update":"Thu Apr 18 14:44:20 2024","interfaces":[{"interface":"back","average":{"1min":1.137,"5min":1.137,"15min":1.137},"min":{"1min":0.626,"5min":0.626,"15min":0.626},"max":{"1min":1.6919999999999999,"5min":1.6919999999999999,"15min":1.6919999999999999},"last":1.202},{"interface":"front","average":{"1min":1.1100000000000001,"5min":1.1100000000000001,"15min":1.1100000000000001},"min":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"max":{"1min":1.8899999999999999,"5min":1.8899999999999999,"15min":1.8899999999999999},"last":1.0700000000000001}]},{"osd":11,"last update":"Thu Apr 18 14:44:20 2024","interfaces":[{"interface":"back","average":{"1min":1.1890000000000001,"5min":1.1890000000000001,"15min":1.1890000000000001},"min":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"max":{"1min":2.04,"5min":2.04,"15min":2.04},"last":1.0009999999999999},{"interface":"front","average":{"1min":1.1599999999999999,"5min":1.1599999999999999,"15min":1.1599999999999999},"min":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"max":{"1min":1.8660000000000001,"5min":1.8660000000000001,"15min":1.8660000000000001},"last":1.083}]},{"osd":13,"last update":"Thu Apr 18 14:44:20 2024","interfaces":[{"interface":"back","average":{"1min":1.181,"5min":1.181,"15min":1.181},"min":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"max":{"1min":1.8080000000000001,"5min":1.8080000000000001,"15min":1.8080000000000001},"last":1.014},{"interface":"front","average":{"1min":1.228,"5min":1.228,"15min":1.228},"min":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"max":{"1min":2.133,"5min":2.133,"15min":2.133},"last":0.91100000000000003}]},{"osd":14,"last update":"Thu Apr 18 14:44:20 2024","interfaces":[{"interface":"back","average":{"1min":1.226,"5min":1.226,"15min":1.226},"min":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"max":{"1min":1.7410000000000001,"5min":1.7410000000000001,"15min":1.7410000000000001},"last":0.94399999999999995},{"interface":"front","average":{"1min":1.232,"5min":1.232,"15min":1.232},"min":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"max":{"1min":1.966,"5min":1.966,"15min":1.966},"last":1.0389999999999999}]},{"osd":15,"last update":"Thu Apr 18 14:44:20 2024","interfaces":[{"interface":"back","average":{"1min":1.2190000000000001,"5min":1.2190000000000001,"15min":1.2190000000000001},"min":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"max":{"1min":1.802,"5min":1.802,"15min":1.802},"last":0.98299999999999998},{"interface":"front","average":{"1min":1.2889999999999999,"5min":1.2889999999999999,"15min":1.2889999999999999},"min":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"max":{"1min":1.8580000000000001,"5min":1.8580000000000001,"15min":1.8580000000000001},"last":1.101}]}]},{"osd":0,"up_from":23,"seq":98784247825,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":46328,"kb_used_data":15212,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94325512,"statfs":{"total":96636764160,"available":96589324288,"internally_reserved":0,"allocated":15577088,"data_stored":20514406,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[1,4,6,7,8,10,11,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Apr 18 14:44:23 2024","interfaces":[{"interface":"back","average":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":1.218,"5min":1.218,"15min":1.218},"last":0.71199999999999997},{"interface":"front","average":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.47,"5min":1.47,"15min":1.47},"last":0.82799999999999996}]},{"osd":4,"last update":"Thu Apr 18 14:44:19 2024","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":1.5409999999999999,"5min":1.5409999999999999,"15min":1.5409999999999999},"last":0.46899999999999997},{"interface":"front","average":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":1.903,"5min":1.903,"15min":1.903},"last":0.34999999999999998}]},{"osd":6,"last update":"Thu Apr 18 14:44:19 2024","interfaces":[{"interface":"back","average":{"1min":0.90200000000000002,"5min":0.90200000000000002,"15min":0.90200000000000002},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":2.5009999999999999,"5min":2.5009999999999999,"15min":2.5009999999999999},"last":0.63500000000000001},{"interface":"front","average":{"1min":0.89500000000000002,"5min":0.89500000000000002,"15min":0.89500000000000002},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":1.6240000000000001,"5min":1.6240000000000001,"15min":1.6240000000000001},"last":0.66700000000000004}]},{"osd":7,"last update":"Thu Apr 18 14:44:19 2024","interfaces":[{"interface":"back","average":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":1.2350000000000001,"5min":1.2350000000000001,"15min":1.2350000000000001},"last":0.54700000000000004},{"interface":"front","average":{"1min":0.93899999999999995,"5min":0.93899999999999995,"15min":0.93899999999999995},"min":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"max":{"1min":1.5860000000000001,"5min":1.5860000000000001,"15min":1.5860000000000001},"last":0.79900000000000004}]},{"osd":8,"last update":"Thu Apr 18 14:44:19 2024","interfaces":[{"interface":"back","average":{"1min":1.734,"5min":1.734,"15min":1.734},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":18.015999999999998,"5min":18.015999999999998,"15min":18.015999999999998},"last":0.436},{"interface":"front","average":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":1.6599999999999999,"5min":1.6599999999999999,"15min":1.6599999999999999},"last":0.45000000000000001}]},{"osd":10,"last update":"Thu Apr 18 14:44:19 2024","interfaces":[{"interface":"back","average":{"1min":1.0960000000000001,"5min":1.0960000000000001,"15min":1.0960000000000001},"min":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"max":{"1min":2.1339999999999999,"5min":2.1339999999999999,"15min":2.1339999999999999},"last":0.85499999999999998},{"interface":"front","average":{"1min":1.119,"5min":1.119,"15min":1.119},"min":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"max":{"1min":1.8540000000000001,"5min":1.8540000000000001,"15min":1.8540000000000001},"last":0.749}]},{"osd":11,"last update":"Thu Apr 18 14:44:19 2024","interfaces":[{"interface":"back","average":{"1min":2.9990000000000001,"5min":2.9990000000000001,"15min":2.9990000000000001},"min":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":41.195999999999998,"5min":41.195999999999998,"15min":41.195999999999998},"last":0.77900000000000003},{"interface":"front","average":{"1min":3.1339999999999999,"5min":3.1339999999999999,"15min":3.1339999999999999},"min":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"max":{"1min":41.216999999999999,"5min":41.216999999999999,"15min":41.216999999999999},"last":0.88}]},{"osd":13,"last update":"Thu Apr 18 14:44:23 2024","interfaces":[{"interface":"back","average":{"1min":0.95099999999999996,"5min":0.95099999999999996,"15min":0.95099999999999996},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":1.881,"5min":1.881,"15min":1.881},"last":0.65500000000000003},{"interface":"front","average":{"1min":1.091,"5min":1.091,"15min":1.091},"min":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":1.8720000000000001,"5min":1.8720000000000001,"15min":1.8720000000000001},"last":0.67600000000000005}]},{"osd":14,"last update":"Thu Apr 18 14:44:19 2024","interfaces":[{"interface":"back","average":{"1min":1.103,"5min":1.103,"15min":1.103},"min":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"max":{"1min":1.95,"5min":1.95,"15min":1.95},"last":0.69899999999999995},{"interface":"front","average":{"1min":1.095,"5min":1.095,"15min":1.095},"min":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"max":{"1min":2.1219999999999999,"5min":2.1219999999999999,"15min":2.1219999999999999},"last":0.59199999999999997}]},{"osd":15,"last update":"Thu Apr 18 14:44:19 2024","interfaces":[{"interface":"back","average":{"1min":1.224,"5min":1.224,"15min":1.224},"min":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"max":{"1min":1.929,"5min":1.929,"15min":1.929},"last":0.73699999999999999},{"interface":"front","average":{"1min":1.179,"5min":1.179,"15min":1.179},"min":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":2.056,"5min":2.056,"15min":2.056},"last":0.78900000000000003}]}]},{"osd":3,"up_from":23,"seq":98784247824,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41424,"kb_used_data":10312,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94330416,"statfs":{"total":96636764160,"available":96594345984,"internally_reserved":0,"allocated":10559488,"data_stored":16445429,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31848904},"hb_peers":[0,1,2,4,5,7,8,9,10,11,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Apr 18 14:44:20 2024","interfaces":[{"interface":"back","average":{"1min":0.88200000000000001,"5min":0.88200000000000001,"15min":0.88200000000000001},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":1.4510000000000001,"5min":1.4510000000000001,"15min":1.4510000000000001},"last":0.79900000000000004},{"interface":"front","average":{"1min":1,"5min":1,"15min":1},"min":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"max":{"1min":1.4850000000000001,"5min":1.4850000000000001,"15min":1.4850000000000001},"last":0.75600000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85499999999999998}]},{"osd":2,"last update":"Thu Apr 18 14:44:20 2024","interfaces":[{"interface":"back","average":{"1min":0.98599999999999999,"5min":0.98599999999999999,"15min":0.98599999999999999},"min":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.5469999999999999,"5min":1.5469999999999999,"15min":1.5469999999999999},"last":1.2509999999999999},{"interface":"front","average":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":0.94999999999999996},"min":{"1min":0.623,"5min":0.623,"15min":0.623},"max":{"1min":1.425,"5min":1.425,"15min":1.425},"last":1.1080000000000001}]},{"osd":4,"last update":"Thu Apr 18 14:44:20 2024","interfaces":[{"interface":"back","average":{"1min":1.008,"5min":1.008,"15min":1.008},"min":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.7030000000000001,"5min":1.7030000000000001,"15min":1.7030000000000001},"last":0.98299999999999998},{"interface":"front","average":{"1min":0.98699999999999999,"5min":0.98699999999999999,"15min":0.98699999999999999},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":1.5309999999999999,"5min":1.5309999999999999,"15min":1.5309999999999999},"last":1.1759999999999999}]},{"osd":5,"last update":"Thu Apr 18 14:44:20 2024","interfaces":[{"interface":"back","average":{"1min":1.087,"5min":1.087,"15min":1.087},"min":{"1min":0.624,"5min":0.624,"15min":0.624},"max":{"1min":1.663,"5min":1.663,"15min":1.663},"last":1.216},{"interface":"front","average":{"1min":1.206,"5min":1.206,"15min":1.206},"min":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":1.6779999999999999,"5min":1.6779999999999999,"15min":1.6779999999999999},"last":1.1419999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.472}]},{"osd":7,"last update":"Thu Apr 18 14:44:20 2024","interfaces":[{"interface":"back","average":{"1min":1.157,"5min":1.157,"15min":1.157},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.645,"5min":1.645,"15min":1.645},"last":1.0660000000000001},{"interface":"front","average":{"1min":1.115,"5min":1.115,"15min":1.115},"min":{"1min":0.503,"5min":0.503,"15min":0.503},"max":{"1min":1.6419999999999999,"5min":1.6419999999999999,"15min":1.6419999999999999},"last":1.2989999999999999}]},{"osd":8,"last update":"Thu Apr 18 14:44:20 2024","interfaces":[{"interface":"back","average":{"1min":1.1339999999999999,"5min":1.1339999999999999,"15min":1.1339999999999999},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.7529999999999999,"5min":1.7529999999999999,"15min":1.7529999999999999},"last":1.319},{"interface":"front","average":{"1min":1.304,"5min":1.304,"15min":1.304},"min":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"max":{"1min":1.7430000000000001,"5min":1.7430000000000001,"15min":1.7430000000000001},"last":1.2749999999999999}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.341}]},{"osd":10,"last update":"Thu Apr 18 14:44:20 2024","interfaces":[{"interface":"back","average":{"1min":1.327,"5min":1.327,"15min":1.327},"min":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"max":{"1min":1.883,"5min":1.883,"15min":1.883},"last":1.401},{"interface":"front","average":{"1min":1.3660000000000001,"5min":1.3660000000000001,"15min":1.3660000000000001},"min":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"max":{"1min":2.161,"5min":2.161,"15min":2.161},"last":1.377}]},{"osd":11,"last update":"Thu Apr 18 14:44:20 2024","interfaces":[{"interface":"back","average":{"1min":1.4330000000000001,"5min":1.4330000000000001,"15min":1.4330000000000001},"min":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"max":{"1min":1.8959999999999999,"5min":1.8959999999999999,"15min":1.8959999999999999},"last":1.361},{"interface":"front","average":{"1min":1.381,"5min":1.381,"15min":1.381},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":2.1160000000000001,"5min":2.1160000000000001,"15min":2.1160000000000001},"last":1.484}]},{"osd":12,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.8740000000000001}]},{"osd":14,"last update":"Thu Apr 18 14:44:20 2024","interfaces":[{"interface":"back","average":{"1min":1.512,"5min":1.512,"15min":1.512},"min":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":0.94999999999999996},"max":{"1min":2.2879999999999998,"5min":2.2879999999999998,"15min":2.2879999999999998},"last":1.4419999999999999},{"interface":"front","average":{"1min":1.4139999999999999,"5min":1.4139999999999999,"15min":1.4139999999999999},"min":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"max":{"1min":2.0179999999999998,"5min":2.0179999999999998,"15min":2.0179999999999998},"last":1.464}]},{"osd":15,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.51}]}]},{"osd":7,"up_from":23,"seq":98784247826,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":43644,"kb_used_data":12524,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94328196,"statfs":{"total":96636764160,"available":96592072704,"internally_reserved":0,"allocated":12824576,"data_stored":19612742,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":31848907},"hb_peers":[0,2,3,4,5,6,8,10,12,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65900000000000003}]},{"osd":2,"last update":"Thu Apr 18 14:44:21 2024","interfaces":[{"interface":"back","average":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"min":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":1.1519999999999999,"5min":1.1519999999999999,"15min":1.1519999999999999},"last":1.081},{"interface":"front","average":{"1min":0.97599999999999998,"5min":0.97599999999999998,"15min":0.97599999999999998},"min":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"max":{"1min":1.891,"5min":1.891,"15min":1.891},"last":0.77700000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1379999999999999}]},{"osd":4,"last update":"Thu Apr 18 14:44:21 2024","interfaces":[{"interface":"back","average":{"1min":0.95699999999999996,"5min":0.95699999999999996,"15min":0.95699999999999996},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.258,"5min":1.258,"15min":1.258},"last":1.0129999999999999},{"interface":"front","average":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":1.2170000000000001,"5min":1.2170000000000001,"15min":1.2170000000000001},"last":0.81399999999999995}]},{"osd":5,"last update":"Thu Apr 18 14:44:21 2024","interfaces":[{"interface":"back","average":{"1min":1.1140000000000001,"5min":1.1140000000000001,"15min":1.1140000000000001},"min":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"max":{"1min":1.8580000000000001,"5min":1.8580000000000001,"15min":1.8580000000000001},"last":0.85899999999999999},{"interface":"front","average":{"1min":1.1120000000000001,"5min":1.1120000000000001,"15min":1.1120000000000001},"min":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"max":{"1min":1.53,"5min":1.53,"15min":1.53},"last":1.2569999999999999}]},{"osd":6,"last update":"Thu Apr 18 14:44:21 2024","interfaces":[{"interface":"back","average":{"1min":1.139,"5min":1.139,"15min":1.139},"min":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"max":{"1min":1.8759999999999999,"5min":1.8759999999999999,"15min":1.8759999999999999},"last":1.05},{"interface":"front","average":{"1min":1.171,"5min":1.171,"15min":1.171},"min":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"max":{"1min":1.4570000000000001,"5min":1.4570000000000001,"15min":1.4570000000000001},"last":1.466}]},{"osd":8,"last update":"Thu Apr 18 14:44:21 2024","interfaces":[{"interface":"back","average":{"1min":1.095,"5min":1.095,"15min":1.095},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":1.4159999999999999,"5min":1.4159999999999999,"15min":1.4159999999999999},"last":0.96999999999999997},{"interface":"front","average":{"1min":1.274,"5min":1.274,"15min":1.274},"min":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"max":{"1min":1.821,"5min":1.821,"15min":1.821},"last":0.90900000000000003}]},{"osd":10,"last update":"Thu Apr 18 14:44:21 2024","interfaces":[{"interface":"back","average":{"1min":1.151,"5min":1.151,"15min":1.151},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.831,"5min":1.831,"15min":1.831},"last":1.181},{"interface":"front","average":{"1min":1.278,"5min":1.278,"15min":1.278},"min":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"max":{"1min":1.53,"5min":1.53,"15min":1.53},"last":1.3340000000000001}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71699999999999997}]},{"osd":12,"last update":"Thu Apr 18 14:44:21 2024","interfaces":[{"interface":"back","average":{"1min":1.2270000000000001,"5min":1.2270000000000001,"15min":1.2270000000000001},"min":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.7549999999999999,"5min":1.7549999999999999,"15min":1.7549999999999999},"last":1.29},{"interface":"front","average":{"1min":1.4039999999999999,"5min":1.4039999999999999,"15min":1.4039999999999999},"min":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"max":{"1min":2.0960000000000001,"5min":2.0960000000000001,"15min":2.0960000000000001},"last":0.93999999999999995}]},{"osd":14,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3819999999999999}]},{"osd":15,"last update":"Thu Apr 18 14:44:21 2024","interfaces":[{"interface":"back","average":{"1min":1.4330000000000001,"5min":1.4330000000000001,"15min":1.4330000000000001},"min":{"1min":0.874,"5min":0.874,"15min":0.874},"max":{"1min":2.6699999999999999,"5min":2.6699999999999999,"15min":2.6699999999999999},"last":1.115},{"interface":"front","average":{"1min":1.401,"5min":1.401,"15min":1.401},"min":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":2.516,"5min":2.516,"15min":2.516},"last":1.401}]}]},{"osd":8,"up_from":23,"seq":98784247826,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":43840,"kb_used_data":12724,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94328000,"statfs":{"total":96636764160,"available":96591872000,"internally_reserved":0,"allocated":13029376,"data_stored":20651177,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,2,3,5,7,9,11,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52900000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0229999999999999}]},{"osd":2,"last update":"Thu Apr 18 14:44:22 2024","interfaces":[{"interface":"back","average":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":1.1339999999999999,"5min":1.1339999999999999,"15min":1.1339999999999999},"last":1.0580000000000001},{"interface":"front","average":{"1min":0.996,"5min":0.996,"15min":0.996},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":2.54,"5min":2.54,"15min":2.54},"last":0.76900000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97999999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1080000000000001}]},{"osd":5,"last update":"Thu Apr 18 14:44:22 2024","interfaces":[{"interface":"back","average":{"1min":1.0549999999999999,"5min":1.0549999999999999,"15min":1.0549999999999999},"min":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":2.7810000000000001,"5min":2.7810000000000001,"15min":2.7810000000000001},"last":0.73999999999999999},{"interface":"front","average":{"1min":0.91800000000000004,"5min":0.91800000000000004,"15min":0.91800000000000004},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.5309999999999999,"5min":1.5309999999999999,"15min":1.5309999999999999},"last":0.70799999999999996}]},{"osd":7,"last update":"Thu Apr 18 14:44:22 2024","interfaces":[{"interface":"back","average":{"1min":1.042,"5min":1.042,"15min":1.042},"min":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":1.925,"5min":1.925,"15min":1.925},"last":0.92800000000000005},{"interface":"front","average":{"1min":1.0800000000000001,"5min":1.0800000000000001,"15min":1.0800000000000001},"min":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"max":{"1min":1.669,"5min":1.669,"15min":1.669},"last":1.25}]},{"osd":9,"last update":"Thu Apr 18 14:44:22 2024","interfaces":[{"interface":"back","average":{"1min":1.0249999999999999,"5min":1.0249999999999999,"15min":1.0249999999999999},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":1.6479999999999999,"5min":1.6479999999999999,"15min":1.6479999999999999},"last":1.214},{"interface":"front","average":{"1min":1.163,"5min":1.163,"15min":1.163},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":2.9319999999999999,"5min":2.9319999999999999,"15min":2.9319999999999999},"last":0.66500000000000004}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.665}]},{"osd":11,"last update":"Thu Apr 18 14:44:22 2024","interfaces":[{"interface":"back","average":{"1min":1.206,"5min":1.206,"15min":1.206},"min":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"max":{"1min":2.1139999999999999,"5min":2.1139999999999999,"15min":2.1139999999999999},"last":0.79400000000000004},{"interface":"front","average":{"1min":1.2929999999999999,"5min":1.2929999999999999,"15min":1.2929999999999999},"min":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"max":{"1min":2.25,"5min":2.25,"15min":2.25},"last":1.105}]},{"osd":12,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5629999999999999}]},{"osd":14,"last update":"Thu Apr 18 14:44:22 2024","interfaces":[{"interface":"back","average":{"1min":1.341,"5min":1.341,"15min":1.341},"min":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"max":{"1min":2.5800000000000001,"5min":2.5800000000000001,"15min":2.5800000000000001},"last":1.143},{"interface":"front","average":{"1min":1.3919999999999999,"5min":1.3919999999999999,"15min":1.3919999999999999},"min":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"max":{"1min":3.0739999999999998,"5min":3.0739999999999998,"15min":3.0739999999999998},"last":0.82999999999999996}]},{"osd":15,"last update":"Thu Apr 18 14:44:22 2024","interfaces":[{"interface":"back","average":{"1min":1.355,"5min":1.355,"15min":1.355},"min":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"max":{"1min":2.4740000000000002,"5min":2.4740000000000002,"15min":2.4740000000000002},"last":1.179},{"interface":"front","average":{"1min":1.4159999999999999,"5min":1.4159999999999999,"15min":1.4159999999999999},"min":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"max":{"1min":2.8620000000000001,"5min":2.8620000000000001,"15min":2.8620000000000001},"last":0.86699999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":13,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":12,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":13,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":14,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":15,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":14475264,"data_stored":21237760,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":31432704,"data_stored":42668032,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12296192,"data_stored":18427904,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":9355264,"data_stored":15753216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":21028864,"data_stored":36835328,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":13004800,"data_stored":20766720,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":23670784,"data_stored":35631104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":12980224,"data_stored":21315584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":11829248,"data_stored":19959808,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":18952192,"data_stored":30834688,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":21565440,"data_stored":33140736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":20955136,"data_stored":37330944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":12,"total":0,"available":0,"internally_reserved":0,"allocated":16838656,"data_stored":28073984,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":13,"total":0,"available":0,"internally_reserved":0,"allocated":11530240,"data_stored":18210816,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":14,"total":0,"available":0,"internally_reserved":0,"allocated":27975680,"data_stored":44306432,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":15,"total":0,"available":0,"internally_reserved":0,"allocated":22319104,"data_stored":35733504,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-18T14:44:28.820 INFO:tasks.ceph.ceph_manager.ceph:increase pool size by 10 2024-04-18T14:44:28.820 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool set unique_pool_0 pg_num 26 2024-04-18T14:44:28.827 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-04-18T14:44:28.827 INFO:teuthology.orchestra.run.smithi086.stdout:{"epoch":89,"fsid":"ac90c892-1809-401c-a743-76948b63c51a","created":"2024-04-18T14:43:04.477846+0000","modified":"2024-04-18T14:44:28.489297+0000","last_up_change":"2024-04-18T14:43:19.299757+0000","last_in_change":"2024-04-18T14:44:09.371862+0000","flags":"noscrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5801984,"flags_set":["noscrub","pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":16,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-18T14:43:17.412189+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":15.380000114440918,"score_stable":15.380000114440918,"optimal_score":0.12999999523162842,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":0.88725757598876953,"average_primary_affinity":0.94999998807907104,"average_primary_affinity_weighted":0.88999998569488525}},{"pool":2,"pool_name":"rbd","create_time":"2024-04-18T14:43:20.259109+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":3.7699999809265137,"score_stable":3.7699999809265137,"optimal_score":0.73000001907348633,"raw_score_acting":2.75,"raw_score_stable":2.75,"primary_affinity_weighted":0.88725757598876953,"average_primary_affinity":0.94999998807907104,"average_primary_affinity_weighted":0.88999998569488525}},{"pool":3,"pool_name":"unique_pool_0","create_time":"2024-04-18T14:43:28.661432+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":3,"size":7,"min_size":5,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":16,"pg_placement_num":16,"pg_placement_num_target":16,"pg_num_target":16,"pg_num_pending":16,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"89","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":56,"snap_epoch":89,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"shecprofile","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":16384,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rados":{}}}],"osds":[{"osd":0,"uuid":"a2e10d33-3d09-4c39-aa08-15b3f6e81c8c","up":1,"in":1,"weight":1,"primary_affinity":0,"last_clean_begin":0,"last_clean_end":0,"up_from":23,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6804","nonce":24964},{"type":"v1","addr":"172.21.15.86:6806","nonce":24964}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6809","nonce":24964},{"type":"v1","addr":"172.21.15.86:6812","nonce":24964}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6819","nonce":24964},{"type":"v1","addr":"172.21.15.86:6821","nonce":24964}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6814","nonce":24964},{"type":"v1","addr":"172.21.15.86:6817","nonce":24964}]},"public_addr":"172.21.15.86:6806/24964","cluster_addr":"172.21.15.86:6812/24964","heartbeat_back_addr":"172.21.15.86:6821/24964","heartbeat_front_addr":"172.21.15.86:6817/24964","state":["exists","up"]},{"osd":1,"uuid":"9a6146f9-1780-409a-a0a5-e411bc40d674","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6824","nonce":24895},{"type":"v1","addr":"172.21.15.96:6825","nonce":24895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6826","nonce":24895},{"type":"v1","addr":"172.21.15.96:6827","nonce":24895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6830","nonce":24895},{"type":"v1","addr":"172.21.15.96:6831","nonce":24895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6828","nonce":24895},{"type":"v1","addr":"172.21.15.96:6829","nonce":24895}]},"public_addr":"172.21.15.96:6825/24895","cluster_addr":"172.21.15.96:6827/24895","heartbeat_back_addr":"172.21.15.96:6831/24895","heartbeat_front_addr":"172.21.15.96:6829/24895","state":["exists","up"]},{"osd":2,"uuid":"9c040397-fc12-4375-b34c-b7f3b5c299ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6817","nonce":24902},{"type":"v1","addr":"172.21.15.119:6819","nonce":24902}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6821","nonce":24902},{"type":"v1","addr":"172.21.15.119:6823","nonce":24902}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6829","nonce":24902},{"type":"v1","addr":"172.21.15.119:6831","nonce":24902}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6825","nonce":24902},{"type":"v1","addr":"172.21.15.119:6827","nonce":24902}]},"public_addr":"172.21.15.119:6819/24902","cluster_addr":"172.21.15.119:6823/24902","heartbeat_back_addr":"172.21.15.119:6831/24902","heartbeat_front_addr":"172.21.15.119:6827/24902","state":["exists","up"]},{"osd":3,"uuid":"d6f346dc-57cc-4ad0-9db3-352ced49a170","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":23,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":25220},{"type":"v1","addr":"172.21.15.134:6810","nonce":25220}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6816","nonce":25220},{"type":"v1","addr":"172.21.15.134:6820","nonce":25220}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6828","nonce":25220},{"type":"v1","addr":"172.21.15.134:6831","nonce":25220}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6822","nonce":25220},{"type":"v1","addr":"172.21.15.134:6825","nonce":25220}]},"public_addr":"172.21.15.134:6810/25220","cluster_addr":"172.21.15.134:6820/25220","heartbeat_back_addr":"172.21.15.134:6831/25220","heartbeat_front_addr":"172.21.15.134:6825/25220","state":["exists","up"]},{"osd":4,"uuid":"b4a1348c-ca08-4588-8c5e-1b6338672f3f","up":1,"in":1,"weight":1,"primary_affinity":0.82489013671875,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6805","nonce":24962},{"type":"v1","addr":"172.21.15.86:6808","nonce":24962}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6811","nonce":24962},{"type":"v1","addr":"172.21.15.86:6815","nonce":24962}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6822","nonce":24962},{"type":"v1","addr":"172.21.15.86:6823","nonce":24962}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6818","nonce":24962},{"type":"v1","addr":"172.21.15.86:6820","nonce":24962}]},"public_addr":"172.21.15.86:6808/24962","cluster_addr":"172.21.15.86:6815/24962","heartbeat_back_addr":"172.21.15.86:6823/24962","heartbeat_front_addr":"172.21.15.86:6820/24962","state":["exists","up"]},{"osd":5,"uuid":"2685cc4b-3fea-483c-a6ce-c74feae525a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6813","nonce":24898},{"type":"v1","addr":"172.21.15.96:6815","nonce":24898}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6818","nonce":24898},{"type":"v1","addr":"172.21.15.96:6819","nonce":24898}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6822","nonce":24898},{"type":"v1","addr":"172.21.15.96:6823","nonce":24898}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6820","nonce":24898},{"type":"v1","addr":"172.21.15.96:6821","nonce":24898}]},"public_addr":"172.21.15.96:6815/24898","cluster_addr":"172.21.15.96:6819/24898","heartbeat_back_addr":"172.21.15.96:6823/24898","heartbeat_front_addr":"172.21.15.96:6821/24898","state":["exists","up"]},{"osd":6,"uuid":"a8dab92a-d416-4383-b35f-6ac033677638","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6816","nonce":24903},{"type":"v1","addr":"172.21.15.119:6818","nonce":24903}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6820","nonce":24903},{"type":"v1","addr":"172.21.15.119:6822","nonce":24903}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6828","nonce":24903},{"type":"v1","addr":"172.21.15.119:6830","nonce":24903}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6824","nonce":24903},{"type":"v1","addr":"172.21.15.119:6826","nonce":24903}]},"public_addr":"172.21.15.119:6818/24903","cluster_addr":"172.21.15.119:6822/24903","heartbeat_back_addr":"172.21.15.119:6830/24903","heartbeat_front_addr":"172.21.15.119:6826/24903","state":["exists","up"]},{"osd":7,"uuid":"17e98ed9-593e-46df-82fa-80e4a36e6bf0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":23,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6809","nonce":25221},{"type":"v1","addr":"172.21.15.134:6814","nonce":25221}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6819","nonce":25221},{"type":"v1","addr":"172.21.15.134:6823","nonce":25221}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6832","nonce":25221},{"type":"v1","addr":"172.21.15.134:6833","nonce":25221}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6826","nonce":25221},{"type":"v1","addr":"172.21.15.134:6830","nonce":25221}]},"public_addr":"172.21.15.134:6814/25221","cluster_addr":"172.21.15.134:6823/25221","heartbeat_back_addr":"172.21.15.134:6833/25221","heartbeat_front_addr":"172.21.15.134:6830/25221","state":["exists","up"]},{"osd":8,"uuid":"be2c6ad5-ae83-463b-a8da-b8705b8c9ecd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":23,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6824","nonce":24967},{"type":"v1","addr":"172.21.15.86:6825","nonce":24967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6826","nonce":24967},{"type":"v1","addr":"172.21.15.86:6827","nonce":24967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6830","nonce":24967},{"type":"v1","addr":"172.21.15.86:6831","nonce":24967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6828","nonce":24967},{"type":"v1","addr":"172.21.15.86:6829","nonce":24967}]},"public_addr":"172.21.15.86:6825/24967","cluster_addr":"172.21.15.86:6827/24967","heartbeat_back_addr":"172.21.15.86:6831/24967","heartbeat_front_addr":"172.21.15.86:6829/24967","state":["exists","up"]},{"osd":9,"uuid":"441c6b04-1540-46ea-b180-4b8fceda9c5e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6808","nonce":24896},{"type":"v1","addr":"172.21.15.96:6809","nonce":24896}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6810","nonce":24896},{"type":"v1","addr":"172.21.15.96:6811","nonce":24896}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6816","nonce":24896},{"type":"v1","addr":"172.21.15.96:6817","nonce":24896}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6812","nonce":24896},{"type":"v1","addr":"172.21.15.96:6814","nonce":24896}]},"public_addr":"172.21.15.96:6809/24896","cluster_addr":"172.21.15.96:6811/24896","heartbeat_back_addr":"172.21.15.96:6817/24896","heartbeat_front_addr":"172.21.15.96:6814/24896","state":["exists","up"]},{"osd":10,"uuid":"024a5dc2-0960-4540-89d5-7d40f5c4c2c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6800","nonce":24904},{"type":"v1","addr":"172.21.15.119:6801","nonce":24904}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6802","nonce":24904},{"type":"v1","addr":"172.21.15.119:6803","nonce":24904}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6806","nonce":24904},{"type":"v1","addr":"172.21.15.119:6807","nonce":24904}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6804","nonce":24904},{"type":"v1","addr":"172.21.15.119:6805","nonce":24904}]},"public_addr":"172.21.15.119:6801/24904","cluster_addr":"172.21.15.119:6803/24904","heartbeat_back_addr":"172.21.15.119:6807/24904","heartbeat_front_addr":"172.21.15.119:6805/24904","state":["exists","up"]},{"osd":11,"uuid":"b46de3d2-dc85-4a95-b7d9-9bcdc0cbf035","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":25222},{"type":"v1","addr":"172.21.15.134:6803","nonce":25222}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":25222},{"type":"v1","addr":"172.21.15.134:6805","nonce":25222}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6813","nonce":25222},{"type":"v1","addr":"172.21.15.134:6817","nonce":25222}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6807","nonce":25222},{"type":"v1","addr":"172.21.15.134:6811","nonce":25222}]},"public_addr":"172.21.15.134:6803/25222","cluster_addr":"172.21.15.134:6805/25222","heartbeat_back_addr":"172.21.15.134:6817/25222","heartbeat_front_addr":"172.21.15.134:6811/25222","state":["exists","up"]},{"osd":12,"uuid":"29a50ae9-9c89-459b-b1de-a7f57905a6ca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6800","nonce":24965},{"type":"v1","addr":"172.21.15.86:6801","nonce":24965}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6802","nonce":24965},{"type":"v1","addr":"172.21.15.86:6803","nonce":24965}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6813","nonce":24965},{"type":"v1","addr":"172.21.15.86:6816","nonce":24965}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6807","nonce":24965},{"type":"v1","addr":"172.21.15.86:6810","nonce":24965}]},"public_addr":"172.21.15.86:6801/24965","cluster_addr":"172.21.15.86:6803/24965","heartbeat_back_addr":"172.21.15.86:6816/24965","heartbeat_front_addr":"172.21.15.86:6810/24965","state":["exists","up"]},{"osd":13,"uuid":"4afcbb15-5c72-4b5f-bbd1-bddeba50b262","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6800","nonce":24897},{"type":"v1","addr":"172.21.15.96:6801","nonce":24897}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6802","nonce":24897},{"type":"v1","addr":"172.21.15.96:6803","nonce":24897}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6806","nonce":24897},{"type":"v1","addr":"172.21.15.96:6807","nonce":24897}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6804","nonce":24897},{"type":"v1","addr":"172.21.15.96:6805","nonce":24897}]},"public_addr":"172.21.15.96:6801/24897","cluster_addr":"172.21.15.96:6803/24897","heartbeat_back_addr":"172.21.15.96:6807/24897","heartbeat_front_addr":"172.21.15.96:6805/24897","state":["exists","up"]},{"osd":14,"uuid":"d713adf7-4bce-443c-873c-3226cd6e5a50","up":1,"in":1,"weight":1,"primary_affinity":0.3712310791015625,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6808","nonce":24905},{"type":"v1","addr":"172.21.15.119:6809","nonce":24905}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6810","nonce":24905},{"type":"v1","addr":"172.21.15.119:6811","nonce":24905}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6814","nonce":24905},{"type":"v1","addr":"172.21.15.119:6815","nonce":24905}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6812","nonce":24905},{"type":"v1","addr":"172.21.15.119:6813","nonce":24905}]},"public_addr":"172.21.15.119:6809/24905","cluster_addr":"172.21.15.119:6811/24905","heartbeat_back_addr":"172.21.15.119:6815/24905","heartbeat_front_addr":"172.21.15.119:6813/24905","state":["exists","up"]},{"osd":15,"uuid":"abfd15ca-bea7-4ed9-890d-c9d4add42879","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":23,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6808","nonce":25223},{"type":"v1","addr":"172.21.15.134:6812","nonce":25223}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6815","nonce":25223},{"type":"v1","addr":"172.21.15.134:6818","nonce":25223}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6827","nonce":25223},{"type":"v1","addr":"172.21.15.134:6829","nonce":25223}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6821","nonce":25223},{"type":"v1","addr":"172.21.15.134:6824","nonce":25223}]},"public_addr":"172.21.15.134:6812/25223","cluster_addr":"172.21.15.134:6818/25223","heartbeat_back_addr":"172.21.15.134:6829/25223","heartbeat_front_addr":"172.21.15.134:6824/25223","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T14:44:24.729842+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T14:43:15.506438+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T14:44:16.473504+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T14:43:15.307798+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T14:44:20.295466+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T14:43:15.492500+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T14:43:15.367390+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T14:43:15.465492+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T14:43:15.502850+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T14:43:15.384186+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T14:43:15.381570+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T14:44:23.484251+0000","dead_epoch":0},{"osd":12,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T14:44:19.461153+0000","dead_epoch":0},{"osd":13,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T14:44:22.805253+0000","dead_epoch":0},{"osd":14,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T14:43:15.200225+0000","dead_epoch":0},{"osd":15,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T14:43:15.363752+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"},"shecprofile":{"c":"2","crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","k":"4","m":"3","name":"shecprofile","plugin":"shec","technique":"multiple"}},"removed_snaps_queue":[{"pool":3,"snaps":[{"begin":19,"length":1},{"begin":35,"length":1},{"begin":39,"length":1}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-18T14:44:28.847 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-18T14:44:28.884 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-04-18T14:44:28.884 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T14:44:28.898 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.15.asok dump_ops_in_flight 2024-04-18T14:44:28.910 INFO:tasks.ceph.osd.1.smithi096.stderr:2024-04-18T14:44:28.909+0000 7f56a7a98640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 24887) UID: 0 2024-04-18T14:44:29.010 INFO:tasks.ceph.osd.3.smithi134.stderr:2024-04-18T14:44:29.015+0000 7fe7a4443640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25211) UID: 0 2024-04-18T14:44:29.015 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-04-18T14:44:29.015 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T14:44:29.031 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.15.asok dump_blocked_ops 2024-04-18T14:44:29.111 INFO:tasks.ceph.osd.12.smithi086.stderr:2024-04-18T14:44:29.109+0000 7f6904968640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 12 (PID: 24960) UID: 0 2024-04-18T14:44:29.191 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-04-18T14:44:29.191 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T14:44:29.205 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-04-18T14:44:29.206 INFO:teuthology.orchestra.run.smithi086.stderr:dumped all 2024-04-18T14:44:29.207 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.15.asok dump_historic_ops 2024-04-18T14:44:29.212 INFO:tasks.ceph.osd.9.smithi096.stderr:2024-04-18T14:44:29.213+0000 7fa2c1cbf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 9 (PID: 24891) UID: 0 2024-04-18T14:44:29.223 INFO:teuthology.orchestra.run.smithi086.stdout:{"pg_ready":true,"pg_map":{"version":113,"stamp":"2024-04-18T14:44:28.501724+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":166674976,"num_objects":164,"num_object_clones":112,"num_object_copies":1138,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":164,"num_whiteouts":7,"num_read":592,"num_read_kb":234833,"num_write":1107,"num_write_kb":177924,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":86,"num_bytes_recovered":78118912,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1734,"ondisk_log_size":1734,"up":130,"acting":130,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":130,"num_osds":16,"num_per_pool_osds":16,"num_per_pool_omap_osds":16,"kb":1509949440,"kb_used":809392,"kb_used_data":297556,"kb_used_omap":24,"kb_used_meta":511591,"kb_avail":1509140048,"statfs":{"total":1546188226560,"available":1545359409152,"internally_reserved":0,"allocated":304697344,"data_stored":461914524,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":25506,"internal_metadata":523869278},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":40,"apply_latency_ms":40,"commit_latency_ns":40000000,"apply_latency_ns":40000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":13336576,"num_objects":14,"num_object_clones":13,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":2,"num_read":20,"num_read_kb":30001,"num_write":66,"num_write_kb":15440,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.115506"},"pg_stats":[{"pgid":"3.f","version":"85'52","reported_seq":210,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-18T14:44:26.505896+0000","last_change":"2024-04-18T14:44:24.427623+0000","last_active":"2024-04-18T14:44:26.505896+0000","last_peered":"2024-04-18T14:44:26.505896+0000","last_clean":"2024-04-18T14:44:26.505896+0000","last_became_active":"2024-04-18T14:43:30.738648+0000","last_became_peered":"2024-04-18T14:43:30.738648+0000","last_unstale":"2024-04-18T14:44:26.505896+0000","last_undegraded":"2024-04-18T14:44:26.505896+0000","last_fullsized":"2024-04-18T14:44:26.505896+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T14:43:29.615264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T14:43:29.615264+0000","last_clean_scrub_stamp":"2024-04-18T14:43:29.615264+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T14:44:32.547784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.028230990000000001,"stat_sum":{"num_bytes":950272,"num_objects":4,"num_object_clones":2,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":4517,"num_write":11,"num_write_kb":1168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,12,4,13,14,10,2],"acting":[11,12,4,13,14,10,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[{"start":"13","length":"1"},{"start":"23","length":"1"},{"start":"27","length":"1"}]},{"pgid":"3.e","version":"84'112","reported_seq":288,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-18T14:44:23.540967+0000","last_change":"2024-04-18T14:44:21.477592+0000","last_active":"2024-04-18T14:44:23.540967+0000","last_peered":"2024-04-18T14:44:23.540967+0000","last_clean":"2024-04-18T14:44:23.540967+0000","last_became_active":"2024-04-18T14:44:10.416764+0000","last_became_peered":"2024-04-18T14:44:10.416764+0000","last_unstale":"2024-04-18T14:44:23.540967+0000","last_undegraded":"2024-04-18T14:44:23.540967+0000","last_fullsized":"2024-04-18T14:44:23.540967+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T14:43:29.615264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T14:43:29.615264+0000","last_clean_scrub_stamp":"2024-04-18T14:43:29.615264+0000","objects_scrubbed":0,"log_size":112,"log_dups_size":0,"ondisk_log_size":112,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T14:44:43.107561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.027533792000000001,"stat_sum":{"num_bytes":14123008,"num_objects":10,"num_object_clones":7,"num_object_copies":70,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":23,"num_read_kb":5723,"num_write":79,"num_write_kb":15152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":11,"num_bytes_recovered":5472256,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,1,11,2,0,3],"acting":[8,9,1,11,2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[{"start":"2","length":"1"},{"start":"13","length":"1"},{"start":"16","length":"1"},{"start":"23","length":"1"}]},{"pgid":"3.d","version":"82'62","reported_seq":202,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-18T14:44:22.489587+0000","last_change":"2024-04-18T14:44:21.507603+0000","last_active":"2024-04-18T14:44:22.489587+0000","last_peered":"2024-04-18T14:44:22.489587+0000","last_clean":"2024-04-18T14:44:22.489587+0000","last_became_active":"2024-04-18T14:43:30.735975+0000","last_became_peered":"2024-04-18T14:43:30.735975+0000","last_unstale":"2024-04-18T14:44:22.489587+0000","last_undegraded":"2024-04-18T14:44:22.489587+0000","last_fullsized":"2024-04-18T14:44:22.489587+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T14:43:29.615264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T14:43:29.615264+0000","last_clean_scrub_stamp":"2024-04-18T14:43:29.615264+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T14:44:53.155373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.032556712000000002,"stat_sum":{"num_bytes":4358144,"num_objects":7,"num_object_clones":5,"num_object_copies":49,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":1,"num_read":14,"num_read_kb":3269,"num_write":16,"num_write_kb":4256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,0,12,10,2,6],"acting":[7,3,0,12,10,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"2","length":"1"},{"start":"13","length":"1"},{"start":"16","length":"1"},{"start":"23","length":"1"}]},{"pgid":"3.c","version":"85'190","reported_seq":344,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-18T14:44:26.505899+0000","last_change":"2024-04-18T14:44:24.434702+0000","last_active":"2024-04-18T14:44:26.505899+0000","last_peered":"2024-04-18T14:44:26.505899+0000","last_clean":"2024-04-18T14:44:26.505899+0000","last_became_active":"2024-04-18T14:43:30.737285+0000","last_became_peered":"2024-04-18T14:43:30.737285+0000","last_unstale":"2024-04-18T14:44:26.505899+0000","last_undegraded":"2024-04-18T14:44:26.505899+0000","last_fullsized":"2024-04-18T14:44:26.505899+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T14:43:29.615264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T14:43:29.615264+0000","last_clean_scrub_stamp":"2024-04-18T14:43:29.615264+0000","objects_scrubbed":0,"log_size":190,"log_dups_size":0,"ondisk_log_size":190,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T14:44:34.651938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.036289460000000003,"stat_sum":{"num_bytes":19103744,"num_objects":21,"num_object_clones":15,"num_object_copies":147,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":1,"num_read":61,"num_read_kb":23582,"num_write":103,"num_write_kb":16848,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,10,14,12,4,2,6],"acting":[11,10,14,12,4,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[{"start":"13","length":"1"},{"start":"23","length":"1"},{"start":"27","length":"1"}]},{"pgid":"3.b","version":"87'96","reported_seq":278,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-18T14:44:27.530074+0000","last_change":"2024-04-18T14:44:24.439519+0000","last_active":"2024-04-18T14:44:27.530074+0000","last_peered":"2024-04-18T14:44:27.530074+0000","last_clean":"2024-04-18T14:44:27.530074+0000","last_became_active":"2024-04-18T14:44:10.413165+0000","last_became_peered":"2024-04-18T14:44:10.413165+0000","last_unstale":"2024-04-18T14:44:27.530074+0000","last_undegraded":"2024-04-18T14:44:27.530074+0000","last_fullsized":"2024-04-18T14:44:27.530074+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T14:43:29.615264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T14:43:29.615264+0000","last_clean_scrub_stamp":"2024-04-18T14:43:29.615264+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":0,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T14:44:57.226209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.045183559999999998,"stat_sum":{"num_bytes":11255808,"num_objects":14,"num_object_clones":11,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":24,"num_read_kb":16337,"num_write":122,"num_write_kb":11216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":3735552,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,6,1,9,8,7,14],"acting":[10,6,1,9,8,7,14],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[{"start":"13","length":"1"},{"start":"23","length":"1"},{"start":"27","length":"1"}]},{"pgid":"3.a","version":"84'92","reported_seq":272,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-18T14:44:23.563471+0000","last_change":"2024-04-18T14:44:21.512666+0000","last_active":"2024-04-18T14:44:23.563471+0000","last_peered":"2024-04-18T14:44:23.563471+0000","last_clean":"2024-04-18T14:44:23.563471+0000","last_became_active":"2024-04-18T14:44:10.417346+0000","last_became_peered":"2024-04-18T14:44:10.417346+0000","last_unstale":"2024-04-18T14:44:23.563471+0000","last_undegraded":"2024-04-18T14:44:23.563471+0000","last_fullsized":"2024-04-18T14:44:23.563471+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T14:43:29.615264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T14:43:29.615264+0000","last_clean_scrub_stamp":"2024-04-18T14:43:29.615264+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T14:44:30.191494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.053584856,"stat_sum":{"num_bytes":9699328,"num_objects":11,"num_object_clones":7,"num_object_copies":77,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":27,"num_read_kb":11053,"num_write":75,"num_write_kb":9792,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":10584064,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,9,8,15,11],"acting":[3,7,1,9,8,15,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"},{"start":"13","length":"1"},{"start":"16","length":"1"},{"start":"23","length":"1"}]},{"pgid":"3.9","version":"85'187","reported_seq":410,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-18T14:44:26.502667+0000","last_change":"2024-04-18T14:44:24.440087+0000","last_active":"2024-04-18T14:44:26.502667+0000","last_peered":"2024-04-18T14:44:26.502667+0000","last_clean":"2024-04-18T14:44:26.502667+0000","last_became_active":"2024-04-18T14:44:13.557905+0000","last_became_peered":"2024-04-18T14:44:13.557905+0000","last_unstale":"2024-04-18T14:44:26.502667+0000","last_undegraded":"2024-04-18T14:44:26.502667+0000","last_fullsized":"2024-04-18T14:44:26.502667+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T14:43:29.615264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T14:43:29.615264+0000","last_clean_scrub_stamp":"2024-04-18T14:43:29.615264+0000","objects_scrubbed":0,"log_size":187,"log_dups_size":0,"ondisk_log_size":187,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T14:44:36.314474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.040204142999999998,"stat_sum":{"num_bytes":19070976,"num_objects":17,"num_object_clones":11,"num_object_copies":119,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":1,"num_read":48,"num_read_kb":19701,"num_write":71,"num_write_kb":22608,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":18,"num_bytes_recovered":19070976,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[12,1,14,4,15,10,6],"acting":[12,1,14,4,15,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":12,"acting_primary":12,"purged_snaps":[{"start":"13","length":"1"},{"start":"23","length":"1"},{"start":"27","length":"1"}]},{"pgid":"3.8","version":"85'192","reported_seq":422,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-18T14:44:24.416324+0000","last_change":"2024-04-18T14:44:24.417398+0000","last_active":"2024-04-18T14:44:24.416324+0000","last_peered":"2024-04-18T14:44:24.416324+0000","last_clean":"2024-04-18T14:44:24.416324+0000","last_became_active":"2024-04-18T14:44:13.557985+0000","last_became_peered":"2024-04-18T14:44:13.557985+0000","last_unstale":"2024-04-18T14:44:24.416324+0000","last_undegraded":"2024-04-18T14:44:24.416324+0000","last_fullsized":"2024-04-18T14:44:24.416324+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T14:43:29.615264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T14:43:29.615264+0000","last_clean_scrub_stamp":"2024-04-18T14:43:29.615264+0000","objects_scrubbed":0,"log_size":192,"log_dups_size":0,"ondisk_log_size":192,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T14:44:30.625952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.033226977999999997,"stat_sum":{"num_bytes":27230208,"num_objects":17,"num_object_clones":11,"num_object_copies":119,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":74,"num_read_kb":36460,"num_write":89,"num_write_kb":27472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":17,"num_bytes_recovered":14991360,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,0,4,14,15,1],"acting":[5,10,0,4,14,15,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"13","length":"1"},{"start":"23","length":"1"},{"start":"27","length":"1"}]},{"pgid":"1.0","version":"26'157","reported_seq":264,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-18T14:44:23.630947+0000","last_change":"2024-04-18T14:43:20.323829+0000","last_active":"2024-04-18T14:44:23.630947+0000","last_peered":"2024-04-18T14:44:23.630947+0000","last_clean":"2024-04-18T14:44:23.630947+0000","last_became_active":"2024-04-18T14:43:20.323133+0000","last_became_peered":"2024-04-18T14:43:20.323133+0000","last_unstale":"2024-04-18T14:44:23.630947+0000","last_undegraded":"2024-04-18T14:44:23.630947+0000","last_fullsized":"2024-04-18T14:44:23.630947+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T14:43:18.296821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T14:43:18.296821+0000","last_clean_scrub_stamp":"2024-04-18T14:43:18.296821+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T14:44:25.445335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[13,0],"acting":[13,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":13,"acting_primary":13,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":79,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-18T14:44:23.471112+0000","last_change":"2024-04-18T14:44:23.449444+0000","last_active":"2024-04-18T14:44:23.471112+0000","last_peered":"2024-04-18T14:44:23.471112+0000","last_clean":"2024-04-18T14:44:23.471112+0000","last_became_active":"2024-04-18T14:43:21.327764+0000","last_became_peered":"2024-04-18T14:43:21.327764+0000","last_unstale":"2024-04-18T14:44:23.471112+0000","last_undegraded":"2024-04-18T14:44:23.471112+0000","last_fullsized":"2024-04-18T14:44:23.471112+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T14:44:23.449241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T14:43:20.303322+0000","last_clean_scrub_stamp":"2024-04-18T14:44:23.449241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T14:45:36.175611+0000","scrub_duration":0.0029048670000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,15],"acting":[5,15],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"85'62","reported_seq":237,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-18T14:44:24.419612+0000","last_change":"2024-04-18T14:44:24.420589+0000","last_active":"2024-04-18T14:44:24.419612+0000","last_peered":"2024-04-18T14:44:24.419612+0000","last_clean":"2024-04-18T14:44:24.419612+0000","last_became_active":"2024-04-18T14:44:10.415771+0000","last_became_peered":"2024-04-18T14:44:10.415771+0000","last_unstale":"2024-04-18T14:44:24.419612+0000","last_undegraded":"2024-04-18T14:44:24.419612+0000","last_fullsized":"2024-04-18T14:44:24.419612+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T14:43:29.615264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T14:43:29.615264+0000","last_clean_scrub_stamp":"2024-04-18T14:43:29.615264+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T14:44:50.487239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.018562775,"stat_sum":{"num_bytes":6848512,"num_objects":5,"num_object_clones":3,"num_object_copies":35,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":33609,"num_write":41,"num_write_kb":6688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":7307264,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[13,12,3,4,15,1,11],"acting":[13,12,3,4,15,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":13,"acting_primary":13,"purged_snaps":[{"start":"13","length":"1"},{"start":"23","length":"1"},{"start":"27","length":"1"}]},{"pgid":"2.0","version":"0'0","reported_seq":65,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-18T14:44:22.482283+0000","last_change":"2024-04-18T14:43:21.414881+0000","last_active":"2024-04-18T14:44:22.482283+0000","last_peered":"2024-04-18T14:44:22.482283+0000","last_clean":"2024-04-18T14:44:22.482283+0000","last_became_active":"2024-04-18T14:43:21.414060+0000","last_became_peered":"2024-04-18T14:43:21.414060+0000","last_unstale":"2024-04-18T14:44:22.482283+0000","last_undegraded":"2024-04-18T14:44:22.482283+0000","last_fullsized":"2024-04-18T14:44:22.482283+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T14:43:20.303322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T14:43:20.303322+0000","last_clean_scrub_stamp":"2024-04-18T14:43:20.303322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T14:44:26.835605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"87'114","reported_seq":266,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-18T14:44:26.511176+0000","last_change":"2024-04-18T14:44:24.446786+0000","last_active":"2024-04-18T14:44:26.511176+0000","last_peered":"2024-04-18T14:44:26.511176+0000","last_clean":"2024-04-18T14:44:26.511176+0000","last_became_active":"2024-04-18T14:43:30.746554+0000","last_became_peered":"2024-04-18T14:43:30.746554+0000","last_unstale":"2024-04-18T14:44:26.511176+0000","last_undegraded":"2024-04-18T14:44:26.511176+0000","last_fullsized":"2024-04-18T14:44:26.511176+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T14:43:29.615264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T14:43:29.615264+0000","last_clean_scrub_stamp":"2024-04-18T14:43:29.615264+0000","objects_scrubbed":0,"log_size":114,"log_dups_size":0,"ondisk_log_size":114,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T14:44:30.628320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.034244214000000002,"stat_sum":{"num_bytes":12238848,"num_objects":13,"num_object_clones":9,"num_object_copies":91,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":1,"num_read":36,"num_read_kb":25157,"num_write":74,"num_write_kb":12096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,11,9,5,12,0,13],"acting":[6,11,9,5,12,0,13],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"13","length":"1"},{"start":"23","length":"1"},{"start":"27","length":"1"}]},{"pgid":"2.1","version":"0'0","reported_seq":78,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-18T14:44:24.148269+0000","last_change":"2024-04-18T14:44:24.148269+0000","last_active":"2024-04-18T14:44:24.148269+0000","last_peered":"2024-04-18T14:44:24.148269+0000","last_clean":"2024-04-18T14:44:24.148269+0000","last_became_active":"2024-04-18T14:43:21.328534+0000","last_became_peered":"2024-04-18T14:43:21.328534+0000","last_unstale":"2024-04-18T14:44:24.148269+0000","last_undegraded":"2024-04-18T14:44:24.148269+0000","last_fullsized":"2024-04-18T14:44:24.148269+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T14:44:24.148141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T14:43:20.303322+0000","last_clean_scrub_stamp":"2024-04-18T14:44:24.148141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T14:45:30.466689+0000","scrub_duration":0.001593882,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[13,5],"acting":[13,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":13,"acting_primary":13,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":163,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-18T14:44:26.502492+0000","last_change":"2024-04-18T14:44:24.399739+0000","last_active":"2024-04-18T14:44:26.502492+0000","last_peered":"2024-04-18T14:44:26.502492+0000","last_clean":"2024-04-18T14:44:26.502492+0000","last_became_active":"2024-04-18T14:44:10.408892+0000","last_became_peered":"2024-04-18T14:44:10.408892+0000","last_unstale":"2024-04-18T14:44:26.502492+0000","last_undegraded":"2024-04-18T14:44:26.502492+0000","last_fullsized":"2024-04-18T14:44:26.502492+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T14:43:29.615264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T14:43:29.615264+0000","last_clean_scrub_stamp":"2024-04-18T14:43:29.615264+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T14:44:43.444986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010584290000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[12,11,15,1,5,0,6],"acting":[12,11,15,1,5,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":12,"acting_primary":12,"purged_snaps":[{"start":"13","length":"1"},{"start":"23","length":"1"},{"start":"27","length":"1"}]},{"pgid":"2.2","version":"0'0","reported_seq":65,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-18T14:44:22.482325+0000","last_change":"2024-04-18T14:43:21.465969+0000","last_active":"2024-04-18T14:44:22.482325+0000","last_peered":"2024-04-18T14:44:22.482325+0000","last_clean":"2024-04-18T14:44:22.482325+0000","last_became_active":"2024-04-18T14:43:21.465481+0000","last_became_peered":"2024-04-18T14:43:21.465481+0000","last_unstale":"2024-04-18T14:44:22.482325+0000","last_undegraded":"2024-04-18T14:44:22.482325+0000","last_fullsized":"2024-04-18T14:44:22.482325+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T14:43:20.303322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T14:43:20.303322+0000","last_clean_scrub_stamp":"2024-04-18T14:43:20.303322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T14:44:45.650560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10],"acting":[3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"82'61","reported_seq":205,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-18T14:44:24.402538+0000","last_change":"2024-04-18T14:44:24.402916+0000","last_active":"2024-04-18T14:44:24.402538+0000","last_peered":"2024-04-18T14:44:24.402538+0000","last_clean":"2024-04-18T14:44:24.402538+0000","last_became_active":"2024-04-18T14:43:30.737990+0000","last_became_peered":"2024-04-18T14:43:30.737990+0000","last_unstale":"2024-04-18T14:44:24.402538+0000","last_undegraded":"2024-04-18T14:44:24.402538+0000","last_fullsized":"2024-04-18T14:44:24.402538+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T14:43:29.615264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T14:43:29.615264+0000","last_clean_scrub_stamp":"2024-04-18T14:43:29.615264+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T14:44:56.230031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00063665300000000005,"stat_sum":{"num_bytes":3244032,"num_objects":6,"num_object_clones":4,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":13,"num_read_kb":379,"num_write":16,"num_write_kb":3456,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[13,7,2,15,4,5,3],"acting":[13,7,2,15,4,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":13,"acting_primary":13,"purged_snaps":[{"start":"13","length":"1"},{"start":"23","length":"1"},{"start":"27","length":"1"}]},{"pgid":"3.5","version":"82'40","reported_seq":184,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-18T14:44:22.459801+0000","last_change":"2024-04-18T14:44:21.501260+0000","last_active":"2024-04-18T14:44:22.459801+0000","last_peered":"2024-04-18T14:44:22.459801+0000","last_clean":"2024-04-18T14:44:22.459801+0000","last_became_active":"2024-04-18T14:43:30.653147+0000","last_became_peered":"2024-04-18T14:43:30.653147+0000","last_unstale":"2024-04-18T14:44:22.459801+0000","last_undegraded":"2024-04-18T14:44:22.459801+0000","last_fullsized":"2024-04-18T14:44:22.459801+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T14:43:29.615264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T14:43:29.615264+0000","last_clean_scrub_stamp":"2024-04-18T14:43:29.615264+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T14:44:48.289654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.031239925000000002,"stat_sum":{"num_bytes":3014656,"num_objects":3,"num_object_clones":2,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":10,"num_read_kb":1876,"num_write":33,"num_write_kb":4624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[15,6,14,13,7,11,8],"acting":[15,6,14,13,7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":15,"acting_primary":15,"purged_snaps":[{"start":"2","length":"1"},{"start":"13","length":"1"},{"start":"16","length":"1"},{"start":"23","length":"1"}]},{"pgid":"2.4","version":"0'0","reported_seq":71,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-18T14:44:26.499724+0000","last_change":"2024-04-18T14:43:21.348882+0000","last_active":"2024-04-18T14:44:26.499724+0000","last_peered":"2024-04-18T14:44:26.499724+0000","last_clean":"2024-04-18T14:44:26.499724+0000","last_became_active":"2024-04-18T14:43:21.348012+0000","last_became_peered":"2024-04-18T14:43:21.348012+0000","last_unstale":"2024-04-18T14:44:26.499724+0000","last_undegraded":"2024-04-18T14:44:26.499724+0000","last_fullsized":"2024-04-18T14:44:26.499724+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T14:43:20.303322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T14:43:20.303322+0000","last_clean_scrub_stamp":"2024-04-18T14:43:20.303322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T14:44:27.891832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,12],"acting":[6,12],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.4","version":"88'33","reported_seq":209,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-18T14:44:27.551810+0000","last_change":"2024-04-18T14:44:24.395228+0000","last_active":"2024-04-18T14:44:27.551810+0000","last_peered":"2024-04-18T14:44:27.551810+0000","last_clean":"2024-04-18T14:44:27.551810+0000","last_became_active":"2024-04-18T14:44:10.411493+0000","last_became_peered":"2024-04-18T14:44:10.411493+0000","last_unstale":"2024-04-18T14:44:27.551810+0000","last_undegraded":"2024-04-18T14:44:27.551810+0000","last_fullsized":"2024-04-18T14:44:27.551810+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T14:43:29.615264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T14:43:29.615264+0000","last_clean_scrub_stamp":"2024-04-18T14:43:29.615264+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T14:44:39.265728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0014429989999999999,"stat_sum":{"num_bytes":6520832,"num_objects":3,"num_object_clones":2,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":8,"num_read_kb":1491,"num_write":13,"num_write_kb":6864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":507904,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,12,14,1,6,11,13],"acting":[10,12,14,1,6,11,13],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[{"start":"13","length":"1"},{"start":"23","length":"1"},{"start":"27","length":"1"}]},{"pgid":"2.5","version":"0'0","reported_seq":67,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-18T14:44:22.471426+0000","last_change":"2024-04-18T14:43:21.423043+0000","last_active":"2024-04-18T14:44:22.471426+0000","last_peered":"2024-04-18T14:44:22.471426+0000","last_clean":"2024-04-18T14:44:22.471426+0000","last_became_active":"2024-04-18T14:43:21.422468+0000","last_became_peered":"2024-04-18T14:43:21.422468+0000","last_unstale":"2024-04-18T14:44:22.471426+0000","last_undegraded":"2024-04-18T14:44:22.471426+0000","last_fullsized":"2024-04-18T14:44:22.471426+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T14:43:20.303322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T14:43:20.303322+0000","last_clean_scrub_stamp":"2024-04-18T14:43:20.303322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T14:44:36.598607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2],"acting":[8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.7","version":"83'131","reported_seq":280,"reported_epoch":84,"state":"peering","last_fresh":"2024-04-18T14:44:23.467800+0000","last_change":"2024-04-18T14:44:23.467800+0000","last_active":"2024-04-18T14:44:23.467800+0000","last_peered":"2024-04-18T14:44:22.475891+0000","last_clean":"2024-04-18T14:44:22.475891+0000","last_became_active":"2024-04-18T14:43:30.747200+0000","last_became_peered":"2024-04-18T14:43:30.747200+0000","last_unstale":"2024-04-18T14:44:23.467800+0000","last_undegraded":"2024-04-18T14:44:23.467800+0000","last_fullsized":"2024-04-18T14:44:23.467800+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T14:43:29.615264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T14:43:29.615264+0000","last_clean_scrub_stamp":"2024-04-18T14:43:29.615264+0000","objects_scrubbed":0,"log_size":131,"log_dups_size":0,"ondisk_log_size":131,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T14:44:49.458743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.066260246999999994,"stat_sum":{"num_bytes":9748480,"num_objects":14,"num_object_clones":10,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":1,"num_read":50,"num_read_kb":35805,"num_write":107,"num_write_kb":10832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[14,8,9,4,2,5,11],"acting":[14,8,9,4,2,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[{"start":"2","length":"1"},{"start":"13","length":"1"},{"start":"16","length":"1"},{"start":"23","length":"1"}]},{"pgid":"2.6","version":"0'0","reported_seq":70,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-18T14:44:25.474630+0000","last_change":"2024-04-18T14:43:21.414621+0000","last_active":"2024-04-18T14:44:25.474630+0000","last_peered":"2024-04-18T14:44:25.474630+0000","last_clean":"2024-04-18T14:44:25.474630+0000","last_became_active":"2024-04-18T14:43:21.413906+0000","last_became_peered":"2024-04-18T14:43:21.413906+0000","last_unstale":"2024-04-18T14:44:25.474630+0000","last_undegraded":"2024-04-18T14:44:25.474630+0000","last_fullsized":"2024-04-18T14:44:25.474630+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T14:43:20.303322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T14:43:20.303322+0000","last_clean_scrub_stamp":"2024-04-18T14:43:20.303322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T14:44:28.448910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[14,0],"acting":[14,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":14,"acting_primary":14,"purged_snaps":[]},{"pgid":"3.6","version":"85'153","reported_seq":342,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-18T14:44:25.474641+0000","last_change":"2024-04-18T14:44:24.427189+0000","last_active":"2024-04-18T14:44:25.474641+0000","last_peered":"2024-04-18T14:44:25.474641+0000","last_clean":"2024-04-18T14:44:25.474641+0000","last_became_active":"2024-04-18T14:44:10.420748+0000","last_became_peered":"2024-04-18T14:44:10.420748+0000","last_unstale":"2024-04-18T14:44:25.474641+0000","last_undegraded":"2024-04-18T14:44:25.474641+0000","last_fullsized":"2024-04-18T14:44:25.474641+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T14:43:29.615264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T14:43:29.615264+0000","last_clean_scrub_stamp":"2024-04-18T14:43:29.615264+0000","objects_scrubbed":0,"log_size":153,"log_dups_size":0,"ondisk_log_size":153,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T14:44:55.595983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.033298451999999999,"stat_sum":{"num_bytes":18677760,"num_objects":17,"num_object_clones":13,"num_object_copies":119,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":2,"num_read":31,"num_read_kb":15756,"num_write":54,"num_write_kb":21392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":15,"num_bytes_recovered":16449536,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[14,13,1,15,6,7,9],"acting":[14,13,1,15,6,7,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":14,"acting_primary":14,"purged_snaps":[{"start":"13","length":"1"},{"start":"23","length":"1"},{"start":"27","length":"1"}]},{"pgid":"2.7","version":"0'0","reported_seq":77,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-18T14:44:22.508764+0000","last_change":"2024-04-18T14:44:22.508764+0000","last_active":"2024-04-18T14:44:22.508764+0000","last_peered":"2024-04-18T14:44:22.508764+0000","last_clean":"2024-04-18T14:44:22.508764+0000","last_became_active":"2024-04-18T14:43:21.328185+0000","last_became_peered":"2024-04-18T14:43:21.328185+0000","last_unstale":"2024-04-18T14:44:22.508764+0000","last_undegraded":"2024-04-18T14:44:22.508764+0000","last_fullsized":"2024-04-18T14:44:22.508764+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T14:44:22.508567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T14:43:20.303322+0000","last_clean_scrub_stamp":"2024-04-18T14:44:22.508567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T14:45:46.236519+0000","scrub_duration":0.0031913549999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[15,13],"acting":[15,13],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":15,"acting_primary":15,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":16,"stat_sum":{"num_bytes":166084608,"num_objects":162,"num_object_clones":112,"num_object_copies":1134,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":162,"num_whiteouts":7,"num_read":456,"num_read_kb":234715,"num_write":904,"num_write_kb":174464,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":86,"num_bytes_recovered":78118912,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":290209792,"data_stored":460226560,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1577,"ondisk_log_size":1577,"up":112,"acting":112,"num_store_stats":16},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":11},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1064960,"data_stored":1057856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":13,"up_from":24,"seq":103079215120,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":44084,"kb_used_data":12972,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94327756,"statfs":{"total":96636764160,"available":96591622144,"internally_reserved":0,"allocated":13283328,"data_stored":19442424,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,2,3,4,5,7,11,12,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Apr 18 14:44:21 2024","interfaces":[{"interface":"back","average":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"min":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":1.792,"5min":1.792,"15min":1.792},"last":0.81899999999999995},{"interface":"front","average":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"min":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":2.0600000000000001,"5min":2.0600000000000001,"15min":2.0600000000000001},"last":0.63700000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96599999999999997}]},{"osd":2,"last update":"Thu Apr 18 14:44:21 2024","interfaces":[{"interface":"back","average":{"1min":1.0389999999999999,"5min":1.0389999999999999,"15min":1.0389999999999999},"min":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"max":{"1min":1.974,"5min":1.974,"15min":1.974},"last":1.2749999999999999},{"interface":"front","average":{"1min":1,"5min":1,"15min":1},"min":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.9910000000000001,"5min":1.9910000000000001,"15min":1.9910000000000001},"last":1.212}]},{"osd":3,"last update":"Thu Apr 18 14:44:21 2024","interfaces":[{"interface":"back","average":{"1min":0.91500000000000004,"5min":0.91500000000000004,"15min":0.91500000000000004},"min":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"max":{"1min":1.2110000000000001,"5min":1.2110000000000001,"15min":1.2110000000000001},"last":1.044},{"interface":"front","average":{"1min":1.0489999999999999,"5min":1.0489999999999999,"15min":1.0489999999999999},"min":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":1.4430000000000001,"5min":1.4430000000000001,"15min":1.4430000000000001},"last":1.0900000000000001}]},{"osd":4,"last update":"Thu Apr 18 14:44:21 2024","interfaces":[{"interface":"back","average":{"1min":0.98099999999999998,"5min":0.98099999999999998,"15min":0.98099999999999998},"min":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.3919999999999999,"5min":1.3919999999999999,"15min":1.3919999999999999},"last":1.1499999999999999},{"interface":"front","average":{"1min":0.90100000000000002,"5min":0.90100000000000002,"15min":0.90100000000000002},"min":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":1.306,"5min":1.306,"15min":1.306},"last":0.93700000000000006}]},{"osd":5,"last update":"Thu Apr 18 14:44:21 2024","interfaces":[{"interface":"back","average":{"1min":0.96399999999999997,"5min":0.96399999999999997,"15min":0.96399999999999997},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":1.5860000000000001,"5min":1.5860000000000001,"15min":1.5860000000000001},"last":1.125},{"interface":"front","average":{"1min":1.0780000000000001,"5min":1.0780000000000001,"15min":1.0780000000000001},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.536,"5min":1.536,"15min":1.536},"last":1.298}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1950000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3220000000000001}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.369}]},{"osd":12,"last update":"Thu Apr 18 14:44:21 2024","interfaces":[{"interface":"back","average":{"1min":1.2709999999999999,"5min":1.2709999999999999,"15min":1.2709999999999999},"min":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"max":{"1min":1.911,"5min":1.911,"15min":1.911},"last":1.004},{"interface":"front","average":{"1min":1.3140000000000001,"5min":1.3140000000000001,"15min":1.3140000000000001},"min":{"1min":0.755,"5min":0.755,"15min":0.755},"max":{"1min":2.504,"5min":2.504,"15min":2.504},"last":1.478}]},{"osd":14,"last update":"Thu Apr 18 14:44:21 2024","interfaces":[{"interface":"back","average":{"1min":1.2909999999999999,"5min":1.2909999999999999,"15min":1.2909999999999999},"min":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"max":{"1min":3.6240000000000001,"5min":3.6240000000000001,"15min":3.6240000000000001},"last":1.3420000000000001},{"interface":"front","average":{"1min":1.357,"5min":1.357,"15min":1.357},"min":{"1min":0.627,"5min":0.627,"15min":0.627},"max":{"1min":2.1960000000000002,"5min":2.1960000000000002,"15min":2.1960000000000002},"last":1.4490000000000001}]},{"osd":15,"last update":"Thu Apr 18 14:44:21 2024","interfaces":[{"interface":"back","average":{"1min":1.3560000000000001,"5min":1.3560000000000001,"15min":1.3560000000000001},"min":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"max":{"1min":2.1080000000000001,"5min":2.1080000000000001,"15min":2.1080000000000001},"last":1.522},{"interface":"front","average":{"1min":1.26,"5min":1.26,"15min":1.26},"min":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"max":{"1min":1.8380000000000001,"5min":1.8380000000000001,"15min":1.8380000000000001},"last":1.423}]}]},{"osd":9,"up_from":24,"seq":103079215121,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51392,"kb_used_data":20276,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94320448,"statfs":{"total":96636764160,"available":96584138752,"internally_reserved":0,"allocated":20762624,"data_stored":32127192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1599,"internal_metadata":31848897},"hb_peers":[0,1,3,8,10,11,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Apr 18 14:44:20 2024","interfaces":[{"interface":"back","average":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":1.0429999999999999,"5min":1.0429999999999999,"15min":1.0429999999999999},"last":0.68799999999999994},{"interface":"front","average":{"1min":0.95199999999999996,"5min":0.95199999999999996,"15min":0.95199999999999996},"min":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"max":{"1min":1.6559999999999999,"5min":1.6559999999999999,"15min":1.6559999999999999},"last":0.60699999999999998}]},{"osd":1,"last update":"Thu Apr 18 14:44:20 2024","interfaces":[{"interface":"back","average":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"min":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":1.3200000000000001,"5min":1.3200000000000001,"15min":1.3200000000000001},"last":0.79400000000000004},{"interface":"front","average":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.2509999999999999,"5min":1.2509999999999999,"15min":1.2509999999999999},"last":0.65200000000000002}]},{"osd":3,"last update":"Thu Apr 18 14:44:20 2024","interfaces":[{"interface":"back","average":{"1min":1.032,"5min":1.032,"15min":1.032},"min":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"max":{"1min":1.5980000000000001,"5min":1.5980000000000001,"15min":1.5980000000000001},"last":1.115},{"interface":"front","average":{"1min":1.1539999999999999,"5min":1.1539999999999999,"15min":1.1539999999999999},"min":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"max":{"1min":1.722,"5min":1.722,"15min":1.722},"last":0.871}]},{"osd":8,"last update":"Thu Apr 18 14:44:20 2024","interfaces":[{"interface":"back","average":{"1min":0.94899999999999995,"5min":0.94899999999999995,"15min":0.94899999999999995},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":1.6899999999999999,"5min":1.6899999999999999,"15min":1.6899999999999999},"last":0.91500000000000004},{"interface":"front","average":{"1min":1.3380000000000001,"5min":1.3380000000000001,"15min":1.3380000000000001},"min":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"max":{"1min":5.4989999999999997,"5min":5.4989999999999997,"15min":5.4989999999999997},"last":0.83999999999999997}]},{"osd":10,"last update":"Thu Apr 18 14:44:20 2024","interfaces":[{"interface":"back","average":{"1min":1.196,"5min":1.196,"15min":1.196},"min":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"max":{"1min":1.5429999999999999,"5min":1.5429999999999999,"15min":1.5429999999999999},"last":1.089},{"interface":"front","average":{"1min":1.117,"5min":1.117,"15min":1.117},"min":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"max":{"1min":1.7689999999999999,"5min":1.7689999999999999,"15min":1.7689999999999999},"last":1.1950000000000001}]},{"osd":11,"last update":"Thu Apr 18 14:44:20 2024","interfaces":[{"interface":"back","average":{"1min":1.1279999999999999,"5min":1.1279999999999999,"15min":1.1279999999999999},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.849,"5min":1.849,"15min":1.849},"last":1.149},{"interface":"front","average":{"1min":1.2310000000000001,"5min":1.2310000000000001,"15min":1.2310000000000001},"min":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"max":{"1min":1.8109999999999999,"5min":1.8109999999999999,"15min":1.8109999999999999},"last":1.298}]},{"osd":12,"last update":"Thu Apr 18 14:44:20 2024","interfaces":[{"interface":"back","average":{"1min":1.2989999999999999,"5min":1.2989999999999999,"15min":1.2989999999999999},"min":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"max":{"1min":2.1560000000000001,"5min":2.1560000000000001,"15min":2.1560000000000001},"last":0.94299999999999995},{"interface":"front","average":{"1min":1.29,"5min":1.29,"15min":1.29},"min":{"1min":0.748,"5min":0.748,"15min":0.748},"max":{"1min":2.6930000000000001,"5min":2.6930000000000001,"15min":2.6930000000000001},"last":1.004}]},{"osd":13,"last update":"Thu Apr 18 14:44:20 2024","interfaces":[{"interface":"back","average":{"1min":1.4079999999999999,"5min":1.4079999999999999,"15min":1.4079999999999999},"min":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"max":{"1min":2.6030000000000002,"5min":2.6030000000000002,"15min":2.6030000000000002},"last":1.264},{"interface":"front","average":{"1min":1.4710000000000001,"5min":1.4710000000000001,"15min":1.4710000000000001},"min":{"1min":0.92100000000000004,"5min":0.92100000000000004,"15min":0.92100000000000004},"max":{"1min":2.472,"5min":2.472,"15min":2.472},"last":1.3620000000000001}]},{"osd":14,"last update":"Thu Apr 18 14:44:20 2024","interfaces":[{"interface":"back","average":{"1min":1.456,"5min":1.456,"15min":1.456},"min":{"1min":0.88400000000000001,"5min":0.88400000000000001,"15min":0.88400000000000001},"max":{"1min":2.3180000000000001,"5min":2.3180000000000001,"15min":2.3180000000000001},"last":1.4079999999999999},{"interface":"front","average":{"1min":1.5389999999999999,"5min":1.5389999999999999,"15min":1.5389999999999999},"min":{"1min":1.016,"5min":1.016,"15min":1.016},"max":{"1min":2.6549999999999998,"5min":2.6549999999999998,"15min":2.6549999999999998},"last":1.173}]},{"osd":15,"last update":"Thu Apr 18 14:44:20 2024","interfaces":[{"interface":"back","average":{"1min":1.4119999999999999,"5min":1.4119999999999999,"15min":1.4119999999999999},"min":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"max":{"1min":2.7789999999999999,"5min":2.7789999999999999,"15min":2.7789999999999999},"last":1.242},{"interface":"front","average":{"1min":1.4359999999999999,"5min":1.4359999999999999,"15min":1.4359999999999999},"min":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"max":{"1min":1.923,"5min":1.923,"15min":1.923},"last":1.4470000000000001}]}]},{"osd":5,"up_from":24,"seq":103079215122,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":44920,"kb_used_data":13804,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94326920,"statfs":{"total":96636764160,"available":96590766080,"internally_reserved":0,"allocated":14135296,"data_stored":21379288,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,3,4,6,10,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83399999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47799999999999998}]},{"osd":3,"last update":"Thu Apr 18 14:44:24 2024","interfaces":[{"interface":"back","average":{"1min":1.024,"5min":1.024,"15min":1.024},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":1.4650000000000001,"5min":1.4650000000000001,"15min":1.4650000000000001},"last":0.70699999999999996},{"interface":"front","average":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":0.94999999999999996},"min":{"1min":0.621,"5min":0.621,"15min":0.621},"max":{"1min":1.8460000000000001,"5min":1.8460000000000001,"15min":1.8460000000000001},"last":0.67200000000000004}]},{"osd":4,"last update":"Thu Apr 18 14:44:24 2024","interfaces":[{"interface":"back","average":{"1min":0.89400000000000002,"5min":0.89400000000000002,"15min":0.89400000000000002},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":1.968,"5min":1.968,"15min":1.968},"last":0.68500000000000005},{"interface":"front","average":{"1min":1.016,"5min":1.016,"15min":1.016},"min":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"max":{"1min":1.819,"5min":1.819,"15min":1.819},"last":0.66000000000000003}]},{"osd":6,"last update":"Thu Apr 18 14:44:24 2024","interfaces":[{"interface":"back","average":{"1min":1.0629999999999999,"5min":1.0629999999999999,"15min":1.0629999999999999},"min":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"max":{"1min":2.0760000000000001,"5min":2.0760000000000001,"15min":2.0760000000000001},"last":0.72999999999999998},{"interface":"front","average":{"1min":1.101,"5min":1.101,"15min":1.101},"min":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"max":{"1min":1.694,"5min":1.694,"15min":1.694},"last":0.80900000000000005}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2330000000000001}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96599999999999997}]},{"osd":10,"last update":"Thu Apr 18 14:44:24 2024","interfaces":[{"interface":"back","average":{"1min":1.232,"5min":1.232,"15min":1.232},"min":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"max":{"1min":2.2709999999999999,"5min":2.2709999999999999,"15min":2.2709999999999999},"last":0.78400000000000003},{"interface":"front","average":{"1min":1.2569999999999999,"5min":1.2569999999999999,"15min":1.2569999999999999},"min":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"max":{"1min":2.4470000000000001,"5min":2.4470000000000001,"15min":2.4470000000000001},"last":0.84899999999999998}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.256}]},{"osd":12,"last update":"Thu Apr 18 14:44:24 2024","interfaces":[{"interface":"back","average":{"1min":1.1140000000000001,"5min":1.1140000000000001,"15min":1.1140000000000001},"min":{"1min":0.625,"5min":0.625,"15min":0.625},"max":{"1min":1.728,"5min":1.728,"15min":1.728},"last":0.625},{"interface":"front","average":{"1min":1.339,"5min":1.339,"15min":1.339},"min":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"max":{"1min":2.008,"5min":2.008,"15min":2.008},"last":0.88500000000000001}]},{"osd":13,"last update":"Thu Apr 18 14:44:24 2024","interfaces":[{"interface":"back","average":{"1min":1.355,"5min":1.355,"15min":1.355},"min":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":2.5070000000000001,"5min":2.5070000000000001,"15min":2.5070000000000001},"last":0.53500000000000003},{"interface":"front","average":{"1min":1.2949999999999999,"5min":1.2949999999999999,"15min":1.2949999999999999},"min":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":2.992,"5min":2.992,"15min":2.992},"last":0.59699999999999998}]},{"osd":14,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97499999999999998}]},{"osd":15,"last update":"Thu Apr 18 14:44:24 2024","interfaces":[{"interface":"back","average":{"1min":1.486,"5min":1.486,"15min":1.486},"min":{"1min":0.879,"5min":0.879,"15min":0.879},"max":{"1min":2.415,"5min":2.415,"15min":2.415},"last":0.94099999999999995},{"interface":"front","average":{"1min":1.4470000000000001,"5min":1.4470000000000001,"15min":1.4470000000000001},"min":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"max":{"1min":2.7799999999999998,"5min":2.7799999999999998,"15min":2.7799999999999998},"last":0.92300000000000004}]}]},{"osd":14,"up_from":21,"seq":90194313234,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":77712,"kb_used_data":28544,"kb_used_omap":1,"kb_used_meta":49150,"kb_avail":94294128,"statfs":{"total":96636764160,"available":96557187072,"internally_reserved":0,"allocated":29229056,"data_stored":45029692,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":50330054},"hb_peers":[0,1,2,4,5,6,7,8,9,11,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Apr 18 14:44:21 2024","interfaces":[{"interface":"back","average":{"1min":0.96899999999999997,"5min":0.96899999999999997,"15min":0.96899999999999997},"min":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"max":{"1min":1.454,"5min":1.454,"15min":1.454},"last":0.71499999999999997},{"interface":"front","average":{"1min":1.0660000000000001,"5min":1.0660000000000001,"15min":1.0660000000000001},"min":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"max":{"1min":1.9390000000000001,"5min":1.9390000000000001,"15min":1.9390000000000001},"last":0.86699999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98099999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42599999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94499999999999995}]},{"osd":4,"last update":"Thu Apr 18 14:44:20 2024","interfaces":[{"interface":"back","average":{"1min":0.95099999999999996,"5min":0.95099999999999996,"15min":0.95099999999999996},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.296,"5min":1.296,"15min":1.296},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.97599999999999998,"5min":0.97599999999999998,"15min":0.97599999999999998},"min":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"max":{"1min":1.5129999999999999,"5min":1.5129999999999999,"15min":1.5129999999999999},"last":0.82699999999999996}]},{"osd":5,"last update":"Thu Apr 18 14:44:20 2024","interfaces":[{"interface":"back","average":{"1min":1.218,"5min":1.218,"15min":1.218},"min":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"max":{"1min":2.1269999999999998,"5min":2.1269999999999998,"15min":2.1269999999999998},"last":0.94799999999999995},{"interface":"front","average":{"1min":1.1679999999999999,"5min":1.1679999999999999,"15min":1.1679999999999999},"min":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"max":{"1min":1.5920000000000001,"5min":1.5920000000000001,"15min":1.5920000000000001},"last":0.60499999999999998}]},{"osd":6,"last update":"Thu Apr 18 14:44:20 2024","interfaces":[{"interface":"back","average":{"1min":0.94699999999999995,"5min":0.94699999999999995,"15min":0.94699999999999995},"min":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"max":{"1min":1.3160000000000001,"5min":1.3160000000000001,"15min":1.3160000000000001},"last":0.58899999999999997},{"interface":"front","average":{"1min":1.163,"5min":1.163,"15min":1.163},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":1.7689999999999999,"5min":1.7689999999999999,"15min":1.7689999999999999},"last":0.77800000000000002}]},{"osd":7,"last update":"Thu Apr 18 14:44:20 2024","interfaces":[{"interface":"back","average":{"1min":1.234,"5min":1.234,"15min":1.234},"min":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"max":{"1min":1.7529999999999999,"5min":1.7529999999999999,"15min":1.7529999999999999},"last":0.76500000000000001},{"interface":"front","average":{"1min":1.1759999999999999,"5min":1.1759999999999999,"15min":1.1759999999999999},"min":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"max":{"1min":1.587,"5min":1.587,"15min":1.587},"last":0.73099999999999998}]},{"osd":8,"last update":"Thu Apr 18 14:44:20 2024","interfaces":[{"interface":"back","average":{"1min":1.292,"5min":1.292,"15min":1.292},"min":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"max":{"1min":2.0569999999999999,"5min":2.0569999999999999,"15min":2.0569999999999999},"last":0.92400000000000004},{"interface":"front","average":{"1min":1.2509999999999999,"5min":1.2509999999999999,"15min":1.2509999999999999},"min":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"max":{"1min":1.8740000000000001,"5min":1.8740000000000001,"15min":1.8740000000000001},"last":0.79300000000000004}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0089999999999999}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4219999999999999}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83999999999999997}]},{"osd":12,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.016}]},{"osd":13,"last update":"Thu Apr 18 14:44:20 2024","interfaces":[{"interface":"back","average":{"1min":1.464,"5min":1.464,"15min":1.464},"min":{"1min":0.86799999999999999,"5min":0.86799999999999999,"15min":0.86799999999999999},"max":{"1min":1.8620000000000001,"5min":1.8620000000000001,"15min":1.8620000000000001},"last":0.84699999999999998},{"interface":"front","average":{"1min":1.5349999999999999,"5min":1.5349999999999999,"15min":1.5349999999999999},"min":{"1min":0.94299999999999995,"5min":0.94299999999999995,"15min":0.94299999999999995},"max":{"1min":2.452,"5min":2.452,"15min":2.452},"last":1.03}]},{"osd":15,"last update":"Thu Apr 18 14:44:20 2024","interfaces":[{"interface":"back","average":{"1min":1.5129999999999999,"5min":1.5129999999999999,"15min":1.5129999999999999},"min":{"1min":0.95699999999999996,"5min":0.95699999999999996,"15min":0.95699999999999996},"max":{"1min":2.2549999999999999,"5min":2.2549999999999999,"15min":2.2549999999999999},"last":0.93400000000000005},{"interface":"front","average":{"1min":1.476,"5min":1.476,"15min":1.476},"min":{"1min":0.89800000000000002,"5min":0.89800000000000002,"15min":0.89800000000000002},"max":{"1min":1.9550000000000001,"5min":1.9550000000000001,"15min":1.9550000000000001},"last":0.90800000000000003}]}]},{"osd":1,"up_from":24,"seq":103079215122,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":63000,"kb_used_data":31884,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94308840,"statfs":{"total":96636764160,"available":96572252160,"internally_reserved":0,"allocated":32649216,"data_stored":43369868,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,2,3,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Apr 18 14:44:25 2024","interfaces":[{"interface":"back","average":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":1.165,"5min":1.165,"15min":1.165},"last":0.67900000000000005},{"interface":"front","average":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"min":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":1.292,"5min":1.292,"15min":1.292},"last":0.79300000000000004}]},{"osd":2,"last update":"Thu Apr 18 14:44:25 2024","interfaces":[{"interface":"back","average":{"1min":0.93899999999999995,"5min":0.93899999999999995,"15min":0.93899999999999995},"min":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"max":{"1min":1.3180000000000001,"5min":1.3180000000000001,"15min":1.3180000000000001},"last":1.232},{"interface":"front","average":{"1min":0.95199999999999996,"5min":0.95199999999999996,"15min":0.95199999999999996},"min":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":1.345,"5min":1.345,"15min":1.345},"last":0.86599999999999999}]},{"osd":3,"last update":"Thu Apr 18 14:44:25 2024","interfaces":[{"interface":"back","average":{"1min":1.0760000000000001,"5min":1.0760000000000001,"15min":1.0760000000000001},"min":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":1.486,"5min":1.486,"15min":1.486},"last":1.1619999999999999},{"interface":"front","average":{"1min":1.1679999999999999,"5min":1.1679999999999999,"15min":1.1679999999999999},"min":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"max":{"1min":1.7789999999999999,"5min":1.7789999999999999,"15min":1.7789999999999999},"last":1.0509999999999999}]},{"osd":4,"last update":"Thu Apr 18 14:44:25 2024","interfaces":[{"interface":"back","average":{"1min":0.98299999999999998,"5min":0.98299999999999998,"15min":0.98299999999999998},"min":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"max":{"1min":1.728,"5min":1.728,"15min":1.728},"last":0.95799999999999996},{"interface":"front","average":{"1min":0.93700000000000006,"5min":0.93700000000000006,"15min":0.93700000000000006},"min":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"max":{"1min":1.6950000000000001,"5min":1.6950000000000001,"15min":1.6950000000000001},"last":1.1200000000000001}]},{"osd":5,"last update":"Thu Apr 18 14:44:25 2024","interfaces":[{"interface":"back","average":{"1min":1.0089999999999999,"5min":1.0089999999999999,"15min":1.0089999999999999},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":1.819,"5min":1.819,"15min":1.819},"last":0.98099999999999998},{"interface":"front","average":{"1min":1.083,"5min":1.083,"15min":1.083},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":1.841,"5min":1.841,"15min":1.841},"last":0.90100000000000002}]},{"osd":6,"last update":"Thu Apr 18 14:44:25 2024","interfaces":[{"interface":"back","average":{"1min":1.2529999999999999,"5min":1.2529999999999999,"15min":1.2529999999999999},"min":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"max":{"1min":2.3639999999999999,"5min":2.3639999999999999,"15min":2.3639999999999999},"last":1.3220000000000001},{"interface":"front","average":{"1min":1.1839999999999999,"5min":1.1839999999999999,"15min":1.1839999999999999},"min":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"max":{"1min":1.9419999999999999,"5min":1.9419999999999999,"15min":1.9419999999999999},"last":1.028}]},{"osd":7,"last update":"Thu Apr 18 14:44:25 2024","interfaces":[{"interface":"back","average":{"1min":1.2050000000000001,"5min":1.2050000000000001,"15min":1.2050000000000001},"min":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"max":{"1min":1.96,"5min":1.96,"15min":1.96},"last":0.93700000000000006},{"interface":"front","average":{"1min":1.2509999999999999,"5min":1.2509999999999999,"15min":1.2509999999999999},"min":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"max":{"1min":2.4399999999999999,"5min":2.4399999999999999,"15min":2.4399999999999999},"last":1.194}]},{"osd":8,"last update":"Thu Apr 18 14:44:25 2024","interfaces":[{"interface":"back","average":{"1min":1.2330000000000001,"5min":1.2330000000000001,"15min":1.2330000000000001},"min":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"max":{"1min":1.881,"5min":1.881,"15min":1.881},"last":0.83699999999999997},{"interface":"front","average":{"1min":1.26,"5min":1.26,"15min":1.26},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":2.5169999999999999,"5min":2.5169999999999999,"15min":2.5169999999999999},"last":1.087}]},{"osd":9,"last update":"Thu Apr 18 14:44:25 2024","interfaces":[{"interface":"back","average":{"1min":1.3280000000000001,"5min":1.3280000000000001,"15min":1.3280000000000001},"min":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":2.4780000000000002,"5min":2.4780000000000002,"15min":2.4780000000000002},"last":1.294},{"interface":"front","average":{"1min":1.3129999999999999,"5min":1.3129999999999999,"15min":1.3129999999999999},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":2.161,"5min":2.161,"15min":2.161},"last":0.74199999999999999}]},{"osd":10,"last update":"Thu Apr 18 14:44:25 2024","interfaces":[{"interface":"back","average":{"1min":1.407,"5min":1.407,"15min":1.407},"min":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"max":{"1min":2.625,"5min":2.625,"15min":2.625},"last":1.2669999999999999},{"interface":"front","average":{"1min":1.446,"5min":1.446,"15min":1.446},"min":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"max":{"1min":2.5529999999999999,"5min":2.5529999999999999,"15min":2.5529999999999999},"last":1.353}]}]},{"osd":2,"up_from":22,"seq":94489280530,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40272,"kb_used_data":13248,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94331568,"statfs":{"total":96636764160,"available":96595525632,"internally_reserved":0,"allocated":13565952,"data_stored":19161429,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,3,5,6,7,8,10,11,12,14],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Apr 18 14:44:22 2024","interfaces":[{"interface":"back","average":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"min":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"max":{"1min":1.175,"5min":1.175,"15min":1.175},"last":0.86199999999999999},{"interface":"front","average":{"1min":0.90900000000000003,"5min":0.90900000000000003,"15min":0.90900000000000003},"min":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"max":{"1min":1.3740000000000001,"5min":1.3740000000000001,"15min":1.3740000000000001},"last":0.97699999999999998}]},{"osd":3,"last update":"Thu Apr 18 14:44:22 2024","interfaces":[{"interface":"back","average":{"1min":1.0409999999999999,"5min":1.0409999999999999,"15min":1.0409999999999999},"min":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"max":{"1min":1.6830000000000001,"5min":1.6830000000000001,"15min":1.6830000000000001},"last":0.90300000000000002},{"interface":"front","average":{"1min":1.0700000000000001,"5min":1.0700000000000001,"15min":1.0700000000000001},"min":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"max":{"1min":1.8839999999999999,"5min":1.8839999999999999,"15min":1.8839999999999999},"last":0.94399999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96699999999999997}]},{"osd":5,"last update":"Thu Apr 18 14:44:22 2024","interfaces":[{"interface":"back","average":{"1min":0.98799999999999999,"5min":0.98799999999999999,"15min":0.98799999999999999},"min":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"max":{"1min":1.5469999999999999,"5min":1.5469999999999999,"15min":1.5469999999999999},"last":1.369},{"interface":"front","average":{"1min":0.92500000000000004,"5min":0.92500000000000004,"15min":0.92500000000000004},"min":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":1.333,"5min":1.333,"15min":1.333},"last":1.4079999999999999}]},{"osd":6,"last update":"Thu Apr 18 14:44:19 2024","interfaces":[{"interface":"back","average":{"1min":1.115,"5min":1.115,"15min":1.115},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":2.0529999999999999,"5min":2.0529999999999999,"15min":2.0529999999999999},"last":1.149},{"interface":"front","average":{"1min":1.089,"5min":1.089,"15min":1.089},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.8069999999999999,"5min":1.8069999999999999,"15min":1.8069999999999999},"last":1.0649999999999999}]},{"osd":7,"last update":"Thu Apr 18 14:44:22 2024","interfaces":[{"interface":"back","average":{"1min":1.165,"5min":1.165,"15min":1.165},"min":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"max":{"1min":2.012,"5min":2.012,"15min":2.012},"last":1.298},{"interface":"front","average":{"1min":1.2949999999999999,"5min":1.2949999999999999,"15min":1.2949999999999999},"min":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"max":{"1min":2.1419999999999999,"5min":2.1419999999999999,"15min":2.1419999999999999},"last":1.498}]},{"osd":8,"last update":"Thu Apr 18 14:44:22 2024","interfaces":[{"interface":"back","average":{"1min":1.224,"5min":1.224,"15min":1.224},"min":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"max":{"1min":1.988,"5min":1.988,"15min":1.988},"last":1.5309999999999999},{"interface":"front","average":{"1min":1.3120000000000001,"5min":1.3120000000000001,"15min":1.3120000000000001},"min":{"1min":0.84999999999999998,"5min":0.84999999999999998,"15min":0.84999999999999998},"max":{"1min":2.2240000000000002,"5min":2.2240000000000002,"15min":2.2240000000000002},"last":1.71}]},{"osd":10,"last update":"Thu Apr 18 14:44:19 2024","interfaces":[{"interface":"back","average":{"1min":1.365,"5min":1.365,"15min":1.365},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":2.319,"5min":2.319,"15min":2.319},"last":1.6060000000000001},{"interface":"front","average":{"1min":1.3879999999999999,"5min":1.3879999999999999,"15min":1.3879999999999999},"min":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"max":{"1min":2.27,"5min":2.27,"15min":2.27},"last":1.6599999999999999}]},{"osd":11,"last update":"Thu Apr 18 14:44:19 2024","interfaces":[{"interface":"back","average":{"1min":1.49,"5min":1.49,"15min":1.49},"min":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"max":{"1min":2.4950000000000001,"5min":2.4950000000000001,"15min":2.4950000000000001},"last":1.5840000000000001},{"interface":"front","average":{"1min":1.4590000000000001,"5min":1.4590000000000001,"15min":1.4590000000000001},"min":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"max":{"1min":2.411,"5min":2.411,"15min":2.411},"last":1.6299999999999999}]},{"osd":12,"last update":"Thu Apr 18 14:44:19 2024","interfaces":[{"interface":"back","average":{"1min":1.4910000000000001,"5min":1.4910000000000001,"15min":1.4910000000000001},"min":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":0.88500000000000001},"max":{"1min":2.2669999999999999,"5min":2.2669999999999999,"15min":2.2669999999999999},"last":1.4610000000000001},{"interface":"front","average":{"1min":1.514,"5min":1.514,"15min":1.514},"min":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"max":{"1min":2.3719999999999999,"5min":2.3719999999999999,"15min":2.3719999999999999},"last":1.74}]},{"osd":14,"last update":"Thu Apr 18 14:44:19 2024","interfaces":[{"interface":"back","average":{"1min":1.4390000000000001,"5min":1.4390000000000001,"15min":1.4390000000000001},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":2.3050000000000002,"5min":2.3050000000000002,"15min":2.3050000000000002},"last":1.7849999999999999},{"interface":"front","average":{"1min":1.5069999999999999,"5min":1.5069999999999999,"15min":1.5069999999999999},"min":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":2.4020000000000001,"5min":2.4020000000000001,"15min":2.4020000000000001},"last":1.5569999999999999}]}]},{"osd":15,"up_from":23,"seq":98784247826,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":52752,"kb_used_data":21632,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94319088,"statfs":{"total":96636764160,"available":96582746112,"internally_reserved":0,"allocated":22151168,"data_stored":32953414,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31848903},"hb_peers":[0,4,5,6,7,8,10,11,13,14],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Apr 18 14:44:19 2024","interfaces":[{"interface":"back","average":{"1min":0.94699999999999995,"5min":0.94699999999999995,"15min":0.94699999999999995},"min":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"max":{"1min":1.405,"5min":1.405,"15min":1.405},"last":0.69799999999999995},{"interface":"front","average":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"min":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":1.0569999999999999,"5min":1.0569999999999999,"15min":1.0569999999999999},"last":0.86399999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2050000000000001}]},{"osd":4,"last update":"Thu Apr 18 14:44:19 2024","interfaces":[{"interface":"back","average":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.85099999999999998},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.2669999999999999,"5min":1.2669999999999999,"15min":1.2669999999999999},"last":0.79600000000000004},{"interface":"front","average":{"1min":0.877,"5min":0.877,"15min":0.877},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.2410000000000001,"5min":1.2410000000000001,"15min":1.2410000000000001},"last":0.93500000000000005}]},{"osd":5,"last update":"Thu Apr 18 14:44:22 2024","interfaces":[{"interface":"back","average":{"1min":1.0209999999999999,"5min":1.0209999999999999,"15min":1.0209999999999999},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":2.0579999999999998,"5min":2.0579999999999998,"15min":2.0579999999999998},"last":1.038},{"interface":"front","average":{"1min":1.089,"5min":1.089,"15min":1.089},"min":{"1min":0.75,"5min":0.75,"15min":0.75},"max":{"1min":1.9259999999999999,"5min":1.9259999999999999,"15min":1.9259999999999999},"last":0.91500000000000004}]},{"osd":6,"last update":"Thu Apr 18 14:44:19 2024","interfaces":[{"interface":"back","average":{"1min":1.1379999999999999,"5min":1.1379999999999999,"15min":1.1379999999999999},"min":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"max":{"1min":1.8680000000000001,"5min":1.8680000000000001,"15min":1.8680000000000001},"last":1.224},{"interface":"front","average":{"1min":1.228,"5min":1.228,"15min":1.228},"min":{"1min":0.86499999999999999,"5min":0.86499999999999999,"15min":0.86499999999999999},"max":{"1min":1.79,"5min":1.79,"15min":1.79},"last":1.121}]},{"osd":7,"last update":"Thu Apr 18 14:44:19 2024","interfaces":[{"interface":"back","average":{"1min":1.0549999999999999,"5min":1.0549999999999999,"15min":1.0549999999999999},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":1.488,"5min":1.488,"15min":1.488},"last":1.0860000000000001},{"interface":"front","average":{"1min":1.1830000000000001,"5min":1.1830000000000001,"15min":1.1830000000000001},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":1.976,"5min":1.976,"15min":1.976},"last":1.355}]},{"osd":8,"last update":"Thu Apr 18 14:44:19 2024","interfaces":[{"interface":"back","average":{"1min":1.1879999999999999,"5min":1.1879999999999999,"15min":1.1879999999999999},"min":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"max":{"1min":2.004,"5min":2.004,"15min":2.004},"last":0.95999999999999996},{"interface":"front","average":{"1min":1.222,"5min":1.222,"15min":1.222},"min":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"max":{"1min":1.786,"5min":1.786,"15min":1.786},"last":1.1930000000000001}]},{"osd":10,"last update":"Thu Apr 18 14:44:19 2024","interfaces":[{"interface":"back","average":{"1min":1.3360000000000001,"5min":1.3360000000000001,"15min":1.3360000000000001},"min":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"max":{"1min":2.403,"5min":2.403,"15min":2.403},"last":1.1479999999999999},{"interface":"front","average":{"1min":1.331,"5min":1.331,"15min":1.331},"min":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"max":{"1min":2.2549999999999999,"5min":2.2549999999999999,"15min":2.2549999999999999},"last":1.004}]},{"osd":11,"last update":"Thu Apr 18 14:44:19 2024","interfaces":[{"interface":"back","average":{"1min":1.399,"5min":1.399,"15min":1.399},"min":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"max":{"1min":2.2109999999999999,"5min":2.2109999999999999,"15min":2.2109999999999999},"last":1.325},{"interface":"front","average":{"1min":1.4490000000000001,"5min":1.4490000000000001,"15min":1.4490000000000001},"min":{"1min":0.629,"5min":0.629,"15min":0.629},"max":{"1min":2.1589999999999998,"5min":2.1589999999999998,"15min":2.1589999999999998},"last":1.2909999999999999}]},{"osd":13,"last update":"Thu Apr 18 14:44:22 2024","interfaces":[{"interface":"back","average":{"1min":1.391,"5min":1.391,"15min":1.391},"min":{"1min":1.0109999999999999,"5min":1.0109999999999999,"15min":1.0109999999999999},"max":{"1min":1.9419999999999999,"5min":1.9419999999999999,"15min":1.9419999999999999},"last":1.1739999999999999},{"interface":"front","average":{"1min":1.387,"5min":1.387,"15min":1.387},"min":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"max":{"1min":1.8959999999999999,"5min":1.8959999999999999,"15min":1.8959999999999999},"last":1.2450000000000001}]},{"osd":14,"last update":"Thu Apr 18 14:44:19 2024","interfaces":[{"interface":"back","average":{"1min":1.4279999999999999,"5min":1.4279999999999999,"15min":1.4279999999999999},"min":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"max":{"1min":2.351,"5min":2.351,"15min":2.351},"last":1.4370000000000001},{"interface":"front","average":{"1min":1.454,"5min":1.454,"15min":1.454},"min":{"1min":0.84299999999999997,"5min":0.84299999999999997,"15min":0.84299999999999997},"max":{"1min":2.766,"5min":2.766,"15min":2.766},"last":1.3799999999999999}]}]},{"osd":4,"up_from":22,"seq":94489280529,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":52888,"kb_used_data":21772,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94318952,"statfs":{"total":96636764160,"available":96582606848,"internally_reserved":0,"allocated":22294528,"data_stored":37568009,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[2,3,5,6,10,11,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":2,"last update":"Thu Apr 18 14:44:20 2024","interfaces":[{"interface":"back","average":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":1.2330000000000001,"5min":1.2330000000000001,"15min":1.2330000000000001},"last":0.66800000000000004},{"interface":"front","average":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":1.306,"5min":1.306,"15min":1.306},"last":0.57399999999999995}]},{"osd":3,"last update":"Thu Apr 18 14:44:20 2024","interfaces":[{"interface":"back","average":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":1.1499999999999999,"5min":1.1499999999999999,"15min":1.1499999999999999},"last":0.68300000000000005},{"interface":"front","average":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":1.0169999999999999,"5min":1.0169999999999999,"15min":1.0169999999999999},"last":0.55700000000000005}]},{"osd":5,"last update":"Thu Apr 18 14:44:20 2024","interfaces":[{"interface":"back","average":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":1.0609999999999999,"5min":1.0609999999999999,"15min":1.0609999999999999},"last":0.54800000000000004},{"interface":"front","average":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":1.2190000000000001,"5min":1.2190000000000001,"15min":1.2190000000000001},"last":0.623}]},{"osd":6,"last update":"Thu Apr 18 14:44:20 2024","interfaces":[{"interface":"back","average":{"1min":0.84999999999999998,"5min":0.84999999999999998,"15min":0.84999999999999998},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":1.1930000000000001,"5min":1.1930000000000001,"15min":1.1930000000000001},"last":0.82099999999999995},{"interface":"front","average":{"1min":0.88,"5min":0.88,"15min":0.88},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.337,"5min":1.337,"15min":1.337},"last":0.58799999999999997}]},{"osd":10,"last update":"Thu Apr 18 14:44:20 2024","interfaces":[{"interface":"back","average":{"1min":0.876,"5min":0.876,"15min":0.876},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":1.49,"5min":1.49,"15min":1.49},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.90900000000000003,"5min":0.90900000000000003,"15min":0.90900000000000003},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.5700000000000001,"5min":1.5700000000000001,"15min":1.5700000000000001},"last":0.70099999999999996}]},{"osd":11,"last update":"Thu Apr 18 14:44:20 2024","interfaces":[{"interface":"back","average":{"1min":0.86499999999999999,"5min":0.86499999999999999,"15min":0.86499999999999999},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":1.2130000000000001,"5min":1.2130000000000001,"15min":1.2130000000000001},"last":0.39900000000000002},{"interface":"front","average":{"1min":0.90100000000000002,"5min":0.90100000000000002,"15min":0.90100000000000002},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.365,"5min":1.365,"15min":1.365},"last":0.51900000000000002}]},{"osd":12,"last update":"Thu Apr 18 14:44:20 2024","interfaces":[{"interface":"back","average":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":1.1879999999999999,"5min":1.1879999999999999,"15min":1.1879999999999999},"last":0.32900000000000001},{"interface":"front","average":{"1min":0.86099999999999999,"5min":0.86099999999999999,"15min":0.86099999999999999},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":1.2949999999999999,"5min":1.2949999999999999,"15min":1.2949999999999999},"last":0.35199999999999998}]},{"osd":13,"last update":"Thu Apr 18 14:44:20 2024","interfaces":[{"interface":"back","average":{"1min":0.95999999999999996,"5min":0.95999999999999996,"15min":0.95999999999999996},"min":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.4279999999999999,"5min":1.4279999999999999,"15min":1.4279999999999999},"last":0.65200000000000002},{"interface":"front","average":{"1min":0.89900000000000002,"5min":0.89900000000000002,"15min":0.89900000000000002},"min":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"max":{"1min":1.3360000000000001,"5min":1.3360000000000001,"15min":1.3360000000000001},"last":0.63700000000000001}]},{"osd":14,"last update":"Thu Apr 18 14:44:20 2024","interfaces":[{"interface":"back","average":{"1min":1.022,"5min":1.022,"15min":1.022},"min":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":1.4730000000000001,"5min":1.4730000000000001,"15min":1.4730000000000001},"last":0.81100000000000005},{"interface":"front","average":{"1min":1.0429999999999999,"5min":1.0429999999999999,"15min":1.0429999999999999},"min":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"max":{"1min":1.369,"5min":1.369,"15min":1.369},"last":0.53400000000000003}]},{"osd":15,"last update":"Thu Apr 18 14:44:20 2024","interfaces":[{"interface":"back","average":{"1min":1.016,"5min":1.016,"15min":1.016},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.5980000000000001,"5min":1.5980000000000001,"15min":1.5980000000000001},"last":0.79700000000000004},{"interface":"front","average":{"1min":1.02,"5min":1.02,"15min":1.02},"min":{"1min":0.624,"5min":0.624,"15min":0.624},"max":{"1min":1.5649999999999999,"5min":1.5649999999999999,"15min":1.5649999999999999},"last":0.71299999999999997}]}]},{"osd":6,"up_from":22,"seq":94489280529,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":54348,"kb_used_data":23224,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94317492,"statfs":{"total":96636764160,"available":96581111808,"internally_reserved":0,"allocated":23781376,"data_stored":35211580,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31848903},"hb_peers":[0,1,5,7,8,9,11,12,13,14],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47199999999999998}]},{"osd":1,"last update":"Thu Apr 18 14:44:19 2024","interfaces":[{"interface":"back","average":{"1min":1.0329999999999999,"5min":1.0329999999999999,"15min":1.0329999999999999},"min":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"max":{"1min":1.633,"5min":1.633,"15min":1.633},"last":0.877},{"interface":"front","average":{"1min":1.129,"5min":1.129,"15min":1.129},"min":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"max":{"1min":1.585,"5min":1.585,"15min":1.585},"last":1.1319999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95399999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86599999999999999}]},{"osd":5,"last update":"Thu Apr 18 14:44:19 2024","interfaces":[{"interface":"back","average":{"1min":0.96399999999999997,"5min":0.96399999999999997,"15min":0.96399999999999997},"min":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":1.627,"5min":1.627,"15min":1.627},"last":0.69399999999999995},{"interface":"front","average":{"1min":0.98199999999999998,"5min":0.98199999999999998,"15min":0.98199999999999998},"min":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"max":{"1min":1.246,"5min":1.246,"15min":1.246},"last":0.65100000000000002}]},{"osd":7,"last update":"Thu Apr 18 14:44:19 2024","interfaces":[{"interface":"back","average":{"1min":1.1399999999999999,"5min":1.1399999999999999,"15min":1.1399999999999999},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.5860000000000001,"5min":1.5860000000000001,"15min":1.5860000000000001},"last":1.052},{"interface":"front","average":{"1min":1.022,"5min":1.022,"15min":1.022},"min":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":1.482,"5min":1.482,"15min":1.482},"last":0.90900000000000003}]},{"osd":8,"last update":"Thu Apr 18 14:44:19 2024","interfaces":[{"interface":"back","average":{"1min":0.99299999999999999,"5min":0.99299999999999999,"15min":0.99299999999999999},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.3380000000000001,"5min":1.3380000000000001,"15min":1.3380000000000001},"last":0.58299999999999996},{"interface":"front","average":{"1min":1.163,"5min":1.163,"15min":1.163},"min":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"max":{"1min":1.673,"5min":1.673,"15min":1.673},"last":0.76000000000000001}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.03}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3240000000000001}]},{"osd":11,"last update":"Thu Apr 18 14:44:17 2024","interfaces":[{"interface":"back","average":{"1min":1.359,"5min":1.359,"15min":1.359},"min":{"1min":1.0229999999999999,"5min":1.0229999999999999,"15min":1.0229999999999999},"max":{"1min":2.3610000000000002,"5min":2.3610000000000002,"15min":2.3610000000000002},"last":0.98999999999999999},{"interface":"front","average":{"1min":1.1439999999999999,"5min":1.1439999999999999,"15min":1.1439999999999999},"min":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"max":{"1min":1.698,"5min":1.698,"15min":1.698},"last":0.84599999999999997}]},{"osd":12,"last update":"Thu Apr 18 14:44:17 2024","interfaces":[{"interface":"back","average":{"1min":1.1950000000000001,"5min":1.1950000000000001,"15min":1.1950000000000001},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.5189999999999999,"5min":1.5189999999999999,"15min":1.5189999999999999},"last":0.72599999999999998},{"interface":"front","average":{"1min":1.3400000000000001,"5min":1.3400000000000001,"15min":1.3400000000000001},"min":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"max":{"1min":2.1920000000000002,"5min":2.1920000000000002,"15min":2.1920000000000002},"last":0.93100000000000005}]},{"osd":13,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.095}]},{"osd":14,"last update":"Thu Apr 18 14:44:17 2024","interfaces":[{"interface":"back","average":{"1min":1.3280000000000001,"5min":1.3280000000000001,"15min":1.3280000000000001},"min":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"max":{"1min":1.8580000000000001,"5min":1.8580000000000001,"15min":1.8580000000000001},"last":1.1739999999999999},{"interface":"front","average":{"1min":1.347,"5min":1.347,"15min":1.347},"min":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":1.712,"5min":1.712,"15min":1.712},"last":1.073}]}]},{"osd":10,"up_from":22,"seq":94489280530,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":52288,"kb_used_data":21164,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94319552,"statfs":{"total":96636764160,"available":96583221248,"internally_reserved":0,"allocated":21671936,"data_stored":32720368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1599,"internal_metadata":31848897},"hb_peers":[1,6,7,8,9,11,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81899999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.371}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.117}]},{"osd":6,"last update":"Thu Apr 18 14:44:20 2024","interfaces":[{"interface":"back","average":{"1min":1.1830000000000001,"5min":1.1830000000000001,"15min":1.1830000000000001},"min":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"max":{"1min":3.9830000000000001,"5min":3.9830000000000001,"15min":3.9830000000000001},"last":0.39200000000000002},{"interface":"front","average":{"1min":1.0309999999999999,"5min":1.0309999999999999,"15min":1.0309999999999999},"min":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"max":{"1min":2.9420000000000002,"5min":2.9420000000000002,"15min":2.9420000000000002},"last":0.36099999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60799999999999998}]},{"osd":8,"last update":"Thu Apr 18 14:44:20 2024","interfaces":[{"interface":"back","average":{"1min":1.091,"5min":1.091,"15min":1.091},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":4.0439999999999996,"5min":4.0439999999999996,"15min":4.0439999999999996},"last":0.66800000000000004},{"interface":"front","average":{"1min":1.4390000000000001,"5min":1.4390000000000001,"15min":1.4390000000000001},"min":{"1min":0.89500000000000002,"5min":0.89500000000000002,"15min":0.89500000000000002},"max":{"1min":4.4900000000000002,"5min":4.4900000000000002,"15min":4.4900000000000002},"last":0.63400000000000001}]},{"osd":9,"last update":"Thu Apr 18 14:44:20 2024","interfaces":[{"interface":"back","average":{"1min":1.3580000000000001,"5min":1.3580000000000001,"15min":1.3580000000000001},"min":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"max":{"1min":3.8439999999999999,"5min":3.8439999999999999,"15min":3.8439999999999999},"last":0.56499999999999995},{"interface":"front","average":{"1min":1.361,"5min":1.361,"15min":1.361},"min":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"max":{"1min":4.2880000000000003,"5min":4.2880000000000003,"15min":4.2880000000000003},"last":0.70199999999999996}]},{"osd":11,"last update":"Thu Apr 18 14:44:20 2024","interfaces":[{"interface":"back","average":{"1min":1.4159999999999999,"5min":1.4159999999999999,"15min":1.4159999999999999},"min":{"1min":0.755,"5min":0.755,"15min":0.755},"max":{"1min":4.3399999999999999,"5min":4.3399999999999999,"15min":4.3399999999999999},"last":0.74399999999999999},{"interface":"front","average":{"1min":1.5740000000000001,"5min":1.5740000000000001,"15min":1.5740000000000001},"min":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"max":{"1min":4.4450000000000003,"5min":4.4450000000000003,"15min":4.4450000000000003},"last":0.72499999999999998}]},{"osd":12,"last update":"Thu Apr 18 14:44:20 2024","interfaces":[{"interface":"back","average":{"1min":1.3440000000000001,"5min":1.3440000000000001,"15min":1.3440000000000001},"min":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"max":{"1min":3.5539999999999998,"5min":3.5539999999999998,"15min":3.5539999999999998},"last":0.68700000000000006},{"interface":"front","average":{"1min":1.431,"5min":1.431,"15min":1.431},"min":{"1min":0.621,"5min":0.621,"15min":0.621},"max":{"1min":4.125,"5min":4.125,"15min":4.125},"last":0.61899999999999999}]},{"osd":13,"last update":"Thu Apr 18 14:44:20 2024","interfaces":[{"interface":"back","average":{"1min":1.71,"5min":1.71,"15min":1.71},"min":{"1min":1.1160000000000001,"5min":1.1160000000000001,"15min":1.1160000000000001},"max":{"1min":4.5359999999999996,"5min":4.5359999999999996,"15min":4.5359999999999996},"last":0.77100000000000002},{"interface":"front","average":{"1min":1.5429999999999999,"5min":1.5429999999999999,"15min":1.5429999999999999},"min":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.85599999999999998},"max":{"1min":4.0049999999999999,"5min":4.0049999999999999,"15min":4.0049999999999999},"last":0.755}]},{"osd":14,"last update":"Thu Apr 18 14:44:20 2024","interfaces":[{"interface":"back","average":{"1min":1.7090000000000001,"5min":1.7090000000000001,"15min":1.7090000000000001},"min":{"1min":1.073,"5min":1.073,"15min":1.073},"max":{"1min":4.3940000000000001,"5min":4.3940000000000001,"15min":4.3940000000000001},"last":0.5},{"interface":"front","average":{"1min":1.5680000000000001,"5min":1.5680000000000001,"15min":1.5680000000000001},"min":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"max":{"1min":3.73,"5min":3.73,"15min":3.73},"last":0.53800000000000003}]},{"osd":15,"last update":"Thu Apr 18 14:44:20 2024","interfaces":[{"interface":"back","average":{"1min":1.5629999999999999,"5min":1.5629999999999999,"15min":1.5629999999999999},"min":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":0.94999999999999996},"max":{"1min":4.1959999999999997,"5min":4.1959999999999997,"15min":4.1959999999999997},"last":0.78600000000000003},{"interface":"front","average":{"1min":1.802,"5min":1.802,"15min":1.802},"min":{"1min":1.1579999999999999,"5min":1.1579999999999999,"15min":1.1579999999999999},"max":{"1min":4.577,"5min":4.577,"15min":4.577},"last":0.80600000000000005}]}]},{"osd":11,"up_from":22,"seq":94489280530,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51704,"kb_used_data":20584,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94320136,"statfs":{"total":96636764160,"available":96583819264,"internally_reserved":0,"allocated":21078016,"data_stored":36920841,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31848901},"hb_peers":[2,4,5,6,8,10,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":2,"last update":"Thu Apr 18 14:44:18 2024","interfaces":[{"interface":"back","average":{"1min":0.93899999999999995,"5min":0.93899999999999995,"15min":0.93899999999999995},"min":{"1min":0.503,"5min":0.503,"15min":0.503},"max":{"1min":1.367,"5min":1.367,"15min":1.367},"last":1.028},{"interface":"front","average":{"1min":1.0229999999999999,"5min":1.0229999999999999,"15min":1.0229999999999999},"min":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":2.863,"5min":2.863,"15min":2.863},"last":0.80900000000000005}]},{"osd":4,"last update":"Thu Apr 18 14:44:18 2024","interfaces":[{"interface":"back","average":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"min":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":1.1259999999999999,"5min":1.1259999999999999,"15min":1.1259999999999999},"last":1.1339999999999999},{"interface":"front","average":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.129,"5min":1.129,"15min":1.129},"last":0.92300000000000004}]},{"osd":5,"last update":"Thu Apr 18 14:44:23 2024","interfaces":[{"interface":"back","average":{"1min":0.98999999999999999,"5min":0.98999999999999999,"15min":0.98999999999999999},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":1.5840000000000001,"5min":1.5840000000000001,"15min":1.5840000000000001},"last":1.2569999999999999},{"interface":"front","average":{"1min":0.97199999999999998,"5min":0.97199999999999998,"15min":0.97199999999999998},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.619,"5min":1.619,"15min":1.619},"last":0.873}]},{"osd":6,"last update":"Thu Apr 18 14:44:18 2024","interfaces":[{"interface":"back","average":{"1min":1.1319999999999999,"5min":1.1319999999999999,"15min":1.1319999999999999},"min":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"max":{"1min":2.9199999999999999,"5min":2.9199999999999999,"15min":2.9199999999999999},"last":1.159},{"interface":"front","average":{"1min":1,"5min":1,"15min":1},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.9510000000000001,"5min":1.9510000000000001,"15min":1.9510000000000001},"last":0.76900000000000002}]},{"osd":8,"last update":"Thu Apr 18 14:44:23 2024","interfaces":[{"interface":"back","average":{"1min":0.97799999999999998,"5min":0.97799999999999998,"15min":0.97799999999999998},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.452,"5min":1.452,"15min":1.452},"last":1.085},{"interface":"front","average":{"1min":1.006,"5min":1.006,"15min":1.006},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":1.383,"5min":1.383,"15min":1.383},"last":1.109}]},{"osd":10,"last update":"Thu Apr 18 14:44:18 2024","interfaces":[{"interface":"back","average":{"1min":1.234,"5min":1.234,"15min":1.234},"min":{"1min":0.745,"5min":0.745,"15min":0.745},"max":{"1min":2.774,"5min":2.774,"15min":2.774},"last":0.622},{"interface":"front","average":{"1min":1.105,"5min":1.105,"15min":1.105},"min":{"1min":0.627,"5min":0.627,"15min":0.627},"max":{"1min":1.6890000000000001,"5min":1.6890000000000001,"15min":1.6890000000000001},"last":0.94799999999999995}]},{"osd":12,"last update":"Thu Apr 18 14:44:18 2024","interfaces":[{"interface":"back","average":{"1min":1.1639999999999999,"5min":1.1639999999999999,"15min":1.1639999999999999},"min":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.6719999999999999,"5min":1.6719999999999999,"15min":1.6719999999999999},"last":0.83799999999999997},{"interface":"front","average":{"1min":1.2729999999999999,"5min":1.2729999999999999,"15min":1.2729999999999999},"min":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"max":{"1min":3.4169999999999998,"5min":3.4169999999999998,"15min":3.4169999999999998},"last":1.0569999999999999}]},{"osd":13,"last update":"Thu Apr 18 14:44:23 2024","interfaces":[{"interface":"back","average":{"1min":1.367,"5min":1.367,"15min":1.367},"min":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"max":{"1min":3.3239999999999998,"5min":3.3239999999999998,"15min":3.3239999999999998},"last":0.98499999999999999},{"interface":"front","average":{"1min":1.1639999999999999,"5min":1.1639999999999999,"15min":1.1639999999999999},"min":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"max":{"1min":1.746,"5min":1.746,"15min":1.746},"last":1.004}]},{"osd":14,"last update":"Thu Apr 18 14:44:18 2024","interfaces":[{"interface":"back","average":{"1min":1.1950000000000001,"5min":1.1950000000000001,"15min":1.1950000000000001},"min":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"max":{"1min":1.6619999999999999,"5min":1.6619999999999999,"15min":1.6619999999999999},"last":0.90400000000000003},{"interface":"front","average":{"1min":1.2450000000000001,"5min":1.2450000000000001,"15min":1.2450000000000001},"min":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"max":{"1min":1.7210000000000001,"5min":1.7210000000000001,"15min":1.7210000000000001},"last":1.1919999999999999}]},{"osd":15,"last update":"Thu Apr 18 14:44:23 2024","interfaces":[{"interface":"back","average":{"1min":1.284,"5min":1.284,"15min":1.284},"min":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"max":{"1min":1.851,"5min":1.851,"15min":1.851},"last":1.3049999999999999},{"interface":"front","average":{"1min":1.409,"5min":1.409,"15min":1.409},"min":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"max":{"1min":3.3769999999999998,"5min":3.3769999999999998,"15min":3.3769999999999998},"last":1.238}]}]},{"osd":12,"up_from":22,"seq":94489280530,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":48796,"kb_used_data":17680,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94323044,"statfs":{"total":96636764160,"available":96586797056,"internally_reserved":0,"allocated":18104320,"data_stored":28806665,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,3,4,5,6,10,11,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.621}]},{"osd":1,"last update":"Thu Apr 18 14:44:20 2024","interfaces":[{"interface":"back","average":{"1min":0.93999999999999995,"5min":0.93999999999999995,"15min":0.93999999999999995},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.5449999999999999,"5min":1.5449999999999999,"15min":1.5449999999999999},"last":0.76200000000000001},{"interface":"front","average":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":1.2649999999999999,"5min":1.2649999999999999,"15min":1.2649999999999999},"last":0.74399999999999999}]},{"osd":3,"last update":"Thu Apr 18 14:44:20 2024","interfaces":[{"interface":"back","average":{"1min":0.93999999999999995,"5min":0.93999999999999995,"15min":0.93999999999999995},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":1.4930000000000001,"5min":1.4930000000000001,"15min":1.4930000000000001},"last":0.81499999999999995},{"interface":"front","average":{"1min":0.91500000000000004,"5min":0.91500000000000004,"15min":0.91500000000000004},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.4319999999999999,"5min":1.4319999999999999,"15min":1.4319999999999999},"last":0.79500000000000004}]},{"osd":4,"last update":"Thu Apr 18 14:44:20 2024","interfaces":[{"interface":"back","average":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":1.383,"5min":1.383,"15min":1.383},"last":0.72299999999999998},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":1.335,"5min":1.335,"15min":1.335},"last":0.64200000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78200000000000003}]},{"osd":6,"last update":"Thu Apr 18 14:44:20 2024","interfaces":[{"interface":"back","average":{"1min":1.0289999999999999,"5min":1.0289999999999999,"15min":1.0289999999999999},"min":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":1.6060000000000001,"5min":1.6060000000000001,"15min":1.6060000000000001},"last":1.127},{"interface":"front","average":{"1min":1.0820000000000001,"5min":1.0820000000000001,"15min":1.0820000000000001},"min":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"max":{"1min":1.5620000000000001,"5min":1.5620000000000001,"15min":1.5620000000000001},"last":1.054}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1539999999999999}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4119999999999999}]},{"osd":10,"last update":"Thu Apr 18 14:44:20 2024","interfaces":[{"interface":"back","average":{"1min":1.137,"5min":1.137,"15min":1.137},"min":{"1min":0.626,"5min":0.626,"15min":0.626},"max":{"1min":1.6919999999999999,"5min":1.6919999999999999,"15min":1.6919999999999999},"last":1.202},{"interface":"front","average":{"1min":1.1100000000000001,"5min":1.1100000000000001,"15min":1.1100000000000001},"min":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"max":{"1min":1.8899999999999999,"5min":1.8899999999999999,"15min":1.8899999999999999},"last":1.0700000000000001}]},{"osd":11,"last update":"Thu Apr 18 14:44:20 2024","interfaces":[{"interface":"back","average":{"1min":1.1890000000000001,"5min":1.1890000000000001,"15min":1.1890000000000001},"min":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"max":{"1min":2.04,"5min":2.04,"15min":2.04},"last":1.0009999999999999},{"interface":"front","average":{"1min":1.1599999999999999,"5min":1.1599999999999999,"15min":1.1599999999999999},"min":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"max":{"1min":1.8660000000000001,"5min":1.8660000000000001,"15min":1.8660000000000001},"last":1.083}]},{"osd":13,"last update":"Thu Apr 18 14:44:20 2024","interfaces":[{"interface":"back","average":{"1min":1.181,"5min":1.181,"15min":1.181},"min":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"max":{"1min":1.8080000000000001,"5min":1.8080000000000001,"15min":1.8080000000000001},"last":1.014},{"interface":"front","average":{"1min":1.228,"5min":1.228,"15min":1.228},"min":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"max":{"1min":2.133,"5min":2.133,"15min":2.133},"last":0.91100000000000003}]},{"osd":14,"last update":"Thu Apr 18 14:44:20 2024","interfaces":[{"interface":"back","average":{"1min":1.226,"5min":1.226,"15min":1.226},"min":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"max":{"1min":1.7410000000000001,"5min":1.7410000000000001,"15min":1.7410000000000001},"last":0.94399999999999995},{"interface":"front","average":{"1min":1.232,"5min":1.232,"15min":1.232},"min":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"max":{"1min":1.966,"5min":1.966,"15min":1.966},"last":1.0389999999999999}]},{"osd":15,"last update":"Thu Apr 18 14:44:20 2024","interfaces":[{"interface":"back","average":{"1min":1.2190000000000001,"5min":1.2190000000000001,"15min":1.2190000000000001},"min":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"max":{"1min":1.802,"5min":1.802,"15min":1.802},"last":0.98299999999999998},{"interface":"front","average":{"1min":1.2889999999999999,"5min":1.2889999999999999,"15min":1.2889999999999999},"min":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"max":{"1min":1.8580000000000001,"5min":1.8580000000000001,"15min":1.8580000000000001},"last":1.101}]}]},{"osd":0,"up_from":23,"seq":98784247825,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":46328,"kb_used_data":15212,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94325512,"statfs":{"total":96636764160,"available":96589324288,"internally_reserved":0,"allocated":15577088,"data_stored":20514406,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[1,4,6,7,8,10,11,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Apr 18 14:44:23 2024","interfaces":[{"interface":"back","average":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":1.218,"5min":1.218,"15min":1.218},"last":0.71199999999999997},{"interface":"front","average":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.47,"5min":1.47,"15min":1.47},"last":0.82799999999999996}]},{"osd":4,"last update":"Thu Apr 18 14:44:19 2024","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":1.5409999999999999,"5min":1.5409999999999999,"15min":1.5409999999999999},"last":0.46899999999999997},{"interface":"front","average":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":1.903,"5min":1.903,"15min":1.903},"last":0.34999999999999998}]},{"osd":6,"last update":"Thu Apr 18 14:44:19 2024","interfaces":[{"interface":"back","average":{"1min":0.90200000000000002,"5min":0.90200000000000002,"15min":0.90200000000000002},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":2.5009999999999999,"5min":2.5009999999999999,"15min":2.5009999999999999},"last":0.63500000000000001},{"interface":"front","average":{"1min":0.89500000000000002,"5min":0.89500000000000002,"15min":0.89500000000000002},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":1.6240000000000001,"5min":1.6240000000000001,"15min":1.6240000000000001},"last":0.66700000000000004}]},{"osd":7,"last update":"Thu Apr 18 14:44:19 2024","interfaces":[{"interface":"back","average":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":1.2350000000000001,"5min":1.2350000000000001,"15min":1.2350000000000001},"last":0.54700000000000004},{"interface":"front","average":{"1min":0.93899999999999995,"5min":0.93899999999999995,"15min":0.93899999999999995},"min":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"max":{"1min":1.5860000000000001,"5min":1.5860000000000001,"15min":1.5860000000000001},"last":0.79900000000000004}]},{"osd":8,"last update":"Thu Apr 18 14:44:19 2024","interfaces":[{"interface":"back","average":{"1min":1.734,"5min":1.734,"15min":1.734},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":18.015999999999998,"5min":18.015999999999998,"15min":18.015999999999998},"last":0.436},{"interface":"front","average":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":1.6599999999999999,"5min":1.6599999999999999,"15min":1.6599999999999999},"last":0.45000000000000001}]},{"osd":10,"last update":"Thu Apr 18 14:44:19 2024","interfaces":[{"interface":"back","average":{"1min":1.0960000000000001,"5min":1.0960000000000001,"15min":1.0960000000000001},"min":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"max":{"1min":2.1339999999999999,"5min":2.1339999999999999,"15min":2.1339999999999999},"last":0.85499999999999998},{"interface":"front","average":{"1min":1.119,"5min":1.119,"15min":1.119},"min":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"max":{"1min":1.8540000000000001,"5min":1.8540000000000001,"15min":1.8540000000000001},"last":0.749}]},{"osd":11,"last update":"Thu Apr 18 14:44:19 2024","interfaces":[{"interface":"back","average":{"1min":2.9990000000000001,"5min":2.9990000000000001,"15min":2.9990000000000001},"min":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":41.195999999999998,"5min":41.195999999999998,"15min":41.195999999999998},"last":0.77900000000000003},{"interface":"front","average":{"1min":3.1339999999999999,"5min":3.1339999999999999,"15min":3.1339999999999999},"min":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"max":{"1min":41.216999999999999,"5min":41.216999999999999,"15min":41.216999999999999},"last":0.88}]},{"osd":13,"last update":"Thu Apr 18 14:44:23 2024","interfaces":[{"interface":"back","average":{"1min":0.95099999999999996,"5min":0.95099999999999996,"15min":0.95099999999999996},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":1.881,"5min":1.881,"15min":1.881},"last":0.65500000000000003},{"interface":"front","average":{"1min":1.091,"5min":1.091,"15min":1.091},"min":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":1.8720000000000001,"5min":1.8720000000000001,"15min":1.8720000000000001},"last":0.67600000000000005}]},{"osd":14,"last update":"Thu Apr 18 14:44:19 2024","interfaces":[{"interface":"back","average":{"1min":1.103,"5min":1.103,"15min":1.103},"min":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"max":{"1min":1.95,"5min":1.95,"15min":1.95},"last":0.69899999999999995},{"interface":"front","average":{"1min":1.095,"5min":1.095,"15min":1.095},"min":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"max":{"1min":2.1219999999999999,"5min":2.1219999999999999,"15min":2.1219999999999999},"last":0.59199999999999997}]},{"osd":15,"last update":"Thu Apr 18 14:44:19 2024","interfaces":[{"interface":"back","average":{"1min":1.224,"5min":1.224,"15min":1.224},"min":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"max":{"1min":1.929,"5min":1.929,"15min":1.929},"last":0.73699999999999999},{"interface":"front","average":{"1min":1.179,"5min":1.179,"15min":1.179},"min":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":2.056,"5min":2.056,"15min":2.056},"last":0.78900000000000003}]}]},{"osd":3,"up_from":23,"seq":98784247824,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41424,"kb_used_data":10312,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94330416,"statfs":{"total":96636764160,"available":96594345984,"internally_reserved":0,"allocated":10559488,"data_stored":16445429,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31848904},"hb_peers":[0,1,2,4,5,7,8,9,10,11,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Apr 18 14:44:20 2024","interfaces":[{"interface":"back","average":{"1min":0.88200000000000001,"5min":0.88200000000000001,"15min":0.88200000000000001},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":1.4510000000000001,"5min":1.4510000000000001,"15min":1.4510000000000001},"last":0.79900000000000004},{"interface":"front","average":{"1min":1,"5min":1,"15min":1},"min":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"max":{"1min":1.4850000000000001,"5min":1.4850000000000001,"15min":1.4850000000000001},"last":0.75600000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85499999999999998}]},{"osd":2,"last update":"Thu Apr 18 14:44:20 2024","interfaces":[{"interface":"back","average":{"1min":0.98599999999999999,"5min":0.98599999999999999,"15min":0.98599999999999999},"min":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.5469999999999999,"5min":1.5469999999999999,"15min":1.5469999999999999},"last":1.2509999999999999},{"interface":"front","average":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":0.94999999999999996},"min":{"1min":0.623,"5min":0.623,"15min":0.623},"max":{"1min":1.425,"5min":1.425,"15min":1.425},"last":1.1080000000000001}]},{"osd":4,"last update":"Thu Apr 18 14:44:20 2024","interfaces":[{"interface":"back","average":{"1min":1.008,"5min":1.008,"15min":1.008},"min":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.7030000000000001,"5min":1.7030000000000001,"15min":1.7030000000000001},"last":0.98299999999999998},{"interface":"front","average":{"1min":0.98699999999999999,"5min":0.98699999999999999,"15min":0.98699999999999999},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":1.5309999999999999,"5min":1.5309999999999999,"15min":1.5309999999999999},"last":1.1759999999999999}]},{"osd":5,"last update":"Thu Apr 18 14:44:20 2024","interfaces":[{"interface":"back","average":{"1min":1.087,"5min":1.087,"15min":1.087},"min":{"1min":0.624,"5min":0.624,"15min":0.624},"max":{"1min":1.663,"5min":1.663,"15min":1.663},"last":1.216},{"interface":"front","average":{"1min":1.206,"5min":1.206,"15min":1.206},"min":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":1.6779999999999999,"5min":1.6779999999999999,"15min":1.6779999999999999},"last":1.1419999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.472}]},{"osd":7,"last update":"Thu Apr 18 14:44:20 2024","interfaces":[{"interface":"back","average":{"1min":1.157,"5min":1.157,"15min":1.157},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.645,"5min":1.645,"15min":1.645},"last":1.0660000000000001},{"interface":"front","average":{"1min":1.115,"5min":1.115,"15min":1.115},"min":{"1min":0.503,"5min":0.503,"15min":0.503},"max":{"1min":1.6419999999999999,"5min":1.6419999999999999,"15min":1.6419999999999999},"last":1.2989999999999999}]},{"osd":8,"last update":"Thu Apr 18 14:44:20 2024","interfaces":[{"interface":"back","average":{"1min":1.1339999999999999,"5min":1.1339999999999999,"15min":1.1339999999999999},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.7529999999999999,"5min":1.7529999999999999,"15min":1.7529999999999999},"last":1.319},{"interface":"front","average":{"1min":1.304,"5min":1.304,"15min":1.304},"min":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"max":{"1min":1.7430000000000001,"5min":1.7430000000000001,"15min":1.7430000000000001},"last":1.2749999999999999}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.341}]},{"osd":10,"last update":"Thu Apr 18 14:44:20 2024","interfaces":[{"interface":"back","average":{"1min":1.327,"5min":1.327,"15min":1.327},"min":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"max":{"1min":1.883,"5min":1.883,"15min":1.883},"last":1.401},{"interface":"front","average":{"1min":1.3660000000000001,"5min":1.3660000000000001,"15min":1.3660000000000001},"min":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"max":{"1min":2.161,"5min":2.161,"15min":2.161},"last":1.377}]},{"osd":11,"last update":"Thu Apr 18 14:44:20 2024","interfaces":[{"interface":"back","average":{"1min":1.4330000000000001,"5min":1.4330000000000001,"15min":1.4330000000000001},"min":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"max":{"1min":1.8959999999999999,"5min":1.8959999999999999,"15min":1.8959999999999999},"last":1.361},{"interface":"front","average":{"1min":1.381,"5min":1.381,"15min":1.381},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":2.1160000000000001,"5min":2.1160000000000001,"15min":2.1160000000000001},"last":1.484}]},{"osd":12,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.8740000000000001}]},{"osd":14,"last update":"Thu Apr 18 14:44:20 2024","interfaces":[{"interface":"back","average":{"1min":1.512,"5min":1.512,"15min":1.512},"min":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":0.94999999999999996},"max":{"1min":2.2879999999999998,"5min":2.2879999999999998,"15min":2.2879999999999998},"last":1.4419999999999999},{"interface":"front","average":{"1min":1.4139999999999999,"5min":1.4139999999999999,"15min":1.4139999999999999},"min":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"max":{"1min":2.0179999999999998,"5min":2.0179999999999998,"15min":2.0179999999999998},"last":1.464}]},{"osd":15,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.51}]}]},{"osd":7,"up_from":23,"seq":98784247826,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":43644,"kb_used_data":12524,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94328196,"statfs":{"total":96636764160,"available":96592072704,"internally_reserved":0,"allocated":12824576,"data_stored":19612742,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":31848907},"hb_peers":[0,2,3,4,5,6,8,10,12,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65900000000000003}]},{"osd":2,"last update":"Thu Apr 18 14:44:21 2024","interfaces":[{"interface":"back","average":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"min":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":1.1519999999999999,"5min":1.1519999999999999,"15min":1.1519999999999999},"last":1.081},{"interface":"front","average":{"1min":0.97599999999999998,"5min":0.97599999999999998,"15min":0.97599999999999998},"min":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"max":{"1min":1.891,"5min":1.891,"15min":1.891},"last":0.77700000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1379999999999999}]},{"osd":4,"last update":"Thu Apr 18 14:44:21 2024","interfaces":[{"interface":"back","average":{"1min":0.95699999999999996,"5min":0.95699999999999996,"15min":0.95699999999999996},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.258,"5min":1.258,"15min":1.258},"last":1.0129999999999999},{"interface":"front","average":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":1.2170000000000001,"5min":1.2170000000000001,"15min":1.2170000000000001},"last":0.81399999999999995}]},{"osd":5,"last update":"Thu Apr 18 14:44:21 2024","interfaces":[{"interface":"back","average":{"1min":1.1140000000000001,"5min":1.1140000000000001,"15min":1.1140000000000001},"min":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"max":{"1min":1.8580000000000001,"5min":1.8580000000000001,"15min":1.8580000000000001},"last":0.85899999999999999},{"interface":"front","average":{"1min":1.1120000000000001,"5min":1.1120000000000001,"15min":1.1120000000000001},"min":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"max":{"1min":1.53,"5min":1.53,"15min":1.53},"last":1.2569999999999999}]},{"osd":6,"last update":"Thu Apr 18 14:44:21 2024","interfaces":[{"interface":"back","average":{"1min":1.139,"5min":1.139,"15min":1.139},"min":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"max":{"1min":1.8759999999999999,"5min":1.8759999999999999,"15min":1.8759999999999999},"last":1.05},{"interface":"front","average":{"1min":1.171,"5min":1.171,"15min":1.171},"min":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"max":{"1min":1.4570000000000001,"5min":1.4570000000000001,"15min":1.4570000000000001},"last":1.466}]},{"osd":8,"last update":"Thu Apr 18 14:44:21 2024","interfaces":[{"interface":"back","average":{"1min":1.095,"5min":1.095,"15min":1.095},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":1.4159999999999999,"5min":1.4159999999999999,"15min":1.4159999999999999},"last":0.96999999999999997},{"interface":"front","average":{"1min":1.274,"5min":1.274,"15min":1.274},"min":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"max":{"1min":1.821,"5min":1.821,"15min":1.821},"last":0.90900000000000003}]},{"osd":10,"last update":"Thu Apr 18 14:44:21 2024","interfaces":[{"interface":"back","average":{"1min":1.151,"5min":1.151,"15min":1.151},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.831,"5min":1.831,"15min":1.831},"last":1.181},{"interface":"front","average":{"1min":1.278,"5min":1.278,"15min":1.278},"min":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"max":{"1min":1.53,"5min":1.53,"15min":1.53},"last":1.3340000000000001}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71699999999999997}]},{"osd":12,"last update":"Thu Apr 18 14:44:21 2024","interfaces":[{"interface":"back","average":{"1min":1.2270000000000001,"5min":1.2270000000000001,"15min":1.2270000000000001},"min":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.7549999999999999,"5min":1.7549999999999999,"15min":1.7549999999999999},"last":1.29},{"interface":"front","average":{"1min":1.4039999999999999,"5min":1.4039999999999999,"15min":1.4039999999999999},"min":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"max":{"1min":2.0960000000000001,"5min":2.0960000000000001,"15min":2.0960000000000001},"last":0.93999999999999995}]},{"osd":14,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3819999999999999}]},{"osd":15,"last update":"Thu Apr 18 14:44:21 2024","interfaces":[{"interface":"back","average":{"1min":1.4330000000000001,"5min":1.4330000000000001,"15min":1.4330000000000001},"min":{"1min":0.874,"5min":0.874,"15min":0.874},"max":{"1min":2.6699999999999999,"5min":2.6699999999999999,"15min":2.6699999999999999},"last":1.115},{"interface":"front","average":{"1min":1.401,"5min":1.401,"15min":1.401},"min":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":2.516,"5min":2.516,"15min":2.516},"last":1.401}]}]},{"osd":8,"up_from":23,"seq":98784247826,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":43840,"kb_used_data":12724,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94328000,"statfs":{"total":96636764160,"available":96591872000,"internally_reserved":0,"allocated":13029376,"data_stored":20651177,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,2,3,5,7,9,11,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52900000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0229999999999999}]},{"osd":2,"last update":"Thu Apr 18 14:44:22 2024","interfaces":[{"interface":"back","average":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":1.1339999999999999,"5min":1.1339999999999999,"15min":1.1339999999999999},"last":1.0580000000000001},{"interface":"front","average":{"1min":0.996,"5min":0.996,"15min":0.996},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":2.54,"5min":2.54,"15min":2.54},"last":0.76900000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97999999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1080000000000001}]},{"osd":5,"last update":"Thu Apr 18 14:44:22 2024","interfaces":[{"interface":"back","average":{"1min":1.0549999999999999,"5min":1.0549999999999999,"15min":1.0549999999999999},"min":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":2.7810000000000001,"5min":2.7810000000000001,"15min":2.7810000000000001},"last":0.73999999999999999},{"interface":"front","average":{"1min":0.91800000000000004,"5min":0.91800000000000004,"15min":0.91800000000000004},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.5309999999999999,"5min":1.5309999999999999,"15min":1.5309999999999999},"last":0.70799999999999996}]},{"osd":7,"last update":"Thu Apr 18 14:44:22 2024","interfaces":[{"interface":"back","average":{"1min":1.042,"5min":1.042,"15min":1.042},"min":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":1.925,"5min":1.925,"15min":1.925},"last":0.92800000000000005},{"interface":"front","average":{"1min":1.0800000000000001,"5min":1.0800000000000001,"15min":1.0800000000000001},"min":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"max":{"1min":1.669,"5min":1.669,"15min":1.669},"last":1.25}]},{"osd":9,"last update":"Thu Apr 18 14:44:22 2024","interfaces":[{"interface":"back","average":{"1min":1.0249999999999999,"5min":1.0249999999999999,"15min":1.0249999999999999},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":1.6479999999999999,"5min":1.6479999999999999,"15min":1.6479999999999999},"last":1.214},{"interface":"front","average":{"1min":1.163,"5min":1.163,"15min":1.163},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":2.9319999999999999,"5min":2.9319999999999999,"15min":2.9319999999999999},"last":0.66500000000000004}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.665}]},{"osd":11,"last update":"Thu Apr 18 14:44:22 2024","interfaces":[{"interface":"back","average":{"1min":1.206,"5min":1.206,"15min":1.206},"min":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"max":{"1min":2.1139999999999999,"5min":2.1139999999999999,"15min":2.1139999999999999},"last":0.79400000000000004},{"interface":"front","average":{"1min":1.2929999999999999,"5min":1.2929999999999999,"15min":1.2929999999999999},"min":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"max":{"1min":2.25,"5min":2.25,"15min":2.25},"last":1.105}]},{"osd":12,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5629999999999999}]},{"osd":14,"last update":"Thu Apr 18 14:44:22 2024","interfaces":[{"interface":"back","average":{"1min":1.341,"5min":1.341,"15min":1.341},"min":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"max":{"1min":2.5800000000000001,"5min":2.5800000000000001,"15min":2.5800000000000001},"last":1.143},{"interface":"front","average":{"1min":1.3919999999999999,"5min":1.3919999999999999,"15min":1.3919999999999999},"min":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"max":{"1min":3.0739999999999998,"5min":3.0739999999999998,"15min":3.0739999999999998},"last":0.82999999999999996}]},{"osd":15,"last update":"Thu Apr 18 14:44:22 2024","interfaces":[{"interface":"back","average":{"1min":1.355,"5min":1.355,"15min":1.355},"min":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"max":{"1min":2.4740000000000002,"5min":2.4740000000000002,"15min":2.4740000000000002},"last":1.179},{"interface":"front","average":{"1min":1.4159999999999999,"5min":1.4159999999999999,"15min":1.4159999999999999},"min":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"max":{"1min":2.8620000000000001,"5min":2.8620000000000001,"15min":2.8620000000000001},"last":0.86699999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":13,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":12,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":13,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":14,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":15,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":14475264,"data_stored":21237760,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":31432704,"data_stored":42668032,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12296192,"data_stored":18427904,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":9355264,"data_stored":15753216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":21028864,"data_stored":36835328,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":13004800,"data_stored":20766720,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":23670784,"data_stored":35631104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":12980224,"data_stored":21315584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":11829248,"data_stored":19959808,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":18952192,"data_stored":30834688,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":21565440,"data_stored":33140736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":20955136,"data_stored":37330944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":12,"total":0,"available":0,"internally_reserved":0,"allocated":16838656,"data_stored":28073984,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":13,"total":0,"available":0,"internally_reserved":0,"allocated":11530240,"data_stored":18210816,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":14,"total":0,"available":0,"internally_reserved":0,"allocated":27975680,"data_stored":44306432,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":15,"total":0,"available":0,"internally_reserved":0,"allocated":22319104,"data_stored":35733504,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-18T14:44:29.313 INFO:tasks.ceph.osd.8.smithi086.stderr:2024-04-18T14:44:29.309+0000 7f29f7b9d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 8 (PID: 24958) UID: 0 2024-04-18T14:44:29.331 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-04-18T14:44:29.331 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T14:44:29.346 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-18T14:44:29.382 INFO:teuthology.orchestra.run.smithi086.stderr:set pool 3 pg_num to 26 2024-04-18T14:44:29.404 INFO:tasks.ceph.ceph_manager.ceph:removing pool_name unique_pool_0 2024-04-18T14:44:29.404 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm unique_pool_0 unique_pool_0 --yes-i-really-really-mean-it 2024-04-18T14:44:29.413 INFO:tasks.ceph.osd.9.smithi096.stderr:2024-04-18T14:44:29.413+0000 7fa2c1cbf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 9 (PID: 24891) UID: 0 2024-04-18T14:44:29.475 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-04-18T14:44:29.476 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T14:44:29.490 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-18T14:44:29.514 INFO:tasks.ceph.osd.6.smithi119.stderr:2024-04-18T14:44:29.514+0000 7fb7cb8bd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 24896) UID: 0 2024-04-18T14:44:29.516 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-04-18T14:44:29.615 INFO:tasks.ceph.osd.6.smithi119.stderr:2024-04-18T14:44:29.618+0000 7fb7cb8bd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 24896) UID: 0 2024-04-18T14:44:29.644 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-04-18T14:44:29.644 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T14:44:29.659 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-18T14:44:29.717 INFO:tasks.ceph.osd.7.smithi134.stderr:2024-04-18T14:44:29.719+0000 7fd7de549640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25213) UID: 0 2024-04-18T14:44:29.768 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-04-18T14:44:29.768 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T14:44:29.781 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-04-18T14:44:29.818 INFO:tasks.ceph.osd.10.smithi119.stderr:2024-04-18T14:44:29.818+0000 7f6f24c12640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 10 (PID: 24898) UID: 0 2024-04-18T14:44:29.886 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-04-18T14:44:29.886 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T14:44:29.899 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-04-18T14:44:29.947 INFO:tasks.ceph.osd.8.smithi086.stderr:2024-04-18T14:44:29.945+0000 7f29f7b9d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 8 (PID: 24958) UID: 0 2024-04-18T14:44:30.012 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-04-18T14:44:30.012 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T14:44:30.020 INFO:tasks.ceph.osd.14.smithi119.stderr:2024-04-18T14:44:30.022+0000 7f180f599640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 14 (PID: 24900) UID: 0 2024-04-18T14:44:30.025 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-04-18T14:44:30.121 INFO:tasks.ceph.osd.8.smithi086.stderr:2024-04-18T14:44:30.117+0000 7f29f7b9d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 8 (PID: 24958) UID: 0 2024-04-18T14:44:30.183 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-04-18T14:44:30.184 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T14:44:30.197 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.8.asok dump_ops_in_flight 2024-04-18T14:44:30.223 INFO:tasks.ceph.osd.15.smithi134.stderr:2024-04-18T14:44:30.227+0000 7f08e6a51640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 15 (PID: 25218) UID: 0 2024-04-18T14:44:30.311 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-18T14:44:30.324 INFO:tasks.ceph.osd.7.smithi134.stderr:2024-04-18T14:44:30.327+0000 7fd7de549640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25213) UID: 0 2024-04-18T14:44:30.356 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-04-18T14:44:30.356 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T14:44:30.370 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.8.asok dump_blocked_ops 2024-04-18T14:44:30.425 INFO:tasks.ceph.osd.10.smithi119.stderr:2024-04-18T14:44:30.426+0000 7f6f24c12640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 10 (PID: 24898) UID: 0 2024-04-18T14:44:30.440 INFO:teuthology.orchestra.run.smithi086.stdout:osd.0: {} 2024-04-18T14:44:30.440 INFO:teuthology.orchestra.run.smithi086.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-18T14:44:30.459 INFO:teuthology.orchestra.run.smithi086.stdout:osd.1: {} 2024-04-18T14:44:30.460 INFO:teuthology.orchestra.run.smithi086.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-18T14:44:30.478 INFO:teuthology.orchestra.run.smithi086.stdout:osd.2: {} 2024-04-18T14:44:30.479 INFO:teuthology.orchestra.run.smithi086.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-18T14:44:30.488 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-04-18T14:44:30.488 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T14:44:30.497 INFO:teuthology.orchestra.run.smithi086.stdout:osd.3: {} 2024-04-18T14:44:30.497 INFO:teuthology.orchestra.run.smithi086.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-18T14:44:30.501 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.8.asok dump_historic_ops 2024-04-18T14:44:30.512 INFO:teuthology.orchestra.run.smithi086.stderr:pool 'unique_pool_0' removed 2024-04-18T14:44:30.513 INFO:teuthology.orchestra.run.smithi086.stderr:nodeep-scrub is set 2024-04-18T14:44:30.514 INFO:teuthology.orchestra.run.smithi086.stdout:osd.4: {} 2024-04-18T14:44:30.514 INFO:teuthology.orchestra.run.smithi086.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-18T14:44:30.529 INFO:tasks.ceph.osd.9.smithi096.stderr:2024-04-18T14:44:30.529+0000 7fa2c1cbf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 9 (PID: 24891) UID: 0 2024-04-18T14:44:30.534 DEBUG:teuthology.run_tasks:Unwinding manager thrashosds 2024-04-18T14:44:30.542 INFO:tasks.thrashosds:joining thrashosds 2024-04-18T14:44:30.543 INFO:teuthology.orchestra.run.smithi086.stdout:osd.5: {} 2024-04-18T14:44:30.543 INFO:teuthology.orchestra.run.smithi086.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-18T14:44:30.557 INFO:teuthology.orchestra.run.smithi086.stdout:osd.6: {} 2024-04-18T14:44:30.558 INFO:teuthology.orchestra.run.smithi086.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-18T14:44:30.577 INFO:teuthology.orchestra.run.smithi086.stdout:osd.7: {} 2024-04-18T14:44:30.577 INFO:teuthology.orchestra.run.smithi086.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-18T14:44:30.592 INFO:teuthology.orchestra.run.smithi086.stdout:osd.8: {} 2024-04-18T14:44:30.592 INFO:teuthology.orchestra.run.smithi086.stderr:osd.8: osd_enable_op_tracker = '' 2024-04-18T14:44:30.612 INFO:teuthology.orchestra.run.smithi086.stdout:osd.9: {} 2024-04-18T14:44:30.612 INFO:teuthology.orchestra.run.smithi086.stderr:osd.9: osd_enable_op_tracker = '' 2024-04-18T14:44:30.625 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-04-18T14:44:30.625 INFO:teuthology.orchestra.run.smithi086.stdout: "size": 20, 2024-04-18T14:44:30.625 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 600, 2024-04-18T14:44:30.625 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [ 2024-04-18T14:44:30.625 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:30.625 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4559.0:306 3.es0 3:780bca72:::smithi13430248-6:head [append 0~770048] snapc d=[d,b,a,8,7,2] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-18T14:44:30.625 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-04-18T14:43:44.504007+0000", 2024-04-18T14:44:30.625 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 46.120867586999999, 2024-04-18T14:44:30.626 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.011648129, 2024-04-18T14:44:30.626 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-04-18T14:44:30.626 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T14:44:30.626 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-04-18T14:44:30.626 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4559", 2024-04-18T14:44:30.626 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.134:0/3113589487", 2024-04-18T14:44:30.626 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 306 2024-04-18T14:44:30.626 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:30.626 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-04-18T14:44:30.626 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:30.626 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-04-18T14:44:30.626 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:44.504007+0000", 2024-04-18T14:44:30.627 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:44:30.627 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:30.627 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:30.627 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-04-18T14:44:30.627 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:44.504007+0000", 2024-04-18T14:44:30.627 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:44:30.627 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:30.627 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:30.627 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-04-18T14:44:30.627 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:44.504004+0000", 2024-04-18T14:44:30.627 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999967 2024-04-18T14:44:30.627 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:30.627 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:30.627 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-04-18T14:44:30.627 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:44.505037+0000", 2024-04-18T14:44:30.628 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0010331030000000001 2024-04-18T14:44:30.628 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:30.628 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:30.628 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-04-18T14:44:30.628 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:44.505057+0000", 2024-04-18T14:44:30.628 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.0579999999999999e-05 2024-04-18T14:44:30.628 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:30.628 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:30.628 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-04-18T14:44:30.628 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:44.505066+0000", 2024-04-18T14:44:30.628 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.4349999999999997e-06 2024-04-18T14:44:30.628 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:30.628 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:30.628 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-04-18T14:44:30.628 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:44.505117+0000", 2024-04-18T14:44:30.629 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.0782999999999998e-05 2024-04-18T14:44:30.629 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:30.629 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:30.629 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-04-18T14:44:30.629 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:44.505215+0000", 2024-04-18T14:44:30.629 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.8090000000000004e-05 2024-04-18T14:44:30.629 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:30.629 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:30.629 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_started", 2024-04-18T14:44:30.629 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:44.506696+0000", 2024-04-18T14:44:30.629 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0014812429999999999 2024-04-18T14:44:30.629 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:30.629 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:30.629 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_committed", 2024-04-18T14:44:30.629 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:44.512780+0000", 2024-04-18T14:44:30.630 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0060844430000000001 2024-04-18T14:44:30.630 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:30.630 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:30.630 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-04-18T14:44:30.630 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:44.515586+0000", 2024-04-18T14:44:30.630 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.002805896 2024-04-18T14:44:30.630 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:30.630 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:30.630 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-04-18T14:44:30.630 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:44.515655+0000", 2024-04-18T14:44:30.630 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.8749000000000002e-05 2024-04-18T14:44:30.630 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:44:30.630 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-04-18T14:44:30.631 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:44:30.631 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:30.631 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:30.631 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4559.0:514 3.es0 3:77281ef4:::smithi13430248-3:head [copy-from ver 55] snapc 19=[19,16,14,13,11,f,b,a,7,2] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-18T14:44:30.631 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-04-18T14:43:56.576333+0000", 2024-04-18T14:44:30.631 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 34.048541825000001, 2024-04-18T14:44:30.631 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.020917282999999998, 2024-04-18T14:44:30.631 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-04-18T14:44:30.631 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T14:44:30.631 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-04-18T14:44:30.631 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4559", 2024-04-18T14:44:30.631 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.134:0/3113589487", 2024-04-18T14:44:30.631 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 514 2024-04-18T14:44:30.631 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:30.632 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-04-18T14:44:30.632 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:30.632 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-04-18T14:44:30.632 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:56.576333+0000", 2024-04-18T14:44:30.632 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:44:30.632 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:30.632 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:30.632 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-04-18T14:44:30.632 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:56.576333+0000", 2024-04-18T14:44:30.632 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:44:30.632 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:30.632 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:30.632 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-04-18T14:44:30.632 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:56.576330+0000", 2024-04-18T14:44:30.632 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999976 2024-04-18T14:44:30.633 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:30.633 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:30.633 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-04-18T14:44:30.633 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:56.576342+0000", 2024-04-18T14:44:30.633 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.1622e-05 2024-04-18T14:44:30.633 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:30.633 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:30.633 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-04-18T14:44:30.633 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:56.576359+0000", 2024-04-18T14:44:30.633 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.7234000000000001e-05 2024-04-18T14:44:30.633 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:30.633 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:30.633 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-04-18T14:44:30.633 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:56.576369+0000", 2024-04-18T14:44:30.634 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.3419999999999997e-06 2024-04-18T14:44:30.634 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:30.634 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:30.634 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-04-18T14:44:30.634 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:56.576440+0000", 2024-04-18T14:44:30.634 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.1693000000000006e-05 2024-04-18T14:44:30.634 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:30.634 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:30.634 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-04-18T14:44:30.634 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:56.576566+0000", 2024-04-18T14:44:30.634 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00012597699999999999 2024-04-18T14:44:30.634 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:30.634 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:30.634 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_started", 2024-04-18T14:44:30.635 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:56.585726+0000", 2024-04-18T14:44:30.635 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0091601249999999999 2024-04-18T14:44:30.635 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:30.635 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:30.635 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_committed", 2024-04-18T14:44:30.635 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:56.590557+0000", 2024-04-18T14:44:30.635 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0048303699999999996 2024-04-18T14:44:30.635 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:30.635 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:30.635 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-04-18T14:44:30.635 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:56.597131+0000", 2024-04-18T14:44:30.635 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0065739250000000004 2024-04-18T14:44:30.635 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:30.635 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:30.636 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-04-18T14:44:30.636 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:56.597250+0000", 2024-04-18T14:44:30.636 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0001194 2024-04-18T14:44:30.636 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:44:30.636 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-04-18T14:44:30.636 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:44:30.636 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:30.636 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:30.636 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4559.0:515 3.es0 3:77281ef4:::smithi13430248-3:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e57)", 2024-04-18T14:44:30.636 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-04-18T14:43:56.576386+0000", 2024-04-18T14:44:30.636 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 34.048488663000001, 2024-04-18T14:44:30.636 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.012420726999999999, 2024-04-18T14:44:30.636 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-04-18T14:44:30.636 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-04-18T14:44:30.636 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-04-18T14:44:30.637 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4559", 2024-04-18T14:44:30.637 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.134:0/3113589487", 2024-04-18T14:44:30.637 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 515 2024-04-18T14:44:30.637 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:30.637 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-04-18T14:44:30.637 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:30.637 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-04-18T14:44:30.637 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:56.576386+0000", 2024-04-18T14:44:30.637 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:44:30.637 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:30.637 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:30.637 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-04-18T14:44:30.637 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:56.576386+0000", 2024-04-18T14:44:30.638 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:44:30.638 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:30.638 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:30.638 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-04-18T14:44:30.638 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:56.576385+0000", 2024-04-18T14:44:30.638 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-04-18T14:44:30.638 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:30.638 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:30.638 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-04-18T14:44:30.638 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:56.576388+0000", 2024-04-18T14:44:30.638 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.0189999999999998e-06 2024-04-18T14:44:30.638 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:30.638 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:30.638 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-04-18T14:44:30.639 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:56.576395+0000", 2024-04-18T14:44:30.639 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.8199999999999999e-06 2024-04-18T14:44:30.639 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:30.639 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:30.639 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-04-18T14:44:30.639 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:56.576401+0000", 2024-04-18T14:44:30.639 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.964e-06 2024-04-18T14:44:30.639 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:30.639 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:30.639 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-04-18T14:44:30.639 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:56.576801+0000", 2024-04-18T14:44:30.639 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00040004199999999998 2024-04-18T14:44:30.639 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:30.640 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:30.640 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for blocked object", 2024-04-18T14:44:30.640 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:56.576891+0000", 2024-04-18T14:44:30.640 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.9529000000000003e-05 2024-04-18T14:44:30.640 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:30.640 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:30.640 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-04-18T14:44:30.640 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:56.588587+0000", 2024-04-18T14:44:30.640 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.011696592 2024-04-18T14:44:30.640 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:30.640 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:30.640 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-04-18T14:44:30.640 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:56.588693+0000", 2024-04-18T14:44:30.640 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000105945 2024-04-18T14:44:30.641 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:30.641 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:30.641 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-04-18T14:44:30.641 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:56.588807+0000", 2024-04-18T14:44:30.641 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000113269 2024-04-18T14:44:30.641 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:44:30.641 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-04-18T14:44:30.641 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:44:30.641 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:30.641 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:30.641 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "MOSDECSubOpWrite(3.7s1 63/30 ECSubWrite(tid=162, reqid=osd.14.0:162, at_version=63'70, trim_to=0'0, roll_forward_to=60'65))", 2024-04-18T14:44:30.641 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-04-18T14:44:02.387673+0000", 2024-04-18T14:44:30.641 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 28.237201351, 2024-04-18T14:44:30.641 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.011396827, 2024-04-18T14:44:30.642 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-04-18T14:44:30.642 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "reached pg", 2024-04-18T14:44:30.642 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-04-18T14:44:30.642 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:30.642 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-04-18T14:44:30.642 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:02.387673+0000", 2024-04-18T14:44:30.642 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:44:30.642 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:30.642 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:30.642 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-04-18T14:44:30.642 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:02.387673+0000", 2024-04-18T14:44:30.642 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:44:30.642 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:30.642 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:30.642 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-04-18T14:44:30.643 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:02.387672+0000", 2024-04-18T14:44:30.643 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-04-18T14:44:30.643 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:30.643 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:30.643 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-04-18T14:44:30.643 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:02.387691+0000", 2024-04-18T14:44:30.643 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.8215000000000001e-05 2024-04-18T14:44:30.643 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:30.643 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:30.643 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-04-18T14:44:30.643 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:02.387701+0000", 2024-04-18T14:44:30.643 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.8640000000000008e-06 2024-04-18T14:44:30.643 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:30.644 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:30.644 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-04-18T14:44:30.644 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:02.387707+0000", 2024-04-18T14:44:30.644 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.049e-06 2024-04-18T14:44:30.644 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:30.644 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:30.644 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-04-18T14:44:30.644 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:02.387752+0000", 2024-04-18T14:44:30.644 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.5510999999999998e-05 2024-04-18T14:44:30.644 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:30.644 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:30.644 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_started", 2024-04-18T14:44:30.644 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:02.387761+0000", 2024-04-18T14:44:30.644 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.4339999999999992e-06 2024-04-18T14:44:30.644 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:30.645 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:30.645 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_committed", 2024-04-18T14:44:30.645 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:02.399030+0000", 2024-04-18T14:44:30.645 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.011269713000000001 2024-04-18T14:44:30.645 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:30.645 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:30.645 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-04-18T14:44:30.645 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:02.399070+0000", 2024-04-18T14:44:30.645 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.9823000000000001e-05 2024-04-18T14:44:30.645 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:44:30.645 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-04-18T14:44:30.645 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:44:30.645 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:30.645 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:30.646 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4559.0:782 3.es0 3:77281ef4:::smithi13430248-3:head [copy-from ver 32] snapc 2b=[2b,2a,29,28,27,26,23,22,1e,1c,1a,16,14,13,11,2] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-18T14:44:30.646 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-04-18T14:44:15.392139+0000", 2024-04-18T14:44:30.646 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 15.232735262, 2024-04-18T14:44:30.646 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.046534005000000003, 2024-04-18T14:44:30.646 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-04-18T14:44:30.646 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T14:44:30.646 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-04-18T14:44:30.646 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4559", 2024-04-18T14:44:30.646 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.134:0/3113589487", 2024-04-18T14:44:30.646 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 782 2024-04-18T14:44:30.646 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:30.646 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-04-18T14:44:30.646 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:30.646 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-04-18T14:44:30.647 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:15.392139+0000", 2024-04-18T14:44:30.647 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:44:30.647 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:30.647 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:30.647 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-04-18T14:44:30.647 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:15.392139+0000", 2024-04-18T14:44:30.647 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:44:30.647 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:30.647 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:30.647 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-04-18T14:44:30.647 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:15.392137+0000", 2024-04-18T14:44:30.647 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999971 2024-04-18T14:44:30.647 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:30.647 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:30.647 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-04-18T14:44:30.648 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:15.392150+0000", 2024-04-18T14:44:30.648 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.3407999999999999e-05 2024-04-18T14:44:30.648 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:30.648 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:30.648 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-04-18T14:44:30.648 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:15.392177+0000", 2024-04-18T14:44:30.648 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.6673e-05 2024-04-18T14:44:30.648 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:30.648 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:30.648 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-04-18T14:44:30.648 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:15.392190+0000", 2024-04-18T14:44:30.648 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.291e-05 2024-04-18T14:44:30.648 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:30.648 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:30.649 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-04-18T14:44:30.649 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:15.392274+0000", 2024-04-18T14:44:30.649 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.4719e-05 2024-04-18T14:44:30.649 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:30.649 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:30.649 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op must wait for map", 2024-04-18T14:44:30.649 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:15.392286+0000", 2024-04-18T14:44:30.649 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.1222e-05 2024-04-18T14:44:30.649 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:30.649 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:30.649 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-04-18T14:44:30.649 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:15.394619+0000", 2024-04-18T14:44:30.649 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0023329589999999999 2024-04-18T14:44:30.649 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:30.649 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:30.650 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-04-18T14:44:30.650 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:15.394712+0000", 2024-04-18T14:44:30.650 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.3776000000000005e-05 2024-04-18T14:44:30.650 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:30.650 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:30.650 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_started", 2024-04-18T14:44:30.650 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:15.426643+0000", 2024-04-18T14:44:30.650 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.031930585999999997 2024-04-18T14:44:30.650 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:30.650 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:30.650 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_committed", 2024-04-18T14:44:30.650 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:15.432978+0000", 2024-04-18T14:44:30.651 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.006335327 2024-04-18T14:44:30.651 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:30.651 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:30.651 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-04-18T14:44:30.651 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:15.438629+0000", 2024-04-18T14:44:30.651 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0056511790000000001 2024-04-18T14:44:30.651 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:30.651 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:30.651 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-04-18T14:44:30.651 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:15.438673+0000", 2024-04-18T14:44:30.651 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.3946000000000002e-05 2024-04-18T14:44:30.651 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:44:30.651 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-04-18T14:44:30.651 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:44:30.651 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:30.651 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:30.652 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4559.0:783 3.es0 3:77281ef4:::smithi13430248-3:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e76)", 2024-04-18T14:44:30.652 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-04-18T14:44:15.392213+0000", 2024-04-18T14:44:30.652 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 15.232662005, 2024-04-18T14:44:30.652 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.038811674999999997, 2024-04-18T14:44:30.652 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-04-18T14:44:30.652 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-04-18T14:44:30.652 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-04-18T14:44:30.652 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4559", 2024-04-18T14:44:30.652 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.134:0/3113589487", 2024-04-18T14:44:30.652 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 783 2024-04-18T14:44:30.652 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:30.652 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-04-18T14:44:30.652 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:30.652 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-04-18T14:44:30.653 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:15.392213+0000", 2024-04-18T14:44:30.653 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:44:30.653 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:30.653 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:30.653 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-04-18T14:44:30.653 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:15.392213+0000", 2024-04-18T14:44:30.653 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:44:30.653 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:30.653 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:30.653 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-04-18T14:44:30.653 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:15.392212+0000", 2024-04-18T14:44:30.653 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-04-18T14:44:30.653 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:30.653 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:30.654 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-04-18T14:44:30.654 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:15.392216+0000", 2024-04-18T14:44:30.654 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.6780000000000002e-06 2024-04-18T14:44:30.654 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:30.654 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:30.654 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-04-18T14:44:30.654 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:15.392225+0000", 2024-04-18T14:44:30.654 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.5009999999999993e-06 2024-04-18T14:44:30.654 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:30.654 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:30.654 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-04-18T14:44:30.654 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:15.392230+0000", 2024-04-18T14:44:30.654 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.8999999999999997e-06 2024-04-18T14:44:30.654 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:30.655 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:30.655 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-04-18T14:44:30.655 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:15.392342+0000", 2024-04-18T14:44:30.655 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00011234999999999999 2024-04-18T14:44:30.655 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:30.655 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:30.655 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting_for_map not empty", 2024-04-18T14:44:30.655 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:15.392347+0000", 2024-04-18T14:44:30.655 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.724e-06 2024-04-18T14:44:30.655 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:30.655 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:30.655 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-04-18T14:44:30.655 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:15.394881+0000", 2024-04-18T14:44:30.655 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.002534302 2024-04-18T14:44:30.655 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:30.656 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:30.656 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for blocked object", 2024-04-18T14:44:30.656 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:15.394943+0000", 2024-04-18T14:44:30.656 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.1246000000000003e-05 2024-04-18T14:44:30.656 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:30.656 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:30.656 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-04-18T14:44:30.656 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:15.430843+0000", 2024-04-18T14:44:30.656 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.035899964999999999 2024-04-18T14:44:30.656 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:30.656 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:30.656 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-04-18T14:44:30.656 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:15.430934+0000", 2024-04-18T14:44:30.656 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.1102999999999998e-05 2024-04-18T14:44:30.656 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:30.657 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:30.657 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-04-18T14:44:30.657 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:15.431024+0000", 2024-04-18T14:44:30.657 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.0499000000000002e-05 2024-04-18T14:44:30.657 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:44:30.657 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-04-18T14:44:30.657 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:44:30.657 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:30.657 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:30.657 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4559.0:813 3.es0 3:759027ba:::smithi13430248-28:head [append 0~622592] snapc 2b=[2b,2a,29,28,27,26,23,22,1e,1c,1a,16,14,13,11,2] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-18T14:44:30.657 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-04-18T14:44:15.640559+0000", 2024-04-18T14:44:30.657 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 14.984315798000001, 2024-04-18T14:44:30.657 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0099473830000000006, 2024-04-18T14:44:30.658 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-04-18T14:44:30.658 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T14:44:30.658 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-04-18T14:44:30.658 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4559", 2024-04-18T14:44:30.658 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.134:0/3113589487", 2024-04-18T14:44:30.658 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 813 2024-04-18T14:44:30.658 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:30.658 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-04-18T14:44:30.658 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:30.658 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-04-18T14:44:30.658 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:15.640559+0000", 2024-04-18T14:44:30.658 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:44:30.658 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:30.658 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:30.659 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-04-18T14:44:30.659 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:15.640559+0000", 2024-04-18T14:44:30.659 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:44:30.659 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:30.659 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:30.659 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-04-18T14:44:30.659 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:15.640555+0000", 2024-04-18T14:44:30.659 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999967 2024-04-18T14:44:30.659 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:30.659 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:30.659 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-04-18T14:44:30.659 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:15.641725+0000", 2024-04-18T14:44:30.659 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0011691399999999999 2024-04-18T14:44:30.659 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:30.659 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:30.660 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-04-18T14:44:30.660 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:15.641760+0000", 2024-04-18T14:44:30.660 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.5209000000000001e-05 2024-04-18T14:44:30.660 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:30.660 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:30.660 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-04-18T14:44:30.660 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:15.641776+0000", 2024-04-18T14:44:30.660 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.6092000000000001e-05 2024-04-18T14:44:30.660 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:30.660 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:30.660 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-04-18T14:44:30.660 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:15.641887+0000", 2024-04-18T14:44:30.660 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000110612 2024-04-18T14:44:30.660 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:30.660 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:30.661 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-04-18T14:44:30.661 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:15.642054+0000", 2024-04-18T14:44:30.661 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00016698599999999999 2024-04-18T14:44:30.661 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:30.661 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:30.661 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_started", 2024-04-18T14:44:30.661 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:15.643756+0000", 2024-04-18T14:44:30.661 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.001702942 2024-04-18T14:44:30.661 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:30.661 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:30.661 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_committed", 2024-04-18T14:44:30.661 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:15.649831+0000", 2024-04-18T14:44:30.661 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0060744270000000003 2024-04-18T14:44:30.661 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:30.661 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:30.662 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-04-18T14:44:30.662 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:15.650321+0000", 2024-04-18T14:44:30.662 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00049031599999999997 2024-04-18T14:44:30.662 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:30.662 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:30.662 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-04-18T14:44:30.662 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:15.650506+0000", 2024-04-18T14:44:30.662 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000184966 2024-04-18T14:44:30.662 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:44:30.662 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-04-18T14:44:30.663 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:44:30.663 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:30.663 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:30.663 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4559.0:815 3.es0 3:759027ba:::smithi13430248-28:head [append 0~688128] snapc 2b=[2b,2a,29,28,27,26,23,22,1e,1c,1a,16,14,13,11,2] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-18T14:44:30.663 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-04-18T14:44:15.648660+0000", 2024-04-18T14:44:30.663 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 14.97621479, 2024-04-18T14:44:30.663 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.010314398000000001, 2024-04-18T14:44:30.663 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-04-18T14:44:30.663 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T14:44:30.663 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-04-18T14:44:30.663 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4559", 2024-04-18T14:44:30.663 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.134:0/3113589487", 2024-04-18T14:44:30.663 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 815 2024-04-18T14:44:30.663 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:30.663 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-04-18T14:44:30.664 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:30.664 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-04-18T14:44:30.664 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:15.648660+0000", 2024-04-18T14:44:30.664 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:44:30.664 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:30.664 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:30.664 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-04-18T14:44:30.664 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:15.648660+0000", 2024-04-18T14:44:30.664 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:44:30.664 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:30.664 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:30.664 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-04-18T14:44:30.664 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:15.648652+0000", 2024-04-18T14:44:30.664 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999919 2024-04-18T14:44:30.664 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:30.665 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:30.665 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-04-18T14:44:30.665 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:15.649577+0000", 2024-04-18T14:44:30.665 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00092487099999999996 2024-04-18T14:44:30.665 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:30.665 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:30.665 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-04-18T14:44:30.665 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:15.649611+0000", 2024-04-18T14:44:30.665 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.4242000000000002e-05 2024-04-18T14:44:30.665 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:30.665 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:30.665 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-04-18T14:44:30.665 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:15.649625+0000", 2024-04-18T14:44:30.665 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.4396000000000001e-05 2024-04-18T14:44:30.666 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:30.666 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:30.666 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-04-18T14:44:30.666 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:15.650822+0000", 2024-04-18T14:44:30.666 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.001196339 2024-04-18T14:44:30.666 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:30.666 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:30.666 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-04-18T14:44:30.666 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:15.650980+0000", 2024-04-18T14:44:30.666 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00015831600000000001 2024-04-18T14:44:30.666 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:30.666 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:30.666 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_started", 2024-04-18T14:44:30.667 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:15.652339+0000", 2024-04-18T14:44:30.667 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0013586920000000001 2024-04-18T14:44:30.667 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:30.667 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:30.667 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_committed", 2024-04-18T14:44:30.667 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:15.658393+0000", 2024-04-18T14:44:30.667 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0060548329999999999 2024-04-18T14:44:30.667 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:30.667 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:30.667 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-04-18T14:44:30.667 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:15.658854+0000", 2024-04-18T14:44:30.667 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00046059399999999999 2024-04-18T14:44:30.667 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:30.667 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:30.667 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-04-18T14:44:30.668 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:15.658974+0000", 2024-04-18T14:44:30.668 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000120178 2024-04-18T14:44:30.668 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:44:30.668 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-04-18T14:44:30.668 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:44:30.668 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:30.668 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:30.668 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4559.0:816 3.es0 3:759027ba:::smithi13430248-28:head [append 0~212992] snapc 2b=[2b,2a,29,28,27,26,23,22,1e,1c,1a,16,14,13,11,2] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-18T14:44:30.668 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-04-18T14:44:15.650019+0000", 2024-04-18T14:44:30.668 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 14.974855881, 2024-04-18T14:44:30.668 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.010009838, 2024-04-18T14:44:30.668 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-04-18T14:44:30.668 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T14:44:30.668 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-04-18T14:44:30.669 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4559", 2024-04-18T14:44:30.669 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.134:0/3113589487", 2024-04-18T14:44:30.669 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 816 2024-04-18T14:44:30.669 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:30.669 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-04-18T14:44:30.669 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:30.669 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-04-18T14:44:30.669 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:15.650019+0000", 2024-04-18T14:44:30.669 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:44:30.669 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:30.669 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:30.669 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-04-18T14:44:30.669 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:15.650019+0000", 2024-04-18T14:44:30.669 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:44:30.669 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:30.670 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:30.670 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-04-18T14:44:30.670 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:15.650017+0000", 2024-04-18T14:44:30.670 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999986 2024-04-18T14:44:30.670 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:30.670 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:30.670 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-04-18T14:44:30.670 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:15.650230+0000", 2024-04-18T14:44:30.670 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000213327 2024-04-18T14:44:30.670 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:30.670 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:30.670 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-04-18T14:44:30.670 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:15.650254+0000", 2024-04-18T14:44:30.670 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.3708999999999999e-05 2024-04-18T14:44:30.671 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:30.671 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:30.671 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-04-18T14:44:30.671 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:15.650268+0000", 2024-04-18T14:44:30.671 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.3393999999999999e-05 2024-04-18T14:44:30.671 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:30.671 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:30.671 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-04-18T14:44:30.671 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:15.654448+0000", 2024-04-18T14:44:30.671 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0041801720000000002 2024-04-18T14:44:30.671 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:30.671 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:30.671 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-04-18T14:44:30.671 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:15.654619+0000", 2024-04-18T14:44:30.672 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000171359 2024-04-18T14:44:30.672 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:30.672 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:30.672 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_started", 2024-04-18T14:44:30.672 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:15.655781+0000", 2024-04-18T14:44:30.672 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00116165 2024-04-18T14:44:30.672 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:30.672 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:30.672 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_committed", 2024-04-18T14:44:30.672 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:15.658552+0000", 2024-04-18T14:44:30.672 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0027713030000000001 2024-04-18T14:44:30.672 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:30.672 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:30.672 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-04-18T14:44:30.672 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:15.659942+0000", 2024-04-18T14:44:30.672 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00139014 2024-04-18T14:44:30.673 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:30.673 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:30.673 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-04-18T14:44:30.673 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:15.660029+0000", 2024-04-18T14:44:30.673 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.6364000000000002e-05 2024-04-18T14:44:30.673 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:44:30.673 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-04-18T14:44:30.673 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:44:30.673 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:30.673 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:30.673 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4559.0:817 3.es0 3:759027ba:::smithi13430248-28:head [setxattr _header (57) in=7b] snapc 2b=[2b,2a,29,28,27,26,23,22,1e,1c,1a,16,14,13,11,2] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-18T14:44:30.673 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-04-18T14:44:15.650284+0000", 2024-04-18T14:44:30.673 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 14.974590309, 2024-04-18T14:44:30.673 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.010315394, 2024-04-18T14:44:30.673 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-04-18T14:44:30.674 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T14:44:30.674 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-04-18T14:44:30.674 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4559", 2024-04-18T14:44:30.674 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.134:0/3113589487", 2024-04-18T14:44:30.674 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 817 2024-04-18T14:44:30.674 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:30.674 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-04-18T14:44:30.674 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:30.674 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-04-18T14:44:30.674 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:15.650284+0000", 2024-04-18T14:44:30.674 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:44:30.674 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:30.674 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:30.674 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-04-18T14:44:30.674 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:15.650284+0000", 2024-04-18T14:44:30.675 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:44:30.675 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:30.675 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:30.675 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-04-18T14:44:30.675 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:15.650283+0000", 2024-04-18T14:44:30.675 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-04-18T14:44:30.675 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:30.675 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:30.675 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-04-18T14:44:30.675 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:15.650289+0000", 2024-04-18T14:44:30.675 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.8529999999999997e-06 2024-04-18T14:44:30.675 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:30.675 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:30.675 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-04-18T14:44:30.676 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:15.650300+0000", 2024-04-18T14:44:30.676 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.0842999999999999e-05 2024-04-18T14:44:30.676 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:30.676 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:30.676 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-04-18T14:44:30.676 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:15.650308+0000", 2024-04-18T14:44:30.676 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.2430000000000005e-06 2024-04-18T14:44:30.676 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:30.676 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:30.676 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-04-18T14:44:30.676 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:15.656767+0000", 2024-04-18T14:44:30.676 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0064587550000000001 2024-04-18T14:44:30.676 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:30.676 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:30.676 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-04-18T14:44:30.677 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:15.656928+0000", 2024-04-18T14:44:30.677 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00016096 2024-04-18T14:44:30.677 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:30.677 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:30.677 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_started", 2024-04-18T14:44:30.677 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:15.657815+0000", 2024-04-18T14:44:30.677 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00088741899999999997 2024-04-18T14:44:30.677 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:30.677 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:30.677 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_committed", 2024-04-18T14:44:30.677 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:15.660231+0000", 2024-04-18T14:44:30.677 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0024156669999999998 2024-04-18T14:44:30.677 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:30.677 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:30.677 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-04-18T14:44:30.677 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:15.660516+0000", 2024-04-18T14:44:30.678 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000285025 2024-04-18T14:44:30.678 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:30.678 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:30.678 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-04-18T14:44:30.678 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:15.660600+0000", 2024-04-18T14:44:30.678 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.3749000000000001e-05 2024-04-18T14:44:30.678 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:44:30.678 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-04-18T14:44:30.678 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:44:30.678 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:30.678 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:30.678 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4559.0:818 3.es0 3:759027ba:::smithi13430248-28:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e76)", 2024-04-18T14:44:30.678 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-04-18T14:44:15.650320+0000", 2024-04-18T14:44:30.678 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 14.974554997, 2024-04-18T14:44:30.678 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.013936936, 2024-04-18T14:44:30.679 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-04-18T14:44:30.679 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-04-18T14:44:30.679 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-04-18T14:44:30.679 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4559", 2024-04-18T14:44:30.679 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.134:0/3113589487", 2024-04-18T14:44:30.679 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 818 2024-04-18T14:44:30.679 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:30.679 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-04-18T14:44:30.679 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:30.679 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-04-18T14:44:30.679 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:15.650320+0000", 2024-04-18T14:44:30.679 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:44:30.679 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:30.679 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:30.680 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-04-18T14:44:30.680 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:15.650320+0000", 2024-04-18T14:44:30.680 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:44:30.680 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:30.680 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:30.680 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-04-18T14:44:30.680 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:15.650319+0000", 2024-04-18T14:44:30.680 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-04-18T14:44:30.680 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:30.680 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:30.680 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-04-18T14:44:30.680 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:15.650324+0000", 2024-04-18T14:44:30.680 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.2229999999999998e-06 2024-04-18T14:44:30.680 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:30.680 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:30.681 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-04-18T14:44:30.681 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:15.650335+0000", 2024-04-18T14:44:30.681 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.0607e-05 2024-04-18T14:44:30.681 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:30.681 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:30.681 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-04-18T14:44:30.681 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:15.650345+0000", 2024-04-18T14:44:30.681 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.0906e-05 2024-04-18T14:44:30.681 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:30.681 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:30.681 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-04-18T14:44:30.681 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:15.661242+0000", 2024-04-18T14:44:30.681 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.010896662999999999 2024-04-18T14:44:30.681 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:30.681 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:30.682 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-04-18T14:44:30.682 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:15.661487+0000", 2024-04-18T14:44:30.682 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00024494300000000002 2024-04-18T14:44:30.682 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:30.682 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:30.682 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-04-18T14:44:30.682 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:15.664257+0000", 2024-04-18T14:44:30.682 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0027694210000000002 2024-04-18T14:44:30.682 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:44:30.682 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-04-18T14:44:30.682 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:44:30.682 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:30.682 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:30.682 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4559.0:913 3.es0 3:780bca72:::smithi13430248-6:head [append 0~770048] snapc 30=[30,2c,2b,2a,29,28,27,26,22,1e,1c,1a,14,11] ondisk+write+known_if_redirected+supports_pool_eio e82)", 2024-04-18T14:44:30.682 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-04-18T14:44:21.476454+0000", 2024-04-18T14:44:30.683 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 9.1484209449999998, 2024-04-18T14:44:30.683 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.015432092999999999, 2024-04-18T14:44:30.683 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-04-18T14:44:30.683 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T14:44:30.683 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-04-18T14:44:30.683 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4559", 2024-04-18T14:44:30.683 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.134:0/3113589487", 2024-04-18T14:44:30.683 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 913 2024-04-18T14:44:30.683 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:30.683 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-04-18T14:44:30.683 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:30.683 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-04-18T14:44:30.683 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:21.476454+0000", 2024-04-18T14:44:30.683 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:44:30.683 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:30.684 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:30.684 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-04-18T14:44:30.684 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:21.476454+0000", 2024-04-18T14:44:30.684 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:44:30.684 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:30.684 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:30.684 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-04-18T14:44:30.684 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:21.476452+0000", 2024-04-18T14:44:30.684 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999981 2024-04-18T14:44:30.684 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:30.684 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:30.684 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-04-18T14:44:30.684 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:21.478088+0000", 2024-04-18T14:44:30.684 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.001636497 2024-04-18T14:44:30.685 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:30.685 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:30.685 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-04-18T14:44:30.685 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:21.478107+0000", 2024-04-18T14:44:30.685 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.9301999999999999e-05 2024-04-18T14:44:30.685 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:30.685 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:30.685 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-04-18T14:44:30.685 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:21.478118+0000", 2024-04-18T14:44:30.685 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.04e-05 2024-04-18T14:44:30.685 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:30.685 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:30.685 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-04-18T14:44:30.685 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:21.478176+0000", 2024-04-18T14:44:30.686 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.8505999999999999e-05 2024-04-18T14:44:30.686 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:30.686 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:30.686 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-04-18T14:44:30.686 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:21.478310+0000", 2024-04-18T14:44:30.686 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000133423 2024-04-18T14:44:30.686 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:30.686 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:30.686 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_started", 2024-04-18T14:44:30.686 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:21.479468+0000", 2024-04-18T14:44:30.686 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.001157986 2024-04-18T14:44:30.686 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:30.686 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:30.686 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_committed", 2024-04-18T14:44:30.686 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:21.485236+0000", 2024-04-18T14:44:30.687 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0057683769999999999 2024-04-18T14:44:30.687 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:30.687 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:30.687 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-04-18T14:44:30.687 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:21.491788+0000", 2024-04-18T14:44:30.687 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0065514739999999998 2024-04-18T14:44:30.687 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:30.687 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:30.687 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-04-18T14:44:30.687 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:21.491886+0000", 2024-04-18T14:44:30.687 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.8208999999999994e-05 2024-04-18T14:44:30.687 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:44:30.687 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-04-18T14:44:30.687 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:44:30.687 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:30.687 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:30.688 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4559.0:914 3.es0 3:780bca72:::smithi13430248-6:head [append 0~540672] snapc 30=[30,2c,2b,2a,29,28,27,26,22,1e,1c,1a,14,11] ondisk+write+known_if_redirected+supports_pool_eio e82)", 2024-04-18T14:44:30.688 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-04-18T14:44:21.480954+0000", 2024-04-18T14:44:30.688 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 9.1439208539999992, 2024-04-18T14:44:30.688 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.015355890000000001, 2024-04-18T14:44:30.688 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-04-18T14:44:30.688 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T14:44:30.688 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-04-18T14:44:30.688 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4559", 2024-04-18T14:44:30.688 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.134:0/3113589487", 2024-04-18T14:44:30.688 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 914 2024-04-18T14:44:30.688 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:30.688 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-04-18T14:44:30.689 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:30.689 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-04-18T14:44:30.689 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:21.480954+0000", 2024-04-18T14:44:30.689 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:44:30.689 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:30.689 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:30.689 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-04-18T14:44:30.689 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:21.480954+0000", 2024-04-18T14:44:30.689 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:44:30.689 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:30.689 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:30.689 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-04-18T14:44:30.689 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:21.480952+0000", 2024-04-18T14:44:30.689 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999981 2024-04-18T14:44:30.689 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:30.690 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:30.690 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-04-18T14:44:30.690 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:21.482236+0000", 2024-04-18T14:44:30.690 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.001284269 2024-04-18T14:44:30.690 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:30.690 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:30.690 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-04-18T14:44:30.690 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:21.482258+0000", 2024-04-18T14:44:30.690 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.2243999999999999e-05 2024-04-18T14:44:30.690 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:30.690 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:30.690 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-04-18T14:44:30.690 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:21.482267+0000", 2024-04-18T14:44:30.690 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.8370000000000003e-06 2024-04-18T14:44:30.690 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:30.691 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:30.691 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-04-18T14:44:30.691 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:21.483041+0000", 2024-04-18T14:44:30.691 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00077384999999999997 2024-04-18T14:44:30.691 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:30.691 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:30.691 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-04-18T14:44:30.691 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:21.483182+0000", 2024-04-18T14:44:30.691 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00014160600000000001 2024-04-18T14:44:30.691 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:30.691 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:30.691 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_started", 2024-04-18T14:44:30.691 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:21.484221+0000", 2024-04-18T14:44:30.691 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.001038855 2024-04-18T14:44:30.691 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:30.692 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:30.692 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_committed", 2024-04-18T14:44:30.692 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:21.491619+0000", 2024-04-18T14:44:30.692 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.007397247 2024-04-18T14:44:30.692 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:30.692 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:30.692 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-04-18T14:44:30.692 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:21.496249+0000", 2024-04-18T14:44:30.692 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.004630253 2024-04-18T14:44:30.692 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:30.692 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:30.692 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-04-18T14:44:30.692 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:21.496310+0000", 2024-04-18T14:44:30.692 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.0819000000000002e-05 2024-04-18T14:44:30.693 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:44:30.693 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-04-18T14:44:30.693 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:44:30.693 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:30.693 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:30.693 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4559.0:915 3.es0 3:780bca72:::smithi13430248-6:head [append 0~753664] snapc 30=[30,2c,2b,2a,29,28,27,26,22,1e,1c,1a,14,11] ondisk+write+known_if_redirected+supports_pool_eio e82)", 2024-04-18T14:44:30.693 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-04-18T14:44:21.486199+0000", 2024-04-18T14:44:30.693 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 9.1386753259999995, 2024-04-18T14:44:30.693 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.014802275, 2024-04-18T14:44:30.693 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-04-18T14:44:30.693 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T14:44:30.693 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-04-18T14:44:30.693 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4559", 2024-04-18T14:44:30.693 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.134:0/3113589487", 2024-04-18T14:44:30.693 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 915 2024-04-18T14:44:30.694 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:30.694 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-04-18T14:44:30.694 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:30.694 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-04-18T14:44:30.694 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:21.486199+0000", 2024-04-18T14:44:30.694 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:44:30.694 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:30.694 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:30.694 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-04-18T14:44:30.694 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:21.486199+0000", 2024-04-18T14:44:30.694 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:44:30.694 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:30.694 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:30.694 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-04-18T14:44:30.695 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:21.486197+0000", 2024-04-18T14:44:30.695 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999976 2024-04-18T14:44:30.695 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:30.695 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:30.695 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-04-18T14:44:30.695 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:21.487012+0000", 2024-04-18T14:44:30.695 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00081568899999999998 2024-04-18T14:44:30.695 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:30.695 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:30.695 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-04-18T14:44:30.695 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:21.487031+0000", 2024-04-18T14:44:30.695 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.8417999999999999e-05 2024-04-18T14:44:30.695 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:30.695 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:30.695 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-04-18T14:44:30.695 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:21.487041+0000", 2024-04-18T14:44:30.696 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.0604e-05 2024-04-18T14:44:30.696 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:30.696 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:30.696 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-04-18T14:44:30.696 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:21.487089+0000", 2024-04-18T14:44:30.696 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.7809999999999998e-05 2024-04-18T14:44:30.696 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:30.696 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:30.696 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-04-18T14:44:30.696 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:21.487239+0000", 2024-04-18T14:44:30.696 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000149698 2024-04-18T14:44:30.696 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:30.696 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:30.696 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_started", 2024-04-18T14:44:30.696 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:21.488329+0000", 2024-04-18T14:44:30.697 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.001089771 2024-04-18T14:44:30.697 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:30.697 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:30.697 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_committed", 2024-04-18T14:44:30.697 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:21.491905+0000", 2024-04-18T14:44:30.697 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.003576082 2024-04-18T14:44:30.697 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:30.697 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:30.697 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-04-18T14:44:30.697 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:21.500943+0000", 2024-04-18T14:44:30.697 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0090378500000000001 2024-04-18T14:44:30.697 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:30.697 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:30.697 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-04-18T14:44:30.697 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:21.501002+0000", 2024-04-18T14:44:30.697 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.8946000000000001e-05 2024-04-18T14:44:30.698 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:44:30.698 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-04-18T14:44:30.698 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:44:30.698 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:30.698 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:30.698 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4559.0:916 3.es0 3:780bca72:::smithi13430248-6:head [append 0~262144] snapc 30=[30,2c,2b,2a,29,28,27,26,22,1e,1c,1a,14,11] ondisk+write+known_if_redirected+supports_pool_eio e82)", 2024-04-18T14:44:30.698 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-04-18T14:44:21.488372+0000", 2024-04-18T14:44:30.698 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 9.1365026539999992, 2024-04-18T14:44:30.698 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.012809506, 2024-04-18T14:44:30.698 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-04-18T14:44:30.698 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T14:44:30.698 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-04-18T14:44:30.698 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4559", 2024-04-18T14:44:30.698 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.134:0/3113589487", 2024-04-18T14:44:30.698 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 916 2024-04-18T14:44:30.699 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:30.699 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-04-18T14:44:30.699 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:30.699 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-04-18T14:44:30.699 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:21.488372+0000", 2024-04-18T14:44:30.699 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:44:30.699 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:30.699 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:30.699 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-04-18T14:44:30.699 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:21.488372+0000", 2024-04-18T14:44:30.699 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:44:30.699 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:30.699 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:30.699 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-04-18T14:44:30.699 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:21.488370+0000", 2024-04-18T14:44:30.700 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999986 2024-04-18T14:44:30.700 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:30.700 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:30.700 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-04-18T14:44:30.700 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:21.488593+0000", 2024-04-18T14:44:30.700 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00022244699999999999 2024-04-18T14:44:30.700 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:30.700 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:30.700 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-04-18T14:44:30.700 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:21.488610+0000", 2024-04-18T14:44:30.700 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.7258999999999999e-05 2024-04-18T14:44:30.700 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:30.700 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:30.700 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-04-18T14:44:30.700 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:21.488619+0000", 2024-04-18T14:44:30.701 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.6910000000000003e-06 2024-04-18T14:44:30.701 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:30.701 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:30.701 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-04-18T14:44:30.701 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:21.489569+0000", 2024-04-18T14:44:30.701 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00095007100000000003 2024-04-18T14:44:30.701 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:30.701 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:30.701 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-04-18T14:44:30.701 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:21.489729+0000", 2024-04-18T14:44:30.701 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00016028 2024-04-18T14:44:30.701 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:30.701 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:30.701 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_started", 2024-04-18T14:44:30.701 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:21.490434+0000", 2024-04-18T14:44:30.701 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00070458000000000001 2024-04-18T14:44:30.702 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:30.702 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:30.702 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_committed", 2024-04-18T14:44:30.702 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:21.493208+0000", 2024-04-18T14:44:30.702 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0027739370000000002 2024-04-18T14:44:30.702 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:30.702 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:30.702 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-04-18T14:44:30.702 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:21.501124+0000", 2024-04-18T14:44:30.702 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0079165290000000003 2024-04-18T14:44:30.702 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:30.702 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:30.702 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-04-18T14:44:30.702 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:21.501181+0000", 2024-04-18T14:44:30.703 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.7141000000000001e-05 2024-04-18T14:44:30.703 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:44:30.703 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-04-18T14:44:30.703 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:44:30.703 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:30.703 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:30.703 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4559.0:917 3.es0 3:780bca72:::smithi13430248-6:head [setxattr _header (56) in=7b] snapc 30=[30,2c,2b,2a,29,28,27,26,22,1e,1c,1a,14,11] ondisk+write+known_if_redirected+supports_pool_eio e82)", 2024-04-18T14:44:30.703 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-04-18T14:44:21.488629+0000", 2024-04-18T14:44:30.703 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 9.1362458760000003, 2024-04-18T14:44:30.703 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.013341056, 2024-04-18T14:44:30.703 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-04-18T14:44:30.703 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T14:44:30.703 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-04-18T14:44:30.703 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4559", 2024-04-18T14:44:30.704 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.134:0/3113589487", 2024-04-18T14:44:30.704 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 917 2024-04-18T14:44:30.704 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:30.704 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-04-18T14:44:30.704 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:30.704 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-04-18T14:44:30.704 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:21.488629+0000", 2024-04-18T14:44:30.704 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:44:30.704 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:30.704 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:30.704 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-04-18T14:44:30.704 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:21.488629+0000", 2024-04-18T14:44:30.704 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:44:30.704 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:30.704 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:30.705 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-04-18T14:44:30.705 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:21.488628+0000", 2024-04-18T14:44:30.705 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-04-18T14:44:30.705 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:30.705 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:30.705 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-04-18T14:44:30.705 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:21.488632+0000", 2024-04-18T14:44:30.705 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.3209999999999998e-06 2024-04-18T14:44:30.705 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:30.705 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:30.705 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-04-18T14:44:30.705 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:21.488640+0000", 2024-04-18T14:44:30.705 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.8320000000000006e-06 2024-04-18T14:44:30.705 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:30.705 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:30.706 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-04-18T14:44:30.706 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:21.488646+0000", 2024-04-18T14:44:30.706 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.7520000000000002e-06 2024-04-18T14:44:30.706 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:30.706 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:30.706 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-04-18T14:44:30.706 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:21.492032+0000", 2024-04-18T14:44:30.706 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0033858619999999999 2024-04-18T14:44:30.706 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:30.706 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:30.706 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-04-18T14:44:30.706 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:21.492196+0000", 2024-04-18T14:44:30.706 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00016383200000000001 2024-04-18T14:44:30.706 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:30.707 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:30.707 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_started", 2024-04-18T14:44:30.707 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:21.492741+0000", 2024-04-18T14:44:30.707 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000545825 2024-04-18T14:44:30.707 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:30.707 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:30.707 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_committed", 2024-04-18T14:44:30.707 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:21.493360+0000", 2024-04-18T14:44:30.707 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00061870200000000005 2024-04-18T14:44:30.707 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:30.707 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:30.707 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-04-18T14:44:30.707 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:21.501903+0000", 2024-04-18T14:44:30.707 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0085432909999999997 2024-04-18T14:44:30.708 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:30.708 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:30.708 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-04-18T14:44:30.708 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:21.501970+0000", 2024-04-18T14:44:30.708 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.6315999999999993e-05 2024-04-18T14:44:30.708 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:44:30.708 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-04-18T14:44:30.708 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:44:30.708 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:30.708 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:30.708 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4559.0:918 3.es0 3:780bca72:::smithi13430248-6:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e82)", 2024-04-18T14:44:30.708 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-04-18T14:44:21.488651+0000", 2024-04-18T14:44:30.708 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 9.1362231860000005, 2024-04-18T14:44:30.708 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.015957091999999999, 2024-04-18T14:44:30.708 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-04-18T14:44:30.709 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-04-18T14:44:30.709 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-04-18T14:44:30.709 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4559", 2024-04-18T14:44:30.709 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.134:0/3113589487", 2024-04-18T14:44:30.709 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 918 2024-04-18T14:44:30.709 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:30.709 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-04-18T14:44:30.709 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:30.709 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-04-18T14:44:30.709 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:21.488651+0000", 2024-04-18T14:44:30.709 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:44:30.709 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:30.709 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:30.709 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-04-18T14:44:30.709 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:21.488651+0000", 2024-04-18T14:44:30.710 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:44:30.710 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:30.710 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:30.710 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-04-18T14:44:30.710 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:21.488651+0000", 2024-04-18T14:44:30.710 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-04-18T14:44:30.710 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:30.710 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:30.710 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-04-18T14:44:30.710 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:21.488654+0000", 2024-04-18T14:44:30.710 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.8509999999999999e-06 2024-04-18T14:44:30.710 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:30.710 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:30.710 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-04-18T14:44:30.710 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:21.488663+0000", 2024-04-18T14:44:30.711 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.5529999999999998e-06 2024-04-18T14:44:30.711 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:30.711 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:30.711 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-04-18T14:44:30.711 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:21.488671+0000", 2024-04-18T14:44:30.711 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.9859999999999994e-06 2024-04-18T14:44:30.711 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:30.711 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:30.711 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-04-18T14:44:30.711 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:21.493074+0000", 2024-04-18T14:44:30.711 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0044024349999999997 2024-04-18T14:44:30.711 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:30.711 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:30.711 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for rw locks", 2024-04-18T14:44:30.711 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:21.493187+0000", 2024-04-18T14:44:30.712 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000113386 2024-04-18T14:44:30.712 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:30.712 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:30.712 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-04-18T14:44:30.712 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:21.502253+0000", 2024-04-18T14:44:30.712 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0090656810000000008 2024-04-18T14:44:30.712 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:30.712 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:30.712 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-04-18T14:44:30.712 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:21.502317+0000", 2024-04-18T14:44:30.712 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.3833999999999999e-05 2024-04-18T14:44:30.712 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:30.712 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:30.712 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-04-18T14:44:30.712 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:21.504608+0000", 2024-04-18T14:44:30.712 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0022918460000000002 2024-04-18T14:44:30.713 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:44:30.713 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-04-18T14:44:30.713 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:44:30.713 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:30.713 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:30.713 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4559.0:1012 3.7s1 3:e3a0e00d:::smithi13430248-30:head [append 0~0] snapc 37=[37,36,35,33,32,30,2c,2b,2a,29,28,26,22,1e,1c,1a,14,11] ondisk+write+known_if_redirected+supports_pool_eio e88)", 2024-04-18T14:44:30.713 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-04-18T14:44:27.488444+0000", 2024-04-18T14:44:30.713 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 3.1364310230000001, 2024-04-18T14:44:30.713 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.017461966999999998, 2024-04-18T14:44:30.713 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-04-18T14:44:30.713 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T14:44:30.713 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-04-18T14:44:30.713 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4559", 2024-04-18T14:44:30.713 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.134:0/3113589487", 2024-04-18T14:44:30.713 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 1012 2024-04-18T14:44:30.714 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:30.714 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-04-18T14:44:30.714 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:30.714 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-04-18T14:44:30.714 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:27.488444+0000", 2024-04-18T14:44:30.714 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:44:30.714 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:30.714 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:30.714 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-04-18T14:44:30.714 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:27.488444+0000", 2024-04-18T14:44:30.714 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:44:30.714 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:30.714 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:30.714 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-04-18T14:44:30.714 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:27.488439+0000", 2024-04-18T14:44:30.715 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999957 2024-04-18T14:44:30.715 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:30.715 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:30.715 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-04-18T14:44:30.715 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:27.488461+0000", 2024-04-18T14:44:30.715 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.1339e-05 2024-04-18T14:44:30.715 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:30.715 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:30.715 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-04-18T14:44:30.715 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:27.488509+0000", 2024-04-18T14:44:30.715 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.8841999999999998e-05 2024-04-18T14:44:30.715 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:30.715 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:30.715 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-04-18T14:44:30.715 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:27.488537+0000", 2024-04-18T14:44:30.715 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.7589e-05 2024-04-18T14:44:30.716 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:30.716 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:30.716 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-04-18T14:44:30.716 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:27.488632+0000", 2024-04-18T14:44:30.716 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.5087999999999995e-05 2024-04-18T14:44:30.716 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:30.716 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:30.716 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op must wait for map", 2024-04-18T14:44:30.716 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:27.488641+0000", 2024-04-18T14:44:30.716 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.9949999999999994e-06 2024-04-18T14:44:30.716 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:30.716 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:30.716 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-04-18T14:44:30.716 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:27.495701+0000", 2024-04-18T14:44:30.716 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0070601270000000002 2024-04-18T14:44:30.717 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:30.717 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:30.717 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-04-18T14:44:30.717 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:27.495802+0000", 2024-04-18T14:44:30.717 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00010076700000000001 2024-04-18T14:44:30.717 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:30.717 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:30.717 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_started", 2024-04-18T14:44:30.717 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:27.496632+0000", 2024-04-18T14:44:30.717 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00083036700000000004 2024-04-18T14:44:30.717 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:30.717 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:30.717 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_committed", 2024-04-18T14:44:30.717 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:27.500758+0000", 2024-04-18T14:44:30.717 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0041261420000000002 2024-04-18T14:44:30.717 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:30.718 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:30.718 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-04-18T14:44:30.718 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:27.505822+0000", 2024-04-18T14:44:30.718 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0050637329999999999 2024-04-18T14:44:30.718 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:30.718 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:30.718 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-04-18T14:44:30.718 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:27.505906+0000", 2024-04-18T14:44:30.718 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.3363999999999997e-05 2024-04-18T14:44:30.718 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:44:30.718 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-04-18T14:44:30.718 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:44:30.718 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:30.718 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:30.719 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4559.0:1013 3.7s1 3:e3a0e00d:::smithi13430248-30:head [rollback 37] snapc 37=[37,36,35,33,32,30,2c,2b,2a,29,28,26,22,1e,1c,1a,14,11] ondisk+write+known_if_redirected+supports_pool_eio e88)", 2024-04-18T14:44:30.719 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-04-18T14:44:27.488578+0000", 2024-04-18T14:44:30.719 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 3.136296277, 2024-04-18T14:44:30.719 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.018134701, 2024-04-18T14:44:30.719 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-04-18T14:44:30.719 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T14:44:30.719 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-04-18T14:44:30.719 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4559", 2024-04-18T14:44:30.719 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.134:0/3113589487", 2024-04-18T14:44:30.719 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 1013 2024-04-18T14:44:30.719 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:30.719 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-04-18T14:44:30.719 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:30.719 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-04-18T14:44:30.719 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:27.488578+0000", 2024-04-18T14:44:30.720 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:44:30.720 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:30.720 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:30.720 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-04-18T14:44:30.720 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:27.488578+0000", 2024-04-18T14:44:30.720 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:44:30.720 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:30.720 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:30.720 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-04-18T14:44:30.720 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:27.488577+0000", 2024-04-18T14:44:30.720 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999986 2024-04-18T14:44:30.720 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:30.720 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:30.720 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-04-18T14:44:30.720 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:27.488587+0000", 2024-04-18T14:44:30.720 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.0689999999999999e-05 2024-04-18T14:44:30.721 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:30.721 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:30.721 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-04-18T14:44:30.721 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:27.488607+0000", 2024-04-18T14:44:30.721 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.9833000000000001e-05 2024-04-18T14:44:30.721 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:30.721 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:30.721 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-04-18T14:44:30.721 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:27.488622+0000", 2024-04-18T14:44:30.721 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.4256e-05 2024-04-18T14:44:30.721 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:30.721 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:30.721 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-04-18T14:44:30.721 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:27.488737+0000", 2024-04-18T14:44:30.721 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000115857 2024-04-18T14:44:30.722 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:30.722 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:30.722 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting_for_map not empty", 2024-04-18T14:44:30.722 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:27.488748+0000", 2024-04-18T14:44:30.722 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.1078e-05 2024-04-18T14:44:30.722 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:30.722 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:30.722 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-04-18T14:44:30.722 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:27.497762+0000", 2024-04-18T14:44:30.722 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0090133160000000004 2024-04-18T14:44:30.722 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:30.722 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:30.722 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-04-18T14:44:30.722 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:27.497916+0000", 2024-04-18T14:44:30.722 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00015389700000000001 2024-04-18T14:44:30.723 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:30.723 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:30.723 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_started", 2024-04-18T14:44:30.723 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:27.498795+0000", 2024-04-18T14:44:30.723 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00087926599999999997 2024-04-18T14:44:30.723 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:30.723 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:30.723 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_committed", 2024-04-18T14:44:30.723 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:27.500760+0000", 2024-04-18T14:44:30.723 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0019648199999999999 2024-04-18T14:44:30.723 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:30.723 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:30.723 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-04-18T14:44:30.723 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:27.506627+0000", 2024-04-18T14:44:30.724 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0058670900000000002 2024-04-18T14:44:30.724 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:30.724 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:30.724 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-04-18T14:44:30.724 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:27.506713+0000", 2024-04-18T14:44:30.724 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.6135000000000001e-05 2024-04-18T14:44:30.724 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:44:30.724 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-04-18T14:44:30.724 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:44:30.724 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:30.724 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:30.724 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4559.0:1014 3.7s1 3:e3a0e00d:::smithi13430248-30:head [append 0~0] snapc 37=[37,36,35,33,32,30,2c,2b,2a,29,28,26,22,1e,1c,1a,14,11] ondisk+write+known_if_redirected+supports_pool_eio e88)", 2024-04-18T14:44:30.724 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-04-18T14:44:27.488686+0000", 2024-04-18T14:44:30.724 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 3.136188937, 2024-04-18T14:44:30.724 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.018345888000000001, 2024-04-18T14:44:30.725 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-04-18T14:44:30.725 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T14:44:30.725 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-04-18T14:44:30.725 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4559", 2024-04-18T14:44:30.725 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.134:0/3113589487", 2024-04-18T14:44:30.725 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 1014 2024-04-18T14:44:30.725 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:30.725 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-04-18T14:44:30.725 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:30.725 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-04-18T14:44:30.725 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:27.488686+0000", 2024-04-18T14:44:30.725 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:44:30.725 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:30.725 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:30.725 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-04-18T14:44:30.726 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:27.488686+0000", 2024-04-18T14:44:30.726 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:44:30.726 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:30.726 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:30.726 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-04-18T14:44:30.726 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:27.488678+0000", 2024-04-18T14:44:30.726 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999924 2024-04-18T14:44:30.726 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:30.726 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:30.726 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-04-18T14:44:30.726 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:27.488692+0000", 2024-04-18T14:44:30.726 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.4327e-05 2024-04-18T14:44:30.726 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:30.727 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:30.727 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-04-18T14:44:30.727 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:27.488712+0000", 2024-04-18T14:44:30.727 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.9789e-05 2024-04-18T14:44:30.727 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:30.727 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:30.727 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-04-18T14:44:30.727 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:27.488749+0000", 2024-04-18T14:44:30.727 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.6745000000000001e-05 2024-04-18T14:44:30.727 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:30.727 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:30.727 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-04-18T14:44:30.727 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:27.488838+0000", 2024-04-18T14:44:30.727 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.9616000000000004e-05 2024-04-18T14:44:30.727 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:30.728 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:30.728 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting_for_map not empty", 2024-04-18T14:44:30.728 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:27.488852+0000", 2024-04-18T14:44:30.728 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.3448000000000001e-05 2024-04-18T14:44:30.728 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:30.728 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:30.728 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-04-18T14:44:30.728 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:27.499445+0000", 2024-04-18T14:44:30.728 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.010593384000000001 2024-04-18T14:44:30.728 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:30.728 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:30.728 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-04-18T14:44:30.729 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:27.499602+0000", 2024-04-18T14:44:30.729 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00015701499999999999 2024-04-18T14:44:30.729 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:30.729 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:30.729 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_started", 2024-04-18T14:44:30.729 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:27.500280+0000", 2024-04-18T14:44:30.729 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000677704 2024-04-18T14:44:30.729 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:30.729 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:30.729 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_committed", 2024-04-18T14:44:30.729 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:27.501139+0000", 2024-04-18T14:44:30.729 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00085886000000000003 2024-04-18T14:44:30.729 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:30.729 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:30.730 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-04-18T14:44:30.730 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:27.506943+0000", 2024-04-18T14:44:30.730 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0058038300000000003 2024-04-18T14:44:30.730 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:30.730 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:30.730 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-04-18T14:44:30.730 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:27.507032+0000", 2024-04-18T14:44:30.730 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.8796999999999997e-05 2024-04-18T14:44:30.730 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:44:30.730 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-04-18T14:44:30.730 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:44:30.731 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:44:30.731 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-04-18T14:44:30.731 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-04-18T14:44:30.731 INFO:teuthology.orchestra.run.smithi086.stdout:osd.10: {} 2024-04-18T14:44:30.732 INFO:teuthology.orchestra.run.smithi086.stderr:osd.10: osd_enable_op_tracker = '' 2024-04-18T14:44:30.733 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.12.asok dump_ops_in_flight 2024-04-18T14:44:30.733 INFO:teuthology.orchestra.run.smithi086.stdout:osd.11: {} 2024-04-18T14:44:30.734 INFO:teuthology.orchestra.run.smithi086.stderr:osd.11: osd_enable_op_tracker = '' 2024-04-18T14:44:30.734 INFO:teuthology.orchestra.run.smithi086.stdout:osd.12: {} 2024-04-18T14:44:30.734 INFO:teuthology.orchestra.run.smithi086.stderr:osd.12: osd_enable_op_tracker = '' 2024-04-18T14:44:30.734 INFO:teuthology.orchestra.run.smithi086.stdout:osd.13: {} 2024-04-18T14:44:30.735 INFO:teuthology.orchestra.run.smithi086.stderr:osd.13: osd_enable_op_tracker = '' 2024-04-18T14:44:30.735 INFO:teuthology.orchestra.run.smithi086.stdout:osd.14: {} 2024-04-18T14:44:30.735 INFO:teuthology.orchestra.run.smithi086.stderr:osd.14: osd_enable_op_tracker = '' 2024-04-18T14:44:30.737 INFO:teuthology.orchestra.run.smithi086.stderr:2024-04-18T14:44:30.733+0000 7f696b7fe640 0 -- 172.21.15.86:0/2559214946 >> [v2:172.21.15.134:6808/25223,v1:172.21.15.134:6812/25223] conn(0x7f696c223410 msgr2=0x7f696c225800 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-04-18T14:44:30.746 INFO:teuthology.orchestra.run.smithi086.stdout:osd.15: {} 2024-04-18T14:44:30.845 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-04-18T14:44:30.845 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [], 2024-04-18T14:44:30.845 INFO:teuthology.orchestra.run.smithi086.stdout: "num_ops": 0 2024-04-18T14:44:30.846 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-04-18T14:44:30.858 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.12.asok dump_blocked_ops 2024-04-18T14:44:30.964 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-04-18T14:44:30.964 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [], 2024-04-18T14:44:30.964 INFO:teuthology.orchestra.run.smithi086.stdout: "complaint_time": 30, 2024-04-18T14:44:30.964 INFO:teuthology.orchestra.run.smithi086.stdout: "num_blocked_ops": 0 2024-04-18T14:44:30.964 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-04-18T14:44:30.981 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.12.asok dump_historic_ops 2024-04-18T14:44:31.090 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-04-18T14:44:31.091 INFO:teuthology.orchestra.run.smithi086.stdout: "size": 20, 2024-04-18T14:44:31.091 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 600, 2024-04-18T14:44:31.091 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [ 2024-04-18T14:44:31.091 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:31.091 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4559.0:247 3.9s0 3:936e42fd:::smithi13430248-33:head [rollback 8] snapc 8=[8,7,4,2] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-04-18T14:44:31.091 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-04-18T14:43:40.758084+0000", 2024-04-18T14:44:31.092 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 50.331876893, 2024-04-18T14:44:31.092 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.01694913, 2024-04-18T14:44:31.092 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-04-18T14:44:31.092 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-04-18T14:44:31.092 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-04-18T14:44:31.092 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4559", 2024-04-18T14:44:31.092 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.134:0/3113589487", 2024-04-18T14:44:31.092 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 247 2024-04-18T14:44:31.093 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:31.093 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-04-18T14:44:31.093 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:31.093 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-04-18T14:44:31.093 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:40.758084+0000", 2024-04-18T14:44:31.093 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:44:31.093 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:31.093 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:31.094 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-04-18T14:44:31.094 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:40.758084+0000", 2024-04-18T14:44:31.094 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:44:31.094 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:31.094 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:31.094 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-04-18T14:44:31.094 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:40.758082+0000", 2024-04-18T14:44:31.094 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999976 2024-04-18T14:44:31.094 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:31.094 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:31.094 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-04-18T14:44:31.094 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:40.758095+0000", 2024-04-18T14:44:31.094 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.2542e-05 2024-04-18T14:44:31.095 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:31.095 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:31.095 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-04-18T14:44:31.095 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:40.758121+0000", 2024-04-18T14:44:31.095 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.6653e-05 2024-04-18T14:44:31.095 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:31.095 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:31.095 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-04-18T14:44:31.095 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:40.758136+0000", 2024-04-18T14:44:31.095 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.4647999999999999e-05 2024-04-18T14:44:31.095 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:31.095 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:31.096 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-04-18T14:44:31.096 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:40.758238+0000", 2024-04-18T14:44:31.096 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000102221 2024-04-18T14:44:31.096 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:31.096 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:31.096 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op must wait for map", 2024-04-18T14:44:31.096 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:40.758252+0000", 2024-04-18T14:44:31.096 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.4409999999999999e-05 2024-04-18T14:44:31.096 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:31.096 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:31.096 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-04-18T14:44:31.096 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:40.764488+0000", 2024-04-18T14:44:31.096 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0062357890000000003 2024-04-18T14:44:31.096 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:31.096 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:31.097 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-04-18T14:44:31.097 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:40.764705+0000", 2024-04-18T14:44:31.097 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00021706000000000001 2024-04-18T14:44:31.097 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:31.097 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:31.097 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-04-18T14:44:31.097 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:40.775034+0000", 2024-04-18T14:44:31.097 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.010328198 2024-04-18T14:44:31.097 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:44:31.097 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-04-18T14:44:31.097 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:44:31.097 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:31.097 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:31.097 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4559.0:486 3.9s0 3:98a09a6d:::smithi13430248-38:head [append 0~720896] snapc 19=[19,16,14,13,11,f,b,a,7,2] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-18T14:44:31.097 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-04-18T14:43:56.447555+0000", 2024-04-18T14:44:31.098 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 34.642406489000003, 2024-04-18T14:44:31.098 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.01549087, 2024-04-18T14:44:31.098 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-04-18T14:44:31.098 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T14:44:31.098 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-04-18T14:44:31.098 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4559", 2024-04-18T14:44:31.098 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.134:0/3113589487", 2024-04-18T14:44:31.098 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 486 2024-04-18T14:44:31.098 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:31.098 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-04-18T14:44:31.098 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:31.098 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-04-18T14:44:31.098 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:56.447555+0000", 2024-04-18T14:44:31.098 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:44:31.098 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:31.099 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:31.099 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-04-18T14:44:31.099 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:56.447555+0000", 2024-04-18T14:44:31.099 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:44:31.099 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:31.099 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:31.099 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-04-18T14:44:31.099 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:56.447551+0000", 2024-04-18T14:44:31.099 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999962 2024-04-18T14:44:31.099 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:31.099 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:31.099 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-04-18T14:44:31.099 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:56.448771+0000", 2024-04-18T14:44:31.099 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.001219543 2024-04-18T14:44:31.099 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:31.100 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:31.100 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-04-18T14:44:31.100 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:56.448806+0000", 2024-04-18T14:44:31.100 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.5199e-05 2024-04-18T14:44:31.100 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:31.100 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:31.100 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-04-18T14:44:31.100 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:56.448831+0000", 2024-04-18T14:44:31.100 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.4803e-05 2024-04-18T14:44:31.100 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:31.100 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:31.100 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-04-18T14:44:31.100 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:56.448963+0000", 2024-04-18T14:44:31.100 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00013249299999999999 2024-04-18T14:44:31.100 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:31.101 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:31.101 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-04-18T14:44:31.101 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:56.449126+0000", 2024-04-18T14:44:31.101 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00016307299999999999 2024-04-18T14:44:31.101 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:31.101 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:31.101 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_started", 2024-04-18T14:44:31.101 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:56.451189+0000", 2024-04-18T14:44:31.101 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.002062454 2024-04-18T14:44:31.101 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:31.101 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:31.101 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_committed", 2024-04-18T14:44:31.101 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:56.459360+0000", 2024-04-18T14:44:31.101 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0081711389999999991 2024-04-18T14:44:31.101 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:31.101 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:31.102 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-04-18T14:44:31.102 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:56.462826+0000", 2024-04-18T14:44:31.102 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0034659249999999999 2024-04-18T14:44:31.102 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:31.102 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:31.102 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-04-18T14:44:31.102 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:56.463046+0000", 2024-04-18T14:44:31.102 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00022002400000000001 2024-04-18T14:44:31.102 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:44:31.102 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-04-18T14:44:31.102 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:44:31.103 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:31.103 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:31.103 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4559.0:487 3.9s0 3:98a09a6d:::smithi13430248-38:head [append 0~442368] snapc 19=[19,16,14,13,11,f,b,a,7,2] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-18T14:44:31.103 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-04-18T14:43:56.450970+0000", 2024-04-18T14:44:31.103 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 34.638991396000002, 2024-04-18T14:44:31.103 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.014296059999999999, 2024-04-18T14:44:31.104 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-04-18T14:44:31.104 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T14:44:31.104 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-04-18T14:44:31.104 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4559", 2024-04-18T14:44:31.104 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.134:0/3113589487", 2024-04-18T14:44:31.104 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 487 2024-04-18T14:44:31.104 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:31.104 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-04-18T14:44:31.104 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:31.104 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-04-18T14:44:31.104 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:56.450970+0000", 2024-04-18T14:44:31.104 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:44:31.104 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:31.105 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:31.105 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-04-18T14:44:31.105 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:56.450970+0000", 2024-04-18T14:44:31.105 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:44:31.105 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:31.105 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:31.105 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-04-18T14:44:31.105 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:56.450968+0000", 2024-04-18T14:44:31.105 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999981 2024-04-18T14:44:31.105 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:31.105 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:31.105 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-04-18T14:44:31.105 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:56.452370+0000", 2024-04-18T14:44:31.105 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0014018780000000001 2024-04-18T14:44:31.106 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:31.106 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:31.106 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-04-18T14:44:31.106 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:56.452401+0000", 2024-04-18T14:44:31.106 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.0929000000000002e-05 2024-04-18T14:44:31.106 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:31.106 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:31.107 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-04-18T14:44:31.107 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:56.452421+0000", 2024-04-18T14:44:31.107 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.9996e-05 2024-04-18T14:44:31.107 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:31.107 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:31.107 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-04-18T14:44:31.107 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:56.454319+0000", 2024-04-18T14:44:31.107 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.001898928 2024-04-18T14:44:31.107 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:31.107 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:31.107 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-04-18T14:44:31.107 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:56.454545+0000", 2024-04-18T14:44:31.107 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000225107 2024-04-18T14:44:31.108 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:31.108 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:31.108 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_started", 2024-04-18T14:44:31.108 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:56.456501+0000", 2024-04-18T14:44:31.108 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0019567260000000002 2024-04-18T14:44:31.108 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:31.109 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:31.109 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_committed", 2024-04-18T14:44:31.109 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:56.461859+0000", 2024-04-18T14:44:31.110 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0053572100000000003 2024-04-18T14:44:31.110 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:31.110 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:31.110 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-04-18T14:44:31.110 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:56.465119+0000", 2024-04-18T14:44:31.110 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0032608429999999998 2024-04-18T14:44:31.111 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:31.111 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:31.111 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-04-18T14:44:31.111 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:56.465266+0000", 2024-04-18T14:44:31.111 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00014657299999999999 2024-04-18T14:44:31.111 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:44:31.111 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-04-18T14:44:31.111 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:44:31.111 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:31.111 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:31.111 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4559.0:488 3.9s0 3:98a09a6d:::smithi13430248-38:head [append 0~327680] snapc 19=[19,16,14,13,11,f,b,a,7,2] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-18T14:44:31.112 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-04-18T14:43:56.453627+0000", 2024-04-18T14:44:31.112 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 34.636334599000001, 2024-04-18T14:44:31.112 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.012641879, 2024-04-18T14:44:31.112 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-04-18T14:44:31.112 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T14:44:31.112 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-04-18T14:44:31.112 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4559", 2024-04-18T14:44:31.112 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.134:0/3113589487", 2024-04-18T14:44:31.112 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 488 2024-04-18T14:44:31.112 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:31.112 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-04-18T14:44:31.112 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:31.112 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-04-18T14:44:31.112 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:56.453627+0000", 2024-04-18T14:44:31.112 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:44:31.113 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:31.113 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:31.113 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-04-18T14:44:31.113 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:56.453627+0000", 2024-04-18T14:44:31.113 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:44:31.113 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:31.113 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:31.113 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-04-18T14:44:31.113 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:56.453624+0000", 2024-04-18T14:44:31.113 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999971 2024-04-18T14:44:31.113 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:31.113 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:31.113 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-04-18T14:44:31.113 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:56.454243+0000", 2024-04-18T14:44:31.113 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00061905300000000005 2024-04-18T14:44:31.113 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:31.114 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:31.114 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-04-18T14:44:31.114 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:56.454276+0000", 2024-04-18T14:44:31.114 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.3399000000000003e-05 2024-04-18T14:44:31.114 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:31.114 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:31.114 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-04-18T14:44:31.114 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:56.454298+0000", 2024-04-18T14:44:31.114 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.1416e-05 2024-04-18T14:44:31.114 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:31.114 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:31.114 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-04-18T14:44:31.114 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:56.459395+0000", 2024-04-18T14:44:31.114 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0050973590000000001 2024-04-18T14:44:31.115 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:31.115 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:31.115 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-04-18T14:44:31.115 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:56.459535+0000", 2024-04-18T14:44:31.115 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00013988 2024-04-18T14:44:31.115 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:31.115 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:31.115 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_started", 2024-04-18T14:44:31.115 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:56.460302+0000", 2024-04-18T14:44:31.115 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00076662500000000005 2024-04-18T14:44:31.115 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:31.115 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:31.115 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_committed", 2024-04-18T14:44:31.115 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:56.463194+0000", 2024-04-18T14:44:31.115 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0028919269999999999 2024-04-18T14:44:31.116 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:31.116 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:31.116 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-04-18T14:44:31.116 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:56.466136+0000", 2024-04-18T14:44:31.116 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0029428890000000002 2024-04-18T14:44:31.116 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:31.116 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:31.116 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-04-18T14:44:31.116 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:56.466269+0000", 2024-04-18T14:44:31.116 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00013214100000000001 2024-04-18T14:44:31.116 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:44:31.116 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-04-18T14:44:31.117 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:44:31.117 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:31.117 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:31.117 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4559.0:489 3.9s0 3:98a09a6d:::smithi13430248-38:head [setxattr _header (57) in=7b] snapc 19=[19,16,14,13,11,f,b,a,7,2] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-18T14:44:31.117 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-04-18T14:43:56.454317+0000", 2024-04-18T14:44:31.117 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 34.635644292000002, 2024-04-18T14:44:31.117 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.012423783000000001, 2024-04-18T14:44:31.117 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-04-18T14:44:31.117 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T14:44:31.117 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-04-18T14:44:31.117 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4559", 2024-04-18T14:44:31.117 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.134:0/3113589487", 2024-04-18T14:44:31.117 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 489 2024-04-18T14:44:31.117 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:31.117 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-04-18T14:44:31.117 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:31.118 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-04-18T14:44:31.118 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:56.454317+0000", 2024-04-18T14:44:31.118 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:44:31.118 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:31.118 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:31.118 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-04-18T14:44:31.118 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:56.454317+0000", 2024-04-18T14:44:31.118 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:44:31.118 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:31.118 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:31.119 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-04-18T14:44:31.119 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:56.454315+0000", 2024-04-18T14:44:31.119 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999986 2024-04-18T14:44:31.119 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:31.119 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:31.119 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-04-18T14:44:31.119 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:56.454328+0000", 2024-04-18T14:44:31.119 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.309e-05 2024-04-18T14:44:31.119 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:31.119 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:31.119 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-04-18T14:44:31.120 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:56.454346+0000", 2024-04-18T14:44:31.120 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.7269e-05 2024-04-18T14:44:31.120 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:31.120 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:31.120 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-04-18T14:44:31.120 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:56.454361+0000", 2024-04-18T14:44:31.120 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.5549999999999999e-05 2024-04-18T14:44:31.120 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:31.120 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:31.120 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-04-18T14:44:31.120 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:56.460968+0000", 2024-04-18T14:44:31.120 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0066067950000000004 2024-04-18T14:44:31.120 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:31.120 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:31.120 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-04-18T14:44:31.120 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:56.461114+0000", 2024-04-18T14:44:31.121 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00014624000000000001 2024-04-18T14:44:31.121 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:31.121 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:31.121 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_started", 2024-04-18T14:44:31.121 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:56.461614+0000", 2024-04-18T14:44:31.121 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00049955500000000005 2024-04-18T14:44:31.121 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:31.121 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:31.121 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_committed", 2024-04-18T14:44:31.121 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:56.464895+0000", 2024-04-18T14:44:31.121 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0032811110000000002 2024-04-18T14:44:31.121 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:31.121 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:31.121 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-04-18T14:44:31.121 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:56.466578+0000", 2024-04-18T14:44:31.121 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.001682577 2024-04-18T14:44:31.122 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:31.122 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:31.122 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-04-18T14:44:31.122 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:56.466741+0000", 2024-04-18T14:44:31.122 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00016322600000000001 2024-04-18T14:44:31.122 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:44:31.122 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-04-18T14:44:31.122 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:44:31.122 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:31.122 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:31.123 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4559.0:490 3.9s0 3:98a09a6d:::smithi13430248-38:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e57)", 2024-04-18T14:44:31.123 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-04-18T14:43:56.454375+0000", 2024-04-18T14:44:31.123 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 34.635586009999997, 2024-04-18T14:44:31.123 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.015524559, 2024-04-18T14:44:31.123 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-04-18T14:44:31.123 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-04-18T14:44:31.123 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-04-18T14:44:31.123 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4559", 2024-04-18T14:44:31.124 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.134:0/3113589487", 2024-04-18T14:44:31.124 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 490 2024-04-18T14:44:31.124 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:31.124 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-04-18T14:44:31.124 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:31.124 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-04-18T14:44:31.124 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:56.454375+0000", 2024-04-18T14:44:31.124 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:44:31.124 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:31.124 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:31.124 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-04-18T14:44:31.124 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:56.454375+0000", 2024-04-18T14:44:31.124 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:44:31.124 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:31.124 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:31.125 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-04-18T14:44:31.125 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:56.454374+0000", 2024-04-18T14:44:31.125 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999986 2024-04-18T14:44:31.125 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:31.125 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:31.125 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-04-18T14:44:31.125 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:56.454383+0000", 2024-04-18T14:44:31.125 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.4530000000000008e-06 2024-04-18T14:44:31.125 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:31.125 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:31.125 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-04-18T14:44:31.125 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:56.454402+0000", 2024-04-18T14:44:31.125 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.8315999999999999e-05 2024-04-18T14:44:31.125 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:31.125 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:31.126 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-04-18T14:44:31.126 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:56.454417+0000", 2024-04-18T14:44:31.126 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.5033e-05 2024-04-18T14:44:31.126 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:31.126 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:31.126 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-04-18T14:44:31.126 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:56.464402+0000", 2024-04-18T14:44:31.126 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0099848720000000005 2024-04-18T14:44:31.126 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:31.126 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:31.126 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for rw locks", 2024-04-18T14:44:31.126 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:56.464745+0000", 2024-04-18T14:44:31.126 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00034393 2024-04-18T14:44:31.126 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:31.127 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:31.127 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-04-18T14:44:31.127 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:56.467517+0000", 2024-04-18T14:44:31.127 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0027717839999999998 2024-04-18T14:44:31.127 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:31.127 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:31.127 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-04-18T14:44:31.127 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:56.467784+0000", 2024-04-18T14:44:31.127 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00026669200000000001 2024-04-18T14:44:31.127 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:31.127 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:31.127 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-04-18T14:44:31.127 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:56.469900+0000", 2024-04-18T14:44:31.127 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0021158919999999999 2024-04-18T14:44:31.127 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:44:31.128 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-04-18T14:44:31.128 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:44:31.128 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:31.128 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:31.128 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4559.0:504 3.9s0 3:98a09a6d:::smithi13430248-38:head [append 0~0] snapc 19=[19,16,14,13,11,f,b,a,7,2] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-18T14:44:31.128 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-04-18T14:43:56.547183+0000", 2024-04-18T14:44:31.128 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 34.542778581999997, 2024-04-18T14:44:31.128 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.013133432, 2024-04-18T14:44:31.128 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-04-18T14:44:31.128 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T14:44:31.128 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-04-18T14:44:31.128 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4559", 2024-04-18T14:44:31.128 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.134:0/3113589487", 2024-04-18T14:44:31.128 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 504 2024-04-18T14:44:31.128 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:31.129 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-04-18T14:44:31.129 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:31.129 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-04-18T14:44:31.129 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:56.547183+0000", 2024-04-18T14:44:31.129 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:44:31.129 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:31.129 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:31.129 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-04-18T14:44:31.129 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:56.547183+0000", 2024-04-18T14:44:31.129 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:44:31.129 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:31.129 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:31.129 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-04-18T14:44:31.129 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:56.547182+0000", 2024-04-18T14:44:31.129 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-04-18T14:44:31.130 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:31.130 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:31.130 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-04-18T14:44:31.130 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:56.547186+0000", 2024-04-18T14:44:31.130 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.464e-06 2024-04-18T14:44:31.130 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:31.130 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:31.130 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-04-18T14:44:31.130 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:56.547196+0000", 2024-04-18T14:44:31.130 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.5400000000000001e-06 2024-04-18T14:44:31.130 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:31.130 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:31.130 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-04-18T14:44:31.130 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:56.547203+0000", 2024-04-18T14:44:31.131 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.72e-06 2024-04-18T14:44:31.131 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:31.131 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:31.131 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-04-18T14:44:31.131 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:56.549707+0000", 2024-04-18T14:44:31.131 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0025045990000000001 2024-04-18T14:44:31.131 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:31.131 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:31.131 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-04-18T14:44:31.131 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:56.549841+0000", 2024-04-18T14:44:31.131 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000133404 2024-04-18T14:44:31.131 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:31.131 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:31.131 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_started", 2024-04-18T14:44:31.131 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:56.550457+0000", 2024-04-18T14:44:31.131 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00061647000000000004 2024-04-18T14:44:31.132 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:31.132 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:31.132 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_committed", 2024-04-18T14:44:31.132 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:56.551675+0000", 2024-04-18T14:44:31.132 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0012178600000000001 2024-04-18T14:44:31.132 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:31.132 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:31.132 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-04-18T14:44:31.132 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:56.560246+0000", 2024-04-18T14:44:31.132 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0085714169999999996 2024-04-18T14:44:31.132 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:31.132 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:31.132 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-04-18T14:44:31.132 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:56.560316+0000", 2024-04-18T14:44:31.132 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.9645000000000002e-05 2024-04-18T14:44:31.133 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:44:31.133 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-04-18T14:44:31.133 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:44:31.133 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:31.133 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:31.133 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4559.0:507 3.9s0 3:9cf55191:::smithi13430248-16:head [copy-from ver 48] snapc 19=[19,16,14,13,11,f,b,a,7,2] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-18T14:44:31.133 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-04-18T14:43:56.576189+0000", 2024-04-18T14:44:31.133 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 34.513772007, 2024-04-18T14:44:31.133 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.020256327000000001, 2024-04-18T14:44:31.133 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-04-18T14:44:31.133 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T14:44:31.133 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-04-18T14:44:31.133 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4559", 2024-04-18T14:44:31.133 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.134:0/3113589487", 2024-04-18T14:44:31.134 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 507 2024-04-18T14:44:31.134 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:31.134 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-04-18T14:44:31.134 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:31.134 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-04-18T14:44:31.134 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:56.576189+0000", 2024-04-18T14:44:31.134 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:44:31.134 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:31.134 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:31.134 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-04-18T14:44:31.134 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:56.576189+0000", 2024-04-18T14:44:31.134 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:44:31.134 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:31.134 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:31.134 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-04-18T14:44:31.135 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:56.576187+0000", 2024-04-18T14:44:31.135 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999976 2024-04-18T14:44:31.135 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:31.135 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:31.135 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-04-18T14:44:31.135 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:56.576199+0000", 2024-04-18T14:44:31.135 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.2729e-05 2024-04-18T14:44:31.135 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:31.135 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:31.135 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-04-18T14:44:31.135 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:56.576222+0000", 2024-04-18T14:44:31.135 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.2047000000000001e-05 2024-04-18T14:44:31.135 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:31.135 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:31.135 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-04-18T14:44:31.135 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:56.576233+0000", 2024-04-18T14:44:31.136 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.1741e-05 2024-04-18T14:44:31.136 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:31.136 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:31.136 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-04-18T14:44:31.136 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:56.576290+0000", 2024-04-18T14:44:31.136 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.6774000000000002e-05 2024-04-18T14:44:31.136 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:31.136 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:31.136 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-04-18T14:44:31.136 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:56.576423+0000", 2024-04-18T14:44:31.136 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00013259 2024-04-18T14:44:31.136 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:31.136 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:31.136 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_started", 2024-04-18T14:44:31.137 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:56.585718+0000", 2024-04-18T14:44:31.137 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0092951079999999998 2024-04-18T14:44:31.137 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:31.137 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:31.137 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_committed", 2024-04-18T14:44:31.137 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:56.593570+0000", 2024-04-18T14:44:31.137 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.007852632 2024-04-18T14:44:31.137 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:31.137 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:31.137 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-04-18T14:44:31.137 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:56.596350+0000", 2024-04-18T14:44:31.137 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0027794489999999998 2024-04-18T14:44:31.137 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:31.137 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:31.137 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-04-18T14:44:31.138 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:56.596446+0000", 2024-04-18T14:44:31.138 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.5773000000000006e-05 2024-04-18T14:44:31.138 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:44:31.138 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-04-18T14:44:31.138 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:44:31.138 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:31.138 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:31.138 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4559.0:508 3.9s0 3:9cf55191:::smithi13430248-16:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e57)", 2024-04-18T14:44:31.138 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-04-18T14:43:56.576245+0000", 2024-04-18T14:44:31.138 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 34.513716084000002, 2024-04-18T14:44:31.138 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.012675728000000001, 2024-04-18T14:44:31.138 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-04-18T14:44:31.138 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-04-18T14:44:31.138 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-04-18T14:44:31.139 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4559", 2024-04-18T14:44:31.139 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.134:0/3113589487", 2024-04-18T14:44:31.139 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 508 2024-04-18T14:44:31.139 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:31.139 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-04-18T14:44:31.139 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:31.139 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-04-18T14:44:31.139 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:56.576245+0000", 2024-04-18T14:44:31.139 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:44:31.139 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:31.139 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:31.139 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-04-18T14:44:31.139 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:56.576245+0000", 2024-04-18T14:44:31.139 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:44:31.140 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:31.140 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:31.140 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-04-18T14:44:31.140 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:56.576245+0000", 2024-04-18T14:44:31.140 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-04-18T14:44:31.140 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:31.140 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:31.140 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-04-18T14:44:31.140 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:56.576248+0000", 2024-04-18T14:44:31.140 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.625e-06 2024-04-18T14:44:31.140 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:31.140 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:31.140 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-04-18T14:44:31.140 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:56.576257+0000", 2024-04-18T14:44:31.140 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.9910000000000008e-06 2024-04-18T14:44:31.141 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:31.141 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:31.141 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-04-18T14:44:31.141 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:56.576264+0000", 2024-04-18T14:44:31.141 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.5869999999999998e-06 2024-04-18T14:44:31.141 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:31.141 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:31.141 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-04-18T14:44:31.141 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:56.576670+0000", 2024-04-18T14:44:31.141 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000405976 2024-04-18T14:44:31.141 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:31.141 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:31.141 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for blocked object", 2024-04-18T14:44:31.141 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:56.576749+0000", 2024-04-18T14:44:31.141 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.8882999999999997e-05 2024-04-18T14:44:31.142 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:31.142 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:31.142 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-04-18T14:44:31.142 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:56.588691+0000", 2024-04-18T14:44:31.142 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.011942708 2024-04-18T14:44:31.142 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:31.142 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:31.142 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-04-18T14:44:31.142 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:56.588815+0000", 2024-04-18T14:44:31.142 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00012397299999999999 2024-04-18T14:44:31.142 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:31.142 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:31.142 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-04-18T14:44:31.142 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:43:56.588921+0000", 2024-04-18T14:44:31.142 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00010563799999999999 2024-04-18T14:44:31.143 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:44:31.143 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-04-18T14:44:31.143 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:44:31.143 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:31.143 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:31.143 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4559.0:644 3.9s0 3:94766bb7:::smithi13430248-17:head [append 0~655360] snapc 23=[23,22,1e,1d,1c,1a,16,14,13,11,a,2] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-04-18T14:44:31.143 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-04-18T14:44:06.395465+0000", 2024-04-18T14:44:31.143 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 24.694496166, 2024-04-18T14:44:31.143 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.014701519, 2024-04-18T14:44:31.143 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-04-18T14:44:31.143 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T14:44:31.143 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-04-18T14:44:31.143 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4559", 2024-04-18T14:44:31.143 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.134:0/3113589487", 2024-04-18T14:44:31.143 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 644 2024-04-18T14:44:31.144 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:31.144 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-04-18T14:44:31.144 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:31.144 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-04-18T14:44:31.144 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:06.395465+0000", 2024-04-18T14:44:31.144 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:44:31.144 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:31.144 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:31.144 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-04-18T14:44:31.144 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:06.395465+0000", 2024-04-18T14:44:31.144 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:44:31.144 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:31.144 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:31.144 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-04-18T14:44:31.144 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:06.395462+0000", 2024-04-18T14:44:31.144 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999971 2024-04-18T14:44:31.145 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:31.145 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:31.145 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-04-18T14:44:31.145 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:06.396348+0000", 2024-04-18T14:44:31.145 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00088584199999999997 2024-04-18T14:44:31.145 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:31.145 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:31.145 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-04-18T14:44:31.145 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:06.396371+0000", 2024-04-18T14:44:31.145 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.2841e-05 2024-04-18T14:44:31.145 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:31.145 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:31.145 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-04-18T14:44:31.145 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:06.396385+0000", 2024-04-18T14:44:31.145 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.3878e-05 2024-04-18T14:44:31.146 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:31.146 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:31.146 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-04-18T14:44:31.146 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:06.396460+0000", 2024-04-18T14:44:31.146 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.5066000000000003e-05 2024-04-18T14:44:31.146 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:31.146 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:31.146 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-04-18T14:44:31.146 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:06.396568+0000", 2024-04-18T14:44:31.146 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00010834 2024-04-18T14:44:31.146 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:31.146 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:31.146 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_started", 2024-04-18T14:44:31.146 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:06.397748+0000", 2024-04-18T14:44:31.147 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0011796300000000001 2024-04-18T14:44:31.147 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:31.147 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:31.147 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_committed", 2024-04-18T14:44:31.147 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:06.400307+0000", 2024-04-18T14:44:31.147 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0025595150000000001 2024-04-18T14:44:31.147 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:31.147 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:31.147 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-04-18T14:44:31.147 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:06.410069+0000", 2024-04-18T14:44:31.147 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0097613549999999993 2024-04-18T14:44:31.147 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:31.147 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:31.147 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-04-18T14:44:31.147 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:06.410167+0000", 2024-04-18T14:44:31.148 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.7874000000000005e-05 2024-04-18T14:44:31.148 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:44:31.148 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-04-18T14:44:31.148 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:44:31.148 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:31.148 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:31.148 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4559.0:649 3.9s0 3:94766bb7:::smithi13430248-17:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e67)", 2024-04-18T14:44:31.148 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-04-18T14:44:06.406452+0000", 2024-04-18T14:44:31.148 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 24.683509031, 2024-04-18T14:44:31.148 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.011828353, 2024-04-18T14:44:31.148 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-04-18T14:44:31.148 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-04-18T14:44:31.148 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-04-18T14:44:31.148 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4559", 2024-04-18T14:44:31.148 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.134:0/3113589487", 2024-04-18T14:44:31.148 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 649 2024-04-18T14:44:31.149 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:31.149 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-04-18T14:44:31.149 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:31.149 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-04-18T14:44:31.149 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:06.406452+0000", 2024-04-18T14:44:31.149 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:44:31.149 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:31.149 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:31.149 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-04-18T14:44:31.149 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:06.406452+0000", 2024-04-18T14:44:31.149 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:44:31.149 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:31.149 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:31.149 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-04-18T14:44:31.150 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:06.406452+0000", 2024-04-18T14:44:31.150 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967296 2024-04-18T14:44:31.150 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:31.150 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:31.150 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-04-18T14:44:31.150 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:06.406455+0000", 2024-04-18T14:44:31.150 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.332e-06 2024-04-18T14:44:31.150 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:31.150 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:31.150 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-04-18T14:44:31.150 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:06.406459+0000", 2024-04-18T14:44:31.150 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.9999999999999998e-06 2024-04-18T14:44:31.150 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:31.150 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:31.151 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-04-18T14:44:31.151 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:06.406468+0000", 2024-04-18T14:44:31.151 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.3559999999999993e-06 2024-04-18T14:44:31.151 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:31.151 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:31.151 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-04-18T14:44:31.151 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:06.410228+0000", 2024-04-18T14:44:31.151 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0037600960000000001 2024-04-18T14:44:31.151 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:31.151 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:31.151 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for rw locks", 2024-04-18T14:44:31.151 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:06.410285+0000", 2024-04-18T14:44:31.151 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.7111000000000003e-05 2024-04-18T14:44:31.151 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:31.151 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:31.152 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-04-18T14:44:31.152 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:06.416450+0000", 2024-04-18T14:44:31.152 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0061647189999999999 2024-04-18T14:44:31.152 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:31.152 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:31.152 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-04-18T14:44:31.152 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:06.416596+0000", 2024-04-18T14:44:31.152 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000146484 2024-04-18T14:44:31.152 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:31.152 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:31.152 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-04-18T14:44:31.152 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:06.418281+0000", 2024-04-18T14:44:31.152 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.001684489 2024-04-18T14:44:31.152 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:44:31.152 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-04-18T14:44:31.153 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:44:31.153 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:31.153 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:31.153 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4559.0:773 3.9s0 3:94766bb7:::smithi13430248-17:head [copy-from ver 22] snapc 2b=[2b,2a,29,28,27,26,23,22,1e,1c,1a,16,14,13,11,2] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-18T14:44:31.153 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-04-18T14:44:15.388696+0000", 2024-04-18T14:44:31.153 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 15.701264833, 2024-04-18T14:44:31.153 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.036513024999999998, 2024-04-18T14:44:31.153 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-04-18T14:44:31.153 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T14:44:31.153 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-04-18T14:44:31.153 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4559", 2024-04-18T14:44:31.153 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.134:0/3113589487", 2024-04-18T14:44:31.153 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 773 2024-04-18T14:44:31.153 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:31.153 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-04-18T14:44:31.154 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:31.154 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-04-18T14:44:31.154 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:15.388696+0000", 2024-04-18T14:44:31.154 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:44:31.154 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:31.154 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:31.154 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-04-18T14:44:31.154 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:15.388696+0000", 2024-04-18T14:44:31.154 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:44:31.154 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:31.154 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:31.154 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-04-18T14:44:31.154 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:15.388693+0000", 2024-04-18T14:44:31.154 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999962 2024-04-18T14:44:31.154 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:31.155 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:31.155 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-04-18T14:44:31.155 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:15.388716+0000", 2024-04-18T14:44:31.155 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.3280000000000001e-05 2024-04-18T14:44:31.155 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:31.155 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:31.155 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-04-18T14:44:31.155 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:15.388749+0000", 2024-04-18T14:44:31.155 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.2888000000000001e-05 2024-04-18T14:44:31.155 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:31.155 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:31.155 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-04-18T14:44:31.155 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:15.388763+0000", 2024-04-18T14:44:31.155 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.3799e-05 2024-04-18T14:44:31.156 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:31.156 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:31.156 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-04-18T14:44:31.156 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:15.388839+0000", 2024-04-18T14:44:31.156 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.6239e-05 2024-04-18T14:44:31.156 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:31.156 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:31.156 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op must wait for map", 2024-04-18T14:44:31.156 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:15.388851+0000", 2024-04-18T14:44:31.156 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.186e-05 2024-04-18T14:44:31.156 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:31.156 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:31.156 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-04-18T14:44:31.156 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:15.399284+0000", 2024-04-18T14:44:31.156 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.010433177 2024-04-18T14:44:31.156 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:31.157 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:31.157 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-04-18T14:44:31.157 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:15.399470+0000", 2024-04-18T14:44:31.157 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00018628500000000001 2024-04-18T14:44:31.157 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:31.157 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:31.157 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_started", 2024-04-18T14:44:31.157 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:15.418799+0000", 2024-04-18T14:44:31.157 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.019329030000000001 2024-04-18T14:44:31.157 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:31.157 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:31.157 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_committed", 2024-04-18T14:44:31.157 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:15.423550+0000", 2024-04-18T14:44:31.157 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0047512120000000003 2024-04-18T14:44:31.157 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:31.158 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:31.158 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-04-18T14:44:31.158 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:15.425118+0000", 2024-04-18T14:44:31.158 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.001568091 2024-04-18T14:44:31.158 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:31.158 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:31.158 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-04-18T14:44:31.158 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:15.425209+0000", 2024-04-18T14:44:31.158 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.1020999999999995e-05 2024-04-18T14:44:31.158 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:44:31.158 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-04-18T14:44:31.158 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:44:31.158 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:31.158 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:31.159 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4559.0:774 3.9s0 3:94766bb7:::smithi13430248-17:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e76)", 2024-04-18T14:44:31.159 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-04-18T14:44:15.388778+0000", 2024-04-18T14:44:31.159 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 15.701183221000001, 2024-04-18T14:44:31.159 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.032149105999999997, 2024-04-18T14:44:31.159 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-04-18T14:44:31.159 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-04-18T14:44:31.159 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-04-18T14:44:31.159 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4559", 2024-04-18T14:44:31.159 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.134:0/3113589487", 2024-04-18T14:44:31.159 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 774 2024-04-18T14:44:31.159 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:31.159 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-04-18T14:44:31.159 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:31.159 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-04-18T14:44:31.159 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:15.388778+0000", 2024-04-18T14:44:31.160 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:44:31.160 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:31.160 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:31.160 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-04-18T14:44:31.160 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:15.388778+0000", 2024-04-18T14:44:31.160 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:44:31.160 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:31.160 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:31.160 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-04-18T14:44:31.160 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:15.388777+0000", 2024-04-18T14:44:31.160 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-04-18T14:44:31.160 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:31.160 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:31.160 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-04-18T14:44:31.160 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:15.388782+0000", 2024-04-18T14:44:31.161 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.4700000000000004e-06 2024-04-18T14:44:31.161 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:31.161 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:31.161 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-04-18T14:44:31.161 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:15.388790+0000", 2024-04-18T14:44:31.161 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.089e-06 2024-04-18T14:44:31.161 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:31.161 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:31.161 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-04-18T14:44:31.161 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:15.388795+0000", 2024-04-18T14:44:31.161 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.1390000000000003e-06 2024-04-18T14:44:31.161 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:31.161 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:31.161 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-04-18T14:44:31.161 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:15.388926+0000", 2024-04-18T14:44:31.162 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00013075399999999999 2024-04-18T14:44:31.162 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:31.162 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:31.162 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting_for_map not empty", 2024-04-18T14:44:31.162 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:15.388937+0000", 2024-04-18T14:44:31.162 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.0927000000000001e-05 2024-04-18T14:44:31.162 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:31.162 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:31.162 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-04-18T14:44:31.162 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:15.400228+0000", 2024-04-18T14:44:31.162 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.011290932 2024-04-18T14:44:31.162 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:31.162 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:31.162 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for blocked object", 2024-04-18T14:44:31.163 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:15.400301+0000", 2024-04-18T14:44:31.163 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.3421000000000001e-05 2024-04-18T14:44:31.163 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:31.163 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:31.163 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-04-18T14:44:31.163 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:15.420683+0000", 2024-04-18T14:44:31.163 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.020382173999999999 2024-04-18T14:44:31.163 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:31.163 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:31.163 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-04-18T14:44:31.163 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:15.420807+0000", 2024-04-18T14:44:31.163 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00012386799999999999 2024-04-18T14:44:31.163 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:31.163 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:31.164 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-04-18T14:44:31.164 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:15.420927+0000", 2024-04-18T14:44:31.164 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000119913 2024-04-18T14:44:31.164 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:44:31.164 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-04-18T14:44:31.164 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:44:31.164 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:31.164 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:31.164 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4559.0:779 3.9s0 3:98a09a6d:::smithi13430248-38:head [read 0~1638400,checksum,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e76)", 2024-04-18T14:44:31.164 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-04-18T14:44:15.391975+0000", 2024-04-18T14:44:31.164 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 15.697985973, 2024-04-18T14:44:31.164 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.014293854999999999, 2024-04-18T14:44:31.164 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-04-18T14:44:31.164 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-04-18T14:44:31.164 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-04-18T14:44:31.164 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4559", 2024-04-18T14:44:31.165 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.134:0/3113589487", 2024-04-18T14:44:31.165 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 779 2024-04-18T14:44:31.165 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:31.165 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-04-18T14:44:31.165 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:31.165 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-04-18T14:44:31.165 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:15.391975+0000", 2024-04-18T14:44:31.165 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:44:31.165 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:31.165 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:31.165 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-04-18T14:44:31.165 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:15.391975+0000", 2024-04-18T14:44:31.165 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:44:31.165 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:31.165 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:31.166 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-04-18T14:44:31.166 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:15.391973+0000", 2024-04-18T14:44:31.166 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999971 2024-04-18T14:44:31.166 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:31.166 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:31.166 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-04-18T14:44:31.166 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:15.391987+0000", 2024-04-18T14:44:31.166 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.4731e-05 2024-04-18T14:44:31.166 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:31.166 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:31.166 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-04-18T14:44:31.166 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:15.392012+0000", 2024-04-18T14:44:31.166 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.4309999999999999e-05 2024-04-18T14:44:31.166 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:31.166 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:31.167 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-04-18T14:44:31.167 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:15.392026+0000", 2024-04-18T14:44:31.167 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.4538e-05 2024-04-18T14:44:31.167 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:31.167 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:31.167 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-04-18T14:44:31.167 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:15.392085+0000", 2024-04-18T14:44:31.167 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.8569000000000001e-05 2024-04-18T14:44:31.167 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:31.167 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:31.167 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting_for_map not empty", 2024-04-18T14:44:31.167 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:15.392091+0000", 2024-04-18T14:44:31.167 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.7839999999999998e-06 2024-04-18T14:44:31.167 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:31.167 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:31.167 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-04-18T14:44:31.168 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:15.400332+0000", 2024-04-18T14:44:31.168 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0082402329999999996 2024-04-18T14:44:31.168 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:31.168 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:31.168 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-04-18T14:44:31.168 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:15.400516+0000", 2024-04-18T14:44:31.168 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00018459300000000001 2024-04-18T14:44:31.168 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:31.168 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:31.168 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-04-18T14:44:31.168 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:15.406269+0000", 2024-04-18T14:44:31.168 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0057529010000000004 2024-04-18T14:44:31.168 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:44:31.168 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-04-18T14:44:31.168 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:44:31.169 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:31.169 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:31.169 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4559.0:780 3.9s0 3:98a09a6d:::smithi13430248-38:head [read 0~1638400,checksum] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e76)", 2024-04-18T14:44:31.169 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-04-18T14:44:15.392037+0000", 2024-04-18T14:44:31.169 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 15.697923872000001, 2024-04-18T14:44:31.169 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.015564479000000001, 2024-04-18T14:44:31.169 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-04-18T14:44:31.169 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-04-18T14:44:31.169 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-04-18T14:44:31.169 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4559", 2024-04-18T14:44:31.169 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.134:0/3113589487", 2024-04-18T14:44:31.169 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 780 2024-04-18T14:44:31.169 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:31.169 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-04-18T14:44:31.169 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:31.169 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-04-18T14:44:31.170 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:15.392037+0000", 2024-04-18T14:44:31.170 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:44:31.170 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:31.170 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:31.170 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-04-18T14:44:31.170 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:15.392037+0000", 2024-04-18T14:44:31.170 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:44:31.170 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:31.170 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:31.170 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-04-18T14:44:31.170 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:15.392037+0000", 2024-04-18T14:44:31.170 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-04-18T14:44:31.170 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:31.170 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:31.170 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-04-18T14:44:31.171 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:15.392044+0000", 2024-04-18T14:44:31.171 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.6699999999999997e-06 2024-04-18T14:44:31.171 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:31.171 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:31.171 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-04-18T14:44:31.171 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:15.392049+0000", 2024-04-18T14:44:31.171 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.8080000000000001e-06 2024-04-18T14:44:31.171 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:31.171 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:31.171 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-04-18T14:44:31.171 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:15.392054+0000", 2024-04-18T14:44:31.171 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.7099999999999998e-06 2024-04-18T14:44:31.171 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:31.171 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:31.171 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-04-18T14:44:31.171 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:15.392150+0000", 2024-04-18T14:44:31.172 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.5513999999999994e-05 2024-04-18T14:44:31.172 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:31.172 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:31.172 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting_for_map not empty", 2024-04-18T14:44:31.172 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:15.392157+0000", 2024-04-18T14:44:31.172 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.8399999999999995e-06 2024-04-18T14:44:31.172 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:31.172 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:31.172 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-04-18T14:44:31.172 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:15.401238+0000", 2024-04-18T14:44:31.172 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0090805680000000007 2024-04-18T14:44:31.172 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:31.172 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:31.172 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-04-18T14:44:31.172 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:15.401328+0000", 2024-04-18T14:44:31.172 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.9901000000000005e-05 2024-04-18T14:44:31.173 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:31.173 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:31.173 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-04-18T14:44:31.173 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:15.407602+0000", 2024-04-18T14:44:31.173 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.006273977 2024-04-18T14:44:31.173 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:44:31.173 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-04-18T14:44:31.173 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:44:31.173 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:31.173 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:31.173 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4559.0:781 3.9s0 3:98a09a6d:::smithi13430248-38:head [read 0~1638400,checksum] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e76)", 2024-04-18T14:44:31.173 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-04-18T14:44:15.392076+0000", 2024-04-18T14:44:31.173 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 15.697885224, 2024-04-18T14:44:31.173 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.016730854999999999, 2024-04-18T14:44:31.173 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-04-18T14:44:31.173 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-04-18T14:44:31.174 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-04-18T14:44:31.174 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4559", 2024-04-18T14:44:31.174 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.134:0/3113589487", 2024-04-18T14:44:31.174 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 781 2024-04-18T14:44:31.174 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:31.174 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-04-18T14:44:31.174 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:31.174 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-04-18T14:44:31.174 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:15.392076+0000", 2024-04-18T14:44:31.174 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:44:31.174 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:31.174 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:31.174 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-04-18T14:44:31.174 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:15.392076+0000", 2024-04-18T14:44:31.175 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:44:31.175 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:31.175 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:31.175 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-04-18T14:44:31.175 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:15.392076+0000", 2024-04-18T14:44:31.175 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-04-18T14:44:31.175 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:31.175 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:31.175 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-04-18T14:44:31.175 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:15.392079+0000", 2024-04-18T14:44:31.175 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.5049999999999999e-06 2024-04-18T14:44:31.175 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:31.175 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:31.175 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-04-18T14:44:31.175 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:15.392085+0000", 2024-04-18T14:44:31.175 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.998e-06 2024-04-18T14:44:31.176 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:31.176 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:31.176 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-04-18T14:44:31.176 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:15.392089+0000", 2024-04-18T14:44:31.176 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.1729999999999997e-06 2024-04-18T14:44:31.176 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:31.176 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:31.176 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-04-18T14:44:31.176 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:15.392192+0000", 2024-04-18T14:44:31.176 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00010218899999999999 2024-04-18T14:44:31.176 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:31.176 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:31.176 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting_for_map not empty", 2024-04-18T14:44:31.176 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:15.392199+0000", 2024-04-18T14:44:31.177 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.3359999999999997e-06 2024-04-18T14:44:31.177 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:31.177 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:31.177 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-04-18T14:44:31.177 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:15.401660+0000", 2024-04-18T14:44:31.177 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0094607760000000006 2024-04-18T14:44:31.177 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:31.177 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:31.177 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-04-18T14:44:31.177 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:15.401736+0000", 2024-04-18T14:44:31.177 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.6258000000000001e-05 2024-04-18T14:44:31.177 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:31.177 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:31.177 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-04-18T14:44:31.177 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:15.408807+0000", 2024-04-18T14:44:31.177 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0070710210000000003 2024-04-18T14:44:31.178 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:44:31.178 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-04-18T14:44:31.178 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:44:31.178 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:31.178 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:31.178 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4559.0:807 3.9s0 3:9ca71dbb:::smithi13430248-12:head [append 0~606208] snapc 2b=[2b,2a,29,28,27,26,23,22,1e,1c,1a,16,14,13,11,2] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-18T14:44:31.178 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-04-18T14:44:15.614504+0000", 2024-04-18T14:44:31.178 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 15.475457516000001, 2024-04-18T14:44:31.178 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.013258373, 2024-04-18T14:44:31.178 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-04-18T14:44:31.178 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T14:44:31.178 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-04-18T14:44:31.178 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4559", 2024-04-18T14:44:31.178 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.134:0/3113589487", 2024-04-18T14:44:31.178 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 807 2024-04-18T14:44:31.179 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:31.179 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-04-18T14:44:31.179 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:31.179 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-04-18T14:44:31.179 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:15.614504+0000", 2024-04-18T14:44:31.179 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:44:31.179 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:31.179 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:31.179 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-04-18T14:44:31.179 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:15.614504+0000", 2024-04-18T14:44:31.179 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:44:31.179 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:31.179 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:31.179 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-04-18T14:44:31.179 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:15.614501+0000", 2024-04-18T14:44:31.179 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999971 2024-04-18T14:44:31.180 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:31.180 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:31.180 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-04-18T14:44:31.180 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:15.615812+0000", 2024-04-18T14:44:31.180 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0013106210000000001 2024-04-18T14:44:31.180 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:31.180 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:31.180 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-04-18T14:44:31.180 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:15.615847+0000", 2024-04-18T14:44:31.180 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.5231999999999997e-05 2024-04-18T14:44:31.180 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:31.180 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:31.180 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-04-18T14:44:31.180 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:15.615866+0000", 2024-04-18T14:44:31.180 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.8736000000000002e-05 2024-04-18T14:44:31.181 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:31.181 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:31.181 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-04-18T14:44:31.181 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:15.615957+0000", 2024-04-18T14:44:31.181 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.1088999999999995e-05 2024-04-18T14:44:31.181 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:31.181 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:31.181 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-04-18T14:44:31.181 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:15.616212+0000", 2024-04-18T14:44:31.181 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00025488600000000001 2024-04-18T14:44:31.181 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:31.181 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:31.181 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_started", 2024-04-18T14:44:31.181 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:15.617986+0000", 2024-04-18T14:44:31.181 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0017745009999999999 2024-04-18T14:44:31.182 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:31.182 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:31.182 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_committed", 2024-04-18T14:44:31.182 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:15.624176+0000", 2024-04-18T14:44:31.182 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0061902440000000001 2024-04-18T14:44:31.182 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:31.182 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:31.182 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-04-18T14:44:31.182 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:15.627620+0000", 2024-04-18T14:44:31.182 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.003443256 2024-04-18T14:44:31.182 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:31.182 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:31.182 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-04-18T14:44:31.182 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:15.627762+0000", 2024-04-18T14:44:31.182 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00014245100000000001 2024-04-18T14:44:31.183 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:44:31.183 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-04-18T14:44:31.183 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:44:31.183 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:31.183 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:31.183 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4559.0:808 3.9s0 3:9ca71dbb:::smithi13430248-12:head [append 0~507904] snapc 2b=[2b,2a,29,28,27,26,23,22,1e,1c,1a,16,14,13,11,2] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-18T14:44:31.183 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-04-18T14:44:15.618576+0000", 2024-04-18T14:44:31.183 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 15.471385006, 2024-04-18T14:44:31.183 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.014659643999999999, 2024-04-18T14:44:31.183 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-04-18T14:44:31.183 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T14:44:31.183 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-04-18T14:44:31.183 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4559", 2024-04-18T14:44:31.183 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.134:0/3113589487", 2024-04-18T14:44:31.183 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 808 2024-04-18T14:44:31.184 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:31.184 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-04-18T14:44:31.184 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:31.184 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-04-18T14:44:31.184 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:15.618576+0000", 2024-04-18T14:44:31.184 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:44:31.184 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:31.184 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:31.184 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-04-18T14:44:31.184 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:15.618576+0000", 2024-04-18T14:44:31.184 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:44:31.184 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:31.184 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:31.184 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-04-18T14:44:31.184 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:15.618569+0000", 2024-04-18T14:44:31.185 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999924 2024-04-18T14:44:31.185 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:31.185 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:31.185 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-04-18T14:44:31.185 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:15.619708+0000", 2024-04-18T14:44:31.185 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0011390580000000001 2024-04-18T14:44:31.185 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:31.185 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:31.185 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-04-18T14:44:31.185 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:15.619739+0000", 2024-04-18T14:44:31.185 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.1816000000000002e-05 2024-04-18T14:44:31.185 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:31.185 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:31.185 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-04-18T14:44:31.185 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:15.619761+0000", 2024-04-18T14:44:31.185 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.1395000000000001e-05 2024-04-18T14:44:31.186 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:31.186 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:31.186 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-04-18T14:44:31.186 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:15.620798+0000", 2024-04-18T14:44:31.186 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0010367460000000001 2024-04-18T14:44:31.186 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:31.186 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:31.186 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-04-18T14:44:31.186 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:15.620997+0000", 2024-04-18T14:44:31.186 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00019954799999999999 2024-04-18T14:44:31.186 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:31.186 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:31.186 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_started", 2024-04-18T14:44:31.186 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:15.622366+0000", 2024-04-18T14:44:31.186 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.001369005 2024-04-18T14:44:31.187 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:31.187 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:31.187 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_committed", 2024-04-18T14:44:31.187 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:15.627882+0000", 2024-04-18T14:44:31.187 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0055155689999999997 2024-04-18T14:44:31.187 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:31.187 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:31.187 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-04-18T14:44:31.187 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:15.633074+0000", 2024-04-18T14:44:31.187 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0051920890000000004 2024-04-18T14:44:31.187 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:31.187 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:31.187 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-04-18T14:44:31.187 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:15.633236+0000", 2024-04-18T14:44:31.187 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00016209699999999999 2024-04-18T14:44:31.188 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:44:31.188 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-04-18T14:44:31.188 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:44:31.188 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:31.188 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:31.188 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4559.0:809 3.9s0 3:9ca71dbb:::smithi13430248-12:head [append 0~573440] snapc 2b=[2b,2a,29,28,27,26,23,22,1e,1c,1a,16,14,13,11,2] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-18T14:44:31.188 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-04-18T14:44:15.622720+0000", 2024-04-18T14:44:31.188 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 15.467241742000001, 2024-04-18T14:44:31.188 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.011233886, 2024-04-18T14:44:31.188 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-04-18T14:44:31.188 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T14:44:31.188 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-04-18T14:44:31.188 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4559", 2024-04-18T14:44:31.188 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.134:0/3113589487", 2024-04-18T14:44:31.188 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 809 2024-04-18T14:44:31.189 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:31.189 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-04-18T14:44:31.189 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:31.189 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-04-18T14:44:31.189 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:15.622720+0000", 2024-04-18T14:44:31.189 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:44:31.189 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:31.189 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:31.189 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-04-18T14:44:31.189 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:15.622720+0000", 2024-04-18T14:44:31.189 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:44:31.189 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:31.189 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:31.189 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-04-18T14:44:31.189 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:15.622713+0000", 2024-04-18T14:44:31.190 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999933 2024-04-18T14:44:31.190 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:31.190 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:31.190 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-04-18T14:44:31.190 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:15.623919+0000", 2024-04-18T14:44:31.190 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0012063989999999999 2024-04-18T14:44:31.190 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:31.190 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:31.190 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-04-18T14:44:31.190 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:15.623950+0000", 2024-04-18T14:44:31.190 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.0471999999999999e-05 2024-04-18T14:44:31.190 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:31.190 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:31.190 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-04-18T14:44:31.190 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:15.623968+0000", 2024-04-18T14:44:31.191 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.8505999999999999e-05 2024-04-18T14:44:31.191 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:31.191 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:31.191 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-04-18T14:44:31.191 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:15.624505+0000", 2024-04-18T14:44:31.191 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00053719300000000005 2024-04-18T14:44:31.191 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:31.191 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:31.191 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-04-18T14:44:31.191 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:15.624712+0000", 2024-04-18T14:44:31.191 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000207111 2024-04-18T14:44:31.191 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:31.191 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:31.191 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_started", 2024-04-18T14:44:31.191 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:15.626041+0000", 2024-04-18T14:44:31.191 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.001328271 2024-04-18T14:44:31.192 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:31.192 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:31.192 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_committed", 2024-04-18T14:44:31.192 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:15.632808+0000", 2024-04-18T14:44:31.192 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.006766935 2024-04-18T14:44:31.192 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:31.192 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:31.192 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-04-18T14:44:31.192 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:15.633782+0000", 2024-04-18T14:44:31.192 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00097387500000000002 2024-04-18T14:44:31.192 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:31.192 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:31.192 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-04-18T14:44:31.192 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:15.633953+0000", 2024-04-18T14:44:31.192 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00017191 2024-04-18T14:44:31.193 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:44:31.193 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-04-18T14:44:31.193 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:44:31.193 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:31.193 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:31.193 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4559.0:812 3.9s0 3:9ca71dbb:::smithi13430248-12:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e76)", 2024-04-18T14:44:31.193 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-04-18T14:44:15.626928+0000", 2024-04-18T14:44:31.193 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 15.463033231000001, 2024-04-18T14:44:31.193 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.013227831000000001, 2024-04-18T14:44:31.193 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-04-18T14:44:31.193 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-04-18T14:44:31.193 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-04-18T14:44:31.193 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4559", 2024-04-18T14:44:31.193 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.134:0/3113589487", 2024-04-18T14:44:31.193 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 812 2024-04-18T14:44:31.194 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:31.194 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-04-18T14:44:31.194 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:31.194 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-04-18T14:44:31.194 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:15.626928+0000", 2024-04-18T14:44:31.194 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:44:31.194 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:31.194 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:31.194 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-04-18T14:44:31.194 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:15.626928+0000", 2024-04-18T14:44:31.194 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-04-18T14:44:31.194 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:31.194 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:31.194 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-04-18T14:44:31.195 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:15.626927+0000", 2024-04-18T14:44:31.195 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999986 2024-04-18T14:44:31.195 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:31.195 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:31.195 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-04-18T14:44:31.195 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:15.626937+0000", 2024-04-18T14:44:31.195 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.0485999999999999e-05 2024-04-18T14:44:31.195 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:31.195 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:31.195 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-04-18T14:44:31.195 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:15.626949+0000", 2024-04-18T14:44:31.195 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.1603000000000001e-05 2024-04-18T14:44:31.195 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:31.195 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:31.195 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-04-18T14:44:31.196 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:15.626957+0000", 2024-04-18T14:44:31.196 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.2700000000000004e-06 2024-04-18T14:44:31.196 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:31.196 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:31.196 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-04-18T14:44:31.196 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:15.634970+0000", 2024-04-18T14:44:31.196 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0080123959999999998 2024-04-18T14:44:31.196 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:31.196 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:31.196 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for rw locks", 2024-04-18T14:44:31.196 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:15.635115+0000", 2024-04-18T14:44:31.196 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00014588099999999999 2024-04-18T14:44:31.196 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:31.196 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:31.196 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-04-18T14:44:31.197 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:15.638034+0000", 2024-04-18T14:44:31.197 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.002918318 2024-04-18T14:44:31.197 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:31.197 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:31.197 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-04-18T14:44:31.197 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:15.638157+0000", 2024-04-18T14:44:31.197 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00012356499999999999 2024-04-18T14:44:31.197 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-04-18T14:44:31.197 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-04-18T14:44:31.197 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-04-18T14:44:31.197 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-04-18T14:44:15.640156+0000", 2024-04-18T14:44:31.197 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0019986219999999998 2024-04-18T14:44:31.197 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:44:31.197 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-04-18T14:44:31.197 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:44:31.198 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-04-18T14:44:31.198 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-04-18T14:44:31.198 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-04-18T14:44:31.199 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-18T14:44:31.330 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2024-04-18T14:44:31.330 INFO:teuthology.orchestra.run.smithi096.stdout: "ops": [], 2024-04-18T14:44:31.330 INFO:teuthology.orchestra.run.smithi096.stdout: "num_ops": 0 2024-04-18T14:44:31.331 INFO:teuthology.orchestra.run.smithi096.stdout:} 2024-04-18T14:44:31.344 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-18T14:44:31.466 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2024-04-18T14:44:31.466 INFO:teuthology.orchestra.run.smithi096.stdout: "ops": [], 2024-04-18T14:44:31.466 INFO:teuthology.orchestra.run.smithi096.stdout: "complaint_time": 30, 2024-04-18T14:44:31.466 INFO:teuthology.orchestra.run.smithi096.stdout: "num_blocked_ops": 0 2024-04-18T14:44:31.466 INFO:teuthology.orchestra.run.smithi096.stdout:} 2024-04-18T14:44:31.481 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-18T14:44:31.606 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2024-04-18T14:44:31.607 INFO:teuthology.orchestra.run.smithi096.stdout: "size": 20, 2024-04-18T14:44:31.607 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 600, 2024-04-18T14:44:31.607 INFO:teuthology.orchestra.run.smithi096.stdout: "ops": [ 2024-04-18T14:44:31.607 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:31.607 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "MOSDECSubOpWrite(3.es2 78/70 ECSubWrite(tid=101, reqid=osd.8.0:101, at_version=78'80, trim_to=0'0, roll_forward_to=76'78))", 2024-04-18T14:44:31.607 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-04-18T14:44:17.427679+0000", 2024-04-18T14:44:31.607 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 14.178640768999999, 2024-04-18T14:44:31.608 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.007927178, 2024-04-18T14:44:31.608 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-04-18T14:44:31.608 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "reached pg", 2024-04-18T14:44:31.608 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-04-18T14:44:31.608 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:31.608 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-04-18T14:44:31.608 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:17.427679+0000", 2024-04-18T14:44:31.608 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:44:31.609 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:31.609 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:31.609 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-04-18T14:44:31.609 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:17.427679+0000", 2024-04-18T14:44:31.609 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:44:31.610 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:31.610 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:31.610 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-04-18T14:44:31.610 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:17.427678+0000", 2024-04-18T14:44:31.610 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 4294967295.9999995 2024-04-18T14:44:31.610 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:31.610 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:31.611 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-04-18T14:44:31.611 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:17.427722+0000", 2024-04-18T14:44:31.611 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 4.3551999999999999e-05 2024-04-18T14:44:31.611 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:31.611 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:31.611 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-04-18T14:44:31.611 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:17.427744+0000", 2024-04-18T14:44:31.611 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.2133e-05 2024-04-18T14:44:31.611 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:31.611 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:31.611 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-04-18T14:44:31.612 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:17.427762+0000", 2024-04-18T14:44:31.612 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.7866000000000001e-05 2024-04-18T14:44:31.612 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:31.612 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:31.612 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-04-18T14:44:31.612 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:17.427936+0000", 2024-04-18T14:44:31.612 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00017411999999999999 2024-04-18T14:44:31.612 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:31.612 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:31.613 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_started", 2024-04-18T14:44:31.613 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:17.428000+0000", 2024-04-18T14:44:31.613 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 6.4596000000000003e-05 2024-04-18T14:44:31.613 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:31.613 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:31.613 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_committed", 2024-04-18T14:44:31.613 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:17.435546+0000", 2024-04-18T14:44:31.614 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0075452119999999999 2024-04-18T14:44:31.614 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:31.614 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:31.614 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-04-18T14:44:31.614 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:17.435606+0000", 2024-04-18T14:44:31.615 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 6.0222e-05 2024-04-18T14:44:31.615 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:44:31.615 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T14:44:31.615 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:44:31.615 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:31.615 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:31.615 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "MOSDECSubOpWrite(3.es2 78/70 ECSubWrite(tid=102, reqid=osd.8.0:102, at_version=78'82, trim_to=0'0, roll_forward_to=76'78))", 2024-04-18T14:44:31.615 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-04-18T14:44:17.429653+0000", 2024-04-18T14:44:31.615 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 14.176666393, 2024-04-18T14:44:31.616 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0088783409999999997, 2024-04-18T14:44:31.616 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-04-18T14:44:31.616 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "reached pg", 2024-04-18T14:44:31.616 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-04-18T14:44:31.616 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:31.616 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-04-18T14:44:31.616 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:17.429653+0000", 2024-04-18T14:44:31.616 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:44:31.617 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:31.617 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:31.617 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-04-18T14:44:31.617 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:17.429653+0000", 2024-04-18T14:44:31.617 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:44:31.617 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:31.618 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:31.618 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-04-18T14:44:31.618 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:17.429651+0000", 2024-04-18T14:44:31.618 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 4294967295.9999986 2024-04-18T14:44:31.618 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:31.618 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:31.618 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-04-18T14:44:31.618 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:17.429703+0000", 2024-04-18T14:44:31.618 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 5.1876000000000003e-05 2024-04-18T14:44:31.621 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:31.622 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:31.622 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-04-18T14:44:31.622 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:17.429732+0000", 2024-04-18T14:44:31.622 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.8433e-05 2024-04-18T14:44:31.622 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:31.623 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:31.623 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-04-18T14:44:31.623 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:17.429752+0000", 2024-04-18T14:44:31.623 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.0112999999999999e-05 2024-04-18T14:44:31.623 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:31.623 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:31.623 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-04-18T14:44:31.623 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:17.430519+0000", 2024-04-18T14:44:31.623 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00076738200000000005 2024-04-18T14:44:31.624 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:31.624 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:31.624 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_started", 2024-04-18T14:44:31.624 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:17.430547+0000", 2024-04-18T14:44:31.624 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.8189000000000001e-05 2024-04-18T14:44:31.625 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:31.625 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:31.625 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_committed", 2024-04-18T14:44:31.625 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:17.438477+0000", 2024-04-18T14:44:31.625 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0079292689999999992 2024-04-18T14:44:31.625 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:31.625 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:31.625 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-04-18T14:44:31.625 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:17.438531+0000", 2024-04-18T14:44:31.625 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 5.4648999999999998e-05 2024-04-18T14:44:31.625 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:44:31.625 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T14:44:31.625 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:44:31.625 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:31.625 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:31.626 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "MOSDECSubOpWrite(3.8s6 78/73 ECSubWrite(tid=206, reqid=osd.5.0:206, at_version=78'145, trim_to=0'0, roll_forward_to=78'141))", 2024-04-18T14:44:31.626 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-04-18T14:44:17.431226+0000", 2024-04-18T14:44:31.626 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 14.175093645, 2024-04-18T14:44:31.626 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.012993625999999999, 2024-04-18T14:44:31.626 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-04-18T14:44:31.626 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "reached pg", 2024-04-18T14:44:31.626 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-04-18T14:44:31.626 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:31.626 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-04-18T14:44:31.626 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:17.431226+0000", 2024-04-18T14:44:31.626 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:44:31.626 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:31.627 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:31.627 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-04-18T14:44:31.627 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:17.431226+0000", 2024-04-18T14:44:31.627 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:44:31.627 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:31.627 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:31.627 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-04-18T14:44:31.627 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:17.431225+0000", 2024-04-18T14:44:31.627 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 4294967295.999999 2024-04-18T14:44:31.627 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:31.627 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:31.627 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-04-18T14:44:31.627 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:17.431296+0000", 2024-04-18T14:44:31.627 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 7.1520999999999995e-05 2024-04-18T14:44:31.627 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:31.628 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:31.628 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-04-18T14:44:31.628 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:17.431321+0000", 2024-04-18T14:44:31.628 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.4700000000000001e-05 2024-04-18T14:44:31.628 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:31.628 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:31.628 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-04-18T14:44:31.628 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:17.431340+0000", 2024-04-18T14:44:31.628 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.8496e-05 2024-04-18T14:44:31.628 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:31.628 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:31.628 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-04-18T14:44:31.628 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:17.434108+0000", 2024-04-18T14:44:31.628 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0027687950000000001 2024-04-18T14:44:31.629 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:31.629 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:31.629 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_started", 2024-04-18T14:44:31.629 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:17.434130+0000", 2024-04-18T14:44:31.629 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.1696e-05 2024-04-18T14:44:31.629 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:31.629 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:31.629 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_committed", 2024-04-18T14:44:31.629 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:17.444155+0000", 2024-04-18T14:44:31.629 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.010025259 2024-04-18T14:44:31.629 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:31.629 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:31.630 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-04-18T14:44:31.630 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:17.444219+0000", 2024-04-18T14:44:31.630 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 6.4018999999999998e-05 2024-04-18T14:44:31.630 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:44:31.630 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T14:44:31.630 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:44:31.630 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:31.630 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:31.630 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "MOSDECSubOpWrite(3.2s5 78/70 ECSubWrite(tid=285, reqid=osd.13.0:285, at_version=78'50, trim_to=0'0, roll_forward_to=76'46))", 2024-04-18T14:44:31.630 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-04-18T14:44:17.432126+0000", 2024-04-18T14:44:31.630 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 14.174193706000001, 2024-04-18T14:44:31.630 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.013533366999999999, 2024-04-18T14:44:31.630 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-04-18T14:44:31.630 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "reached pg", 2024-04-18T14:44:31.631 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-04-18T14:44:31.631 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:31.631 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-04-18T14:44:31.631 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:17.432126+0000", 2024-04-18T14:44:31.631 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:44:31.631 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:31.631 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:31.631 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-04-18T14:44:31.631 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:17.432126+0000", 2024-04-18T14:44:31.631 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:44:31.631 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:31.631 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:31.631 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-04-18T14:44:31.631 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:17.432124+0000", 2024-04-18T14:44:31.631 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 4294967295.9999986 2024-04-18T14:44:31.632 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:31.632 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:31.632 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-04-18T14:44:31.632 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:17.432174+0000", 2024-04-18T14:44:31.632 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 4.9431999999999997e-05 2024-04-18T14:44:31.632 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:31.633 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:31.633 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-04-18T14:44:31.633 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:17.432201+0000", 2024-04-18T14:44:31.633 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.7328999999999999e-05 2024-04-18T14:44:31.633 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:31.633 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:31.633 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-04-18T14:44:31.633 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:17.432222+0000", 2024-04-18T14:44:31.633 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.0497e-05 2024-04-18T14:44:31.633 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:31.634 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:31.634 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-04-18T14:44:31.634 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:17.433336+0000", 2024-04-18T14:44:31.634 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.001114142 2024-04-18T14:44:31.634 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:31.634 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:31.634 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_started", 2024-04-18T14:44:31.634 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:17.433362+0000", 2024-04-18T14:44:31.634 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.6409000000000001e-05 2024-04-18T14:44:31.634 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:31.634 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:31.634 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_committed", 2024-04-18T14:44:31.634 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:17.445589+0000", 2024-04-18T14:44:31.634 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.012226765000000001 2024-04-18T14:44:31.635 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:31.635 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:31.635 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-04-18T14:44:31.635 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:17.445659+0000", 2024-04-18T14:44:31.635 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 7.0018999999999995e-05 2024-04-18T14:44:31.635 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:44:31.635 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T14:44:31.635 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:44:31.635 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:31.635 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:31.635 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "MOSDECSubOpWrite(3.6s2 78/70 ECSubWrite(tid=279, reqid=osd.14.0:279, at_version=78'115, trim_to=0'0, roll_forward_to=77'111))", 2024-04-18T14:44:31.635 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-04-18T14:44:17.434316+0000", 2024-04-18T14:44:31.636 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 14.172003206999999, 2024-04-18T14:44:31.636 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.011331341999999999, 2024-04-18T14:44:31.636 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-04-18T14:44:31.636 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "reached pg", 2024-04-18T14:44:31.636 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-04-18T14:44:31.636 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:31.636 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-04-18T14:44:31.636 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:17.434316+0000", 2024-04-18T14:44:31.636 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:44:31.636 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:31.636 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:31.636 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-04-18T14:44:31.636 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:17.434316+0000", 2024-04-18T14:44:31.636 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:44:31.637 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:31.637 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:31.637 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-04-18T14:44:31.637 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:17.434315+0000", 2024-04-18T14:44:31.637 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 4294967295.9999986 2024-04-18T14:44:31.637 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:31.637 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:31.637 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-04-18T14:44:31.637 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:17.434356+0000", 2024-04-18T14:44:31.637 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 4.1245999999999998e-05 2024-04-18T14:44:31.637 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:31.637 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:31.637 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-04-18T14:44:31.637 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:17.434379+0000", 2024-04-18T14:44:31.638 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.2923000000000001e-05 2024-04-18T14:44:31.638 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:31.638 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:31.638 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-04-18T14:44:31.638 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:17.434393+0000", 2024-04-18T14:44:31.638 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.3502999999999999e-05 2024-04-18T14:44:31.638 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:31.638 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:31.638 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-04-18T14:44:31.638 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:17.434828+0000", 2024-04-18T14:44:31.638 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00043581300000000001 2024-04-18T14:44:31.638 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:31.638 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:31.639 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_started", 2024-04-18T14:44:31.639 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:17.434838+0000", 2024-04-18T14:44:31.639 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 9.2760000000000006e-06 2024-04-18T14:44:31.639 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:31.639 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:31.639 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_committed", 2024-04-18T14:44:31.639 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:17.445611+0000", 2024-04-18T14:44:31.639 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.01077316 2024-04-18T14:44:31.639 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:31.639 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:31.640 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-04-18T14:44:31.640 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:17.445648+0000", 2024-04-18T14:44:31.640 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.6671000000000002e-05 2024-04-18T14:44:31.640 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:44:31.640 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T14:44:31.640 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:44:31.640 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:31.640 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:31.640 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "MOSDECSubOpWrite(3.as2 78/70 ECSubWrite(tid=96, reqid=osd.3.0:96, at_version=78'63, trim_to=0'0, roll_forward_to=72'61))", 2024-04-18T14:44:31.640 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-04-18T14:44:17.434467+0000", 2024-04-18T14:44:31.640 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 14.171852313, 2024-04-18T14:44:31.640 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.01124319, 2024-04-18T14:44:31.640 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-04-18T14:44:31.640 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "reached pg", 2024-04-18T14:44:31.641 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-04-18T14:44:31.641 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:31.641 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-04-18T14:44:31.641 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:17.434467+0000", 2024-04-18T14:44:31.641 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:44:31.641 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:31.641 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:31.641 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-04-18T14:44:31.641 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:17.434467+0000", 2024-04-18T14:44:31.641 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:44:31.641 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:31.641 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:31.641 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-04-18T14:44:31.641 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:17.434467+0000", 2024-04-18T14:44:31.641 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 4294967295.9999995 2024-04-18T14:44:31.642 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:31.642 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:31.642 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-04-18T14:44:31.642 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:17.434515+0000", 2024-04-18T14:44:31.642 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 4.8392e-05 2024-04-18T14:44:31.642 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:31.642 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:31.642 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-04-18T14:44:31.642 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:17.434536+0000", 2024-04-18T14:44:31.642 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.1078999999999999e-05 2024-04-18T14:44:31.642 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:31.643 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:31.643 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-04-18T14:44:31.643 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:17.434554+0000", 2024-04-18T14:44:31.643 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.7773000000000001e-05 2024-04-18T14:44:31.643 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:31.643 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:31.643 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-04-18T14:44:31.643 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:17.435030+0000", 2024-04-18T14:44:31.643 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000475737 2024-04-18T14:44:31.643 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:31.643 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:31.643 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_started", 2024-04-18T14:44:31.643 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:17.435046+0000", 2024-04-18T14:44:31.643 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.6137000000000002e-05 2024-04-18T14:44:31.644 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:31.644 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:31.644 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_committed", 2024-04-18T14:44:31.644 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:17.445674+0000", 2024-04-18T14:44:31.644 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.010627862 2024-04-18T14:44:31.644 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:31.644 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:31.644 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-04-18T14:44:31.644 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:17.445710+0000", 2024-04-18T14:44:31.644 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.6786000000000003e-05 2024-04-18T14:44:31.644 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:44:31.644 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T14:44:31.644 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:44:31.644 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:31.645 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:31.645 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "MOSDECSubOpWrite(3.bs2 78/70 ECSubWrite(tid=95, reqid=osd.10.0:95, at_version=78'44, trim_to=0'0, roll_forward_to=77'40))", 2024-04-18T14:44:31.645 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-04-18T14:44:17.436210+0000", 2024-04-18T14:44:31.645 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 14.170109548999999, 2024-04-18T14:44:31.645 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0093763460000000007, 2024-04-18T14:44:31.645 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-04-18T14:44:31.645 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "reached pg", 2024-04-18T14:44:31.645 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-04-18T14:44:31.645 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:31.645 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-04-18T14:44:31.645 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:17.436210+0000", 2024-04-18T14:44:31.645 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:44:31.645 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:31.645 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:31.645 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-04-18T14:44:31.646 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:17.436210+0000", 2024-04-18T14:44:31.646 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:44:31.646 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:31.646 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:31.646 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-04-18T14:44:31.646 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:17.436209+0000", 2024-04-18T14:44:31.646 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 4294967295.999999 2024-04-18T14:44:31.646 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:31.646 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:31.646 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-04-18T14:44:31.646 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:17.436233+0000", 2024-04-18T14:44:31.646 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.3859999999999999e-05 2024-04-18T14:44:31.646 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:31.646 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:31.647 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-04-18T14:44:31.647 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:17.436247+0000", 2024-04-18T14:44:31.647 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.4134999999999999e-05 2024-04-18T14:44:31.647 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:31.647 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:31.647 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-04-18T14:44:31.647 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:17.436269+0000", 2024-04-18T14:44:31.647 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.1532e-05 2024-04-18T14:44:31.647 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:31.647 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:31.647 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-04-18T14:44:31.647 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:17.436452+0000", 2024-04-18T14:44:31.647 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00018317299999999999 2024-04-18T14:44:31.647 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:31.647 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:31.648 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_started", 2024-04-18T14:44:31.648 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:17.436475+0000", 2024-04-18T14:44:31.648 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.2869000000000001e-05 2024-04-18T14:44:31.648 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:31.648 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:31.648 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_committed", 2024-04-18T14:44:31.648 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:17.445494+0000", 2024-04-18T14:44:31.648 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0090194920000000005 2024-04-18T14:44:31.648 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:31.648 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:31.648 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-04-18T14:44:31.648 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:17.445586+0000", 2024-04-18T14:44:31.648 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 9.2128999999999998e-05 2024-04-18T14:44:31.648 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:44:31.648 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T14:44:31.649 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:44:31.649 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:31.649 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:31.649 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "MOSDECSubOpWrite(3.as2 78/70 ECSubWrite(tid=97, reqid=osd.3.0:97, at_version=78'65, trim_to=0'0, roll_forward_to=72'61))", 2024-04-18T14:44:31.649 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-04-18T14:44:17.436489+0000", 2024-04-18T14:44:31.649 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 14.169830875000001, 2024-04-18T14:44:31.649 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.011624206, 2024-04-18T14:44:31.649 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-04-18T14:44:31.649 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "reached pg", 2024-04-18T14:44:31.649 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-04-18T14:44:31.649 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:31.649 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-04-18T14:44:31.649 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:17.436489+0000", 2024-04-18T14:44:31.649 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:44:31.649 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:31.650 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:31.650 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-04-18T14:44:31.650 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:17.436489+0000", 2024-04-18T14:44:31.650 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:44:31.650 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:31.650 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:31.650 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-04-18T14:44:31.650 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:17.436482+0000", 2024-04-18T14:44:31.650 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 4294967295.9999933 2024-04-18T14:44:31.650 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:31.650 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:31.650 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-04-18T14:44:31.650 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:17.436529+0000", 2024-04-18T14:44:31.650 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 4.7580999999999997e-05 2024-04-18T14:44:31.650 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:31.651 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:31.651 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-04-18T14:44:31.651 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:17.436553+0000", 2024-04-18T14:44:31.651 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.3810000000000001e-05 2024-04-18T14:44:31.651 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:31.651 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:31.651 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-04-18T14:44:31.651 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:17.436608+0000", 2024-04-18T14:44:31.651 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 5.4829e-05 2024-04-18T14:44:31.651 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:31.651 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:31.651 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-04-18T14:44:31.651 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:17.444713+0000", 2024-04-18T14:44:31.651 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0081046580000000007 2024-04-18T14:44:31.651 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:31.652 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:31.652 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_started", 2024-04-18T14:44:31.652 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:17.444737+0000", 2024-04-18T14:44:31.652 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.4757e-05 2024-04-18T14:44:31.652 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:31.652 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:31.652 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_committed", 2024-04-18T14:44:31.652 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:17.448060+0000", 2024-04-18T14:44:31.652 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0033228670000000002 2024-04-18T14:44:31.652 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:31.652 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:31.652 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-04-18T14:44:31.652 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:17.448113+0000", 2024-04-18T14:44:31.652 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 5.2522000000000003e-05 2024-04-18T14:44:31.652 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:44:31.653 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T14:44:31.653 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:44:31.653 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:31.653 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:31.653 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "MOSDECSubOpWrite(3.9s1 78/73 ECSubWrite(tid=196, reqid=osd.12.0:196, at_version=78'137, trim_to=0'0, roll_forward_to=76'135))", 2024-04-18T14:44:31.653 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-04-18T14:44:17.436706+0000", 2024-04-18T14:44:31.653 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 14.169613819, 2024-04-18T14:44:31.653 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0088841930000000003, 2024-04-18T14:44:31.653 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-04-18T14:44:31.653 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "reached pg", 2024-04-18T14:44:31.653 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-04-18T14:44:31.653 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:31.653 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-04-18T14:44:31.653 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:17.436706+0000", 2024-04-18T14:44:31.653 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:44:31.654 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:31.654 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:31.654 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-04-18T14:44:31.654 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:17.436706+0000", 2024-04-18T14:44:31.654 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:44:31.654 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:31.654 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:31.654 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-04-18T14:44:31.654 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:17.436705+0000", 2024-04-18T14:44:31.654 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 4294967295.9999995 2024-04-18T14:44:31.654 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:31.654 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:31.654 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-04-18T14:44:31.654 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:17.436742+0000", 2024-04-18T14:44:31.655 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.7064999999999998e-05 2024-04-18T14:44:31.655 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:31.655 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:31.655 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-04-18T14:44:31.655 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:17.436760+0000", 2024-04-18T14:44:31.655 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.774e-05 2024-04-18T14:44:31.655 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:31.655 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:31.655 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-04-18T14:44:31.655 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:17.436774+0000", 2024-04-18T14:44:31.655 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.4494e-05 2024-04-18T14:44:31.655 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:31.655 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:31.655 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-04-18T14:44:31.656 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:17.436923+0000", 2024-04-18T14:44:31.656 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00014905699999999999 2024-04-18T14:44:31.656 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:31.656 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:31.656 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_started", 2024-04-18T14:44:31.656 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:17.436949+0000", 2024-04-18T14:44:31.656 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.5279999999999999e-05 2024-04-18T14:44:31.656 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:31.656 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:31.656 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_committed", 2024-04-18T14:44:31.656 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:17.445565+0000", 2024-04-18T14:44:31.656 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0086166309999999996 2024-04-18T14:44:31.656 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:31.656 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:31.656 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-04-18T14:44:31.657 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:17.445590+0000", 2024-04-18T14:44:31.657 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.4451999999999999e-05 2024-04-18T14:44:31.657 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:44:31.657 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T14:44:31.657 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:44:31.657 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:31.657 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:31.657 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "MOSDECSubOpWrite(3.6s2 82/70 ECSubWrite(tid=318, reqid=osd.14.0:318, at_version=82'140, trim_to=0'0, roll_forward_to=81'138))", 2024-04-18T14:44:31.657 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-04-18T14:44:21.459557+0000", 2024-04-18T14:44:31.657 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 10.146762217999999, 2024-04-18T14:44:31.657 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.015194288, 2024-04-18T14:44:31.657 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-04-18T14:44:31.657 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "reached pg", 2024-04-18T14:44:31.657 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-04-18T14:44:31.658 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:31.658 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-04-18T14:44:31.658 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:21.459557+0000", 2024-04-18T14:44:31.658 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:44:31.658 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:31.658 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:31.658 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-04-18T14:44:31.658 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:21.459557+0000", 2024-04-18T14:44:31.658 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:44:31.658 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:31.658 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:31.658 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-04-18T14:44:31.658 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:21.459556+0000", 2024-04-18T14:44:31.658 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 4294967295.9999995 2024-04-18T14:44:31.659 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:31.659 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:31.659 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-04-18T14:44:31.659 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:21.459602+0000", 2024-04-18T14:44:31.659 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 4.5503000000000001e-05 2024-04-18T14:44:31.659 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:31.659 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:31.659 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-04-18T14:44:31.659 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:21.459632+0000", 2024-04-18T14:44:31.659 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.9893e-05 2024-04-18T14:44:31.659 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:31.659 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:31.659 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-04-18T14:44:31.659 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:21.459652+0000", 2024-04-18T14:44:31.660 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.9882e-05 2024-04-18T14:44:31.660 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:31.660 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:31.660 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-04-18T14:44:31.660 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:21.459794+0000", 2024-04-18T14:44:31.660 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00014235800000000001 2024-04-18T14:44:31.660 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:31.660 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:31.660 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_started", 2024-04-18T14:44:31.660 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:21.459822+0000", 2024-04-18T14:44:31.660 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.7725999999999998e-05 2024-04-18T14:44:31.660 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:31.660 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:31.660 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_committed", 2024-04-18T14:44:31.660 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:21.474685+0000", 2024-04-18T14:44:31.660 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.014863604000000001 2024-04-18T14:44:31.661 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:31.661 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:31.661 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-04-18T14:44:31.661 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:21.474751+0000", 2024-04-18T14:44:31.661 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 6.6021999999999999e-05 2024-04-18T14:44:31.661 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:44:31.661 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T14:44:31.661 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:44:31.661 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:31.661 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:31.661 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "MOSDECSubOpWrite(3.8s6 82/73 ECSubWrite(tid=230, reqid=osd.5.0:230, at_version=82'169, trim_to=0'0, roll_forward_to=81'165))", 2024-04-18T14:44:31.661 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-04-18T14:44:21.459890+0000", 2024-04-18T14:44:31.661 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 10.146429599999999, 2024-04-18T14:44:31.661 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.011622507000000001, 2024-04-18T14:44:31.662 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-04-18T14:44:31.662 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "reached pg", 2024-04-18T14:44:31.662 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-04-18T14:44:31.662 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:31.662 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-04-18T14:44:31.662 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:21.459890+0000", 2024-04-18T14:44:31.662 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:44:31.662 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:31.662 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:31.662 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-04-18T14:44:31.662 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:21.459890+0000", 2024-04-18T14:44:31.662 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:44:31.662 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:31.663 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:31.663 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-04-18T14:44:31.663 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:21.459888+0000", 2024-04-18T14:44:31.663 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 4294967295.9999986 2024-04-18T14:44:31.663 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:31.663 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:31.663 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-04-18T14:44:31.663 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:21.459940+0000", 2024-04-18T14:44:31.663 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 5.1579000000000002e-05 2024-04-18T14:44:31.663 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:31.663 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:31.663 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-04-18T14:44:31.663 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:21.459967+0000", 2024-04-18T14:44:31.663 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.7523000000000001e-05 2024-04-18T14:44:31.663 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:31.663 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:31.664 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-04-18T14:44:31.664 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:21.459993+0000", 2024-04-18T14:44:31.664 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.5199999999999999e-05 2024-04-18T14:44:31.664 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:31.664 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:31.664 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-04-18T14:44:31.664 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:21.460102+0000", 2024-04-18T14:44:31.664 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000109221 2024-04-18T14:44:31.664 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:31.664 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:31.664 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_started", 2024-04-18T14:44:31.664 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:21.460128+0000", 2024-04-18T14:44:31.664 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.6112999999999999e-05 2024-04-18T14:44:31.664 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:31.665 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:31.665 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_committed", 2024-04-18T14:44:31.665 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:21.471397+0000", 2024-04-18T14:44:31.665 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.011269276999999999 2024-04-18T14:44:31.665 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:31.665 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:31.665 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-04-18T14:44:31.665 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:21.471512+0000", 2024-04-18T14:44:31.665 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000115198 2024-04-18T14:44:31.665 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:44:31.665 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T14:44:31.665 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:44:31.665 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:31.665 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:31.666 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "MOSDECSubOpWrite(3.es2 82/70 ECSubWrite(tid=117, reqid=osd.8.0:116, at_version=0'0, trim_to=0'0, roll_forward_to=82'98))", 2024-04-18T14:44:31.666 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-04-18T14:44:21.463649+0000", 2024-04-18T14:44:31.666 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 10.142670534000001, 2024-04-18T14:44:31.666 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.011147066000000001, 2024-04-18T14:44:31.666 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-04-18T14:44:31.666 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "reached pg", 2024-04-18T14:44:31.666 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-04-18T14:44:31.666 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:31.666 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-04-18T14:44:31.666 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:21.463649+0000", 2024-04-18T14:44:31.666 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:44:31.666 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:31.666 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:31.667 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-04-18T14:44:31.667 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:21.463649+0000", 2024-04-18T14:44:31.667 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:44:31.667 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:31.667 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:31.667 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-04-18T14:44:31.667 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:21.463647+0000", 2024-04-18T14:44:31.667 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 4294967295.9999981 2024-04-18T14:44:31.667 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:31.667 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:31.667 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-04-18T14:44:31.667 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:21.463681+0000", 2024-04-18T14:44:31.667 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.3769999999999997e-05 2024-04-18T14:44:31.667 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:31.667 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:31.668 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-04-18T14:44:31.668 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:21.463713+0000", 2024-04-18T14:44:31.668 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.2274999999999998e-05 2024-04-18T14:44:31.668 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:31.668 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:31.668 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-04-18T14:44:31.668 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:21.463740+0000", 2024-04-18T14:44:31.668 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.7064e-05 2024-04-18T14:44:31.668 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:31.668 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:31.668 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-04-18T14:44:31.668 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:21.463964+0000", 2024-04-18T14:44:31.668 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00022403599999999999 2024-04-18T14:44:31.668 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:31.669 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:31.669 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_started", 2024-04-18T14:44:31.669 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:21.463988+0000", 2024-04-18T14:44:31.669 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.3901999999999999e-05 2024-04-18T14:44:31.669 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:31.669 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:31.669 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_committed", 2024-04-18T14:44:31.669 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:21.474764+0000", 2024-04-18T14:44:31.669 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.010775886 2024-04-18T14:44:31.669 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:31.669 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:31.669 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-04-18T14:44:31.669 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:21.474796+0000", 2024-04-18T14:44:31.669 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.2116000000000002e-05 2024-04-18T14:44:31.670 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:44:31.670 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T14:44:31.670 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:44:31.670 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:31.670 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:31.670 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "MOSDECSubOpWrite(3.es2 82/70 ECSubWrite(tid=118, reqid=osd.8.0:118, at_version=82'100, trim_to=0'0, roll_forward_to=82'98))", 2024-04-18T14:44:31.670 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-04-18T14:44:21.463778+0000", 2024-04-18T14:44:31.670 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 10.142541362999999, 2024-04-18T14:44:31.670 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.011049498, 2024-04-18T14:44:31.670 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-04-18T14:44:31.670 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "reached pg", 2024-04-18T14:44:31.670 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-04-18T14:44:31.670 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:31.670 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-04-18T14:44:31.670 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:21.463778+0000", 2024-04-18T14:44:31.671 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:44:31.671 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:31.671 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:31.671 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-04-18T14:44:31.671 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:21.463778+0000", 2024-04-18T14:44:31.671 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:44:31.671 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:31.671 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:31.671 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-04-18T14:44:31.671 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:21.463777+0000", 2024-04-18T14:44:31.671 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 4294967295.999999 2024-04-18T14:44:31.671 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:31.671 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:31.671 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-04-18T14:44:31.671 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:21.463837+0000", 2024-04-18T14:44:31.672 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 6.0109000000000003e-05 2024-04-18T14:44:31.672 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:31.672 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:31.672 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-04-18T14:44:31.672 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:21.463878+0000", 2024-04-18T14:44:31.672 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 4.0519000000000003e-05 2024-04-18T14:44:31.672 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:31.672 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:31.672 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-04-18T14:44:31.672 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:21.463898+0000", 2024-04-18T14:44:31.672 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.9899999999999999e-05 2024-04-18T14:44:31.672 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:31.672 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:31.672 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-04-18T14:44:31.672 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:21.464514+0000", 2024-04-18T14:44:31.673 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00061609900000000005 2024-04-18T14:44:31.673 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:31.673 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:31.673 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_started", 2024-04-18T14:44:31.673 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:21.464538+0000", 2024-04-18T14:44:31.673 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.4239999999999998e-05 2024-04-18T14:44:31.673 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:31.673 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:31.673 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_committed", 2024-04-18T14:44:31.673 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:21.474799+0000", 2024-04-18T14:44:31.673 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.010261533999999999 2024-04-18T14:44:31.673 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:31.673 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:31.673 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-04-18T14:44:31.674 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:21.474828+0000", 2024-04-18T14:44:31.674 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.8143000000000001e-05 2024-04-18T14:44:31.674 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:44:31.674 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T14:44:31.674 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:44:31.674 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:31.674 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:31.674 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "MOSDECSubOpWrite(3.9s1 82/73 ECSubWrite(tid=220, reqid=osd.12.0:220, at_version=82'167, trim_to=0'0, roll_forward_to=81'165))", 2024-04-18T14:44:31.674 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-04-18T14:44:21.464358+0000", 2024-04-18T14:44:31.674 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 10.141961193, 2024-04-18T14:44:31.674 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0077306670000000001, 2024-04-18T14:44:31.674 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-04-18T14:44:31.674 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "reached pg", 2024-04-18T14:44:31.674 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-04-18T14:44:31.675 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:31.675 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-04-18T14:44:31.675 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:21.464358+0000", 2024-04-18T14:44:31.675 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:44:31.675 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:31.675 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:31.675 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-04-18T14:44:31.675 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:21.464358+0000", 2024-04-18T14:44:31.675 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:44:31.675 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:31.675 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:31.675 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-04-18T14:44:31.675 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:21.464358+0000", 2024-04-18T14:44:31.675 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 4294967295.9999995 2024-04-18T14:44:31.676 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:31.676 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:31.676 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-04-18T14:44:31.676 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:21.464414+0000", 2024-04-18T14:44:31.676 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 5.6566e-05 2024-04-18T14:44:31.676 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:31.676 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:31.676 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-04-18T14:44:31.676 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:21.464441+0000", 2024-04-18T14:44:31.676 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.7246e-05 2024-04-18T14:44:31.676 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:31.676 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:31.676 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-04-18T14:44:31.676 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:21.464470+0000", 2024-04-18T14:44:31.677 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.8745999999999999e-05 2024-04-18T14:44:31.677 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:31.677 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:31.677 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-04-18T14:44:31.677 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:21.464697+0000", 2024-04-18T14:44:31.677 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00022689300000000001 2024-04-18T14:44:31.677 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:31.677 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:31.677 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_started", 2024-04-18T14:44:31.677 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:21.464724+0000", 2024-04-18T14:44:31.677 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.6455999999999999e-05 2024-04-18T14:44:31.677 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:31.677 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:31.677 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_committed", 2024-04-18T14:44:31.678 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:21.472039+0000", 2024-04-18T14:44:31.678 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0073152069999999998 2024-04-18T14:44:31.678 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:31.678 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:31.678 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-04-18T14:44:31.678 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:21.472089+0000", 2024-04-18T14:44:31.678 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 5.0093000000000003e-05 2024-04-18T14:44:31.678 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:44:31.678 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T14:44:31.678 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:44:31.678 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:31.678 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:31.678 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "MOSDECSubOpWrite(3.bs2 82/70 ECSubWrite(tid=125, reqid=osd.10.0:125, at_version=82'71, trim_to=0'0, roll_forward_to=81'67))", 2024-04-18T14:44:31.678 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-04-18T14:44:21.469940+0000", 2024-04-18T14:44:31.679 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 10.136379038999999, 2024-04-18T14:44:31.679 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0084549169999999993, 2024-04-18T14:44:31.679 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-04-18T14:44:31.679 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "reached pg", 2024-04-18T14:44:31.679 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-04-18T14:44:31.679 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:31.679 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-04-18T14:44:31.679 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:21.469940+0000", 2024-04-18T14:44:31.679 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:44:31.679 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:31.679 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:31.679 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-04-18T14:44:31.679 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:21.469940+0000", 2024-04-18T14:44:31.679 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:44:31.679 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:31.679 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:31.680 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-04-18T14:44:31.680 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:21.469940+0000", 2024-04-18T14:44:31.680 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 4294967295.999999 2024-04-18T14:44:31.680 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:31.680 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:31.680 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-04-18T14:44:31.680 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:21.469990+0000", 2024-04-18T14:44:31.680 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 5.0325999999999999e-05 2024-04-18T14:44:31.680 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:31.680 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:31.680 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-04-18T14:44:31.680 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:21.470011+0000", 2024-04-18T14:44:31.680 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.0778999999999999e-05 2024-04-18T14:44:31.680 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:31.681 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:31.681 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-04-18T14:44:31.681 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:21.470028+0000", 2024-04-18T14:44:31.681 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.6929999999999999e-05 2024-04-18T14:44:31.681 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:31.681 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:31.681 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-04-18T14:44:31.681 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:21.471924+0000", 2024-04-18T14:44:31.681 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0018963669999999999 2024-04-18T14:44:31.681 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:31.681 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:31.681 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_started", 2024-04-18T14:44:31.681 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:21.471951+0000", 2024-04-18T14:44:31.681 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.7322e-05 2024-04-18T14:44:31.682 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:31.682 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:31.682 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_committed", 2024-04-18T14:44:31.682 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:21.478356+0000", 2024-04-18T14:44:31.682 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0064050770000000003 2024-04-18T14:44:31.682 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:31.682 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:31.682 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-04-18T14:44:31.682 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:21.478395+0000", 2024-04-18T14:44:31.682 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.8979000000000001e-05 2024-04-18T14:44:31.682 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:44:31.682 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T14:44:31.682 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:44:31.682 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:31.682 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:31.683 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "MOSDECSubOpWrite(3.as2 82/70 ECSubWrite(tid=112, reqid=osd.3.0:112, at_version=82'79, trim_to=0'0, roll_forward_to=80'75))", 2024-04-18T14:44:31.683 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-04-18T14:44:21.476457+0000", 2024-04-18T14:44:31.683 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 10.129862897000001, 2024-04-18T14:44:31.683 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0080011019999999995, 2024-04-18T14:44:31.683 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-04-18T14:44:31.683 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "reached pg", 2024-04-18T14:44:31.683 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-04-18T14:44:31.683 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:31.683 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-04-18T14:44:31.683 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:21.476457+0000", 2024-04-18T14:44:31.683 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:44:31.683 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:31.683 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:31.683 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-04-18T14:44:31.683 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:21.476457+0000", 2024-04-18T14:44:31.684 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:44:31.684 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:31.684 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:31.684 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-04-18T14:44:31.684 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:21.476454+0000", 2024-04-18T14:44:31.684 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 4294967295.9999981 2024-04-18T14:44:31.684 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:31.684 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:31.684 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-04-18T14:44:31.684 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:21.476510+0000", 2024-04-18T14:44:31.684 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 5.5584999999999997e-05 2024-04-18T14:44:31.684 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:31.684 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:31.684 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-04-18T14:44:31.684 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:21.476546+0000", 2024-04-18T14:44:31.685 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.5599999999999998e-05 2024-04-18T14:44:31.685 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:31.685 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:31.685 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-04-18T14:44:31.685 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:21.476569+0000", 2024-04-18T14:44:31.685 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.3393000000000001e-05 2024-04-18T14:44:31.685 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:31.685 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:31.685 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-04-18T14:44:31.685 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:21.476697+0000", 2024-04-18T14:44:31.685 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00012755399999999999 2024-04-18T14:44:31.685 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:31.685 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:31.685 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_started", 2024-04-18T14:44:31.686 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:21.476718+0000", 2024-04-18T14:44:31.686 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.1923e-05 2024-04-18T14:44:31.686 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:31.686 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:31.686 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_committed", 2024-04-18T14:44:31.686 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:21.484404+0000", 2024-04-18T14:44:31.686 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0076859739999999999 2024-04-18T14:44:31.686 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:31.686 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:31.686 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-04-18T14:44:31.686 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:21.484458+0000", 2024-04-18T14:44:31.686 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 5.3162999999999999e-05 2024-04-18T14:44:31.686 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:44:31.686 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T14:44:31.686 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:44:31.687 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:31.687 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:31.687 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "MOSDECSubOpWrite(3.9s1 82/73 ECSubWrite(tid=222, reqid=osd.12.0:221, at_version=0'0, trim_to=0'0, roll_forward_to=82'169))", 2024-04-18T14:44:31.687 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-04-18T14:44:21.480280+0000", 2024-04-18T14:44:31.687 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 10.126039562000001, 2024-04-18T14:44:31.687 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0079078399999999993, 2024-04-18T14:44:31.687 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-04-18T14:44:31.687 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "reached pg", 2024-04-18T14:44:31.687 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-04-18T14:44:31.687 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:31.687 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-04-18T14:44:31.687 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:21.480280+0000", 2024-04-18T14:44:31.687 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:44:31.687 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:31.688 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:31.688 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-04-18T14:44:31.688 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:21.480280+0000", 2024-04-18T14:44:31.688 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:44:31.688 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:31.688 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:31.688 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-04-18T14:44:31.688 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:21.480270+0000", 2024-04-18T14:44:31.688 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 4294967295.9999905 2024-04-18T14:44:31.688 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:31.688 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:31.688 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-04-18T14:44:31.688 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:21.480309+0000", 2024-04-18T14:44:31.688 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.9005999999999999e-05 2024-04-18T14:44:31.689 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:31.689 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:31.689 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-04-18T14:44:31.689 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:21.480337+0000", 2024-04-18T14:44:31.689 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.7182000000000002e-05 2024-04-18T14:44:31.689 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:31.689 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:31.689 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-04-18T14:44:31.689 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:21.480358+0000", 2024-04-18T14:44:31.689 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.1407e-05 2024-04-18T14:44:31.689 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:31.689 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:31.689 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-04-18T14:44:31.689 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:21.480536+0000", 2024-04-18T14:44:31.689 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00017776700000000001 2024-04-18T14:44:31.690 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:31.690 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:31.690 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_started", 2024-04-18T14:44:31.690 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:21.480561+0000", 2024-04-18T14:44:31.690 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.5792e-05 2024-04-18T14:44:31.690 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:31.690 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:31.690 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_committed", 2024-04-18T14:44:31.690 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:21.488121+0000", 2024-04-18T14:44:31.690 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0075599070000000003 2024-04-18T14:44:31.690 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:31.690 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:31.690 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-04-18T14:44:31.690 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:21.488188+0000", 2024-04-18T14:44:31.691 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 6.6295000000000001e-05 2024-04-18T14:44:31.691 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:44:31.691 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T14:44:31.691 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:44:31.691 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:31.691 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:31.691 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "MOSDECSubOpWrite(3.es2 82/70 ECSubWrite(tid=121, reqid=client.4559.0:914, at_version=82'102, trim_to=0'0, roll_forward_to=82'100))", 2024-04-18T14:44:31.691 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-04-18T14:44:21.484677+0000", 2024-04-18T14:44:31.691 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 10.121642788999999, 2024-04-18T14:44:31.691 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.007934188, 2024-04-18T14:44:31.691 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-04-18T14:44:31.691 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "reached pg", 2024-04-18T14:44:31.691 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-04-18T14:44:31.691 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:31.692 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-04-18T14:44:31.692 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:21.484677+0000", 2024-04-18T14:44:31.692 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:44:31.692 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:31.692 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:31.692 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-04-18T14:44:31.692 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:21.484677+0000", 2024-04-18T14:44:31.692 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:44:31.692 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:31.692 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:31.692 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-04-18T14:44:31.692 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:21.484675+0000", 2024-04-18T14:44:31.692 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 4294967295.9999981 2024-04-18T14:44:31.692 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:31.693 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:31.693 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-04-18T14:44:31.693 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:21.485027+0000", 2024-04-18T14:44:31.693 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00035239100000000002 2024-04-18T14:44:31.693 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:31.693 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:31.693 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-04-18T14:44:31.693 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:21.485057+0000", 2024-04-18T14:44:31.693 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.0066e-05 2024-04-18T14:44:31.693 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:31.693 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:31.693 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-04-18T14:44:31.693 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:21.485079+0000", 2024-04-18T14:44:31.693 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.1982999999999999e-05 2024-04-18T14:44:31.694 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:31.694 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:31.694 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-04-18T14:44:31.694 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:21.485265+0000", 2024-04-18T14:44:31.694 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00018561599999999999 2024-04-18T14:44:31.694 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:31.694 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:31.694 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_started", 2024-04-18T14:44:31.694 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:21.485300+0000", 2024-04-18T14:44:31.694 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.4629999999999999e-05 2024-04-18T14:44:31.694 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:31.694 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:31.694 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_committed", 2024-04-18T14:44:31.694 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:21.492569+0000", 2024-04-18T14:44:31.695 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.007269284 2024-04-18T14:44:31.695 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:31.695 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:31.695 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-04-18T14:44:31.695 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:21.492611+0000", 2024-04-18T14:44:31.695 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 4.1981999999999999e-05 2024-04-18T14:44:31.695 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:44:31.695 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T14:44:31.695 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:44:31.695 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:31.695 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:31.695 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "MOSDECSubOpWrite(3.8s6 82/73 ECSubWrite(tid=242, reqid=client.4559.0:933, at_version=82'181, trim_to=0'0, roll_forward_to=82'179))", 2024-04-18T14:44:31.695 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-04-18T14:44:21.735434+0000", 2024-04-18T14:44:31.695 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 9.8708856980000004, 2024-04-18T14:44:31.696 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0079862389999999991, 2024-04-18T14:44:31.696 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-04-18T14:44:31.696 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "reached pg", 2024-04-18T14:44:31.696 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-04-18T14:44:31.696 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:31.696 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-04-18T14:44:31.696 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:21.735434+0000", 2024-04-18T14:44:31.696 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:44:31.696 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:31.696 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:31.696 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-04-18T14:44:31.696 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:21.735434+0000", 2024-04-18T14:44:31.696 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:44:31.696 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:31.697 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:31.697 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-04-18T14:44:31.697 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:21.735431+0000", 2024-04-18T14:44:31.697 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 4294967295.9999971 2024-04-18T14:44:31.697 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:31.697 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:31.697 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-04-18T14:44:31.697 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:21.736828+0000", 2024-04-18T14:44:31.697 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0013970880000000001 2024-04-18T14:44:31.697 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:31.697 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:31.697 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-04-18T14:44:31.697 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:21.736890+0000", 2024-04-18T14:44:31.697 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 6.1571999999999999e-05 2024-04-18T14:44:31.697 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:31.698 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:31.698 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-04-18T14:44:31.698 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:21.736925+0000", 2024-04-18T14:44:31.698 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.5176000000000003e-05 2024-04-18T14:44:31.698 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:31.698 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:31.698 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-04-18T14:44:31.698 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:21.737071+0000", 2024-04-18T14:44:31.698 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000145761 2024-04-18T14:44:31.698 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:31.698 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:31.698 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_started", 2024-04-18T14:44:31.698 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:21.737101+0000", 2024-04-18T14:44:31.698 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.0629000000000001e-05 2024-04-18T14:44:31.699 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:31.699 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:31.699 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_committed", 2024-04-18T14:44:31.699 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:21.743355+0000", 2024-04-18T14:44:31.699 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0062541799999999998 2024-04-18T14:44:31.699 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:31.699 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:31.699 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-04-18T14:44:31.699 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:21.743420+0000", 2024-04-18T14:44:31.699 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 6.4635999999999996e-05 2024-04-18T14:44:31.699 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:44:31.699 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T14:44:31.699 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:44:31.699 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:31.699 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:31.700 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "MOSDECSubOpWrite(3.4s3 88/70 ECSubWrite(tid=160, reqid=client.4559.0:1010, at_version=88'33, trim_to=0'0, roll_forward_to=86'31))", 2024-04-18T14:44:31.700 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-04-18T14:44:27.542272+0000", 2024-04-18T14:44:31.700 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 4.0640475990000002, 2024-04-18T14:44:31.700 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.012282014000000001, 2024-04-18T14:44:31.700 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-04-18T14:44:31.700 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "reached pg", 2024-04-18T14:44:31.700 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-04-18T14:44:31.700 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:31.700 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-04-18T14:44:31.700 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:27.542272+0000", 2024-04-18T14:44:31.700 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:44:31.700 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:31.700 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:31.700 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-04-18T14:44:31.700 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:27.542272+0000", 2024-04-18T14:44:31.701 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:44:31.701 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:31.701 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:31.701 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-04-18T14:44:31.701 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:27.542270+0000", 2024-04-18T14:44:31.701 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 4294967295.9999976 2024-04-18T14:44:31.701 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:31.701 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:31.701 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-04-18T14:44:31.701 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:27.545733+0000", 2024-04-18T14:44:31.701 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0034635820000000002 2024-04-18T14:44:31.701 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:31.701 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:31.701 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-04-18T14:44:31.701 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:27.545772+0000", 2024-04-18T14:44:31.702 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.8835999999999999e-05 2024-04-18T14:44:31.702 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:31.702 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:31.702 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-04-18T14:44:31.702 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:27.545791+0000", 2024-04-18T14:44:31.702 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.878e-05 2024-04-18T14:44:31.702 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:31.702 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:31.702 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-04-18T14:44:31.702 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:27.545921+0000", 2024-04-18T14:44:31.702 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00013073800000000001 2024-04-18T14:44:31.702 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:31.702 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:31.702 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_started", 2024-04-18T14:44:31.702 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:27.545943+0000", 2024-04-18T14:44:31.703 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.1336e-05 2024-04-18T14:44:31.703 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:31.703 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:31.703 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_committed", 2024-04-18T14:44:31.703 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:27.554482+0000", 2024-04-18T14:44:31.703 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0085389660000000003 2024-04-18T14:44:31.703 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:31.703 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:31.703 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-04-18T14:44:31.703 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:27.554554+0000", 2024-04-18T14:44:31.703 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 7.2092e-05 2024-04-18T14:44:31.703 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:44:31.703 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T14:44:31.703 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:44:31.703 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:44:31.703 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T14:44:31.704 INFO:teuthology.orchestra.run.smithi096.stdout:} 2024-04-18T14:44:31.705 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-04-18T14:44:31.832 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2024-04-18T14:44:31.832 INFO:teuthology.orchestra.run.smithi096.stdout: "ops": [], 2024-04-18T14:44:31.832 INFO:teuthology.orchestra.run.smithi096.stdout: "num_ops": 0 2024-04-18T14:44:31.832 INFO:teuthology.orchestra.run.smithi096.stdout:} 2024-04-18T14:44:31.846 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-04-18T14:44:31.966 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2024-04-18T14:44:31.967 INFO:teuthology.orchestra.run.smithi096.stdout: "ops": [], 2024-04-18T14:44:31.967 INFO:teuthology.orchestra.run.smithi096.stdout: "complaint_time": 30, 2024-04-18T14:44:31.967 INFO:teuthology.orchestra.run.smithi096.stdout: "num_blocked_ops": 0 2024-04-18T14:44:31.967 INFO:teuthology.orchestra.run.smithi096.stdout:} 2024-04-18T14:44:31.981 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-04-18T14:44:32.101 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2024-04-18T14:44:32.101 INFO:teuthology.orchestra.run.smithi096.stdout: "size": 20, 2024-04-18T14:44:32.101 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 600, 2024-04-18T14:44:32.102 INFO:teuthology.orchestra.run.smithi096.stdout: "ops": [ 2024-04-18T14:44:32.102 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:32.102 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4559.0:700 3.8s0 3:1890b7c2:::smithi13430248-36:head [read 0~2277376,checksum,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e71)", 2024-04-18T14:44:32.102 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-04-18T14:44:10.450791+0000", 2024-04-18T14:44:32.102 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 21.649055595, 2024-04-18T14:44:32.102 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.0036317619999999, 2024-04-18T14:44:32.103 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-04-18T14:44:32.103 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "started", 2024-04-18T14:44:32.103 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-04-18T14:44:32.103 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4559", 2024-04-18T14:44:32.103 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "172.21.15.134:0/3113589487", 2024-04-18T14:44:32.103 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 700 2024-04-18T14:44:32.104 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:32.104 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-04-18T14:44:32.104 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:32.104 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-04-18T14:44:32.104 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:10.450791+0000", 2024-04-18T14:44:32.104 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:44:32.105 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:32.105 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:32.105 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-04-18T14:44:32.105 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:10.450791+0000", 2024-04-18T14:44:32.105 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:44:32.105 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:32.105 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:32.106 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-04-18T14:44:32.106 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:10.450787+0000", 2024-04-18T14:44:32.106 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 4294967295.9999962 2024-04-18T14:44:32.106 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:32.106 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:32.106 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-04-18T14:44:32.106 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:10.450809+0000", 2024-04-18T14:44:32.106 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.1659e-05 2024-04-18T14:44:32.107 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:32.107 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:32.107 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-04-18T14:44:32.107 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:10.450863+0000", 2024-04-18T14:44:32.107 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 5.4095999999999998e-05 2024-04-18T14:44:32.107 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:32.107 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:32.107 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-04-18T14:44:32.107 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:10.450888+0000", 2024-04-18T14:44:32.108 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.5425000000000001e-05 2024-04-18T14:44:32.108 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:32.108 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:32.108 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-04-18T14:44:32.108 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:10.451094+0000", 2024-04-18T14:44:32.108 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000205892 2024-04-18T14:44:32.108 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:32.108 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:32.108 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for peered", 2024-04-18T14:44:32.109 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:10.451100+0000", 2024-04-18T14:44:32.109 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 6.4250000000000003e-06 2024-04-18T14:44:32.109 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:32.109 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:32.109 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-04-18T14:44:32.109 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:11.441774+0000", 2024-04-18T14:44:32.109 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.99067378399999995 2024-04-18T14:44:32.109 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:32.110 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:32.110 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-04-18T14:44:32.110 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:11.442482+0000", 2024-04-18T14:44:32.110 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000707561 2024-04-18T14:44:32.110 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:32.110 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:32.110 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-04-18T14:44:32.110 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:11.454422+0000", 2024-04-18T14:44:32.111 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.011940749000000001 2024-04-18T14:44:32.111 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:44:32.111 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T14:44:32.111 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:44:32.111 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:32.111 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:32.111 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4559.0:701 3.8s0 3:1890b7c2:::smithi13430248-36:head [read 0~2277376,checksum] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e71)", 2024-04-18T14:44:32.111 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-04-18T14:44:10.450921+0000", 2024-04-18T14:44:32.111 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 21.648925327000001, 2024-04-18T14:44:32.112 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.0086094160000001, 2024-04-18T14:44:32.112 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-04-18T14:44:32.112 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "started", 2024-04-18T14:44:32.112 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-04-18T14:44:32.112 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4559", 2024-04-18T14:44:32.112 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "172.21.15.134:0/3113589487", 2024-04-18T14:44:32.112 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 701 2024-04-18T14:44:32.113 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:32.113 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-04-18T14:44:32.113 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:32.113 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-04-18T14:44:32.113 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:10.450921+0000", 2024-04-18T14:44:32.113 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:44:32.113 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:32.113 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:32.113 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-04-18T14:44:32.113 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:10.450921+0000", 2024-04-18T14:44:32.113 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:44:32.113 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:32.113 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:32.114 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-04-18T14:44:32.114 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:10.450919+0000", 2024-04-18T14:44:32.114 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 4294967295.9999986 2024-04-18T14:44:32.114 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:32.114 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:32.114 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-04-18T14:44:32.114 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:10.450939+0000", 2024-04-18T14:44:32.114 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.9378999999999999e-05 2024-04-18T14:44:32.114 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:32.114 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:32.114 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-04-18T14:44:32.114 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:10.450961+0000", 2024-04-18T14:44:32.114 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.2537000000000001e-05 2024-04-18T14:44:32.114 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:32.115 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:32.115 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-04-18T14:44:32.115 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:10.450978+0000", 2024-04-18T14:44:32.115 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.6432000000000001e-05 2024-04-18T14:44:32.115 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:32.115 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:32.115 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-04-18T14:44:32.115 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:10.451427+0000", 2024-04-18T14:44:32.115 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00044940099999999999 2024-04-18T14:44:32.115 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:32.115 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:32.115 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for peered", 2024-04-18T14:44:32.115 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:10.451432+0000", 2024-04-18T14:44:32.115 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 5.293e-06 2024-04-18T14:44:32.115 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:32.115 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:32.116 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-04-18T14:44:32.116 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:11.449104+0000", 2024-04-18T14:44:32.116 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.99767109700000001 2024-04-18T14:44:32.116 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:32.116 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:32.116 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-04-18T14:44:32.116 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:11.449872+0000", 2024-04-18T14:44:32.116 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00076860399999999999 2024-04-18T14:44:32.116 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:32.116 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:32.116 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-04-18T14:44:32.116 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:11.459530+0000", 2024-04-18T14:44:32.116 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0096582000000000005 2024-04-18T14:44:32.116 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:44:32.116 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T14:44:32.117 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:44:32.117 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:32.117 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:32.117 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4559.0:702 3.8s0 3:1890b7c2:::smithi13430248-36:head [read 0~2277376,checksum] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e71)", 2024-04-18T14:44:32.117 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-04-18T14:44:10.451254+0000", 2024-04-18T14:44:32.117 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 21.648591865, 2024-04-18T14:44:32.117 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.017487407, 2024-04-18T14:44:32.117 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-04-18T14:44:32.117 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "started", 2024-04-18T14:44:32.117 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-04-18T14:44:32.117 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4559", 2024-04-18T14:44:32.117 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "172.21.15.134:0/3113589487", 2024-04-18T14:44:32.117 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 702 2024-04-18T14:44:32.117 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:32.117 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-04-18T14:44:32.117 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:32.118 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-04-18T14:44:32.118 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:10.451254+0000", 2024-04-18T14:44:32.118 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:44:32.118 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:32.118 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:32.118 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-04-18T14:44:32.118 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:10.451254+0000", 2024-04-18T14:44:32.118 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:44:32.118 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:32.118 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:32.118 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-04-18T14:44:32.118 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:10.451252+0000", 2024-04-18T14:44:32.118 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 4294967295.9999981 2024-04-18T14:44:32.118 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:32.119 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:32.119 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-04-18T14:44:32.119 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:10.451266+0000", 2024-04-18T14:44:32.119 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.3416e-05 2024-04-18T14:44:32.119 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:32.119 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:32.119 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-04-18T14:44:32.119 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:10.451294+0000", 2024-04-18T14:44:32.119 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.8016000000000001e-05 2024-04-18T14:44:32.119 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:32.119 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:32.119 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-04-18T14:44:32.119 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:10.451314+0000", 2024-04-18T14:44:32.119 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.0533000000000001e-05 2024-04-18T14:44:32.119 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:32.120 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:32.120 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-04-18T14:44:32.120 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:10.451543+0000", 2024-04-18T14:44:32.120 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00022914499999999999 2024-04-18T14:44:32.120 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:32.120 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:32.120 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for peered", 2024-04-18T14:44:32.120 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:10.451548+0000", 2024-04-18T14:44:32.120 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 4.4259999999999996e-06 2024-04-18T14:44:32.120 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:32.120 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:32.120 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-04-18T14:44:32.120 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:11.459742+0000", 2024-04-18T14:44:32.120 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.0081943200000001 2024-04-18T14:44:32.120 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:32.121 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:32.121 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-04-18T14:44:32.121 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:11.460043+0000", 2024-04-18T14:44:32.121 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00030079 2024-04-18T14:44:32.121 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:32.121 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:32.121 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-04-18T14:44:32.121 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:11.468742+0000", 2024-04-18T14:44:32.121 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0086989040000000004 2024-04-18T14:44:32.121 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:44:32.121 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T14:44:32.121 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:44:32.121 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:32.121 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:32.121 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(osd.6.22:3 3.8s0 3:1d392465:::smithi13430248-23:head [assert-version v101,copy-get max 8388608] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e72)", 2024-04-18T14:44:32.121 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-04-18T14:44:11.397780+0000", 2024-04-18T14:44:32.122 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 20.702065816000001, 2024-04-18T14:44:32.122 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.073837854999999994, 2024-04-18T14:44:32.122 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-04-18T14:44:32.122 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "started", 2024-04-18T14:44:32.122 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-04-18T14:44:32.122 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:32.122 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-04-18T14:44:32.122 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:11.397780+0000", 2024-04-18T14:44:32.122 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:44:32.122 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:32.122 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:32.122 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-04-18T14:44:32.122 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:11.397780+0000", 2024-04-18T14:44:32.122 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:44:32.122 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:32.123 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:32.123 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-04-18T14:44:32.123 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:11.397778+0000", 2024-04-18T14:44:32.123 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 4294967295.9999971 2024-04-18T14:44:32.123 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:32.123 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:32.123 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-04-18T14:44:32.123 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:11.397806+0000", 2024-04-18T14:44:32.123 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.8742999999999999e-05 2024-04-18T14:44:32.123 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:32.123 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:32.123 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-04-18T14:44:32.123 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:11.397850+0000", 2024-04-18T14:44:32.123 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 4.3081999999999998e-05 2024-04-18T14:44:32.123 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:32.123 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:32.124 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-04-18T14:44:32.124 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:11.397881+0000", 2024-04-18T14:44:32.124 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.1463e-05 2024-04-18T14:44:32.124 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:32.124 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:32.124 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-04-18T14:44:32.124 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:11.410976+0000", 2024-04-18T14:44:32.124 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.013094814999999999 2024-04-18T14:44:32.124 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:32.124 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:32.124 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for peered", 2024-04-18T14:44:32.124 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:11.410985+0000", 2024-04-18T14:44:32.124 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 9.2599999999999994e-06 2024-04-18T14:44:32.124 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:32.124 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:32.124 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-04-18T14:44:32.124 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:11.462636+0000", 2024-04-18T14:44:32.124 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.051650790000000002 2024-04-18T14:44:32.125 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:32.125 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:32.125 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-04-18T14:44:32.125 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:11.463037+0000", 2024-04-18T14:44:32.125 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00040085700000000001 2024-04-18T14:44:32.125 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:32.125 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:32.125 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-04-18T14:44:32.125 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:11.471618+0000", 2024-04-18T14:44:32.125 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0085816109999999994 2024-04-18T14:44:32.125 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:44:32.125 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T14:44:32.125 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:44:32.125 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:32.125 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:32.125 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4559.0:732 3.8s0 3:106507f9:::smithi13430248-8:head [append 0~720896] snapc 27=[27,26,23,22,1e,1c,1a,16,14,13,11,2] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-04-18T14:44:32.126 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-04-18T14:44:11.752856+0000", 2024-04-18T14:44:32.126 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 20.346990474999998, 2024-04-18T14:44:32.126 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.034769960000000003, 2024-04-18T14:44:32.126 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-04-18T14:44:32.126 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T14:44:32.126 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-04-18T14:44:32.126 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4559", 2024-04-18T14:44:32.126 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "172.21.15.134:0/3113589487", 2024-04-18T14:44:32.126 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 732 2024-04-18T14:44:32.126 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:32.126 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-04-18T14:44:32.126 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:32.126 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-04-18T14:44:32.126 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:11.752856+0000", 2024-04-18T14:44:32.127 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:44:32.127 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:32.127 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:32.127 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-04-18T14:44:32.127 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:11.752856+0000", 2024-04-18T14:44:32.127 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:44:32.127 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:32.127 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:32.127 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-04-18T14:44:32.127 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:11.752853+0000", 2024-04-18T14:44:32.127 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 4294967295.9999976 2024-04-18T14:44:32.127 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:32.127 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:32.127 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-04-18T14:44:32.128 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:11.754831+0000", 2024-04-18T14:44:32.128 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.001977946 2024-04-18T14:44:32.128 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:32.128 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:32.128 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-04-18T14:44:32.128 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:11.754865+0000", 2024-04-18T14:44:32.128 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.3756e-05 2024-04-18T14:44:32.128 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:32.128 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:32.128 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-04-18T14:44:32.128 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:11.754885+0000", 2024-04-18T14:44:32.128 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.0213000000000001e-05 2024-04-18T14:44:32.128 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:32.128 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:32.128 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-04-18T14:44:32.129 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:11.757505+0000", 2024-04-18T14:44:32.129 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0026195319999999999 2024-04-18T14:44:32.129 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:32.129 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:32.129 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-04-18T14:44:32.129 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:11.757878+0000", 2024-04-18T14:44:32.129 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000372689 2024-04-18T14:44:32.129 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:32.129 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:32.129 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_started", 2024-04-18T14:44:32.129 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:11.760371+0000", 2024-04-18T14:44:32.129 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0024931950000000001 2024-04-18T14:44:32.129 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:32.129 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:32.129 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_committed", 2024-04-18T14:44:32.130 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:11.764926+0000", 2024-04-18T14:44:32.130 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0045554460000000003 2024-04-18T14:44:32.130 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:32.130 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:32.130 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-04-18T14:44:32.130 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:11.786971+0000", 2024-04-18T14:44:32.130 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.022044956000000001 2024-04-18T14:44:32.130 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:32.130 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:32.130 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-04-18T14:44:32.130 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:11.787626+0000", 2024-04-18T14:44:32.130 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00065465399999999996 2024-04-18T14:44:32.130 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:44:32.130 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T14:44:32.131 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:44:32.131 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:32.131 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:32.131 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4559.0:733 3.8s0 3:106507f9:::smithi13430248-8:head [append 0~32768] snapc 27=[27,26,23,22,1e,1c,1a,16,14,13,11,2] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-04-18T14:44:32.131 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-04-18T14:44:11.754908+0000", 2024-04-18T14:44:32.131 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 20.344937971, 2024-04-18T14:44:32.131 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.033340726000000001, 2024-04-18T14:44:32.131 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-04-18T14:44:32.131 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T14:44:32.131 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-04-18T14:44:32.131 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4559", 2024-04-18T14:44:32.131 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "172.21.15.134:0/3113589487", 2024-04-18T14:44:32.131 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 733 2024-04-18T14:44:32.131 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:32.131 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-04-18T14:44:32.131 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:32.131 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-04-18T14:44:32.132 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:11.754908+0000", 2024-04-18T14:44:32.132 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:44:32.132 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:32.132 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:32.132 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-04-18T14:44:32.132 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:11.754908+0000", 2024-04-18T14:44:32.132 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:44:32.132 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:32.132 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:32.132 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-04-18T14:44:32.132 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:11.754906+0000", 2024-04-18T14:44:32.132 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 4294967295.9999981 2024-04-18T14:44:32.132 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:32.132 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:32.132 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-04-18T14:44:32.132 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:11.754962+0000", 2024-04-18T14:44:32.133 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 5.5418999999999999e-05 2024-04-18T14:44:32.133 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:32.133 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:32.133 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-04-18T14:44:32.133 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:11.754984+0000", 2024-04-18T14:44:32.133 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.2523000000000001e-05 2024-04-18T14:44:32.133 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:32.133 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:32.133 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-04-18T14:44:32.133 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:11.755008+0000", 2024-04-18T14:44:32.133 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.4309000000000001e-05 2024-04-18T14:44:32.133 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:32.133 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:32.133 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-04-18T14:44:32.133 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:11.762184+0000", 2024-04-18T14:44:32.133 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0071758949999999998 2024-04-18T14:44:32.133 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:32.134 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:32.134 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-04-18T14:44:32.134 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:11.762387+0000", 2024-04-18T14:44:32.134 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000202895 2024-04-18T14:44:32.134 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:32.134 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:32.134 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_started", 2024-04-18T14:44:32.134 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:11.763696+0000", 2024-04-18T14:44:32.134 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.001308743 2024-04-18T14:44:32.134 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:32.134 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:32.134 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_committed", 2024-04-18T14:44:32.134 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:11.765944+0000", 2024-04-18T14:44:32.134 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0022475910000000002 2024-04-18T14:44:32.135 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:32.135 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:32.135 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-04-18T14:44:32.135 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:11.787875+0000", 2024-04-18T14:44:32.135 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.021931062000000001 2024-04-18T14:44:32.135 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:32.135 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:32.135 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-04-18T14:44:32.135 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:11.788249+0000", 2024-04-18T14:44:32.135 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00037438899999999998 2024-04-18T14:44:32.135 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:44:32.135 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T14:44:32.135 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:44:32.135 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:32.135 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:32.135 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4559.0:734 3.8s0 3:106507f9:::smithi13430248-8:head [setxattr _header (56) in=7b] snapc 27=[27,26,23,22,1e,1c,1a,16,14,13,11,2] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-04-18T14:44:32.135 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-04-18T14:44:11.755024+0000", 2024-04-18T14:44:32.136 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 20.34482259, 2024-04-18T14:44:32.136 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.034074383999999999, 2024-04-18T14:44:32.136 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-04-18T14:44:32.136 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T14:44:32.136 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-04-18T14:44:32.136 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4559", 2024-04-18T14:44:32.136 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "172.21.15.134:0/3113589487", 2024-04-18T14:44:32.136 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 734 2024-04-18T14:44:32.136 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:32.136 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-04-18T14:44:32.136 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:32.136 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-04-18T14:44:32.136 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:11.755024+0000", 2024-04-18T14:44:32.136 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:44:32.136 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:32.136 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:32.137 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-04-18T14:44:32.137 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:11.755024+0000", 2024-04-18T14:44:32.137 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:44:32.137 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:32.137 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:32.137 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-04-18T14:44:32.137 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:11.755022+0000", 2024-04-18T14:44:32.137 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 4294967295.9999986 2024-04-18T14:44:32.137 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:32.137 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:32.137 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-04-18T14:44:32.137 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:11.755031+0000", 2024-04-18T14:44:32.137 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 8.884e-06 2024-04-18T14:44:32.137 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:32.137 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:32.138 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-04-18T14:44:32.138 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:11.755049+0000", 2024-04-18T14:44:32.138 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.8372e-05 2024-04-18T14:44:32.138 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:32.138 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:32.138 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-04-18T14:44:32.138 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:11.755064+0000", 2024-04-18T14:44:32.138 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.418e-05 2024-04-18T14:44:32.138 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:32.138 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:32.138 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-04-18T14:44:32.138 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:11.766259+0000", 2024-04-18T14:44:32.138 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.011195208 2024-04-18T14:44:32.138 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:32.138 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:32.139 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-04-18T14:44:32.139 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:11.766455+0000", 2024-04-18T14:44:32.139 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00019597899999999999 2024-04-18T14:44:32.139 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:32.139 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:32.139 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_started", 2024-04-18T14:44:32.139 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:11.767454+0000", 2024-04-18T14:44:32.139 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00099949299999999995 2024-04-18T14:44:32.139 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:32.139 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:32.139 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_committed", 2024-04-18T14:44:32.139 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:11.770568+0000", 2024-04-18T14:44:32.139 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0031138419999999999 2024-04-18T14:44:32.139 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:32.139 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:32.140 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-04-18T14:44:32.140 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:11.788575+0000", 2024-04-18T14:44:32.140 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.018006501000000001 2024-04-18T14:44:32.140 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:32.140 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:32.140 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-04-18T14:44:32.140 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:11.789098+0000", 2024-04-18T14:44:32.140 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00052342199999999995 2024-04-18T14:44:32.140 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:44:32.140 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T14:44:32.140 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:44:32.140 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:32.140 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:32.140 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4559.0:735 3.8s0 3:106507f9:::smithi13430248-8:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e72)", 2024-04-18T14:44:32.140 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-04-18T14:44:11.755076+0000", 2024-04-18T14:44:32.140 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 20.344770338, 2024-04-18T14:44:32.141 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.041597215, 2024-04-18T14:44:32.141 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-04-18T14:44:32.141 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "started", 2024-04-18T14:44:32.141 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-04-18T14:44:32.141 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4559", 2024-04-18T14:44:32.141 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "172.21.15.134:0/3113589487", 2024-04-18T14:44:32.141 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 735 2024-04-18T14:44:32.141 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:32.141 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-04-18T14:44:32.141 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:32.141 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-04-18T14:44:32.141 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:11.755076+0000", 2024-04-18T14:44:32.141 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:44:32.141 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:32.141 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:32.141 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-04-18T14:44:32.141 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:11.755076+0000", 2024-04-18T14:44:32.142 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:44:32.142 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:32.142 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:32.142 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-04-18T14:44:32.142 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:11.755075+0000", 2024-04-18T14:44:32.142 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 4294967295.9999986 2024-04-18T14:44:32.142 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:32.142 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:32.142 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-04-18T14:44:32.142 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:11.755081+0000", 2024-04-18T14:44:32.142 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 6.7569999999999998e-06 2024-04-18T14:44:32.142 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:32.142 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:32.142 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-04-18T14:44:32.143 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:11.755100+0000", 2024-04-18T14:44:32.143 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.8902e-05 2024-04-18T14:44:32.143 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:32.143 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:32.143 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-04-18T14:44:32.143 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:11.755114+0000", 2024-04-18T14:44:32.143 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.3664e-05 2024-04-18T14:44:32.143 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:32.143 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:32.143 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-04-18T14:44:32.143 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:11.768447+0000", 2024-04-18T14:44:32.143 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.013333024000000001 2024-04-18T14:44:32.143 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:32.143 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:32.143 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for rw locks", 2024-04-18T14:44:32.144 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:11.768656+0000", 2024-04-18T14:44:32.144 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00020867499999999999 2024-04-18T14:44:32.144 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:32.144 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:32.144 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-04-18T14:44:32.144 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:11.789996+0000", 2024-04-18T14:44:32.144 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.021340391 2024-04-18T14:44:32.144 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:32.144 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:32.144 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-04-18T14:44:32.144 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:11.790290+0000", 2024-04-18T14:44:32.144 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00029385400000000002 2024-04-18T14:44:32.144 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:32.144 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:32.144 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-04-18T14:44:32.145 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:11.796673+0000", 2024-04-18T14:44:32.145 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0063831679999999998 2024-04-18T14:44:32.145 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:44:32.145 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T14:44:32.145 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:44:32.145 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:32.145 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:32.145 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4559.0:736 3.8s0 3:1890b7c2:::smithi13430248-36:head [read 0~2277376,checksum,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e72)", 2024-04-18T14:44:32.145 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-04-18T14:44:11.755127+0000", 2024-04-18T14:44:32.145 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 20.344719429000001, 2024-04-18T14:44:32.145 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.02301605, 2024-04-18T14:44:32.145 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-04-18T14:44:32.145 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "started", 2024-04-18T14:44:32.145 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-04-18T14:44:32.145 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4559", 2024-04-18T14:44:32.146 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "172.21.15.134:0/3113589487", 2024-04-18T14:44:32.146 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 736 2024-04-18T14:44:32.146 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:32.146 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-04-18T14:44:32.146 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:32.146 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-04-18T14:44:32.146 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:11.755127+0000", 2024-04-18T14:44:32.146 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:44:32.146 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:32.146 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:32.146 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-04-18T14:44:32.146 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:11.755127+0000", 2024-04-18T14:44:32.146 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:44:32.146 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:32.147 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:32.147 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-04-18T14:44:32.147 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:11.755126+0000", 2024-04-18T14:44:32.147 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 4294967295.999999 2024-04-18T14:44:32.147 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:32.147 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:32.147 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-04-18T14:44:32.147 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:11.755133+0000", 2024-04-18T14:44:32.147 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 7.7729999999999999e-06 2024-04-18T14:44:32.147 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:32.147 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:32.147 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-04-18T14:44:32.147 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:11.755151+0000", 2024-04-18T14:44:32.147 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.7235999999999999e-05 2024-04-18T14:44:32.147 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:32.147 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:32.148 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-04-18T14:44:32.148 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:11.755164+0000", 2024-04-18T14:44:32.148 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.325e-05 2024-04-18T14:44:32.148 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:32.148 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:32.148 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-04-18T14:44:32.148 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:11.768749+0000", 2024-04-18T14:44:32.148 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.013585372 2024-04-18T14:44:32.148 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:32.148 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:32.148 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-04-18T14:44:32.148 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:11.768912+0000", 2024-04-18T14:44:32.148 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00016301600000000001 2024-04-18T14:44:32.148 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:32.148 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:32.149 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-04-18T14:44:32.149 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:11.778143+0000", 2024-04-18T14:44:32.149 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0092305289999999995 2024-04-18T14:44:32.149 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:44:32.149 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T14:44:32.149 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:44:32.149 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:32.149 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:32.149 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4559.0:737 3.8s0 3:1890b7c2:::smithi13430248-36:head [read 0~2277376,checksum] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e72)", 2024-04-18T14:44:32.149 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-04-18T14:44:11.755176+0000", 2024-04-18T14:44:32.149 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 20.34467016, 2024-04-18T14:44:32.149 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.028686533, 2024-04-18T14:44:32.149 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-04-18T14:44:32.149 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "started", 2024-04-18T14:44:32.149 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-04-18T14:44:32.150 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4559", 2024-04-18T14:44:32.150 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "172.21.15.134:0/3113589487", 2024-04-18T14:44:32.150 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 737 2024-04-18T14:44:32.150 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:32.150 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-04-18T14:44:32.150 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:32.150 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-04-18T14:44:32.150 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:11.755176+0000", 2024-04-18T14:44:32.150 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:44:32.150 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:32.150 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:32.150 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-04-18T14:44:32.150 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:11.755176+0000", 2024-04-18T14:44:32.150 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:44:32.151 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:32.151 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:32.151 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-04-18T14:44:32.151 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:11.755175+0000", 2024-04-18T14:44:32.151 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 4294967295.999999 2024-04-18T14:44:32.151 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:32.151 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:32.151 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-04-18T14:44:32.151 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:11.755183+0000", 2024-04-18T14:44:32.151 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 8.0260000000000007e-06 2024-04-18T14:44:32.151 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:32.151 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:32.151 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-04-18T14:44:32.151 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:11.755200+0000", 2024-04-18T14:44:32.151 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.6963e-05 2024-04-18T14:44:32.152 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:32.152 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:32.152 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-04-18T14:44:32.152 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:11.755213+0000", 2024-04-18T14:44:32.152 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.254e-05 2024-04-18T14:44:32.152 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:32.152 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:32.152 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-04-18T14:44:32.152 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:11.769617+0000", 2024-04-18T14:44:32.152 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.014404597999999999 2024-04-18T14:44:32.152 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:32.152 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:32.152 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-04-18T14:44:32.152 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:11.769882+0000", 2024-04-18T14:44:32.152 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00026468500000000002 2024-04-18T14:44:32.152 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:32.153 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:32.153 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-04-18T14:44:32.153 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:11.783863+0000", 2024-04-18T14:44:32.153 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.013980853999999999 2024-04-18T14:44:32.153 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:44:32.153 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T14:44:32.153 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:44:32.153 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:32.153 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:32.153 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4559.0:738 3.8s0 3:1890b7c2:::smithi13430248-36:head [read 0~2277376,checksum] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e72)", 2024-04-18T14:44:32.153 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-04-18T14:44:11.755225+0000", 2024-04-18T14:44:32.153 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 20.344620856999999, 2024-04-18T14:44:32.153 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.031362080000000001, 2024-04-18T14:44:32.153 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-04-18T14:44:32.153 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "started", 2024-04-18T14:44:32.153 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-04-18T14:44:32.154 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4559", 2024-04-18T14:44:32.154 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "172.21.15.134:0/3113589487", 2024-04-18T14:44:32.154 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 738 2024-04-18T14:44:32.154 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:32.154 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-04-18T14:44:32.154 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:32.154 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-04-18T14:44:32.154 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:11.755225+0000", 2024-04-18T14:44:32.154 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:44:32.154 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:32.154 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:32.154 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-04-18T14:44:32.154 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:11.755225+0000", 2024-04-18T14:44:32.154 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:44:32.154 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:32.155 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:32.155 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-04-18T14:44:32.155 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:11.755225+0000", 2024-04-18T14:44:32.155 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 4294967295.999999 2024-04-18T14:44:32.155 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:32.155 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:32.155 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-04-18T14:44:32.155 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:11.755231+0000", 2024-04-18T14:44:32.155 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 6.8329999999999996e-06 2024-04-18T14:44:32.155 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:32.155 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:32.155 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-04-18T14:44:32.155 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:11.755249+0000", 2024-04-18T14:44:32.155 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.7652999999999999e-05 2024-04-18T14:44:32.156 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:32.156 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:32.156 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-04-18T14:44:32.156 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:11.755262+0000", 2024-04-18T14:44:32.156 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.3397000000000001e-05 2024-04-18T14:44:32.156 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:32.156 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:32.156 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-04-18T14:44:32.156 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:11.773359+0000", 2024-04-18T14:44:32.156 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.018096847999999999 2024-04-18T14:44:32.156 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:32.156 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:32.156 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-04-18T14:44:32.156 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:11.773569+0000", 2024-04-18T14:44:32.156 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000209903 2024-04-18T14:44:32.156 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:32.157 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:32.157 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-04-18T14:44:32.157 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:11.786587+0000", 2024-04-18T14:44:32.157 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.01301835 2024-04-18T14:44:32.157 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:44:32.157 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T14:44:32.157 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:44:32.158 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:32.158 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:32.158 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4559.0:785 3.8s0 3:17e457c8:::smithi13430248-35:head [copy-from ver 61] snapc 2b=[2b,2a,29,28,27,26,23,22,1e,1c,1a,16,14,13,11,2] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-18T14:44:32.158 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-04-18T14:44:15.392614+0000", 2024-04-18T14:44:32.158 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 16.707232717, 2024-04-18T14:44:32.158 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.043019109999999999, 2024-04-18T14:44:32.158 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-04-18T14:44:32.158 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T14:44:32.159 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-04-18T14:44:32.159 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4559", 2024-04-18T14:44:32.159 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "172.21.15.134:0/3113589487", 2024-04-18T14:44:32.159 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 785 2024-04-18T14:44:32.159 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:32.159 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-04-18T14:44:32.159 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:32.159 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-04-18T14:44:32.160 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:15.392614+0000", 2024-04-18T14:44:32.160 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:44:32.160 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:32.160 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:32.160 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-04-18T14:44:32.160 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:15.392614+0000", 2024-04-18T14:44:32.160 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:44:32.160 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:32.161 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:32.161 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-04-18T14:44:32.161 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:15.392611+0000", 2024-04-18T14:44:32.161 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 4294967295.9999976 2024-04-18T14:44:32.161 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:32.161 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:32.161 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-04-18T14:44:32.162 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:15.392625+0000", 2024-04-18T14:44:32.162 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.3746e-05 2024-04-18T14:44:32.162 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:32.162 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:32.162 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-04-18T14:44:32.162 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:15.392655+0000", 2024-04-18T14:44:32.163 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.0552999999999997e-05 2024-04-18T14:44:32.163 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:32.163 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:32.163 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-04-18T14:44:32.163 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:15.392683+0000", 2024-04-18T14:44:32.163 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.7325999999999999e-05 2024-04-18T14:44:32.163 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:32.163 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:32.164 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-04-18T14:44:32.164 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:15.392764+0000", 2024-04-18T14:44:32.164 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 8.0920000000000005e-05 2024-04-18T14:44:32.164 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:32.164 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:32.164 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-04-18T14:44:32.165 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:15.393007+0000", 2024-04-18T14:44:32.165 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00024368799999999999 2024-04-18T14:44:32.165 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:32.165 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:32.165 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_started", 2024-04-18T14:44:32.165 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:15.424538+0000", 2024-04-18T14:44:32.165 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.031530184000000003 2024-04-18T14:44:32.165 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:32.165 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:32.166 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_committed", 2024-04-18T14:44:32.166 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:15.428083+0000", 2024-04-18T14:44:32.166 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.003545145 2024-04-18T14:44:32.166 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:32.166 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:32.166 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-04-18T14:44:32.166 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:15.435530+0000", 2024-04-18T14:44:32.167 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0074477129999999999 2024-04-18T14:44:32.167 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:32.167 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:32.167 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-04-18T14:44:32.167 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:15.435633+0000", 2024-04-18T14:44:32.167 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000102305 2024-04-18T14:44:32.167 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:44:32.168 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T14:44:32.168 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:44:32.168 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:32.168 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:32.168 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4559.0:786 3.8s0 3:17e457c8:::smithi13430248-35:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e76)", 2024-04-18T14:44:32.168 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-04-18T14:44:15.392702+0000", 2024-04-18T14:44:32.169 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 16.707144536000001, 2024-04-18T14:44:32.169 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.035125588999999999, 2024-04-18T14:44:32.169 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-04-18T14:44:32.169 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "started", 2024-04-18T14:44:32.169 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-04-18T14:44:32.169 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4559", 2024-04-18T14:44:32.169 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "172.21.15.134:0/3113589487", 2024-04-18T14:44:32.170 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 786 2024-04-18T14:44:32.170 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:32.170 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-04-18T14:44:32.170 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:32.170 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-04-18T14:44:32.170 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:15.392702+0000", 2024-04-18T14:44:32.170 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:44:32.170 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:32.170 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:32.170 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-04-18T14:44:32.170 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:15.392702+0000", 2024-04-18T14:44:32.170 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:44:32.171 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:32.171 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:32.171 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-04-18T14:44:32.171 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:15.392701+0000", 2024-04-18T14:44:32.171 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 4294967295.999999 2024-04-18T14:44:32.171 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:32.171 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:32.171 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-04-18T14:44:32.171 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:15.392706+0000", 2024-04-18T14:44:32.171 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 5.2630000000000003e-06 2024-04-18T14:44:32.171 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:32.171 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:32.171 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-04-18T14:44:32.171 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:15.392718+0000", 2024-04-18T14:44:32.171 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.1736000000000001e-05 2024-04-18T14:44:32.172 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:32.172 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:32.172 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-04-18T14:44:32.172 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:15.392726+0000", 2024-04-18T14:44:32.172 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 8.0900000000000005e-06 2024-04-18T14:44:32.172 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:32.172 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:32.172 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-04-18T14:44:32.172 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:15.393241+0000", 2024-04-18T14:44:32.172 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00051566299999999997 2024-04-18T14:44:32.172 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:32.172 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:32.172 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for blocked object", 2024-04-18T14:44:32.172 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:15.393332+0000", 2024-04-18T14:44:32.172 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 9.0167999999999995e-05 2024-04-18T14:44:32.172 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:32.173 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:32.173 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-04-18T14:44:32.173 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:15.427577+0000", 2024-04-18T14:44:32.173 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.034245167 2024-04-18T14:44:32.173 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:32.173 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:32.173 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-04-18T14:44:32.173 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:15.427703+0000", 2024-04-18T14:44:32.173 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00012610900000000001 2024-04-18T14:44:32.173 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:32.173 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:32.173 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-04-18T14:44:32.173 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:15.427827+0000", 2024-04-18T14:44:32.173 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00012443900000000001 2024-04-18T14:44:32.173 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:44:32.173 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T14:44:32.174 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:44:32.174 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:32.174 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:32.174 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4559.0:887 3.8s0 3:1890b7c2:::smithi13430248-36:head [append 0~622592] snapc 30=[30,2c,2b,2a,29,28,27,26,22,1e,1c,1a,14,13,11] ondisk+write+known_if_redirected+supports_pool_eio e81)", 2024-04-18T14:44:32.174 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-04-18T14:44:20.468675+0000", 2024-04-18T14:44:32.174 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 11.631171109, 2024-04-18T14:44:32.174 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.020247993999999998, 2024-04-18T14:44:32.174 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-04-18T14:44:32.174 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T14:44:32.174 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-04-18T14:44:32.174 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4559", 2024-04-18T14:44:32.174 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "172.21.15.134:0/3113589487", 2024-04-18T14:44:32.174 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 887 2024-04-18T14:44:32.174 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:32.175 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-04-18T14:44:32.175 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:32.175 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-04-18T14:44:32.175 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:20.468675+0000", 2024-04-18T14:44:32.175 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:44:32.175 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:32.175 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:32.175 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-04-18T14:44:32.175 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:20.468675+0000", 2024-04-18T14:44:32.175 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:44:32.175 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:32.175 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:32.175 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-04-18T14:44:32.175 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:20.468673+0000", 2024-04-18T14:44:32.175 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 4294967295.9999976 2024-04-18T14:44:32.175 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:32.175 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:32.176 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-04-18T14:44:32.176 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:20.469690+0000", 2024-04-18T14:44:32.176 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.001016887 2024-04-18T14:44:32.176 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:32.176 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:32.176 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-04-18T14:44:32.176 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:20.469716+0000", 2024-04-18T14:44:32.176 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.6585999999999999e-05 2024-04-18T14:44:32.176 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:32.176 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:32.176 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-04-18T14:44:32.176 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:20.469733+0000", 2024-04-18T14:44:32.176 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.6957e-05 2024-04-18T14:44:32.176 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:32.176 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:32.176 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-04-18T14:44:32.177 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:20.475638+0000", 2024-04-18T14:44:32.177 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0059052519999999997 2024-04-18T14:44:32.177 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:32.177 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:32.177 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-04-18T14:44:32.177 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:20.475820+0000", 2024-04-18T14:44:32.177 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000182144 2024-04-18T14:44:32.177 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:32.177 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:32.177 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_started", 2024-04-18T14:44:32.177 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:20.478124+0000", 2024-04-18T14:44:32.177 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0023032370000000001 2024-04-18T14:44:32.177 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:32.177 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:32.177 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_committed", 2024-04-18T14:44:32.177 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:20.485026+0000", 2024-04-18T14:44:32.178 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00690246 2024-04-18T14:44:32.178 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:32.178 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:32.178 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-04-18T14:44:32.178 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:20.488728+0000", 2024-04-18T14:44:32.178 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0037019710000000001 2024-04-18T14:44:32.178 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:32.178 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:32.178 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-04-18T14:44:32.178 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:20.488923+0000", 2024-04-18T14:44:32.178 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00019500299999999999 2024-04-18T14:44:32.178 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:44:32.178 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T14:44:32.178 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:44:32.179 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:32.179 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:32.179 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4559.0:891 3.8s0 3:1890b7c2:::smithi13430248-36:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e81)", 2024-04-18T14:44:32.179 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-04-18T14:44:20.479791+0000", 2024-04-18T14:44:32.179 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 11.620055008, 2024-04-18T14:44:32.179 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.019763571000000001, 2024-04-18T14:44:32.179 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-04-18T14:44:32.179 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "started", 2024-04-18T14:44:32.179 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-04-18T14:44:32.179 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4559", 2024-04-18T14:44:32.179 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "172.21.15.134:0/3113589487", 2024-04-18T14:44:32.179 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 891 2024-04-18T14:44:32.179 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:32.179 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-04-18T14:44:32.179 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:32.179 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-04-18T14:44:32.180 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:20.479791+0000", 2024-04-18T14:44:32.180 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:44:32.180 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:32.180 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:32.180 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-04-18T14:44:32.180 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:20.479791+0000", 2024-04-18T14:44:32.180 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:44:32.180 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:32.180 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:32.180 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-04-18T14:44:32.180 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:20.479790+0000", 2024-04-18T14:44:32.180 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 4294967295.999999 2024-04-18T14:44:32.180 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:32.180 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:32.180 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-04-18T14:44:32.180 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:20.479797+0000", 2024-04-18T14:44:32.181 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 6.5230000000000001e-06 2024-04-18T14:44:32.181 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:32.181 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:32.181 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-04-18T14:44:32.181 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:20.479821+0000", 2024-04-18T14:44:32.181 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.4239999999999998e-05 2024-04-18T14:44:32.181 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:32.181 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:32.181 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-04-18T14:44:32.181 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:20.479835+0000", 2024-04-18T14:44:32.181 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.4389999999999999e-05 2024-04-18T14:44:32.181 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:32.181 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:32.181 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-04-18T14:44:32.181 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:20.491762+0000", 2024-04-18T14:44:32.181 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.011926496999999999 2024-04-18T14:44:32.182 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:32.182 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:32.182 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for rw locks", 2024-04-18T14:44:32.182 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:20.491895+0000", 2024-04-18T14:44:32.182 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0001328 2024-04-18T14:44:32.182 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:32.182 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:32.182 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-04-18T14:44:32.182 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:20.497096+0000", 2024-04-18T14:44:32.182 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0052017269999999997 2024-04-18T14:44:32.182 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:32.182 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:32.182 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-04-18T14:44:32.182 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:20.497350+0000", 2024-04-18T14:44:32.183 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00025345100000000002 2024-04-18T14:44:32.183 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:32.183 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:32.183 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-04-18T14:44:32.183 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:20.499555+0000", 2024-04-18T14:44:32.183 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0022050559999999999 2024-04-18T14:44:32.183 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:44:32.183 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T14:44:32.183 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:44:32.183 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:32.183 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:32.183 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4559.0:932 3.8s0 3:106507f9:::smithi13430248-8:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e82)", 2024-04-18T14:44:32.183 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-04-18T14:44:21.700228+0000", 2024-04-18T14:44:32.183 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 10.399617828, 2024-04-18T14:44:32.183 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.020099740000000001, 2024-04-18T14:44:32.184 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-04-18T14:44:32.184 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "started", 2024-04-18T14:44:32.184 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-04-18T14:44:32.184 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4559", 2024-04-18T14:44:32.184 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "172.21.15.134:0/3113589487", 2024-04-18T14:44:32.184 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 932 2024-04-18T14:44:32.184 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:32.184 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-04-18T14:44:32.184 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:32.184 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-04-18T14:44:32.184 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:21.700228+0000", 2024-04-18T14:44:32.184 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:44:32.184 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:32.184 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:32.184 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-04-18T14:44:32.185 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:21.700228+0000", 2024-04-18T14:44:32.185 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:44:32.185 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:32.185 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:32.185 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-04-18T14:44:32.185 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:21.700228+0000", 2024-04-18T14:44:32.185 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 4294967295.999999 2024-04-18T14:44:32.185 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:32.185 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:32.185 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-04-18T14:44:32.185 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:21.700233+0000", 2024-04-18T14:44:32.185 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 5.8830000000000003e-06 2024-04-18T14:44:32.185 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:32.185 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:32.185 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-04-18T14:44:32.185 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:21.700252+0000", 2024-04-18T14:44:32.186 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.9066e-05 2024-04-18T14:44:32.186 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:32.186 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:32.186 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-04-18T14:44:32.186 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:21.700271+0000", 2024-04-18T14:44:32.186 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.8139999999999999e-05 2024-04-18T14:44:32.186 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:32.186 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:32.186 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-04-18T14:44:32.186 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:21.714483+0000", 2024-04-18T14:44:32.186 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.014212044 2024-04-18T14:44:32.186 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:32.186 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:32.186 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for rw locks", 2024-04-18T14:44:32.187 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:21.714808+0000", 2024-04-18T14:44:32.187 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00032577799999999998 2024-04-18T14:44:32.187 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:32.187 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:32.187 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-04-18T14:44:32.187 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:21.717157+0000", 2024-04-18T14:44:32.187 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0023482440000000002 2024-04-18T14:44:32.187 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:32.187 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:32.187 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-04-18T14:44:32.187 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:21.717404+0000", 2024-04-18T14:44:32.187 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00024749 2024-04-18T14:44:32.187 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:32.187 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:32.187 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-04-18T14:44:32.188 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:21.720328+0000", 2024-04-18T14:44:32.188 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0029240210000000002 2024-04-18T14:44:32.188 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:44:32.188 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T14:44:32.188 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:44:32.188 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:32.188 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:32.188 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4559.0:933 3.8s0 3:1aa3fae8:::smithi13430248-32:head [copy-from ver 80] snapc 30=[30,2c,2b,2a,29,28,27,26,22,1e,1c,1a,14,11] ondisk+write+known_if_redirected+supports_pool_eio e82)", 2024-04-18T14:44:32.188 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-04-18T14:44:21.700283+0000", 2024-04-18T14:44:32.188 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 10.399562892000001, 2024-04-18T14:44:32.188 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.045682977, 2024-04-18T14:44:32.188 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-04-18T14:44:32.188 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T14:44:32.188 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-04-18T14:44:32.189 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4559", 2024-04-18T14:44:32.189 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "172.21.15.134:0/3113589487", 2024-04-18T14:44:32.189 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 933 2024-04-18T14:44:32.189 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:32.189 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-04-18T14:44:32.189 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:32.189 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-04-18T14:44:32.189 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:21.700283+0000", 2024-04-18T14:44:32.189 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:44:32.189 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:32.189 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:32.189 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-04-18T14:44:32.189 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:21.700283+0000", 2024-04-18T14:44:32.189 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:44:32.189 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:32.189 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:32.190 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-04-18T14:44:32.190 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:21.700282+0000", 2024-04-18T14:44:32.190 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 4294967295.999999 2024-04-18T14:44:32.190 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:32.190 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:32.190 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-04-18T14:44:32.190 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:21.700290+0000", 2024-04-18T14:44:32.190 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 8.2099999999999993e-06 2024-04-18T14:44:32.190 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:32.190 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:32.190 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-04-18T14:44:32.190 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:21.700304+0000", 2024-04-18T14:44:32.190 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.3253e-05 2024-04-18T14:44:32.190 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:32.191 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:32.191 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-04-18T14:44:32.191 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:21.700318+0000", 2024-04-18T14:44:32.191 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.4246e-05 2024-04-18T14:44:32.191 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:32.191 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:32.191 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-04-18T14:44:32.191 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:21.718270+0000", 2024-04-18T14:44:32.191 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.017952115000000001 2024-04-18T14:44:32.191 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:32.191 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:32.191 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-04-18T14:44:32.191 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:21.718438+0000", 2024-04-18T14:44:32.191 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000167944 2024-04-18T14:44:32.192 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:32.192 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:32.192 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_started", 2024-04-18T14:44:32.192 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:21.734910+0000", 2024-04-18T14:44:32.192 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.016471848000000001 2024-04-18T14:44:32.192 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:32.192 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:32.192 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_committed", 2024-04-18T14:44:32.192 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:21.743238+0000", 2024-04-18T14:44:32.192 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0083284399999999995 2024-04-18T14:44:32.192 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:32.192 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:32.192 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-04-18T14:44:32.192 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:21.745847+0000", 2024-04-18T14:44:32.192 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0026091230000000001 2024-04-18T14:44:32.192 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:32.193 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:32.193 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-04-18T14:44:32.193 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:21.745966+0000", 2024-04-18T14:44:32.193 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00011898800000000001 2024-04-18T14:44:32.193 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:44:32.193 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T14:44:32.193 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:44:32.193 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:32.193 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:32.193 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4559.0:934 3.8s0 3:1aa3fae8:::smithi13430248-32:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e82)", 2024-04-18T14:44:32.193 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-04-18T14:44:21.700330+0000", 2024-04-18T14:44:32.193 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 10.399516186, 2024-04-18T14:44:32.193 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.040667973000000003, 2024-04-18T14:44:32.193 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-04-18T14:44:32.193 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "started", 2024-04-18T14:44:32.194 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-04-18T14:44:32.194 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4559", 2024-04-18T14:44:32.194 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "172.21.15.134:0/3113589487", 2024-04-18T14:44:32.194 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 934 2024-04-18T14:44:32.194 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:32.194 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-04-18T14:44:32.194 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:32.194 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-04-18T14:44:32.194 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:21.700330+0000", 2024-04-18T14:44:32.194 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:44:32.194 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:32.194 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:32.194 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-04-18T14:44:32.194 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:21.700330+0000", 2024-04-18T14:44:32.194 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:44:32.195 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:32.195 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:32.195 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-04-18T14:44:32.195 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:21.700329+0000", 2024-04-18T14:44:32.195 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 4294967295.999999 2024-04-18T14:44:32.195 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:32.195 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:32.195 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-04-18T14:44:32.195 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:21.700335+0000", 2024-04-18T14:44:32.195 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 6.2430000000000002e-06 2024-04-18T14:44:32.195 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:32.195 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:32.195 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-04-18T14:44:32.195 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:21.700357+0000", 2024-04-18T14:44:32.195 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.1543e-05 2024-04-18T14:44:32.196 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:32.196 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:32.196 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-04-18T14:44:32.196 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:21.700373+0000", 2024-04-18T14:44:32.196 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.6589999999999999e-05 2024-04-18T14:44:32.196 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:32.196 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:32.196 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-04-18T14:44:32.196 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:21.720557+0000", 2024-04-18T14:44:32.196 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.020183988999999999 2024-04-18T14:44:32.196 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:32.196 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:32.196 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for blocked object", 2024-04-18T14:44:32.196 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:21.720779+0000", 2024-04-18T14:44:32.196 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00022130300000000001 2024-04-18T14:44:32.196 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:32.197 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:32.197 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-04-18T14:44:32.197 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:21.740557+0000", 2024-04-18T14:44:32.197 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.019778035999999999 2024-04-18T14:44:32.197 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:32.197 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:32.197 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-04-18T14:44:32.197 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:21.740825+0000", 2024-04-18T14:44:32.197 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00026813199999999997 2024-04-18T14:44:32.197 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:32.197 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:32.197 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-04-18T14:44:32.198 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:21.740998+0000", 2024-04-18T14:44:32.198 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000173244 2024-04-18T14:44:32.198 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:44:32.198 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T14:44:32.198 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:44:32.198 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:32.198 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:32.198 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4559.0:993 3.8s0 3:1d392465:::smithi13430248-23:head [setxattr _header (57) in=7b] snapc 35=[35,33,32,30,2c,2b,2a,29,28,26,22,1e,1c,1a,14,11] ondisk+write+known_if_redirected+supports_pool_eio e86)", 2024-04-18T14:44:32.198 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-04-18T14:44:25.524994+0000", 2024-04-18T14:44:32.198 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 6.5748518449999995, 2024-04-18T14:44:32.198 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.020007008999999999, 2024-04-18T14:44:32.198 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-04-18T14:44:32.198 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T14:44:32.198 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-04-18T14:44:32.199 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4559", 2024-04-18T14:44:32.199 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "172.21.15.134:0/3113589487", 2024-04-18T14:44:32.199 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 993 2024-04-18T14:44:32.199 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:32.199 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-04-18T14:44:32.199 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:32.199 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-04-18T14:44:32.199 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:25.524994+0000", 2024-04-18T14:44:32.199 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:44:32.199 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:32.199 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:32.199 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-04-18T14:44:32.199 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:25.524994+0000", 2024-04-18T14:44:32.200 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:44:32.200 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:32.200 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:32.200 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-04-18T14:44:32.200 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:25.524993+0000", 2024-04-18T14:44:32.200 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 4294967295.999999 2024-04-18T14:44:32.200 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:32.200 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:32.200 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-04-18T14:44:32.200 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:25.525001+0000", 2024-04-18T14:44:32.200 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 7.4100000000000002e-06 2024-04-18T14:44:32.200 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:32.200 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:32.201 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-04-18T14:44:32.201 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:25.525015+0000", 2024-04-18T14:44:32.201 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.4516e-05 2024-04-18T14:44:32.201 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:32.201 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:32.201 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-04-18T14:44:32.202 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:25.525027+0000", 2024-04-18T14:44:32.202 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.1453e-05 2024-04-18T14:44:32.202 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:32.202 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:32.202 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-04-18T14:44:32.202 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:25.525258+0000", 2024-04-18T14:44:32.203 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00023099700000000001 2024-04-18T14:44:32.203 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:32.203 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:32.203 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting_for_map not empty", 2024-04-18T14:44:32.203 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:25.525279+0000", 2024-04-18T14:44:32.203 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.1246e-05 2024-04-18T14:44:32.203 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:32.203 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:32.203 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-04-18T14:44:32.203 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:25.534535+0000", 2024-04-18T14:44:32.203 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0092565549999999996 2024-04-18T14:44:32.204 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:32.204 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:32.204 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-04-18T14:44:32.204 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:25.534803+0000", 2024-04-18T14:44:32.204 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00026721900000000002 2024-04-18T14:44:32.204 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:32.204 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:32.205 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_started", 2024-04-18T14:44:32.205 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:25.535678+0000", 2024-04-18T14:44:32.205 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00087517300000000003 2024-04-18T14:44:32.205 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:32.205 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:32.205 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_committed", 2024-04-18T14:44:32.205 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:25.537479+0000", 2024-04-18T14:44:32.206 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0018006579999999999 2024-04-18T14:44:32.206 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:32.206 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:32.206 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-04-18T14:44:32.206 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:25.544775+0000", 2024-04-18T14:44:32.206 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0072968310000000002 2024-04-18T14:44:32.207 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:32.207 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:32.207 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-04-18T14:44:32.207 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:25.545001+0000", 2024-04-18T14:44:32.207 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00022608400000000001 2024-04-18T14:44:32.207 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:44:32.207 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T14:44:32.208 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:44:32.208 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:32.208 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:32.208 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4559.0:994 3.8s0 3:1d392465:::smithi13430248-23:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e86)", 2024-04-18T14:44:32.208 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-04-18T14:44:25.525072+0000", 2024-04-18T14:44:32.208 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 6.5747746960000004, 2024-04-18T14:44:32.208 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.023671063999999999, 2024-04-18T14:44:32.209 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-04-18T14:44:32.209 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "started", 2024-04-18T14:44:32.209 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-04-18T14:44:32.209 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4559", 2024-04-18T14:44:32.209 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "172.21.15.134:0/3113589487", 2024-04-18T14:44:32.209 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 994 2024-04-18T14:44:32.210 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:32.210 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-04-18T14:44:32.210 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:32.210 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-04-18T14:44:32.210 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:25.525072+0000", 2024-04-18T14:44:32.210 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:44:32.210 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:32.211 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:32.211 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-04-18T14:44:32.211 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:25.525072+0000", 2024-04-18T14:44:32.211 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:44:32.211 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:32.211 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:32.212 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-04-18T14:44:32.212 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:25.525071+0000", 2024-04-18T14:44:32.212 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 4294967295.999999 2024-04-18T14:44:32.212 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:32.212 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:32.212 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-04-18T14:44:32.212 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:25.525076+0000", 2024-04-18T14:44:32.213 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 5.1529999999999996e-06 2024-04-18T14:44:32.213 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:32.213 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:32.213 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-04-18T14:44:32.213 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:25.525088+0000", 2024-04-18T14:44:32.213 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.1883e-05 2024-04-18T14:44:32.213 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:32.214 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:32.214 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-04-18T14:44:32.214 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:25.525098+0000", 2024-04-18T14:44:32.214 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.0349999999999999e-05 2024-04-18T14:44:32.214 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:32.214 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:32.214 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-04-18T14:44:32.214 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:25.525326+0000", 2024-04-18T14:44:32.215 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00022837000000000001 2024-04-18T14:44:32.215 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:32.215 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:32.215 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting_for_map not empty", 2024-04-18T14:44:32.215 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:25.525336+0000", 2024-04-18T14:44:32.215 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 9.346e-06 2024-04-18T14:44:32.215 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:32.215 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:32.216 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-04-18T14:44:32.216 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:25.536467+0000", 2024-04-18T14:44:32.216 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.011131385000000001 2024-04-18T14:44:32.216 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:32.216 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:32.216 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for rw locks", 2024-04-18T14:44:32.216 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:25.536725+0000", 2024-04-18T14:44:32.216 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00025825300000000001 2024-04-18T14:44:32.216 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:32.216 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:32.216 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-04-18T14:44:32.216 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:25.545992+0000", 2024-04-18T14:44:32.216 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0092664400000000008 2024-04-18T14:44:32.216 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:32.216 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:32.216 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-04-18T14:44:32.217 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:25.546273+0000", 2024-04-18T14:44:32.217 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000281093 2024-04-18T14:44:32.217 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:32.217 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:32.217 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-04-18T14:44:32.217 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:25.548743+0000", 2024-04-18T14:44:32.217 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.002469714 2024-04-18T14:44:32.217 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:44:32.217 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T14:44:32.217 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:44:32.217 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:44:32.217 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T14:44:32.217 INFO:teuthology.orchestra.run.smithi096.stdout:} 2024-04-18T14:44:32.219 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.9.asok dump_ops_in_flight 2024-04-18T14:44:32.346 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2024-04-18T14:44:32.346 INFO:teuthology.orchestra.run.smithi096.stdout: "ops": [], 2024-04-18T14:44:32.346 INFO:teuthology.orchestra.run.smithi096.stdout: "num_ops": 0 2024-04-18T14:44:32.346 INFO:teuthology.orchestra.run.smithi096.stdout:} 2024-04-18T14:44:32.361 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.9.asok dump_blocked_ops 2024-04-18T14:44:32.485 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2024-04-18T14:44:32.485 INFO:teuthology.orchestra.run.smithi096.stdout: "ops": [], 2024-04-18T14:44:32.485 INFO:teuthology.orchestra.run.smithi096.stdout: "complaint_time": 30, 2024-04-18T14:44:32.485 INFO:teuthology.orchestra.run.smithi096.stdout: "num_blocked_ops": 0 2024-04-18T14:44:32.485 INFO:teuthology.orchestra.run.smithi096.stdout:} 2024-04-18T14:44:32.498 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.9.asok dump_historic_ops 2024-04-18T14:44:32.545 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-04-18T14:44:32.617 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2024-04-18T14:44:32.618 INFO:teuthology.orchestra.run.smithi096.stdout: "size": 20, 2024-04-18T14:44:32.618 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 600, 2024-04-18T14:44:32.618 INFO:teuthology.orchestra.run.smithi096.stdout: "ops": [ 2024-04-18T14:44:32.618 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:32.618 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "MOSDECSubOpWrite(3.1s2 63/30 ECSubWrite(tid=56, reqid=osd.6.0:56, at_version=63'37, trim_to=0'0, roll_forward_to=59'35))", 2024-04-18T14:44:32.618 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-04-18T14:44:02.385571+0000", 2024-04-18T14:44:32.618 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 30.231936327, 2024-04-18T14:44:32.618 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0084711279999999996, 2024-04-18T14:44:32.618 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-04-18T14:44:32.618 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "reached pg", 2024-04-18T14:44:32.618 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-04-18T14:44:32.618 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:32.619 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-04-18T14:44:32.619 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:02.385571+0000", 2024-04-18T14:44:32.619 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:44:32.619 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:32.619 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:32.619 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-04-18T14:44:32.619 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:02.385571+0000", 2024-04-18T14:44:32.619 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:44:32.619 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:32.619 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:32.619 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-04-18T14:44:32.619 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:02.385570+0000", 2024-04-18T14:44:32.619 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 4294967295.9999995 2024-04-18T14:44:32.619 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:32.619 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:32.620 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-04-18T14:44:32.620 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:02.385640+0000", 2024-04-18T14:44:32.620 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 6.9232000000000004e-05 2024-04-18T14:44:32.620 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:32.620 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:32.620 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-04-18T14:44:32.620 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:02.385669+0000", 2024-04-18T14:44:32.620 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.9390000000000002e-05 2024-04-18T14:44:32.620 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:32.620 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:32.620 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-04-18T14:44:32.620 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:02.385692+0000", 2024-04-18T14:44:32.620 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.3096999999999999e-05 2024-04-18T14:44:32.620 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:32.620 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:32.621 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-04-18T14:44:32.621 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:02.386245+0000", 2024-04-18T14:44:32.621 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00055288899999999998 2024-04-18T14:44:32.621 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:32.621 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:32.621 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_started", 2024-04-18T14:44:32.621 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:02.386271+0000", 2024-04-18T14:44:32.621 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.5757000000000001e-05 2024-04-18T14:44:32.621 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:32.621 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:32.621 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_committed", 2024-04-18T14:44:32.622 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:02.393982+0000", 2024-04-18T14:44:32.622 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0077113340000000002 2024-04-18T14:44:32.622 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:32.622 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:32.622 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-04-18T14:44:32.622 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:02.394042+0000", 2024-04-18T14:44:32.622 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 6.0118999999999998e-05 2024-04-18T14:44:32.622 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:44:32.622 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T14:44:32.622 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:44:32.622 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:32.622 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:32.623 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "MOSDECSubOpWrite(3.es1 63/30 ECSubWrite(tid=55, reqid=osd.8.0:55, at_version=63'44, trim_to=0'0, roll_forward_to=59'42))", 2024-04-18T14:44:32.623 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-04-18T14:44:02.386150+0000", 2024-04-18T14:44:32.623 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 30.231357640999999, 2024-04-18T14:44:32.623 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.010214071, 2024-04-18T14:44:32.623 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-04-18T14:44:32.623 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "reached pg", 2024-04-18T14:44:32.623 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-04-18T14:44:32.623 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:32.623 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-04-18T14:44:32.623 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:02.386150+0000", 2024-04-18T14:44:32.623 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:44:32.623 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:32.623 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:32.623 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-04-18T14:44:32.624 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:02.386150+0000", 2024-04-18T14:44:32.624 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:44:32.624 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:32.624 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:32.624 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-04-18T14:44:32.624 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:02.386149+0000", 2024-04-18T14:44:32.624 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 4294967295.9999995 2024-04-18T14:44:32.624 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:32.624 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:32.624 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-04-18T14:44:32.624 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:02.386210+0000", 2024-04-18T14:44:32.624 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 6.1183e-05 2024-04-18T14:44:32.624 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:32.624 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:32.624 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-04-18T14:44:32.625 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:02.386238+0000", 2024-04-18T14:44:32.625 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.7764e-05 2024-04-18T14:44:32.625 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:32.625 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:32.625 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-04-18T14:44:32.625 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:02.386270+0000", 2024-04-18T14:44:32.625 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.1636e-05 2024-04-18T14:44:32.625 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:32.625 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:32.625 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-04-18T14:44:32.625 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:02.387227+0000", 2024-04-18T14:44:32.625 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00095727799999999999 2024-04-18T14:44:32.625 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:32.625 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:32.625 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_started", 2024-04-18T14:44:32.625 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:02.387250+0000", 2024-04-18T14:44:32.626 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.2954000000000001e-05 2024-04-18T14:44:32.626 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:32.626 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:32.626 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_committed", 2024-04-18T14:44:32.626 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:02.396288+0000", 2024-04-18T14:44:32.626 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0090381650000000008 2024-04-18T14:44:32.626 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:32.626 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:32.626 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-04-18T14:44:32.626 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:02.396364+0000", 2024-04-18T14:44:32.626 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 7.5760999999999995e-05 2024-04-18T14:44:32.626 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:44:32.626 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T14:44:32.626 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:44:32.627 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:32.627 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:32.627 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "MOSDECSubOpWrite(3.6s6 63/30 ECSubWrite(tid=161, reqid=client.4559.0:582, at_version=63'58, trim_to=0'0, roll_forward_to=59'56))", 2024-04-18T14:44:32.627 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-04-18T14:44:02.387923+0000", 2024-04-18T14:44:32.627 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 30.229584438, 2024-04-18T14:44:32.627 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.011185921999999999, 2024-04-18T14:44:32.627 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-04-18T14:44:32.627 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "reached pg", 2024-04-18T14:44:32.627 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-04-18T14:44:32.627 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:32.627 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-04-18T14:44:32.627 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:02.387923+0000", 2024-04-18T14:44:32.628 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:44:32.628 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:32.628 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:32.628 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-04-18T14:44:32.628 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:02.387923+0000", 2024-04-18T14:44:32.628 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:44:32.628 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:32.628 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:32.628 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-04-18T14:44:32.628 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:02.387922+0000", 2024-04-18T14:44:32.628 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 4294967295.999999 2024-04-18T14:44:32.628 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:32.628 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:32.628 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-04-18T14:44:32.629 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:02.387983+0000", 2024-04-18T14:44:32.629 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 6.0983000000000002e-05 2024-04-18T14:44:32.629 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:32.629 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:32.629 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-04-18T14:44:32.629 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:02.388007+0000", 2024-04-18T14:44:32.629 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.3890999999999999e-05 2024-04-18T14:44:32.629 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:32.629 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:32.629 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-04-18T14:44:32.629 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:02.388025+0000", 2024-04-18T14:44:32.629 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.7541e-05 2024-04-18T14:44:32.629 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:32.629 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:32.629 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-04-18T14:44:32.630 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:02.388609+0000", 2024-04-18T14:44:32.630 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00058442900000000002 2024-04-18T14:44:32.630 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:32.630 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:32.630 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_started", 2024-04-18T14:44:32.630 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:02.388633+0000", 2024-04-18T14:44:32.630 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.3683e-05 2024-04-18T14:44:32.630 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:32.630 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:32.630 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_committed", 2024-04-18T14:44:32.630 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:02.398974+0000", 2024-04-18T14:44:32.630 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.010341474 2024-04-18T14:44:32.630 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:32.630 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:32.631 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-04-18T14:44:32.631 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:02.399109+0000", 2024-04-18T14:44:32.631 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000134778 2024-04-18T14:44:32.631 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:44:32.631 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T14:44:32.631 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:44:32.631 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:32.631 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:32.631 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "MOSDECSubOpWrite(3.7s2 63/30 ECSubWrite(tid=162, reqid=osd.14.0:162, at_version=63'70, trim_to=0'0, roll_forward_to=60'65))", 2024-04-18T14:44:32.631 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-04-18T14:44:02.388041+0000", 2024-04-18T14:44:32.631 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 30.229466091999999, 2024-04-18T14:44:32.631 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.011181602000000001, 2024-04-18T14:44:32.631 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-04-18T14:44:32.631 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "reached pg", 2024-04-18T14:44:32.631 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-04-18T14:44:32.631 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:32.631 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-04-18T14:44:32.632 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:02.388041+0000", 2024-04-18T14:44:32.632 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:44:32.632 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:32.632 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:32.632 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-04-18T14:44:32.632 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:02.388041+0000", 2024-04-18T14:44:32.632 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:44:32.632 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:32.632 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:32.632 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-04-18T14:44:32.632 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:02.388040+0000", 2024-04-18T14:44:32.632 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 4294967295.999999 2024-04-18T14:44:32.632 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:32.632 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:32.632 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-04-18T14:44:32.632 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:02.388077+0000", 2024-04-18T14:44:32.632 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.6965000000000003e-05 2024-04-18T14:44:32.633 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:32.633 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:32.633 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-04-18T14:44:32.633 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:02.388091+0000", 2024-04-18T14:44:32.633 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.4005000000000001e-05 2024-04-18T14:44:32.633 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:32.633 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:32.633 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-04-18T14:44:32.633 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:02.388103+0000", 2024-04-18T14:44:32.633 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.2069000000000001e-05 2024-04-18T14:44:32.633 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:32.633 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:32.633 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-04-18T14:44:32.633 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:02.390027+0000", 2024-04-18T14:44:32.633 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.001923679 2024-04-18T14:44:32.633 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:32.634 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:32.634 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_started", 2024-04-18T14:44:32.634 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:02.390129+0000", 2024-04-18T14:44:32.634 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000101828 2024-04-18T14:44:32.634 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:32.634 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:32.634 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_committed", 2024-04-18T14:44:32.634 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:02.399089+0000", 2024-04-18T14:44:32.634 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0089604279999999994 2024-04-18T14:44:32.635 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:32.635 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:32.635 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-04-18T14:44:32.635 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:02.399223+0000", 2024-04-18T14:44:32.635 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000133604 2024-04-18T14:44:32.635 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:44:32.635 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T14:44:32.635 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:44:32.635 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:32.635 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:32.635 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "MOSDECSubOpWrite(3.1s2 63/30 ECSubWrite(tid=57, reqid=osd.6.0:57, at_version=63'39, trim_to=0'0, roll_forward_to=59'35))", 2024-04-18T14:44:32.635 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-04-18T14:44:02.388136+0000", 2024-04-18T14:44:32.635 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 30.229371436000001, 2024-04-18T14:44:32.635 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.01102156, 2024-04-18T14:44:32.635 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-04-18T14:44:32.636 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "reached pg", 2024-04-18T14:44:32.636 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-04-18T14:44:32.636 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:32.636 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-04-18T14:44:32.636 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:02.388136+0000", 2024-04-18T14:44:32.636 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:44:32.636 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:32.636 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:32.636 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-04-18T14:44:32.636 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:02.388136+0000", 2024-04-18T14:44:32.636 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:44:32.636 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:32.636 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:32.636 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-04-18T14:44:32.636 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:02.388134+0000", 2024-04-18T14:44:32.637 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 4294967295.9999986 2024-04-18T14:44:32.637 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:32.637 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:32.637 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-04-18T14:44:32.637 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:02.388191+0000", 2024-04-18T14:44:32.637 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 5.6224000000000002e-05 2024-04-18T14:44:32.637 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:32.637 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:32.637 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-04-18T14:44:32.637 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:02.388219+0000", 2024-04-18T14:44:32.637 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.8572999999999999e-05 2024-04-18T14:44:32.637 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:32.637 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:32.637 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-04-18T14:44:32.637 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:02.388239+0000", 2024-04-18T14:44:32.637 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.9344e-05 2024-04-18T14:44:32.638 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:32.638 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:32.638 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-04-18T14:44:32.638 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:02.388411+0000", 2024-04-18T14:44:32.638 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000172277 2024-04-18T14:44:32.638 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:32.638 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:32.638 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_started", 2024-04-18T14:44:32.638 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:02.388435+0000", 2024-04-18T14:44:32.638 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.4297000000000001e-05 2024-04-18T14:44:32.638 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:32.638 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:32.638 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_committed", 2024-04-18T14:44:32.638 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:02.399045+0000", 2024-04-18T14:44:32.638 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.010609379 2024-04-18T14:44:32.639 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:32.639 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:32.639 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-04-18T14:44:32.639 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:02.399158+0000", 2024-04-18T14:44:32.639 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00011299299999999999 2024-04-18T14:44:32.639 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:44:32.639 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T14:44:32.639 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:44:32.639 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:32.639 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:32.639 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "MOSDECSubOpWrite(3.es1 63/30 ECSubWrite(tid=56, reqid=osd.8.0:56, at_version=63'46, trim_to=0'0, roll_forward_to=59'42))", 2024-04-18T14:44:32.639 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-04-18T14:44:02.388191+0000", 2024-04-18T14:44:32.639 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 30.229316736000001, 2024-04-18T14:44:32.639 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0082288799999999992, 2024-04-18T14:44:32.639 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-04-18T14:44:32.639 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "reached pg", 2024-04-18T14:44:32.640 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-04-18T14:44:32.640 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:32.640 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-04-18T14:44:32.640 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:02.388191+0000", 2024-04-18T14:44:32.640 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:44:32.640 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:32.640 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:32.640 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-04-18T14:44:32.640 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:02.388191+0000", 2024-04-18T14:44:32.640 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:44:32.640 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:32.640 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:32.640 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-04-18T14:44:32.640 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:02.388190+0000", 2024-04-18T14:44:32.640 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 4294967295.999999 2024-04-18T14:44:32.640 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:32.641 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:32.641 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-04-18T14:44:32.641 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:02.388228+0000", 2024-04-18T14:44:32.641 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.8121999999999999e-05 2024-04-18T14:44:32.641 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:32.641 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:32.641 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-04-18T14:44:32.641 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:02.388248+0000", 2024-04-18T14:44:32.641 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.9724e-05 2024-04-18T14:44:32.641 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:32.641 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:32.641 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-04-18T14:44:32.641 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:02.388262+0000", 2024-04-18T14:44:32.641 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.4202000000000001e-05 2024-04-18T14:44:32.641 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:32.641 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:32.641 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-04-18T14:44:32.642 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:02.388796+0000", 2024-04-18T14:44:32.642 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00053393099999999997 2024-04-18T14:44:32.642 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:32.642 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:32.642 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_started", 2024-04-18T14:44:32.642 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:02.388818+0000", 2024-04-18T14:44:32.642 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.2450999999999999e-05 2024-04-18T14:44:32.642 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:32.642 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:32.642 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_committed", 2024-04-18T14:44:32.642 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:02.396383+0000", 2024-04-18T14:44:32.642 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0075645640000000002 2024-04-18T14:44:32.642 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:32.643 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:32.643 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-04-18T14:44:32.643 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:02.396420+0000", 2024-04-18T14:44:32.643 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.6888999999999999e-05 2024-04-18T14:44:32.643 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:44:32.643 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T14:44:32.643 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:44:32.643 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:32.643 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:32.643 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "MOSDECSubOpWrite(3.6s6 63/30 ECSubWrite(tid=163, reqid=osd.14.0:163, at_version=63'60, trim_to=0'0, roll_forward_to=59'56))", 2024-04-18T14:44:32.643 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-04-18T14:44:02.391896+0000", 2024-04-18T14:44:32.643 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 30.225611851, 2024-04-18T14:44:32.643 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0081183950000000005, 2024-04-18T14:44:32.643 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-04-18T14:44:32.643 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "reached pg", 2024-04-18T14:44:32.643 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-04-18T14:44:32.643 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:32.644 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-04-18T14:44:32.644 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:02.391896+0000", 2024-04-18T14:44:32.644 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:44:32.644 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:32.644 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:32.644 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-04-18T14:44:32.644 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:02.391896+0000", 2024-04-18T14:44:32.644 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:44:32.644 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:32.644 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:32.644 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-04-18T14:44:32.644 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:02.391894+0000", 2024-04-18T14:44:32.644 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 4294967295.9999986 2024-04-18T14:44:32.644 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:32.644 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:32.644 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-04-18T14:44:32.645 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:02.391946+0000", 2024-04-18T14:44:32.645 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 5.1823999999999997e-05 2024-04-18T14:44:32.645 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:32.645 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:32.645 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-04-18T14:44:32.645 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:02.391986+0000", 2024-04-18T14:44:32.645 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 4.0234999999999997e-05 2024-04-18T14:44:32.646 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:32.646 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:32.646 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-04-18T14:44:32.646 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:02.392007+0000", 2024-04-18T14:44:32.646 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.0560999999999998e-05 2024-04-18T14:44:32.646 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:32.646 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:32.646 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-04-18T14:44:32.646 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:02.394241+0000", 2024-04-18T14:44:32.646 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.002233886 2024-04-18T14:44:32.646 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:32.646 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:32.646 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_started", 2024-04-18T14:44:32.646 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:02.394266+0000", 2024-04-18T14:44:32.646 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.5086999999999999e-05 2024-04-18T14:44:32.647 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:32.647 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:32.647 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_committed", 2024-04-18T14:44:32.647 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:02.399962+0000", 2024-04-18T14:44:32.647 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0056963880000000001 2024-04-18T14:44:32.647 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:32.647 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:32.647 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-04-18T14:44:32.647 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:02.400014+0000", 2024-04-18T14:44:32.647 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 5.1963999999999999e-05 2024-04-18T14:44:32.647 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:44:32.647 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T14:44:32.647 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:44:32.647 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:32.647 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:32.647 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "MOSDECSubOpWrite(3.6s6 67/30 ECSubWrite(tid=193, reqid=client.4559.0:656, at_version=67'78, trim_to=0'0, roll_forward_to=66'76))", 2024-04-18T14:44:32.648 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-04-18T14:44:06.458785+0000", 2024-04-18T14:44:32.648 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 26.158722267000002, 2024-04-18T14:44:32.648 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0090892390000000007, 2024-04-18T14:44:32.648 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-04-18T14:44:32.648 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "reached pg", 2024-04-18T14:44:32.648 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-04-18T14:44:32.648 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:32.648 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-04-18T14:44:32.648 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:06.458785+0000", 2024-04-18T14:44:32.648 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:44:32.648 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:32.648 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:32.648 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-04-18T14:44:32.648 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:06.458785+0000", 2024-04-18T14:44:32.648 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:44:32.649 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:32.649 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:32.649 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-04-18T14:44:32.649 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:06.458785+0000", 2024-04-18T14:44:32.649 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 4294967295.9999995 2024-04-18T14:44:32.649 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:32.649 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:32.649 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-04-18T14:44:32.649 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:06.459441+0000", 2024-04-18T14:44:32.649 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00065652799999999997 2024-04-18T14:44:32.649 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:32.649 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:32.649 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-04-18T14:44:32.649 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:06.459480+0000", 2024-04-18T14:44:32.649 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.9189e-05 2024-04-18T14:44:32.649 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:32.650 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:32.650 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-04-18T14:44:32.650 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:06.459529+0000", 2024-04-18T14:44:32.650 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 4.8195999999999997e-05 2024-04-18T14:44:32.650 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:32.650 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:32.650 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-04-18T14:44:32.650 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:06.459642+0000", 2024-04-18T14:44:32.650 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000113051 2024-04-18T14:44:32.650 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:32.650 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:32.650 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_started", 2024-04-18T14:44:32.650 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:06.459659+0000", 2024-04-18T14:44:32.650 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.7452000000000002e-05 2024-04-18T14:44:32.650 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:32.650 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:32.651 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_committed", 2024-04-18T14:44:32.651 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:06.467817+0000", 2024-04-18T14:44:32.651 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0081580739999999995 2024-04-18T14:44:32.651 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:32.651 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:32.651 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-04-18T14:44:32.651 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:06.467874+0000", 2024-04-18T14:44:32.651 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 5.7129000000000001e-05 2024-04-18T14:44:32.651 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:44:32.651 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T14:44:32.651 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:44:32.651 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:32.651 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:32.651 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "MOSDECSubOpWrite(3.1s2 72/30 ECSubWrite(tid=77, reqid=client.4559.0:715, at_version=72'62, trim_to=0'0, roll_forward_to=71'59))", 2024-04-18T14:44:32.651 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-04-18T14:44:11.488201+0000", 2024-04-18T14:44:32.651 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 21.129306492000001, 2024-04-18T14:44:32.652 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0096875209999999993, 2024-04-18T14:44:32.652 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-04-18T14:44:32.652 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "reached pg", 2024-04-18T14:44:32.652 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-04-18T14:44:32.652 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:32.652 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-04-18T14:44:32.652 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:11.488201+0000", 2024-04-18T14:44:32.652 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:44:32.652 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:32.652 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:32.652 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-04-18T14:44:32.652 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:11.488201+0000", 2024-04-18T14:44:32.652 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:44:32.652 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:32.652 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:32.652 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-04-18T14:44:32.652 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:11.488200+0000", 2024-04-18T14:44:32.653 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 4294967295.9999995 2024-04-18T14:44:32.653 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:32.653 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:32.653 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-04-18T14:44:32.653 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:11.491078+0000", 2024-04-18T14:44:32.653 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0028773779999999999 2024-04-18T14:44:32.654 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:32.654 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:32.654 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-04-18T14:44:32.654 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:11.491113+0000", 2024-04-18T14:44:32.654 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.5271000000000002e-05 2024-04-18T14:44:32.654 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:32.654 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:32.655 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-04-18T14:44:32.655 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:11.491134+0000", 2024-04-18T14:44:32.655 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.1299000000000001e-05 2024-04-18T14:44:32.655 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:32.655 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:32.655 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-04-18T14:44:32.655 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:11.491278+0000", 2024-04-18T14:44:32.655 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000143721 2024-04-18T14:44:32.655 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:32.655 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:32.655 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_started", 2024-04-18T14:44:32.655 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:11.491303+0000", 2024-04-18T14:44:32.655 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.5040000000000001e-05 2024-04-18T14:44:32.656 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:32.656 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:32.656 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_committed", 2024-04-18T14:44:32.656 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:11.497836+0000", 2024-04-18T14:44:32.656 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0065333960000000003 2024-04-18T14:44:32.656 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:32.656 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:32.656 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-04-18T14:44:32.656 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:11.497888+0000", 2024-04-18T14:44:32.656 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 5.2065999999999999e-05 2024-04-18T14:44:32.656 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:44:32.656 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T14:44:32.656 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:44:32.656 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:32.656 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:32.656 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "MOSDECSubOpWrite(3.es1 78/70 ECSubWrite(tid=101, reqid=osd.8.0:101, at_version=78'80, trim_to=0'0, roll_forward_to=76'78))", 2024-04-18T14:44:32.657 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-04-18T14:44:17.427429+0000", 2024-04-18T14:44:32.657 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 15.190078897999999, 2024-04-18T14:44:32.657 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0081917110000000008, 2024-04-18T14:44:32.657 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-04-18T14:44:32.657 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "reached pg", 2024-04-18T14:44:32.657 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-04-18T14:44:32.657 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:32.657 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-04-18T14:44:32.657 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:17.427429+0000", 2024-04-18T14:44:32.657 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:44:32.657 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:32.657 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:32.657 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-04-18T14:44:32.657 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:17.427429+0000", 2024-04-18T14:44:32.657 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:44:32.657 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:32.658 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:32.658 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-04-18T14:44:32.658 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:17.427428+0000", 2024-04-18T14:44:32.658 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 4294967295.9999995 2024-04-18T14:44:32.658 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:32.658 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:32.658 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-04-18T14:44:32.658 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:17.427515+0000", 2024-04-18T14:44:32.658 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 8.6995000000000003e-05 2024-04-18T14:44:32.658 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:32.658 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:32.658 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-04-18T14:44:32.658 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:17.427562+0000", 2024-04-18T14:44:32.658 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 4.6992e-05 2024-04-18T14:44:32.658 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:32.659 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:32.659 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-04-18T14:44:32.659 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:17.427588+0000", 2024-04-18T14:44:32.659 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.6363000000000002e-05 2024-04-18T14:44:32.659 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:32.659 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:32.659 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-04-18T14:44:32.659 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:17.427719+0000", 2024-04-18T14:44:32.659 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00013041699999999999 2024-04-18T14:44:32.659 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:32.659 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:32.659 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_started", 2024-04-18T14:44:32.659 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:17.427747+0000", 2024-04-18T14:44:32.659 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.8343999999999998e-05 2024-04-18T14:44:32.659 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:32.660 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:32.660 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_committed", 2024-04-18T14:44:32.660 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:17.435310+0000", 2024-04-18T14:44:32.660 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0075630109999999997 2024-04-18T14:44:32.660 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:32.660 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:32.660 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-04-18T14:44:32.660 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:17.435620+0000", 2024-04-18T14:44:32.660 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00031024900000000002 2024-04-18T14:44:32.660 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:44:32.660 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T14:44:32.660 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:44:32.660 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:32.660 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:32.660 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "MOSDECSubOpWrite(3.bs3 78/70 ECSubWrite(tid=94, reqid=osd.10.0:94, at_version=78'42, trim_to=0'0, roll_forward_to=77'40))", 2024-04-18T14:44:32.661 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-04-18T14:44:17.427655+0000", 2024-04-18T14:44:32.661 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 15.189852766, 2024-04-18T14:44:32.661 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0082016109999999993, 2024-04-18T14:44:32.661 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-04-18T14:44:32.661 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "reached pg", 2024-04-18T14:44:32.661 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-04-18T14:44:32.661 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:32.661 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-04-18T14:44:32.661 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:17.427655+0000", 2024-04-18T14:44:32.661 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:44:32.661 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:32.661 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:32.661 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-04-18T14:44:32.661 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:17.427655+0000", 2024-04-18T14:44:32.661 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:44:32.662 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:32.662 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:32.662 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-04-18T14:44:32.662 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:17.427654+0000", 2024-04-18T14:44:32.662 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 4294967295.9999995 2024-04-18T14:44:32.662 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:32.662 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:32.662 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-04-18T14:44:32.662 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:17.427701+0000", 2024-04-18T14:44:32.662 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 4.7332e-05 2024-04-18T14:44:32.662 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:32.662 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:32.662 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-04-18T14:44:32.662 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:17.427726+0000", 2024-04-18T14:44:32.662 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.4805999999999999e-05 2024-04-18T14:44:32.663 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:32.663 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:32.663 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-04-18T14:44:32.663 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:17.427750+0000", 2024-04-18T14:44:32.663 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.332e-05 2024-04-18T14:44:32.663 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:32.663 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:32.663 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-04-18T14:44:32.663 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:17.429392+0000", 2024-04-18T14:44:32.663 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0016423659999999999 2024-04-18T14:44:32.663 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:32.663 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:32.663 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_started", 2024-04-18T14:44:32.663 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:17.429419+0000", 2024-04-18T14:44:32.663 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.7016e-05 2024-04-18T14:44:32.663 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:32.664 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:32.664 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_committed", 2024-04-18T14:44:32.664 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:17.435807+0000", 2024-04-18T14:44:32.664 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0063877769999999999 2024-04-18T14:44:32.664 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:32.664 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:32.664 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-04-18T14:44:32.664 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:17.435856+0000", 2024-04-18T14:44:32.664 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 4.9517e-05 2024-04-18T14:44:32.664 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:44:32.665 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T14:44:32.665 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:44:32.665 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:32.665 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:32.665 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "MOSDECSubOpWrite(3.7s2 78/30 ECSubWrite(tid=277, reqid=osd.14.0:277, at_version=78'101, trim_to=0'0, roll_forward_to=76'99))", 2024-04-18T14:44:32.665 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-04-18T14:44:17.439549+0000", 2024-04-18T14:44:32.665 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 15.177957921999999, 2024-04-18T14:44:32.665 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0086485490000000002, 2024-04-18T14:44:32.665 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-04-18T14:44:32.665 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "reached pg", 2024-04-18T14:44:32.665 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-04-18T14:44:32.665 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:32.665 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-04-18T14:44:32.665 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:17.439549+0000", 2024-04-18T14:44:32.665 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:44:32.665 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:32.666 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:32.666 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-04-18T14:44:32.666 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:17.439549+0000", 2024-04-18T14:44:32.666 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:44:32.666 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:32.666 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:32.666 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-04-18T14:44:32.666 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:17.439549+0000", 2024-04-18T14:44:32.666 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 4294967295.999999 2024-04-18T14:44:32.666 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:32.666 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:32.666 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-04-18T14:44:32.666 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:17.439592+0000", 2024-04-18T14:44:32.666 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 4.3551999999999999e-05 2024-04-18T14:44:32.667 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:32.667 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:32.667 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-04-18T14:44:32.667 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:17.439612+0000", 2024-04-18T14:44:32.667 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.9902999999999999e-05 2024-04-18T14:44:32.667 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:32.667 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:32.667 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-04-18T14:44:32.667 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:17.439656+0000", 2024-04-18T14:44:32.667 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 4.3479000000000002e-05 2024-04-18T14:44:32.667 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:32.667 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:32.667 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-04-18T14:44:32.667 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:17.440682+0000", 2024-04-18T14:44:32.667 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0010266139999999999 2024-04-18T14:44:32.667 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:32.668 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:32.668 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_started", 2024-04-18T14:44:32.668 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:17.440704+0000", 2024-04-18T14:44:32.668 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.1993000000000001e-05 2024-04-18T14:44:32.668 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:32.668 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:32.668 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_committed", 2024-04-18T14:44:32.668 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:17.448156+0000", 2024-04-18T14:44:32.668 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0074514739999999996 2024-04-18T14:44:32.668 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:32.668 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:32.669 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-04-18T14:44:32.669 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:17.448198+0000", 2024-04-18T14:44:32.669 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 4.2307e-05 2024-04-18T14:44:32.669 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:44:32.669 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T14:44:32.669 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:44:32.669 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:32.669 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:32.669 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "MOSDECSubOpWrite(3.6s6 78/70 ECSubWrite(tid=287, reqid=osd.14.0:285, at_version=0'0, trim_to=0'0, roll_forward_to=78'119))", 2024-04-18T14:44:32.669 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-04-18T14:44:17.481485+0000", 2024-04-18T14:44:32.669 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 15.136022243999999, 2024-04-18T14:44:32.669 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0090039219999999993, 2024-04-18T14:44:32.669 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-04-18T14:44:32.669 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "reached pg", 2024-04-18T14:44:32.669 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-04-18T14:44:32.670 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:32.670 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-04-18T14:44:32.670 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:17.481485+0000", 2024-04-18T14:44:32.670 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:44:32.670 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:32.670 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:32.670 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-04-18T14:44:32.670 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:17.481485+0000", 2024-04-18T14:44:32.670 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:44:32.670 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:32.670 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:32.670 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-04-18T14:44:32.670 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:17.481485+0000", 2024-04-18T14:44:32.670 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 4294967295.9999995 2024-04-18T14:44:32.670 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:32.671 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:32.671 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-04-18T14:44:32.671 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:17.481490+0000", 2024-04-18T14:44:32.671 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 5.6529999999999999e-06 2024-04-18T14:44:32.671 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:32.671 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:32.671 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-04-18T14:44:32.671 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:17.481495+0000", 2024-04-18T14:44:32.671 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 4.921e-06 2024-04-18T14:44:32.671 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:32.671 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:32.671 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-04-18T14:44:32.671 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:17.481500+0000", 2024-04-18T14:44:32.672 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 4.6369999999999998e-06 2024-04-18T14:44:32.672 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:32.672 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:32.672 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-04-18T14:44:32.672 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:17.481888+0000", 2024-04-18T14:44:32.672 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00038758199999999998 2024-04-18T14:44:32.672 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:32.672 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:32.672 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_started", 2024-04-18T14:44:32.672 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:17.481899+0000", 2024-04-18T14:44:32.672 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.11e-05 2024-04-18T14:44:32.672 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:32.673 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:32.673 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_committed", 2024-04-18T14:44:32.673 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:17.490444+0000", 2024-04-18T14:44:32.673 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0085450739999999997 2024-04-18T14:44:32.673 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:32.673 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:32.673 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-04-18T14:44:32.673 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:17.490489+0000", 2024-04-18T14:44:32.673 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 4.5349000000000002e-05 2024-04-18T14:44:32.673 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:44:32.673 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T14:44:32.674 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:44:32.674 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:32.674 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:32.674 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "MOSDECSubOpWrite(3.6s6 82/70 ECSubWrite(tid=318, reqid=osd.14.0:318, at_version=82'140, trim_to=0'0, roll_forward_to=81'138))", 2024-04-18T14:44:32.674 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-04-18T14:44:21.460392+0000", 2024-04-18T14:44:32.674 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 11.157114936999999, 2024-04-18T14:44:32.674 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0099549300000000007, 2024-04-18T14:44:32.674 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-04-18T14:44:32.674 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "reached pg", 2024-04-18T14:44:32.674 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-04-18T14:44:32.674 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:32.674 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-04-18T14:44:32.675 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:21.460392+0000", 2024-04-18T14:44:32.675 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:44:32.675 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:32.675 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:32.675 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-04-18T14:44:32.675 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:21.460392+0000", 2024-04-18T14:44:32.675 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:44:32.675 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:32.675 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:32.675 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-04-18T14:44:32.675 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:21.460390+0000", 2024-04-18T14:44:32.675 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 4294967295.9999976 2024-04-18T14:44:32.675 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:32.676 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:32.676 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-04-18T14:44:32.676 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:21.460445+0000", 2024-04-18T14:44:32.676 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 5.5099000000000002e-05 2024-04-18T14:44:32.676 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:32.676 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:32.676 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-04-18T14:44:32.676 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:21.460480+0000", 2024-04-18T14:44:32.676 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.4882999999999998e-05 2024-04-18T14:44:32.676 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:32.676 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:32.677 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-04-18T14:44:32.677 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:21.460503+0000", 2024-04-18T14:44:32.677 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.3053000000000001e-05 2024-04-18T14:44:32.677 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:32.677 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:32.677 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-04-18T14:44:32.677 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:21.460714+0000", 2024-04-18T14:44:32.677 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000210423 2024-04-18T14:44:32.677 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:32.677 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:32.677 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_started", 2024-04-18T14:44:32.677 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:21.460740+0000", 2024-04-18T14:44:32.677 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.635e-05 2024-04-18T14:44:32.677 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:32.677 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:32.677 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_committed", 2024-04-18T14:44:32.678 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:21.468019+0000", 2024-04-18T14:44:32.678 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0072793270000000004 2024-04-18T14:44:32.678 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:32.678 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:32.678 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-04-18T14:44:32.678 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:21.470347+0000", 2024-04-18T14:44:32.678 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0023280549999999999 2024-04-18T14:44:32.678 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:44:32.678 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T14:44:32.678 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:44:32.678 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:32.678 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:32.679 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "MOSDECSubOpWrite(3.7s2 82/30 ECSubWrite(tid=320, reqid=osd.14.0:320, at_version=82'123, trim_to=0'0, roll_forward_to=80'119))", 2024-04-18T14:44:32.679 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-04-18T14:44:21.472480+0000", 2024-04-18T14:44:32.679 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 11.145027294, 2024-04-18T14:44:32.679 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.011241184, 2024-04-18T14:44:32.679 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-04-18T14:44:32.679 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "reached pg", 2024-04-18T14:44:32.679 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-04-18T14:44:32.679 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:32.679 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-04-18T14:44:32.679 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:21.472480+0000", 2024-04-18T14:44:32.679 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:44:32.679 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:32.679 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:32.679 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-04-18T14:44:32.680 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:21.472480+0000", 2024-04-18T14:44:32.680 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:44:32.680 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:32.680 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:32.680 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-04-18T14:44:32.680 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:21.472478+0000", 2024-04-18T14:44:32.680 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 4294967295.9999981 2024-04-18T14:44:32.680 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:32.680 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:32.680 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-04-18T14:44:32.680 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:21.472535+0000", 2024-04-18T14:44:32.680 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 5.6202000000000002e-05 2024-04-18T14:44:32.680 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:32.680 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:32.680 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-04-18T14:44:32.680 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:21.472580+0000", 2024-04-18T14:44:32.681 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 4.5466000000000001e-05 2024-04-18T14:44:32.681 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:32.681 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:32.681 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-04-18T14:44:32.681 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:21.472603+0000", 2024-04-18T14:44:32.681 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.2793e-05 2024-04-18T14:44:32.681 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:32.681 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:32.681 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-04-18T14:44:32.681 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:21.472735+0000", 2024-04-18T14:44:32.681 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00013228099999999999 2024-04-18T14:44:32.681 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:32.681 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:32.681 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_started", 2024-04-18T14:44:32.681 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:21.472761+0000", 2024-04-18T14:44:32.681 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.5933000000000001e-05 2024-04-18T14:44:32.682 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:32.682 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:32.682 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_committed", 2024-04-18T14:44:32.682 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:21.483664+0000", 2024-04-18T14:44:32.682 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.010902983 2024-04-18T14:44:32.682 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:32.682 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:32.682 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-04-18T14:44:32.682 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:21.483721+0000", 2024-04-18T14:44:32.682 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 5.7315999999999998e-05 2024-04-18T14:44:32.682 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:44:32.682 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T14:44:32.682 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:44:32.682 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:32.683 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:32.683 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "MOSDECSubOpWrite(3.7s2 82/30 ECSubWrite(tid=322, reqid=osd.14.0:322, at_version=82'125, trim_to=0'0, roll_forward_to=80'119))", 2024-04-18T14:44:32.683 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-04-18T14:44:21.473030+0000", 2024-04-18T14:44:32.683 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 11.144477221000001, 2024-04-18T14:44:32.683 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.014901639, 2024-04-18T14:44:32.683 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-04-18T14:44:32.683 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "reached pg", 2024-04-18T14:44:32.683 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-04-18T14:44:32.683 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:32.683 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-04-18T14:44:32.683 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:21.473030+0000", 2024-04-18T14:44:32.683 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:44:32.683 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:32.684 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:32.684 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-04-18T14:44:32.684 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:21.473030+0000", 2024-04-18T14:44:32.684 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:44:32.684 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:32.684 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:32.684 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-04-18T14:44:32.684 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:21.473029+0000", 2024-04-18T14:44:32.684 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 4294967295.999999 2024-04-18T14:44:32.684 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:32.684 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:32.684 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-04-18T14:44:32.684 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:21.473079+0000", 2024-04-18T14:44:32.684 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 5.0336000000000001e-05 2024-04-18T14:44:32.684 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:32.684 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:32.685 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-04-18T14:44:32.685 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:21.473103+0000", 2024-04-18T14:44:32.685 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.3516e-05 2024-04-18T14:44:32.685 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:32.685 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:32.685 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-04-18T14:44:32.685 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:21.473122+0000", 2024-04-18T14:44:32.685 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.8853999999999999e-05 2024-04-18T14:44:32.685 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:32.685 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:32.685 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-04-18T14:44:32.686 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:21.476930+0000", 2024-04-18T14:44:32.686 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.003808498 2024-04-18T14:44:32.686 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:32.686 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:32.686 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_started", 2024-04-18T14:44:32.686 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:21.476955+0000", 2024-04-18T14:44:32.687 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.4343000000000001e-05 2024-04-18T14:44:32.687 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:32.687 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:32.687 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_committed", 2024-04-18T14:44:32.687 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:21.487778+0000", 2024-04-18T14:44:32.687 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.010823789 2024-04-18T14:44:32.687 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:32.687 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:32.687 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-04-18T14:44:32.687 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:21.487932+0000", 2024-04-18T14:44:32.687 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00015337599999999999 2024-04-18T14:44:32.687 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:44:32.688 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T14:44:32.688 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:44:32.688 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:32.688 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:32.688 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "MOSDECSubOpWrite(3.as3 82/70 ECSubWrite(tid=112, reqid=osd.3.0:112, at_version=82'79, trim_to=0'0, roll_forward_to=80'75))", 2024-04-18T14:44:32.688 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-04-18T14:44:21.476137+0000", 2024-04-18T14:44:32.688 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 11.141370505999999, 2024-04-18T14:44:32.688 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.011879643, 2024-04-18T14:44:32.688 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-04-18T14:44:32.688 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "reached pg", 2024-04-18T14:44:32.688 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-04-18T14:44:32.688 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:32.688 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-04-18T14:44:32.688 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:21.476137+0000", 2024-04-18T14:44:32.688 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:44:32.688 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:32.689 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:32.689 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-04-18T14:44:32.689 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:21.476137+0000", 2024-04-18T14:44:32.689 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:44:32.689 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:32.689 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:32.689 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-04-18T14:44:32.689 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:21.476135+0000", 2024-04-18T14:44:32.689 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 4294967295.9999976 2024-04-18T14:44:32.689 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:32.689 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:32.689 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-04-18T14:44:32.689 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:21.476192+0000", 2024-04-18T14:44:32.689 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 5.7639000000000002e-05 2024-04-18T14:44:32.689 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:32.690 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:32.690 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-04-18T14:44:32.690 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:21.476227+0000", 2024-04-18T14:44:32.690 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.4143000000000002e-05 2024-04-18T14:44:32.690 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:32.690 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:32.690 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-04-18T14:44:32.690 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:21.476249+0000", 2024-04-18T14:44:32.690 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.2463000000000002e-05 2024-04-18T14:44:32.690 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:32.690 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:32.690 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-04-18T14:44:32.690 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:21.476480+0000", 2024-04-18T14:44:32.690 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00023135899999999999 2024-04-18T14:44:32.690 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:32.691 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:32.691 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_started", 2024-04-18T14:44:32.691 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:21.476506+0000", 2024-04-18T14:44:32.691 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.5505999999999999e-05 2024-04-18T14:44:32.691 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:32.691 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:32.691 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_committed", 2024-04-18T14:44:32.691 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:21.487709+0000", 2024-04-18T14:44:32.691 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.011203108 2024-04-18T14:44:32.691 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:32.691 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:32.691 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-04-18T14:44:32.691 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:21.488017+0000", 2024-04-18T14:44:32.691 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00030758800000000002 2024-04-18T14:44:32.691 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:44:32.691 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T14:44:32.692 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:44:32.692 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:32.692 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:32.692 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "MOSDECSubOpWrite(3.es1 82/70 ECSubWrite(tid=119, reqid=osd.8.0:118, at_version=0'0, trim_to=0'0, roll_forward_to=82'100))", 2024-04-18T14:44:32.692 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-04-18T14:44:21.477847+0000", 2024-04-18T14:44:32.692 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 11.139660136, 2024-04-18T14:44:32.692 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0104142, 2024-04-18T14:44:32.692 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-04-18T14:44:32.692 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "reached pg", 2024-04-18T14:44:32.692 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-04-18T14:44:32.692 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:32.692 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-04-18T14:44:32.692 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:21.477847+0000", 2024-04-18T14:44:32.692 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:44:32.692 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:32.692 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:32.692 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-04-18T14:44:32.693 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:21.477847+0000", 2024-04-18T14:44:32.693 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:44:32.693 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:32.693 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:32.693 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-04-18T14:44:32.693 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:21.477845+0000", 2024-04-18T14:44:32.693 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 4294967295.9999981 2024-04-18T14:44:32.693 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:32.693 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:32.693 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-04-18T14:44:32.693 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:21.477876+0000", 2024-04-18T14:44:32.693 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.0518999999999997e-05 2024-04-18T14:44:32.693 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:32.693 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:32.693 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-04-18T14:44:32.693 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:21.477909+0000", 2024-04-18T14:44:32.694 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.2987000000000001e-05 2024-04-18T14:44:32.694 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:32.694 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:32.694 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-04-18T14:44:32.694 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:21.477932+0000", 2024-04-18T14:44:32.694 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.3298999999999998e-05 2024-04-18T14:44:32.694 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:32.694 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:32.694 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-04-18T14:44:32.694 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:21.478058+0000", 2024-04-18T14:44:32.694 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00012551500000000001 2024-04-18T14:44:32.695 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:32.695 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:32.695 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_started", 2024-04-18T14:44:32.695 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:21.478085+0000", 2024-04-18T14:44:32.695 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.7282000000000001e-05 2024-04-18T14:44:32.695 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:32.696 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:32.696 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_committed", 2024-04-18T14:44:32.696 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:21.488208+0000", 2024-04-18T14:44:32.696 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.010123109999999999 2024-04-18T14:44:32.696 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:32.696 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:32.696 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-04-18T14:44:32.697 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:21.488261+0000", 2024-04-18T14:44:32.697 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 5.3307999999999999e-05 2024-04-18T14:44:32.697 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:44:32.697 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T14:44:32.697 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:44:32.697 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:32.697 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:32.697 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "MOSDECSubOpWrite(3.1s2 82/30 ECSubWrite(tid=108, reqid=osd.6.0:108, at_version=82'100, trim_to=0'0, roll_forward_to=80'98))", 2024-04-18T14:44:32.697 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-04-18T14:44:21.479231+0000", 2024-04-18T14:44:32.698 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 11.138276187000001, 2024-04-18T14:44:32.698 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0086895819999999995, 2024-04-18T14:44:32.698 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-04-18T14:44:32.698 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "reached pg", 2024-04-18T14:44:32.698 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-04-18T14:44:32.698 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:32.699 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-04-18T14:44:32.699 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:21.479231+0000", 2024-04-18T14:44:32.699 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:44:32.699 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:32.699 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:32.699 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-04-18T14:44:32.699 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:21.479231+0000", 2024-04-18T14:44:32.699 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:44:32.699 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:32.699 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:32.699 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-04-18T14:44:32.699 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:21.479230+0000", 2024-04-18T14:44:32.699 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 4294967295.999999 2024-04-18T14:44:32.699 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:32.700 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:32.700 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-04-18T14:44:32.700 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:21.479290+0000", 2024-04-18T14:44:32.700 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 5.9296000000000003e-05 2024-04-18T14:44:32.700 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:32.700 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:32.700 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-04-18T14:44:32.700 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:21.479322+0000", 2024-04-18T14:44:32.700 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.2651999999999998e-05 2024-04-18T14:44:32.700 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:32.700 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:32.701 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-04-18T14:44:32.701 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:21.479344+0000", 2024-04-18T14:44:32.701 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.1552999999999998e-05 2024-04-18T14:44:32.701 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:32.701 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:32.701 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-04-18T14:44:32.701 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:21.479600+0000", 2024-04-18T14:44:32.701 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00025649899999999998 2024-04-18T14:44:32.701 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:32.701 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:32.702 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_started", 2024-04-18T14:44:32.702 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:21.479635+0000", 2024-04-18T14:44:32.702 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.4493000000000003e-05 2024-04-18T14:44:32.702 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:32.702 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:32.702 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_committed", 2024-04-18T14:44:32.702 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:21.487862+0000", 2024-04-18T14:44:32.702 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0082272869999999998 2024-04-18T14:44:32.703 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:32.703 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:32.703 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-04-18T14:44:32.703 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:21.487921+0000", 2024-04-18T14:44:32.703 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 5.8758999999999998e-05 2024-04-18T14:44:32.703 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:44:32.703 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T14:44:32.703 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:44:32.703 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:32.703 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:32.704 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "MOSDECSubOpWrite(3.1s2 87/30 ECSubWrite(tid=122, reqid=client.4559.0:1005, at_version=87'114, trim_to=0'0, roll_forward_to=85'112))", 2024-04-18T14:44:32.704 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-04-18T14:44:26.499371+0000", 2024-04-18T14:44:32.704 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 6.1181360930000004, 2024-04-18T14:44:32.704 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0084388780000000004, 2024-04-18T14:44:32.704 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-04-18T14:44:32.704 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "reached pg", 2024-04-18T14:44:32.704 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-04-18T14:44:32.704 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:32.704 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-04-18T14:44:32.704 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:26.499371+0000", 2024-04-18T14:44:32.705 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:44:32.705 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:32.705 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:32.705 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-04-18T14:44:32.705 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:26.499371+0000", 2024-04-18T14:44:32.705 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:44:32.705 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:32.705 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:32.705 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-04-18T14:44:32.705 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:26.499371+0000", 2024-04-18T14:44:32.706 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 4294967295.999999 2024-04-18T14:44:32.706 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:32.706 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:32.706 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-04-18T14:44:32.706 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:26.499914+0000", 2024-04-18T14:44:32.706 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00054330800000000005 2024-04-18T14:44:32.706 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:32.706 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:32.707 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-04-18T14:44:32.707 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:26.499951+0000", 2024-04-18T14:44:32.707 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.7082000000000002e-05 2024-04-18T14:44:32.707 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:32.707 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:32.707 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-04-18T14:44:32.707 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:26.499975+0000", 2024-04-18T14:44:32.707 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.4182999999999999e-05 2024-04-18T14:44:32.707 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:32.708 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:32.708 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-04-18T14:44:32.708 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:26.500201+0000", 2024-04-18T14:44:32.708 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00022577 2024-04-18T14:44:32.708 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:32.708 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:32.708 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_started", 2024-04-18T14:44:32.708 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:26.500233+0000", 2024-04-18T14:44:32.708 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.1958999999999997e-05 2024-04-18T14:44:32.708 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:32.709 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:32.709 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_committed", 2024-04-18T14:44:32.709 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:26.507753+0000", 2024-04-18T14:44:32.709 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0075203370000000002 2024-04-18T14:44:32.709 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:32.709 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:32.709 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-04-18T14:44:32.709 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:26.507810+0000", 2024-04-18T14:44:32.709 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 5.7039000000000001e-05 2024-04-18T14:44:32.710 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:44:32.710 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T14:44:32.710 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:44:32.710 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:44:32.710 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T14:44:32.710 INFO:teuthology.orchestra.run.smithi096.stdout:} 2024-04-18T14:44:32.712 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.13.asok dump_ops_in_flight 2024-04-18T14:44:32.835 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2024-04-18T14:44:32.835 INFO:teuthology.orchestra.run.smithi096.stdout: "ops": [], 2024-04-18T14:44:32.835 INFO:teuthology.orchestra.run.smithi096.stdout: "num_ops": 0 2024-04-18T14:44:32.835 INFO:teuthology.orchestra.run.smithi096.stdout:} 2024-04-18T14:44:32.852 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.13.asok dump_blocked_ops 2024-04-18T14:44:32.968 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2024-04-18T14:44:32.968 INFO:teuthology.orchestra.run.smithi096.stdout: "ops": [], 2024-04-18T14:44:32.968 INFO:teuthology.orchestra.run.smithi096.stdout: "complaint_time": 30, 2024-04-18T14:44:32.968 INFO:teuthology.orchestra.run.smithi096.stdout: "num_blocked_ops": 0 2024-04-18T14:44:32.968 INFO:teuthology.orchestra.run.smithi096.stdout:} 2024-04-18T14:44:32.983 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.13.asok dump_historic_ops 2024-04-18T14:44:33.099 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2024-04-18T14:44:33.099 INFO:teuthology.orchestra.run.smithi096.stdout: "size": 20, 2024-04-18T14:44:33.099 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 600, 2024-04-18T14:44:33.099 INFO:teuthology.orchestra.run.smithi096.stdout: "ops": [ 2024-04-18T14:44:33.099 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:33.100 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4212.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-18T14:44:33.100 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-04-18T14:43:19.321281+0000", 2024-04-18T14:44:33.100 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 73.778759675000003, 2024-04-18T14:44:33.100 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.0074994820000001, 2024-04-18T14:44:33.100 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-04-18T14:44:33.100 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T14:44:33.100 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-04-18T14:44:33.100 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4212", 2024-04-18T14:44:33.100 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "172.21.15.134:0/3325451476", 2024-04-18T14:44:33.100 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 1 2024-04-18T14:44:33.100 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:33.100 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-04-18T14:44:33.100 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:33.100 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-04-18T14:44:33.101 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:19.321281+0000", 2024-04-18T14:44:33.101 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:44:33.101 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:33.101 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:33.101 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-04-18T14:44:33.101 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:19.321281+0000", 2024-04-18T14:44:33.101 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:44:33.101 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:33.101 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:33.101 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-04-18T14:44:33.101 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:19.321279+0000", 2024-04-18T14:44:33.101 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 4294967295.9999971 2024-04-18T14:44:33.101 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:33.101 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:33.101 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-04-18T14:44:33.101 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:19.321299+0000", 2024-04-18T14:44:33.102 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.0098e-05 2024-04-18T14:44:33.102 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:33.102 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:33.102 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-04-18T14:44:33.102 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:19.321342+0000", 2024-04-18T14:44:33.102 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 4.3146000000000003e-05 2024-04-18T14:44:33.102 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:33.102 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:33.102 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-04-18T14:44:33.102 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:19.321367+0000", 2024-04-18T14:44:33.102 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.5318000000000001e-05 2024-04-18T14:44:33.102 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:33.102 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:33.102 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-04-18T14:44:33.103 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:19.321511+0000", 2024-04-18T14:44:33.103 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000143981 2024-04-18T14:44:33.103 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:33.103 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:33.103 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for peered", 2024-04-18T14:44:33.103 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:19.321560+0000", 2024-04-18T14:44:33.103 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 4.8279999999999999e-05 2024-04-18T14:44:33.103 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:33.103 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:33.103 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-04-18T14:44:33.103 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.324154+0000", 2024-04-18T14:44:33.103 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.0025947829999999 2024-04-18T14:44:33.103 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:33.103 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:33.104 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-04-18T14:44:33.104 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.324558+0000", 2024-04-18T14:44:33.104 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00040310999999999998 2024-04-18T14:44:33.104 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:33.104 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:33.104 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for subops from 0", 2024-04-18T14:44:33.104 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.325049+0000", 2024-04-18T14:44:33.104 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00049149000000000003 2024-04-18T14:44:33.104 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:33.104 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:33.104 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_commit_rec", 2024-04-18T14:44:33.104 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.326473+0000", 2024-04-18T14:44:33.104 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.001423517 2024-04-18T14:44:33.104 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:33.105 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:33.105 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-04-18T14:44:33.105 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.328533+0000", 2024-04-18T14:44:33.105 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0020606779999999998 2024-04-18T14:44:33.105 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:33.105 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:33.105 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-04-18T14:44:33.105 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.328679+0000", 2024-04-18T14:44:33.105 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00014585800000000001 2024-04-18T14:44:33.105 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:33.105 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:33.105 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-04-18T14:44:33.105 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.328781+0000", 2024-04-18T14:44:33.105 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000101872 2024-04-18T14:44:33.105 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:44:33.105 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T14:44:33.106 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:44:33.106 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:33.106 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:33.106 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4212.0:110 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-04-18T14:44:33.106 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-04-18T14:43:20.700822+0000", 2024-04-18T14:44:33.106 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 72.399218880999996, 2024-04-18T14:44:33.106 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.021022381999999999, 2024-04-18T14:44:33.106 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-04-18T14:44:33.106 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T14:44:33.106 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-04-18T14:44:33.106 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4212", 2024-04-18T14:44:33.106 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "172.21.15.134:0/3325451476", 2024-04-18T14:44:33.106 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 110 2024-04-18T14:44:33.106 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:33.107 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-04-18T14:44:33.107 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:33.107 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-04-18T14:44:33.107 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.700822+0000", 2024-04-18T14:44:33.107 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:44:33.107 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:33.107 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:33.107 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-04-18T14:44:33.107 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.700822+0000", 2024-04-18T14:44:33.107 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:44:33.107 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:33.107 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:33.107 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-04-18T14:44:33.107 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.700821+0000", 2024-04-18T14:44:33.107 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 4294967295.999999 2024-04-18T14:44:33.107 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:33.108 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:33.108 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-04-18T14:44:33.108 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.700828+0000", 2024-04-18T14:44:33.108 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 6.9269999999999999e-06 2024-04-18T14:44:33.108 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:33.108 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:33.108 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-04-18T14:44:33.108 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.700839+0000", 2024-04-18T14:44:33.108 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.0702e-05 2024-04-18T14:44:33.108 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:33.108 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:33.108 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-04-18T14:44:33.108 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.700847+0000", 2024-04-18T14:44:33.108 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 7.6020000000000002e-06 2024-04-18T14:44:33.108 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:33.108 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:33.109 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-04-18T14:44:33.109 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.709488+0000", 2024-04-18T14:44:33.109 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0086410080000000004 2024-04-18T14:44:33.109 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:33.109 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:33.109 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-04-18T14:44:33.109 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.709751+0000", 2024-04-18T14:44:33.109 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000263272 2024-04-18T14:44:33.109 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:33.109 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:33.109 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for subops from 0", 2024-04-18T14:44:33.109 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.710106+0000", 2024-04-18T14:44:33.109 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000355037 2024-04-18T14:44:33.109 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:33.109 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:33.110 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-04-18T14:44:33.110 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.714026+0000", 2024-04-18T14:44:33.110 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0039202860000000003 2024-04-18T14:44:33.110 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:33.110 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:33.110 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_commit_rec", 2024-04-18T14:44:33.110 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.721600+0000", 2024-04-18T14:44:33.110 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0075740879999999997 2024-04-18T14:44:33.110 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:33.110 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:33.110 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-04-18T14:44:33.110 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.721740+0000", 2024-04-18T14:44:33.110 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00013932500000000001 2024-04-18T14:44:33.110 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:33.110 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:33.111 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-04-18T14:44:33.111 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.721845+0000", 2024-04-18T14:44:33.111 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000104992 2024-04-18T14:44:33.111 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:44:33.111 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T14:44:33.111 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:44:33.111 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:33.111 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:33.111 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4212.0:111 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-04-18T14:44:33.111 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-04-18T14:43:20.700855+0000", 2024-04-18T14:44:33.111 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 72.399185997000004, 2024-04-18T14:44:33.111 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.021347998, 2024-04-18T14:44:33.111 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-04-18T14:44:33.111 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T14:44:33.111 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-04-18T14:44:33.112 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4212", 2024-04-18T14:44:33.112 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "172.21.15.134:0/3325451476", 2024-04-18T14:44:33.112 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 111 2024-04-18T14:44:33.112 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:33.112 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-04-18T14:44:33.112 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:33.112 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-04-18T14:44:33.112 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.700855+0000", 2024-04-18T14:44:33.112 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:44:33.112 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:33.112 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:33.112 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-04-18T14:44:33.112 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.700855+0000", 2024-04-18T14:44:33.112 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:44:33.112 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:33.113 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:33.113 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-04-18T14:44:33.113 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.700854+0000", 2024-04-18T14:44:33.113 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 4294967295.999999 2024-04-18T14:44:33.113 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:33.113 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:33.113 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-04-18T14:44:33.113 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.700860+0000", 2024-04-18T14:44:33.113 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 5.7189999999999998e-06 2024-04-18T14:44:33.113 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:33.113 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:33.113 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-04-18T14:44:33.113 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.700869+0000", 2024-04-18T14:44:33.113 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 8.9889999999999998e-06 2024-04-18T14:44:33.113 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:33.114 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:33.114 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-04-18T14:44:33.114 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.700876+0000", 2024-04-18T14:44:33.114 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 7.0430000000000002e-06 2024-04-18T14:44:33.114 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:33.114 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:33.114 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-04-18T14:44:33.114 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.711224+0000", 2024-04-18T14:44:33.114 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.010347897 2024-04-18T14:44:33.114 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:33.114 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:33.114 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-04-18T14:44:33.114 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.711463+0000", 2024-04-18T14:44:33.114 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00023920699999999999 2024-04-18T14:44:33.115 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:33.115 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:33.115 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for subops from 0", 2024-04-18T14:44:33.115 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.711805+0000", 2024-04-18T14:44:33.115 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00034209600000000001 2024-04-18T14:44:33.115 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:33.115 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:33.115 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-04-18T14:44:33.115 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.715645+0000", 2024-04-18T14:44:33.115 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.003839309 2024-04-18T14:44:33.115 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:33.115 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:33.115 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_commit_rec", 2024-04-18T14:44:33.115 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.721971+0000", 2024-04-18T14:44:33.116 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0063267729999999999 2024-04-18T14:44:33.116 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:33.116 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:33.116 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-04-18T14:44:33.116 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.722107+0000", 2024-04-18T14:44:33.116 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00013514500000000001 2024-04-18T14:44:33.116 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:33.116 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:33.116 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-04-18T14:44:33.116 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.722203+0000", 2024-04-18T14:44:33.116 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 9.6545999999999993e-05 2024-04-18T14:44:33.116 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:44:33.117 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T14:44:33.117 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:44:33.117 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:33.117 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:33.117 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4212.0:112 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-04-18T14:44:33.117 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-04-18T14:43:20.700902+0000", 2024-04-18T14:44:33.117 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 72.399138854, 2024-04-18T14:44:33.117 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.021658816000000001, 2024-04-18T14:44:33.117 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-04-18T14:44:33.117 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T14:44:33.117 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-04-18T14:44:33.117 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4212", 2024-04-18T14:44:33.117 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "172.21.15.134:0/3325451476", 2024-04-18T14:44:33.117 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 112 2024-04-18T14:44:33.117 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:33.118 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-04-18T14:44:33.118 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:33.118 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-04-18T14:44:33.118 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.700902+0000", 2024-04-18T14:44:33.118 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:44:33.118 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:33.118 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:33.118 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-04-18T14:44:33.118 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.700902+0000", 2024-04-18T14:44:33.118 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:44:33.118 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:33.118 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:33.118 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-04-18T14:44:33.118 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.700901+0000", 2024-04-18T14:44:33.118 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 4294967295.999999 2024-04-18T14:44:33.119 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:33.119 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:33.119 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-04-18T14:44:33.119 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.701003+0000", 2024-04-18T14:44:33.119 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000102205 2024-04-18T14:44:33.119 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:33.119 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:33.119 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-04-18T14:44:33.119 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.701016+0000", 2024-04-18T14:44:33.119 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.2908000000000001e-05 2024-04-18T14:44:33.119 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:33.119 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:33.119 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-04-18T14:44:33.119 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.701025+0000", 2024-04-18T14:44:33.119 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 8.7229999999999993e-06 2024-04-18T14:44:33.120 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:33.120 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:33.120 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-04-18T14:44:33.120 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.712558+0000", 2024-04-18T14:44:33.120 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.011533181 2024-04-18T14:44:33.120 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:33.120 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:33.120 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-04-18T14:44:33.120 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.712690+0000", 2024-04-18T14:44:33.120 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00013159200000000001 2024-04-18T14:44:33.120 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:33.120 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:33.120 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for subops from 0", 2024-04-18T14:44:33.120 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.712895+0000", 2024-04-18T14:44:33.120 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000205126 2024-04-18T14:44:33.120 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:33.121 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:33.121 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-04-18T14:44:33.121 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.721499+0000", 2024-04-18T14:44:33.121 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0086041469999999995 2024-04-18T14:44:33.121 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:33.121 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:33.121 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_commit_rec", 2024-04-18T14:44:33.121 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.722336+0000", 2024-04-18T14:44:33.121 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00083725200000000003 2024-04-18T14:44:33.121 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:33.121 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:33.121 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-04-18T14:44:33.121 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.722461+0000", 2024-04-18T14:44:33.121 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00012457899999999999 2024-04-18T14:44:33.122 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:33.122 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:33.122 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-04-18T14:44:33.122 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.722561+0000", 2024-04-18T14:44:33.122 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000100066 2024-04-18T14:44:33.122 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:44:33.122 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T14:44:33.122 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:44:33.122 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:33.122 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:33.122 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4212.0:113 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-04-18T14:44:33.122 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-04-18T14:43:20.701035+0000", 2024-04-18T14:44:33.122 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 72.399005668000001, 2024-04-18T14:44:33.122 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.021756507000000001, 2024-04-18T14:44:33.122 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-04-18T14:44:33.123 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T14:44:33.123 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-04-18T14:44:33.123 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4212", 2024-04-18T14:44:33.123 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "172.21.15.134:0/3325451476", 2024-04-18T14:44:33.123 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 113 2024-04-18T14:44:33.123 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:33.123 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-04-18T14:44:33.123 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:33.123 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-04-18T14:44:33.123 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.701035+0000", 2024-04-18T14:44:33.123 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:44:33.123 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:33.123 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:33.123 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-04-18T14:44:33.123 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.701035+0000", 2024-04-18T14:44:33.124 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:44:33.124 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:33.124 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:33.124 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-04-18T14:44:33.124 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.701035+0000", 2024-04-18T14:44:33.124 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 4294967295.999999 2024-04-18T14:44:33.124 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:33.125 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:33.125 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-04-18T14:44:33.125 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.701041+0000", 2024-04-18T14:44:33.125 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 6.0290000000000002e-06 2024-04-18T14:44:33.125 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:33.125 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:33.125 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-04-18T14:44:33.125 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.701050+0000", 2024-04-18T14:44:33.125 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 9.0299999999999999e-06 2024-04-18T14:44:33.125 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:33.126 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:33.126 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-04-18T14:44:33.126 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.701057+0000", 2024-04-18T14:44:33.126 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 6.9550000000000003e-06 2024-04-18T14:44:33.126 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:33.126 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:33.126 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-04-18T14:44:33.126 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.714308+0000", 2024-04-18T14:44:33.126 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.013251281 2024-04-18T14:44:33.126 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:33.126 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:33.126 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-04-18T14:44:33.126 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.714542+0000", 2024-04-18T14:44:33.126 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00023440000000000001 2024-04-18T14:44:33.127 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:33.127 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:33.127 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for subops from 0", 2024-04-18T14:44:33.127 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.714898+0000", 2024-04-18T14:44:33.127 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00035589500000000001 2024-04-18T14:44:33.127 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:33.127 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:33.127 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-04-18T14:44:33.127 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.721874+0000", 2024-04-18T14:44:33.127 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0069761620000000002 2024-04-18T14:44:33.127 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:33.127 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:33.127 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_commit_rec", 2024-04-18T14:44:33.127 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.722665+0000", 2024-04-18T14:44:33.127 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00079023299999999999 2024-04-18T14:44:33.128 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:33.128 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:33.128 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-04-18T14:44:33.128 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.722737+0000", 2024-04-18T14:44:33.128 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 7.2156999999999994e-05 2024-04-18T14:44:33.128 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:33.128 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:33.128 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-04-18T14:44:33.128 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.722792+0000", 2024-04-18T14:44:33.128 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 5.5095e-05 2024-04-18T14:44:33.128 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:44:33.128 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T14:44:33.128 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:44:33.128 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:33.128 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:33.129 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4212.0:114 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-04-18T14:44:33.129 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-04-18T14:43:20.701065+0000", 2024-04-18T14:44:33.129 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 72.398976007000002, 2024-04-18T14:44:33.129 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.022072597999999999, 2024-04-18T14:44:33.129 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-04-18T14:44:33.129 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T14:44:33.129 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-04-18T14:44:33.129 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4212", 2024-04-18T14:44:33.129 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "172.21.15.134:0/3325451476", 2024-04-18T14:44:33.129 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 114 2024-04-18T14:44:33.129 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:33.129 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-04-18T14:44:33.129 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:33.129 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-04-18T14:44:33.129 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.701065+0000", 2024-04-18T14:44:33.130 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:44:33.130 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:33.130 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:33.130 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-04-18T14:44:33.130 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.701065+0000", 2024-04-18T14:44:33.130 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:44:33.130 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:33.130 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:33.130 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-04-18T14:44:33.130 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.701064+0000", 2024-04-18T14:44:33.130 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 4294967295.9999995 2024-04-18T14:44:33.130 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:33.130 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:33.130 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-04-18T14:44:33.130 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.701070+0000", 2024-04-18T14:44:33.131 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 5.6400000000000002e-06 2024-04-18T14:44:33.131 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:33.131 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:33.131 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-04-18T14:44:33.131 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.701079+0000", 2024-04-18T14:44:33.131 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 8.9590000000000001e-06 2024-04-18T14:44:33.131 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:33.131 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:33.131 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-04-18T14:44:33.131 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.701086+0000", 2024-04-18T14:44:33.131 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 6.8499999999999996e-06 2024-04-18T14:44:33.131 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:33.131 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:33.131 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-04-18T14:44:33.131 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.715764+0000", 2024-04-18T14:44:33.132 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.01467833 2024-04-18T14:44:33.132 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:33.132 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:33.132 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-04-18T14:44:33.132 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.715902+0000", 2024-04-18T14:44:33.132 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00013763499999999999 2024-04-18T14:44:33.132 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:33.132 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:33.132 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for subops from 0", 2024-04-18T14:44:33.132 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.716201+0000", 2024-04-18T14:44:33.132 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00029946200000000001 2024-04-18T14:44:33.132 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:33.132 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:33.132 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-04-18T14:44:33.132 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.721892+0000", 2024-04-18T14:44:33.132 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0056902680000000001 2024-04-18T14:44:33.133 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:33.133 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:33.133 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_commit_rec", 2024-04-18T14:44:33.133 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.722918+0000", 2024-04-18T14:44:33.133 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0010263130000000001 2024-04-18T14:44:33.133 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:33.133 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:33.133 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-04-18T14:44:33.133 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.723034+0000", 2024-04-18T14:44:33.133 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000116481 2024-04-18T14:44:33.133 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:33.133 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:33.133 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-04-18T14:44:33.133 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.723138+0000", 2024-04-18T14:44:33.133 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000103274 2024-04-18T14:44:33.134 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:44:33.134 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T14:44:33.134 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:44:33.134 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:33.134 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:33.134 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4212.0:115 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-04-18T14:44:33.134 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-04-18T14:43:20.701238+0000", 2024-04-18T14:44:33.134 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 72.398802611999997, 2024-04-18T14:44:33.134 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.02214089, 2024-04-18T14:44:33.134 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-04-18T14:44:33.134 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T14:44:33.134 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-04-18T14:44:33.134 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4212", 2024-04-18T14:44:33.134 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "172.21.15.134:0/3325451476", 2024-04-18T14:44:33.135 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 115 2024-04-18T14:44:33.135 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:33.135 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-04-18T14:44:33.135 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:33.135 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-04-18T14:44:33.135 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.701238+0000", 2024-04-18T14:44:33.135 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:44:33.135 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:33.135 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:33.135 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-04-18T14:44:33.135 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.701238+0000", 2024-04-18T14:44:33.135 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:44:33.135 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:33.135 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:33.135 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-04-18T14:44:33.135 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.701237+0000", 2024-04-18T14:44:33.135 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 4294967295.9999986 2024-04-18T14:44:33.136 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:33.136 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:33.136 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-04-18T14:44:33.136 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.701377+0000", 2024-04-18T14:44:33.136 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000139849 2024-04-18T14:44:33.136 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:33.136 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:33.136 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-04-18T14:44:33.136 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.701392+0000", 2024-04-18T14:44:33.136 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.5322e-05 2024-04-18T14:44:33.136 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:33.136 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:33.136 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-04-18T14:44:33.136 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.701401+0000", 2024-04-18T14:44:33.136 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 8.9430000000000006e-06 2024-04-18T14:44:33.136 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:33.137 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:33.137 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-04-18T14:44:33.137 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.719830+0000", 2024-04-18T14:44:33.137 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.018429009999999999 2024-04-18T14:44:33.137 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:33.137 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:33.137 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-04-18T14:44:33.137 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.720057+0000", 2024-04-18T14:44:33.137 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00022700500000000001 2024-04-18T14:44:33.137 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:33.137 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:33.137 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for subops from 0", 2024-04-18T14:44:33.137 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.720408+0000", 2024-04-18T14:44:33.137 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00035086399999999999 2024-04-18T14:44:33.137 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:33.137 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:33.138 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-04-18T14:44:33.138 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.723171+0000", 2024-04-18T14:44:33.138 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.002762708 2024-04-18T14:44:33.138 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:33.138 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:33.138 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_commit_rec", 2024-04-18T14:44:33.138 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.723264+0000", 2024-04-18T14:44:33.138 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 9.2888999999999998e-05 2024-04-18T14:44:33.138 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:33.138 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:33.138 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-04-18T14:44:33.138 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.723329+0000", 2024-04-18T14:44:33.138 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 6.5394000000000004e-05 2024-04-18T14:44:33.138 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:33.139 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:33.139 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-04-18T14:44:33.139 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.723379+0000", 2024-04-18T14:44:33.139 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 5.0126000000000001e-05 2024-04-18T14:44:33.139 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:44:33.139 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T14:44:33.139 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:44:33.139 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:33.139 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:33.139 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4212.0:116 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-04-18T14:44:33.139 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-04-18T14:43:20.701416+0000", 2024-04-18T14:44:33.139 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 72.398625335999995, 2024-04-18T14:44:33.139 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.024681692000000002, 2024-04-18T14:44:33.139 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-04-18T14:44:33.139 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T14:44:33.140 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-04-18T14:44:33.140 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4212", 2024-04-18T14:44:33.140 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "172.21.15.134:0/3325451476", 2024-04-18T14:44:33.140 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 116 2024-04-18T14:44:33.140 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:33.140 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-04-18T14:44:33.140 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:33.140 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-04-18T14:44:33.140 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.701416+0000", 2024-04-18T14:44:33.140 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:44:33.140 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:33.140 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:33.140 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-04-18T14:44:33.140 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.701416+0000", 2024-04-18T14:44:33.140 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:44:33.140 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:33.141 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:33.141 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-04-18T14:44:33.141 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.701415+0000", 2024-04-18T14:44:33.141 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 4294967295.999999 2024-04-18T14:44:33.141 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:33.141 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:33.141 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-04-18T14:44:33.141 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.701434+0000", 2024-04-18T14:44:33.141 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.9258000000000001e-05 2024-04-18T14:44:33.141 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:33.141 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:33.141 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-04-18T14:44:33.141 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.701445+0000", 2024-04-18T14:44:33.141 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.0485999999999999e-05 2024-04-18T14:44:33.141 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:33.142 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:33.142 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-04-18T14:44:33.142 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.701452+0000", 2024-04-18T14:44:33.142 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 7.9060000000000002e-06 2024-04-18T14:44:33.142 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:33.142 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:33.142 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-04-18T14:44:33.142 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.723471+0000", 2024-04-18T14:44:33.142 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.022019047 2024-04-18T14:44:33.142 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:33.142 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:33.142 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-04-18T14:44:33.142 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.723697+0000", 2024-04-18T14:44:33.142 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000225634 2024-04-18T14:44:33.142 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:33.142 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:33.143 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for subops from 0", 2024-04-18T14:44:33.143 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.724053+0000", 2024-04-18T14:44:33.143 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000355798 2024-04-18T14:44:33.143 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:33.143 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:33.143 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_commit_rec", 2024-04-18T14:44:33.143 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.725675+0000", 2024-04-18T14:44:33.143 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.001622264 2024-04-18T14:44:33.143 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:33.143 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:33.143 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-04-18T14:44:33.143 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.725879+0000", 2024-04-18T14:44:33.143 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00020390299999999999 2024-04-18T14:44:33.143 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:33.143 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:33.144 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-04-18T14:44:33.144 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.725994+0000", 2024-04-18T14:44:33.144 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000115158 2024-04-18T14:44:33.144 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:33.144 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:33.144 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-04-18T14:44:33.144 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.726097+0000", 2024-04-18T14:44:33.144 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000103231 2024-04-18T14:44:33.144 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:44:33.144 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T14:44:33.144 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:44:33.144 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:33.144 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:33.144 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4212.0:117 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-04-18T14:44:33.144 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-04-18T14:43:20.701462+0000", 2024-04-18T14:44:33.144 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 72.398579502999993, 2024-04-18T14:44:33.145 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.025118439999999999, 2024-04-18T14:44:33.145 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-04-18T14:44:33.145 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T14:44:33.145 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-04-18T14:44:33.145 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4212", 2024-04-18T14:44:33.145 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "172.21.15.134:0/3325451476", 2024-04-18T14:44:33.145 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 117 2024-04-18T14:44:33.145 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:33.145 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-04-18T14:44:33.145 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:33.145 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-04-18T14:44:33.145 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.701462+0000", 2024-04-18T14:44:33.145 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:44:33.145 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:33.145 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:33.145 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-04-18T14:44:33.146 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.701462+0000", 2024-04-18T14:44:33.146 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:44:33.146 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:33.146 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:33.146 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-04-18T14:44:33.146 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.701461+0000", 2024-04-18T14:44:33.146 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 4294967295.9999995 2024-04-18T14:44:33.146 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:33.146 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:33.146 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-04-18T14:44:33.146 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.701468+0000", 2024-04-18T14:44:33.146 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 6.6630000000000004e-06 2024-04-18T14:44:33.146 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:33.146 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:33.146 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-04-18T14:44:33.147 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.701478+0000", 2024-04-18T14:44:33.147 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.0796e-05 2024-04-18T14:44:33.147 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:33.147 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:33.147 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-04-18T14:44:33.147 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.701486+0000", 2024-04-18T14:44:33.147 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 7.3490000000000003e-06 2024-04-18T14:44:33.147 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:33.147 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:33.147 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-04-18T14:44:33.147 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.724772+0000", 2024-04-18T14:44:33.147 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.023286554000000001 2024-04-18T14:44:33.147 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:33.147 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:33.147 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-04-18T14:44:33.148 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.724901+0000", 2024-04-18T14:44:33.148 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00012827499999999999 2024-04-18T14:44:33.148 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:33.148 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:33.148 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for subops from 0", 2024-04-18T14:44:33.148 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.725102+0000", 2024-04-18T14:44:33.148 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000201471 2024-04-18T14:44:33.148 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:33.148 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:33.148 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_commit_rec", 2024-04-18T14:44:33.148 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.726349+0000", 2024-04-18T14:44:33.148 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.001247061 2024-04-18T14:44:33.148 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:33.148 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:33.148 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-04-18T14:44:33.149 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.726373+0000", 2024-04-18T14:44:33.149 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.4207999999999999e-05 2024-04-18T14:44:33.149 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:33.149 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:33.149 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-04-18T14:44:33.149 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.726488+0000", 2024-04-18T14:44:33.149 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000115118 2024-04-18T14:44:33.149 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:33.149 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:33.149 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-04-18T14:44:33.149 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:20.726580+0000", 2024-04-18T14:44:33.149 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 9.1612000000000003e-05 2024-04-18T14:44:33.149 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:44:33.149 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T14:44:33.149 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:44:33.150 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:33.150 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:33.150 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4212.0:164 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-04-18T14:44:33.150 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-04-18T14:43:21.039689+0000", 2024-04-18T14:44:33.150 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 72.060351831999995, 2024-04-18T14:44:33.150 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.020243589999999999, 2024-04-18T14:44:33.150 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-04-18T14:44:33.150 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T14:44:33.150 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-04-18T14:44:33.150 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4212", 2024-04-18T14:44:33.150 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "172.21.15.134:0/3325451476", 2024-04-18T14:44:33.150 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 164 2024-04-18T14:44:33.150 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:33.150 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-04-18T14:44:33.151 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:33.151 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-04-18T14:44:33.151 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:21.039689+0000", 2024-04-18T14:44:33.151 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:44:33.151 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:33.151 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:33.151 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-04-18T14:44:33.151 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:21.039689+0000", 2024-04-18T14:44:33.151 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:44:33.151 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:33.151 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:33.151 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-04-18T14:44:33.151 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:21.039689+0000", 2024-04-18T14:44:33.151 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 4294967295.9999995 2024-04-18T14:44:33.152 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:33.152 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:33.152 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-04-18T14:44:33.152 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:21.039773+0000", 2024-04-18T14:44:33.152 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 8.4040000000000002e-05 2024-04-18T14:44:33.152 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:33.152 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:33.152 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-04-18T14:44:33.152 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:21.039783+0000", 2024-04-18T14:44:33.152 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.0786e-05 2024-04-18T14:44:33.152 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:33.152 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:33.152 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-04-18T14:44:33.152 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:21.039791+0000", 2024-04-18T14:44:33.152 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 7.8320000000000006e-06 2024-04-18T14:44:33.152 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:33.152 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:33.153 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-04-18T14:44:33.153 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:21.056266+0000", 2024-04-18T14:44:33.153 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.016474586999999999 2024-04-18T14:44:33.153 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:33.153 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:33.153 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-04-18T14:44:33.153 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:21.056394+0000", 2024-04-18T14:44:33.153 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00012773299999999999 2024-04-18T14:44:33.153 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:33.153 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:33.153 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for subops from 0", 2024-04-18T14:44:33.153 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:21.056584+0000", 2024-04-18T14:44:33.153 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00019052500000000001 2024-04-18T14:44:33.153 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:33.153 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:33.154 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_commit_rec", 2024-04-18T14:44:33.154 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:21.059718+0000", 2024-04-18T14:44:33.154 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0031340999999999999 2024-04-18T14:44:33.154 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:33.154 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:33.154 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-04-18T14:44:33.154 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:21.059746+0000", 2024-04-18T14:44:33.154 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.7447999999999999e-05 2024-04-18T14:44:33.154 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:33.154 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:33.154 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-04-18T14:44:33.154 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:21.059876+0000", 2024-04-18T14:44:33.154 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00013080599999999999 2024-04-18T14:44:33.154 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:33.155 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:33.155 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-04-18T14:44:33.155 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:21.059933+0000", 2024-04-18T14:44:33.155 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 5.6372999999999997e-05 2024-04-18T14:44:33.155 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:44:33.155 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T14:44:33.155 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:44:33.155 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:33.155 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:33.155 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4212.0:165 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-04-18T14:44:33.155 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-04-18T14:43:21.039800+0000", 2024-04-18T14:44:33.155 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 72.060240630999999, 2024-04-18T14:44:33.155 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.022777954, 2024-04-18T14:44:33.155 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-04-18T14:44:33.155 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T14:44:33.155 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-04-18T14:44:33.156 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4212", 2024-04-18T14:44:33.156 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "172.21.15.134:0/3325451476", 2024-04-18T14:44:33.156 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 165 2024-04-18T14:44:33.156 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:33.156 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-04-18T14:44:33.156 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:33.156 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-04-18T14:44:33.156 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:21.039800+0000", 2024-04-18T14:44:33.156 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:44:33.156 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:33.156 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:33.156 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-04-18T14:44:33.156 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:21.039800+0000", 2024-04-18T14:44:33.156 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:44:33.156 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:33.156 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:33.157 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-04-18T14:44:33.157 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:21.039800+0000", 2024-04-18T14:44:33.157 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 4294967295.999999 2024-04-18T14:44:33.157 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:33.157 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:33.157 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-04-18T14:44:33.157 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:21.039806+0000", 2024-04-18T14:44:33.157 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 6.263e-06 2024-04-18T14:44:33.157 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:33.157 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:33.157 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-04-18T14:44:33.157 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:21.039815+0000", 2024-04-18T14:44:33.157 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 9.0790000000000007e-06 2024-04-18T14:44:33.157 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:33.157 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:33.157 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-04-18T14:44:33.158 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:21.039822+0000", 2024-04-18T14:44:33.158 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 6.9929999999999998e-06 2024-04-18T14:44:33.158 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:33.158 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:33.158 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-04-18T14:44:33.158 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:21.058092+0000", 2024-04-18T14:44:33.158 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.018269884 2024-04-18T14:44:33.158 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:33.158 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:33.158 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-04-18T14:44:33.158 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:21.058307+0000", 2024-04-18T14:44:33.158 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00021547600000000001 2024-04-18T14:44:33.158 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:33.158 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:33.158 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for subops from 0", 2024-04-18T14:44:33.159 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:21.058667+0000", 2024-04-18T14:44:33.159 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00035945500000000001 2024-04-18T14:44:33.159 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:33.159 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:33.159 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_commit_rec", 2024-04-18T14:44:33.159 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:21.060393+0000", 2024-04-18T14:44:33.159 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0017262619999999999 2024-04-18T14:44:33.159 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:33.159 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:33.159 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-04-18T14:44:33.159 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:21.062336+0000", 2024-04-18T14:44:33.159 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.001943078 2024-04-18T14:44:33.159 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:33.159 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:33.159 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-04-18T14:44:33.159 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:21.062471+0000", 2024-04-18T14:44:33.160 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00013455300000000001 2024-04-18T14:44:33.160 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:33.160 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:33.160 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-04-18T14:44:33.160 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:21.062578+0000", 2024-04-18T14:44:33.160 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00010770800000000001 2024-04-18T14:44:33.160 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:44:33.160 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T14:44:33.160 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:44:33.160 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:33.160 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:33.160 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4212.0:187 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-04-18T14:44:33.160 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-04-18T14:43:21.211285+0000", 2024-04-18T14:44:33.160 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 71.888755699000001, 2024-04-18T14:44:33.160 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.022261811999999999, 2024-04-18T14:44:33.161 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-04-18T14:44:33.161 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T14:44:33.161 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-04-18T14:44:33.161 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4212", 2024-04-18T14:44:33.161 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "172.21.15.134:0/3325451476", 2024-04-18T14:44:33.161 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 187 2024-04-18T14:44:33.161 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:33.161 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-04-18T14:44:33.161 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:33.161 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-04-18T14:44:33.161 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:21.211285+0000", 2024-04-18T14:44:33.161 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:44:33.161 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:33.161 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:33.161 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-04-18T14:44:33.162 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:21.211285+0000", 2024-04-18T14:44:33.162 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:44:33.162 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:33.162 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:33.162 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-04-18T14:44:33.162 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:21.211285+0000", 2024-04-18T14:44:33.162 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 4294967295.9999995 2024-04-18T14:44:33.162 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:33.162 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:33.162 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-04-18T14:44:33.162 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:21.211290+0000", 2024-04-18T14:44:33.162 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 5.6999999999999996e-06 2024-04-18T14:44:33.162 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:33.162 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:33.162 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-04-18T14:44:33.163 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:21.211300+0000", 2024-04-18T14:44:33.163 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 9.0890000000000006e-06 2024-04-18T14:44:33.163 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:33.163 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:33.163 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-04-18T14:44:33.163 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:21.211306+0000", 2024-04-18T14:44:33.163 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 6.8029999999999999e-06 2024-04-18T14:44:33.163 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:33.163 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:33.163 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-04-18T14:44:33.163 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:21.228301+0000", 2024-04-18T14:44:33.163 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.016994598999999999 2024-04-18T14:44:33.163 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:33.163 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:33.163 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-04-18T14:44:33.164 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:21.228558+0000", 2024-04-18T14:44:33.164 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00025666600000000001 2024-04-18T14:44:33.164 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:33.164 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:33.164 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for subops from 0", 2024-04-18T14:44:33.164 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:21.228844+0000", 2024-04-18T14:44:33.164 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00028685700000000001 2024-04-18T14:44:33.164 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:33.164 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:33.164 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-04-18T14:44:33.164 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:21.233311+0000", 2024-04-18T14:44:33.164 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0044661400000000004 2024-04-18T14:44:33.164 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:33.164 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:33.164 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_commit_rec", 2024-04-18T14:44:33.165 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:21.233386+0000", 2024-04-18T14:44:33.165 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 7.5184000000000004e-05 2024-04-18T14:44:33.165 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:33.165 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:33.165 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-04-18T14:44:33.165 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:21.233457+0000", 2024-04-18T14:44:33.165 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 7.0914999999999994e-05 2024-04-18T14:44:33.165 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:33.165 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:33.165 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-04-18T14:44:33.165 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:21.233547+0000", 2024-04-18T14:44:33.165 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 9.0486000000000001e-05 2024-04-18T14:44:33.165 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:44:33.165 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T14:44:33.165 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:44:33.166 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:33.166 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:33.166 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4212.0:188 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-04-18T14:44:33.166 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-04-18T14:43:21.211314+0000", 2024-04-18T14:44:33.166 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 71.888726950999995, 2024-04-18T14:44:33.166 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.022928674999999999, 2024-04-18T14:44:33.166 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-04-18T14:44:33.166 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T14:44:33.166 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-04-18T14:44:33.166 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4212", 2024-04-18T14:44:33.166 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "172.21.15.134:0/3325451476", 2024-04-18T14:44:33.166 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 188 2024-04-18T14:44:33.166 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:33.166 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-04-18T14:44:33.167 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:33.167 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-04-18T14:44:33.167 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:21.211314+0000", 2024-04-18T14:44:33.167 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:44:33.167 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:33.167 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:33.167 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-04-18T14:44:33.167 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:21.211314+0000", 2024-04-18T14:44:33.167 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:44:33.167 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:33.167 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:33.167 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-04-18T14:44:33.167 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:21.211314+0000", 2024-04-18T14:44:33.167 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 4294967295.9999995 2024-04-18T14:44:33.167 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:33.167 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:33.168 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-04-18T14:44:33.168 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:21.211413+0000", 2024-04-18T14:44:33.168 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 9.9754999999999996e-05 2024-04-18T14:44:33.168 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:33.168 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:33.168 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-04-18T14:44:33.168 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:21.211425+0000", 2024-04-18T14:44:33.168 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.1259e-05 2024-04-18T14:44:33.168 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:33.168 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:33.168 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-04-18T14:44:33.168 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:21.211435+0000", 2024-04-18T14:44:33.168 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 9.9990000000000003e-06 2024-04-18T14:44:33.168 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:33.168 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:33.169 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-04-18T14:44:33.169 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:21.230726+0000", 2024-04-18T14:44:33.169 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.019291490000000001 2024-04-18T14:44:33.169 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:33.169 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:33.169 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-04-18T14:44:33.169 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:21.230855+0000", 2024-04-18T14:44:33.169 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000129102 2024-04-18T14:44:33.169 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:33.169 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:33.169 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for subops from 0", 2024-04-18T14:44:33.169 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:21.231049+0000", 2024-04-18T14:44:33.169 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00019388900000000001 2024-04-18T14:44:33.169 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:33.169 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:33.169 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-04-18T14:44:33.170 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:21.233333+0000", 2024-04-18T14:44:33.170 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0022836309999999999 2024-04-18T14:44:33.170 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:33.170 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:33.170 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_commit_rec", 2024-04-18T14:44:33.170 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:21.234118+0000", 2024-04-18T14:44:33.170 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00078523999999999998 2024-04-18T14:44:33.170 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:33.170 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:33.170 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-04-18T14:44:33.170 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:21.234191+0000", 2024-04-18T14:44:33.170 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 7.3028000000000006e-05 2024-04-18T14:44:33.170 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:33.170 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:33.170 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-04-18T14:44:33.171 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:21.234243+0000", 2024-04-18T14:44:33.171 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 5.1898999999999999e-05 2024-04-18T14:44:33.171 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:44:33.171 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T14:44:33.171 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:44:33.171 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:33.171 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:33.171 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4212.0:189 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-04-18T14:44:33.171 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-04-18T14:43:21.211444+0000", 2024-04-18T14:44:33.171 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 71.888597008000005, 2024-04-18T14:44:33.171 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.023955757000000001, 2024-04-18T14:44:33.171 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-04-18T14:44:33.171 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T14:44:33.171 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-04-18T14:44:33.171 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4212", 2024-04-18T14:44:33.171 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "172.21.15.134:0/3325451476", 2024-04-18T14:44:33.172 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 189 2024-04-18T14:44:33.172 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:33.172 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-04-18T14:44:33.172 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:33.172 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-04-18T14:44:33.172 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:21.211444+0000", 2024-04-18T14:44:33.172 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:44:33.172 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:33.172 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:33.172 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-04-18T14:44:33.172 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:21.211444+0000", 2024-04-18T14:44:33.172 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:44:33.172 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:33.172 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:33.172 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-04-18T14:44:33.172 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:21.211443+0000", 2024-04-18T14:44:33.173 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 4294967295.999999 2024-04-18T14:44:33.173 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:33.173 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:33.173 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-04-18T14:44:33.173 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:21.211450+0000", 2024-04-18T14:44:33.173 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 6.28e-06 2024-04-18T14:44:33.173 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:33.173 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:33.173 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-04-18T14:44:33.173 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:21.211459+0000", 2024-04-18T14:44:33.173 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 9.132e-06 2024-04-18T14:44:33.173 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:33.173 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:33.173 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-04-18T14:44:33.173 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:21.211466+0000", 2024-04-18T14:44:33.173 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 6.8530000000000003e-06 2024-04-18T14:44:33.173 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:33.174 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:33.174 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-04-18T14:44:33.174 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:21.231986+0000", 2024-04-18T14:44:33.174 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.020520218 2024-04-18T14:44:33.174 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:33.174 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:33.174 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-04-18T14:44:33.174 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:21.232208+0000", 2024-04-18T14:44:33.174 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000222208 2024-04-18T14:44:33.174 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:33.174 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:33.174 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for subops from 0", 2024-04-18T14:44:33.174 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:21.232551+0000", 2024-04-18T14:44:33.174 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00034289999999999999 2024-04-18T14:44:33.174 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:33.175 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:33.175 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-04-18T14:44:33.175 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:21.233981+0000", 2024-04-18T14:44:33.175 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0014303390000000001 2024-04-18T14:44:33.175 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:33.175 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:33.175 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_commit_rec", 2024-04-18T14:44:33.175 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:21.235295+0000", 2024-04-18T14:44:33.175 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0013134189999999999 2024-04-18T14:44:33.175 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:33.175 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:33.175 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-04-18T14:44:33.175 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:21.235354+0000", 2024-04-18T14:44:33.175 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 5.8928000000000002e-05 2024-04-18T14:44:33.175 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:33.176 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:33.176 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-04-18T14:44:33.176 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:43:21.235400+0000", 2024-04-18T14:44:33.176 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 4.6273999999999998e-05 2024-04-18T14:44:33.176 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:44:33.176 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T14:44:33.176 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:44:33.176 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:33.176 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:33.176 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4559.0:560 3.3s0 3:c95aa19c:::smithi13430248-26:head [copy-from ver 48] snapc 1d=[1d,1c,1a,19,16,14,13,11,b,a,7,2] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2024-04-18T14:44:33.176 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-04-18T14:44:00.380761+0000", 2024-04-18T14:44:33.176 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 32.719280187000003, 2024-04-18T14:44:33.176 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.023909372000000002, 2024-04-18T14:44:33.176 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-04-18T14:44:33.176 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T14:44:33.177 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-04-18T14:44:33.177 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4559", 2024-04-18T14:44:33.177 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "172.21.15.134:0/3113589487", 2024-04-18T14:44:33.177 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 560 2024-04-18T14:44:33.177 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:33.177 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-04-18T14:44:33.177 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:33.177 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-04-18T14:44:33.177 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:00.380761+0000", 2024-04-18T14:44:33.177 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:44:33.177 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:33.177 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:33.177 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-04-18T14:44:33.177 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:00.380761+0000", 2024-04-18T14:44:33.177 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:44:33.177 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:33.178 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:33.178 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-04-18T14:44:33.178 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:00.380756+0000", 2024-04-18T14:44:33.178 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 4294967295.9999957 2024-04-18T14:44:33.178 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:33.178 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:33.178 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-04-18T14:44:33.178 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:00.380778+0000", 2024-04-18T14:44:33.178 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.1319999999999999e-05 2024-04-18T14:44:33.178 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:33.178 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:33.178 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-04-18T14:44:33.178 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:00.380813+0000", 2024-04-18T14:44:33.178 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.5648999999999997e-05 2024-04-18T14:44:33.178 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:33.179 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:33.179 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-04-18T14:44:33.179 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:00.380841+0000", 2024-04-18T14:44:33.179 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.7189999999999999e-05 2024-04-18T14:44:33.179 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:33.179 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:33.179 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-04-18T14:44:33.179 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:00.380990+0000", 2024-04-18T14:44:33.179 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00014950799999999999 2024-04-18T14:44:33.179 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:33.179 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:33.179 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op must wait for map", 2024-04-18T14:44:33.179 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:00.381015+0000", 2024-04-18T14:44:33.179 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.4760999999999999e-05 2024-04-18T14:44:33.179 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:33.180 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:33.180 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-04-18T14:44:33.180 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:00.384807+0000", 2024-04-18T14:44:33.180 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0037916069999999998 2024-04-18T14:44:33.180 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:33.180 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:33.180 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-04-18T14:44:33.180 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:00.385079+0000", 2024-04-18T14:44:33.180 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000272296 2024-04-18T14:44:33.180 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:33.180 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:33.180 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_started", 2024-04-18T14:44:33.180 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:00.398546+0000", 2024-04-18T14:44:33.180 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.013467451 2024-04-18T14:44:33.180 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:33.181 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:33.181 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_committed", 2024-04-18T14:44:33.181 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:00.401693+0000", 2024-04-18T14:44:33.181 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0031470199999999999 2024-04-18T14:44:33.181 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:33.181 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:33.181 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-04-18T14:44:33.181 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:00.404555+0000", 2024-04-18T14:44:33.181 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0028617030000000002 2024-04-18T14:44:33.181 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:33.181 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:33.181 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-04-18T14:44:33.181 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:00.404670+0000", 2024-04-18T14:44:33.181 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000115312 2024-04-18T14:44:33.181 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:44:33.181 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T14:44:33.182 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:44:33.182 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:33.182 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:33.182 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4559.0:709 3.2s0 3:42079eea:::smithi13430248-44:head [read 0~4620288,checksum,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e72)", 2024-04-18T14:44:33.182 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-04-18T14:44:11.388746+0000", 2024-04-18T14:44:33.182 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 21.711295109000002, 2024-04-18T14:44:33.182 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.023104972000000001, 2024-04-18T14:44:33.182 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-04-18T14:44:33.182 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "started", 2024-04-18T14:44:33.182 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-04-18T14:44:33.182 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4559", 2024-04-18T14:44:33.182 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "172.21.15.134:0/3113589487", 2024-04-18T14:44:33.182 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 709 2024-04-18T14:44:33.182 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:33.182 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-04-18T14:44:33.183 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:33.183 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-04-18T14:44:33.183 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:11.388746+0000", 2024-04-18T14:44:33.183 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:44:33.183 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:33.183 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:33.183 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-04-18T14:44:33.183 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:11.388746+0000", 2024-04-18T14:44:33.183 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:44:33.183 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:33.183 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:33.183 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-04-18T14:44:33.183 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:11.388742+0000", 2024-04-18T14:44:33.183 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 4294967295.9999962 2024-04-18T14:44:33.183 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:33.183 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:33.184 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-04-18T14:44:33.184 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:11.388762+0000", 2024-04-18T14:44:33.184 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.035e-05 2024-04-18T14:44:33.184 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:33.184 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:33.184 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-04-18T14:44:33.184 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:11.388810+0000", 2024-04-18T14:44:33.184 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 4.7615999999999999e-05 2024-04-18T14:44:33.184 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:33.184 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:33.184 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-04-18T14:44:33.184 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:11.388835+0000", 2024-04-18T14:44:33.184 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.5038999999999999e-05 2024-04-18T14:44:33.184 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:33.184 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:33.185 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-04-18T14:44:33.185 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:11.388952+0000", 2024-04-18T14:44:33.185 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000117351 2024-04-18T14:44:33.185 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:33.185 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:33.185 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op must wait for map", 2024-04-18T14:44:33.185 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:11.388966+0000", 2024-04-18T14:44:33.185 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.3334e-05 2024-04-18T14:44:33.185 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:33.185 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:33.185 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-04-18T14:44:33.185 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:11.393030+0000", 2024-04-18T14:44:33.185 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.004064855 2024-04-18T14:44:33.185 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:33.185 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:33.186 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-04-18T14:44:33.186 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:11.393277+0000", 2024-04-18T14:44:33.186 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00024683499999999999 2024-04-18T14:44:33.186 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:33.186 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:33.186 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-04-18T14:44:33.186 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:11.411851+0000", 2024-04-18T14:44:33.186 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.018573638999999999 2024-04-18T14:44:33.186 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:44:33.186 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T14:44:33.186 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:44:33.186 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:33.186 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:33.186 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4559.0:710 3.2s0 3:42079eea:::smithi13430248-44:head [read 0~4620288,checksum] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e72)", 2024-04-18T14:44:33.186 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-04-18T14:44:11.388868+0000", 2024-04-18T14:44:33.187 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 21.711173263999999, 2024-04-18T14:44:33.187 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.027186416000000001, 2024-04-18T14:44:33.187 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-04-18T14:44:33.187 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "started", 2024-04-18T14:44:33.187 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-04-18T14:44:33.187 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4559", 2024-04-18T14:44:33.187 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "172.21.15.134:0/3113589487", 2024-04-18T14:44:33.187 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 710 2024-04-18T14:44:33.187 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:33.187 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-04-18T14:44:33.187 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:33.187 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-04-18T14:44:33.187 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:11.388868+0000", 2024-04-18T14:44:33.187 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:44:33.187 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:33.187 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:33.188 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-04-18T14:44:33.188 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:11.388868+0000", 2024-04-18T14:44:33.188 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:44:33.188 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:33.188 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:33.188 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-04-18T14:44:33.188 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:11.388866+0000", 2024-04-18T14:44:33.188 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 4294967295.9999986 2024-04-18T14:44:33.188 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:33.188 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:33.188 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-04-18T14:44:33.188 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:11.388876+0000", 2024-04-18T14:44:33.188 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 9.9690000000000006e-06 2024-04-18T14:44:33.188 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:33.188 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:33.189 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-04-18T14:44:33.189 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:11.388891+0000", 2024-04-18T14:44:33.189 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.4663e-05 2024-04-18T14:44:33.189 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:33.189 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:33.189 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-04-18T14:44:33.189 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:11.388907+0000", 2024-04-18T14:44:33.189 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.575e-05 2024-04-18T14:44:33.189 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:33.189 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:33.189 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-04-18T14:44:33.189 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:11.389121+0000", 2024-04-18T14:44:33.189 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00021439899999999999 2024-04-18T14:44:33.189 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:33.189 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:33.190 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting_for_map not empty", 2024-04-18T14:44:33.190 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:11.389141+0000", 2024-04-18T14:44:33.190 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.0273000000000001e-05 2024-04-18T14:44:33.190 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:33.190 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:33.190 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-04-18T14:44:33.190 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:11.394165+0000", 2024-04-18T14:44:33.190 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0050239619999999999 2024-04-18T14:44:33.190 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:33.190 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:33.190 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-04-18T14:44:33.190 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:11.394408+0000", 2024-04-18T14:44:33.190 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00024312199999999999 2024-04-18T14:44:33.190 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:33.191 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:33.191 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-04-18T14:44:33.191 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:11.416054+0000", 2024-04-18T14:44:33.191 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.021645818000000001 2024-04-18T14:44:33.191 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:44:33.191 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T14:44:33.191 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:44:33.191 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:33.191 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:33.191 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4559.0:711 3.2s0 3:42079eea:::smithi13430248-44:head [read 0~4620288,checksum] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e72)", 2024-04-18T14:44:33.191 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-04-18T14:44:11.388928+0000", 2024-04-18T14:44:33.191 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 21.711113182999998, 2024-04-18T14:44:33.191 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.030877597999999999, 2024-04-18T14:44:33.191 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-04-18T14:44:33.191 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "started", 2024-04-18T14:44:33.191 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-04-18T14:44:33.192 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4559", 2024-04-18T14:44:33.192 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "172.21.15.134:0/3113589487", 2024-04-18T14:44:33.192 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 711 2024-04-18T14:44:33.192 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:33.192 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-04-18T14:44:33.192 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:33.192 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-04-18T14:44:33.192 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:11.388928+0000", 2024-04-18T14:44:33.192 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:44:33.192 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:33.192 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:33.192 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-04-18T14:44:33.192 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:11.388928+0000", 2024-04-18T14:44:33.192 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:44:33.192 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:33.193 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:33.193 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-04-18T14:44:33.193 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:11.388927+0000", 2024-04-18T14:44:33.193 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 4294967295.9999986 2024-04-18T14:44:33.193 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:33.193 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:33.193 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-04-18T14:44:33.193 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:11.388935+0000", 2024-04-18T14:44:33.193 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 8.2330000000000006e-06 2024-04-18T14:44:33.193 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:33.193 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:33.193 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-04-18T14:44:33.193 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:11.388955+0000", 2024-04-18T14:44:33.193 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.9910000000000001e-05 2024-04-18T14:44:33.193 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:33.194 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:33.194 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-04-18T14:44:33.194 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:11.388970+0000", 2024-04-18T14:44:33.194 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.4986e-05 2024-04-18T14:44:33.194 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:33.194 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:33.194 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-04-18T14:44:33.194 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:11.389243+0000", 2024-04-18T14:44:33.194 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000272964 2024-04-18T14:44:33.194 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:33.194 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:33.194 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting_for_map not empty", 2024-04-18T14:44:33.194 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:11.389262+0000", 2024-04-18T14:44:33.194 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.9337000000000001e-05 2024-04-18T14:44:33.194 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:33.195 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:33.195 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-04-18T14:44:33.195 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:11.395125+0000", 2024-04-18T14:44:33.195 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0058632650000000003 2024-04-18T14:44:33.195 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:33.195 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:33.195 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-04-18T14:44:33.195 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:11.395390+0000", 2024-04-18T14:44:33.195 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00026478100000000001 2024-04-18T14:44:33.195 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:33.195 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:33.195 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-04-18T14:44:33.195 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:11.419806+0000", 2024-04-18T14:44:33.195 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.024415527999999999 2024-04-18T14:44:33.195 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:44:33.196 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T14:44:33.196 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:44:33.196 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:33.196 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:33.196 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4559.0:848 3.2s0 3:42079eea:::smithi13430248-44:head [read 0~6815744,checksum] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e77)", 2024-04-18T14:44:33.196 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-04-18T14:44:16.434969+0000", 2024-04-18T14:44:33.196 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 16.665071644000001, 2024-04-18T14:44:33.196 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.024318681000000002, 2024-04-18T14:44:33.196 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-04-18T14:44:33.196 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "started", 2024-04-18T14:44:33.196 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-04-18T14:44:33.196 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4559", 2024-04-18T14:44:33.196 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "172.21.15.134:0/3113589487", 2024-04-18T14:44:33.196 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 848 2024-04-18T14:44:33.196 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:33.197 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-04-18T14:44:33.197 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:33.197 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-04-18T14:44:33.197 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:16.434969+0000", 2024-04-18T14:44:33.197 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:44:33.197 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:33.197 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:33.197 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-04-18T14:44:33.197 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:16.434969+0000", 2024-04-18T14:44:33.197 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:44:33.197 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:33.197 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:33.197 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-04-18T14:44:33.197 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:16.434968+0000", 2024-04-18T14:44:33.197 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 4294967295.9999981 2024-04-18T14:44:33.197 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:33.198 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:33.198 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-04-18T14:44:33.198 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:16.434980+0000", 2024-04-18T14:44:33.198 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.1736000000000001e-05 2024-04-18T14:44:33.198 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:33.198 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:33.198 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-04-18T14:44:33.198 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:16.435001+0000", 2024-04-18T14:44:33.198 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.107e-05 2024-04-18T14:44:33.198 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:33.198 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:33.198 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-04-18T14:44:33.198 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:16.435012+0000", 2024-04-18T14:44:33.198 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.1603000000000001e-05 2024-04-18T14:44:33.198 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:33.198 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:33.199 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-04-18T14:44:33.199 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:16.435514+0000", 2024-04-18T14:44:33.199 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00050183400000000005 2024-04-18T14:44:33.199 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:33.199 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:33.199 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-04-18T14:44:33.199 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:16.435650+0000", 2024-04-18T14:44:33.199 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00013549699999999999 2024-04-18T14:44:33.199 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:33.199 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:33.199 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-04-18T14:44:33.199 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:16.459288+0000", 2024-04-18T14:44:33.199 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.023638624 2024-04-18T14:44:33.199 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:44:33.199 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T14:44:33.199 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:44:33.200 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:33.200 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:33.200 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4559.0:849 3.2s0 3:42079eea:::smithi13430248-44:head [read 0~6815744,checksum] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e77)", 2024-04-18T14:44:33.200 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-04-18T14:44:16.435027+0000", 2024-04-18T14:44:33.200 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 16.665014532000001, 2024-04-18T14:44:33.200 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.029968542000000001, 2024-04-18T14:44:33.200 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-04-18T14:44:33.200 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "started", 2024-04-18T14:44:33.200 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-04-18T14:44:33.200 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4559", 2024-04-18T14:44:33.200 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "172.21.15.134:0/3113589487", 2024-04-18T14:44:33.200 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 849 2024-04-18T14:44:33.200 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:33.200 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-04-18T14:44:33.200 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:33.201 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-04-18T14:44:33.201 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:16.435027+0000", 2024-04-18T14:44:33.201 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:44:33.201 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:33.201 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:33.201 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-04-18T14:44:33.201 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:16.435027+0000", 2024-04-18T14:44:33.201 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-04-18T14:44:33.201 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:33.201 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:33.201 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-04-18T14:44:33.201 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:16.435025+0000", 2024-04-18T14:44:33.201 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 4294967295.9999986 2024-04-18T14:44:33.201 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:33.201 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:33.201 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-04-18T14:44:33.202 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:16.435039+0000", 2024-04-18T14:44:33.202 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.3910000000000001e-05 2024-04-18T14:44:33.202 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:33.202 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:33.202 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-04-18T14:44:33.202 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:16.435060+0000", 2024-04-18T14:44:33.202 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.1143000000000001e-05 2024-04-18T14:44:33.202 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:33.202 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:33.202 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-04-18T14:44:33.202 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:16.435068+0000", 2024-04-18T14:44:33.202 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 8.0029999999999994e-06 2024-04-18T14:44:33.202 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:33.202 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:33.202 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-04-18T14:44:33.202 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:16.435919+0000", 2024-04-18T14:44:33.203 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00085065 2024-04-18T14:44:33.203 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:33.203 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:33.203 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-04-18T14:44:33.203 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:16.435992+0000", 2024-04-18T14:44:33.203 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 7.3201000000000006e-05 2024-04-18T14:44:33.203 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T14:44:33.203 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T14:44:33.203 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-04-18T14:44:33.203 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-04-18T14:44:16.464995+0000", 2024-04-18T14:44:33.203 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.029002910999999999 2024-04-18T14:44:33.203 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:44:33.203 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T14:44:33.203 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:44:33.203 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T14:44:33.203 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T14:44:33.204 INFO:teuthology.orchestra.run.smithi096.stdout:} 2024-04-18T14:44:33.205 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-18T14:44:33.337 INFO:teuthology.orchestra.run.smithi119.stdout:{ 2024-04-18T14:44:33.337 INFO:teuthology.orchestra.run.smithi119.stdout: "ops": [], 2024-04-18T14:44:33.337 INFO:teuthology.orchestra.run.smithi119.stdout: "num_ops": 0 2024-04-18T14:44:33.337 INFO:teuthology.orchestra.run.smithi119.stdout:} 2024-04-18T14:44:33.350 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-18T14:44:33.473 INFO:teuthology.orchestra.run.smithi119.stdout:{ 2024-04-18T14:44:33.473 INFO:teuthology.orchestra.run.smithi119.stdout: "ops": [], 2024-04-18T14:44:33.473 INFO:teuthology.orchestra.run.smithi119.stdout: "complaint_time": 30, 2024-04-18T14:44:33.473 INFO:teuthology.orchestra.run.smithi119.stdout: "num_blocked_ops": 0 2024-04-18T14:44:33.473 INFO:teuthology.orchestra.run.smithi119.stdout:} 2024-04-18T14:44:33.487 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-18T14:44:33.542 INFO:teuthology.orchestra.run.smithi086.stderr:noscrub is unset 2024-04-18T14:44:33.566 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-04-18T14:44:33.607 INFO:teuthology.orchestra.run.smithi119.stdout:{ 2024-04-18T14:44:33.607 INFO:teuthology.orchestra.run.smithi119.stdout: "size": 20, 2024-04-18T14:44:33.608 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 600, 2024-04-18T14:44:33.608 INFO:teuthology.orchestra.run.smithi119.stdout: "ops": [ 2024-04-18T14:44:33.608 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:33.608 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "MOSDECSubOpWrite(3.cs5 41/30 ECSubWrite(tid=45, reqid=osd.11.0:45, at_version=41'22, trim_to=0'0, roll_forward_to=39'20))", 2024-04-18T14:44:33.608 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-04-18T14:43:40.764595+0000", 2024-04-18T14:44:33.608 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 52.845845103000002, 2024-04-18T14:44:33.609 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.010712411999999999, 2024-04-18T14:44:33.609 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-04-18T14:44:33.609 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "reached pg", 2024-04-18T14:44:33.609 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-04-18T14:44:33.609 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:33.609 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-04-18T14:44:33.609 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:40.764595+0000", 2024-04-18T14:44:33.610 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:44:33.610 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:33.610 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:33.610 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-04-18T14:44:33.610 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:40.764595+0000", 2024-04-18T14:44:33.610 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:44:33.611 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:33.611 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:33.611 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-04-18T14:44:33.611 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:40.764594+0000", 2024-04-18T14:44:33.611 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4294967295.999999 2024-04-18T14:44:33.611 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:33.611 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:33.611 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-04-18T14:44:33.611 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:40.764660+0000", 2024-04-18T14:44:33.612 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 6.5122000000000004e-05 2024-04-18T14:44:33.612 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:33.612 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:33.612 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-04-18T14:44:33.612 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:40.764693+0000", 2024-04-18T14:44:33.612 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.3213999999999997e-05 2024-04-18T14:44:33.612 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:33.612 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:33.612 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-04-18T14:44:33.612 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:40.764715+0000", 2024-04-18T14:44:33.612 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.2580000000000001e-05 2024-04-18T14:44:33.612 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:33.612 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:33.612 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-04-18T14:44:33.613 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:40.764838+0000", 2024-04-18T14:44:33.613 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00012281299999999999 2024-04-18T14:44:33.613 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:33.613 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:33.613 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_started", 2024-04-18T14:44:33.613 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:40.764853+0000", 2024-04-18T14:44:33.613 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.5237e-05 2024-04-18T14:44:33.613 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:33.613 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:33.613 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_committed", 2024-04-18T14:44:33.613 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:40.775242+0000", 2024-04-18T14:44:33.613 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.010388807999999999 2024-04-18T14:44:33.613 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:33.613 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:33.613 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-04-18T14:44:33.613 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:40.775308+0000", 2024-04-18T14:44:33.614 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 6.5494999999999995e-05 2024-04-18T14:44:33.614 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:44:33.614 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-04-18T14:44:33.614 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:44:33.614 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:33.614 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:33.614 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "MOSDECSubOpWrite(3.cs5 41/30 ECSubWrite(tid=46, reqid=osd.11.0:46, at_version=41'24, trim_to=0'0, roll_forward_to=39'20))", 2024-04-18T14:44:33.614 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-04-18T14:43:40.765803+0000", 2024-04-18T14:44:33.614 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 52.844637353000003, 2024-04-18T14:44:33.614 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.010134018999999999, 2024-04-18T14:44:33.614 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-04-18T14:44:33.614 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "reached pg", 2024-04-18T14:44:33.614 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-04-18T14:44:33.614 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:33.615 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-04-18T14:44:33.615 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:40.765803+0000", 2024-04-18T14:44:33.615 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:44:33.615 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:33.615 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:33.615 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-04-18T14:44:33.615 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:40.765803+0000", 2024-04-18T14:44:33.615 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:44:33.615 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:33.615 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:33.615 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-04-18T14:44:33.615 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:40.765801+0000", 2024-04-18T14:44:33.615 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4294967295.9999981 2024-04-18T14:44:33.615 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:33.615 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:33.615 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-04-18T14:44:33.616 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:40.765857+0000", 2024-04-18T14:44:33.616 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 5.6385000000000003e-05 2024-04-18T14:44:33.616 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:33.616 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:33.616 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-04-18T14:44:33.616 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:40.765888+0000", 2024-04-18T14:44:33.616 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.0886999999999998e-05 2024-04-18T14:44:33.616 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:33.616 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:33.616 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-04-18T14:44:33.616 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:40.765910+0000", 2024-04-18T14:44:33.616 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.2084000000000001e-05 2024-04-18T14:44:33.616 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:33.616 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:33.616 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-04-18T14:44:33.617 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:40.767603+0000", 2024-04-18T14:44:33.617 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0016922409999999999 2024-04-18T14:44:33.617 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:33.617 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:33.617 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_started", 2024-04-18T14:44:33.617 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:40.767627+0000", 2024-04-18T14:44:33.617 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.4204000000000001e-05 2024-04-18T14:44:33.617 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:33.617 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:33.617 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_committed", 2024-04-18T14:44:33.617 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:40.775885+0000", 2024-04-18T14:44:33.617 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0082576769999999997 2024-04-18T14:44:33.617 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:33.617 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:33.617 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-04-18T14:44:33.618 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:40.775937+0000", 2024-04-18T14:44:33.618 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 5.2537999999999997e-05 2024-04-18T14:44:33.618 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:44:33.618 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-04-18T14:44:33.618 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:44:33.618 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:33.618 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:33.618 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "MOSDECSubOpWrite(3.cs5 72/30 ECSubWrite(tid=191, reqid=client.4559.0:742, at_version=72'124, trim_to=0'0, roll_forward_to=71'122))", 2024-04-18T14:44:33.618 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-04-18T14:44:11.762815+0000", 2024-04-18T14:44:33.618 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 21.847625813000001, 2024-04-18T14:44:33.618 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.016261212000000001, 2024-04-18T14:44:33.618 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-04-18T14:44:33.618 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "reached pg", 2024-04-18T14:44:33.618 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-04-18T14:44:33.618 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:33.619 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-04-18T14:44:33.619 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:11.762815+0000", 2024-04-18T14:44:33.619 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:44:33.619 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:33.619 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:33.619 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-04-18T14:44:33.620 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:11.762815+0000", 2024-04-18T14:44:33.620 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:44:33.620 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:33.620 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:33.620 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-04-18T14:44:33.620 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:11.762814+0000", 2024-04-18T14:44:33.620 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4294967295.9999995 2024-04-18T14:44:33.621 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:33.621 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:33.621 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-04-18T14:44:33.621 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:11.763613+0000", 2024-04-18T14:44:33.621 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00079931700000000002 2024-04-18T14:44:33.621 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:33.621 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:33.621 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-04-18T14:44:33.622 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:11.763662+0000", 2024-04-18T14:44:33.622 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4.9060000000000001e-05 2024-04-18T14:44:33.622 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:33.622 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:33.622 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-04-18T14:44:33.622 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:11.763694+0000", 2024-04-18T14:44:33.622 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.2209000000000003e-05 2024-04-18T14:44:33.624 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:33.624 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:33.624 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-04-18T14:44:33.624 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:11.763938+0000", 2024-04-18T14:44:33.624 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000243422 2024-04-18T14:44:33.624 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:33.624 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:33.624 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_started", 2024-04-18T14:44:33.624 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:11.763968+0000", 2024-04-18T14:44:33.624 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.0063e-05 2024-04-18T14:44:33.625 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:33.625 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:33.625 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_committed", 2024-04-18T14:44:33.625 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:11.779009+0000", 2024-04-18T14:44:33.625 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.015041381 2024-04-18T14:44:33.625 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:33.626 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:33.626 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-04-18T14:44:33.626 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:11.779076+0000", 2024-04-18T14:44:33.626 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 6.6463000000000004e-05 2024-04-18T14:44:33.626 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:44:33.626 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-04-18T14:44:33.626 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:44:33.626 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:33.626 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:33.626 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "MOSDECSubOpWrite(3.cs5 72/30 ECSubWrite(tid=192, reqid=client.4559.0:743, at_version=72'125, trim_to=0'0, roll_forward_to=71'122))", 2024-04-18T14:44:33.626 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-04-18T14:44:11.769193+0000", 2024-04-18T14:44:33.626 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 21.841247309, 2024-04-18T14:44:33.626 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0099247339999999993, 2024-04-18T14:44:33.626 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-04-18T14:44:33.627 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "reached pg", 2024-04-18T14:44:33.627 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-04-18T14:44:33.627 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:33.627 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-04-18T14:44:33.627 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:11.769193+0000", 2024-04-18T14:44:33.627 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:44:33.627 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:33.627 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:33.627 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-04-18T14:44:33.627 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:11.769193+0000", 2024-04-18T14:44:33.627 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:44:33.628 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:33.628 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:33.628 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-04-18T14:44:33.628 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:11.769191+0000", 2024-04-18T14:44:33.628 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4294967295.9999976 2024-04-18T14:44:33.628 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:33.628 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:33.628 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-04-18T14:44:33.628 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:11.769502+0000", 2024-04-18T14:44:33.628 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00031144199999999999 2024-04-18T14:44:33.628 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:33.628 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:33.628 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-04-18T14:44:33.628 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:11.769538+0000", 2024-04-18T14:44:33.628 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.5803000000000003e-05 2024-04-18T14:44:33.629 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:33.629 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:33.629 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-04-18T14:44:33.629 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:11.769560+0000", 2024-04-18T14:44:33.629 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.1892999999999999e-05 2024-04-18T14:44:33.629 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:33.629 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:33.629 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-04-18T14:44:33.629 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:11.770699+0000", 2024-04-18T14:44:33.629 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0011391509999999999 2024-04-18T14:44:33.629 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:33.629 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:33.629 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_started", 2024-04-18T14:44:33.629 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:11.770724+0000", 2024-04-18T14:44:33.629 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.4613e-05 2024-04-18T14:44:33.629 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:33.630 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:33.630 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_committed", 2024-04-18T14:44:33.630 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:11.779090+0000", 2024-04-18T14:44:33.630 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0083662690000000008 2024-04-18T14:44:33.630 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:33.630 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:33.630 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-04-18T14:44:33.630 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:11.779118+0000", 2024-04-18T14:44:33.630 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.7912999999999999e-05 2024-04-18T14:44:33.630 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:44:33.630 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-04-18T14:44:33.630 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:44:33.630 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:33.631 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:33.631 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "MOSDECSubOpWrite(3.cs5 72/30 ECSubWrite(tid=194, reqid=client.4559.0:745, at_version=72'127, trim_to=0'0, roll_forward_to=71'122))", 2024-04-18T14:44:33.631 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-04-18T14:44:11.772156+0000", 2024-04-18T14:44:33.631 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 21.838284842, 2024-04-18T14:44:33.631 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.011867262999999999, 2024-04-18T14:44:33.631 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-04-18T14:44:33.631 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "reached pg", 2024-04-18T14:44:33.631 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-04-18T14:44:33.631 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:33.631 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-04-18T14:44:33.631 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:11.772156+0000", 2024-04-18T14:44:33.631 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:44:33.631 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:33.631 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:33.631 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-04-18T14:44:33.631 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:11.772156+0000", 2024-04-18T14:44:33.632 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:44:33.632 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:33.632 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:33.632 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-04-18T14:44:33.632 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:11.772153+0000", 2024-04-18T14:44:33.632 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4294967295.9999976 2024-04-18T14:44:33.632 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:33.632 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:33.632 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-04-18T14:44:33.632 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:11.772782+0000", 2024-04-18T14:44:33.632 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00062876200000000005 2024-04-18T14:44:33.632 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:33.632 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:33.632 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-04-18T14:44:33.632 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:11.772816+0000", 2024-04-18T14:44:33.633 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.3800000000000002e-05 2024-04-18T14:44:33.633 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:33.633 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:33.633 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-04-18T14:44:33.633 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:11.772839+0000", 2024-04-18T14:44:33.633 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.3289999999999999e-05 2024-04-18T14:44:33.633 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:33.633 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:33.634 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-04-18T14:44:33.634 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:11.774492+0000", 2024-04-18T14:44:33.634 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.001652494 2024-04-18T14:44:33.634 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:33.634 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:33.634 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_started", 2024-04-18T14:44:33.635 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:11.774520+0000", 2024-04-18T14:44:33.635 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.8526000000000001e-05 2024-04-18T14:44:33.635 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:33.635 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:33.635 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_committed", 2024-04-18T14:44:33.635 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:11.783954+0000", 2024-04-18T14:44:33.636 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0094335749999999996 2024-04-18T14:44:33.636 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:33.636 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:33.636 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-04-18T14:44:33.636 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:11.784023+0000", 2024-04-18T14:44:33.636 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 6.9189000000000005e-05 2024-04-18T14:44:33.636 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:44:33.636 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-04-18T14:44:33.636 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:44:33.636 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:33.637 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:33.637 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "MOSDECSubOpWrite(3.cs5 72/30 ECSubWrite(tid=199, reqid=client.4559.0:760, at_version=72'133, trim_to=0'0, roll_forward_to=72'125))", 2024-04-18T14:44:33.637 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-04-18T14:44:11.787891+0000", 2024-04-18T14:44:33.637 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 21.822549391999999, 2024-04-18T14:44:33.637 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.010536894999999999, 2024-04-18T14:44:33.637 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-04-18T14:44:33.637 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "reached pg", 2024-04-18T14:44:33.637 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-04-18T14:44:33.637 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:33.637 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-04-18T14:44:33.637 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:11.787891+0000", 2024-04-18T14:44:33.637 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:44:33.637 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:33.638 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:33.638 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-04-18T14:44:33.638 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:11.787891+0000", 2024-04-18T14:44:33.638 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:44:33.638 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:33.638 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:33.638 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-04-18T14:44:33.638 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:11.787889+0000", 2024-04-18T14:44:33.638 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4294967295.9999976 2024-04-18T14:44:33.638 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:33.638 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:33.638 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-04-18T14:44:33.638 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:11.788406+0000", 2024-04-18T14:44:33.639 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00051784300000000004 2024-04-18T14:44:33.639 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:33.639 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:33.639 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-04-18T14:44:33.639 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:11.788451+0000", 2024-04-18T14:44:33.639 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4.4956999999999997e-05 2024-04-18T14:44:33.639 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:33.639 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:33.639 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-04-18T14:44:33.639 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:11.788477+0000", 2024-04-18T14:44:33.639 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.5383000000000001e-05 2024-04-18T14:44:33.639 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:33.639 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:33.639 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-04-18T14:44:33.639 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:11.788684+0000", 2024-04-18T14:44:33.639 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000207641 2024-04-18T14:44:33.640 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:33.640 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:33.640 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_started", 2024-04-18T14:44:33.640 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:11.788711+0000", 2024-04-18T14:44:33.640 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.6950000000000001e-05 2024-04-18T14:44:33.640 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:33.640 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:33.640 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_committed", 2024-04-18T14:44:33.640 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:11.798378+0000", 2024-04-18T14:44:33.640 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0096662390000000001 2024-04-18T14:44:33.640 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:33.640 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:33.640 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-04-18T14:44:33.640 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:11.798428+0000", 2024-04-18T14:44:33.640 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 5.0352000000000002e-05 2024-04-18T14:44:33.641 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:44:33.641 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-04-18T14:44:33.641 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:44:33.641 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:33.641 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:33.641 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "MOSDECSubOpWrite(3.cs5 72/30 ECSubWrite(tid=200, reqid=client.4559.0:761, at_version=72'134, trim_to=0'0, roll_forward_to=72'126))", 2024-04-18T14:44:33.641 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-04-18T14:44:11.790722+0000", 2024-04-18T14:44:33.641 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 21.819718167000001, 2024-04-18T14:44:33.641 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.01161918, 2024-04-18T14:44:33.641 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-04-18T14:44:33.641 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "reached pg", 2024-04-18T14:44:33.641 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-04-18T14:44:33.641 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:33.641 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-04-18T14:44:33.641 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:11.790722+0000", 2024-04-18T14:44:33.641 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:44:33.642 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:33.642 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:33.642 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-04-18T14:44:33.642 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:11.790722+0000", 2024-04-18T14:44:33.642 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:44:33.642 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:33.642 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:33.642 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-04-18T14:44:33.642 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:11.790720+0000", 2024-04-18T14:44:33.642 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4294967295.9999981 2024-04-18T14:44:33.642 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:33.642 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:33.642 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-04-18T14:44:33.642 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:11.791016+0000", 2024-04-18T14:44:33.643 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00029604799999999998 2024-04-18T14:44:33.643 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:33.643 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:33.643 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-04-18T14:44:33.643 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:11.791087+0000", 2024-04-18T14:44:33.643 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 7.1008999999999997e-05 2024-04-18T14:44:33.643 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:33.643 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:33.643 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-04-18T14:44:33.643 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:11.791117+0000", 2024-04-18T14:44:33.643 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.9485999999999999e-05 2024-04-18T14:44:33.643 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:33.643 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:33.643 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-04-18T14:44:33.643 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:11.795559+0000", 2024-04-18T14:44:33.644 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0044420500000000003 2024-04-18T14:44:33.644 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:33.644 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:33.644 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_started", 2024-04-18T14:44:33.644 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:11.795586+0000", 2024-04-18T14:44:33.644 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.6913000000000001e-05 2024-04-18T14:44:33.644 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:33.644 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:33.644 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_committed", 2024-04-18T14:44:33.644 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:11.802293+0000", 2024-04-18T14:44:33.644 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0067068190000000001 2024-04-18T14:44:33.644 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:33.644 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:33.644 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-04-18T14:44:33.644 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:11.802341+0000", 2024-04-18T14:44:33.645 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4.8897999999999998e-05 2024-04-18T14:44:33.645 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:44:33.645 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-04-18T14:44:33.645 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:44:33.645 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:33.645 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:33.645 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "MOSDECSubOpWrite(3.cs5 72/30 ECSubWrite(tid=201, reqid=client.4559.0:762, at_version=72'135, trim_to=0'0, roll_forward_to=72'126))", 2024-04-18T14:44:33.645 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-04-18T14:44:11.792333+0000", 2024-04-18T14:44:33.645 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 21.818107005999998, 2024-04-18T14:44:33.645 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.010364986, 2024-04-18T14:44:33.645 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-04-18T14:44:33.645 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "reached pg", 2024-04-18T14:44:33.645 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-04-18T14:44:33.645 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:33.645 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-04-18T14:44:33.645 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:11.792333+0000", 2024-04-18T14:44:33.646 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:44:33.646 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:33.646 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:33.646 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-04-18T14:44:33.646 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:11.792333+0000", 2024-04-18T14:44:33.646 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:44:33.646 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:33.646 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:33.646 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-04-18T14:44:33.646 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:11.792331+0000", 2024-04-18T14:44:33.646 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4294967295.9999981 2024-04-18T14:44:33.646 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:33.647 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:33.647 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-04-18T14:44:33.647 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:11.792428+0000", 2024-04-18T14:44:33.647 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 9.6309000000000002e-05 2024-04-18T14:44:33.647 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:33.647 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:33.647 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-04-18T14:44:33.647 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:11.792473+0000", 2024-04-18T14:44:33.647 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4.5729999999999998e-05 2024-04-18T14:44:33.647 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:33.647 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:33.647 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-04-18T14:44:33.647 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:11.792498+0000", 2024-04-18T14:44:33.648 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.4850000000000001e-05 2024-04-18T14:44:33.648 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:33.648 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:33.648 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-04-18T14:44:33.648 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:11.797919+0000", 2024-04-18T14:44:33.648 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0054206009999999997 2024-04-18T14:44:33.648 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:33.648 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:33.648 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_started", 2024-04-18T14:44:33.648 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:11.797943+0000", 2024-04-18T14:44:33.648 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.4394000000000001e-05 2024-04-18T14:44:33.648 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:33.648 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:33.648 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_committed", 2024-04-18T14:44:33.648 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:11.802665+0000", 2024-04-18T14:44:33.649 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0047213200000000002 2024-04-18T14:44:33.649 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:33.649 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:33.649 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-04-18T14:44:33.649 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:11.802698+0000", 2024-04-18T14:44:33.649 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.3794999999999997e-05 2024-04-18T14:44:33.649 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:44:33.649 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-04-18T14:44:33.649 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:44:33.650 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:33.650 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:33.650 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "MOSDECSubOpWrite(3.ds5 78/30 ECSubWrite(tid=54, reqid=osd.7.0:54, at_version=78'49, trim_to=0'0, roll_forward_to=77'47))", 2024-04-18T14:44:33.650 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-04-18T14:44:17.431379+0000", 2024-04-18T14:44:33.650 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 16.179061295, 2024-04-18T14:44:33.651 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.011137813999999999, 2024-04-18T14:44:33.651 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-04-18T14:44:33.651 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "reached pg", 2024-04-18T14:44:33.651 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-04-18T14:44:33.651 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:33.651 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-04-18T14:44:33.652 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:17.431379+0000", 2024-04-18T14:44:33.652 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:44:33.652 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:33.652 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:33.652 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-04-18T14:44:33.652 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:17.431379+0000", 2024-04-18T14:44:33.652 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:44:33.653 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:33.653 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:33.653 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-04-18T14:44:33.653 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:17.431378+0000", 2024-04-18T14:44:33.653 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4294967295.9999995 2024-04-18T14:44:33.653 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:33.653 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:33.654 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-04-18T14:44:33.654 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:17.431437+0000", 2024-04-18T14:44:33.654 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 5.8817000000000003e-05 2024-04-18T14:44:33.654 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:33.654 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:33.654 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-04-18T14:44:33.655 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:17.431464+0000", 2024-04-18T14:44:33.655 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.6872999999999998e-05 2024-04-18T14:44:33.655 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:33.655 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:33.655 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-04-18T14:44:33.655 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:17.431487+0000", 2024-04-18T14:44:33.656 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.2753000000000001e-05 2024-04-18T14:44:33.656 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:33.656 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:33.656 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-04-18T14:44:33.656 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:17.431814+0000", 2024-04-18T14:44:33.656 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00032756799999999998 2024-04-18T14:44:33.657 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:33.657 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:33.657 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_started", 2024-04-18T14:44:33.657 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:17.431841+0000", 2024-04-18T14:44:33.657 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.6395999999999999e-05 2024-04-18T14:44:33.657 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:33.657 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:33.658 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_committed", 2024-04-18T14:44:33.658 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:17.442461+0000", 2024-04-18T14:44:33.658 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.010620095 2024-04-18T14:44:33.658 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:33.658 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:33.658 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-04-18T14:44:33.659 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:17.442517+0000", 2024-04-18T14:44:33.659 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 5.5976000000000001e-05 2024-04-18T14:44:33.659 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:44:33.659 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-04-18T14:44:33.659 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:44:33.659 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:33.659 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:33.660 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "MOSDECSubOpWrite(3.fs6 78/30 ECSubWrite(tid=212, reqid=osd.11.0:212, at_version=78'38, trim_to=0'0, roll_forward_to=68'36))", 2024-04-18T14:44:33.660 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-04-18T14:44:17.432648+0000", 2024-04-18T14:44:33.660 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 16.177792835000002, 2024-04-18T14:44:33.660 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.015095374, 2024-04-18T14:44:33.660 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-04-18T14:44:33.660 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "reached pg", 2024-04-18T14:44:33.660 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-04-18T14:44:33.661 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:33.661 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-04-18T14:44:33.661 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:17.432648+0000", 2024-04-18T14:44:33.661 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:44:33.662 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:33.662 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:33.662 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-04-18T14:44:33.662 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:17.432648+0000", 2024-04-18T14:44:33.662 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:44:33.662 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:33.662 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:33.662 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-04-18T14:44:33.662 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:17.432647+0000", 2024-04-18T14:44:33.662 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4294967295.9999995 2024-04-18T14:44:33.666 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:33.666 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:33.666 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-04-18T14:44:33.666 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:17.432720+0000", 2024-04-18T14:44:33.666 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 7.2873000000000005e-05 2024-04-18T14:44:33.666 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:33.667 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:33.667 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-04-18T14:44:33.667 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:17.432748+0000", 2024-04-18T14:44:33.667 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.7603e-05 2024-04-18T14:44:33.667 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:33.667 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:33.668 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-04-18T14:44:33.668 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:17.432769+0000", 2024-04-18T14:44:33.668 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.1257e-05 2024-04-18T14:44:33.668 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:33.668 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:33.668 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-04-18T14:44:33.669 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:17.433122+0000", 2024-04-18T14:44:33.669 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00035333400000000002 2024-04-18T14:44:33.669 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:33.669 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:33.669 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_started", 2024-04-18T14:44:33.669 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:17.433146+0000", 2024-04-18T14:44:33.669 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.4372999999999999e-05 2024-04-18T14:44:33.670 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:33.670 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:33.670 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_committed", 2024-04-18T14:44:33.670 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:17.447680+0000", 2024-04-18T14:44:33.670 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.014533221000000001 2024-04-18T14:44:33.670 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:33.671 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:33.671 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-04-18T14:44:33.671 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:17.447743+0000", 2024-04-18T14:44:33.671 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 6.3243000000000004e-05 2024-04-18T14:44:33.671 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:44:33.671 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-04-18T14:44:33.671 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:44:33.672 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:33.672 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:33.672 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "MOSDECSubOpWrite(3.3s2 78/30 ECSubWrite(tid=282, reqid=osd.13.0:282, at_version=78'49, trim_to=0'0, roll_forward_to=69'47))", 2024-04-18T14:44:33.672 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-04-18T14:44:17.433192+0000", 2024-04-18T14:44:33.672 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 16.177248623000001, 2024-04-18T14:44:33.672 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.016119607000000001, 2024-04-18T14:44:33.672 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-04-18T14:44:33.673 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "reached pg", 2024-04-18T14:44:33.673 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-04-18T14:44:33.673 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:33.673 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-04-18T14:44:33.673 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:17.433192+0000", 2024-04-18T14:44:33.673 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:44:33.673 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:33.673 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:33.674 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-04-18T14:44:33.674 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:17.433192+0000", 2024-04-18T14:44:33.674 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:44:33.674 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:33.674 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:33.674 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-04-18T14:44:33.674 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:17.433191+0000", 2024-04-18T14:44:33.675 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4294967295.9999995 2024-04-18T14:44:33.675 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:33.675 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:33.675 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-04-18T14:44:33.675 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:17.433246+0000", 2024-04-18T14:44:33.675 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 5.5040000000000002e-05 2024-04-18T14:44:33.675 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:33.675 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:33.675 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-04-18T14:44:33.675 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:17.433275+0000", 2024-04-18T14:44:33.675 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.9300000000000001e-05 2024-04-18T14:44:33.675 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:33.675 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:33.675 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-04-18T14:44:33.676 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:17.433299+0000", 2024-04-18T14:44:33.676 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.3159999999999998e-05 2024-04-18T14:44:33.676 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:33.676 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:33.676 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-04-18T14:44:33.676 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:17.433438+0000", 2024-04-18T14:44:33.676 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000139639 2024-04-18T14:44:33.676 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:33.676 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:33.676 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_started", 2024-04-18T14:44:33.676 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:17.433527+0000", 2024-04-18T14:44:33.676 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 8.8566000000000006e-05 2024-04-18T14:44:33.676 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:33.676 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:33.676 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_committed", 2024-04-18T14:44:33.677 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:17.449259+0000", 2024-04-18T14:44:33.677 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.015732286000000002 2024-04-18T14:44:33.677 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:33.677 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:33.677 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-04-18T14:44:33.677 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:17.449311+0000", 2024-04-18T14:44:33.677 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 5.2326e-05 2024-04-18T14:44:33.677 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:44:33.677 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-04-18T14:44:33.677 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:44:33.677 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:33.677 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:33.677 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "MOSDECSubOpWrite(3.ds5 78/30 ECSubWrite(tid=55, reqid=osd.7.0:55, at_version=78'51, trim_to=0'0, roll_forward_to=77'47))", 2024-04-18T14:44:33.677 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-04-18T14:44:17.433764+0000", 2024-04-18T14:44:33.677 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 16.17667625, 2024-04-18T14:44:33.678 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.015455708, 2024-04-18T14:44:33.678 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-04-18T14:44:33.678 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "reached pg", 2024-04-18T14:44:33.678 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-04-18T14:44:33.678 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:33.678 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-04-18T14:44:33.678 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:17.433764+0000", 2024-04-18T14:44:33.678 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:44:33.678 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:33.678 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:33.678 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-04-18T14:44:33.678 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:17.433764+0000", 2024-04-18T14:44:33.678 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:44:33.678 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:33.678 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:33.679 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-04-18T14:44:33.679 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:17.433762+0000", 2024-04-18T14:44:33.679 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4294967295.9999981 2024-04-18T14:44:33.679 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:33.679 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:33.679 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-04-18T14:44:33.679 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:17.433815+0000", 2024-04-18T14:44:33.679 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 5.2250000000000003e-05 2024-04-18T14:44:33.679 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:33.679 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:33.679 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-04-18T14:44:33.679 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:17.433845+0000", 2024-04-18T14:44:33.679 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.0658999999999999e-05 2024-04-18T14:44:33.679 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:33.679 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:33.679 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-04-18T14:44:33.679 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:17.433867+0000", 2024-04-18T14:44:33.680 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.1647000000000001e-05 2024-04-18T14:44:33.680 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:33.680 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:33.680 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-04-18T14:44:33.680 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:17.435260+0000", 2024-04-18T14:44:33.680 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0013929019999999999 2024-04-18T14:44:33.680 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:33.680 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:33.680 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_started", 2024-04-18T14:44:33.680 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:17.435283+0000", 2024-04-18T14:44:33.680 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.2759999999999999e-05 2024-04-18T14:44:33.680 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:33.680 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:33.680 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_committed", 2024-04-18T14:44:33.680 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:17.449149+0000", 2024-04-18T14:44:33.681 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.013866208 2024-04-18T14:44:33.681 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:33.681 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:33.681 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-04-18T14:44:33.681 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:17.449220+0000", 2024-04-18T14:44:33.681 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 7.1038999999999995e-05 2024-04-18T14:44:33.681 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:44:33.681 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-04-18T14:44:33.681 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:44:33.681 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:33.681 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:33.681 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "MOSDECSubOpWrite(3.cs5 78/30 ECSubWrite(tid=213, reqid=osd.11.0:213, at_version=78'137, trim_to=0'0, roll_forward_to=72'135))", 2024-04-18T14:44:33.681 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-04-18T14:44:17.437110+0000", 2024-04-18T14:44:33.681 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 16.173330746000001, 2024-04-18T14:44:33.681 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.012384162000000001, 2024-04-18T14:44:33.681 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-04-18T14:44:33.682 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "reached pg", 2024-04-18T14:44:33.682 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-04-18T14:44:33.682 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:33.682 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-04-18T14:44:33.682 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:17.437110+0000", 2024-04-18T14:44:33.682 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:44:33.682 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:33.682 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:33.682 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-04-18T14:44:33.682 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:17.437110+0000", 2024-04-18T14:44:33.682 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:44:33.682 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:33.682 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:33.682 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-04-18T14:44:33.682 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:17.437108+0000", 2024-04-18T14:44:33.683 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4294967295.9999981 2024-04-18T14:44:33.683 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:33.683 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:33.683 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-04-18T14:44:33.683 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:17.437165+0000", 2024-04-18T14:44:33.683 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 5.6901999999999998e-05 2024-04-18T14:44:33.683 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:33.683 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:33.683 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-04-18T14:44:33.683 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:17.437201+0000", 2024-04-18T14:44:33.683 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.6470000000000001e-05 2024-04-18T14:44:33.683 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:33.683 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:33.683 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-04-18T14:44:33.683 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:17.437227+0000", 2024-04-18T14:44:33.683 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.5397000000000001e-05 2024-04-18T14:44:33.684 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:33.684 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:33.684 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-04-18T14:44:33.684 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:17.437493+0000", 2024-04-18T14:44:33.684 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00026662799999999998 2024-04-18T14:44:33.684 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:33.684 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:33.684 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_started", 2024-04-18T14:44:33.684 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:17.437518+0000", 2024-04-18T14:44:33.684 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.4833000000000001e-05 2024-04-18T14:44:33.684 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:33.684 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:33.684 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_committed", 2024-04-18T14:44:33.684 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:17.449397+0000", 2024-04-18T14:44:33.684 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.011878882 2024-04-18T14:44:33.685 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:33.685 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:33.685 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-04-18T14:44:33.685 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:17.449494+0000", 2024-04-18T14:44:33.685 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 9.6753e-05 2024-04-18T14:44:33.685 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:44:33.685 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-04-18T14:44:33.685 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:44:33.685 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:33.685 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:33.685 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "MOSDECSubOpWrite(3.3s2 78/30 ECSubWrite(tid=284, reqid=osd.13.0:284, at_version=78'51, trim_to=0'0, roll_forward_to=69'47))", 2024-04-18T14:44:33.685 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-04-18T14:44:17.439146+0000", 2024-04-18T14:44:33.685 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 16.171293915, 2024-04-18T14:44:33.685 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.015057528000000001, 2024-04-18T14:44:33.685 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-04-18T14:44:33.686 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "reached pg", 2024-04-18T14:44:33.686 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-04-18T14:44:33.686 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:33.686 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-04-18T14:44:33.686 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:17.439146+0000", 2024-04-18T14:44:33.686 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:44:33.686 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:33.686 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:33.686 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-04-18T14:44:33.686 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:17.439146+0000", 2024-04-18T14:44:33.686 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:44:33.686 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:33.686 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:33.686 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-04-18T14:44:33.686 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:17.439145+0000", 2024-04-18T14:44:33.686 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4294967295.9999981 2024-04-18T14:44:33.687 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:33.687 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:33.687 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-04-18T14:44:33.687 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:17.439198+0000", 2024-04-18T14:44:33.687 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 5.3229999999999997e-05 2024-04-18T14:44:33.687 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:33.687 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:33.687 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-04-18T14:44:33.687 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:17.439256+0000", 2024-04-18T14:44:33.687 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 5.8165999999999998e-05 2024-04-18T14:44:33.687 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:33.687 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:33.687 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-04-18T14:44:33.687 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:17.439278+0000", 2024-04-18T14:44:33.687 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.2079999999999999e-05 2024-04-18T14:44:33.688 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:33.688 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:33.688 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-04-18T14:44:33.688 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:17.444175+0000", 2024-04-18T14:44:33.688 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0048972119999999997 2024-04-18T14:44:33.688 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:33.688 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:33.688 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_started", 2024-04-18T14:44:33.688 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:17.444188+0000", 2024-04-18T14:44:33.688 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.3193000000000001e-05 2024-04-18T14:44:33.688 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:33.688 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:33.688 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_committed", 2024-04-18T14:44:33.688 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:17.454145+0000", 2024-04-18T14:44:33.688 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0099565839999999992 2024-04-18T14:44:33.689 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:33.689 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:33.689 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-04-18T14:44:33.689 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:17.454204+0000", 2024-04-18T14:44:33.689 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 5.8983000000000001e-05 2024-04-18T14:44:33.689 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:44:33.689 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-04-18T14:44:33.689 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:44:33.689 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:33.689 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:33.689 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "MOSDECSubOpWrite(3.cs5 78/30 ECSubWrite(tid=214, reqid=osd.11.0:214, at_version=78'139, trim_to=0'0, roll_forward_to=72'135))", 2024-04-18T14:44:33.689 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-04-18T14:44:17.440994+0000", 2024-04-18T14:44:33.689 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 16.169446065999999, 2024-04-18T14:44:33.689 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.013372098000000001, 2024-04-18T14:44:33.689 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-04-18T14:44:33.689 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "reached pg", 2024-04-18T14:44:33.690 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-04-18T14:44:33.690 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:33.690 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-04-18T14:44:33.690 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:17.440994+0000", 2024-04-18T14:44:33.690 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:44:33.690 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:33.690 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:33.690 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-04-18T14:44:33.690 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:17.440994+0000", 2024-04-18T14:44:33.690 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:44:33.690 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:33.690 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:33.690 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-04-18T14:44:33.690 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:17.440992+0000", 2024-04-18T14:44:33.690 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4294967295.9999981 2024-04-18T14:44:33.691 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:33.691 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:33.691 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-04-18T14:44:33.691 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:17.441047+0000", 2024-04-18T14:44:33.691 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 5.4339000000000003e-05 2024-04-18T14:44:33.691 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:33.691 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:33.691 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-04-18T14:44:33.691 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:17.441083+0000", 2024-04-18T14:44:33.691 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.6276999999999998e-05 2024-04-18T14:44:33.691 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:33.691 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:33.691 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-04-18T14:44:33.691 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:17.441110+0000", 2024-04-18T14:44:33.691 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.667e-05 2024-04-18T14:44:33.691 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:33.692 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:33.692 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-04-18T14:44:33.692 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:17.443171+0000", 2024-04-18T14:44:33.692 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0020610839999999999 2024-04-18T14:44:33.692 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:33.692 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:33.692 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_started", 2024-04-18T14:44:33.692 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:17.443194+0000", 2024-04-18T14:44:33.692 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.3295999999999999e-05 2024-04-18T14:44:33.692 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:33.692 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:33.692 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_committed", 2024-04-18T14:44:33.692 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:17.454310+0000", 2024-04-18T14:44:33.692 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.011116035 2024-04-18T14:44:33.692 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:33.693 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:33.693 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-04-18T14:44:33.693 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:17.454366+0000", 2024-04-18T14:44:33.693 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 5.6242999999999997e-05 2024-04-18T14:44:33.693 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:44:33.693 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-04-18T14:44:33.693 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:44:33.693 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:33.693 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:33.693 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "MOSDECSubOpWrite(3.7s4 78/30 ECSubWrite(tid=277, reqid=osd.14.0:277, at_version=78'101, trim_to=0'0, roll_forward_to=76'99))", 2024-04-18T14:44:33.693 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-04-18T14:44:17.442246+0000", 2024-04-18T14:44:33.693 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 16.168194538000002, 2024-04-18T14:44:33.693 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.011859102, 2024-04-18T14:44:33.693 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-04-18T14:44:33.693 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "reached pg", 2024-04-18T14:44:33.693 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-04-18T14:44:33.694 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:33.694 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-04-18T14:44:33.694 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:17.442246+0000", 2024-04-18T14:44:33.694 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:44:33.694 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:33.694 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:33.694 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-04-18T14:44:33.694 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:17.442246+0000", 2024-04-18T14:44:33.694 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:44:33.694 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:33.694 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:33.694 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-04-18T14:44:33.694 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:17.442245+0000", 2024-04-18T14:44:33.694 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4294967295.999999 2024-04-18T14:44:33.694 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:33.695 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:33.695 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-04-18T14:44:33.695 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:17.442304+0000", 2024-04-18T14:44:33.695 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 5.8523000000000002e-05 2024-04-18T14:44:33.695 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:33.695 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:33.695 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-04-18T14:44:33.695 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:17.442333+0000", 2024-04-18T14:44:33.695 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.9672999999999999e-05 2024-04-18T14:44:33.695 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:33.695 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:33.695 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-04-18T14:44:33.695 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:17.442355+0000", 2024-04-18T14:44:33.695 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.1330000000000001e-05 2024-04-18T14:44:33.695 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:33.696 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:33.696 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-04-18T14:44:33.696 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:17.442504+0000", 2024-04-18T14:44:33.696 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000149352 2024-04-18T14:44:33.696 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:33.696 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:33.696 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_started", 2024-04-18T14:44:33.696 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:17.442536+0000", 2024-04-18T14:44:33.696 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.1925999999999999e-05 2024-04-18T14:44:33.696 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:33.696 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:33.696 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_committed", 2024-04-18T14:44:33.696 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:17.454044+0000", 2024-04-18T14:44:33.696 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.011507842000000001 2024-04-18T14:44:33.696 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:33.696 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:33.697 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-04-18T14:44:33.697 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:17.454105+0000", 2024-04-18T14:44:33.697 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 6.1229999999999995e-05 2024-04-18T14:44:33.697 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:44:33.697 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-04-18T14:44:33.697 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:44:33.697 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:33.697 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:33.697 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "MOSDECSubOpWrite(3.7s4 78/30 ECSubWrite(tid=278, reqid=osd.14.0:278, at_version=78'103, trim_to=0'0, roll_forward_to=76'99))", 2024-04-18T14:44:33.697 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-04-18T14:44:17.442395+0000", 2024-04-18T14:44:33.697 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 16.168045530000001, 2024-04-18T14:44:33.697 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.013060497000000001, 2024-04-18T14:44:33.697 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-04-18T14:44:33.697 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "reached pg", 2024-04-18T14:44:33.697 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-04-18T14:44:33.698 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:33.698 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-04-18T14:44:33.698 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:17.442395+0000", 2024-04-18T14:44:33.698 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:44:33.698 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:33.698 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:33.698 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-04-18T14:44:33.698 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:17.442395+0000", 2024-04-18T14:44:33.698 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:44:33.698 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:33.698 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:33.698 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-04-18T14:44:33.698 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:17.442394+0000", 2024-04-18T14:44:33.698 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4294967295.999999 2024-04-18T14:44:33.698 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:33.699 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:33.699 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-04-18T14:44:33.699 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:17.442444+0000", 2024-04-18T14:44:33.699 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 5.0025999999999998e-05 2024-04-18T14:44:33.699 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:33.699 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:33.699 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-04-18T14:44:33.699 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:17.442465+0000", 2024-04-18T14:44:33.699 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.1420000000000002e-05 2024-04-18T14:44:33.699 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:33.699 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:33.699 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-04-18T14:44:33.699 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:17.442482+0000", 2024-04-18T14:44:33.699 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.6759999999999999e-05 2024-04-18T14:44:33.699 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:33.700 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:33.700 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-04-18T14:44:33.700 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:17.447822+0000", 2024-04-18T14:44:33.700 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0053395919999999998 2024-04-18T14:44:33.700 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:33.700 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:33.700 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_started", 2024-04-18T14:44:33.700 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:17.447846+0000", 2024-04-18T14:44:33.700 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.3904e-05 2024-04-18T14:44:33.700 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:33.700 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:33.700 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_committed", 2024-04-18T14:44:33.700 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:17.455388+0000", 2024-04-18T14:44:33.700 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0075427180000000003 2024-04-18T14:44:33.700 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:33.700 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:33.701 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-04-18T14:44:33.701 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:17.455455+0000", 2024-04-18T14:44:33.701 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 6.6989999999999994e-05 2024-04-18T14:44:33.701 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:44:33.701 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-04-18T14:44:33.701 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:44:33.701 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:33.701 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:33.701 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "MOSDECSubOpWrite(3.7s4 82/30 ECSubWrite(tid=320, reqid=osd.14.0:320, at_version=82'123, trim_to=0'0, roll_forward_to=80'119))", 2024-04-18T14:44:33.701 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-04-18T14:44:21.473579+0000", 2024-04-18T14:44:33.701 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 12.136861648, 2024-04-18T14:44:33.701 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0096503219999999994, 2024-04-18T14:44:33.701 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-04-18T14:44:33.701 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "reached pg", 2024-04-18T14:44:33.701 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-04-18T14:44:33.702 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:33.702 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-04-18T14:44:33.702 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:21.473579+0000", 2024-04-18T14:44:33.702 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:44:33.702 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:33.702 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:33.702 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-04-18T14:44:33.702 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:21.473579+0000", 2024-04-18T14:44:33.702 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:44:33.702 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:33.702 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:33.702 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-04-18T14:44:33.702 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:21.473577+0000", 2024-04-18T14:44:33.702 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4294967295.9999981 2024-04-18T14:44:33.702 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:33.703 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:33.703 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-04-18T14:44:33.703 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:21.473631+0000", 2024-04-18T14:44:33.703 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 5.3601999999999999e-05 2024-04-18T14:44:33.703 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:33.703 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:33.703 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-04-18T14:44:33.703 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:21.473664+0000", 2024-04-18T14:44:33.703 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.3274e-05 2024-04-18T14:44:33.703 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:33.703 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:33.703 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-04-18T14:44:33.703 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:21.473685+0000", 2024-04-18T14:44:33.703 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.1386000000000002e-05 2024-04-18T14:44:33.703 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:33.703 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:33.704 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-04-18T14:44:33.704 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:21.473871+0000", 2024-04-18T14:44:33.704 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00018613200000000001 2024-04-18T14:44:33.704 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:33.704 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:33.704 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_started", 2024-04-18T14:44:33.704 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:21.473898+0000", 2024-04-18T14:44:33.704 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.7013e-05 2024-04-18T14:44:33.704 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:33.704 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:33.704 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_committed", 2024-04-18T14:44:33.704 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:21.483199+0000", 2024-04-18T14:44:33.704 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0093007820000000005 2024-04-18T14:44:33.704 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:33.704 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:33.705 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-04-18T14:44:33.705 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:21.483229+0000", 2024-04-18T14:44:33.705 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.9955999999999999e-05 2024-04-18T14:44:33.705 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:44:33.705 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-04-18T14:44:33.705 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:44:33.705 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:33.705 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:33.705 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "MOSDECSubOpWrite(3.3s2 82/30 ECSubWrite(tid=298, reqid=osd.13.0:298, at_version=82'59, trim_to=0'0, roll_forward_to=80'57))", 2024-04-18T14:44:33.705 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-04-18T14:44:21.474373+0000", 2024-04-18T14:44:33.705 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 12.136067518000001, 2024-04-18T14:44:33.705 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.010541801999999999, 2024-04-18T14:44:33.705 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-04-18T14:44:33.705 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "reached pg", 2024-04-18T14:44:33.705 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-04-18T14:44:33.706 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:33.706 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-04-18T14:44:33.706 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:21.474373+0000", 2024-04-18T14:44:33.706 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:44:33.706 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:33.706 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:33.706 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-04-18T14:44:33.706 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:21.474373+0000", 2024-04-18T14:44:33.706 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:44:33.706 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:33.706 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:33.706 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-04-18T14:44:33.706 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:21.474371+0000", 2024-04-18T14:44:33.706 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4294967295.9999981 2024-04-18T14:44:33.706 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:33.707 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:33.707 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-04-18T14:44:33.707 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:21.474426+0000", 2024-04-18T14:44:33.707 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 5.4633999999999999e-05 2024-04-18T14:44:33.707 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:33.707 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:33.707 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-04-18T14:44:33.707 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:21.474458+0000", 2024-04-18T14:44:33.707 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.1912999999999998e-05 2024-04-18T14:44:33.707 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:33.707 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:33.707 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-04-18T14:44:33.707 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:21.474479+0000", 2024-04-18T14:44:33.707 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.0856000000000002e-05 2024-04-18T14:44:33.707 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:33.707 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:33.708 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-04-18T14:44:33.708 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:21.474828+0000", 2024-04-18T14:44:33.708 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00034933400000000003 2024-04-18T14:44:33.708 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:33.708 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:33.708 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_started", 2024-04-18T14:44:33.708 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:21.474856+0000", 2024-04-18T14:44:33.708 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.7783000000000001e-05 2024-04-18T14:44:33.708 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:33.708 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:33.708 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_committed", 2024-04-18T14:44:33.708 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:21.484847+0000", 2024-04-18T14:44:33.708 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0099917840000000001 2024-04-18T14:44:33.708 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:33.708 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:33.709 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-04-18T14:44:33.709 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:21.484915+0000", 2024-04-18T14:44:33.709 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 6.7214999999999999e-05 2024-04-18T14:44:33.709 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:44:33.709 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-04-18T14:44:33.709 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:44:33.709 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:33.709 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:33.709 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "MOSDECSubOpWrite(3.7s4 82/30 ECSubWrite(tid=322, reqid=osd.14.0:322, at_version=82'125, trim_to=0'0, roll_forward_to=80'119))", 2024-04-18T14:44:33.709 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-04-18T14:44:21.475379+0000", 2024-04-18T14:44:33.709 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 12.135061322, 2024-04-18T14:44:33.709 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.009771198, 2024-04-18T14:44:33.709 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-04-18T14:44:33.709 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "reached pg", 2024-04-18T14:44:33.709 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-04-18T14:44:33.709 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:33.710 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-04-18T14:44:33.710 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:21.475379+0000", 2024-04-18T14:44:33.710 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:44:33.710 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:33.710 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:33.710 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-04-18T14:44:33.710 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:21.475379+0000", 2024-04-18T14:44:33.710 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:44:33.710 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:33.710 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:33.710 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-04-18T14:44:33.710 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:21.475377+0000", 2024-04-18T14:44:33.710 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4294967295.9999981 2024-04-18T14:44:33.710 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:33.710 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:33.711 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-04-18T14:44:33.711 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:21.475429+0000", 2024-04-18T14:44:33.711 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 5.1940000000000001e-05 2024-04-18T14:44:33.711 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:33.711 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:33.711 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-04-18T14:44:33.711 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:21.475483+0000", 2024-04-18T14:44:33.711 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 5.3906000000000002e-05 2024-04-18T14:44:33.711 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:33.711 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:33.711 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-04-18T14:44:33.711 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:21.475508+0000", 2024-04-18T14:44:33.711 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.457e-05 2024-04-18T14:44:33.711 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:33.711 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:33.711 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-04-18T14:44:33.712 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:21.479350+0000", 2024-04-18T14:44:33.712 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.003841957 2024-04-18T14:44:33.712 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:33.712 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:33.712 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_started", 2024-04-18T14:44:33.712 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:21.479377+0000", 2024-04-18T14:44:33.712 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.7100000000000001e-05 2024-04-18T14:44:33.712 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:33.712 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:33.712 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_committed", 2024-04-18T14:44:33.712 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:21.485112+0000", 2024-04-18T14:44:33.712 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0057355430000000001 2024-04-18T14:44:33.712 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:33.712 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:33.712 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-04-18T14:44:33.713 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:21.485150+0000", 2024-04-18T14:44:33.713 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.8078999999999999e-05 2024-04-18T14:44:33.713 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:44:33.713 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-04-18T14:44:33.713 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:44:33.713 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:44:33.713 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-04-18T14:44:33.713 INFO:teuthology.orchestra.run.smithi119.stdout:} 2024-04-18T14:44:33.714 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-04-18T14:44:33.840 INFO:teuthology.orchestra.run.smithi119.stdout:{ 2024-04-18T14:44:33.840 INFO:teuthology.orchestra.run.smithi119.stdout: "ops": [], 2024-04-18T14:44:33.840 INFO:teuthology.orchestra.run.smithi119.stdout: "num_ops": 0 2024-04-18T14:44:33.840 INFO:teuthology.orchestra.run.smithi119.stdout:} 2024-04-18T14:44:33.854 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-04-18T14:44:33.974 INFO:teuthology.orchestra.run.smithi119.stdout:{ 2024-04-18T14:44:33.975 INFO:teuthology.orchestra.run.smithi119.stdout: "ops": [], 2024-04-18T14:44:33.975 INFO:teuthology.orchestra.run.smithi119.stdout: "complaint_time": 30, 2024-04-18T14:44:33.975 INFO:teuthology.orchestra.run.smithi119.stdout: "num_blocked_ops": 0 2024-04-18T14:44:33.975 INFO:teuthology.orchestra.run.smithi119.stdout:} 2024-04-18T14:44:33.988 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-04-18T14:44:34.117 INFO:teuthology.orchestra.run.smithi119.stdout:{ 2024-04-18T14:44:34.117 INFO:teuthology.orchestra.run.smithi119.stdout: "size": 20, 2024-04-18T14:44:34.117 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 600, 2024-04-18T14:44:34.117 INFO:teuthology.orchestra.run.smithi119.stdout: "ops": [ 2024-04-18T14:44:34.118 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:34.118 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(client.4559.0:189 3.1s0 3:8de3c091:::smithi13430248-9:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e37)", 2024-04-18T14:44:34.118 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-04-18T14:43:36.761939+0000", 2024-04-18T14:44:34.118 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 57.357615895000002, 2024-04-18T14:44:34.118 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.018164527, 2024-04-18T14:44:34.118 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-04-18T14:44:34.118 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "started", 2024-04-18T14:44:34.118 INFO:teuthology.orchestra.run.smithi119.stdout: "client_info": { 2024-04-18T14:44:34.119 INFO:teuthology.orchestra.run.smithi119.stdout: "client": "client.4559", 2024-04-18T14:44:34.119 INFO:teuthology.orchestra.run.smithi119.stdout: "client_addr": "172.21.15.134:0/3113589487", 2024-04-18T14:44:34.119 INFO:teuthology.orchestra.run.smithi119.stdout: "tid": 189 2024-04-18T14:44:34.119 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:34.119 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-04-18T14:44:34.120 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:34.120 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-04-18T14:44:34.120 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:36.761939+0000", 2024-04-18T14:44:34.120 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:44:34.120 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:34.120 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:34.120 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-04-18T14:44:34.121 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:36.761939+0000", 2024-04-18T14:44:34.121 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:44:34.121 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:34.121 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:34.121 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-04-18T14:44:34.121 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:36.761938+0000", 2024-04-18T14:44:34.122 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4294967295.9999986 2024-04-18T14:44:34.122 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:34.122 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:34.122 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-04-18T14:44:34.122 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:36.761947+0000", 2024-04-18T14:44:34.122 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 9.2399999999999996e-06 2024-04-18T14:44:34.122 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:34.122 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:34.122 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-04-18T14:44:34.122 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:36.761967+0000", 2024-04-18T14:44:34.122 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.9956999999999999e-05 2024-04-18T14:44:34.122 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:34.123 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:34.123 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-04-18T14:44:34.123 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:36.761988+0000", 2024-04-18T14:44:34.123 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.1115e-05 2024-04-18T14:44:34.123 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:34.123 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:34.123 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-04-18T14:44:34.123 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:36.767166+0000", 2024-04-18T14:44:34.123 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0051778420000000002 2024-04-18T14:44:34.123 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:34.123 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:34.123 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for rw locks", 2024-04-18T14:44:34.124 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:36.767335+0000", 2024-04-18T14:44:34.124 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00016923099999999999 2024-04-18T14:44:34.124 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:34.124 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:34.124 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-04-18T14:44:34.124 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:36.775552+0000", 2024-04-18T14:44:34.125 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0082173460000000004 2024-04-18T14:44:34.125 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:34.125 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:34.125 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-04-18T14:44:34.125 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:36.775682+0000", 2024-04-18T14:44:34.125 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000129803 2024-04-18T14:44:34.125 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:34.125 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:34.125 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-04-18T14:44:34.125 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:36.780104+0000", 2024-04-18T14:44:34.125 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0044214129999999999 2024-04-18T14:44:34.125 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:44:34.126 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-04-18T14:44:34.126 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:44:34.126 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:34.126 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:34.126 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(client.4559.0:373 3.1s0 3:8de3c091:::smithi13430248-9:head [read 0~1409024,checksum] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-04-18T14:44:34.126 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-04-18T14:43:50.376336+0000", 2024-04-18T14:44:34.126 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 43.743219224999997, 2024-04-18T14:44:34.126 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.017062416, 2024-04-18T14:44:34.126 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-04-18T14:44:34.126 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "started", 2024-04-18T14:44:34.126 INFO:teuthology.orchestra.run.smithi119.stdout: "client_info": { 2024-04-18T14:44:34.126 INFO:teuthology.orchestra.run.smithi119.stdout: "client": "client.4559", 2024-04-18T14:44:34.126 INFO:teuthology.orchestra.run.smithi119.stdout: "client_addr": "172.21.15.134:0/3113589487", 2024-04-18T14:44:34.126 INFO:teuthology.orchestra.run.smithi119.stdout: "tid": 373 2024-04-18T14:44:34.127 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:34.127 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-04-18T14:44:34.127 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:34.127 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-04-18T14:44:34.127 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:50.376336+0000", 2024-04-18T14:44:34.127 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:44:34.127 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:34.127 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:34.127 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-04-18T14:44:34.127 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:50.376336+0000", 2024-04-18T14:44:34.127 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:44:34.128 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:34.128 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:34.128 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-04-18T14:44:34.128 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:50.376334+0000", 2024-04-18T14:44:34.128 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4294967295.9999986 2024-04-18T14:44:34.128 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:34.128 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:34.128 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-04-18T14:44:34.129 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:50.376344+0000", 2024-04-18T14:44:34.129 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 9.9939999999999995e-06 2024-04-18T14:44:34.129 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:34.129 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:34.129 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-04-18T14:44:34.129 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:50.376363+0000", 2024-04-18T14:44:34.129 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.9063e-05 2024-04-18T14:44:34.130 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:34.130 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:34.130 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-04-18T14:44:34.130 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:50.376379+0000", 2024-04-18T14:44:34.130 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.5153999999999999e-05 2024-04-18T14:44:34.130 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:34.130 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:34.130 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-04-18T14:44:34.131 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:50.376635+0000", 2024-04-18T14:44:34.131 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00025632600000000003 2024-04-18T14:44:34.131 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:34.131 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:34.131 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting_for_map not empty", 2024-04-18T14:44:34.131 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:50.376657+0000", 2024-04-18T14:44:34.131 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.1693999999999999e-05 2024-04-18T14:44:34.131 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:34.131 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:34.131 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-04-18T14:44:34.132 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:50.383261+0000", 2024-04-18T14:44:34.132 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0066047579999999996 2024-04-18T14:44:34.132 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:34.132 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:34.132 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-04-18T14:44:34.132 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:50.383496+0000", 2024-04-18T14:44:34.132 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00023489299999999999 2024-04-18T14:44:34.132 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:34.132 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:34.132 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-04-18T14:44:34.132 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:50.393398+0000", 2024-04-18T14:44:34.132 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0099019269999999996 2024-04-18T14:44:34.133 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:44:34.133 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-04-18T14:44:34.133 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:44:34.133 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:34.133 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:34.133 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(client.4559.0:374 3.1s0 3:8de3c091:::smithi13430248-9:head [read 0~1409024,checksum] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-04-18T14:44:34.133 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-04-18T14:43:50.376424+0000", 2024-04-18T14:44:34.133 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 43.743131507000001, 2024-04-18T14:44:34.133 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.018965715000000001, 2024-04-18T14:44:34.133 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-04-18T14:44:34.133 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "started", 2024-04-18T14:44:34.133 INFO:teuthology.orchestra.run.smithi119.stdout: "client_info": { 2024-04-18T14:44:34.134 INFO:teuthology.orchestra.run.smithi119.stdout: "client": "client.4559", 2024-04-18T14:44:34.134 INFO:teuthology.orchestra.run.smithi119.stdout: "client_addr": "172.21.15.134:0/3113589487", 2024-04-18T14:44:34.134 INFO:teuthology.orchestra.run.smithi119.stdout: "tid": 374 2024-04-18T14:44:34.134 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:34.134 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-04-18T14:44:34.134 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:34.134 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-04-18T14:44:34.134 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:50.376424+0000", 2024-04-18T14:44:34.134 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:44:34.134 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:34.135 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:34.135 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-04-18T14:44:34.135 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:50.376424+0000", 2024-04-18T14:44:34.135 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:44:34.135 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:34.135 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:34.135 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-04-18T14:44:34.135 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:50.376422+0000", 2024-04-18T14:44:34.135 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4294967295.9999986 2024-04-18T14:44:34.135 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:34.135 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:34.135 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-04-18T14:44:34.135 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:50.376430+0000", 2024-04-18T14:44:34.135 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 7.7610000000000007e-06 2024-04-18T14:44:34.135 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:34.136 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:34.136 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-04-18T14:44:34.136 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:50.376447+0000", 2024-04-18T14:44:34.136 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.734e-05 2024-04-18T14:44:34.136 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:34.136 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:34.136 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-04-18T14:44:34.136 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:50.376462+0000", 2024-04-18T14:44:34.136 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.4286e-05 2024-04-18T14:44:34.136 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:34.137 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:34.137 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-04-18T14:44:34.137 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:50.376723+0000", 2024-04-18T14:44:34.137 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000260914 2024-04-18T14:44:34.137 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:34.137 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:34.137 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting_for_map not empty", 2024-04-18T14:44:34.137 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:50.376743+0000", 2024-04-18T14:44:34.137 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.031e-05 2024-04-18T14:44:34.137 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:34.138 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:34.138 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-04-18T14:44:34.138 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:50.387572+0000", 2024-04-18T14:44:34.138 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.010829544 2024-04-18T14:44:34.138 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:34.138 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:34.138 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-04-18T14:44:34.138 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:50.387758+0000", 2024-04-18T14:44:34.138 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000185849 2024-04-18T14:44:34.138 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:34.138 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:34.138 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-04-18T14:44:34.138 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:50.395389+0000", 2024-04-18T14:44:34.138 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0076309810000000002 2024-04-18T14:44:34.139 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:44:34.139 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-04-18T14:44:34.139 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:44:34.139 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:34.139 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:34.139 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(client.4559.0:512 3.1s0 3:8edef92b:::smithi13430248-24:head [copy-from ver 13] snapc 19=[19,16,14,13,11,f,b,a,7,2] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-18T14:44:34.139 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-04-18T14:43:56.578477+0000", 2024-04-18T14:44:34.139 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 37.541077731000001, 2024-04-18T14:44:34.139 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.021126664, 2024-04-18T14:44:34.139 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-04-18T14:44:34.139 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T14:44:34.140 INFO:teuthology.orchestra.run.smithi119.stdout: "client_info": { 2024-04-18T14:44:34.140 INFO:teuthology.orchestra.run.smithi119.stdout: "client": "client.4559", 2024-04-18T14:44:34.140 INFO:teuthology.orchestra.run.smithi119.stdout: "client_addr": "172.21.15.134:0/3113589487", 2024-04-18T14:44:34.140 INFO:teuthology.orchestra.run.smithi119.stdout: "tid": 512 2024-04-18T14:44:34.140 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:34.140 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-04-18T14:44:34.140 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:34.140 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-04-18T14:44:34.140 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:56.578477+0000", 2024-04-18T14:44:34.140 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:44:34.140 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:34.141 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:34.141 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-04-18T14:44:34.141 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:56.578477+0000", 2024-04-18T14:44:34.141 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:44:34.141 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:34.141 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:34.141 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-04-18T14:44:34.141 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:56.578473+0000", 2024-04-18T14:44:34.141 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4294967295.9999962 2024-04-18T14:44:34.141 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:34.141 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:34.141 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-04-18T14:44:34.141 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:56.578491+0000", 2024-04-18T14:44:34.141 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.7784000000000001e-05 2024-04-18T14:44:34.142 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:34.142 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:34.142 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-04-18T14:44:34.142 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:56.578576+0000", 2024-04-18T14:44:34.142 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 8.5117000000000005e-05 2024-04-18T14:44:34.142 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:34.142 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:34.142 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-04-18T14:44:34.142 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:56.578601+0000", 2024-04-18T14:44:34.142 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.4581000000000001e-05 2024-04-18T14:44:34.142 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:34.142 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:34.142 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-04-18T14:44:34.143 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:56.578739+0000", 2024-04-18T14:44:34.143 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000138271 2024-04-18T14:44:34.143 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:34.143 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:34.143 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-04-18T14:44:34.143 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:56.578932+0000", 2024-04-18T14:44:34.143 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000192649 2024-04-18T14:44:34.143 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:34.143 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:34.143 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_started", 2024-04-18T14:44:34.143 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:56.587757+0000", 2024-04-18T14:44:34.143 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0088247970000000005 2024-04-18T14:44:34.143 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:34.143 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:34.144 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_committed", 2024-04-18T14:44:34.144 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:56.591615+0000", 2024-04-18T14:44:34.144 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.003858336 2024-04-18T14:44:34.144 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:34.144 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:34.144 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-04-18T14:44:34.144 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:56.599453+0000", 2024-04-18T14:44:34.144 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0078382509999999992 2024-04-18T14:44:34.144 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:34.144 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:34.144 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-04-18T14:44:34.144 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:56.599604+0000", 2024-04-18T14:44:34.145 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000150688 2024-04-18T14:44:34.145 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:44:34.145 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-04-18T14:44:34.145 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:44:34.145 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:34.145 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:34.145 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(client.4559.0:715 3.1s0 3:891e68bf:::smithi13430248-19:head [copy-from ver 101] snapc 27=[27,26,23,22,1e,1c,1a,16,14,13,11,2] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-04-18T14:44:34.145 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-04-18T14:44:11.391972+0000", 2024-04-18T14:44:34.145 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 22.727582696999999, 2024-04-18T14:44:34.145 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.10959126, 2024-04-18T14:44:34.145 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-04-18T14:44:34.145 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T14:44:34.145 INFO:teuthology.orchestra.run.smithi119.stdout: "client_info": { 2024-04-18T14:44:34.145 INFO:teuthology.orchestra.run.smithi119.stdout: "client": "client.4559", 2024-04-18T14:44:34.145 INFO:teuthology.orchestra.run.smithi119.stdout: "client_addr": "172.21.15.134:0/3113589487", 2024-04-18T14:44:34.146 INFO:teuthology.orchestra.run.smithi119.stdout: "tid": 715 2024-04-18T14:44:34.146 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:34.146 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-04-18T14:44:34.146 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:34.146 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-04-18T14:44:34.146 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:11.391972+0000", 2024-04-18T14:44:34.146 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:44:34.146 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:34.146 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:34.146 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-04-18T14:44:34.146 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:11.391972+0000", 2024-04-18T14:44:34.146 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:44:34.147 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:34.147 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:34.147 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-04-18T14:44:34.147 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:11.391969+0000", 2024-04-18T14:44:34.147 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4294967295.9999962 2024-04-18T14:44:34.147 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:34.147 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:34.148 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-04-18T14:44:34.148 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:11.391990+0000", 2024-04-18T14:44:34.148 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.1569999999999998e-05 2024-04-18T14:44:34.148 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:34.148 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:34.148 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-04-18T14:44:34.149 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:11.392024+0000", 2024-04-18T14:44:34.149 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.3200000000000001e-05 2024-04-18T14:44:34.149 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:34.149 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:34.149 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-04-18T14:44:34.149 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:11.392045+0000", 2024-04-18T14:44:34.149 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.1195999999999998e-05 2024-04-18T14:44:34.149 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:34.149 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:34.149 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-04-18T14:44:34.149 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:11.392225+0000", 2024-04-18T14:44:34.150 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000180509 2024-04-18T14:44:34.150 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:34.150 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:34.150 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "op must wait for map", 2024-04-18T14:44:34.150 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:11.392245+0000", 2024-04-18T14:44:34.150 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.9726999999999999e-05 2024-04-18T14:44:34.151 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:34.151 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:34.151 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-04-18T14:44:34.151 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:11.396476+0000", 2024-04-18T14:44:34.151 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0042315210000000002 2024-04-18T14:44:34.151 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:34.152 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:34.152 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-04-18T14:44:34.152 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:11.396790+0000", 2024-04-18T14:44:34.152 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00031320399999999998 2024-04-18T14:44:34.152 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:34.152 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:34.152 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_started", 2024-04-18T14:44:34.152 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:11.490642+0000", 2024-04-18T14:44:34.152 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.093852383999999997 2024-04-18T14:44:34.153 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:34.153 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:34.153 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_committed", 2024-04-18T14:44:34.153 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:11.497646+0000", 2024-04-18T14:44:34.153 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0070044160000000003 2024-04-18T14:44:34.153 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:34.153 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:34.153 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-04-18T14:44:34.154 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:11.501312+0000", 2024-04-18T14:44:34.154 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.003665462 2024-04-18T14:44:34.154 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:34.154 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:34.154 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-04-18T14:44:34.154 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:11.501564+0000", 2024-04-18T14:44:34.155 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00025167100000000002 2024-04-18T14:44:34.155 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:44:34.155 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-04-18T14:44:34.155 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:44:34.155 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:34.155 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:34.156 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(client.4559.0:716 3.1s0 3:891e68bf:::smithi13430248-19:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e72)", 2024-04-18T14:44:34.156 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-04-18T14:44:11.392082+0000", 2024-04-18T14:44:34.156 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 22.727472628000001, 2024-04-18T14:44:34.156 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.103574903, 2024-04-18T14:44:34.156 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-04-18T14:44:34.156 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "started", 2024-04-18T14:44:34.156 INFO:teuthology.orchestra.run.smithi119.stdout: "client_info": { 2024-04-18T14:44:34.157 INFO:teuthology.orchestra.run.smithi119.stdout: "client": "client.4559", 2024-04-18T14:44:34.157 INFO:teuthology.orchestra.run.smithi119.stdout: "client_addr": "172.21.15.134:0/3113589487", 2024-04-18T14:44:34.157 INFO:teuthology.orchestra.run.smithi119.stdout: "tid": 716 2024-04-18T14:44:34.157 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:34.157 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-04-18T14:44:34.157 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:34.158 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-04-18T14:44:34.158 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:11.392082+0000", 2024-04-18T14:44:34.158 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:44:34.158 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:34.158 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:34.158 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-04-18T14:44:34.158 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:11.392082+0000", 2024-04-18T14:44:34.158 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:44:34.158 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:34.158 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:34.158 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-04-18T14:44:34.158 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:11.392081+0000", 2024-04-18T14:44:34.158 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4294967295.9999986 2024-04-18T14:44:34.159 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:34.159 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:34.159 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-04-18T14:44:34.159 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:11.392089+0000", 2024-04-18T14:44:34.159 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 8.2859999999999999e-06 2024-04-18T14:44:34.159 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:34.159 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:34.159 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-04-18T14:44:34.159 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:11.392110+0000", 2024-04-18T14:44:34.159 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.0659999999999999e-05 2024-04-18T14:44:34.159 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:34.159 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:34.159 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-04-18T14:44:34.159 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:11.392125+0000", 2024-04-18T14:44:34.160 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.4793999999999999e-05 2024-04-18T14:44:34.160 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:34.160 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:34.160 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-04-18T14:44:34.160 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:11.392468+0000", 2024-04-18T14:44:34.160 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00034309 2024-04-18T14:44:34.160 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:34.160 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:34.160 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting_for_map not empty", 2024-04-18T14:44:34.160 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:11.392499+0000", 2024-04-18T14:44:34.160 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.1090000000000002e-05 2024-04-18T14:44:34.160 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:34.160 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:34.160 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-04-18T14:44:34.161 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:11.397266+0000", 2024-04-18T14:44:34.161 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0047675240000000004 2024-04-18T14:44:34.161 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:34.161 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:34.161 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for blocked object", 2024-04-18T14:44:34.161 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:11.397406+0000", 2024-04-18T14:44:34.161 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000139362 2024-04-18T14:44:34.161 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:34.161 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:34.161 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-04-18T14:44:34.161 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:11.495314+0000", 2024-04-18T14:44:34.161 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.097908712999999994 2024-04-18T14:44:34.162 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:34.162 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:34.162 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-04-18T14:44:34.162 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:11.495488+0000", 2024-04-18T14:44:34.162 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00017332200000000001 2024-04-18T14:44:34.162 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:34.162 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:34.162 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-04-18T14:44:34.162 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:11.495657+0000", 2024-04-18T14:44:34.162 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00016961799999999999 2024-04-18T14:44:34.162 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:44:34.162 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-04-18T14:44:34.162 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:44:34.162 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:34.163 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:34.163 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "MOSDECSubOpWrite(3.cs6 72/30 ECSubWrite(tid=191, reqid=client.4559.0:742, at_version=72'124, trim_to=0'0, roll_forward_to=71'122))", 2024-04-18T14:44:34.163 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-04-18T14:44:11.762989+0000", 2024-04-18T14:44:34.163 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 22.356566206, 2024-04-18T14:44:34.163 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.017483157999999999, 2024-04-18T14:44:34.163 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-04-18T14:44:34.163 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "reached pg", 2024-04-18T14:44:34.163 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-04-18T14:44:34.164 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:34.164 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-04-18T14:44:34.164 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:11.762989+0000", 2024-04-18T14:44:34.164 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:44:34.164 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:34.164 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:34.164 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-04-18T14:44:34.164 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:11.762989+0000", 2024-04-18T14:44:34.164 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:44:34.164 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:34.164 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:34.164 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-04-18T14:44:34.164 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:11.762986+0000", 2024-04-18T14:44:34.165 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4294967295.9999971 2024-04-18T14:44:34.165 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:34.165 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:34.165 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-04-18T14:44:34.165 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:11.766014+0000", 2024-04-18T14:44:34.165 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0030282529999999998 2024-04-18T14:44:34.165 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:34.165 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:34.165 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-04-18T14:44:34.165 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:11.766077+0000", 2024-04-18T14:44:34.165 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 6.2586e-05 2024-04-18T14:44:34.166 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:34.166 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:34.166 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-04-18T14:44:34.166 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:11.766102+0000", 2024-04-18T14:44:34.166 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.5386999999999999e-05 2024-04-18T14:44:34.166 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:34.166 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:34.166 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-04-18T14:44:34.166 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:11.766251+0000", 2024-04-18T14:44:34.166 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00014814599999999999 2024-04-18T14:44:34.166 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:34.166 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:34.166 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_started", 2024-04-18T14:44:34.166 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:11.766280+0000", 2024-04-18T14:44:34.167 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.9221999999999999e-05 2024-04-18T14:44:34.167 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:34.167 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:34.167 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_committed", 2024-04-18T14:44:34.167 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:11.780420+0000", 2024-04-18T14:44:34.167 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.014139898999999999 2024-04-18T14:44:34.167 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:34.167 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:34.167 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-04-18T14:44:34.167 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:11.780472+0000", 2024-04-18T14:44:34.167 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 5.2292e-05 2024-04-18T14:44:34.168 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:44:34.168 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-04-18T14:44:34.168 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:44:34.168 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:34.168 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:34.168 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(client.4559.0:784 3.1s0 3:891e68bf:::smithi13430248-19:head [rmxattr NXqthRdcT\\nYpra`^tP]gObbPnlZajaS`pNaeWSW in=40b,rmxattr RZgqTbskOQTtb`TrapV[kpfRhdestNfNfmVZfoPg in=40b,rmxattr WhheaoZ]ebRkV[bm[dSXUZd]Tc`jlnThbOrlYaXa in=40b,rmxattr _Y]RsTQW\\Xhe^mYeUN\\piag]YmYRNN_ml\\^q]Off in=40b,rmxattr re\\k]Zg[a\\QtVPdN]XaroaNhkr]pNRiXgOnTUW`q in=40b,rmxattr titWXmhVR_fW]j[bb^q`obYVe[XP\\sTjkc^TOfnp in=40b] snapc 2b=[2b,2a,29,28,27,26,23,22,1e,1c,1a,16,14,13,11,2] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-18T14:44:34.168 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-04-18T14:44:15.395463+0000", 2024-04-18T14:44:34.168 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 18.724091893000001, 2024-04-18T14:44:34.168 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.021046380999999999, 2024-04-18T14:44:34.168 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-04-18T14:44:34.169 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T14:44:34.169 INFO:teuthology.orchestra.run.smithi119.stdout: "client_info": { 2024-04-18T14:44:34.169 INFO:teuthology.orchestra.run.smithi119.stdout: "client": "client.4559", 2024-04-18T14:44:34.169 INFO:teuthology.orchestra.run.smithi119.stdout: "client_addr": "172.21.15.134:0/3113589487", 2024-04-18T14:44:34.169 INFO:teuthology.orchestra.run.smithi119.stdout: "tid": 784 2024-04-18T14:44:34.169 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:34.169 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-04-18T14:44:34.169 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:34.169 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-04-18T14:44:34.169 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:15.395463+0000", 2024-04-18T14:44:34.169 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:44:34.169 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:34.169 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:34.169 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-04-18T14:44:34.170 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:15.395463+0000", 2024-04-18T14:44:34.170 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:44:34.170 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:34.170 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:34.170 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-04-18T14:44:34.170 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:15.395461+0000", 2024-04-18T14:44:34.170 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4294967295.9999976 2024-04-18T14:44:34.170 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:34.170 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:34.170 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-04-18T14:44:34.170 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:15.395480+0000", 2024-04-18T14:44:34.170 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.9660000000000002e-05 2024-04-18T14:44:34.170 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:34.171 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:34.171 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-04-18T14:44:34.171 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:15.395514+0000", 2024-04-18T14:44:34.171 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.4106000000000002e-05 2024-04-18T14:44:34.171 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:34.171 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:34.171 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-04-18T14:44:34.171 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:15.395541+0000", 2024-04-18T14:44:34.171 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.635e-05 2024-04-18T14:44:34.171 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:34.171 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:34.171 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-04-18T14:44:34.171 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:15.395706+0000", 2024-04-18T14:44:34.171 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00016543800000000001 2024-04-18T14:44:34.172 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:34.172 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:34.172 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "op must wait for map", 2024-04-18T14:44:34.172 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:15.395731+0000", 2024-04-18T14:44:34.172 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.5137e-05 2024-04-18T14:44:34.172 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:34.172 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:34.172 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-04-18T14:44:34.172 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:15.400744+0000", 2024-04-18T14:44:34.172 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.005012865 2024-04-18T14:44:34.172 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:34.172 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:34.172 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-04-18T14:44:34.173 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:15.401013+0000", 2024-04-18T14:44:34.173 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00026928400000000001 2024-04-18T14:44:34.173 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:34.173 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:34.173 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_started", 2024-04-18T14:44:34.173 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:15.402872+0000", 2024-04-18T14:44:34.173 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0018588190000000001 2024-04-18T14:44:34.173 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:34.173 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:34.173 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_committed", 2024-04-18T14:44:34.173 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:15.409124+0000", 2024-04-18T14:44:34.173 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0062519589999999996 2024-04-18T14:44:34.173 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:34.173 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:34.173 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-04-18T14:44:34.173 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:15.416400+0000", 2024-04-18T14:44:34.174 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0072758909999999996 2024-04-18T14:44:34.174 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:34.174 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:34.174 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-04-18T14:44:34.174 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:15.416510+0000", 2024-04-18T14:44:34.174 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000109372 2024-04-18T14:44:34.174 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:44:34.174 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-04-18T14:44:34.174 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:44:34.174 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:34.174 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:34.174 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(client.4559.0:829 3.1s0 3:8edef92b:::smithi13430248-24:head [copy-from ver 81] snapc 2c=[2c,2b,2a,29,28,27,26,23,22,1e,1c,1a,16,14,13,11,2] ondisk+write+known_if_redirected+supports_pool_eio e77)", 2024-04-18T14:44:34.174 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-04-18T14:44:16.418052+0000", 2024-04-18T14:44:34.175 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 17.701502852000001, 2024-04-18T14:44:34.175 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.053665807000000003, 2024-04-18T14:44:34.175 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-04-18T14:44:34.175 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T14:44:34.175 INFO:teuthology.orchestra.run.smithi119.stdout: "client_info": { 2024-04-18T14:44:34.175 INFO:teuthology.orchestra.run.smithi119.stdout: "client": "client.4559", 2024-04-18T14:44:34.175 INFO:teuthology.orchestra.run.smithi119.stdout: "client_addr": "172.21.15.134:0/3113589487", 2024-04-18T14:44:34.175 INFO:teuthology.orchestra.run.smithi119.stdout: "tid": 829 2024-04-18T14:44:34.175 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:34.175 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-04-18T14:44:34.175 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:34.175 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-04-18T14:44:34.175 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:16.418052+0000", 2024-04-18T14:44:34.175 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:44:34.175 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:34.176 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:34.176 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-04-18T14:44:34.176 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:16.418052+0000", 2024-04-18T14:44:34.176 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:44:34.176 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:34.176 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:34.176 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-04-18T14:44:34.176 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:16.418049+0000", 2024-04-18T14:44:34.176 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4294967295.9999971 2024-04-18T14:44:34.176 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:34.176 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:34.177 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-04-18T14:44:34.177 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:16.418066+0000", 2024-04-18T14:44:34.177 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.7079e-05 2024-04-18T14:44:34.177 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:34.177 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:34.177 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-04-18T14:44:34.177 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:16.418102+0000", 2024-04-18T14:44:34.177 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.5967000000000003e-05 2024-04-18T14:44:34.177 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:34.177 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:34.177 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-04-18T14:44:34.177 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:16.418123+0000", 2024-04-18T14:44:34.177 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.0343000000000002e-05 2024-04-18T14:44:34.178 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:34.178 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:34.178 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-04-18T14:44:34.178 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:16.418250+0000", 2024-04-18T14:44:34.178 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00012688599999999999 2024-04-18T14:44:34.178 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:34.178 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:34.179 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "op must wait for map", 2024-04-18T14:44:34.179 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:16.418266+0000", 2024-04-18T14:44:34.179 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.6237000000000001e-05 2024-04-18T14:44:34.179 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:34.179 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:34.179 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-04-18T14:44:34.179 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:16.423970+0000", 2024-04-18T14:44:34.179 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0057040789999999999 2024-04-18T14:44:34.179 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:34.179 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:34.179 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-04-18T14:44:34.179 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:16.424220+0000", 2024-04-18T14:44:34.179 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00025055500000000002 2024-04-18T14:44:34.180 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:34.180 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:34.180 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_started", 2024-04-18T14:44:34.180 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:16.462776+0000", 2024-04-18T14:44:34.180 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.038556020000000003 2024-04-18T14:44:34.180 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:34.180 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:34.180 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_committed", 2024-04-18T14:44:34.180 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:16.466730+0000", 2024-04-18T14:44:34.180 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0039531940000000002 2024-04-18T14:44:34.180 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:34.180 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:34.181 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-04-18T14:44:34.181 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:16.471627+0000", 2024-04-18T14:44:34.181 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0048974200000000004 2024-04-18T14:44:34.181 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:34.181 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:34.181 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-04-18T14:44:34.181 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:16.471718+0000", 2024-04-18T14:44:34.181 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 9.0983000000000006e-05 2024-04-18T14:44:34.181 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:44:34.181 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-04-18T14:44:34.181 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:44:34.181 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:34.181 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:34.181 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(client.4559.0:830 3.1s0 3:8edef92b:::smithi13430248-24:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e77)", 2024-04-18T14:44:34.182 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-04-18T14:44:16.418143+0000", 2024-04-18T14:44:34.182 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 17.701412502, 2024-04-18T14:44:34.182 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.048579178000000001, 2024-04-18T14:44:34.182 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-04-18T14:44:34.182 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "started", 2024-04-18T14:44:34.182 INFO:teuthology.orchestra.run.smithi119.stdout: "client_info": { 2024-04-18T14:44:34.182 INFO:teuthology.orchestra.run.smithi119.stdout: "client": "client.4559", 2024-04-18T14:44:34.182 INFO:teuthology.orchestra.run.smithi119.stdout: "client_addr": "172.21.15.134:0/3113589487", 2024-04-18T14:44:34.182 INFO:teuthology.orchestra.run.smithi119.stdout: "tid": 830 2024-04-18T14:44:34.182 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:34.182 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-04-18T14:44:34.182 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:34.182 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-04-18T14:44:34.183 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:16.418143+0000", 2024-04-18T14:44:34.183 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:44:34.183 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:34.183 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:34.183 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-04-18T14:44:34.183 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:16.418143+0000", 2024-04-18T14:44:34.183 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:44:34.183 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:34.183 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:34.183 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-04-18T14:44:34.183 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:16.418141+0000", 2024-04-18T14:44:34.184 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4294967295.9999986 2024-04-18T14:44:34.184 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:34.184 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:34.184 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-04-18T14:44:34.184 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:16.418148+0000", 2024-04-18T14:44:34.184 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 6.9770000000000003e-06 2024-04-18T14:44:34.184 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:34.184 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:34.184 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-04-18T14:44:34.184 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:16.418168+0000", 2024-04-18T14:44:34.184 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.9303000000000001e-05 2024-04-18T14:44:34.184 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:34.184 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:34.184 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-04-18T14:44:34.184 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:16.418182+0000", 2024-04-18T14:44:34.185 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.4266e-05 2024-04-18T14:44:34.185 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:34.185 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:34.185 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-04-18T14:44:34.185 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:16.418380+0000", 2024-04-18T14:44:34.185 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00019845900000000001 2024-04-18T14:44:34.185 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:34.185 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:34.185 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting_for_map not empty", 2024-04-18T14:44:34.185 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:16.418396+0000", 2024-04-18T14:44:34.185 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.6047000000000001e-05 2024-04-18T14:44:34.185 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:34.185 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:34.185 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-04-18T14:44:34.185 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:16.424577+0000", 2024-04-18T14:44:34.186 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0061809819999999998 2024-04-18T14:44:34.186 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:34.186 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:34.186 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for blocked object", 2024-04-18T14:44:34.186 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:16.424694+0000", 2024-04-18T14:44:34.186 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000116669 2024-04-18T14:44:34.186 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:34.186 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:34.186 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-04-18T14:44:34.186 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:16.466297+0000", 2024-04-18T14:44:34.186 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.041603382000000001 2024-04-18T14:44:34.186 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:34.186 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:34.186 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-04-18T14:44:34.187 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:16.466508+0000", 2024-04-18T14:44:34.187 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00021091099999999999 2024-04-18T14:44:34.187 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:34.187 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:34.187 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-04-18T14:44:34.187 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:16.466722+0000", 2024-04-18T14:44:34.187 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000213489 2024-04-18T14:44:34.187 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:44:34.187 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-04-18T14:44:34.187 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:44:34.187 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:34.187 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:34.187 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "MOSDECSubOpWrite(3.5s1 78/30 ECSubWrite(tid=41, reqid=osd.15.0:40, at_version=0'0, trim_to=0'0, roll_forward_to=78'34))", 2024-04-18T14:44:34.187 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-04-18T14:44:17.432878+0000", 2024-04-18T14:44:34.188 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 16.686677475, 2024-04-18T14:44:34.188 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.017425369, 2024-04-18T14:44:34.188 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-04-18T14:44:34.188 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "reached pg", 2024-04-18T14:44:34.188 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-04-18T14:44:34.188 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:34.188 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-04-18T14:44:34.188 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:17.432878+0000", 2024-04-18T14:44:34.188 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:44:34.188 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:34.189 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:34.189 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-04-18T14:44:34.189 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:17.432878+0000", 2024-04-18T14:44:34.189 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:44:34.189 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:34.189 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:34.189 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-04-18T14:44:34.189 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:17.432876+0000", 2024-04-18T14:44:34.189 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4294967295.9999981 2024-04-18T14:44:34.189 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:34.189 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:34.190 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-04-18T14:44:34.190 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:17.432905+0000", 2024-04-18T14:44:34.190 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.9606000000000001e-05 2024-04-18T14:44:34.190 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:34.190 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:34.190 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-04-18T14:44:34.190 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:17.432973+0000", 2024-04-18T14:44:34.190 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 6.8182999999999994e-05 2024-04-18T14:44:34.190 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:34.190 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:34.190 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-04-18T14:44:34.191 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:17.432997+0000", 2024-04-18T14:44:34.191 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.3652999999999999e-05 2024-04-18T14:44:34.191 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:34.191 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:34.191 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-04-18T14:44:34.191 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:17.433145+0000", 2024-04-18T14:44:34.191 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000147553 2024-04-18T14:44:34.191 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:34.191 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:34.191 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_started", 2024-04-18T14:44:34.191 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:17.433169+0000", 2024-04-18T14:44:34.191 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.4502999999999999e-05 2024-04-18T14:44:34.191 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:34.191 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:34.192 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_committed", 2024-04-18T14:44:34.192 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:17.450245+0000", 2024-04-18T14:44:34.192 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.017075705 2024-04-18T14:44:34.192 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:34.192 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:34.192 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-04-18T14:44:34.192 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:17.450303+0000", 2024-04-18T14:44:34.192 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 5.8192999999999997e-05 2024-04-18T14:44:34.192 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:44:34.193 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-04-18T14:44:34.193 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:44:34.193 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:34.193 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:34.193 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "MOSDECSubOpWrite(3.ds6 78/30 ECSubWrite(tid=55, reqid=osd.7.0:55, at_version=78'51, trim_to=0'0, roll_forward_to=77'47))", 2024-04-18T14:44:34.193 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-04-18T14:44:17.435783+0000", 2024-04-18T14:44:34.193 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 16.683771868000001, 2024-04-18T14:44:34.193 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.019364541999999998, 2024-04-18T14:44:34.193 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-04-18T14:44:34.193 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "reached pg", 2024-04-18T14:44:34.193 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-04-18T14:44:34.193 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:34.193 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-04-18T14:44:34.193 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:17.435783+0000", 2024-04-18T14:44:34.193 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:44:34.194 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:34.194 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:34.194 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-04-18T14:44:34.194 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:17.435783+0000", 2024-04-18T14:44:34.194 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:44:34.194 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:34.194 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:34.194 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-04-18T14:44:34.194 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:17.435782+0000", 2024-04-18T14:44:34.195 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4294967295.9999986 2024-04-18T14:44:34.195 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:34.195 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:34.195 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-04-18T14:44:34.195 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:17.435838+0000", 2024-04-18T14:44:34.195 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 5.5553999999999997e-05 2024-04-18T14:44:34.195 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:34.195 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:34.196 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-04-18T14:44:34.196 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:17.435862+0000", 2024-04-18T14:44:34.196 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.4882999999999999e-05 2024-04-18T14:44:34.196 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:34.196 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:34.196 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-04-18T14:44:34.196 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:17.435882+0000", 2024-04-18T14:44:34.196 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.9949000000000002e-05 2024-04-18T14:44:34.196 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:34.196 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:34.196 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-04-18T14:44:34.196 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:17.447337+0000", 2024-04-18T14:44:34.196 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.011454489999999999 2024-04-18T14:44:34.197 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:34.197 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:34.197 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_started", 2024-04-18T14:44:34.197 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:17.447359+0000", 2024-04-18T14:44:34.197 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.2048999999999998e-05 2024-04-18T14:44:34.197 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:34.197 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:34.197 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_committed", 2024-04-18T14:44:34.197 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:17.455089+0000", 2024-04-18T14:44:34.197 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.007730247 2024-04-18T14:44:34.197 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:34.197 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:34.197 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-04-18T14:44:34.198 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:17.455148+0000", 2024-04-18T14:44:34.198 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 5.8573999999999999e-05 2024-04-18T14:44:34.198 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:44:34.198 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-04-18T14:44:34.198 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:44:34.198 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:34.198 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:34.198 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "MOSDECSubOpWrite(3.6s4 78/70 ECSubWrite(tid=279, reqid=osd.14.0:279, at_version=78'115, trim_to=0'0, roll_forward_to=77'111))", 2024-04-18T14:44:34.198 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-04-18T14:44:17.438052+0000", 2024-04-18T14:44:34.198 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 16.681503155000001, 2024-04-18T14:44:34.198 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.016876472999999999, 2024-04-18T14:44:34.199 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-04-18T14:44:34.199 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "reached pg", 2024-04-18T14:44:34.199 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-04-18T14:44:34.199 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:34.199 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-04-18T14:44:34.199 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:17.438052+0000", 2024-04-18T14:44:34.199 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:44:34.199 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:34.199 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:34.199 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-04-18T14:44:34.199 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:17.438052+0000", 2024-04-18T14:44:34.199 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:44:34.199 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:34.199 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:34.200 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-04-18T14:44:34.200 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:17.438051+0000", 2024-04-18T14:44:34.200 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4294967295.999999 2024-04-18T14:44:34.200 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:34.200 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:34.200 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-04-18T14:44:34.200 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:17.438109+0000", 2024-04-18T14:44:34.200 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 5.7822000000000003e-05 2024-04-18T14:44:34.200 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:34.200 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:34.200 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-04-18T14:44:34.200 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:17.438134+0000", 2024-04-18T14:44:34.200 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.5086999999999999e-05 2024-04-18T14:44:34.201 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:34.201 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:34.201 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-04-18T14:44:34.201 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:17.438158+0000", 2024-04-18T14:44:34.201 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.423e-05 2024-04-18T14:44:34.201 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:34.201 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:34.201 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-04-18T14:44:34.201 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:17.444361+0000", 2024-04-18T14:44:34.201 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0062027649999999998 2024-04-18T14:44:34.201 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:34.201 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:34.201 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_started", 2024-04-18T14:44:34.201 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:17.444389+0000", 2024-04-18T14:44:34.201 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.8653000000000002e-05 2024-04-18T14:44:34.202 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:34.202 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:34.202 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_committed", 2024-04-18T14:44:34.202 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:17.454856+0000", 2024-04-18T14:44:34.202 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.010466667000000001 2024-04-18T14:44:34.202 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:34.202 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:34.202 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-04-18T14:44:34.202 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:17.454928+0000", 2024-04-18T14:44:34.202 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 7.2348999999999995e-05 2024-04-18T14:44:34.202 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:44:34.202 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-04-18T14:44:34.202 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:44:34.202 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:34.202 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:34.203 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "MOSDECSubOpWrite(3.9s6 78/73 ECSubWrite(tid=196, reqid=osd.12.0:196, at_version=78'137, trim_to=0'0, roll_forward_to=76'135))", 2024-04-18T14:44:34.203 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-04-18T14:44:17.439758+0000", 2024-04-18T14:44:34.203 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 16.679796847999999, 2024-04-18T14:44:34.203 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.021813842, 2024-04-18T14:44:34.203 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-04-18T14:44:34.203 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "reached pg", 2024-04-18T14:44:34.203 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-04-18T14:44:34.204 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:34.204 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-04-18T14:44:34.204 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:17.439758+0000", 2024-04-18T14:44:34.204 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:44:34.204 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:34.204 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:34.204 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-04-18T14:44:34.204 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:17.439758+0000", 2024-04-18T14:44:34.204 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:44:34.204 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:34.204 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:34.204 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-04-18T14:44:34.204 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:17.439757+0000", 2024-04-18T14:44:34.204 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4294967295.999999 2024-04-18T14:44:34.204 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:34.204 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:34.205 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-04-18T14:44:34.205 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:17.439809+0000", 2024-04-18T14:44:34.205 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 5.1802999999999999e-05 2024-04-18T14:44:34.205 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:34.205 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:34.205 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-04-18T14:44:34.205 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:17.441594+0000", 2024-04-18T14:44:34.205 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0017843830000000001 2024-04-18T14:44:34.205 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:34.205 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:34.205 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-04-18T14:44:34.205 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:17.443883+0000", 2024-04-18T14:44:34.205 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0022896259999999999 2024-04-18T14:44:34.205 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:34.205 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:34.206 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-04-18T14:44:34.206 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:17.444024+0000", 2024-04-18T14:44:34.206 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00014086200000000001 2024-04-18T14:44:34.206 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:34.206 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:34.206 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_started", 2024-04-18T14:44:34.206 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:17.444049+0000", 2024-04-18T14:44:34.206 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.4479999999999999e-05 2024-04-18T14:44:34.206 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:34.206 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:34.206 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_committed", 2024-04-18T14:44:34.206 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:17.461512+0000", 2024-04-18T14:44:34.206 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.017463869 2024-04-18T14:44:34.207 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:34.207 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:34.207 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-04-18T14:44:34.207 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:17.461572+0000", 2024-04-18T14:44:34.207 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 5.9653e-05 2024-04-18T14:44:34.207 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:44:34.207 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-04-18T14:44:34.207 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:44:34.207 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:34.207 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:34.207 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "MOSDECSubOpWrite(3.9s6 78/73 ECSubWrite(tid=197, reqid=osd.12.0:197, at_version=78'139, trim_to=0'0, roll_forward_to=76'135))", 2024-04-18T14:44:34.207 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-04-18T14:44:17.446248+0000", 2024-04-18T14:44:34.207 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 16.673306615000001, 2024-04-18T14:44:34.208 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.029710947000000001, 2024-04-18T14:44:34.208 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-04-18T14:44:34.208 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "reached pg", 2024-04-18T14:44:34.208 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-04-18T14:44:34.208 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:34.208 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-04-18T14:44:34.208 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:17.446248+0000", 2024-04-18T14:44:34.209 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:44:34.209 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:34.209 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:34.209 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-04-18T14:44:34.209 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:17.446248+0000", 2024-04-18T14:44:34.209 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:44:34.210 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:34.210 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:34.210 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-04-18T14:44:34.210 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:17.446247+0000", 2024-04-18T14:44:34.210 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4294967295.9999986 2024-04-18T14:44:34.210 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:34.210 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:34.210 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-04-18T14:44:34.211 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:17.446298+0000", 2024-04-18T14:44:34.211 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 5.1393000000000001e-05 2024-04-18T14:44:34.211 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:34.211 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:34.211 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-04-18T14:44:34.211 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:17.446332+0000", 2024-04-18T14:44:34.211 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.3735999999999997e-05 2024-04-18T14:44:34.211 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:34.211 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:34.211 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-04-18T14:44:34.211 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:17.446355+0000", 2024-04-18T14:44:34.211 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.2900000000000001e-05 2024-04-18T14:44:34.211 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:34.211 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:34.212 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-04-18T14:44:34.212 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:17.453739+0000", 2024-04-18T14:44:34.212 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0073842400000000002 2024-04-18T14:44:34.212 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:34.212 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:34.212 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_started", 2024-04-18T14:44:34.212 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:17.453761+0000", 2024-04-18T14:44:34.213 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.1593000000000001e-05 2024-04-18T14:44:34.213 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:34.213 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:34.213 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_committed", 2024-04-18T14:44:34.213 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:17.475913+0000", 2024-04-18T14:44:34.213 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.02215286 2024-04-18T14:44:34.213 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:34.213 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:34.213 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-04-18T14:44:34.213 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:17.475959+0000", 2024-04-18T14:44:34.213 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4.5884999999999999e-05 2024-04-18T14:44:34.213 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:44:34.213 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-04-18T14:44:34.214 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:44:34.214 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:34.214 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:34.214 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "MOSDECSubOpWrite(3.6s4 82/70 ECSubWrite(tid=321, reqid=osd.14.0:321, at_version=82'142, trim_to=0'0, roll_forward_to=81'138))", 2024-04-18T14:44:34.214 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-04-18T14:44:21.477877+0000", 2024-04-18T14:44:34.214 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 12.641677761, 2024-04-18T14:44:34.214 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.019971691, 2024-04-18T14:44:34.214 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-04-18T14:44:34.214 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "reached pg", 2024-04-18T14:44:34.215 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-04-18T14:44:34.215 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:34.215 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-04-18T14:44:34.215 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:21.477877+0000", 2024-04-18T14:44:34.215 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:44:34.215 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:34.215 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:34.215 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-04-18T14:44:34.215 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:21.477877+0000", 2024-04-18T14:44:34.215 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:44:34.215 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:34.215 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:34.215 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-04-18T14:44:34.215 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:21.477876+0000", 2024-04-18T14:44:34.215 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4294967295.9999981 2024-04-18T14:44:34.216 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:34.216 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:34.216 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-04-18T14:44:34.216 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:21.477969+0000", 2024-04-18T14:44:34.216 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 9.3295999999999996e-05 2024-04-18T14:44:34.216 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:34.216 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:34.216 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-04-18T14:44:34.216 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:21.479499+0000", 2024-04-18T14:44:34.216 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.001530235 2024-04-18T14:44:34.216 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:34.216 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:34.216 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-04-18T14:44:34.217 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:21.479524+0000", 2024-04-18T14:44:34.217 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.5202999999999999e-05 2024-04-18T14:44:34.217 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:34.217 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:34.217 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-04-18T14:44:34.217 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:21.479661+0000", 2024-04-18T14:44:34.217 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000136336 2024-04-18T14:44:34.217 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:34.217 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:34.217 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_started", 2024-04-18T14:44:34.217 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:21.479689+0000", 2024-04-18T14:44:34.217 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.8670000000000002e-05 2024-04-18T14:44:34.217 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:34.217 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:34.217 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_committed", 2024-04-18T14:44:34.218 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:21.497787+0000", 2024-04-18T14:44:34.218 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.018097641000000001 2024-04-18T14:44:34.218 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:34.218 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:34.218 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-04-18T14:44:34.218 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:21.497849+0000", 2024-04-18T14:44:34.218 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 6.2056000000000004e-05 2024-04-18T14:44:34.218 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:44:34.218 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-04-18T14:44:34.218 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:44:34.218 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:34.218 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:34.219 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "MOSDECSubOpWrite(3.cs6 82/30 ECSubWrite(tid=253, reqid=osd.11.0:253, at_version=82'174, trim_to=0'0, roll_forward_to=80'170))", 2024-04-18T14:44:34.219 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-04-18T14:44:21.480257+0000", 2024-04-18T14:44:34.219 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 12.639298291999999, 2024-04-18T14:44:34.219 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.017787084000000002, 2024-04-18T14:44:34.219 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-04-18T14:44:34.219 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "reached pg", 2024-04-18T14:44:34.219 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-04-18T14:44:34.219 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:34.219 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-04-18T14:44:34.219 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:21.480257+0000", 2024-04-18T14:44:34.219 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:44:34.219 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:34.219 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:34.219 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-04-18T14:44:34.220 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:21.480257+0000", 2024-04-18T14:44:34.220 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:44:34.220 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:34.220 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:34.220 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-04-18T14:44:34.220 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:21.480256+0000", 2024-04-18T14:44:34.220 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4294967295.999999 2024-04-18T14:44:34.220 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:34.220 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:34.221 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-04-18T14:44:34.221 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:21.480312+0000", 2024-04-18T14:44:34.221 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 5.6446000000000001e-05 2024-04-18T14:44:34.221 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:34.221 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:34.221 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-04-18T14:44:34.221 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:21.480336+0000", 2024-04-18T14:44:34.221 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.4394000000000001e-05 2024-04-18T14:44:34.221 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:34.221 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:34.221 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-04-18T14:44:34.221 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:21.480356+0000", 2024-04-18T14:44:34.222 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.0003000000000001e-05 2024-04-18T14:44:34.222 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:34.222 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:34.222 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-04-18T14:44:34.222 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:21.484298+0000", 2024-04-18T14:44:34.222 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0039411790000000004 2024-04-18T14:44:34.222 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:34.222 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:34.222 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_started", 2024-04-18T14:44:34.222 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:21.484322+0000", 2024-04-18T14:44:34.222 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.4773000000000002e-05 2024-04-18T14:44:34.222 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:34.222 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:34.223 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_committed", 2024-04-18T14:44:34.223 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:21.497997+0000", 2024-04-18T14:44:34.223 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.013675015 2024-04-18T14:44:34.223 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:34.223 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:34.223 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-04-18T14:44:34.223 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:21.498044+0000", 2024-04-18T14:44:34.223 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4.6397000000000003e-05 2024-04-18T14:44:34.223 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:44:34.223 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-04-18T14:44:34.223 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:44:34.223 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:34.223 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:34.223 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "MOSDECSubOpWrite(3.9s6 82/73 ECSubWrite(tid=222, reqid=osd.12.0:221, at_version=0'0, trim_to=0'0, roll_forward_to=82'169))", 2024-04-18T14:44:34.224 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-04-18T14:44:21.482905+0000", 2024-04-18T14:44:34.224 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 12.636649835, 2024-04-18T14:44:34.224 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.019024836999999999, 2024-04-18T14:44:34.224 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-04-18T14:44:34.224 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "reached pg", 2024-04-18T14:44:34.224 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-04-18T14:44:34.224 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:34.224 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-04-18T14:44:34.225 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:21.482905+0000", 2024-04-18T14:44:34.225 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:44:34.225 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:34.225 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:34.225 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-04-18T14:44:34.225 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:21.482905+0000", 2024-04-18T14:44:34.226 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:44:34.226 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:34.226 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:34.226 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-04-18T14:44:34.226 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:21.482903+0000", 2024-04-18T14:44:34.226 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4294967295.9999981 2024-04-18T14:44:34.227 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:34.227 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:34.227 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-04-18T14:44:34.227 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:21.482932+0000", 2024-04-18T14:44:34.227 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.9130000000000001e-05 2024-04-18T14:44:34.227 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:34.228 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:34.228 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-04-18T14:44:34.228 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:21.482968+0000", 2024-04-18T14:44:34.228 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.5948999999999998e-05 2024-04-18T14:44:34.228 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:34.228 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:34.229 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-04-18T14:44:34.229 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:21.483015+0000", 2024-04-18T14:44:34.229 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4.6230000000000003e-05 2024-04-18T14:44:34.229 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:34.229 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:34.229 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-04-18T14:44:34.230 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:21.483213+0000", 2024-04-18T14:44:34.230 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00019806199999999999 2024-04-18T14:44:34.230 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:34.230 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:34.230 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_started", 2024-04-18T14:44:34.230 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:21.483237+0000", 2024-04-18T14:44:34.231 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.4613e-05 2024-04-18T14:44:34.231 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:34.231 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:34.231 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_committed", 2024-04-18T14:44:34.231 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:21.501866+0000", 2024-04-18T14:44:34.231 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.018628563000000001 2024-04-18T14:44:34.232 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:34.232 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:34.232 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-04-18T14:44:34.232 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:21.501930+0000", 2024-04-18T14:44:34.232 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 6.4157000000000003e-05 2024-04-18T14:44:34.233 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:44:34.233 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-04-18T14:44:34.233 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:44:34.233 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:34.233 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:34.233 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "MOSDECSubOpWrite(3.9s6 82/73 ECSubWrite(tid=223, reqid=osd.12.0:223, at_version=82'171, trim_to=0'0, roll_forward_to=82'169))", 2024-04-18T14:44:34.234 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-04-18T14:44:21.486232+0000", 2024-04-18T14:44:34.234 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 12.633322935000001, 2024-04-18T14:44:34.234 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.017914118999999999, 2024-04-18T14:44:34.234 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-04-18T14:44:34.234 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "reached pg", 2024-04-18T14:44:34.234 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-04-18T14:44:34.235 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:34.235 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-04-18T14:44:34.235 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:21.486232+0000", 2024-04-18T14:44:34.235 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:44:34.235 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:34.235 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:34.236 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-04-18T14:44:34.236 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:21.486232+0000", 2024-04-18T14:44:34.236 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:44:34.236 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:34.236 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:34.236 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-04-18T14:44:34.237 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:21.486231+0000", 2024-04-18T14:44:34.237 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4294967295.999999 2024-04-18T14:44:34.237 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:34.237 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:34.237 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-04-18T14:44:34.237 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:21.486278+0000", 2024-04-18T14:44:34.238 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4.7197000000000002e-05 2024-04-18T14:44:34.238 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:34.238 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:34.238 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-04-18T14:44:34.238 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:21.486303+0000", 2024-04-18T14:44:34.238 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.5303000000000002e-05 2024-04-18T14:44:34.238 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:34.238 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:34.238 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-04-18T14:44:34.238 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:21.486330+0000", 2024-04-18T14:44:34.238 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.6196000000000001e-05 2024-04-18T14:44:34.238 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:34.238 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:34.239 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-04-18T14:44:34.239 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:21.494309+0000", 2024-04-18T14:44:34.239 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0079798089999999992 2024-04-18T14:44:34.239 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:34.239 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:34.239 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_started", 2024-04-18T14:44:34.239 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:21.494332+0000", 2024-04-18T14:44:34.239 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.2629999999999998e-05 2024-04-18T14:44:34.239 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:34.239 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:34.239 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_committed", 2024-04-18T14:44:34.239 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:21.504102+0000", 2024-04-18T14:44:34.239 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0097698339999999998 2024-04-18T14:44:34.239 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:34.240 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:34.240 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-04-18T14:44:34.240 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:21.504146+0000", 2024-04-18T14:44:34.240 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4.4310000000000001e-05 2024-04-18T14:44:34.240 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:44:34.240 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-04-18T14:44:34.240 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:44:34.240 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:34.240 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:34.240 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "MOSDECSubOpWrite(3.9s6 82/73 ECSubWrite(tid=224, reqid=osd.12.0:224, at_version=82'173, trim_to=0'0, roll_forward_to=82'169))", 2024-04-18T14:44:34.240 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-04-18T14:44:21.488203+0000", 2024-04-18T14:44:34.240 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 12.631352039999999, 2024-04-18T14:44:34.240 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.017473570000000001, 2024-04-18T14:44:34.241 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-04-18T14:44:34.241 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "reached pg", 2024-04-18T14:44:34.241 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-04-18T14:44:34.241 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:34.241 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-04-18T14:44:34.241 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:21.488203+0000", 2024-04-18T14:44:34.241 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:44:34.241 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:34.241 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:34.241 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-04-18T14:44:34.241 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:21.488203+0000", 2024-04-18T14:44:34.241 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:44:34.241 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:34.241 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:34.241 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-04-18T14:44:34.242 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:21.488201+0000", 2024-04-18T14:44:34.242 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4294967295.9999986 2024-04-18T14:44:34.242 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:34.242 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:34.242 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-04-18T14:44:34.242 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:21.488254+0000", 2024-04-18T14:44:34.242 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 5.2136999999999999e-05 2024-04-18T14:44:34.242 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:34.242 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:34.242 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-04-18T14:44:34.242 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:21.488285+0000", 2024-04-18T14:44:34.242 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.1377000000000001e-05 2024-04-18T14:44:34.242 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:34.243 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:34.243 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-04-18T14:44:34.243 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:21.488307+0000", 2024-04-18T14:44:34.243 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.1729000000000002e-05 2024-04-18T14:44:34.243 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:34.243 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:34.243 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-04-18T14:44:34.243 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:21.497459+0000", 2024-04-18T14:44:34.244 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0091518529999999997 2024-04-18T14:44:34.244 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:34.244 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:34.244 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_started", 2024-04-18T14:44:34.244 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:21.497485+0000", 2024-04-18T14:44:34.244 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.6506999999999999e-05 2024-04-18T14:44:34.244 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:34.245 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:34.245 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_committed", 2024-04-18T14:44:34.245 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:21.505629+0000", 2024-04-18T14:44:34.245 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0081435970000000007 2024-04-18T14:44:34.245 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:34.245 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:34.245 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-04-18T14:44:34.245 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:21.505677+0000", 2024-04-18T14:44:34.245 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4.795e-05 2024-04-18T14:44:34.246 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:44:34.246 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-04-18T14:44:34.246 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:44:34.246 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:44:34.246 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-04-18T14:44:34.246 INFO:teuthology.orchestra.run.smithi119.stdout:} 2024-04-18T14:44:34.247 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.10.asok dump_ops_in_flight 2024-04-18T14:44:34.375 INFO:teuthology.orchestra.run.smithi119.stdout:{ 2024-04-18T14:44:34.375 INFO:teuthology.orchestra.run.smithi119.stdout: "ops": [], 2024-04-18T14:44:34.375 INFO:teuthology.orchestra.run.smithi119.stdout: "num_ops": 0 2024-04-18T14:44:34.376 INFO:teuthology.orchestra.run.smithi119.stdout:} 2024-04-18T14:44:34.389 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.10.asok dump_blocked_ops 2024-04-18T14:44:34.404 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'mon.*' injectargs --mon_osd_down_out_interval=600 2024-04-18T14:44:34.511 INFO:teuthology.orchestra.run.smithi119.stdout:{ 2024-04-18T14:44:34.511 INFO:teuthology.orchestra.run.smithi119.stdout: "ops": [], 2024-04-18T14:44:34.511 INFO:teuthology.orchestra.run.smithi119.stdout: "complaint_time": 30, 2024-04-18T14:44:34.511 INFO:teuthology.orchestra.run.smithi119.stdout: "num_blocked_ops": 0 2024-04-18T14:44:34.512 INFO:teuthology.orchestra.run.smithi119.stdout:} 2024-04-18T14:44:34.525 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.10.asok dump_historic_ops 2024-04-18T14:44:34.541 INFO:teuthology.orchestra.run.smithi086.stderr:nodeep-scrub is unset 2024-04-18T14:44:34.553 INFO:teuthology.orchestra.run.smithi086.stdout:mon.a: {} 2024-04-18T14:44:34.554 INFO:teuthology.orchestra.run.smithi086.stderr:mon.a: mon_osd_down_out_interval = '' (not observed, change may require restart) 2024-04-18T14:44:34.569 INFO:teuthology.orchestra.run.smithi086.stdout:mon.b: {} 2024-04-18T14:44:34.569 INFO:teuthology.orchestra.run.smithi086.stderr:mon.b: mon_osd_down_out_interval = '' (not observed, change may require restart) 2024-04-18T14:44:34.580 INFO:teuthology.orchestra.run.smithi086.stdout:mon.c: {} 2024-04-18T14:44:34.581 INFO:teuthology.orchestra.run.smithi086.stderr:mon.c: mon_osd_down_out_interval = '' (not observed, change may require restart) 2024-04-18T14:44:34.596 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 0 1 2024-04-18T14:44:34.652 INFO:teuthology.orchestra.run.smithi119.stdout:{ 2024-04-18T14:44:34.652 INFO:teuthology.orchestra.run.smithi119.stdout: "size": 20, 2024-04-18T14:44:34.652 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 600, 2024-04-18T14:44:34.652 INFO:teuthology.orchestra.run.smithi119.stdout: "ops": [ 2024-04-18T14:44:34.652 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:34.653 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(client.4559.0:500 3.bs0 3:dcadfff4:::smithi13430248-18:head [copy-from ver 46] snapc 19=[19,16,14,13,11,f,b,a,7,2] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-18T14:44:34.653 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-04-18T14:43:56.549171+0000", 2024-04-18T14:44:34.653 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 38.104627434000001, 2024-04-18T14:44:34.653 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.029487076000000001, 2024-04-18T14:44:34.653 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-04-18T14:44:34.653 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T14:44:34.653 INFO:teuthology.orchestra.run.smithi119.stdout: "client_info": { 2024-04-18T14:44:34.654 INFO:teuthology.orchestra.run.smithi119.stdout: "client": "client.4559", 2024-04-18T14:44:34.654 INFO:teuthology.orchestra.run.smithi119.stdout: "client_addr": "172.21.15.134:0/3113589487", 2024-04-18T14:44:34.654 INFO:teuthology.orchestra.run.smithi119.stdout: "tid": 500 2024-04-18T14:44:34.654 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:34.654 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-04-18T14:44:34.654 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:34.654 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-04-18T14:44:34.654 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:56.549171+0000", 2024-04-18T14:44:34.654 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:44:34.654 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:34.654 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:34.654 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-04-18T14:44:34.655 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:56.549171+0000", 2024-04-18T14:44:34.655 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:44:34.655 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:34.655 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:34.655 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-04-18T14:44:34.655 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:56.549165+0000", 2024-04-18T14:44:34.656 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4294967295.9999948 2024-04-18T14:44:34.656 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:34.656 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:34.656 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-04-18T14:44:34.656 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:56.549189+0000", 2024-04-18T14:44:34.656 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.3450000000000001e-05 2024-04-18T14:44:34.656 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:34.656 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:34.656 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-04-18T14:44:34.656 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:56.549237+0000", 2024-04-18T14:44:34.656 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4.7843999999999998e-05 2024-04-18T14:44:34.656 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:34.656 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:34.657 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-04-18T14:44:34.657 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:56.549262+0000", 2024-04-18T14:44:34.657 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.5596999999999999e-05 2024-04-18T14:44:34.657 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:34.657 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:34.657 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-04-18T14:44:34.657 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:56.549423+0000", 2024-04-18T14:44:34.657 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00016087799999999999 2024-04-18T14:44:34.657 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:34.657 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:34.657 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-04-18T14:44:34.657 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:56.549715+0000", 2024-04-18T14:44:34.657 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00029231599999999998 2024-04-18T14:44:34.657 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:34.657 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:34.657 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_started", 2024-04-18T14:44:34.658 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:56.571279+0000", 2024-04-18T14:44:34.658 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.021564102000000002 2024-04-18T14:44:34.658 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:34.658 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:34.658 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_committed", 2024-04-18T14:44:34.658 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:56.575627+0000", 2024-04-18T14:44:34.658 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0043473380000000001 2024-04-18T14:44:34.658 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:34.658 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:34.658 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-04-18T14:44:34.658 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:56.578450+0000", 2024-04-18T14:44:34.658 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0028231189999999998 2024-04-18T14:44:34.658 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:34.658 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:34.659 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-04-18T14:44:34.659 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:56.578658+0000", 2024-04-18T14:44:34.659 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000207715 2024-04-18T14:44:34.659 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:44:34.659 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-04-18T14:44:34.659 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:44:34.659 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:34.659 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:34.659 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(client.4559.0:501 3.bs0 3:dcadfff4:::smithi13430248-18:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e57)", 2024-04-18T14:44:34.659 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-04-18T14:43:56.549295+0000", 2024-04-18T14:44:34.659 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 38.104503280000003, 2024-04-18T14:44:34.659 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.025687614000000001, 2024-04-18T14:44:34.659 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-04-18T14:44:34.659 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "started", 2024-04-18T14:44:34.659 INFO:teuthology.orchestra.run.smithi119.stdout: "client_info": { 2024-04-18T14:44:34.660 INFO:teuthology.orchestra.run.smithi119.stdout: "client": "client.4559", 2024-04-18T14:44:34.660 INFO:teuthology.orchestra.run.smithi119.stdout: "client_addr": "172.21.15.134:0/3113589487", 2024-04-18T14:44:34.660 INFO:teuthology.orchestra.run.smithi119.stdout: "tid": 501 2024-04-18T14:44:34.660 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:34.660 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-04-18T14:44:34.660 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:34.660 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-04-18T14:44:34.660 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:56.549295+0000", 2024-04-18T14:44:34.660 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:44:34.660 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:34.660 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:34.660 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-04-18T14:44:34.660 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:56.549295+0000", 2024-04-18T14:44:34.660 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:44:34.661 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:34.661 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:34.661 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-04-18T14:44:34.661 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:56.549293+0000", 2024-04-18T14:44:34.661 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4294967295.9999981 2024-04-18T14:44:34.661 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:34.661 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:34.661 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-04-18T14:44:34.661 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:56.549304+0000", 2024-04-18T14:44:34.661 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.1324e-05 2024-04-18T14:44:34.661 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:34.661 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:34.662 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-04-18T14:44:34.662 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:56.549332+0000", 2024-04-18T14:44:34.662 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.7603999999999999e-05 2024-04-18T14:44:34.662 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:34.662 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:34.662 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-04-18T14:44:34.662 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:56.549353+0000", 2024-04-18T14:44:34.662 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.173e-05 2024-04-18T14:44:34.662 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:34.662 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:34.662 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-04-18T14:44:34.662 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:56.550446+0000", 2024-04-18T14:44:34.663 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0010926569999999999 2024-04-18T14:44:34.663 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:34.663 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:34.663 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for blocked object", 2024-04-18T14:44:34.663 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:56.550593+0000", 2024-04-18T14:44:34.663 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00014672599999999999 2024-04-18T14:44:34.663 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:34.663 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:34.663 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-04-18T14:44:34.663 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:56.574447+0000", 2024-04-18T14:44:34.663 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.023853863999999999 2024-04-18T14:44:34.663 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:34.663 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:34.663 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-04-18T14:44:34.663 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:56.574708+0000", 2024-04-18T14:44:34.664 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00026138300000000001 2024-04-18T14:44:34.664 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:34.664 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:34.664 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-04-18T14:44:34.664 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:56.574982+0000", 2024-04-18T14:44:34.664 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00027428899999999999 2024-04-18T14:44:34.664 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:44:34.664 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-04-18T14:44:34.664 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:44:34.664 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:34.664 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:34.664 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(client.4559.0:752 3.bs0 3:dcadfff4:::smithi13430248-18:head [read 0~753664,checksum,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e72)", 2024-04-18T14:44:34.664 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-04-18T14:44:11.772183+0000", 2024-04-18T14:44:34.664 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 22.881615406000002, 2024-04-18T14:44:34.664 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.021279604000000001, 2024-04-18T14:44:34.665 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-04-18T14:44:34.665 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "started", 2024-04-18T14:44:34.665 INFO:teuthology.orchestra.run.smithi119.stdout: "client_info": { 2024-04-18T14:44:34.665 INFO:teuthology.orchestra.run.smithi119.stdout: "client": "client.4559", 2024-04-18T14:44:34.665 INFO:teuthology.orchestra.run.smithi119.stdout: "client_addr": "172.21.15.134:0/3113589487", 2024-04-18T14:44:34.665 INFO:teuthology.orchestra.run.smithi119.stdout: "tid": 752 2024-04-18T14:44:34.665 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:34.665 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-04-18T14:44:34.665 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:34.665 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-04-18T14:44:34.665 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:11.772183+0000", 2024-04-18T14:44:34.665 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:44:34.666 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:34.666 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:34.666 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-04-18T14:44:34.666 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:11.772183+0000", 2024-04-18T14:44:34.666 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:44:34.666 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:34.666 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:34.667 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-04-18T14:44:34.667 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:11.772179+0000", 2024-04-18T14:44:34.667 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4294967295.9999967 2024-04-18T14:44:34.667 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:34.667 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:34.667 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-04-18T14:44:34.667 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:11.772196+0000", 2024-04-18T14:44:34.667 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.6235999999999998e-05 2024-04-18T14:44:34.667 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:34.667 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:34.667 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-04-18T14:44:34.667 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:11.772231+0000", 2024-04-18T14:44:34.668 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.5389999999999998e-05 2024-04-18T14:44:34.668 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:34.668 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:34.668 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-04-18T14:44:34.668 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:11.772251+0000", 2024-04-18T14:44:34.668 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.997e-05 2024-04-18T14:44:34.668 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:34.668 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:34.668 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-04-18T14:44:34.668 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:11.772451+0000", 2024-04-18T14:44:34.668 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00019971499999999999 2024-04-18T14:44:34.668 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:34.668 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:34.668 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-04-18T14:44:34.669 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:11.773123+0000", 2024-04-18T14:44:34.669 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000672698 2024-04-18T14:44:34.669 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:34.669 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:34.669 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-04-18T14:44:34.669 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:11.793462+0000", 2024-04-18T14:44:34.669 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.020338878000000001 2024-04-18T14:44:34.669 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:44:34.669 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-04-18T14:44:34.670 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:44:34.670 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:34.670 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:34.670 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(client.4559.0:753 3.bs0 3:dcadfff4:::smithi13430248-18:head [read 0~753664,checksum] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e72)", 2024-04-18T14:44:34.670 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-04-18T14:44:11.772288+0000", 2024-04-18T14:44:34.670 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 22.881509640000001, 2024-04-18T14:44:34.670 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.022514890999999999, 2024-04-18T14:44:34.670 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-04-18T14:44:34.670 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "started", 2024-04-18T14:44:34.670 INFO:teuthology.orchestra.run.smithi119.stdout: "client_info": { 2024-04-18T14:44:34.670 INFO:teuthology.orchestra.run.smithi119.stdout: "client": "client.4559", 2024-04-18T14:44:34.670 INFO:teuthology.orchestra.run.smithi119.stdout: "client_addr": "172.21.15.134:0/3113589487", 2024-04-18T14:44:34.671 INFO:teuthology.orchestra.run.smithi119.stdout: "tid": 753 2024-04-18T14:44:34.671 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:34.671 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-04-18T14:44:34.671 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:34.671 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-04-18T14:44:34.671 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:11.772288+0000", 2024-04-18T14:44:34.671 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:44:34.671 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:34.671 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:34.671 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-04-18T14:44:34.671 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:11.772288+0000", 2024-04-18T14:44:34.671 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:44:34.672 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:34.672 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:34.672 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-04-18T14:44:34.672 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:11.772287+0000", 2024-04-18T14:44:34.672 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4294967295.9999986 2024-04-18T14:44:34.672 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:34.672 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:34.672 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-04-18T14:44:34.672 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:11.772296+0000", 2024-04-18T14:44:34.672 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 9.4460000000000007e-06 2024-04-18T14:44:34.673 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:34.673 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:34.673 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-04-18T14:44:34.673 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:11.772315+0000", 2024-04-18T14:44:34.673 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.9046999999999999e-05 2024-04-18T14:44:34.673 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:34.673 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:34.673 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-04-18T14:44:34.673 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:11.772331+0000", 2024-04-18T14:44:34.673 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.5017e-05 2024-04-18T14:44:34.673 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:34.674 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:34.674 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-04-18T14:44:34.674 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:11.774017+0000", 2024-04-18T14:44:34.674 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.001686833 2024-04-18T14:44:34.674 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:34.674 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:34.675 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-04-18T14:44:34.675 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:11.774237+0000", 2024-04-18T14:44:34.675 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000219325 2024-04-18T14:44:34.675 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:34.675 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:34.675 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-04-18T14:44:34.676 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:11.794803+0000", 2024-04-18T14:44:34.676 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.020566563 2024-04-18T14:44:34.676 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:44:34.676 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-04-18T14:44:34.676 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:44:34.676 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:34.676 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:34.677 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(client.4559.0:754 3.bs0 3:dcadfff4:::smithi13430248-18:head [read 0~753664,checksum] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e72)", 2024-04-18T14:44:34.677 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-04-18T14:44:11.772343+0000", 2024-04-18T14:44:34.677 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 22.881454873999999, 2024-04-18T14:44:34.677 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.023843545000000001, 2024-04-18T14:44:34.677 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-04-18T14:44:34.677 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "started", 2024-04-18T14:44:34.677 INFO:teuthology.orchestra.run.smithi119.stdout: "client_info": { 2024-04-18T14:44:34.677 INFO:teuthology.orchestra.run.smithi119.stdout: "client": "client.4559", 2024-04-18T14:44:34.677 INFO:teuthology.orchestra.run.smithi119.stdout: "client_addr": "172.21.15.134:0/3113589487", 2024-04-18T14:44:34.678 INFO:teuthology.orchestra.run.smithi119.stdout: "tid": 754 2024-04-18T14:44:34.678 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:34.678 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-04-18T14:44:34.678 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:34.678 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-04-18T14:44:34.678 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:11.772343+0000", 2024-04-18T14:44:34.678 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:44:34.678 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:34.678 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:34.678 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-04-18T14:44:34.679 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:11.772343+0000", 2024-04-18T14:44:34.679 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:44:34.679 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:34.679 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:34.679 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-04-18T14:44:34.679 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:11.772342+0000", 2024-04-18T14:44:34.679 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4294967295.9999986 2024-04-18T14:44:34.680 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:34.680 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:34.680 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-04-18T14:44:34.680 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:11.772350+0000", 2024-04-18T14:44:34.680 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 8.3329999999999997e-06 2024-04-18T14:44:34.680 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:34.680 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:34.680 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-04-18T14:44:34.681 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:11.772372+0000", 2024-04-18T14:44:34.681 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.1719999999999999e-05 2024-04-18T14:44:34.681 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:34.681 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:34.681 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-04-18T14:44:34.681 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:11.772391+0000", 2024-04-18T14:44:34.681 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.931e-05 2024-04-18T14:44:34.681 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:34.681 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:34.681 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-04-18T14:44:34.681 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:11.775073+0000", 2024-04-18T14:44:34.681 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.002681269 2024-04-18T14:44:34.681 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:34.681 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:34.681 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-04-18T14:44:34.681 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:11.775319+0000", 2024-04-18T14:44:34.682 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00024685499999999998 2024-04-18T14:44:34.682 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:34.682 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:34.682 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-04-18T14:44:34.682 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:11.796187+0000", 2024-04-18T14:44:34.682 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.020867281000000001 2024-04-18T14:44:34.682 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:44:34.682 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-04-18T14:44:34.682 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:44:34.682 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:34.682 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:34.683 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(client.4559.0:831 3.bs0 3:db6a9fd1:::smithi13430248-42:head [append 0~0] snapc 2c=[2c,2b,2a,29,28,27,26,23,22,1e,1c,1a,16,14,13,11,2] ondisk+write+known_if_redirected+supports_pool_eio e77)", 2024-04-18T14:44:34.683 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-04-18T14:44:16.418076+0000", 2024-04-18T14:44:34.683 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 18.235722351, 2024-04-18T14:44:34.683 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.024189622000000001, 2024-04-18T14:44:34.683 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-04-18T14:44:34.683 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T14:44:34.683 INFO:teuthology.orchestra.run.smithi119.stdout: "client_info": { 2024-04-18T14:44:34.683 INFO:teuthology.orchestra.run.smithi119.stdout: "client": "client.4559", 2024-04-18T14:44:34.683 INFO:teuthology.orchestra.run.smithi119.stdout: "client_addr": "172.21.15.134:0/3113589487", 2024-04-18T14:44:34.687 INFO:teuthology.orchestra.run.smithi119.stdout: "tid": 831 2024-04-18T14:44:34.687 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:34.687 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-04-18T14:44:34.687 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:34.687 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-04-18T14:44:34.687 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:16.418076+0000", 2024-04-18T14:44:34.687 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:44:34.687 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:34.687 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:34.687 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-04-18T14:44:34.687 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:16.418076+0000", 2024-04-18T14:44:34.688 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:44:34.688 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:34.688 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:34.688 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-04-18T14:44:34.688 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:16.418073+0000", 2024-04-18T14:44:34.688 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4294967295.9999971 2024-04-18T14:44:34.688 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:34.688 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:34.688 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-04-18T14:44:34.688 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:16.418086+0000", 2024-04-18T14:44:34.688 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.3434e-05 2024-04-18T14:44:34.688 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:34.689 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:34.689 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-04-18T14:44:34.689 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:16.418120+0000", 2024-04-18T14:44:34.689 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.3915999999999999e-05 2024-04-18T14:44:34.689 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:34.689 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:34.689 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-04-18T14:44:34.689 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:16.418136+0000", 2024-04-18T14:44:34.689 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.5733999999999999e-05 2024-04-18T14:44:34.689 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:34.689 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:34.690 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-04-18T14:44:34.690 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:16.418282+0000", 2024-04-18T14:44:34.690 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00014630200000000001 2024-04-18T14:44:34.690 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:34.690 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:34.690 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "op must wait for map", 2024-04-18T14:44:34.690 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:16.418302+0000", 2024-04-18T14:44:34.690 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.999e-05 2024-04-18T14:44:34.690 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:34.690 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:34.691 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-04-18T14:44:34.691 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:16.422082+0000", 2024-04-18T14:44:34.691 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0037797030000000001 2024-04-18T14:44:34.691 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:34.691 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:34.691 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-04-18T14:44:34.691 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:16.422343+0000", 2024-04-18T14:44:34.691 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00026110199999999998 2024-04-18T14:44:34.691 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:34.691 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:34.691 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_started", 2024-04-18T14:44:34.691 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:16.424455+0000", 2024-04-18T14:44:34.691 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0021116469999999999 2024-04-18T14:44:34.691 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:34.692 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:34.692 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_committed", 2024-04-18T14:44:34.692 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:16.431693+0000", 2024-04-18T14:44:34.692 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0072383179999999997 2024-04-18T14:44:34.692 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:34.692 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:34.692 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-04-18T14:44:34.692 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:16.442153+0000", 2024-04-18T14:44:34.692 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.010459883 2024-04-18T14:44:34.692 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:34.692 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:34.692 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-04-18T14:44:34.692 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:16.442265+0000", 2024-04-18T14:44:34.692 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000112423 2024-04-18T14:44:34.693 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:44:34.693 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-04-18T14:44:34.693 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:44:34.693 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:34.693 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:34.693 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(client.4559.0:832 3.bs0 3:db6a9fd1:::smithi13430248-42:head [rollback 28] snapc 2c=[2c,2b,2a,29,28,27,26,23,22,1e,1c,1a,16,14,13,11,2] ondisk+write+known_if_redirected+supports_pool_eio e77)", 2024-04-18T14:44:34.693 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-04-18T14:44:16.418165+0000", 2024-04-18T14:44:34.693 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 18.235632924000001, 2024-04-18T14:44:34.693 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.025706539, 2024-04-18T14:44:34.693 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-04-18T14:44:34.693 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T14:44:34.693 INFO:teuthology.orchestra.run.smithi119.stdout: "client_info": { 2024-04-18T14:44:34.694 INFO:teuthology.orchestra.run.smithi119.stdout: "client": "client.4559", 2024-04-18T14:44:34.694 INFO:teuthology.orchestra.run.smithi119.stdout: "client_addr": "172.21.15.134:0/3113589487", 2024-04-18T14:44:34.694 INFO:teuthology.orchestra.run.smithi119.stdout: "tid": 832 2024-04-18T14:44:34.694 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:34.694 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-04-18T14:44:34.694 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:34.694 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-04-18T14:44:34.694 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:16.418165+0000", 2024-04-18T14:44:34.694 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:44:34.694 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:34.694 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:34.694 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-04-18T14:44:34.694 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:16.418165+0000", 2024-04-18T14:44:34.694 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:44:34.694 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:34.695 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:34.695 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-04-18T14:44:34.695 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:16.418164+0000", 2024-04-18T14:44:34.695 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4294967295.9999986 2024-04-18T14:44:34.695 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:34.695 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:34.695 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-04-18T14:44:34.695 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:16.418171+0000", 2024-04-18T14:44:34.695 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 7.7030000000000006e-06 2024-04-18T14:44:34.695 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:34.695 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:34.695 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-04-18T14:44:34.695 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:16.418187+0000", 2024-04-18T14:44:34.695 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.5196e-05 2024-04-18T14:44:34.695 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:34.696 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:34.696 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-04-18T14:44:34.696 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:16.418201+0000", 2024-04-18T14:44:34.696 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.4426999999999999e-05 2024-04-18T14:44:34.696 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:34.696 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:34.696 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-04-18T14:44:34.696 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:16.418471+0000", 2024-04-18T14:44:34.696 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00026968100000000002 2024-04-18T14:44:34.696 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:34.696 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:34.696 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting_for_map not empty", 2024-04-18T14:44:34.696 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:16.418485+0000", 2024-04-18T14:44:34.697 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.384e-05 2024-04-18T14:44:34.697 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:34.697 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:34.697 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-04-18T14:44:34.697 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:16.426026+0000", 2024-04-18T14:44:34.697 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0075412420000000001 2024-04-18T14:44:34.697 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:34.697 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:34.697 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-04-18T14:44:34.697 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:16.426292+0000", 2024-04-18T14:44:34.697 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00026580799999999997 2024-04-18T14:44:34.697 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:34.697 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:34.697 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_started", 2024-04-18T14:44:34.698 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:16.427736+0000", 2024-04-18T14:44:34.698 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.001444299 2024-04-18T14:44:34.698 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:34.698 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:34.698 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_committed", 2024-04-18T14:44:34.698 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:16.443413+0000", 2024-04-18T14:44:34.698 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.015677023000000002 2024-04-18T14:44:34.698 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:34.698 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:34.698 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-04-18T14:44:34.698 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:16.443667+0000", 2024-04-18T14:44:34.698 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00025423200000000001 2024-04-18T14:44:34.698 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:34.699 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:34.699 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-04-18T14:44:34.699 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:16.443872+0000", 2024-04-18T14:44:34.699 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00020442799999999999 2024-04-18T14:44:34.699 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:44:34.699 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-04-18T14:44:34.699 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:44:34.699 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:34.699 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:34.699 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(client.4559.0:833 3.bs0 3:db6a9fd1:::smithi13430248-42:head [append 0~0] snapc 2c=[2c,2b,2a,29,28,27,26,23,22,1e,1c,1a,16,14,13,11,2] ondisk+write+known_if_redirected+supports_pool_eio e77)", 2024-04-18T14:44:34.699 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-04-18T14:44:16.418211+0000", 2024-04-18T14:44:34.699 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 18.235587257999999, 2024-04-18T14:44:34.699 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.028839912999999998, 2024-04-18T14:44:34.699 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-04-18T14:44:34.699 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T14:44:34.699 INFO:teuthology.orchestra.run.smithi119.stdout: "client_info": { 2024-04-18T14:44:34.700 INFO:teuthology.orchestra.run.smithi119.stdout: "client": "client.4559", 2024-04-18T14:44:34.700 INFO:teuthology.orchestra.run.smithi119.stdout: "client_addr": "172.21.15.134:0/3113589487", 2024-04-18T14:44:34.700 INFO:teuthology.orchestra.run.smithi119.stdout: "tid": 833 2024-04-18T14:44:34.700 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:34.700 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-04-18T14:44:34.700 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:34.700 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-04-18T14:44:34.700 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:16.418211+0000", 2024-04-18T14:44:34.700 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:44:34.700 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:34.700 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:34.700 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-04-18T14:44:34.700 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:16.418211+0000", 2024-04-18T14:44:34.701 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:44:34.701 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:34.701 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:34.701 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-04-18T14:44:34.701 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:16.418210+0000", 2024-04-18T14:44:34.701 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4294967295.999999 2024-04-18T14:44:34.701 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:34.701 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:34.701 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-04-18T14:44:34.701 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:16.418214+0000", 2024-04-18T14:44:34.701 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4.2069999999999997e-06 2024-04-18T14:44:34.701 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:34.701 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:34.701 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-04-18T14:44:34.701 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:16.418224+0000", 2024-04-18T14:44:34.701 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.0293e-05 2024-04-18T14:44:34.702 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:34.702 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:34.702 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-04-18T14:44:34.702 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:16.418236+0000", 2024-04-18T14:44:34.702 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.2013e-05 2024-04-18T14:44:34.702 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:34.702 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:34.702 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-04-18T14:44:34.702 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:16.418552+0000", 2024-04-18T14:44:34.702 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000315588 2024-04-18T14:44:34.702 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:34.702 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:34.702 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting_for_map not empty", 2024-04-18T14:44:34.703 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:16.418570+0000", 2024-04-18T14:44:34.703 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.7433000000000001e-05 2024-04-18T14:44:34.703 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:34.703 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:34.703 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-04-18T14:44:34.703 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:16.429228+0000", 2024-04-18T14:44:34.703 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.010658288 2024-04-18T14:44:34.703 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:34.703 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:34.703 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-04-18T14:44:34.703 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:16.429554+0000", 2024-04-18T14:44:34.703 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00032638799999999999 2024-04-18T14:44:34.703 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:34.703 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:34.703 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_started", 2024-04-18T14:44:34.703 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:16.430966+0000", 2024-04-18T14:44:34.704 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.001412155 2024-04-18T14:44:34.704 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:34.704 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:34.704 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_committed", 2024-04-18T14:44:34.704 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:16.443877+0000", 2024-04-18T14:44:34.704 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.012910585 2024-04-18T14:44:34.704 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:34.704 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:34.704 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-04-18T14:44:34.704 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:16.446997+0000", 2024-04-18T14:44:34.704 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0031195820000000001 2024-04-18T14:44:34.704 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:34.704 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:34.704 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-04-18T14:44:34.705 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:16.447051+0000", 2024-04-18T14:44:34.705 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 5.4128000000000001e-05 2024-04-18T14:44:34.705 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:44:34.705 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-04-18T14:44:34.705 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:44:34.705 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:34.705 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:34.705 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(client.4559.0:834 3.bs0 3:dcadfff4:::smithi13430248-18:head [create,setxattr dNUsaqXQnmoOacjgaaZfpahc]PsY[[^jr[mfmShe (1753) in=40b,setxattr UhZXihfNoSgtoiajmXpdpaatOO_osfRPX]dfPcbj (1402) in=40b,setxattr \\]laRbmfn\\dk`\\esn[fNmaPr^korOVtUiYPdahRO (12280) in=40b,setxattr Vagm[`fihbagdtlVtrbSm]^UoTXcPjQON\\rSgXk^ (979) in=40b,setxattr goVsYZbWtTdeOQVYnZPir\\hbhdQQajY[_V_XY[ol (15156) in=40b,setxattr ^c[^YW[aiRgh_`]YSgkatVaPRsZZsQdPrqWZbctd (1191) in=40b,setxattr OgdPUPaadgRTklVNW\\ogXRZ[p_jflTY\\Oimbb_TN (595) in=40b,setxattr []r[RfRaVkcRbmh[h[l^iPW[kT[Q\\mlR[pXOY\\]d (1399) in=40b,setxattr gYa_dgO]sWfWqTa[Pstqs`^]R_kq[q]\\r[cNeQhR (17824) in=40b,setxattr NaZYi]WN`_aO]rpafNNQgtqOXsZYVjTkRan_`jhq (1333) in=40b,setxattr UoOYda]]SYP[a_osbqNpe\\PXY`s_pT\\Zb_YmZh^a (1017) in=40b,setxattr aOmWhkZlNadlRZr]clkQ[nPOcakj]ejj_et\\j`dm (945) in=40b,setxattr emoSeZoh`tmrohOV\\nrt`[NbrgqWQdikW__ra (1717) in=37b,setxattr YfiZnafesiPTPntWensjSZSYUY]eY\\Xobt[aTjdS (978) in=40b,setxattr dgRdPcRUjonWQreiRQqlaYaX (1717) in=24b,setxattr UinOTnqZY`TacOnrakRl\\aY[sPrekhSNja]`oOX] (1649) in=40b,setxattr ]shh]XhSNhQapVgamYTN_knqlafT_PZ_gbh`gWhO (665) in=40b,setxattr QUfYSW`]^\\shZbnXROkUd^aYkerpSdRcncs]lknd (10104) in=40b,setxattr Nj\\geYaQaNsp`grl]adTQ[\\^WtoTgNSgjO\\ZPh^[ (1085) in=40b,setxattr ecNccamVWSj\\QcohQskdjYs`OZV\\XgQXdtfVlbgZ (1049) in=40b] snapc 2c=[2c,2b,2a,29,28,27,26,23,22,1e,1c,1a,16,14,13,11,2] ondisk+write+known_if_redirected+supports_pool_eio e77)", 2024-04-18T14:44:34.705 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-04-18T14:44:16.419827+0000", 2024-04-18T14:44:34.705 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 18.233971449999999, 2024-04-18T14:44:34.705 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.032986371, 2024-04-18T14:44:34.705 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-04-18T14:44:34.705 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T14:44:34.705 INFO:teuthology.orchestra.run.smithi119.stdout: "client_info": { 2024-04-18T14:44:34.705 INFO:teuthology.orchestra.run.smithi119.stdout: "client": "client.4559", 2024-04-18T14:44:34.706 INFO:teuthology.orchestra.run.smithi119.stdout: "client_addr": "172.21.15.134:0/3113589487", 2024-04-18T14:44:34.706 INFO:teuthology.orchestra.run.smithi119.stdout: "tid": 834 2024-04-18T14:44:34.706 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:34.706 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-04-18T14:44:34.706 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:34.706 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-04-18T14:44:34.706 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:16.419827+0000", 2024-04-18T14:44:34.706 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:44:34.706 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:34.706 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:34.706 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-04-18T14:44:34.706 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:16.419827+0000", 2024-04-18T14:44:34.706 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:44:34.706 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:34.707 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:34.707 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-04-18T14:44:34.707 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:16.419824+0000", 2024-04-18T14:44:34.707 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4294967295.9999976 2024-04-18T14:44:34.707 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:34.707 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:34.707 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-04-18T14:44:34.707 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:16.420266+0000", 2024-04-18T14:44:34.707 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00044168899999999999 2024-04-18T14:44:34.707 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:34.707 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:34.707 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-04-18T14:44:34.707 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:16.420298+0000", 2024-04-18T14:44:34.708 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.2286999999999998e-05 2024-04-18T14:44:34.708 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:34.708 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:34.708 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-04-18T14:44:34.708 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:16.420318+0000", 2024-04-18T14:44:34.708 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.0203e-05 2024-04-18T14:44:34.708 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:34.708 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:34.708 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-04-18T14:44:34.708 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:16.420431+0000", 2024-04-18T14:44:34.708 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000112546 2024-04-18T14:44:34.708 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:34.708 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:34.708 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting_for_map not empty", 2024-04-18T14:44:34.708 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:16.420441+0000", 2024-04-18T14:44:34.709 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.0053e-05 2024-04-18T14:44:34.709 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:34.709 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:34.709 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-04-18T14:44:34.709 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:16.432273+0000", 2024-04-18T14:44:34.709 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.011832596000000001 2024-04-18T14:44:34.709 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:34.709 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:34.709 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-04-18T14:44:34.709 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:16.432582+0000", 2024-04-18T14:44:34.709 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00030847399999999999 2024-04-18T14:44:34.709 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:34.709 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:34.710 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_started", 2024-04-18T14:44:34.710 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:16.435718+0000", 2024-04-18T14:44:34.710 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0031362130000000001 2024-04-18T14:44:34.710 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:34.710 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:34.710 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_committed", 2024-04-18T14:44:34.710 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:16.446433+0000", 2024-04-18T14:44:34.710 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.010715257000000001 2024-04-18T14:44:34.710 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:34.711 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:34.711 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-04-18T14:44:34.711 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:16.452730+0000", 2024-04-18T14:44:34.711 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0062969710000000002 2024-04-18T14:44:34.711 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:34.711 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:34.712 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-04-18T14:44:34.712 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:16.452813+0000", 2024-04-18T14:44:34.712 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 8.2502000000000004e-05 2024-04-18T14:44:34.712 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:44:34.712 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-04-18T14:44:34.712 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:44:34.712 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:34.713 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:34.713 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "MOSDECSubOpWrite(3.8s1 78/73 ECSubWrite(tid=206, reqid=osd.5.0:206, at_version=78'145, trim_to=0'0, roll_forward_to=78'141))", 2024-04-18T14:44:34.713 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-04-18T14:44:17.438934+0000", 2024-04-18T14:44:34.713 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 17.214864188, 2024-04-18T14:44:34.713 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.025487961999999999, 2024-04-18T14:44:34.713 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-04-18T14:44:34.713 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "reached pg", 2024-04-18T14:44:34.713 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-04-18T14:44:34.713 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:34.713 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-04-18T14:44:34.713 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:17.438934+0000", 2024-04-18T14:44:34.713 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:44:34.713 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:34.713 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:34.713 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-04-18T14:44:34.714 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:17.438934+0000", 2024-04-18T14:44:34.714 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:44:34.714 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:34.714 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:34.714 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-04-18T14:44:34.714 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:17.438933+0000", 2024-04-18T14:44:34.714 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4294967295.999999 2024-04-18T14:44:34.714 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:34.714 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:34.714 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-04-18T14:44:34.714 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:17.438979+0000", 2024-04-18T14:44:34.714 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4.6289999999999999e-05 2024-04-18T14:44:34.714 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:34.714 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:34.715 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-04-18T14:44:34.715 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:17.439001+0000", 2024-04-18T14:44:34.715 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.2232999999999999e-05 2024-04-18T14:44:34.715 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:34.715 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:34.715 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-04-18T14:44:34.715 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:17.439019+0000", 2024-04-18T14:44:34.715 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.7496e-05 2024-04-18T14:44:34.715 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:34.715 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:34.715 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-04-18T14:44:34.715 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:17.450229+0000", 2024-04-18T14:44:34.715 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.011209714000000001 2024-04-18T14:44:34.715 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:34.715 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:34.716 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_started", 2024-04-18T14:44:34.716 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:17.450252+0000", 2024-04-18T14:44:34.716 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.3206000000000001e-05 2024-04-18T14:44:34.716 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:34.716 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:34.716 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_committed", 2024-04-18T14:44:34.716 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:17.464364+0000", 2024-04-18T14:44:34.716 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.014112102 2024-04-18T14:44:34.716 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:34.716 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:34.716 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-04-18T14:44:34.716 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:17.464422+0000", 2024-04-18T14:44:34.716 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 5.7877000000000002e-05 2024-04-18T14:44:34.716 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:44:34.716 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-04-18T14:44:34.716 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:44:34.717 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:34.717 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:34.717 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(client.4559.0:901 3.bs0 3:db6a9fd1:::smithi13430248-42:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e81)", 2024-04-18T14:44:34.717 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-04-18T14:44:20.522015+0000", 2024-04-18T14:44:34.717 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 14.131782914, 2024-04-18T14:44:34.717 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.022857404000000001, 2024-04-18T14:44:34.717 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-04-18T14:44:34.717 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "started", 2024-04-18T14:44:34.717 INFO:teuthology.orchestra.run.smithi119.stdout: "client_info": { 2024-04-18T14:44:34.717 INFO:teuthology.orchestra.run.smithi119.stdout: "client": "client.4559", 2024-04-18T14:44:34.717 INFO:teuthology.orchestra.run.smithi119.stdout: "client_addr": "172.21.15.134:0/3113589487", 2024-04-18T14:44:34.717 INFO:teuthology.orchestra.run.smithi119.stdout: "tid": 901 2024-04-18T14:44:34.717 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:34.717 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-04-18T14:44:34.717 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:34.718 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-04-18T14:44:34.718 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:20.522015+0000", 2024-04-18T14:44:34.718 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:44:34.718 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:34.718 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:34.718 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-04-18T14:44:34.718 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:20.522015+0000", 2024-04-18T14:44:34.718 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:44:34.718 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:34.718 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:34.718 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-04-18T14:44:34.718 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:20.522014+0000", 2024-04-18T14:44:34.718 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4294967295.9999986 2024-04-18T14:44:34.719 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:34.719 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:34.719 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-04-18T14:44:34.719 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:20.522020+0000", 2024-04-18T14:44:34.719 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 6.6429999999999998e-06 2024-04-18T14:44:34.719 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:34.719 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:34.719 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-04-18T14:44:34.719 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:20.522037+0000", 2024-04-18T14:44:34.719 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.6880000000000001e-05 2024-04-18T14:44:34.719 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:34.719 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:34.719 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-04-18T14:44:34.719 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:20.522108+0000", 2024-04-18T14:44:34.719 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 7.0842999999999999e-05 2024-04-18T14:44:34.720 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:34.720 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:34.720 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-04-18T14:44:34.720 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:20.535616+0000", 2024-04-18T14:44:34.720 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.013507823 2024-04-18T14:44:34.720 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:34.720 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:34.720 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for rw locks", 2024-04-18T14:44:34.720 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:20.535748+0000", 2024-04-18T14:44:34.720 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00013224499999999999 2024-04-18T14:44:34.720 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:34.720 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:34.720 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-04-18T14:44:34.720 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:20.542130+0000", 2024-04-18T14:44:34.720 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0063818310000000001 2024-04-18T14:44:34.721 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:34.721 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:34.721 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-04-18T14:44:34.721 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:20.542374+0000", 2024-04-18T14:44:34.721 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00024357 2024-04-18T14:44:34.721 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:34.721 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:34.721 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-04-18T14:44:34.722 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:20.544872+0000", 2024-04-18T14:44:34.722 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0024988390000000001 2024-04-18T14:44:34.722 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:44:34.722 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-04-18T14:44:34.722 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:44:34.722 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:34.722 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:34.722 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(client.4559.0:939 3.bs0 3:db6a9fd1:::smithi13430248-42:head [append 0~425984] snapc 32=[32,30,2c,2b,2a,29,28,27,26,22,1e,1c,1a,14,11] ondisk+write+known_if_redirected+supports_pool_eio e83)", 2024-04-18T14:44:34.722 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-04-18T14:44:22.485855+0000", 2024-04-18T14:44:34.722 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 12.167942908000001, 2024-04-18T14:44:34.722 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.024186401, 2024-04-18T14:44:34.723 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-04-18T14:44:34.723 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T14:44:34.723 INFO:teuthology.orchestra.run.smithi119.stdout: "client_info": { 2024-04-18T14:44:34.723 INFO:teuthology.orchestra.run.smithi119.stdout: "client": "client.4559", 2024-04-18T14:44:34.723 INFO:teuthology.orchestra.run.smithi119.stdout: "client_addr": "172.21.15.134:0/3113589487", 2024-04-18T14:44:34.723 INFO:teuthology.orchestra.run.smithi119.stdout: "tid": 939 2024-04-18T14:44:34.723 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:34.723 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-04-18T14:44:34.723 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:34.723 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-04-18T14:44:34.723 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:22.485855+0000", 2024-04-18T14:44:34.723 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:44:34.723 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:34.723 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:34.723 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-04-18T14:44:34.723 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:22.485855+0000", 2024-04-18T14:44:34.724 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:44:34.724 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:34.724 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:34.724 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-04-18T14:44:34.724 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:22.485839+0000", 2024-04-18T14:44:34.724 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4294967295.9999843 2024-04-18T14:44:34.725 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:34.725 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:34.725 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-04-18T14:44:34.725 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:22.486880+0000", 2024-04-18T14:44:34.725 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0010406020000000001 2024-04-18T14:44:34.725 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:34.725 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:34.725 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-04-18T14:44:34.725 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:22.486909+0000", 2024-04-18T14:44:34.725 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.8996000000000002e-05 2024-04-18T14:44:34.725 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:34.725 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:34.725 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-04-18T14:44:34.726 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:22.486929+0000", 2024-04-18T14:44:34.726 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.0013999999999998e-05 2024-04-18T14:44:34.726 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:34.726 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:34.726 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-04-18T14:44:34.726 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:22.495754+0000", 2024-04-18T14:44:34.726 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0088247519999999999 2024-04-18T14:44:34.726 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:34.726 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:34.726 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-04-18T14:44:34.726 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:22.496057+0000", 2024-04-18T14:44:34.726 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00030360100000000002 2024-04-18T14:44:34.726 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:34.726 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:34.727 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_started", 2024-04-18T14:44:34.727 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:22.497677+0000", 2024-04-18T14:44:34.727 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0016202009999999999 2024-04-18T14:44:34.727 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:34.727 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:34.727 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_committed", 2024-04-18T14:44:34.727 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:22.503479+0000", 2024-04-18T14:44:34.727 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0058013489999999999 2024-04-18T14:44:34.727 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:34.727 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:34.727 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-04-18T14:44:34.727 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:22.509817+0000", 2024-04-18T14:44:34.727 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0063383739999999999 2024-04-18T14:44:34.727 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:34.727 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:34.728 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-04-18T14:44:34.728 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:22.510041+0000", 2024-04-18T14:44:34.728 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00022433199999999999 2024-04-18T14:44:34.728 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:44:34.728 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-04-18T14:44:34.728 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:44:34.728 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:34.728 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:34.728 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(client.4559.0:940 3.bs0 3:db6a9fd1:::smithi13430248-42:head [append 0~524288] snapc 32=[32,30,2c,2b,2a,29,28,27,26,22,1e,1c,1a,14,11] ondisk+write+known_if_redirected+supports_pool_eio e83)", 2024-04-18T14:44:34.728 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-04-18T14:44:22.489469+0000", 2024-04-18T14:44:34.728 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 12.164329331999999, 2024-04-18T14:44:34.729 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.021788469000000001, 2024-04-18T14:44:34.729 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-04-18T14:44:34.729 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T14:44:34.729 INFO:teuthology.orchestra.run.smithi119.stdout: "client_info": { 2024-04-18T14:44:34.729 INFO:teuthology.orchestra.run.smithi119.stdout: "client": "client.4559", 2024-04-18T14:44:34.729 INFO:teuthology.orchestra.run.smithi119.stdout: "client_addr": "172.21.15.134:0/3113589487", 2024-04-18T14:44:34.730 INFO:teuthology.orchestra.run.smithi119.stdout: "tid": 940 2024-04-18T14:44:34.730 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:34.730 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-04-18T14:44:34.730 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:34.730 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-04-18T14:44:34.730 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:22.489469+0000", 2024-04-18T14:44:34.731 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:44:34.731 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:34.731 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:34.731 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-04-18T14:44:34.731 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:22.489469+0000", 2024-04-18T14:44:34.731 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:44:34.732 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:34.732 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:34.732 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-04-18T14:44:34.732 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:22.489466+0000", 2024-04-18T14:44:34.732 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4294967295.9999971 2024-04-18T14:44:34.732 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:34.733 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:34.733 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-04-18T14:44:34.733 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:22.490637+0000", 2024-04-18T14:44:34.733 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.001171184 2024-04-18T14:44:34.733 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:34.733 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:34.734 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-04-18T14:44:34.734 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:22.490670+0000", 2024-04-18T14:44:34.734 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.3333000000000001e-05 2024-04-18T14:44:34.734 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:34.734 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:34.734 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-04-18T14:44:34.735 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:22.490688+0000", 2024-04-18T14:44:34.735 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.7957000000000001e-05 2024-04-18T14:44:34.735 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:34.735 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:34.735 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-04-18T14:44:34.735 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:22.499244+0000", 2024-04-18T14:44:34.736 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0085561839999999997 2024-04-18T14:44:34.736 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:34.736 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:34.736 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-04-18T14:44:34.736 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:22.499419+0000", 2024-04-18T14:44:34.736 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000175009 2024-04-18T14:44:34.737 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:34.737 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:34.737 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_started", 2024-04-18T14:44:34.737 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:22.501124+0000", 2024-04-18T14:44:34.737 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.001704807 2024-04-18T14:44:34.737 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:34.737 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:34.738 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_committed", 2024-04-18T14:44:34.738 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:22.510076+0000", 2024-04-18T14:44:34.738 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0089518440000000005 2024-04-18T14:44:34.738 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:34.738 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:34.738 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-04-18T14:44:34.738 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:22.511067+0000", 2024-04-18T14:44:34.739 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00099103600000000004 2024-04-18T14:44:34.739 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:34.739 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:34.739 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-04-18T14:44:34.739 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:22.511257+0000", 2024-04-18T14:44:34.739 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000189972 2024-04-18T14:44:34.739 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:44:34.740 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-04-18T14:44:34.740 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:44:34.740 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:34.740 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:34.740 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(client.4559.0:943 3.bs0 3:db6a9fd1:::smithi13430248-42:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e83)", 2024-04-18T14:44:34.740 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-04-18T14:44:22.493331+0000", 2024-04-18T14:44:34.740 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 12.160466979000001, 2024-04-18T14:44:34.740 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.022422965, 2024-04-18T14:44:34.741 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-04-18T14:44:34.741 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "started", 2024-04-18T14:44:34.741 INFO:teuthology.orchestra.run.smithi119.stdout: "client_info": { 2024-04-18T14:44:34.741 INFO:teuthology.orchestra.run.smithi119.stdout: "client": "client.4559", 2024-04-18T14:44:34.741 INFO:teuthology.orchestra.run.smithi119.stdout: "client_addr": "172.21.15.134:0/3113589487", 2024-04-18T14:44:34.741 INFO:teuthology.orchestra.run.smithi119.stdout: "tid": 943 2024-04-18T14:44:34.741 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:34.742 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-04-18T14:44:34.742 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:34.742 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-04-18T14:44:34.742 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:22.493331+0000", 2024-04-18T14:44:34.742 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:44:34.742 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:34.742 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:34.742 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-04-18T14:44:34.743 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:22.493331+0000", 2024-04-18T14:44:34.743 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:44:34.743 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:34.743 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:34.743 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-04-18T14:44:34.743 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:22.493330+0000", 2024-04-18T14:44:34.743 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4294967295.999999 2024-04-18T14:44:34.743 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:34.744 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:34.744 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-04-18T14:44:34.744 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:22.493334+0000", 2024-04-18T14:44:34.744 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4.1529999999999999e-06 2024-04-18T14:44:34.744 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:34.744 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:34.744 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-04-18T14:44:34.744 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:22.493344+0000", 2024-04-18T14:44:34.745 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 9.9329999999999996e-06 2024-04-18T14:44:34.745 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:34.745 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:34.745 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-04-18T14:44:34.745 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:22.493352+0000", 2024-04-18T14:44:34.745 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 7.2969999999999998e-06 2024-04-18T14:44:34.746 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:34.746 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:34.746 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-04-18T14:44:34.746 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:22.513375+0000", 2024-04-18T14:44:34.746 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.020023446 2024-04-18T14:44:34.746 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:34.747 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:34.747 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-04-18T14:44:34.747 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:22.513593+0000", 2024-04-18T14:44:34.747 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000217505 2024-04-18T14:44:34.747 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:34.747 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:34.747 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-04-18T14:44:34.748 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:22.515754+0000", 2024-04-18T14:44:34.748 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0021613639999999998 2024-04-18T14:44:34.748 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:44:34.748 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-04-18T14:44:34.748 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:44:34.748 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:34.748 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:34.748 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(client.4559.0:1000 3.4s0 3:253cfff6:::smithi13430248-31:head [append 0~0] snapc 35=[35,33,32,30,2c,2b,2a,29,28,26,22,1e,1c,1a,14,11] ondisk+write+known_if_redirected+supports_pool_eio e86)", 2024-04-18T14:44:34.748 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-04-18T14:44:25.528322+0000", 2024-04-18T14:44:34.749 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 9.1254755339999996, 2024-04-18T14:44:34.749 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.023230978999999999, 2024-04-18T14:44:34.749 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-04-18T14:44:34.749 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T14:44:34.749 INFO:teuthology.orchestra.run.smithi119.stdout: "client_info": { 2024-04-18T14:44:34.749 INFO:teuthology.orchestra.run.smithi119.stdout: "client": "client.4559", 2024-04-18T14:44:34.749 INFO:teuthology.orchestra.run.smithi119.stdout: "client_addr": "172.21.15.134:0/3113589487", 2024-04-18T14:44:34.749 INFO:teuthology.orchestra.run.smithi119.stdout: "tid": 1000 2024-04-18T14:44:34.749 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:34.749 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-04-18T14:44:34.750 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:34.750 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-04-18T14:44:34.750 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:25.528322+0000", 2024-04-18T14:44:34.750 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:44:34.750 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:34.750 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:34.750 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-04-18T14:44:34.750 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:25.528322+0000", 2024-04-18T14:44:34.750 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:44:34.751 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:34.751 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:34.751 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-04-18T14:44:34.751 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:25.528321+0000", 2024-04-18T14:44:34.751 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4294967295.9999986 2024-04-18T14:44:34.751 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:34.751 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:34.752 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-04-18T14:44:34.752 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:25.528331+0000", 2024-04-18T14:44:34.752 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.0149999999999999e-05 2024-04-18T14:44:34.752 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:34.752 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:34.752 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-04-18T14:44:34.752 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:25.528355+0000", 2024-04-18T14:44:34.753 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.3560000000000001e-05 2024-04-18T14:44:34.753 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:34.753 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:34.753 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-04-18T14:44:34.753 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:25.528372+0000", 2024-04-18T14:44:34.753 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.7405999999999999e-05 2024-04-18T14:44:34.754 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:34.754 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:34.754 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-04-18T14:44:34.754 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:25.528479+0000", 2024-04-18T14:44:34.754 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000107069 2024-04-18T14:44:34.754 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:34.754 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:34.754 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting_for_map not empty", 2024-04-18T14:44:34.754 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:25.528490+0000", 2024-04-18T14:44:34.755 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.0947e-05 2024-04-18T14:44:34.755 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:34.755 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:34.755 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-04-18T14:44:34.755 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:25.544895+0000", 2024-04-18T14:44:34.755 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.016404400999999999 2024-04-18T14:44:34.755 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:34.755 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:34.755 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-04-18T14:44:34.755 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:25.545212+0000", 2024-04-18T14:44:34.755 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00031769699999999998 2024-04-18T14:44:34.755 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:34.755 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:34.755 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_started", 2024-04-18T14:44:34.755 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:25.546437+0000", 2024-04-18T14:44:34.756 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0012249170000000001 2024-04-18T14:44:34.756 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:34.756 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:34.756 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_committed", 2024-04-18T14:44:34.756 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:25.550901+0000", 2024-04-18T14:44:34.756 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0044635899999999999 2024-04-18T14:44:34.756 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:34.756 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:34.756 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-04-18T14:44:34.756 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:25.551452+0000", 2024-04-18T14:44:34.756 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00055106199999999995 2024-04-18T14:44:34.756 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:34.757 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:34.757 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-04-18T14:44:34.757 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:25.551553+0000", 2024-04-18T14:44:34.757 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000101586 2024-04-18T14:44:34.757 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:44:34.757 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-04-18T14:44:34.757 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:44:34.757 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:34.757 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:34.757 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(client.4559.0:1010 3.4s0 3:253cfff6:::smithi13430248-31:head [copy-from ver 137] snapc 37=[37,36,35,33,32,30,2c,2b,2a,29,28,26,22,1e,1c,1a,14,11] ondisk+write+known_if_redirected+supports_pool_eio e88)", 2024-04-18T14:44:34.757 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-04-18T14:44:27.491889+0000", 2024-04-18T14:44:34.758 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 7.1619090090000004, 2024-04-18T14:44:34.758 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.066523407000000007, 2024-04-18T14:44:34.758 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-04-18T14:44:34.758 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T14:44:34.758 INFO:teuthology.orchestra.run.smithi119.stdout: "client_info": { 2024-04-18T14:44:34.758 INFO:teuthology.orchestra.run.smithi119.stdout: "client": "client.4559", 2024-04-18T14:44:34.758 INFO:teuthology.orchestra.run.smithi119.stdout: "client_addr": "172.21.15.134:0/3113589487", 2024-04-18T14:44:34.758 INFO:teuthology.orchestra.run.smithi119.stdout: "tid": 1010 2024-04-18T14:44:34.758 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:34.758 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-04-18T14:44:34.758 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:34.758 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-04-18T14:44:34.758 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:27.491889+0000", 2024-04-18T14:44:34.758 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:44:34.759 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:34.759 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:34.759 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-04-18T14:44:34.759 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:27.491889+0000", 2024-04-18T14:44:34.759 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:44:34.759 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:34.759 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:34.759 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-04-18T14:44:34.759 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:27.491886+0000", 2024-04-18T14:44:34.759 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4294967295.9999967 2024-04-18T14:44:34.759 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:34.759 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:34.759 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-04-18T14:44:34.759 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:27.491903+0000", 2024-04-18T14:44:34.759 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.6935999999999998e-05 2024-04-18T14:44:34.760 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:34.760 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:34.760 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-04-18T14:44:34.760 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:27.491938+0000", 2024-04-18T14:44:34.760 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.4910000000000003e-05 2024-04-18T14:44:34.760 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:34.760 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:34.760 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-04-18T14:44:34.760 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:27.491955+0000", 2024-04-18T14:44:34.760 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.7757e-05 2024-04-18T14:44:34.760 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:34.760 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:34.760 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-04-18T14:44:34.760 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:27.492148+0000", 2024-04-18T14:44:34.761 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00019288199999999999 2024-04-18T14:44:34.761 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:34.761 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:34.761 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "op must wait for map", 2024-04-18T14:44:34.761 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:27.492162+0000", 2024-04-18T14:44:34.761 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.3276e-05 2024-04-18T14:44:34.761 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:34.761 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:34.761 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-04-18T14:44:34.761 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:27.500705+0000", 2024-04-18T14:44:34.761 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0085431350000000003 2024-04-18T14:44:34.761 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:34.761 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:34.761 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-04-18T14:44:34.761 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:27.500988+0000", 2024-04-18T14:44:34.761 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00028361100000000002 2024-04-18T14:44:34.762 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:34.762 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:34.762 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_started", 2024-04-18T14:44:34.762 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:27.545381+0000", 2024-04-18T14:44:34.762 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.044392593000000001 2024-04-18T14:44:34.762 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:34.762 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:34.762 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_committed", 2024-04-18T14:44:34.762 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:27.552716+0000", 2024-04-18T14:44:34.762 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0073352570000000004 2024-04-18T14:44:34.762 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:34.762 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:34.763 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-04-18T14:44:34.763 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:27.558299+0000", 2024-04-18T14:44:34.763 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0055833369999999998 2024-04-18T14:44:34.763 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:34.763 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:34.763 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-04-18T14:44:34.763 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:27.558412+0000", 2024-04-18T14:44:34.763 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000112916 2024-04-18T14:44:34.763 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:44:34.763 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-04-18T14:44:34.763 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:44:34.763 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:34.763 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:34.763 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(client.4559.0:1011 3.4s0 3:253cfff6:::smithi13430248-31:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e88)", 2024-04-18T14:44:34.763 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-04-18T14:44:27.491974+0000", 2024-04-18T14:44:34.764 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 7.1618239859999999, 2024-04-18T14:44:34.764 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.059902380999999998, 2024-04-18T14:44:34.764 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-04-18T14:44:34.764 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "started", 2024-04-18T14:44:34.764 INFO:teuthology.orchestra.run.smithi119.stdout: "client_info": { 2024-04-18T14:44:34.764 INFO:teuthology.orchestra.run.smithi119.stdout: "client": "client.4559", 2024-04-18T14:44:34.764 INFO:teuthology.orchestra.run.smithi119.stdout: "client_addr": "172.21.15.134:0/3113589487", 2024-04-18T14:44:34.764 INFO:teuthology.orchestra.run.smithi119.stdout: "tid": 1011 2024-04-18T14:44:34.764 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:34.764 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-04-18T14:44:34.764 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:34.765 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-04-18T14:44:34.765 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:27.491974+0000", 2024-04-18T14:44:34.765 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:44:34.765 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:34.765 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:34.765 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-04-18T14:44:34.765 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:27.491974+0000", 2024-04-18T14:44:34.765 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:44:34.765 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:34.765 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:34.765 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-04-18T14:44:34.765 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:27.491973+0000", 2024-04-18T14:44:34.765 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4294967295.999999 2024-04-18T14:44:34.766 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:34.766 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:34.766 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-04-18T14:44:34.766 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:27.491978+0000", 2024-04-18T14:44:34.766 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 5.2340000000000002e-06 2024-04-18T14:44:34.766 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:34.766 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:34.766 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-04-18T14:44:34.766 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:27.491994+0000", 2024-04-18T14:44:34.766 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.5835999999999999e-05 2024-04-18T14:44:34.766 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:34.766 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:34.766 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-04-18T14:44:34.766 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:27.492003+0000", 2024-04-18T14:44:34.767 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 8.6570000000000003e-06 2024-04-18T14:44:34.767 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:34.767 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:34.767 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-04-18T14:44:34.767 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:27.492299+0000", 2024-04-18T14:44:34.767 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000296707 2024-04-18T14:44:34.767 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:34.767 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:34.767 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting_for_map not empty", 2024-04-18T14:44:34.767 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:27.492320+0000", 2024-04-18T14:44:34.767 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.0380000000000001e-05 2024-04-18T14:44:34.767 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:34.767 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:34.767 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-04-18T14:44:34.767 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:27.503027+0000", 2024-04-18T14:44:34.767 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.010707151 2024-04-18T14:44:34.768 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:34.768 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:34.768 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for blocked object", 2024-04-18T14:44:34.768 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:27.503162+0000", 2024-04-18T14:44:34.768 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00013498300000000001 2024-04-18T14:44:34.768 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:34.768 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:34.768 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-04-18T14:44:34.768 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:27.551458+0000", 2024-04-18T14:44:34.768 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.048296265999999997 2024-04-18T14:44:34.768 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:34.768 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:34.768 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-04-18T14:44:34.768 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:27.551704+0000", 2024-04-18T14:44:34.768 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00024583800000000001 2024-04-18T14:44:34.768 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:34.769 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:34.769 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-04-18T14:44:34.769 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:27.551876+0000", 2024-04-18T14:44:34.769 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000172256 2024-04-18T14:44:34.769 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:44:34.769 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-04-18T14:44:34.769 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:44:34.769 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:34.769 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:34.769 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(client.4559.0:1019 3.bs0 3:db6a9fd1:::smithi13430248-42:head [read 0~4685824,checksum,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e88)", 2024-04-18T14:44:34.769 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-04-18T14:44:27.492016+0000", 2024-04-18T14:44:34.770 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 7.1617818660000001, 2024-04-18T14:44:34.770 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.031444841000000001, 2024-04-18T14:44:34.770 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-04-18T14:44:34.770 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "started", 2024-04-18T14:44:34.770 INFO:teuthology.orchestra.run.smithi119.stdout: "client_info": { 2024-04-18T14:44:34.770 INFO:teuthology.orchestra.run.smithi119.stdout: "client": "client.4559", 2024-04-18T14:44:34.770 INFO:teuthology.orchestra.run.smithi119.stdout: "client_addr": "172.21.15.134:0/3113589487", 2024-04-18T14:44:34.770 INFO:teuthology.orchestra.run.smithi119.stdout: "tid": 1019 2024-04-18T14:44:34.770 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:34.770 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-04-18T14:44:34.770 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:34.770 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-04-18T14:44:34.771 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:27.492016+0000", 2024-04-18T14:44:34.771 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:44:34.771 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:34.771 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:34.771 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-04-18T14:44:34.771 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:27.492016+0000", 2024-04-18T14:44:34.771 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:44:34.771 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:34.771 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:34.771 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-04-18T14:44:34.771 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:27.492015+0000", 2024-04-18T14:44:34.771 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4294967295.999999 2024-04-18T14:44:34.771 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:34.772 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:34.772 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-04-18T14:44:34.772 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:27.492021+0000", 2024-04-18T14:44:34.772 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 6.1430000000000003e-06 2024-04-18T14:44:34.772 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:34.772 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:34.772 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-04-18T14:44:34.772 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:27.492041+0000", 2024-04-18T14:44:34.772 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.9922999999999999e-05 2024-04-18T14:44:34.772 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:34.772 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:34.772 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-04-18T14:44:34.772 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:27.492053+0000", 2024-04-18T14:44:34.773 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.1600000000000001e-05 2024-04-18T14:44:34.773 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:34.773 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:34.773 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-04-18T14:44:34.773 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:27.492179+0000", 2024-04-18T14:44:34.773 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00012608899999999999 2024-04-18T14:44:34.773 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:34.773 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:34.773 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "op must wait for map", 2024-04-18T14:44:34.773 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:27.492200+0000", 2024-04-18T14:44:34.773 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.1302999999999999e-05 2024-04-18T14:44:34.773 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:34.773 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:34.773 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-04-18T14:44:34.774 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:27.500638+0000", 2024-04-18T14:44:34.774 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0084373520000000004 2024-04-18T14:44:34.774 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:34.774 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:34.774 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-04-18T14:44:34.774 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:27.500909+0000", 2024-04-18T14:44:34.774 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000271828 2024-04-18T14:44:34.774 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:34.774 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:34.774 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-04-18T14:44:34.774 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:27.523461+0000", 2024-04-18T14:44:34.774 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.022551583 2024-04-18T14:44:34.774 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:44:34.774 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-04-18T14:44:34.775 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:44:34.775 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:34.775 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:34.775 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(client.4559.0:1020 3.bs0 3:db6a9fd1:::smithi13430248-42:head [read 0~4685824,checksum] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e88)", 2024-04-18T14:44:34.775 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-04-18T14:44:27.492072+0000", 2024-04-18T14:44:34.775 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 7.1617255169999998, 2024-04-18T14:44:34.775 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.038089304999999997, 2024-04-18T14:44:34.775 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-04-18T14:44:34.775 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "started", 2024-04-18T14:44:34.775 INFO:teuthology.orchestra.run.smithi119.stdout: "client_info": { 2024-04-18T14:44:34.775 INFO:teuthology.orchestra.run.smithi119.stdout: "client": "client.4559", 2024-04-18T14:44:34.775 INFO:teuthology.orchestra.run.smithi119.stdout: "client_addr": "172.21.15.134:0/3113589487", 2024-04-18T14:44:34.775 INFO:teuthology.orchestra.run.smithi119.stdout: "tid": 1020 2024-04-18T14:44:34.775 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:34.776 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-04-18T14:44:34.776 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:34.776 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-04-18T14:44:34.776 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:27.492072+0000", 2024-04-18T14:44:34.776 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:44:34.776 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:34.776 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:34.776 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-04-18T14:44:34.776 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:27.492072+0000", 2024-04-18T14:44:34.776 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:44:34.776 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:34.776 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:34.776 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-04-18T14:44:34.777 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:27.492071+0000", 2024-04-18T14:44:34.777 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4294967295.999999 2024-04-18T14:44:34.777 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:34.777 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:34.777 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-04-18T14:44:34.777 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:27.492079+0000", 2024-04-18T14:44:34.777 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 7.4970000000000004e-06 2024-04-18T14:44:34.777 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:34.777 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:34.777 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-04-18T14:44:34.777 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:27.492115+0000", 2024-04-18T14:44:34.777 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.5837000000000003e-05 2024-04-18T14:44:34.777 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:34.777 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:34.778 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-04-18T14:44:34.778 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:27.492130+0000", 2024-04-18T14:44:34.778 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.535e-05 2024-04-18T14:44:34.778 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:34.778 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:34.778 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-04-18T14:44:34.778 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:27.492295+0000", 2024-04-18T14:44:34.778 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00016445500000000001 2024-04-18T14:44:34.778 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:34.778 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:34.778 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting_for_map not empty", 2024-04-18T14:44:34.778 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:27.492315+0000", 2024-04-18T14:44:34.778 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.0136000000000002e-05 2024-04-18T14:44:34.778 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:34.779 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:34.779 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-04-18T14:44:34.779 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:27.501943+0000", 2024-04-18T14:44:34.779 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0096282360000000001 2024-04-18T14:44:34.779 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:34.779 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:34.779 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-04-18T14:44:34.779 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:27.502214+0000", 2024-04-18T14:44:34.779 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000271208 2024-04-18T14:44:34.779 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:34.779 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:34.779 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-04-18T14:44:34.779 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:27.530162+0000", 2024-04-18T14:44:34.779 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.027947663000000001 2024-04-18T14:44:34.779 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:44:34.779 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-04-18T14:44:34.780 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:44:34.780 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:34.780 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:34.780 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(client.4559.0:1021 3.bs0 3:db6a9fd1:::smithi13430248-42:head [read 0~4685824,checksum] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e88)", 2024-04-18T14:44:34.780 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-04-18T14:44:27.492197+0000", 2024-04-18T14:44:34.780 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 7.1616011679999998, 2024-04-18T14:44:34.780 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.043084339999999999, 2024-04-18T14:44:34.780 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-04-18T14:44:34.780 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "started", 2024-04-18T14:44:34.780 INFO:teuthology.orchestra.run.smithi119.stdout: "client_info": { 2024-04-18T14:44:34.780 INFO:teuthology.orchestra.run.smithi119.stdout: "client": "client.4559", 2024-04-18T14:44:34.780 INFO:teuthology.orchestra.run.smithi119.stdout: "client_addr": "172.21.15.134:0/3113589487", 2024-04-18T14:44:34.780 INFO:teuthology.orchestra.run.smithi119.stdout: "tid": 1021 2024-04-18T14:44:34.780 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:34.780 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-04-18T14:44:34.781 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:34.781 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-04-18T14:44:34.781 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:27.492197+0000", 2024-04-18T14:44:34.781 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:44:34.781 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:34.781 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:34.781 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-04-18T14:44:34.781 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:27.492197+0000", 2024-04-18T14:44:34.781 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:44:34.781 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:34.781 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:34.781 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-04-18T14:44:34.781 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:27.492195+0000", 2024-04-18T14:44:34.781 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4294967295.9999986 2024-04-18T14:44:34.781 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:34.782 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:34.782 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-04-18T14:44:34.782 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:27.492204+0000", 2024-04-18T14:44:34.782 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 8.8959999999999992e-06 2024-04-18T14:44:34.782 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:34.782 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:34.782 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-04-18T14:44:34.782 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:27.492224+0000", 2024-04-18T14:44:34.782 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.0154000000000001e-05 2024-04-18T14:44:34.782 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:34.782 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:34.782 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-04-18T14:44:34.782 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:27.492241+0000", 2024-04-18T14:44:34.782 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.6492999999999999e-05 2024-04-18T14:44:34.782 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:34.783 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:34.783 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-04-18T14:44:34.783 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:27.492384+0000", 2024-04-18T14:44:34.783 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000142726 2024-04-18T14:44:34.783 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:34.783 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:34.783 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting_for_map not empty", 2024-04-18T14:44:34.783 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:27.492402+0000", 2024-04-18T14:44:34.783 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.8618999999999999e-05 2024-04-18T14:44:34.783 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:34.783 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:34.783 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-04-18T14:44:34.783 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:27.507705+0000", 2024-04-18T14:44:34.783 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.015302906 2024-04-18T14:44:34.783 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:34.783 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:34.784 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-04-18T14:44:34.784 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:27.507962+0000", 2024-04-18T14:44:34.784 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00025716500000000001 2024-04-18T14:44:34.784 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:34.784 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:34.784 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-04-18T14:44:34.784 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:27.535281+0000", 2024-04-18T14:44:34.784 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.027318794 2024-04-18T14:44:34.784 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:44:34.784 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-04-18T14:44:34.784 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:44:34.784 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:44:34.784 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-04-18T14:44:34.784 INFO:teuthology.orchestra.run.smithi119.stdout:} 2024-04-18T14:44:34.786 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.14.asok dump_ops_in_flight 2024-04-18T14:44:34.912 INFO:teuthology.orchestra.run.smithi119.stdout:{ 2024-04-18T14:44:34.912 INFO:teuthology.orchestra.run.smithi119.stdout: "ops": [], 2024-04-18T14:44:34.912 INFO:teuthology.orchestra.run.smithi119.stdout: "num_ops": 0 2024-04-18T14:44:34.912 INFO:teuthology.orchestra.run.smithi119.stdout:} 2024-04-18T14:44:34.926 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.14.asok dump_blocked_ops 2024-04-18T14:44:35.050 INFO:teuthology.orchestra.run.smithi119.stdout:{ 2024-04-18T14:44:35.050 INFO:teuthology.orchestra.run.smithi119.stdout: "ops": [], 2024-04-18T14:44:35.050 INFO:teuthology.orchestra.run.smithi119.stdout: "complaint_time": 30, 2024-04-18T14:44:35.050 INFO:teuthology.orchestra.run.smithi119.stdout: "num_blocked_ops": 0 2024-04-18T14:44:35.050 INFO:teuthology.orchestra.run.smithi119.stdout:} 2024-04-18T14:44:35.064 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.14.asok dump_historic_ops 2024-04-18T14:44:35.188 INFO:teuthology.orchestra.run.smithi119.stdout:{ 2024-04-18T14:44:35.188 INFO:teuthology.orchestra.run.smithi119.stdout: "size": 20, 2024-04-18T14:44:35.188 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 600, 2024-04-18T14:44:35.188 INFO:teuthology.orchestra.run.smithi119.stdout: "ops": [ 2024-04-18T14:44:35.188 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:35.188 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(client.4559.0:183 3.7s0 3:e3a0e00d:::smithi13430248-30:head [copy-from ver 12] snapc 4=[4,2] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-18T14:44:35.188 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-04-18T14:43:36.725584+0000", 2024-04-18T14:44:35.188 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 58.464760687000002, 2024-04-18T14:44:35.188 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.032002501000000003, 2024-04-18T14:44:35.188 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-04-18T14:44:35.188 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T14:44:35.189 INFO:teuthology.orchestra.run.smithi119.stdout: "client_info": { 2024-04-18T14:44:35.189 INFO:teuthology.orchestra.run.smithi119.stdout: "client": "client.4559", 2024-04-18T14:44:35.189 INFO:teuthology.orchestra.run.smithi119.stdout: "client_addr": "172.21.15.134:0/3113589487", 2024-04-18T14:44:35.189 INFO:teuthology.orchestra.run.smithi119.stdout: "tid": 183 2024-04-18T14:44:35.189 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:35.189 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-04-18T14:44:35.189 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:35.189 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-04-18T14:44:35.189 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:36.725584+0000", 2024-04-18T14:44:35.189 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:44:35.189 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:35.189 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:35.189 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-04-18T14:44:35.189 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:36.725584+0000", 2024-04-18T14:44:35.190 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:44:35.190 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:35.190 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:35.190 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-04-18T14:44:35.190 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:36.725582+0000", 2024-04-18T14:44:35.190 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4294967295.9999976 2024-04-18T14:44:35.190 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:35.190 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:35.190 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-04-18T14:44:35.190 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:36.725595+0000", 2024-04-18T14:44:35.190 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.325e-05 2024-04-18T14:44:35.190 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:35.190 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:35.191 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-04-18T14:44:35.191 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:36.725618+0000", 2024-04-18T14:44:35.191 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.2574000000000001e-05 2024-04-18T14:44:35.191 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:35.191 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:35.191 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-04-18T14:44:35.191 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:36.725633+0000", 2024-04-18T14:44:35.191 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.5197e-05 2024-04-18T14:44:35.191 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:35.191 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:35.191 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-04-18T14:44:35.191 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:36.725764+0000", 2024-04-18T14:44:35.191 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00013052300000000001 2024-04-18T14:44:35.191 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:35.191 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:35.192 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "op must wait for map", 2024-04-18T14:44:35.192 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:36.725784+0000", 2024-04-18T14:44:35.192 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.0111000000000001e-05 2024-04-18T14:44:35.192 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:35.192 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:35.192 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-04-18T14:44:35.192 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:36.731424+0000", 2024-04-18T14:44:35.192 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0056403479999999999 2024-04-18T14:44:35.192 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:35.192 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:35.192 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-04-18T14:44:35.192 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:36.731754+0000", 2024-04-18T14:44:35.192 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00032950200000000002 2024-04-18T14:44:35.192 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:35.192 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:35.193 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_started", 2024-04-18T14:44:35.193 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:36.748259+0000", 2024-04-18T14:44:35.193 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.016505701000000001 2024-04-18T14:44:35.193 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:35.193 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:35.193 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_committed", 2024-04-18T14:44:35.193 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:36.751859+0000", 2024-04-18T14:44:35.193 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.003599671 2024-04-18T14:44:35.193 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:35.193 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:35.193 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-04-18T14:44:35.193 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:36.757474+0000", 2024-04-18T14:44:35.193 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0056144810000000002 2024-04-18T14:44:35.193 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:35.194 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:35.194 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-04-18T14:44:35.194 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:36.757587+0000", 2024-04-18T14:44:35.194 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000113393 2024-04-18T14:44:35.194 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:44:35.194 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-04-18T14:44:35.194 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:44:35.194 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:35.194 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:35.194 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(client.4559.0:184 3.7s0 3:e3a0e00d:::smithi13430248-30:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e37)", 2024-04-18T14:44:35.194 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-04-18T14:43:36.725653+0000", 2024-04-18T14:44:35.194 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 58.464692206000002, 2024-04-18T14:44:35.194 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.025569002, 2024-04-18T14:44:35.194 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-04-18T14:44:35.195 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "started", 2024-04-18T14:44:35.195 INFO:teuthology.orchestra.run.smithi119.stdout: "client_info": { 2024-04-18T14:44:35.195 INFO:teuthology.orchestra.run.smithi119.stdout: "client": "client.4559", 2024-04-18T14:44:35.195 INFO:teuthology.orchestra.run.smithi119.stdout: "client_addr": "172.21.15.134:0/3113589487", 2024-04-18T14:44:35.195 INFO:teuthology.orchestra.run.smithi119.stdout: "tid": 184 2024-04-18T14:44:35.195 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:35.195 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-04-18T14:44:35.195 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:35.195 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-04-18T14:44:35.195 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:36.725653+0000", 2024-04-18T14:44:35.195 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:44:35.196 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:35.196 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:35.196 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-04-18T14:44:35.196 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:36.725653+0000", 2024-04-18T14:44:35.196 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:44:35.196 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:35.196 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:35.196 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-04-18T14:44:35.196 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:36.725652+0000", 2024-04-18T14:44:35.196 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4294967295.999999 2024-04-18T14:44:35.196 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:35.196 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:35.196 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-04-18T14:44:35.196 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:36.725657+0000", 2024-04-18T14:44:35.197 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4.5170000000000001e-06 2024-04-18T14:44:35.197 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:35.197 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:35.197 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-04-18T14:44:35.197 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:36.725670+0000", 2024-04-18T14:44:35.197 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.3536999999999999e-05 2024-04-18T14:44:35.197 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:35.197 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:35.197 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-04-18T14:44:35.197 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:36.725678+0000", 2024-04-18T14:44:35.197 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 8.2099999999999993e-06 2024-04-18T14:44:35.197 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:35.197 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:35.197 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-04-18T14:44:35.197 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:36.725920+0000", 2024-04-18T14:44:35.197 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00024127299999999999 2024-04-18T14:44:35.198 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:35.198 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:35.198 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting_for_map not empty", 2024-04-18T14:44:35.198 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:36.725937+0000", 2024-04-18T14:44:35.198 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.7011e-05 2024-04-18T14:44:35.198 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:35.198 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:35.198 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-04-18T14:44:35.198 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:36.732196+0000", 2024-04-18T14:44:35.198 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0062595209999999997 2024-04-18T14:44:35.198 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:35.198 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:35.198 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for blocked object", 2024-04-18T14:44:35.198 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:36.732319+0000", 2024-04-18T14:44:35.199 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000122977 2024-04-18T14:44:35.199 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:35.199 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:35.199 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-04-18T14:44:35.199 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:36.750655+0000", 2024-04-18T14:44:35.199 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.018336431 2024-04-18T14:44:35.199 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:35.199 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:35.199 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-04-18T14:44:35.199 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:36.750956+0000", 2024-04-18T14:44:35.199 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00030036800000000002 2024-04-18T14:44:35.199 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:35.199 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:35.199 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-04-18T14:44:35.199 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:36.751222+0000", 2024-04-18T14:44:35.200 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00026612000000000001 2024-04-18T14:44:35.200 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:44:35.200 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-04-18T14:44:35.200 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:44:35.200 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:35.200 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:35.200 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(client.4559.0:242 3.7s0 3:e2767c91:::smithi13430248-5:head [copy-from ver 2] snapc 8=[8,7,4,2] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-04-18T14:44:35.200 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-04-18T14:43:40.759272+0000", 2024-04-18T14:44:35.200 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 54.431073140000002, 2024-04-18T14:44:35.200 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.031013309999999999, 2024-04-18T14:44:35.200 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-04-18T14:44:35.200 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T14:44:35.200 INFO:teuthology.orchestra.run.smithi119.stdout: "client_info": { 2024-04-18T14:44:35.200 INFO:teuthology.orchestra.run.smithi119.stdout: "client": "client.4559", 2024-04-18T14:44:35.200 INFO:teuthology.orchestra.run.smithi119.stdout: "client_addr": "172.21.15.134:0/3113589487", 2024-04-18T14:44:35.201 INFO:teuthology.orchestra.run.smithi119.stdout: "tid": 242 2024-04-18T14:44:35.201 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:35.201 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-04-18T14:44:35.201 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:35.201 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-04-18T14:44:35.201 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:40.759272+0000", 2024-04-18T14:44:35.201 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:44:35.201 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:35.201 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:35.201 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-04-18T14:44:35.201 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:40.759272+0000", 2024-04-18T14:44:35.201 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:44:35.201 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:35.201 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:35.202 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-04-18T14:44:35.202 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:40.759269+0000", 2024-04-18T14:44:35.202 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4294967295.9999971 2024-04-18T14:44:35.202 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:35.202 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:35.202 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-04-18T14:44:35.202 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:40.759294+0000", 2024-04-18T14:44:35.202 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.5335999999999999e-05 2024-04-18T14:44:35.202 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:35.202 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:35.202 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-04-18T14:44:35.202 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:40.759330+0000", 2024-04-18T14:44:35.202 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.5531000000000003e-05 2024-04-18T14:44:35.202 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:35.203 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:35.203 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-04-18T14:44:35.203 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:40.759353+0000", 2024-04-18T14:44:35.203 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.3441000000000001e-05 2024-04-18T14:44:35.203 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:35.203 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:35.203 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-04-18T14:44:35.203 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:40.760398+0000", 2024-04-18T14:44:35.203 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00104484 2024-04-18T14:44:35.203 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:35.203 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:35.203 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-04-18T14:44:35.203 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:40.760662+0000", 2024-04-18T14:44:35.203 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00026342599999999998 2024-04-18T14:44:35.203 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:35.204 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:35.204 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_started", 2024-04-18T14:44:35.204 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:40.783559+0000", 2024-04-18T14:44:35.204 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.022896989 2024-04-18T14:44:35.204 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:35.204 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:35.204 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_committed", 2024-04-18T14:44:35.204 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:40.789488+0000", 2024-04-18T14:44:35.204 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0059289260000000002 2024-04-18T14:44:35.204 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:35.204 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:35.204 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-04-18T14:44:35.204 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:40.790079+0000", 2024-04-18T14:44:35.204 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00059128299999999996 2024-04-18T14:44:35.204 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:35.205 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:35.205 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-04-18T14:44:35.205 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:40.790285+0000", 2024-04-18T14:44:35.205 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000206448 2024-04-18T14:44:35.205 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:44:35.205 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-04-18T14:44:35.205 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:44:35.205 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:35.205 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:35.205 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(client.4559.0:243 3.7s0 3:e2767c91:::smithi13430248-5:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e41)", 2024-04-18T14:44:35.205 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-04-18T14:43:40.759392+0000", 2024-04-18T14:44:35.205 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 54.430952914999999, 2024-04-18T14:44:35.205 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.032366368, 2024-04-18T14:44:35.205 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-04-18T14:44:35.206 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "started", 2024-04-18T14:44:35.206 INFO:teuthology.orchestra.run.smithi119.stdout: "client_info": { 2024-04-18T14:44:35.206 INFO:teuthology.orchestra.run.smithi119.stdout: "client": "client.4559", 2024-04-18T14:44:35.206 INFO:teuthology.orchestra.run.smithi119.stdout: "client_addr": "172.21.15.134:0/3113589487", 2024-04-18T14:44:35.206 INFO:teuthology.orchestra.run.smithi119.stdout: "tid": 243 2024-04-18T14:44:35.206 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:35.206 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-04-18T14:44:35.206 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:35.206 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-04-18T14:44:35.206 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:40.759392+0000", 2024-04-18T14:44:35.206 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:44:35.206 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:35.206 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:35.206 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-04-18T14:44:35.206 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:40.759392+0000", 2024-04-18T14:44:35.207 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:44:35.207 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:35.207 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:35.207 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-04-18T14:44:35.207 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:40.759391+0000", 2024-04-18T14:44:35.207 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4294967295.9999986 2024-04-18T14:44:35.207 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:35.207 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:35.207 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-04-18T14:44:35.207 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:40.759400+0000", 2024-04-18T14:44:35.207 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 8.9770000000000006e-06 2024-04-18T14:44:35.207 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:35.207 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:35.207 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-04-18T14:44:35.207 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:40.759421+0000", 2024-04-18T14:44:35.208 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.1557e-05 2024-04-18T14:44:35.208 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:35.208 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:35.208 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-04-18T14:44:35.208 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:40.759438+0000", 2024-04-18T14:44:35.208 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.6663999999999998e-05 2024-04-18T14:44:35.208 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:35.208 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:35.208 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-04-18T14:44:35.208 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:40.761106+0000", 2024-04-18T14:44:35.208 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.001668367 2024-04-18T14:44:35.208 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:35.208 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:35.208 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for blocked object", 2024-04-18T14:44:35.208 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:40.761224+0000", 2024-04-18T14:44:35.209 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000117376 2024-04-18T14:44:35.209 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:35.209 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:35.209 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-04-18T14:44:35.209 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:40.791296+0000", 2024-04-18T14:44:35.209 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.030072040000000001 2024-04-18T14:44:35.209 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:35.209 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:35.209 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-04-18T14:44:35.209 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:40.791484+0000", 2024-04-18T14:44:35.209 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000188717 2024-04-18T14:44:35.209 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:35.209 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:35.209 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-04-18T14:44:35.210 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:43:40.791759+0000", 2024-04-18T14:44:35.210 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00027425000000000003 2024-04-18T14:44:35.210 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:44:35.210 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-04-18T14:44:35.210 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:44:35.210 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:35.210 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:35.210 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "MOSDECSubOpWrite(3.4s2 68/30 ECSubWrite(tid=63, reqid=osd.10.0:63, at_version=68'20, trim_to=0'0, roll_forward_to=65'18))", 2024-04-18T14:44:35.210 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-04-18T14:44:07.411065+0000", 2024-04-18T14:44:35.210 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 27.77927991, 2024-04-18T14:44:35.210 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.024750998, 2024-04-18T14:44:35.210 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-04-18T14:44:35.210 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "reached pg", 2024-04-18T14:44:35.210 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-04-18T14:44:35.211 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:35.211 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-04-18T14:44:35.211 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:07.411065+0000", 2024-04-18T14:44:35.211 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:44:35.211 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:35.211 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:35.211 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-04-18T14:44:35.211 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:07.411065+0000", 2024-04-18T14:44:35.211 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:44:35.211 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:35.211 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:35.211 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-04-18T14:44:35.211 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:07.411064+0000", 2024-04-18T14:44:35.211 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4294967295.999999 2024-04-18T14:44:35.212 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:35.212 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:35.212 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-04-18T14:44:35.212 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:07.411123+0000", 2024-04-18T14:44:35.212 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 5.8686e-05 2024-04-18T14:44:35.212 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:35.212 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:35.212 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-04-18T14:44:35.212 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:07.411151+0000", 2024-04-18T14:44:35.212 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.8056999999999999e-05 2024-04-18T14:44:35.212 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:35.212 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:35.212 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-04-18T14:44:35.212 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:07.411171+0000", 2024-04-18T14:44:35.212 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.0233000000000001e-05 2024-04-18T14:44:35.212 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:35.213 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:35.213 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-04-18T14:44:35.213 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:07.411295+0000", 2024-04-18T14:44:35.213 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000124012 2024-04-18T14:44:35.213 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:35.213 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:35.213 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_started", 2024-04-18T14:44:35.213 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:07.411321+0000", 2024-04-18T14:44:35.213 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.6069999999999999e-05 2024-04-18T14:44:35.213 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:35.213 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:35.213 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_committed", 2024-04-18T14:44:35.213 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:07.435757+0000", 2024-04-18T14:44:35.213 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.024435779000000001 2024-04-18T14:44:35.214 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:35.214 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:35.214 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-04-18T14:44:35.214 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:07.435816+0000", 2024-04-18T14:44:35.214 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 5.9256999999999999e-05 2024-04-18T14:44:35.214 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:44:35.214 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-04-18T14:44:35.214 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:44:35.214 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:35.214 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:35.214 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "MOSDECSubOpWrite(3.fs4 68/30 ECSubWrite(tid=165, reqid=osd.11.0:165, at_version=68'34, trim_to=0'0, roll_forward_to=65'32))", 2024-04-18T14:44:35.214 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-04-18T14:44:07.412419+0000", 2024-04-18T14:44:35.214 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 27.777926142999998, 2024-04-18T14:44:35.214 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.029301166, 2024-04-18T14:44:35.215 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-04-18T14:44:35.215 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "reached pg", 2024-04-18T14:44:35.215 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-04-18T14:44:35.215 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:35.215 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-04-18T14:44:35.215 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:07.412419+0000", 2024-04-18T14:44:35.215 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:44:35.215 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:35.215 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:35.215 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-04-18T14:44:35.215 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:07.412419+0000", 2024-04-18T14:44:35.215 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:44:35.215 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:35.215 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:35.216 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-04-18T14:44:35.216 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:07.412418+0000", 2024-04-18T14:44:35.216 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4294967295.999999 2024-04-18T14:44:35.216 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:35.216 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:35.216 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-04-18T14:44:35.216 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:07.412468+0000", 2024-04-18T14:44:35.216 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 5.0274e-05 2024-04-18T14:44:35.216 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:35.216 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:35.216 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-04-18T14:44:35.216 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:07.412493+0000", 2024-04-18T14:44:35.216 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.5052e-05 2024-04-18T14:44:35.216 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:35.216 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:35.217 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-04-18T14:44:35.217 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:07.412512+0000", 2024-04-18T14:44:35.217 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.8176999999999999e-05 2024-04-18T14:44:35.217 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:35.217 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:35.217 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-04-18T14:44:35.217 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:07.412620+0000", 2024-04-18T14:44:35.217 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000108429 2024-04-18T14:44:35.217 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:35.217 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:35.217 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_started", 2024-04-18T14:44:35.217 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:07.412646+0000", 2024-04-18T14:44:35.217 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.6310000000000001e-05 2024-04-18T14:44:35.217 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:35.218 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:35.218 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_committed", 2024-04-18T14:44:35.218 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:07.441671+0000", 2024-04-18T14:44:35.218 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.029024583999999999 2024-04-18T14:44:35.218 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:35.218 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:35.218 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-04-18T14:44:35.218 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:07.441720+0000", 2024-04-18T14:44:35.218 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4.9237000000000003e-05 2024-04-18T14:44:35.218 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:44:35.218 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-04-18T14:44:35.218 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:44:35.218 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:35.218 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:35.218 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "MOSDECSubOpWrite(3.fs4 68/30 ECSubWrite(tid=167, reqid=osd.11.0:167, at_version=68'36, trim_to=0'0, roll_forward_to=65'32))", 2024-04-18T14:44:35.219 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-04-18T14:44:07.413949+0000", 2024-04-18T14:44:35.219 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 27.776396068, 2024-04-18T14:44:35.219 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.02828085, 2024-04-18T14:44:35.219 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-04-18T14:44:35.219 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "reached pg", 2024-04-18T14:44:35.219 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-04-18T14:44:35.219 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:35.219 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-04-18T14:44:35.219 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:07.413949+0000", 2024-04-18T14:44:35.219 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:44:35.219 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:35.219 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:35.219 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-04-18T14:44:35.219 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:07.413949+0000", 2024-04-18T14:44:35.219 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:44:35.220 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:35.220 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:35.220 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-04-18T14:44:35.220 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:07.413947+0000", 2024-04-18T14:44:35.220 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4294967295.9999981 2024-04-18T14:44:35.220 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:35.220 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:35.220 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-04-18T14:44:35.220 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:07.414001+0000", 2024-04-18T14:44:35.220 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 5.3220000000000002e-05 2024-04-18T14:44:35.220 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:35.220 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:35.220 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-04-18T14:44:35.221 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:07.414034+0000", 2024-04-18T14:44:35.221 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.2985999999999999e-05 2024-04-18T14:44:35.221 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:35.221 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:35.221 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-04-18T14:44:35.221 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:07.414106+0000", 2024-04-18T14:44:35.221 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 7.2255999999999994e-05 2024-04-18T14:44:35.221 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:35.221 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:35.221 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-04-18T14:44:35.221 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:07.422158+0000", 2024-04-18T14:44:35.221 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0080523190000000005 2024-04-18T14:44:35.221 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:35.221 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:35.221 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_started", 2024-04-18T14:44:35.222 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:07.422185+0000", 2024-04-18T14:44:35.222 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.6928999999999999e-05 2024-04-18T14:44:35.222 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:35.222 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:35.222 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_committed", 2024-04-18T14:44:35.222 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:07.442178+0000", 2024-04-18T14:44:35.222 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.019992916999999999 2024-04-18T14:44:35.222 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:35.222 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:35.222 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-04-18T14:44:35.222 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:07.442230+0000", 2024-04-18T14:44:35.222 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 5.1990000000000002e-05 2024-04-18T14:44:35.222 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:44:35.222 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-04-18T14:44:35.222 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:44:35.223 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:35.223 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:35.223 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "MOSDECSubOpWriteReply(3.7s0 68/30 ECSubWriteReply(tid=203, last_complete=68'90, committed=1, applied=1))", 2024-04-18T14:44:35.223 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-04-18T14:44:07.417478+0000", 2024-04-18T14:44:35.223 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 27.772866874999998, 2024-04-18T14:44:35.223 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.023983576, 2024-04-18T14:44:35.223 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-04-18T14:44:35.223 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "reached pg", 2024-04-18T14:44:35.223 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-04-18T14:44:35.223 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:35.223 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-04-18T14:44:35.223 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:07.417478+0000", 2024-04-18T14:44:35.223 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:44:35.223 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:35.224 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:35.224 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-04-18T14:44:35.224 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:07.417478+0000", 2024-04-18T14:44:35.224 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:44:35.224 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:35.224 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:35.224 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-04-18T14:44:35.224 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:07.417477+0000", 2024-04-18T14:44:35.224 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4294967295.9999981 2024-04-18T14:44:35.224 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:35.224 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:35.224 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-04-18T14:44:35.224 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:07.417487+0000", 2024-04-18T14:44:35.224 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.076e-05 2024-04-18T14:44:35.225 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:35.225 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:35.225 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-04-18T14:44:35.225 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:07.417521+0000", 2024-04-18T14:44:35.225 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.3426999999999997e-05 2024-04-18T14:44:35.225 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:35.225 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:35.225 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-04-18T14:44:35.225 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:07.417541+0000", 2024-04-18T14:44:35.225 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.0296e-05 2024-04-18T14:44:35.225 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:35.225 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:35.225 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-04-18T14:44:35.225 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:07.441431+0000", 2024-04-18T14:44:35.225 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.023889924 2024-04-18T14:44:35.226 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:35.226 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:35.226 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-04-18T14:44:35.226 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:07.441462+0000", 2024-04-18T14:44:35.226 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.0892999999999997e-05 2024-04-18T14:44:35.226 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:44:35.226 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-04-18T14:44:35.226 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:44:35.226 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:35.226 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:35.226 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "MOSDECSubOpWriteReply(3.7s0 68/30 ECSubWriteReply(tid=203, last_complete=68'90, committed=1, applied=1))", 2024-04-18T14:44:35.226 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-04-18T14:44:07.418200+0000", 2024-04-18T14:44:35.226 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 27.772145477999999, 2024-04-18T14:44:35.226 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.023339612999999999, 2024-04-18T14:44:35.227 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-04-18T14:44:35.227 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "reached pg", 2024-04-18T14:44:35.227 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-04-18T14:44:35.227 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:35.227 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-04-18T14:44:35.227 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:07.418200+0000", 2024-04-18T14:44:35.227 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:44:35.227 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:35.227 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:35.227 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-04-18T14:44:35.227 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:07.418200+0000", 2024-04-18T14:44:35.227 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:44:35.227 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:35.227 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:35.228 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-04-18T14:44:35.228 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:07.418198+0000", 2024-04-18T14:44:35.228 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4294967295.9999981 2024-04-18T14:44:35.228 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:35.228 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:35.228 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-04-18T14:44:35.228 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:07.418211+0000", 2024-04-18T14:44:35.228 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.2993000000000001e-05 2024-04-18T14:44:35.228 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:35.228 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:35.228 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-04-18T14:44:35.228 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:07.418250+0000", 2024-04-18T14:44:35.228 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.8902999999999997e-05 2024-04-18T14:44:35.228 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:35.228 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:35.229 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-04-18T14:44:35.229 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:07.418270+0000", 2024-04-18T14:44:35.229 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.9749999999999999e-05 2024-04-18T14:44:35.229 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:35.229 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:35.229 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-04-18T14:44:35.229 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:07.441515+0000", 2024-04-18T14:44:35.229 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.023245717999999999 2024-04-18T14:44:35.229 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:35.229 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:35.229 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-04-18T14:44:35.229 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:07.441539+0000", 2024-04-18T14:44:35.229 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.3961999999999999e-05 2024-04-18T14:44:35.229 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:44:35.230 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-04-18T14:44:35.230 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:44:35.230 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:35.230 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:35.230 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(client.4559.0:739 3.6s0 3:6cb0c218:::smithi13430248-40:head [read 0~4620288,checksum,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e72)", 2024-04-18T14:44:35.230 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-04-18T14:44:11.755981+0000", 2024-04-18T14:44:35.230 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 23.434364526, 2024-04-18T14:44:35.230 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.047836126999999999, 2024-04-18T14:44:35.230 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-04-18T14:44:35.230 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "started", 2024-04-18T14:44:35.230 INFO:teuthology.orchestra.run.smithi119.stdout: "client_info": { 2024-04-18T14:44:35.230 INFO:teuthology.orchestra.run.smithi119.stdout: "client": "client.4559", 2024-04-18T14:44:35.230 INFO:teuthology.orchestra.run.smithi119.stdout: "client_addr": "172.21.15.134:0/3113589487", 2024-04-18T14:44:35.231 INFO:teuthology.orchestra.run.smithi119.stdout: "tid": 739 2024-04-18T14:44:35.231 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:35.231 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-04-18T14:44:35.231 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:35.231 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-04-18T14:44:35.231 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:11.755981+0000", 2024-04-18T14:44:35.231 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:44:35.231 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:35.231 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:35.231 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-04-18T14:44:35.231 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:11.755981+0000", 2024-04-18T14:44:35.231 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:44:35.231 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:35.231 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:35.231 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-04-18T14:44:35.232 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:11.755978+0000", 2024-04-18T14:44:35.232 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4294967295.9999976 2024-04-18T14:44:35.232 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:35.232 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:35.232 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-04-18T14:44:35.232 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:11.755990+0000", 2024-04-18T14:44:35.232 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.1939999999999999e-05 2024-04-18T14:44:35.232 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:35.232 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:35.232 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-04-18T14:44:35.232 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:11.756017+0000", 2024-04-18T14:44:35.232 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.6556000000000001e-05 2024-04-18T14:44:35.232 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:35.232 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:35.232 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-04-18T14:44:35.233 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:11.756030+0000", 2024-04-18T14:44:35.233 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.3634e-05 2024-04-18T14:44:35.233 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:35.233 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:35.233 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-04-18T14:44:35.233 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:11.756134+0000", 2024-04-18T14:44:35.233 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000103612 2024-04-18T14:44:35.233 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:35.233 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:35.233 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-04-18T14:44:35.233 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:11.756310+0000", 2024-04-18T14:44:35.233 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000176532 2024-04-18T14:44:35.233 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:35.234 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:35.234 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-04-18T14:44:35.234 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:11.803817+0000", 2024-04-18T14:44:35.234 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.047506449999999999 2024-04-18T14:44:35.234 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:44:35.234 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-04-18T14:44:35.234 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:44:35.234 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:35.234 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:35.234 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(client.4559.0:740 3.6s0 3:6cb0c218:::smithi13430248-40:head [read 0~4620288,checksum] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e72)", 2024-04-18T14:44:35.234 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-04-18T14:44:11.756052+0000", 2024-04-18T14:44:35.234 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 23.434293539999999, 2024-04-18T14:44:35.234 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.054222003999999997, 2024-04-18T14:44:35.234 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-04-18T14:44:35.235 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "started", 2024-04-18T14:44:35.235 INFO:teuthology.orchestra.run.smithi119.stdout: "client_info": { 2024-04-18T14:44:35.235 INFO:teuthology.orchestra.run.smithi119.stdout: "client": "client.4559", 2024-04-18T14:44:35.235 INFO:teuthology.orchestra.run.smithi119.stdout: "client_addr": "172.21.15.134:0/3113589487", 2024-04-18T14:44:35.235 INFO:teuthology.orchestra.run.smithi119.stdout: "tid": 740 2024-04-18T14:44:35.235 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:35.235 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-04-18T14:44:35.235 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:35.235 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-04-18T14:44:35.235 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:11.756052+0000", 2024-04-18T14:44:35.235 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:44:35.235 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:35.235 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:35.235 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-04-18T14:44:35.236 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:11.756052+0000", 2024-04-18T14:44:35.236 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:44:35.236 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:35.236 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:35.236 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-04-18T14:44:35.236 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:11.756050+0000", 2024-04-18T14:44:35.236 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4294967295.9999986 2024-04-18T14:44:35.236 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:35.236 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:35.236 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-04-18T14:44:35.236 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:11.756058+0000", 2024-04-18T14:44:35.236 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 7.9400000000000002e-06 2024-04-18T14:44:35.236 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:35.237 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:35.237 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-04-18T14:44:35.237 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:11.756087+0000", 2024-04-18T14:44:35.237 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.8799e-05 2024-04-18T14:44:35.237 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:35.237 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:35.237 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-04-18T14:44:35.237 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:11.756098+0000", 2024-04-18T14:44:35.237 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.1257000000000001e-05 2024-04-18T14:44:35.237 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:35.237 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:35.237 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-04-18T14:44:35.237 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:11.756813+0000", 2024-04-18T14:44:35.237 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00071503400000000003 2024-04-18T14:44:35.237 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:35.238 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:35.238 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-04-18T14:44:35.238 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:11.756990+0000", 2024-04-18T14:44:35.238 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000177162 2024-04-18T14:44:35.238 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:35.238 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:35.238 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-04-18T14:44:35.238 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:11.810274+0000", 2024-04-18T14:44:35.238 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.053283125000000001 2024-04-18T14:44:35.238 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:44:35.238 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-04-18T14:44:35.238 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:44:35.238 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:35.239 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:35.239 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(client.4559.0:741 3.6s0 3:6cb0c218:::smithi13430248-40:head [read 0~4620288,checksum] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e72)", 2024-04-18T14:44:35.239 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-04-18T14:44:11.756113+0000", 2024-04-18T14:44:35.239 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 23.434232027, 2024-04-18T14:44:35.239 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.058071340999999999, 2024-04-18T14:44:35.239 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-04-18T14:44:35.239 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "started", 2024-04-18T14:44:35.239 INFO:teuthology.orchestra.run.smithi119.stdout: "client_info": { 2024-04-18T14:44:35.239 INFO:teuthology.orchestra.run.smithi119.stdout: "client": "client.4559", 2024-04-18T14:44:35.239 INFO:teuthology.orchestra.run.smithi119.stdout: "client_addr": "172.21.15.134:0/3113589487", 2024-04-18T14:44:35.239 INFO:teuthology.orchestra.run.smithi119.stdout: "tid": 741 2024-04-18T14:44:35.239 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:35.239 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-04-18T14:44:35.239 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:35.240 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-04-18T14:44:35.240 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:11.756113+0000", 2024-04-18T14:44:35.240 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:44:35.240 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:35.240 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:35.240 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-04-18T14:44:35.240 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:11.756113+0000", 2024-04-18T14:44:35.240 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:44:35.240 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:35.240 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:35.240 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-04-18T14:44:35.240 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:11.756112+0000", 2024-04-18T14:44:35.240 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4294967295.999999 2024-04-18T14:44:35.240 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:35.240 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:35.241 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-04-18T14:44:35.241 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:11.756119+0000", 2024-04-18T14:44:35.241 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 7.4760000000000001e-06 2024-04-18T14:44:35.241 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:35.241 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:35.241 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-04-18T14:44:35.241 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:11.756137+0000", 2024-04-18T14:44:35.241 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.785e-05 2024-04-18T14:44:35.241 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:35.241 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:35.241 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-04-18T14:44:35.241 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:11.756152+0000", 2024-04-18T14:44:35.241 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.4917e-05 2024-04-18T14:44:35.241 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:35.241 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:35.242 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-04-18T14:44:35.242 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:11.757436+0000", 2024-04-18T14:44:35.242 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0012834299999999999 2024-04-18T14:44:35.242 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:35.242 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:35.242 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-04-18T14:44:35.242 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:11.757573+0000", 2024-04-18T14:44:35.242 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000137102 2024-04-18T14:44:35.242 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:35.242 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:35.242 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-04-18T14:44:35.242 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:11.814184+0000", 2024-04-18T14:44:35.242 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.056611692999999998 2024-04-18T14:44:35.242 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:44:35.243 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-04-18T14:44:35.243 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:44:35.243 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:35.243 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:35.243 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "MOSDECSubOpReadReply(3.6s0 72/70 ECSubReadReply(tid=262, attrs_read=0))", 2024-04-18T14:44:35.243 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-04-18T14:44:11.761136+0000", 2024-04-18T14:44:35.243 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 23.429209245999999, 2024-04-18T14:44:35.243 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.047821245999999998, 2024-04-18T14:44:35.243 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-04-18T14:44:35.243 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "reached pg", 2024-04-18T14:44:35.243 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-04-18T14:44:35.243 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:35.243 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-04-18T14:44:35.243 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:11.761136+0000", 2024-04-18T14:44:35.243 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:44:35.244 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:35.244 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:35.244 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-04-18T14:44:35.244 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:11.761136+0000", 2024-04-18T14:44:35.244 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:44:35.244 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:35.244 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:35.244 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-04-18T14:44:35.244 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:11.761135+0000", 2024-04-18T14:44:35.244 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4294967295.999999 2024-04-18T14:44:35.244 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:35.244 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:35.244 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-04-18T14:44:35.244 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:11.796983+0000", 2024-04-18T14:44:35.244 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.035847885000000003 2024-04-18T14:44:35.245 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:35.245 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:35.245 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-04-18T14:44:35.245 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:11.797014+0000", 2024-04-18T14:44:35.245 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.0700000000000001e-05 2024-04-18T14:44:35.245 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:35.245 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:35.245 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-04-18T14:44:35.245 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:11.797031+0000", 2024-04-18T14:44:35.245 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.7136e-05 2024-04-18T14:44:35.245 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:35.245 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:35.245 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-04-18T14:44:35.245 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:11.798153+0000", 2024-04-18T14:44:35.245 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.001122348 2024-04-18T14:44:35.246 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:35.246 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:35.246 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-04-18T14:44:35.246 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:11.808957+0000", 2024-04-18T14:44:35.246 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.010804123000000001 2024-04-18T14:44:35.246 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:44:35.246 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-04-18T14:44:35.246 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:44:35.246 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:35.246 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:35.246 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "MOSDECSubOpReadReply(3.6s0 72/70 ECSubReadReply(tid=264, attrs_read=0))", 2024-04-18T14:44:35.246 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-04-18T14:44:11.781826+0000", 2024-04-18T14:44:35.246 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 23.408519214999998, 2024-04-18T14:44:35.246 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.032528864999999997, 2024-04-18T14:44:35.246 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-04-18T14:44:35.247 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "reached pg", 2024-04-18T14:44:35.247 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-04-18T14:44:35.247 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:35.247 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-04-18T14:44:35.247 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:11.781826+0000", 2024-04-18T14:44:35.247 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:44:35.247 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:35.247 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:35.247 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-04-18T14:44:35.247 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:11.781826+0000", 2024-04-18T14:44:35.247 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:44:35.247 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:35.247 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:35.247 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-04-18T14:44:35.247 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:11.781825+0000", 2024-04-18T14:44:35.248 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4294967295.9999986 2024-04-18T14:44:35.248 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:35.248 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:35.248 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-04-18T14:44:35.248 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:11.809717+0000", 2024-04-18T14:44:35.248 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.02789206 2024-04-18T14:44:35.248 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:35.248 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:35.248 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-04-18T14:44:35.248 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:11.809749+0000", 2024-04-18T14:44:35.248 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.2772999999999999e-05 2024-04-18T14:44:35.248 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:35.248 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:35.248 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-04-18T14:44:35.248 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:11.809769+0000", 2024-04-18T14:44:35.249 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.9623000000000002e-05 2024-04-18T14:44:35.249 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:35.249 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:35.249 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-04-18T14:44:35.249 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:11.810656+0000", 2024-04-18T14:44:35.249 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00088651599999999995 2024-04-18T14:44:35.249 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:35.249 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:35.249 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-04-18T14:44:35.249 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:11.814355+0000", 2024-04-18T14:44:35.249 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0036992459999999998 2024-04-18T14:44:35.249 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:44:35.249 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-04-18T14:44:35.249 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:44:35.249 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:35.249 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:35.250 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(client.4559.0:799 3.7s0 3:ee42865b:::smithi13430248-46:head [copy-from ver 61] snapc 2b=[2b,2a,29,28,27,26,23,22,1e,1c,1a,16,14,13,11,2] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-18T14:44:35.250 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-04-18T14:44:15.568864+0000", 2024-04-18T14:44:35.250 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 19.621480732999999, 2024-04-18T14:44:35.250 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.029408185, 2024-04-18T14:44:35.250 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-04-18T14:44:35.250 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T14:44:35.250 INFO:teuthology.orchestra.run.smithi119.stdout: "client_info": { 2024-04-18T14:44:35.250 INFO:teuthology.orchestra.run.smithi119.stdout: "client": "client.4559", 2024-04-18T14:44:35.250 INFO:teuthology.orchestra.run.smithi119.stdout: "client_addr": "172.21.15.134:0/3113589487", 2024-04-18T14:44:35.250 INFO:teuthology.orchestra.run.smithi119.stdout: "tid": 799 2024-04-18T14:44:35.250 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:35.250 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-04-18T14:44:35.250 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:35.250 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-04-18T14:44:35.251 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:15.568864+0000", 2024-04-18T14:44:35.251 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:44:35.251 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:35.251 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:35.251 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-04-18T14:44:35.251 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:15.568864+0000", 2024-04-18T14:44:35.251 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:44:35.251 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:35.251 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:35.251 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-04-18T14:44:35.251 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:15.568863+0000", 2024-04-18T14:44:35.251 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4294967295.999999 2024-04-18T14:44:35.251 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:35.251 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:35.252 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-04-18T14:44:35.252 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:15.568871+0000", 2024-04-18T14:44:35.252 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 8.1499999999999999e-06 2024-04-18T14:44:35.252 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:35.252 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:35.252 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-04-18T14:44:35.252 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:15.568888+0000", 2024-04-18T14:44:35.252 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.6495999999999999e-05 2024-04-18T14:44:35.252 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:35.252 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:35.252 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-04-18T14:44:35.252 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:15.568906+0000", 2024-04-18T14:44:35.252 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.7773000000000001e-05 2024-04-18T14:44:35.253 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:35.253 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:35.253 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-04-18T14:44:35.253 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:15.569060+0000", 2024-04-18T14:44:35.253 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000154253 2024-04-18T14:44:35.253 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:35.253 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:35.253 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-04-18T14:44:35.253 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:15.569352+0000", 2024-04-18T14:44:35.253 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00029174399999999998 2024-04-18T14:44:35.253 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:35.253 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:35.253 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_started", 2024-04-18T14:44:35.253 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:15.586851+0000", 2024-04-18T14:44:35.253 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.017499486000000002 2024-04-18T14:44:35.254 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:35.254 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:35.254 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_committed", 2024-04-18T14:44:35.254 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:15.594173+0000", 2024-04-18T14:44:35.254 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0073216569999999996 2024-04-18T14:44:35.254 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:35.254 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:35.254 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-04-18T14:44:35.254 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:15.598149+0000", 2024-04-18T14:44:35.254 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0039762030000000002 2024-04-18T14:44:35.254 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:35.254 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:35.254 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-04-18T14:44:35.254 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:15.598273+0000", 2024-04-18T14:44:35.255 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00012354600000000001 2024-04-18T14:44:35.255 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:44:35.255 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-04-18T14:44:35.255 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:44:35.255 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:35.255 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:35.255 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(client.4559.0:800 3.7s0 3:ee42865b:::smithi13430248-46:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e76)", 2024-04-18T14:44:35.255 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-04-18T14:44:15.568946+0000", 2024-04-18T14:44:35.255 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 19.621398747000001, 2024-04-18T14:44:35.255 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.023785720999999999, 2024-04-18T14:44:35.255 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-04-18T14:44:35.255 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "started", 2024-04-18T14:44:35.255 INFO:teuthology.orchestra.run.smithi119.stdout: "client_info": { 2024-04-18T14:44:35.255 INFO:teuthology.orchestra.run.smithi119.stdout: "client": "client.4559", 2024-04-18T14:44:35.255 INFO:teuthology.orchestra.run.smithi119.stdout: "client_addr": "172.21.15.134:0/3113589487", 2024-04-18T14:44:35.255 INFO:teuthology.orchestra.run.smithi119.stdout: "tid": 800 2024-04-18T14:44:35.256 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:35.256 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-04-18T14:44:35.256 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:35.256 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-04-18T14:44:35.256 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:15.568946+0000", 2024-04-18T14:44:35.256 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:44:35.256 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:35.256 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:35.256 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-04-18T14:44:35.256 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:15.568946+0000", 2024-04-18T14:44:35.256 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:44:35.256 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:35.256 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:35.256 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-04-18T14:44:35.257 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:15.568945+0000", 2024-04-18T14:44:35.257 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4294967295.9999986 2024-04-18T14:44:35.257 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:35.257 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:35.257 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-04-18T14:44:35.257 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:15.568952+0000", 2024-04-18T14:44:35.257 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 7.5329999999999997e-06 2024-04-18T14:44:35.257 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:35.257 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:35.257 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-04-18T14:44:35.257 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:15.568971+0000", 2024-04-18T14:44:35.257 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.8397e-05 2024-04-18T14:44:35.257 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:35.257 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:35.258 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-04-18T14:44:35.258 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:15.568986+0000", 2024-04-18T14:44:35.258 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.484e-05 2024-04-18T14:44:35.258 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:35.258 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:35.258 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-04-18T14:44:35.258 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:15.569819+0000", 2024-04-18T14:44:35.258 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00083339299999999998 2024-04-18T14:44:35.258 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:35.258 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:35.258 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for blocked object", 2024-04-18T14:44:35.258 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:15.569959+0000", 2024-04-18T14:44:35.259 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00013939200000000001 2024-04-18T14:44:35.259 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:35.259 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:35.259 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-04-18T14:44:35.259 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:15.592207+0000", 2024-04-18T14:44:35.259 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.022248245999999999 2024-04-18T14:44:35.259 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:35.259 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:35.259 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-04-18T14:44:35.259 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:15.592473+0000", 2024-04-18T14:44:35.259 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00026622499999999998 2024-04-18T14:44:35.259 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:35.260 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:35.260 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-04-18T14:44:35.260 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:15.592732+0000", 2024-04-18T14:44:35.260 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00025914800000000001 2024-04-18T14:44:35.260 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:44:35.260 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-04-18T14:44:35.260 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:44:35.260 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:35.260 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:35.260 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(osd.6.22:4 3.6s0 3:67bcc71e:::smithi13430248-13:head [assert-version v81,copy-get max 8388608] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e77)", 2024-04-18T14:44:35.260 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-04-18T14:44:16.424597+0000", 2024-04-18T14:44:35.260 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 18.765748059, 2024-04-18T14:44:35.260 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.026918959999999999, 2024-04-18T14:44:35.260 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-04-18T14:44:35.260 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "started", 2024-04-18T14:44:35.261 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-04-18T14:44:35.261 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:35.261 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-04-18T14:44:35.261 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:16.424597+0000", 2024-04-18T14:44:35.261 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:44:35.261 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:35.261 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:35.261 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-04-18T14:44:35.261 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:16.424597+0000", 2024-04-18T14:44:35.261 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:44:35.261 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:35.261 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:35.261 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-04-18T14:44:35.261 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:16.424594+0000", 2024-04-18T14:44:35.261 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4294967295.9999971 2024-04-18T14:44:35.262 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:35.262 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:35.262 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-04-18T14:44:35.262 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:16.424616+0000", 2024-04-18T14:44:35.262 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.2204e-05 2024-04-18T14:44:35.262 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:35.262 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:35.262 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-04-18T14:44:35.262 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:16.424649+0000", 2024-04-18T14:44:35.262 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.2845999999999997e-05 2024-04-18T14:44:35.262 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:35.262 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:35.262 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-04-18T14:44:35.262 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:16.424670+0000", 2024-04-18T14:44:35.262 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.0760000000000001e-05 2024-04-18T14:44:35.263 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:35.263 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:35.263 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-04-18T14:44:35.263 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:16.424841+0000", 2024-04-18T14:44:35.263 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00017121200000000001 2024-04-18T14:44:35.263 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:35.263 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:35.263 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "op must wait for map", 2024-04-18T14:44:35.263 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:16.424859+0000", 2024-04-18T14:44:35.263 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.7592999999999999e-05 2024-04-18T14:44:35.263 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:35.263 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:35.263 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-04-18T14:44:35.263 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:16.431043+0000", 2024-04-18T14:44:35.263 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0061840330000000002 2024-04-18T14:44:35.264 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:35.264 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:35.264 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-04-18T14:44:35.264 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:16.431279+0000", 2024-04-18T14:44:35.264 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00023650099999999999 2024-04-18T14:44:35.264 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:35.264 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:35.264 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-04-18T14:44:35.264 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:16.451516+0000", 2024-04-18T14:44:35.264 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.020236771000000001 2024-04-18T14:44:35.264 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:44:35.264 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-04-18T14:44:35.264 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:44:35.264 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:35.264 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:35.265 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(client.4559.0:894 3.6s0 3:6c5ba706:::smithi13430248-4:head [copy-from ver 80] snapc 30=[30,2c,2b,2a,29,28,27,26,22,1e,1c,1a,14,13,11] ondisk+write+known_if_redirected+supports_pool_eio e81)", 2024-04-18T14:44:35.265 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-04-18T14:44:20.499598+0000", 2024-04-18T14:44:35.265 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 14.690747534, 2024-04-18T14:44:35.265 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.041311764000000001, 2024-04-18T14:44:35.265 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-04-18T14:44:35.265 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T14:44:35.265 INFO:teuthology.orchestra.run.smithi119.stdout: "client_info": { 2024-04-18T14:44:35.265 INFO:teuthology.orchestra.run.smithi119.stdout: "client": "client.4559", 2024-04-18T14:44:35.265 INFO:teuthology.orchestra.run.smithi119.stdout: "client_addr": "172.21.15.134:0/3113589487", 2024-04-18T14:44:35.265 INFO:teuthology.orchestra.run.smithi119.stdout: "tid": 894 2024-04-18T14:44:35.265 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:35.265 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-04-18T14:44:35.265 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:35.265 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-04-18T14:44:35.265 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:20.499598+0000", 2024-04-18T14:44:35.266 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:44:35.266 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:35.266 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:35.266 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-04-18T14:44:35.266 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:20.499598+0000", 2024-04-18T14:44:35.266 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:44:35.266 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:35.266 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:35.266 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-04-18T14:44:35.266 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:20.499595+0000", 2024-04-18T14:44:35.266 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4294967295.9999971 2024-04-18T14:44:35.266 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:35.266 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:35.266 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-04-18T14:44:35.267 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:20.499610+0000", 2024-04-18T14:44:35.267 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.4836e-05 2024-04-18T14:44:35.267 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:35.267 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:35.267 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-04-18T14:44:35.267 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:20.499639+0000", 2024-04-18T14:44:35.267 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.9300000000000001e-05 2024-04-18T14:44:35.267 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:35.267 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:35.267 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-04-18T14:44:35.267 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:20.499652+0000", 2024-04-18T14:44:35.267 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.3383e-05 2024-04-18T14:44:35.267 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:35.267 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:35.267 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-04-18T14:44:35.267 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:20.499764+0000", 2024-04-18T14:44:35.268 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00011129999999999999 2024-04-18T14:44:35.268 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:35.268 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:35.268 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-04-18T14:44:35.268 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:20.501081+0000", 2024-04-18T14:44:35.268 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0013174930000000001 2024-04-18T14:44:35.268 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:35.268 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:35.268 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_started", 2024-04-18T14:44:35.268 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:20.528621+0000", 2024-04-18T14:44:35.268 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.027539599000000001 2024-04-18T14:44:35.268 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:35.268 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:35.268 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_committed", 2024-04-18T14:44:35.268 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:20.539815+0000", 2024-04-18T14:44:35.269 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.011194109000000001 2024-04-18T14:44:35.269 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:35.269 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:35.269 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-04-18T14:44:35.269 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:20.539993+0000", 2024-04-18T14:44:35.269 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00017821199999999999 2024-04-18T14:44:35.269 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:35.269 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:35.269 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-04-18T14:44:35.269 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:20.540909+0000", 2024-04-18T14:44:35.269 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00091628499999999997 2024-04-18T14:44:35.269 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:44:35.269 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-04-18T14:44:35.269 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:44:35.269 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:35.270 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:35.270 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(client.4559.0:895 3.6s0 3:6c5ba706:::smithi13430248-4:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e81)", 2024-04-18T14:44:35.270 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-04-18T14:44:20.499674+0000", 2024-04-18T14:44:35.270 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 14.690671081, 2024-04-18T14:44:35.270 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.036387361, 2024-04-18T14:44:35.270 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-04-18T14:44:35.270 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "started", 2024-04-18T14:44:35.270 INFO:teuthology.orchestra.run.smithi119.stdout: "client_info": { 2024-04-18T14:44:35.270 INFO:teuthology.orchestra.run.smithi119.stdout: "client": "client.4559", 2024-04-18T14:44:35.270 INFO:teuthology.orchestra.run.smithi119.stdout: "client_addr": "172.21.15.134:0/3113589487", 2024-04-18T14:44:35.270 INFO:teuthology.orchestra.run.smithi119.stdout: "tid": 895 2024-04-18T14:44:35.270 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:35.270 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-04-18T14:44:35.270 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:35.271 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-04-18T14:44:35.271 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:20.499674+0000", 2024-04-18T14:44:35.271 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:44:35.271 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:35.271 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:35.271 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-04-18T14:44:35.271 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:20.499674+0000", 2024-04-18T14:44:35.271 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:44:35.271 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:35.271 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:35.271 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-04-18T14:44:35.271 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:20.499673+0000", 2024-04-18T14:44:35.271 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4294967295.999999 2024-04-18T14:44:35.271 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:35.271 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:35.272 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-04-18T14:44:35.272 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:20.499678+0000", 2024-04-18T14:44:35.272 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 5.1830000000000002e-06 2024-04-18T14:44:35.272 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:35.272 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:35.272 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-04-18T14:44:35.272 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:20.499692+0000", 2024-04-18T14:44:35.272 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.3862999999999999e-05 2024-04-18T14:44:35.272 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:35.272 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:35.272 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-04-18T14:44:35.272 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:20.499701+0000", 2024-04-18T14:44:35.272 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 8.9169999999999995e-06 2024-04-18T14:44:35.272 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:35.272 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:35.273 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-04-18T14:44:35.273 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:20.501567+0000", 2024-04-18T14:44:35.273 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0018663690000000001 2024-04-18T14:44:35.273 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:35.273 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:35.273 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for blocked object", 2024-04-18T14:44:35.273 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:20.501714+0000", 2024-04-18T14:44:35.273 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00014643300000000001 2024-04-18T14:44:35.273 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:35.273 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:35.273 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-04-18T14:44:35.273 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:20.535487+0000", 2024-04-18T14:44:35.273 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.033773034 2024-04-18T14:44:35.273 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:35.273 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:35.274 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-04-18T14:44:35.274 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:20.535775+0000", 2024-04-18T14:44:35.274 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00028772500000000001 2024-04-18T14:44:35.274 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:35.274 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:35.274 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-04-18T14:44:35.274 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:20.536061+0000", 2024-04-18T14:44:35.274 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00028691399999999998 2024-04-18T14:44:35.274 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:44:35.274 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-04-18T14:44:35.274 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:44:35.274 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:35.274 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:35.274 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(client.4559.0:912 3.7s0 3:ee42865b:::smithi13430248-46:head [rmxattr NdZr`e\\^kXiksh]\\XocenQrhYc]c`[proOfo`Pd^ in=40b,rmxattr [XmPqpoSg`fWjdlmQ_qabof]_WVcPaY[]k[ardgj in=40b,rmxattr \\hZXh`dT^W[c\\XodZZ_d\\QO\\\\[PVWthO_WVOPSQd in=40b,rmxattr `e\\rtQi]nmoP\\cm]oRYN`[]^qVUTsU^_oXm]h\\ec in=40b,rmxattr ctSOqNY_dUqTOjgXYjqgslgNRRPoT\\\\OXPPWrtt_ in=40b,rmxattr iRn][N_NY\\ZhmYdQ[[ptTP_NW^Z]_roZnOpcmR_Y in=40b,rmxattr qqUtZZ]ataUj_[pnh\\jVtU_dRpi^g[VPNeS`Y\\hk in=40b,rmxattr qsgedRfqdW]]cYbWOUgh^ZleaSQiteejr^afXbUj in=40b] snapc 30=[30,2c,2b,2a,29,28,27,26,22,1e,1c,1a,14,11] ondisk+write+known_if_redirected+supports_pool_eio e82)", 2024-04-18T14:44:35.275 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-04-18T14:44:21.456411+0000", 2024-04-18T14:44:35.275 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 13.733934211999999, 2024-04-18T14:44:35.275 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.032929601000000003, 2024-04-18T14:44:35.275 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-04-18T14:44:35.275 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T14:44:35.275 INFO:teuthology.orchestra.run.smithi119.stdout: "client_info": { 2024-04-18T14:44:35.275 INFO:teuthology.orchestra.run.smithi119.stdout: "client": "client.4559", 2024-04-18T14:44:35.275 INFO:teuthology.orchestra.run.smithi119.stdout: "client_addr": "172.21.15.134:0/3113589487", 2024-04-18T14:44:35.275 INFO:teuthology.orchestra.run.smithi119.stdout: "tid": 912 2024-04-18T14:44:35.275 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:35.275 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-04-18T14:44:35.275 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:35.275 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-04-18T14:44:35.275 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:21.456411+0000", 2024-04-18T14:44:35.275 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:44:35.276 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:35.276 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:35.276 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-04-18T14:44:35.276 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:21.456411+0000", 2024-04-18T14:44:35.276 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-04-18T14:44:35.276 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:35.276 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:35.276 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-04-18T14:44:35.276 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:21.456408+0000", 2024-04-18T14:44:35.276 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4294967295.9999967 2024-04-18T14:44:35.277 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:35.277 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:35.277 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-04-18T14:44:35.277 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:21.456426+0000", 2024-04-18T14:44:35.277 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.8053000000000001e-05 2024-04-18T14:44:35.277 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:35.277 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:35.277 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-04-18T14:44:35.277 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:21.456462+0000", 2024-04-18T14:44:35.277 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.6327e-05 2024-04-18T14:44:35.277 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:35.277 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:35.277 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-04-18T14:44:35.278 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:21.456485+0000", 2024-04-18T14:44:35.278 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.2427000000000001e-05 2024-04-18T14:44:35.278 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:35.278 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:35.278 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-04-18T14:44:35.278 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:21.456656+0000", 2024-04-18T14:44:35.278 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00017180799999999999 2024-04-18T14:44:35.278 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:35.278 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:35.278 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "op must wait for map", 2024-04-18T14:44:35.278 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:21.456679+0000", 2024-04-18T14:44:35.278 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.2759999999999999e-05 2024-04-18T14:44:35.278 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:35.278 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:35.279 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-04-18T14:44:35.279 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:21.461652+0000", 2024-04-18T14:44:35.279 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0049729120000000003 2024-04-18T14:44:35.279 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:35.279 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:35.279 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-04-18T14:44:35.279 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:21.461941+0000", 2024-04-18T14:44:35.279 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00028901399999999998 2024-04-18T14:44:35.279 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:35.279 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:35.279 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_started", 2024-04-18T14:44:35.279 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:21.463937+0000", 2024-04-18T14:44:35.279 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.001995981 2024-04-18T14:44:35.279 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:35.279 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:35.280 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_committed", 2024-04-18T14:44:35.280 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:21.477181+0000", 2024-04-18T14:44:35.280 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.013244165 2024-04-18T14:44:35.280 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:35.280 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:35.280 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-04-18T14:44:35.280 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:21.489121+0000", 2024-04-18T14:44:35.280 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.011940159000000001 2024-04-18T14:44:35.280 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-04-18T14:44:35.280 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-04-18T14:44:35.280 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-04-18T14:44:35.280 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-04-18T14:44:21.489341+0000", 2024-04-18T14:44:35.280 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00021920199999999999 2024-04-18T14:44:35.280 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:44:35.281 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-04-18T14:44:35.281 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:44:35.281 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-04-18T14:44:35.281 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-04-18T14:44:35.281 INFO:teuthology.orchestra.run.smithi119.stdout:} 2024-04-18T14:44:35.282 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-04-18T14:44:35.413 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-04-18T14:44:35.413 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [], 2024-04-18T14:44:35.413 INFO:teuthology.orchestra.run.smithi134.stdout: "num_ops": 0 2024-04-18T14:44:35.413 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-04-18T14:44:35.428 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-04-18T14:44:35.547 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-04-18T14:44:35.548 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [], 2024-04-18T14:44:35.548 INFO:teuthology.orchestra.run.smithi134.stdout: "complaint_time": 30, 2024-04-18T14:44:35.548 INFO:teuthology.orchestra.run.smithi134.stdout: "num_blocked_ops": 0 2024-04-18T14:44:35.548 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-04-18T14:44:35.549 INFO:teuthology.orchestra.run.smithi086.stderr:reweighted osd.0 to 1 (10000) 2024-04-18T14:44:35.562 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-04-18T14:44:35.572 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 0 1 2024-04-18T14:44:35.688 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-04-18T14:44:35.688 INFO:teuthology.orchestra.run.smithi134.stdout: "size": 20, 2024-04-18T14:44:35.688 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 600, 2024-04-18T14:44:35.688 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [ 2024-04-18T14:44:35.688 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:35.688 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4559.0:178 3.as0 3:504bbe78:::smithi13430248-37:head [append 0~507904] snapc 4=[4,3,2] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-04-18T14:44:35.689 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T14:43:35.731082+0000", 2024-04-18T14:44:35.689 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 59.959314317999997, 2024-04-18T14:44:35.689 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.015989092, 2024-04-18T14:44:35.689 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T14:44:35.689 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T14:44:35.689 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-18T14:44:35.689 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4559", 2024-04-18T14:44:35.689 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/3113589487", 2024-04-18T14:44:35.689 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 178 2024-04-18T14:44:35.689 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:35.689 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T14:44:35.689 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:35.689 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T14:44:35.689 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:35.731082+0000", 2024-04-18T14:44:35.689 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:44:35.690 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:35.690 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:35.690 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T14:44:35.690 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:35.731082+0000", 2024-04-18T14:44:35.690 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:44:35.690 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:35.690 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:35.690 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T14:44:35.690 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:35.731079+0000", 2024-04-18T14:44:35.690 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999971 2024-04-18T14:44:35.690 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:35.690 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:35.690 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T14:44:35.690 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:35.731663+0000", 2024-04-18T14:44:35.690 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00058377699999999995 2024-04-18T14:44:35.691 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:35.691 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:35.691 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T14:44:35.691 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:35.731697+0000", 2024-04-18T14:44:35.691 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.4578e-05 2024-04-18T14:44:35.691 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:35.691 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:35.691 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T14:44:35.691 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:35.731716+0000", 2024-04-18T14:44:35.691 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8413000000000001e-05 2024-04-18T14:44:35.691 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:35.691 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:35.691 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T14:44:35.691 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:35.731829+0000", 2024-04-18T14:44:35.691 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000113323 2024-04-18T14:44:35.692 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:35.692 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:35.692 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op must wait for map", 2024-04-18T14:44:35.692 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:35.731843+0000", 2024-04-18T14:44:35.692 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.4072e-05 2024-04-18T14:44:35.692 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:35.692 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:35.692 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T14:44:35.692 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:35.735773+0000", 2024-04-18T14:44:35.692 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0039293569999999996 2024-04-18T14:44:35.692 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:35.692 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:35.692 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T14:44:35.692 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:35.736021+0000", 2024-04-18T14:44:35.692 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00024879299999999997 2024-04-18T14:44:35.693 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:35.693 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:35.693 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_started", 2024-04-18T14:44:35.693 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:35.738679+0000", 2024-04-18T14:44:35.693 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0026578460000000002 2024-04-18T14:44:35.693 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:35.693 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:35.693 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_committed", 2024-04-18T14:44:35.693 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:35.745018+0000", 2024-04-18T14:44:35.693 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0063392070000000003 2024-04-18T14:44:35.693 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:35.693 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:35.693 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T14:44:35.693 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:35.746981+0000", 2024-04-18T14:44:35.693 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00196254 2024-04-18T14:44:35.693 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:35.694 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:35.694 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T14:44:35.694 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:35.747071+0000", 2024-04-18T14:44:35.694 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.0016e-05 2024-04-18T14:44:35.694 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:44:35.694 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T14:44:35.694 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:44:35.694 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:35.694 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:35.694 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4559.0:179 3.as0 3:504bbe78:::smithi13430248-37:head [append 0~376832] snapc 4=[4,3,2] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-04-18T14:44:35.694 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T14:43:35.735197+0000", 2024-04-18T14:44:35.694 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 59.955199501000003, 2024-04-18T14:44:35.694 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.013886849999999999, 2024-04-18T14:44:35.694 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T14:44:35.694 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T14:44:35.695 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-18T14:44:35.695 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4559", 2024-04-18T14:44:35.695 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/3113589487", 2024-04-18T14:44:35.695 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 179 2024-04-18T14:44:35.695 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:35.695 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T14:44:35.695 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:35.695 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T14:44:35.696 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:35.735197+0000", 2024-04-18T14:44:35.696 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:44:35.696 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:35.696 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:35.696 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T14:44:35.696 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:35.735197+0000", 2024-04-18T14:44:35.696 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:44:35.696 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:35.696 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:35.696 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T14:44:35.696 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:35.735193+0000", 2024-04-18T14:44:35.696 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999967 2024-04-18T14:44:35.696 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:35.696 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:35.697 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T14:44:35.697 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:35.735791+0000", 2024-04-18T14:44:35.697 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00059791 2024-04-18T14:44:35.697 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:35.697 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:35.697 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T14:44:35.697 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:35.735818+0000", 2024-04-18T14:44:35.697 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.6214e-05 2024-04-18T14:44:35.697 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:35.697 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:35.697 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T14:44:35.697 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:35.735834+0000", 2024-04-18T14:44:35.697 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6603999999999999e-05 2024-04-18T14:44:35.697 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:35.697 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:35.698 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T14:44:35.698 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:35.741060+0000", 2024-04-18T14:44:35.698 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0052256580000000002 2024-04-18T14:44:35.698 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:35.698 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:35.698 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T14:44:35.698 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:35.741402+0000", 2024-04-18T14:44:35.698 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00034264000000000001 2024-04-18T14:44:35.698 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:35.698 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:35.698 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_started", 2024-04-18T14:44:35.698 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:35.743027+0000", 2024-04-18T14:44:35.698 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0016244250000000001 2024-04-18T14:44:35.698 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:35.698 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:35.699 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_committed", 2024-04-18T14:44:35.699 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:35.746673+0000", 2024-04-18T14:44:35.699 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0036466189999999998 2024-04-18T14:44:35.699 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:35.699 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:35.699 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T14:44:35.699 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:35.749020+0000", 2024-04-18T14:44:35.699 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0023462439999999999 2024-04-18T14:44:35.699 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:35.699 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:35.699 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T14:44:35.699 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:35.749084+0000", 2024-04-18T14:44:35.699 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.3875999999999996e-05 2024-04-18T14:44:35.699 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:44:35.699 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T14:44:35.699 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:44:35.700 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:35.700 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:35.700 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4559.0:181 3.as0 3:504bbe78:::smithi13430248-37:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e36)", 2024-04-18T14:44:35.700 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T14:43:35.735904+0000", 2024-04-18T14:44:35.700 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 59.954492514000002, 2024-04-18T14:44:35.700 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.015807422000000002, 2024-04-18T14:44:35.700 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T14:44:35.700 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-04-18T14:44:35.700 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-18T14:44:35.700 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4559", 2024-04-18T14:44:35.700 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/3113589487", 2024-04-18T14:44:35.700 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 181 2024-04-18T14:44:35.700 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:35.700 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T14:44:35.700 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:35.701 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T14:44:35.701 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:35.735904+0000", 2024-04-18T14:44:35.701 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:44:35.701 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:35.701 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:35.701 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T14:44:35.701 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:35.735904+0000", 2024-04-18T14:44:35.701 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:44:35.701 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:35.701 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:35.701 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T14:44:35.701 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:35.735903+0000", 2024-04-18T14:44:35.701 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-18T14:44:35.701 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:35.701 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:35.702 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T14:44:35.702 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:35.735907+0000", 2024-04-18T14:44:35.702 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.1899999999999997e-06 2024-04-18T14:44:35.702 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:35.702 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:35.702 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T14:44:35.702 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:35.735920+0000", 2024-04-18T14:44:35.702 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2857000000000001e-05 2024-04-18T14:44:35.702 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:35.702 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:35.702 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T14:44:35.702 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:35.735927+0000", 2024-04-18T14:44:35.702 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.447e-06 2024-04-18T14:44:35.702 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:35.703 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:35.703 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T14:44:35.703 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:35.746529+0000", 2024-04-18T14:44:35.703 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.010601348 2024-04-18T14:44:35.703 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:35.703 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:35.703 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for rw locks", 2024-04-18T14:44:35.703 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:35.746655+0000", 2024-04-18T14:44:35.703 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000125823 2024-04-18T14:44:35.703 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:35.703 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:35.703 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T14:44:35.703 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:35.749858+0000", 2024-04-18T14:44:35.703 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0032038209999999999 2024-04-18T14:44:35.703 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:35.704 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:35.704 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T14:44:35.704 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:35.750001+0000", 2024-04-18T14:44:35.704 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000142602 2024-04-18T14:44:35.704 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:35.704 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:35.704 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T14:44:35.704 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:35.751711+0000", 2024-04-18T14:44:35.704 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0017101709999999999 2024-04-18T14:44:35.704 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:44:35.704 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T14:44:35.704 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:44:35.704 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:35.704 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:35.704 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4559.0:190 3.as0 3:5474a36d:::smithi13430248-11:head [delete] snapc 4=[4,2] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e37)", 2024-04-18T14:44:35.704 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T14:43:36.761006+0000", 2024-04-18T14:44:35.705 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 58.929390701999999, 2024-04-18T14:44:35.705 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.014529398000000001, 2024-04-18T14:44:35.705 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T14:44:35.705 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T14:44:35.705 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-18T14:44:35.705 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4559", 2024-04-18T14:44:35.705 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/3113589487", 2024-04-18T14:44:35.705 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 190 2024-04-18T14:44:35.705 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:35.706 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T14:44:35.706 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:35.706 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T14:44:35.706 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.761006+0000", 2024-04-18T14:44:35.709 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:44:35.709 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:35.709 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:35.709 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T14:44:35.709 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.761006+0000", 2024-04-18T14:44:35.709 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:44:35.710 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:35.710 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:35.710 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T14:44:35.710 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.761002+0000", 2024-04-18T14:44:35.710 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999967 2024-04-18T14:44:35.710 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:35.710 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:35.710 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T14:44:35.710 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.761018+0000", 2024-04-18T14:44:35.710 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5339999999999999e-05 2024-04-18T14:44:35.710 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:35.710 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:35.710 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T14:44:35.711 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.761058+0000", 2024-04-18T14:44:35.711 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.0197999999999997e-05 2024-04-18T14:44:35.711 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:35.711 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:35.711 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T14:44:35.711 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.761074+0000", 2024-04-18T14:44:35.711 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6646999999999998e-05 2024-04-18T14:44:35.711 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:35.711 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:35.711 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T14:44:35.712 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.761215+0000", 2024-04-18T14:44:35.712 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00014079399999999999 2024-04-18T14:44:35.712 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:35.712 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:35.712 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op must wait for map", 2024-04-18T14:44:35.712 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.761236+0000", 2024-04-18T14:44:35.712 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.105e-05 2024-04-18T14:44:35.712 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:35.712 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:35.712 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T14:44:35.712 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.765644+0000", 2024-04-18T14:44:35.712 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.004408159 2024-04-18T14:44:35.712 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:35.712 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:35.712 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T14:44:35.713 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.765818+0000", 2024-04-18T14:44:35.713 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00017385799999999999 2024-04-18T14:44:35.713 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:35.713 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:35.713 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_started", 2024-04-18T14:44:35.713 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.767388+0000", 2024-04-18T14:44:35.713 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0015693980000000001 2024-04-18T14:44:35.713 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:35.713 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:35.713 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_committed", 2024-04-18T14:44:35.713 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.774151+0000", 2024-04-18T14:44:35.713 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0067634050000000001 2024-04-18T14:44:35.713 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:35.713 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:35.713 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T14:44:35.713 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.775409+0000", 2024-04-18T14:44:35.714 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00125745 2024-04-18T14:44:35.714 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:35.714 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:35.714 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T14:44:35.714 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:36.775535+0000", 2024-04-18T14:44:35.714 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000126379 2024-04-18T14:44:35.714 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:44:35.714 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T14:44:35.714 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:44:35.714 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:35.714 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:35.714 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4559.0:244 3.as0 3:577932fb:::smithi13430248-41:head [read 0~688128,checksum,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-04-18T14:44:35.714 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T14:43:40.759326+0000", 2024-04-18T14:44:35.714 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 54.931069803, 2024-04-18T14:44:35.715 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.017168499, 2024-04-18T14:44:35.715 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T14:44:35.715 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-04-18T14:44:35.715 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-18T14:44:35.715 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4559", 2024-04-18T14:44:35.715 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/3113589487", 2024-04-18T14:44:35.715 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 244 2024-04-18T14:44:35.715 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:35.715 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T14:44:35.715 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:35.715 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T14:44:35.715 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:40.759326+0000", 2024-04-18T14:44:35.715 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:44:35.715 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:35.715 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:35.715 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T14:44:35.716 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:40.759326+0000", 2024-04-18T14:44:35.716 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:44:35.716 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:35.716 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:35.716 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T14:44:35.716 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:40.759323+0000", 2024-04-18T14:44:35.716 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999971 2024-04-18T14:44:35.716 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:35.716 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:35.716 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T14:44:35.716 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:40.759340+0000", 2024-04-18T14:44:35.716 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6344000000000001e-05 2024-04-18T14:44:35.716 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:35.717 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:35.717 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T14:44:35.717 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:40.759375+0000", 2024-04-18T14:44:35.717 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.5043999999999999e-05 2024-04-18T14:44:35.717 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:35.717 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:35.718 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T14:44:35.718 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:40.759392+0000", 2024-04-18T14:44:35.718 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6801000000000001e-05 2024-04-18T14:44:35.718 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:35.718 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:35.718 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T14:44:35.718 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:40.759518+0000", 2024-04-18T14:44:35.718 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00012620200000000001 2024-04-18T14:44:35.718 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:35.718 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:35.718 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op must wait for map", 2024-04-18T14:44:35.718 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:40.759537+0000", 2024-04-18T14:44:35.718 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.9670999999999999e-05 2024-04-18T14:44:35.719 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:35.719 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:35.719 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T14:44:35.719 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:40.764645+0000", 2024-04-18T14:44:35.719 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0051078240000000004 2024-04-18T14:44:35.719 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:35.719 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:35.719 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T14:44:35.719 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:40.764872+0000", 2024-04-18T14:44:35.719 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00022684499999999999 2024-04-18T14:44:35.719 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:35.719 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:35.719 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T14:44:35.719 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:40.776495+0000", 2024-04-18T14:44:35.719 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.011622791 2024-04-18T14:44:35.720 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:44:35.720 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T14:44:35.720 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:44:35.720 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:35.720 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:35.720 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4559.0:245 3.as0 3:577932fb:::smithi13430248-41:head [read 0~688128,checksum] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-04-18T14:44:35.720 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T14:43:40.759413+0000", 2024-04-18T14:44:35.720 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 54.930983091000002, 2024-04-18T14:44:35.720 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.017883375999999999, 2024-04-18T14:44:35.720 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T14:44:35.721 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-04-18T14:44:35.721 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-18T14:44:35.721 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4559", 2024-04-18T14:44:35.721 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/3113589487", 2024-04-18T14:44:35.721 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 245 2024-04-18T14:44:35.721 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:35.721 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T14:44:35.721 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:35.721 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T14:44:35.721 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:40.759413+0000", 2024-04-18T14:44:35.721 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:44:35.721 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:35.721 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:35.721 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T14:44:35.721 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:40.759413+0000", 2024-04-18T14:44:35.721 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:44:35.722 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:35.722 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:35.722 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T14:44:35.722 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:40.759412+0000", 2024-04-18T14:44:35.722 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999986 2024-04-18T14:44:35.722 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:35.722 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:35.722 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T14:44:35.723 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:40.759421+0000", 2024-04-18T14:44:35.723 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.3409999999999992e-06 2024-04-18T14:44:35.723 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:35.723 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:35.723 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T14:44:35.723 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:40.759440+0000", 2024-04-18T14:44:35.723 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8467000000000001e-05 2024-04-18T14:44:35.723 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:35.723 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:35.723 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T14:44:35.723 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:40.759454+0000", 2024-04-18T14:44:35.723 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.4113e-05 2024-04-18T14:44:35.723 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:35.723 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:35.723 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T14:44:35.724 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:40.759694+0000", 2024-04-18T14:44:35.724 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00023988199999999999 2024-04-18T14:44:35.724 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:35.724 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:35.724 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting_for_map not empty", 2024-04-18T14:44:35.724 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:40.759711+0000", 2024-04-18T14:44:35.724 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6988000000000001e-05 2024-04-18T14:44:35.725 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:35.725 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:35.725 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T14:44:35.725 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:40.766045+0000", 2024-04-18T14:44:35.725 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0063342169999999996 2024-04-18T14:44:35.725 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:35.725 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:35.725 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T14:44:35.725 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:40.766299+0000", 2024-04-18T14:44:35.725 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00025419199999999998 2024-04-18T14:44:35.725 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:35.726 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:35.726 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T14:44:35.726 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:40.777297+0000", 2024-04-18T14:44:35.726 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.010997536 2024-04-18T14:44:35.726 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:44:35.726 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T14:44:35.726 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:44:35.726 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:35.726 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:35.726 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4559.0:246 3.as0 3:577932fb:::smithi13430248-41:head [read 0~688128,checksum] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-04-18T14:44:35.726 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T14:43:40.759528+0000", 2024-04-18T14:44:35.726 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 54.930867913999997, 2024-04-18T14:44:35.726 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.019049244, 2024-04-18T14:44:35.726 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T14:44:35.726 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-04-18T14:44:35.727 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-18T14:44:35.727 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4559", 2024-04-18T14:44:35.727 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/3113589487", 2024-04-18T14:44:35.727 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 246 2024-04-18T14:44:35.727 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:35.727 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T14:44:35.727 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:35.727 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T14:44:35.727 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:40.759528+0000", 2024-04-18T14:44:35.728 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:44:35.728 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:35.728 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:35.728 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T14:44:35.728 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:40.759528+0000", 2024-04-18T14:44:35.728 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:44:35.728 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:35.728 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:35.729 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T14:44:35.729 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:40.759527+0000", 2024-04-18T14:44:35.729 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999986 2024-04-18T14:44:35.729 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:35.729 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:35.729 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T14:44:35.729 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:40.759536+0000", 2024-04-18T14:44:35.729 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.1540000000000008e-06 2024-04-18T14:44:35.729 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:35.729 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:35.729 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T14:44:35.729 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:40.759555+0000", 2024-04-18T14:44:35.729 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.9133000000000001e-05 2024-04-18T14:44:35.729 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:35.729 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:35.729 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T14:44:35.730 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:40.759570+0000", 2024-04-18T14:44:35.730 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5017999999999999e-05 2024-04-18T14:44:35.730 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:35.730 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:35.730 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T14:44:35.730 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:40.759776+0000", 2024-04-18T14:44:35.730 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000205577 2024-04-18T14:44:35.730 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:35.730 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:35.730 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting_for_map not empty", 2024-04-18T14:44:35.730 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:40.759792+0000", 2024-04-18T14:44:35.730 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6381000000000001e-05 2024-04-18T14:44:35.730 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:35.730 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:35.730 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T14:44:35.731 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:40.767014+0000", 2024-04-18T14:44:35.731 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0072223299999999999 2024-04-18T14:44:35.731 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:35.731 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:35.731 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T14:44:35.731 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:40.767254+0000", 2024-04-18T14:44:35.731 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00023931899999999999 2024-04-18T14:44:35.731 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:35.731 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:35.731 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T14:44:35.731 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:40.778578+0000", 2024-04-18T14:44:35.731 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.011323796000000001 2024-04-18T14:44:35.731 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:44:35.731 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T14:44:35.731 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:44:35.732 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:35.732 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:35.732 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4559.0:362 3.as0 3:5474a36d:::smithi13430248-11:head [append 0~0] snapc 13=[13,11,f,b,a,8,7,2] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-04-18T14:44:35.732 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T14:43:50.376205+0000", 2024-04-18T14:44:35.732 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 45.314191262000001, 2024-04-18T14:44:35.732 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.013968441, 2024-04-18T14:44:35.732 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T14:44:35.732 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T14:44:35.732 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-18T14:44:35.732 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4559", 2024-04-18T14:44:35.732 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/3113589487", 2024-04-18T14:44:35.732 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 362 2024-04-18T14:44:35.732 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:35.732 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T14:44:35.733 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:35.733 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T14:44:35.733 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:50.376205+0000", 2024-04-18T14:44:35.733 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:44:35.733 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:35.733 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:35.733 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T14:44:35.733 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:50.376205+0000", 2024-04-18T14:44:35.733 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:44:35.733 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:35.733 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:35.733 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T14:44:35.734 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:50.376202+0000", 2024-04-18T14:44:35.734 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999971 2024-04-18T14:44:35.734 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:35.734 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:35.734 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T14:44:35.734 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:50.376220+0000", 2024-04-18T14:44:35.734 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.7876999999999998e-05 2024-04-18T14:44:35.734 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:35.734 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:35.734 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T14:44:35.734 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:50.376256+0000", 2024-04-18T14:44:35.734 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.6384000000000003e-05 2024-04-18T14:44:35.734 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:35.734 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:35.735 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T14:44:35.735 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:50.376274+0000", 2024-04-18T14:44:35.735 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.7727000000000002e-05 2024-04-18T14:44:35.735 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:35.735 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:35.735 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T14:44:35.735 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:50.376445+0000", 2024-04-18T14:44:35.735 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000171046 2024-04-18T14:44:35.735 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:35.735 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:35.735 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op must wait for map", 2024-04-18T14:44:35.735 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:50.376460+0000", 2024-04-18T14:44:35.735 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.4620000000000001e-05 2024-04-18T14:44:35.735 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:35.736 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:35.736 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T14:44:35.736 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:50.381860+0000", 2024-04-18T14:44:35.736 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0054002199999999998 2024-04-18T14:44:35.736 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:35.736 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:35.736 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T14:44:35.736 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:50.382042+0000", 2024-04-18T14:44:35.736 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00018185900000000001 2024-04-18T14:44:35.736 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:35.736 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:35.736 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_started", 2024-04-18T14:44:35.736 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:50.383954+0000", 2024-04-18T14:44:35.736 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0019126530000000001 2024-04-18T14:44:35.736 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:35.736 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:35.737 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_committed", 2024-04-18T14:44:35.737 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:50.389758+0000", 2024-04-18T14:44:35.737 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.005803702 2024-04-18T14:44:35.737 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:35.737 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:35.737 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T14:44:35.737 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:50.390098+0000", 2024-04-18T14:44:35.737 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00033984400000000001 2024-04-18T14:44:35.737 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:35.737 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:35.737 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T14:44:35.737 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:50.390173+0000", 2024-04-18T14:44:35.737 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.5581999999999996e-05 2024-04-18T14:44:35.737 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:44:35.737 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T14:44:35.737 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:44:35.738 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:35.738 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:35.738 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4559.0:363 3.as0 3:5474a36d:::smithi13430248-11:head [rollback 7] snapc 13=[13,11,f,b,a,8,7,2] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-04-18T14:44:35.738 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T14:43:50.376296+0000", 2024-04-18T14:44:35.738 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 45.314100359999998, 2024-04-18T14:44:35.738 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.015443114000000001, 2024-04-18T14:44:35.738 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T14:44:35.738 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T14:44:35.738 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-18T14:44:35.739 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4559", 2024-04-18T14:44:35.739 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/3113589487", 2024-04-18T14:44:35.739 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 363 2024-04-18T14:44:35.739 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:35.739 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T14:44:35.739 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:35.739 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T14:44:35.739 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:50.376296+0000", 2024-04-18T14:44:35.739 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:44:35.739 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:35.739 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:35.739 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T14:44:35.739 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:50.376296+0000", 2024-04-18T14:44:35.739 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:44:35.739 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:35.739 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:35.740 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T14:44:35.740 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:50.376295+0000", 2024-04-18T14:44:35.740 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-18T14:44:35.740 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:35.740 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:35.740 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T14:44:35.740 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:50.376300+0000", 2024-04-18T14:44:35.740 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.7199999999999997e-06 2024-04-18T14:44:35.740 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:35.740 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:35.740 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T14:44:35.740 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:50.376333+0000", 2024-04-18T14:44:35.740 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.3315999999999997e-05 2024-04-18T14:44:35.740 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:35.740 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:35.740 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T14:44:35.741 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:50.376343+0000", 2024-04-18T14:44:35.741 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0346999999999999e-05 2024-04-18T14:44:35.741 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:35.741 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:35.741 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T14:44:35.741 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:50.376596+0000", 2024-04-18T14:44:35.741 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00025260099999999998 2024-04-18T14:44:35.741 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:35.741 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:35.741 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting_for_map not empty", 2024-04-18T14:44:35.741 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:50.376611+0000", 2024-04-18T14:44:35.741 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5594e-05 2024-04-18T14:44:35.741 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:35.741 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:35.741 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T14:44:35.741 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:50.385330+0000", 2024-04-18T14:44:35.742 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0087181299999999993 2024-04-18T14:44:35.742 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:35.742 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:35.742 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T14:44:35.742 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:50.385574+0000", 2024-04-18T14:44:35.742 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00024469699999999999 2024-04-18T14:44:35.742 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:35.742 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:35.742 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_started", 2024-04-18T14:44:35.742 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:50.386969+0000", 2024-04-18T14:44:35.742 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0013943639999999999 2024-04-18T14:44:35.743 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:35.743 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:35.743 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_committed", 2024-04-18T14:44:35.743 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:50.389892+0000", 2024-04-18T14:44:35.743 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0029229059999999999 2024-04-18T14:44:35.743 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:35.743 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:35.744 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T14:44:35.744 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:50.391671+0000", 2024-04-18T14:44:35.744 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0017797080000000001 2024-04-18T14:44:35.744 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:35.744 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:35.745 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T14:44:35.745 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:50.391739+0000", 2024-04-18T14:44:35.745 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.7756999999999995e-05 2024-04-18T14:44:35.745 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:44:35.745 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T14:44:35.745 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:44:35.745 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:35.745 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:35.745 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(osd.5.24:3 3.as0 3:577932fb:::smithi13430248-41:head [assert-version v61,copy-get max 8388608] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e76)", 2024-04-18T14:44:35.745 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T14:44:15.397713+0000", 2024-04-18T14:44:35.745 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 20.292683527000001, 2024-04-18T14:44:35.745 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.018961802, 2024-04-18T14:44:35.745 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T14:44:35.745 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-04-18T14:44:35.746 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T14:44:35.746 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:35.746 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T14:44:35.746 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:15.397713+0000", 2024-04-18T14:44:35.746 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:44:35.746 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:35.746 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:35.746 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T14:44:35.746 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:15.397713+0000", 2024-04-18T14:44:35.746 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:44:35.746 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:35.746 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:35.746 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T14:44:35.746 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:15.397709+0000", 2024-04-18T14:44:35.746 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999962 2024-04-18T14:44:35.747 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:35.747 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:35.747 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T14:44:35.747 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:15.397726+0000", 2024-04-18T14:44:35.747 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.7257000000000001e-05 2024-04-18T14:44:35.747 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:35.747 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:35.747 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T14:44:35.747 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:15.397758+0000", 2024-04-18T14:44:35.747 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.2066000000000001e-05 2024-04-18T14:44:35.747 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:35.747 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:35.747 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T14:44:35.747 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:15.397780+0000", 2024-04-18T14:44:35.747 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2047000000000001e-05 2024-04-18T14:44:35.748 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:35.748 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:35.748 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T14:44:35.748 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:15.397929+0000", 2024-04-18T14:44:35.748 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000148512 2024-04-18T14:44:35.748 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:35.748 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:35.748 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op must wait for map", 2024-04-18T14:44:35.748 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:15.397949+0000", 2024-04-18T14:44:35.748 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0089e-05 2024-04-18T14:44:35.748 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:35.748 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:35.748 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T14:44:35.748 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:15.404337+0000", 2024-04-18T14:44:35.748 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0063883309999999997 2024-04-18T14:44:35.748 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:35.749 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:35.749 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T14:44:35.749 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:15.404582+0000", 2024-04-18T14:44:35.749 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00024442099999999998 2024-04-18T14:44:35.749 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:35.749 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:35.749 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T14:44:35.749 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:15.416675+0000", 2024-04-18T14:44:35.749 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.012092696 2024-04-18T14:44:35.749 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:44:35.749 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T14:44:35.749 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:44:35.749 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:35.749 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:35.750 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(osd.8.23:2 3.as0 3:504bbe78:::smithi13430248-37:head [assert-version v32,copy-get max 8388608] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e76)", 2024-04-18T14:44:35.750 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T14:44:15.399336+0000", 2024-04-18T14:44:35.750 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 20.291059839999999, 2024-04-18T14:44:35.750 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.019313883, 2024-04-18T14:44:35.750 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T14:44:35.750 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-04-18T14:44:35.750 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T14:44:35.750 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:35.750 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T14:44:35.750 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:15.399336+0000", 2024-04-18T14:44:35.750 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:44:35.750 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:35.750 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:35.750 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T14:44:35.750 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:15.399336+0000", 2024-04-18T14:44:35.750 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:44:35.751 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:35.751 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:35.751 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T14:44:35.751 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:15.399334+0000", 2024-04-18T14:44:35.751 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999981 2024-04-18T14:44:35.751 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:35.751 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:35.751 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T14:44:35.751 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:15.399348+0000", 2024-04-18T14:44:35.751 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.4032999999999999e-05 2024-04-18T14:44:35.751 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:35.751 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:35.751 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T14:44:35.751 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:15.399377+0000", 2024-04-18T14:44:35.751 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.8430000000000001e-05 2024-04-18T14:44:35.752 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:35.752 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:35.752 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T14:44:35.752 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:15.399398+0000", 2024-04-18T14:44:35.752 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0786999999999999e-05 2024-04-18T14:44:35.752 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:35.752 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:35.752 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T14:44:35.752 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:15.399497+0000", 2024-04-18T14:44:35.752 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.9265999999999995e-05 2024-04-18T14:44:35.752 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:35.752 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:35.752 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op must wait for map", 2024-04-18T14:44:35.752 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:15.399515+0000", 2024-04-18T14:44:35.752 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8416000000000001e-05 2024-04-18T14:44:35.752 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:35.753 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:35.753 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T14:44:35.753 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:15.406474+0000", 2024-04-18T14:44:35.753 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0069583800000000001 2024-04-18T14:44:35.753 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:35.753 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:35.753 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T14:44:35.753 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:15.406675+0000", 2024-04-18T14:44:35.753 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00020107799999999999 2024-04-18T14:44:35.753 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:35.753 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:35.753 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T14:44:35.753 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:15.418650+0000", 2024-04-18T14:44:35.753 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.01197555 2024-04-18T14:44:35.753 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:44:35.753 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T14:44:35.754 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:44:35.754 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:35.754 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:35.754 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "MOSDECSubOpWriteReply(3.as0 82/70 ECSubWriteReply(tid=111, last_complete=82'77, committed=1, applied=1))", 2024-04-18T14:44:35.754 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T14:44:21.466330+0000", 2024-04-18T14:44:35.754 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 14.224066122, 2024-04-18T14:44:35.754 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.014367962, 2024-04-18T14:44:35.754 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T14:44:35.754 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-04-18T14:44:35.754 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T14:44:35.754 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:35.754 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T14:44:35.754 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:21.466330+0000", 2024-04-18T14:44:35.754 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:44:35.755 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:35.755 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:35.755 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T14:44:35.755 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:21.466330+0000", 2024-04-18T14:44:35.755 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:44:35.755 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:35.755 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:35.755 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T14:44:35.755 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:21.466329+0000", 2024-04-18T14:44:35.755 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999986 2024-04-18T14:44:35.755 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:35.755 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:35.755 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T14:44:35.755 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:21.466338+0000", 2024-04-18T14:44:35.755 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.2720000000000003e-06 2024-04-18T14:44:35.755 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:35.756 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:35.756 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T14:44:35.756 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:21.466365+0000", 2024-04-18T14:44:35.756 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.7314999999999999e-05 2024-04-18T14:44:35.756 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:35.756 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:35.756 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T14:44:35.756 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:21.466378+0000", 2024-04-18T14:44:35.756 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2736e-05 2024-04-18T14:44:35.756 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:35.756 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:35.756 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T14:44:35.756 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:21.480669+0000", 2024-04-18T14:44:35.756 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.014291109999999999 2024-04-18T14:44:35.756 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:35.756 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:35.757 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T14:44:35.757 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:21.480698+0000", 2024-04-18T14:44:35.757 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.9047000000000002e-05 2024-04-18T14:44:35.757 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:44:35.757 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T14:44:35.757 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:44:35.757 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:35.757 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:35.757 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "MOSDECSubOpWriteReply(3.as0 82/70 ECSubWriteReply(tid=111, last_complete=82'77, committed=1, applied=1))", 2024-04-18T14:44:35.757 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T14:44:21.466700+0000", 2024-04-18T14:44:35.757 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 14.223696374999999, 2024-04-18T14:44:35.757 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.014031893, 2024-04-18T14:44:35.757 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T14:44:35.757 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-04-18T14:44:35.757 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T14:44:35.758 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:35.758 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T14:44:35.758 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:21.466700+0000", 2024-04-18T14:44:35.758 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:44:35.758 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:35.758 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:35.758 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T14:44:35.758 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:21.466700+0000", 2024-04-18T14:44:35.758 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:44:35.758 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:35.758 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:35.758 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T14:44:35.758 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:21.466698+0000", 2024-04-18T14:44:35.758 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999981 2024-04-18T14:44:35.758 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:35.758 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:35.759 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T14:44:35.759 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:21.466712+0000", 2024-04-18T14:44:35.759 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.4086e-05 2024-04-18T14:44:35.759 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:35.759 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:35.759 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T14:44:35.759 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:21.466744+0000", 2024-04-18T14:44:35.759 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.1566000000000002e-05 2024-04-18T14:44:35.759 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:35.759 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:35.759 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T14:44:35.759 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:21.466767+0000", 2024-04-18T14:44:35.759 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.3873e-05 2024-04-18T14:44:35.759 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:35.759 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:35.759 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T14:44:35.760 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:21.480722+0000", 2024-04-18T14:44:35.760 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.013954599999999999 2024-04-18T14:44:35.760 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:35.760 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:35.760 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T14:44:35.760 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:21.480732+0000", 2024-04-18T14:44:35.760 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.7280000000000007e-06 2024-04-18T14:44:35.760 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:44:35.760 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T14:44:35.760 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:44:35.760 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:35.760 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:35.760 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "MOSDECSubOpWrite(3.2s2 82/70 ECSubWrite(tid=299, reqid=osd.13.0:299, at_version=82'58, trim_to=0'0, roll_forward_to=80'56))", 2024-04-18T14:44:35.760 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T14:44:21.471365+0000", 2024-04-18T14:44:35.760 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 14.219030828999999, 2024-04-18T14:44:35.760 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.022502139000000001, 2024-04-18T14:44:35.761 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T14:44:35.761 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-04-18T14:44:35.761 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T14:44:35.761 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:35.761 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T14:44:35.761 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:21.471365+0000", 2024-04-18T14:44:35.761 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:44:35.761 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:35.761 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:35.761 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T14:44:35.761 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:21.471365+0000", 2024-04-18T14:44:35.761 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:44:35.761 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:35.761 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:35.761 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T14:44:35.762 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:21.471365+0000", 2024-04-18T14:44:35.762 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-18T14:44:35.762 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:35.762 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:35.762 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T14:44:35.762 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:21.471418+0000", 2024-04-18T14:44:35.762 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.3282999999999998e-05 2024-04-18T14:44:35.762 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:35.762 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:35.762 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T14:44:35.762 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:21.471448+0000", 2024-04-18T14:44:35.762 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.0514e-05 2024-04-18T14:44:35.762 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:35.762 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:35.762 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T14:44:35.763 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:21.471471+0000", 2024-04-18T14:44:35.763 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2909e-05 2024-04-18T14:44:35.763 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:35.763 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:35.763 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T14:44:35.763 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:21.480801+0000", 2024-04-18T14:44:35.763 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0093300699999999993 2024-04-18T14:44:35.763 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:35.763 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:35.763 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_started", 2024-04-18T14:44:35.763 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:21.480810+0000", 2024-04-18T14:44:35.763 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.816e-06 2024-04-18T14:44:35.763 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:35.763 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:35.763 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_committed", 2024-04-18T14:44:35.764 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:21.493808+0000", 2024-04-18T14:44:35.764 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.012997981 2024-04-18T14:44:35.764 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:35.764 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:35.764 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T14:44:35.764 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:21.493868+0000", 2024-04-18T14:44:35.764 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.9305999999999998e-05 2024-04-18T14:44:35.764 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:44:35.764 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T14:44:35.764 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:44:35.764 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:35.764 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:35.764 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "MOSDECSubOpWrite(3.2s2 82/70 ECSubWrite(tid=300, reqid=osd.13.0:300, at_version=82'60, trim_to=0'0, roll_forward_to=80'56))", 2024-04-18T14:44:35.764 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T14:44:21.474342+0000", 2024-04-18T14:44:35.764 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 14.216053919, 2024-04-18T14:44:35.764 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.020703926000000001, 2024-04-18T14:44:35.765 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T14:44:35.765 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-04-18T14:44:35.765 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T14:44:35.765 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:35.765 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T14:44:35.765 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:21.474342+0000", 2024-04-18T14:44:35.765 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:44:35.765 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:35.765 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:35.765 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T14:44:35.765 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:21.474342+0000", 2024-04-18T14:44:35.765 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:44:35.765 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:35.765 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:35.765 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T14:44:35.766 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:21.474341+0000", 2024-04-18T14:44:35.766 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999986 2024-04-18T14:44:35.766 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:35.766 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:35.766 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T14:44:35.766 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:21.474395+0000", 2024-04-18T14:44:35.766 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.4237000000000003e-05 2024-04-18T14:44:35.766 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:35.766 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:35.766 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T14:44:35.766 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:21.474422+0000", 2024-04-18T14:44:35.766 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.6523e-05 2024-04-18T14:44:35.766 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:35.766 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:35.766 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T14:44:35.767 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:21.474443+0000", 2024-04-18T14:44:35.767 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.1667000000000001e-05 2024-04-18T14:44:35.767 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:35.767 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:35.767 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T14:44:35.767 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:21.483888+0000", 2024-04-18T14:44:35.767 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0094445190000000002 2024-04-18T14:44:35.767 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:35.767 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:35.767 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_started", 2024-04-18T14:44:35.767 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:21.483912+0000", 2024-04-18T14:44:35.767 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.4054e-05 2024-04-18T14:44:35.767 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:35.767 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:35.767 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_committed", 2024-04-18T14:44:35.767 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:21.494987+0000", 2024-04-18T14:44:35.768 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.011075234 2024-04-18T14:44:35.768 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:35.768 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:35.768 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T14:44:35.768 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:21.495046+0000", 2024-04-18T14:44:35.768 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.9212000000000002e-05 2024-04-18T14:44:35.768 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:44:35.768 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T14:44:35.768 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:44:35.768 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:35.768 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:35.768 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4559.0:926 3.as0 3:577932fb:::smithi13430248-41:head [create,setxattr ntQVt[arV\\sZ (12980) in=12b,setxattr cbiTQrXTtN[rcsXX]e`cSaeckYftjjZYtT\\Q^igZ (947) in=40b,setxattr Ncc_QolebZhUSbdoam]TtS[WPO`dcS`[mQ]`jeUq (13680) in=40b,setxattr aaW^bm`niOo[qYndkoRPSTsgTRVZsjTbdqNTWSbq (139) in=40b,setxattr ^mjiNm[Oc`m`tdgmetjcaYsTRWfVX[Y]OrieZYts (4560) in=40b,setxattr a_tYdUeqQ\\TlaV]SnRrNNZnbQiX\\r^ocf\\YnUjhY (15364) in=40b,setxattr mQh]P]enrma\\V`gdWlZagTV^ (12980) in=24b,setxattr tOhOYXahpesOiNUhkPgPbV`fUejZib__YUhaXTTR (1051) in=40b,setxattr ZZc]SnhtrtmognZg[mgTlar`PsaWsenZek`Qf`eY (1049) in=40b,setxattr hUURNtkOoXqXi]eatXq^SUacfR`Q]k[iiNgbi` (12980) in=38b,setxattr aQVfqQ[ifabWts (12980) in=14b,setxattr tY]sPTr\\QlZbSqcPigYORZQpfels`mkh^Pkner\\] (805) in=40b,setxattr \\RsX`is\\W_nOa_UaifQU[aaoOZRre^^RegbbOcqT (1891) in=40b,setxattr nqeolZZpfWUXqprf]\\PoS]lk_pef`^QpSreiVttQ (245) in=40b,setxattr \\OeXfOVSON\\t^bQb[lWXiXaYmVQXUcSqQnNh`j`t (4768) in=40b,setxattr eo^U[lhQUeVQ_Nc_bNdcfmXp_UQ`WXl_is_NkOfS (1577) in=40b,setxattr XUbk]peZmr_iot^gmY`pgm`eOnTpNT_SQd`aVj[e (1437) in=40b,setxattr XkXTUfbiTjaQaf\\fq[_\\antZOOTes[[ZYantUYqi (4560) in=40b,setxattr ab]YiQ (12980) in=6b,setxattr ZaSYU^RRVdSq_eaQfajUXsi\\ah^nfW_shiX]UlSd (14172) in=40b] snapc 30=[30,2c,2b,2a,29,28,27,26,22,1e,1c,1a,14,11] ondisk+write+known_if_redirected+supports_pool_eio e82)", 2024-04-18T14:44:35.768 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T14:44:21.660337+0000", 2024-04-18T14:44:35.768 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 14.030059563, 2024-04-18T14:44:35.768 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.017051502999999999, 2024-04-18T14:44:35.769 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T14:44:35.769 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T14:44:35.769 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-18T14:44:35.769 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4559", 2024-04-18T14:44:35.769 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/3113589487", 2024-04-18T14:44:35.769 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 926 2024-04-18T14:44:35.769 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:35.769 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T14:44:35.769 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:35.769 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T14:44:35.769 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:21.660337+0000", 2024-04-18T14:44:35.769 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:44:35.769 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:35.769 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:35.769 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T14:44:35.769 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:21.660337+0000", 2024-04-18T14:44:35.770 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:44:35.770 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:35.770 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:35.770 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T14:44:35.770 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:21.660332+0000", 2024-04-18T14:44:35.770 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999952 2024-04-18T14:44:35.770 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:35.770 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:35.770 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T14:44:35.770 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:21.660566+0000", 2024-04-18T14:44:35.770 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00023413500000000001 2024-04-18T14:44:35.770 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:35.770 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:35.770 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T14:44:35.770 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:21.660602+0000", 2024-04-18T14:44:35.771 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.6117e-05 2024-04-18T14:44:35.771 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:35.771 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:35.771 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T14:44:35.771 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:21.660621+0000", 2024-04-18T14:44:35.771 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.9052999999999999e-05 2024-04-18T14:44:35.771 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:35.771 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:35.771 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T14:44:35.771 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:21.660751+0000", 2024-04-18T14:44:35.771 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000130099 2024-04-18T14:44:35.771 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:35.771 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:35.771 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T14:44:35.771 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:21.660959+0000", 2024-04-18T14:44:35.771 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000207918 2024-04-18T14:44:35.772 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:35.772 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:35.772 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_started", 2024-04-18T14:44:35.772 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:21.662984+0000", 2024-04-18T14:44:35.772 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0020243959999999999 2024-04-18T14:44:35.772 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:35.772 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:35.772 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_committed", 2024-04-18T14:44:35.772 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:21.669853+0000", 2024-04-18T14:44:35.772 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0068691480000000003 2024-04-18T14:44:35.772 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:35.772 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:35.772 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T14:44:35.772 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:21.677175+0000", 2024-04-18T14:44:35.772 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0073227370000000002 2024-04-18T14:44:35.772 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:35.773 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:35.773 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T14:44:35.773 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:21.677388+0000", 2024-04-18T14:44:35.773 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00021277399999999999 2024-04-18T14:44:35.773 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:44:35.773 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T14:44:35.773 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:44:35.773 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:35.773 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:35.773 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4559.0:989 3.as0 3:5dff433d:::smithi13430248-20:head [append 0~0] snapc 35=[35,33,32,30,2c,2b,2a,29,28,26,22,1e,1c,1a,14,11] ondisk+write+known_if_redirected+supports_pool_eio e86)", 2024-04-18T14:44:35.773 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T14:44:25.483824+0000", 2024-04-18T14:44:35.773 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 10.20657272, 2024-04-18T14:44:35.773 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.020090190000000001, 2024-04-18T14:44:35.773 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T14:44:35.773 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T14:44:35.774 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-18T14:44:35.774 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4559", 2024-04-18T14:44:35.774 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/3113589487", 2024-04-18T14:44:35.774 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 989 2024-04-18T14:44:35.774 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:35.774 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T14:44:35.774 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:35.774 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T14:44:35.774 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:25.483824+0000", 2024-04-18T14:44:35.774 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:44:35.774 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:35.774 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:35.774 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T14:44:35.774 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:25.483824+0000", 2024-04-18T14:44:35.774 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:44:35.775 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:35.775 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:35.775 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T14:44:35.775 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:25.483816+0000", 2024-04-18T14:44:35.775 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999928 2024-04-18T14:44:35.775 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:35.775 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:35.775 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T14:44:35.775 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:25.483835+0000", 2024-04-18T14:44:35.775 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8597000000000002e-05 2024-04-18T14:44:35.775 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:35.775 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:35.775 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T14:44:35.775 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:25.483957+0000", 2024-04-18T14:44:35.775 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000121622 2024-04-18T14:44:35.775 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:35.776 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:35.776 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T14:44:35.776 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:25.483982+0000", 2024-04-18T14:44:35.776 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.5794000000000001e-05 2024-04-18T14:44:35.776 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:35.776 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:35.776 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T14:44:35.776 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:25.484127+0000", 2024-04-18T14:44:35.776 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00014492800000000001 2024-04-18T14:44:35.776 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:35.776 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:35.776 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op must wait for map", 2024-04-18T14:44:35.776 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:25.484152+0000", 2024-04-18T14:44:35.776 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.4992999999999999e-05 2024-04-18T14:44:35.776 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:35.776 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:35.777 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T14:44:35.777 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:25.488146+0000", 2024-04-18T14:44:35.777 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0039935789999999997 2024-04-18T14:44:35.777 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:35.777 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:35.777 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T14:44:35.777 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:25.488441+0000", 2024-04-18T14:44:35.777 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00029506500000000001 2024-04-18T14:44:35.777 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:35.777 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:35.777 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_started", 2024-04-18T14:44:35.777 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:25.491456+0000", 2024-04-18T14:44:35.777 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0030151029999999999 2024-04-18T14:44:35.777 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:35.777 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:35.777 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_committed", 2024-04-18T14:44:35.778 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:25.503493+0000", 2024-04-18T14:44:35.778 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.012037093 2024-04-18T14:44:35.778 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:35.778 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:35.778 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T14:44:35.778 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:25.503701+0000", 2024-04-18T14:44:35.778 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000207658 2024-04-18T14:44:35.778 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:35.778 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:35.778 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T14:44:35.778 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:25.503914+0000", 2024-04-18T14:44:35.778 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000212895 2024-04-18T14:44:35.778 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:44:35.778 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T14:44:35.778 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:44:35.779 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:35.779 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:35.779 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4559.0:990 3.as0 3:5dff433d:::smithi13430248-20:head [rollback 28] snapc 35=[35,33,32,30,2c,2b,2a,29,28,26,22,1e,1c,1a,14,11] ondisk+write+known_if_redirected+supports_pool_eio e86)", 2024-04-18T14:44:35.779 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T14:44:25.484013+0000", 2024-04-18T14:44:35.779 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 10.206383108000001, 2024-04-18T14:44:35.779 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.026942089999999998, 2024-04-18T14:44:35.779 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T14:44:35.779 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T14:44:35.779 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-18T14:44:35.779 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4559", 2024-04-18T14:44:35.779 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/3113589487", 2024-04-18T14:44:35.779 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 990 2024-04-18T14:44:35.779 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:35.779 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T14:44:35.779 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:35.779 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T14:44:35.780 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:25.484013+0000", 2024-04-18T14:44:35.780 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:44:35.780 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:35.780 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:35.780 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T14:44:35.780 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:25.484013+0000", 2024-04-18T14:44:35.780 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:44:35.780 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:35.780 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:35.780 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T14:44:35.780 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:25.484012+0000", 2024-04-18T14:44:35.780 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999986 2024-04-18T14:44:35.780 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:35.780 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:35.780 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T14:44:35.780 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:25.484022+0000", 2024-04-18T14:44:35.781 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.893e-06 2024-04-18T14:44:35.781 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:35.781 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:35.781 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T14:44:35.781 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:25.484043+0000", 2024-04-18T14:44:35.781 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.1152999999999999e-05 2024-04-18T14:44:35.781 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:35.781 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:35.781 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T14:44:35.781 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:25.484059+0000", 2024-04-18T14:44:35.781 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6274e-05 2024-04-18T14:44:35.781 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:35.781 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:35.781 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T14:44:35.782 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:25.484364+0000", 2024-04-18T14:44:35.782 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00030465400000000001 2024-04-18T14:44:35.782 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:35.782 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:35.782 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting_for_map not empty", 2024-04-18T14:44:35.782 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:25.484387+0000", 2024-04-18T14:44:35.782 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.3393000000000001e-05 2024-04-18T14:44:35.782 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:35.782 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:35.782 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T14:44:35.782 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:25.498195+0000", 2024-04-18T14:44:35.782 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.013807873 2024-04-18T14:44:35.782 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:35.782 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:35.782 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T14:44:35.783 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:25.498531+0000", 2024-04-18T14:44:35.783 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00033602700000000003 2024-04-18T14:44:35.783 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:35.783 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:35.783 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_started", 2024-04-18T14:44:35.783 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:25.500741+0000", 2024-04-18T14:44:35.783 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.002210236 2024-04-18T14:44:35.783 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:35.783 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:35.783 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_committed", 2024-04-18T14:44:35.783 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:25.507887+0000", 2024-04-18T14:44:35.783 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0071463280000000004 2024-04-18T14:44:35.783 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:35.783 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:35.784 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T14:44:35.784 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:25.510857+0000", 2024-04-18T14:44:35.784 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0029694439999999999 2024-04-18T14:44:35.784 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:35.784 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:35.784 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T14:44:35.784 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:25.510955+0000", 2024-04-18T14:44:35.784 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.8351999999999996e-05 2024-04-18T14:44:35.784 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:44:35.784 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T14:44:35.784 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:44:35.784 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:35.784 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:35.784 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4559.0:991 3.as0 3:5dff433d:::smithi13430248-20:head [append 0~0] snapc 35=[35,33,32,30,2c,2b,2a,29,28,26,22,1e,1c,1a,14,11] ondisk+write+known_if_redirected+supports_pool_eio e86)", 2024-04-18T14:44:35.784 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T14:44:25.484131+0000", 2024-04-18T14:44:35.785 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 10.206265259, 2024-04-18T14:44:35.785 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.029604319, 2024-04-18T14:44:35.785 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T14:44:35.785 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T14:44:35.785 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-18T14:44:35.785 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4559", 2024-04-18T14:44:35.785 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/3113589487", 2024-04-18T14:44:35.785 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 991 2024-04-18T14:44:35.785 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:35.785 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T14:44:35.785 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:35.785 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T14:44:35.785 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:25.484131+0000", 2024-04-18T14:44:35.785 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:44:35.785 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:35.786 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:35.786 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T14:44:35.786 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:25.484131+0000", 2024-04-18T14:44:35.786 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:44:35.786 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:35.786 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:35.786 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T14:44:35.786 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:25.484130+0000", 2024-04-18T14:44:35.786 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999986 2024-04-18T14:44:35.786 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:35.786 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:35.786 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T14:44:35.786 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:25.484138+0000", 2024-04-18T14:44:35.786 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.1000000000000004e-06 2024-04-18T14:44:35.786 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:35.787 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:35.787 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T14:44:35.787 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:25.484160+0000", 2024-04-18T14:44:35.787 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2203000000000001e-05 2024-04-18T14:44:35.787 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:35.787 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:35.787 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T14:44:35.787 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:25.484175+0000", 2024-04-18T14:44:35.787 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5153e-05 2024-04-18T14:44:35.787 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:35.787 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:35.787 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T14:44:35.787 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:25.484455+0000", 2024-04-18T14:44:35.787 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00028005800000000002 2024-04-18T14:44:35.787 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:35.788 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:35.788 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting_for_map not empty", 2024-04-18T14:44:35.788 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:25.484471+0000", 2024-04-18T14:44:35.788 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6133e-05 2024-04-18T14:44:35.788 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:35.788 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:35.788 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T14:44:35.788 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:25.504193+0000", 2024-04-18T14:44:35.788 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.019721127000000001 2024-04-18T14:44:35.788 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:35.788 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:35.788 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T14:44:35.788 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:25.504476+0000", 2024-04-18T14:44:35.788 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00028325399999999998 2024-04-18T14:44:35.788 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:35.789 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:35.789 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_started", 2024-04-18T14:44:35.789 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:25.505841+0000", 2024-04-18T14:44:35.789 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.001365277 2024-04-18T14:44:35.789 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:35.789 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:35.789 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_committed", 2024-04-18T14:44:35.789 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:25.511079+0000", 2024-04-18T14:44:35.789 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0052375249999999998 2024-04-18T14:44:35.789 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:35.789 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:35.789 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T14:44:35.789 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:25.511257+0000", 2024-04-18T14:44:35.789 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00017884199999999999 2024-04-18T14:44:35.789 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:35.790 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:35.790 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T14:44:35.790 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:25.513735+0000", 2024-04-18T14:44:35.790 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0024778970000000002 2024-04-18T14:44:35.790 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:44:35.790 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T14:44:35.790 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:44:35.790 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:35.790 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:35.790 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "MOSDECSubOpWrite(3.2s2 86/70 ECSubWrite(tid=306, reqid=client.4559.0:988, at_version=86'64, trim_to=0'0, roll_forward_to=85'62))", 2024-04-18T14:44:35.790 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T14:44:25.490874+0000", 2024-04-18T14:44:35.790 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 10.199521945000001, 2024-04-18T14:44:35.790 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.019366142999999999, 2024-04-18T14:44:35.790 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T14:44:35.790 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-04-18T14:44:35.791 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T14:44:35.791 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:35.791 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T14:44:35.791 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:25.490874+0000", 2024-04-18T14:44:35.791 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:44:35.791 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:35.791 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:35.791 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T14:44:35.791 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:25.490874+0000", 2024-04-18T14:44:35.791 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:44:35.791 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:35.791 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:35.791 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T14:44:35.791 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:25.490874+0000", 2024-04-18T14:44:35.791 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-04-18T14:44:35.791 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:35.792 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:35.792 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T14:44:35.792 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:25.491185+0000", 2024-04-18T14:44:35.792 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00031147100000000001 2024-04-18T14:44:35.792 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:35.792 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:35.792 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T14:44:35.792 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:25.491217+0000", 2024-04-18T14:44:35.792 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.1906000000000003e-05 2024-04-18T14:44:35.792 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:35.792 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:35.792 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T14:44:35.792 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:25.491238+0000", 2024-04-18T14:44:35.792 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.1060000000000002e-05 2024-04-18T14:44:35.792 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:35.793 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:35.793 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T14:44:35.793 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:25.497435+0000", 2024-04-18T14:44:35.793 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0061966590000000002 2024-04-18T14:44:35.793 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:35.793 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:35.793 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_started", 2024-04-18T14:44:35.793 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:25.497471+0000", 2024-04-18T14:44:35.793 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.5806000000000002e-05 2024-04-18T14:44:35.793 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:35.793 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:35.793 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_committed", 2024-04-18T14:44:35.793 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:25.510188+0000", 2024-04-18T14:44:35.793 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.012717261000000001 2024-04-18T14:44:35.793 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:35.793 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:35.794 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T14:44:35.794 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:25.510240+0000", 2024-04-18T14:44:35.794 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.2580000000000001e-05 2024-04-18T14:44:35.794 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:44:35.794 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T14:44:35.794 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:44:35.794 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:44:35.794 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T14:44:35.794 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-04-18T14:44:35.795 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-04-18T14:44:35.921 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-04-18T14:44:35.922 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [], 2024-04-18T14:44:35.922 INFO:teuthology.orchestra.run.smithi134.stdout: "num_ops": 0 2024-04-18T14:44:35.922 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-04-18T14:44:35.936 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-04-18T14:44:36.059 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-04-18T14:44:36.059 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [], 2024-04-18T14:44:36.059 INFO:teuthology.orchestra.run.smithi134.stdout: "complaint_time": 30, 2024-04-18T14:44:36.059 INFO:teuthology.orchestra.run.smithi134.stdout: "num_blocked_ops": 0 2024-04-18T14:44:36.059 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-04-18T14:44:36.073 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-04-18T14:44:36.192 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-04-18T14:44:36.192 INFO:teuthology.orchestra.run.smithi134.stdout: "size": 20, 2024-04-18T14:44:36.192 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 600, 2024-04-18T14:44:36.192 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [ 2024-04-18T14:44:36.192 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:36.192 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4559.0:495 3.ds0 3:be45a49b:::smithi13430248-50:head [copy-from ver 48] snapc 19=[19,16,14,13,11,f,b,a,7,2] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-18T14:44:36.192 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T14:43:56.541633+0000", 2024-04-18T14:44:36.193 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 39.653247370999999, 2024-04-18T14:44:36.193 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.020360488999999999, 2024-04-18T14:44:36.193 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T14:44:36.193 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T14:44:36.193 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-18T14:44:36.193 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4559", 2024-04-18T14:44:36.193 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/3113589487", 2024-04-18T14:44:36.193 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 495 2024-04-18T14:44:36.193 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:36.193 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T14:44:36.193 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:36.193 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T14:44:36.193 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:56.541633+0000", 2024-04-18T14:44:36.193 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:44:36.193 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:36.194 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:36.194 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T14:44:36.194 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:56.541633+0000", 2024-04-18T14:44:36.194 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:44:36.194 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:36.194 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:36.194 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T14:44:36.194 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:56.541631+0000", 2024-04-18T14:44:36.194 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999981 2024-04-18T14:44:36.194 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:36.194 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:36.194 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T14:44:36.194 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:56.541641+0000", 2024-04-18T14:44:36.194 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0414999999999999e-05 2024-04-18T14:44:36.194 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:36.195 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:36.195 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T14:44:36.195 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:56.541658+0000", 2024-04-18T14:44:36.195 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6626e-05 2024-04-18T14:44:36.195 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:36.195 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:36.195 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T14:44:36.195 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:56.541670+0000", 2024-04-18T14:44:36.195 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2354000000000001e-05 2024-04-18T14:44:36.195 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:36.195 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:36.195 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T14:44:36.195 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:56.541716+0000", 2024-04-18T14:44:36.195 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.5736999999999999e-05 2024-04-18T14:44:36.195 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:36.196 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:36.196 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T14:44:36.196 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:56.541792+0000", 2024-04-18T14:44:36.196 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.6038999999999995e-05 2024-04-18T14:44:36.196 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:36.196 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:36.196 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_started", 2024-04-18T14:44:36.196 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:56.551821+0000", 2024-04-18T14:44:36.196 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.010029222000000001 2024-04-18T14:44:36.196 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:36.196 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:36.196 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_committed", 2024-04-18T14:44:36.196 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:56.555036+0000", 2024-04-18T14:44:36.196 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0032150519999999999 2024-04-18T14:44:36.196 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:36.196 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:36.197 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T14:44:36.197 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:56.561911+0000", 2024-04-18T14:44:36.197 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.006874425 2024-04-18T14:44:36.197 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:36.197 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:36.197 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T14:44:36.197 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:56.561993+0000", 2024-04-18T14:44:36.197 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.2414000000000001e-05 2024-04-18T14:44:36.197 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:44:36.197 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T14:44:36.197 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:44:36.197 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:36.197 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:36.197 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4559.0:496 3.ds0 3:be45a49b:::smithi13430248-50:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e57)", 2024-04-18T14:44:36.197 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T14:43:56.541687+0000", 2024-04-18T14:44:36.197 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 39.653193442000003, 2024-04-18T14:44:36.198 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.013225494000000001, 2024-04-18T14:44:36.198 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T14:44:36.198 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-04-18T14:44:36.198 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-18T14:44:36.198 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4559", 2024-04-18T14:44:36.198 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/3113589487", 2024-04-18T14:44:36.198 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 496 2024-04-18T14:44:36.198 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:36.198 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T14:44:36.198 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:36.198 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T14:44:36.198 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:56.541687+0000", 2024-04-18T14:44:36.198 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:44:36.198 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:36.198 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:36.199 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T14:44:36.199 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:56.541687+0000", 2024-04-18T14:44:36.199 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:44:36.199 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:36.199 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:36.199 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T14:44:36.199 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:56.541686+0000", 2024-04-18T14:44:36.199 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-04-18T14:44:36.199 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:36.199 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:36.199 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T14:44:36.199 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:56.541691+0000", 2024-04-18T14:44:36.199 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.6879999999999998e-06 2024-04-18T14:44:36.199 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:36.199 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:36.200 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T14:44:36.200 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:56.541700+0000", 2024-04-18T14:44:36.200 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.5999999999999996e-06 2024-04-18T14:44:36.200 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:36.200 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:36.200 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T14:44:36.200 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:56.541708+0000", 2024-04-18T14:44:36.200 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.3490000000000003e-06 2024-04-18T14:44:36.200 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:36.200 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:36.200 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T14:44:36.200 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:56.541934+0000", 2024-04-18T14:44:36.200 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00022686399999999999 2024-04-18T14:44:36.200 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:36.200 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:36.201 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for blocked object", 2024-04-18T14:44:36.201 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:56.541985+0000", 2024-04-18T14:44:36.201 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.0426000000000001e-05 2024-04-18T14:44:36.201 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:36.201 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:36.201 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T14:44:36.201 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:56.554624+0000", 2024-04-18T14:44:36.201 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.012639091999999999 2024-04-18T14:44:36.201 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:36.201 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:36.201 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T14:44:36.201 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:56.554762+0000", 2024-04-18T14:44:36.201 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00013839000000000001 2024-04-18T14:44:36.201 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:36.201 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:36.201 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T14:44:36.202 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:56.554912+0000", 2024-04-18T14:44:36.202 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00014976200000000001 2024-04-18T14:44:36.202 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:44:36.202 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T14:44:36.202 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:44:36.202 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:36.202 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:36.202 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4559.0:619 3.ds0 3:b48f58f5:::smithi13430248-34:head [read 0~557056,checksum,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e66)", 2024-04-18T14:44:36.202 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T14:44:05.386939+0000", 2024-04-18T14:44:36.202 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 30.807940842000001, 2024-04-18T14:44:36.202 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.011158332999999999, 2024-04-18T14:44:36.202 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T14:44:36.202 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-04-18T14:44:36.202 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-18T14:44:36.202 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4559", 2024-04-18T14:44:36.203 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/3113589487", 2024-04-18T14:44:36.203 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 619 2024-04-18T14:44:36.203 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:36.203 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T14:44:36.203 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:36.203 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T14:44:36.203 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:05.386939+0000", 2024-04-18T14:44:36.203 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:44:36.203 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:36.203 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:36.203 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T14:44:36.203 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:05.386939+0000", 2024-04-18T14:44:36.203 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:44:36.203 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:36.203 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:36.203 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T14:44:36.204 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:05.386936+0000", 2024-04-18T14:44:36.204 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999967 2024-04-18T14:44:36.204 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:36.204 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:36.204 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T14:44:36.204 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:05.386953+0000", 2024-04-18T14:44:36.204 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.7606999999999999e-05 2024-04-18T14:44:36.204 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:36.204 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:36.204 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T14:44:36.204 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:05.386996+0000", 2024-04-18T14:44:36.204 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.2599999999999999e-05 2024-04-18T14:44:36.204 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:36.204 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:36.204 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T14:44:36.205 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:05.387014+0000", 2024-04-18T14:44:36.205 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8583000000000001e-05 2024-04-18T14:44:36.205 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:36.205 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:36.205 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T14:44:36.205 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:05.387138+0000", 2024-04-18T14:44:36.205 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000123075 2024-04-18T14:44:36.205 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:36.205 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:36.205 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op must wait for map", 2024-04-18T14:44:36.205 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:05.387150+0000", 2024-04-18T14:44:36.205 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2442999999999999e-05 2024-04-18T14:44:36.205 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:36.205 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:36.206 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T14:44:36.206 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:05.391814+0000", 2024-04-18T14:44:36.206 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0046638039999999997 2024-04-18T14:44:36.206 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:36.206 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:36.206 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T14:44:36.206 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:05.392076+0000", 2024-04-18T14:44:36.206 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000261971 2024-04-18T14:44:36.206 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:36.206 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:36.206 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T14:44:36.206 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:05.398097+0000", 2024-04-18T14:44:36.206 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.006021747 2024-04-18T14:44:36.206 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:44:36.206 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T14:44:36.207 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:44:36.207 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:36.207 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:36.207 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4559.0:620 3.ds0 3:b48f58f5:::smithi13430248-34:head [read 0~557056,checksum] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e66)", 2024-04-18T14:44:36.207 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T14:44:05.387040+0000", 2024-04-18T14:44:36.207 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 30.807840373000001, 2024-04-18T14:44:36.207 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.011816439999999999, 2024-04-18T14:44:36.207 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T14:44:36.207 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-04-18T14:44:36.207 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-18T14:44:36.207 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4559", 2024-04-18T14:44:36.207 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/3113589487", 2024-04-18T14:44:36.207 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 620 2024-04-18T14:44:36.207 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:36.207 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T14:44:36.208 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:36.208 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T14:44:36.208 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:05.387040+0000", 2024-04-18T14:44:36.208 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:44:36.208 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:36.208 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:36.208 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T14:44:36.208 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:05.387040+0000", 2024-04-18T14:44:36.208 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:44:36.208 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:36.208 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:36.208 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T14:44:36.208 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:05.387039+0000", 2024-04-18T14:44:36.208 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-18T14:44:36.209 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:36.209 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:36.209 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T14:44:36.209 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:05.387045+0000", 2024-04-18T14:44:36.209 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.5760000000000002e-06 2024-04-18T14:44:36.209 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:36.209 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:36.209 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T14:44:36.209 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:05.387057+0000", 2024-04-18T14:44:36.209 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1714e-05 2024-04-18T14:44:36.209 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:36.209 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:36.209 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T14:44:36.209 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:05.387065+0000", 2024-04-18T14:44:36.210 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.7800000000000001e-06 2024-04-18T14:44:36.210 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:36.210 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:36.210 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T14:44:36.210 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:05.387302+0000", 2024-04-18T14:44:36.210 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00023728399999999999 2024-04-18T14:44:36.210 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:36.210 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:36.210 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting_for_map not empty", 2024-04-18T14:44:36.210 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:05.387323+0000", 2024-04-18T14:44:36.210 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.1330000000000001e-05 2024-04-18T14:44:36.210 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:36.210 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:36.210 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T14:44:36.211 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:05.393386+0000", 2024-04-18T14:44:36.211 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0060623500000000002 2024-04-18T14:44:36.211 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:36.211 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:36.211 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T14:44:36.211 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:05.393566+0000", 2024-04-18T14:44:36.211 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000180135 2024-04-18T14:44:36.211 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:36.211 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:36.211 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T14:44:36.211 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:05.398856+0000", 2024-04-18T14:44:36.211 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.005290271 2024-04-18T14:44:36.211 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:44:36.211 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T14:44:36.211 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:44:36.212 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:36.212 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:36.212 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4559.0:621 3.ds0 3:b48f58f5:::smithi13430248-34:head [read 0~557056,checksum] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e66)", 2024-04-18T14:44:36.212 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T14:44:05.387116+0000", 2024-04-18T14:44:36.212 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 30.807763616999999, 2024-04-18T14:44:36.212 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.012593152, 2024-04-18T14:44:36.212 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T14:44:36.212 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-04-18T14:44:36.212 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-18T14:44:36.212 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4559", 2024-04-18T14:44:36.212 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/3113589487", 2024-04-18T14:44:36.212 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 621 2024-04-18T14:44:36.212 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:36.212 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T14:44:36.212 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:36.213 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T14:44:36.213 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:05.387116+0000", 2024-04-18T14:44:36.213 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:44:36.213 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:36.213 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:36.213 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T14:44:36.213 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:05.387116+0000", 2024-04-18T14:44:36.213 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:44:36.213 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:36.213 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:36.213 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T14:44:36.213 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:05.387116+0000", 2024-04-18T14:44:36.213 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-18T14:44:36.213 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:36.214 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:36.214 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T14:44:36.214 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:05.387121+0000", 2024-04-18T14:44:36.214 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.0560000000000004e-06 2024-04-18T14:44:36.214 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:36.214 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:36.214 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T14:44:36.214 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:05.387131+0000", 2024-04-18T14:44:36.214 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0573e-05 2024-04-18T14:44:36.214 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:36.214 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:36.214 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T14:44:36.214 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:05.387139+0000", 2024-04-18T14:44:36.214 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.8539999999999997e-06 2024-04-18T14:44:36.214 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:36.215 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:36.215 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T14:44:36.215 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:05.387377+0000", 2024-04-18T14:44:36.215 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00023790500000000001 2024-04-18T14:44:36.215 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:36.215 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:36.215 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting_for_map not empty", 2024-04-18T14:44:36.215 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:05.387387+0000", 2024-04-18T14:44:36.215 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.7489999999999993e-06 2024-04-18T14:44:36.215 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:36.215 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:36.215 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T14:44:36.215 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:05.394286+0000", 2024-04-18T14:44:36.215 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0068987500000000004 2024-04-18T14:44:36.215 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:36.215 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:36.216 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T14:44:36.216 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:05.394424+0000", 2024-04-18T14:44:36.216 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000138629 2024-04-18T14:44:36.216 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:36.216 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:36.216 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T14:44:36.216 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:05.399710+0000", 2024-04-18T14:44:36.216 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0052853919999999999 2024-04-18T14:44:36.216 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:44:36.216 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T14:44:36.216 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:44:36.216 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:36.216 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:36.216 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4559.0:835 3.ds0 3:b48f58f5:::smithi13430248-34:head [append 0~655360] snapc 2c=[2c,2b,2a,29,28,27,26,23,22,1e,1c,1a,16,14,13,11,2] ondisk+write+known_if_redirected+supports_pool_eio e77)", 2024-04-18T14:44:36.216 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T14:44:16.426808+0000", 2024-04-18T14:44:36.216 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 19.768071589000002, 2024-04-18T14:44:36.217 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.025524121, 2024-04-18T14:44:36.217 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T14:44:36.217 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T14:44:36.217 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-18T14:44:36.217 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4559", 2024-04-18T14:44:36.217 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/3113589487", 2024-04-18T14:44:36.217 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 835 2024-04-18T14:44:36.217 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:36.217 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T14:44:36.217 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:36.217 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T14:44:36.217 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:16.426808+0000", 2024-04-18T14:44:36.217 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:44:36.217 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:36.217 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:36.218 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T14:44:36.218 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:16.426808+0000", 2024-04-18T14:44:36.218 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:44:36.218 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:36.218 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:36.218 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T14:44:36.218 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:16.426805+0000", 2024-04-18T14:44:36.218 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999967 2024-04-18T14:44:36.218 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:36.218 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:36.218 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T14:44:36.218 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:16.427815+0000", 2024-04-18T14:44:36.218 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0010096059999999999 2024-04-18T14:44:36.218 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:36.218 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:36.219 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T14:44:36.219 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:16.427845+0000", 2024-04-18T14:44:36.219 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.995e-05 2024-04-18T14:44:36.219 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:36.219 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:36.219 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T14:44:36.219 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:16.427860+0000", 2024-04-18T14:44:36.219 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5139e-05 2024-04-18T14:44:36.219 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:36.219 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:36.219 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T14:44:36.219 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:16.427998+0000", 2024-04-18T14:44:36.219 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00013767900000000001 2024-04-18T14:44:36.219 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:36.219 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:36.220 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op must wait for map", 2024-04-18T14:44:36.220 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:16.428016+0000", 2024-04-18T14:44:36.220 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.842e-05 2024-04-18T14:44:36.220 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:36.220 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:36.220 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T14:44:36.220 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:16.430294+0000", 2024-04-18T14:44:36.220 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0022780389999999999 2024-04-18T14:44:36.220 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:36.220 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:36.220 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T14:44:36.220 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:16.430559+0000", 2024-04-18T14:44:36.220 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00026499800000000001 2024-04-18T14:44:36.220 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:36.220 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:36.221 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_started", 2024-04-18T14:44:36.221 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:16.433355+0000", 2024-04-18T14:44:36.221 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.002795498 2024-04-18T14:44:36.221 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:36.221 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:36.221 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_committed", 2024-04-18T14:44:36.221 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:16.445845+0000", 2024-04-18T14:44:36.221 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.012489892000000001 2024-04-18T14:44:36.221 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:36.221 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:36.221 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T14:44:36.221 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:16.452227+0000", 2024-04-18T14:44:36.221 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0063820659999999996 2024-04-18T14:44:36.221 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:36.222 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:36.222 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T14:44:36.222 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:16.452333+0000", 2024-04-18T14:44:36.222 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000105944 2024-04-18T14:44:36.222 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:44:36.222 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T14:44:36.222 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:44:36.222 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:36.222 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:36.222 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4559.0:836 3.ds0 3:b48f58f5:::smithi13430248-34:head [append 0~425984] snapc 2c=[2c,2b,2a,29,28,27,26,23,22,1e,1c,1a,16,14,13,11,2] ondisk+write+known_if_redirected+supports_pool_eio e77)", 2024-04-18T14:44:36.222 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T14:44:16.430117+0000", 2024-04-18T14:44:36.222 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 19.764762920999999, 2024-04-18T14:44:36.222 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.027905771999999999, 2024-04-18T14:44:36.222 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T14:44:36.223 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T14:44:36.223 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-18T14:44:36.223 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4559", 2024-04-18T14:44:36.223 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/3113589487", 2024-04-18T14:44:36.223 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 836 2024-04-18T14:44:36.223 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:36.223 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T14:44:36.223 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:36.223 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T14:44:36.223 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:16.430117+0000", 2024-04-18T14:44:36.223 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:44:36.223 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:36.223 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:36.223 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T14:44:36.223 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:16.430117+0000", 2024-04-18T14:44:36.224 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:44:36.224 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:36.224 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:36.224 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T14:44:36.224 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:16.430114+0000", 2024-04-18T14:44:36.224 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999967 2024-04-18T14:44:36.224 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:36.224 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:36.224 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T14:44:36.224 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:16.430717+0000", 2024-04-18T14:44:36.224 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00060351199999999995 2024-04-18T14:44:36.224 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:36.224 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:36.224 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T14:44:36.224 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:16.430744+0000", 2024-04-18T14:44:36.225 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.6777000000000001e-05 2024-04-18T14:44:36.225 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:36.225 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:36.225 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T14:44:36.225 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:16.430763+0000", 2024-04-18T14:44:36.225 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8756000000000001e-05 2024-04-18T14:44:36.225 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:36.225 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:36.225 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T14:44:36.225 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:16.441380+0000", 2024-04-18T14:44:36.225 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.010617549 2024-04-18T14:44:36.225 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:36.225 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:36.225 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T14:44:36.225 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:16.441465+0000", 2024-04-18T14:44:36.225 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.4324000000000001e-05 2024-04-18T14:44:36.226 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:36.226 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:36.226 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_started", 2024-04-18T14:44:36.226 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:16.442099+0000", 2024-04-18T14:44:36.226 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00063493000000000002 2024-04-18T14:44:36.226 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:36.226 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:36.226 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_committed", 2024-04-18T14:44:36.226 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:16.452126+0000", 2024-04-18T14:44:36.226 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.010026352000000001 2024-04-18T14:44:36.226 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:36.226 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:36.226 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T14:44:36.226 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:16.457933+0000", 2024-04-18T14:44:36.227 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0058070530000000004 2024-04-18T14:44:36.227 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:36.227 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:36.227 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T14:44:36.227 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:16.458023+0000", 2024-04-18T14:44:36.227 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.9982999999999995e-05 2024-04-18T14:44:36.227 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:44:36.227 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T14:44:36.227 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:44:36.227 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:36.227 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:36.227 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4559.0:837 3.ds0 3:b48f58f5:::smithi13430248-34:head [append 0~638976] snapc 2c=[2c,2b,2a,29,28,27,26,23,22,1e,1c,1a,16,14,13,11,2] ondisk+write+known_if_redirected+supports_pool_eio e77)", 2024-04-18T14:44:36.227 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T14:44:16.434604+0000", 2024-04-18T14:44:36.227 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 19.760276083000001, 2024-04-18T14:44:36.227 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.024529546999999999, 2024-04-18T14:44:36.227 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T14:44:36.228 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T14:44:36.228 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-18T14:44:36.228 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4559", 2024-04-18T14:44:36.228 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/3113589487", 2024-04-18T14:44:36.228 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 837 2024-04-18T14:44:36.228 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:36.228 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T14:44:36.228 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:36.228 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T14:44:36.228 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:16.434604+0000", 2024-04-18T14:44:36.228 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:44:36.228 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:36.228 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:36.228 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T14:44:36.228 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:16.434604+0000", 2024-04-18T14:44:36.229 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:44:36.229 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:36.229 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:36.229 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T14:44:36.229 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:16.434600+0000", 2024-04-18T14:44:36.229 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999962 2024-04-18T14:44:36.229 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:36.229 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:36.229 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T14:44:36.229 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:16.435508+0000", 2024-04-18T14:44:36.229 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00090795899999999996 2024-04-18T14:44:36.229 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:36.229 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:36.229 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T14:44:36.229 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:16.435559+0000", 2024-04-18T14:44:36.229 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.0476999999999998e-05 2024-04-18T14:44:36.230 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:36.230 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:36.230 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T14:44:36.230 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:16.435584+0000", 2024-04-18T14:44:36.230 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.5150000000000001e-05 2024-04-18T14:44:36.230 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:36.230 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:36.230 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T14:44:36.230 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:16.446186+0000", 2024-04-18T14:44:36.230 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.010602227000000001 2024-04-18T14:44:36.230 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:36.230 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:36.230 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T14:44:36.230 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:16.446281+0000", 2024-04-18T14:44:36.230 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.5111999999999993e-05 2024-04-18T14:44:36.231 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:36.231 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:36.231 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_started", 2024-04-18T14:44:36.231 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:16.447320+0000", 2024-04-18T14:44:36.231 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0010388929999999999 2024-04-18T14:44:36.231 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:36.231 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:36.231 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_committed", 2024-04-18T14:44:36.231 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:16.452436+0000", 2024-04-18T14:44:36.231 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0051162200000000003 2024-04-18T14:44:36.231 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:36.231 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:36.231 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T14:44:36.231 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:16.459045+0000", 2024-04-18T14:44:36.231 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0066085520000000002 2024-04-18T14:44:36.232 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:36.232 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:36.232 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T14:44:36.232 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:16.459133+0000", 2024-04-18T14:44:36.232 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.8579999999999996e-05 2024-04-18T14:44:36.232 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:44:36.232 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T14:44:36.232 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:44:36.232 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:36.232 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:36.232 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4559.0:838 3.ds0 3:b48f58f5:::smithi13430248-34:head [append 0~491520] snapc 2c=[2c,2b,2a,29,28,27,26,23,22,1e,1c,1a,16,14,13,11,2] ondisk+write+known_if_redirected+supports_pool_eio e77)", 2024-04-18T14:44:36.232 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T14:44:16.439528+0000", 2024-04-18T14:44:36.232 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 19.755352108, 2024-04-18T14:44:36.232 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.019833301000000001, 2024-04-18T14:44:36.232 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T14:44:36.232 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T14:44:36.233 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-18T14:44:36.233 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4559", 2024-04-18T14:44:36.233 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/3113589487", 2024-04-18T14:44:36.233 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 838 2024-04-18T14:44:36.233 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:36.233 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T14:44:36.233 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:36.233 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T14:44:36.233 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:16.439528+0000", 2024-04-18T14:44:36.233 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:44:36.233 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:36.233 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:36.233 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T14:44:36.233 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:16.439528+0000", 2024-04-18T14:44:36.233 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:44:36.234 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:36.234 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:36.234 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T14:44:36.234 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:16.439525+0000", 2024-04-18T14:44:36.234 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999967 2024-04-18T14:44:36.234 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:36.234 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:36.234 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T14:44:36.234 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:16.440383+0000", 2024-04-18T14:44:36.234 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00085854900000000001 2024-04-18T14:44:36.234 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:36.234 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:36.234 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T14:44:36.234 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:16.440419+0000", 2024-04-18T14:44:36.234 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.5859999999999999e-05 2024-04-18T14:44:36.235 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:36.235 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:36.235 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T14:44:36.235 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:16.440439+0000", 2024-04-18T14:44:36.235 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0137e-05 2024-04-18T14:44:36.235 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:36.235 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:36.235 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T14:44:36.235 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:16.448171+0000", 2024-04-18T14:44:36.235 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0077320069999999999 2024-04-18T14:44:36.235 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:36.235 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:36.235 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T14:44:36.235 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:16.448648+0000", 2024-04-18T14:44:36.235 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00047709599999999999 2024-04-18T14:44:36.235 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:36.236 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:36.236 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_started", 2024-04-18T14:44:36.236 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:16.450492+0000", 2024-04-18T14:44:36.236 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0018442689999999999 2024-04-18T14:44:36.236 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:36.236 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:36.236 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_committed", 2024-04-18T14:44:36.236 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:16.455811+0000", 2024-04-18T14:44:36.236 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0053188310000000004 2024-04-18T14:44:36.236 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:36.236 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:36.236 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T14:44:36.236 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:16.459281+0000", 2024-04-18T14:44:36.236 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0034693979999999998 2024-04-18T14:44:36.236 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:36.236 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:36.237 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T14:44:36.237 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:16.459361+0000", 2024-04-18T14:44:36.237 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.0500000000000005e-05 2024-04-18T14:44:36.237 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:44:36.237 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T14:44:36.237 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:44:36.237 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:36.237 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:36.237 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4559.0:839 3.ds0 3:b48f58f5:::smithi13430248-34:head [setxattr _header (57) in=7b] snapc 2c=[2c,2b,2a,29,28,27,26,23,22,1e,1c,1a,16,14,13,11,2] ondisk+write+known_if_redirected+supports_pool_eio e77)", 2024-04-18T14:44:36.237 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T14:44:16.440463+0000", 2024-04-18T14:44:36.237 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 19.754417324999999, 2024-04-18T14:44:36.237 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.019173315, 2024-04-18T14:44:36.237 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T14:44:36.237 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T14:44:36.237 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-18T14:44:36.237 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4559", 2024-04-18T14:44:36.238 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/3113589487", 2024-04-18T14:44:36.238 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 839 2024-04-18T14:44:36.238 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:36.238 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T14:44:36.238 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:36.238 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T14:44:36.238 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:16.440463+0000", 2024-04-18T14:44:36.238 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:44:36.238 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:36.238 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:36.238 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T14:44:36.238 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:16.440463+0000", 2024-04-18T14:44:36.238 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:44:36.238 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:36.238 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:36.239 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T14:44:36.239 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:16.440460+0000", 2024-04-18T14:44:36.239 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999971 2024-04-18T14:44:36.239 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:36.239 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:36.239 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T14:44:36.239 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:16.440471+0000", 2024-04-18T14:44:36.239 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0644e-05 2024-04-18T14:44:36.239 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:36.239 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:36.239 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T14:44:36.239 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:16.440490+0000", 2024-04-18T14:44:36.239 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.9412999999999999e-05 2024-04-18T14:44:36.239 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:36.239 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:36.240 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T14:44:36.240 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:16.440503+0000", 2024-04-18T14:44:36.240 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3046e-05 2024-04-18T14:44:36.240 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:36.240 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:36.240 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T14:44:36.240 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:16.452489+0000", 2024-04-18T14:44:36.240 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.011986 2024-04-18T14:44:36.240 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:36.240 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:36.240 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T14:44:36.240 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:16.452596+0000", 2024-04-18T14:44:36.240 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000107364 2024-04-18T14:44:36.240 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:36.240 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:36.241 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_started", 2024-04-18T14:44:36.241 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:16.453079+0000", 2024-04-18T14:44:36.241 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000482795 2024-04-18T14:44:36.241 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:36.241 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:36.241 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_committed", 2024-04-18T14:44:36.241 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:16.456561+0000", 2024-04-18T14:44:36.241 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0034814030000000001 2024-04-18T14:44:36.241 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:36.241 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:36.241 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T14:44:36.241 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:16.459523+0000", 2024-04-18T14:44:36.241 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0029628089999999998 2024-04-18T14:44:36.241 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:36.241 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:36.241 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T14:44:36.242 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:16.459636+0000", 2024-04-18T14:44:36.242 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00011254799999999999 2024-04-18T14:44:36.242 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:44:36.242 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T14:44:36.242 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:44:36.242 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:36.242 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:36.242 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4559.0:840 3.ds0 3:b48f58f5:::smithi13430248-34:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e77)", 2024-04-18T14:44:36.242 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T14:44:16.440515+0000", 2024-04-18T14:44:36.242 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 19.754364836000001, 2024-04-18T14:44:36.242 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.023015104000000002, 2024-04-18T14:44:36.242 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T14:44:36.242 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-04-18T14:44:36.242 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-18T14:44:36.242 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4559", 2024-04-18T14:44:36.243 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/3113589487", 2024-04-18T14:44:36.243 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 840 2024-04-18T14:44:36.243 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:36.243 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T14:44:36.243 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:36.243 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T14:44:36.243 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:16.440515+0000", 2024-04-18T14:44:36.243 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:44:36.243 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:36.243 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:36.243 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T14:44:36.243 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:16.440515+0000", 2024-04-18T14:44:36.243 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:44:36.243 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:36.244 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:36.244 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T14:44:36.244 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:16.440514+0000", 2024-04-18T14:44:36.244 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999986 2024-04-18T14:44:36.244 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:36.244 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:36.244 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T14:44:36.244 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:16.440521+0000", 2024-04-18T14:44:36.244 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.1799999999999999e-06 2024-04-18T14:44:36.244 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:36.244 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:36.244 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T14:44:36.244 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:16.440539+0000", 2024-04-18T14:44:36.244 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.772e-05 2024-04-18T14:44:36.244 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:36.245 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:36.245 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T14:44:36.245 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:16.440551+0000", 2024-04-18T14:44:36.245 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1756000000000001e-05 2024-04-18T14:44:36.245 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:36.245 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:36.245 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T14:44:36.245 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:16.453734+0000", 2024-04-18T14:44:36.245 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.013183924 2024-04-18T14:44:36.245 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:36.245 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:36.245 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for rw locks", 2024-04-18T14:44:36.245 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:16.453990+0000", 2024-04-18T14:44:36.245 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00025553499999999999 2024-04-18T14:44:36.246 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:36.246 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:36.246 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T14:44:36.246 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:16.460366+0000", 2024-04-18T14:44:36.246 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0063763680000000003 2024-04-18T14:44:36.246 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:36.246 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:36.246 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T14:44:36.246 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:16.460521+0000", 2024-04-18T14:44:36.246 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000155017 2024-04-18T14:44:36.246 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:36.246 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:36.246 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T14:44:36.246 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:16.463530+0000", 2024-04-18T14:44:36.246 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0030089100000000001 2024-04-18T14:44:36.247 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:44:36.247 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T14:44:36.247 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:44:36.247 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:36.247 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:36.247 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "MOSDECSubOpWrite(3.bs5 78/70 ECSubWrite(tid=94, reqid=osd.10.0:94, at_version=78'42, trim_to=0'0, roll_forward_to=77'40))", 2024-04-18T14:44:36.247 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T14:44:17.430108+0000", 2024-04-18T14:44:36.247 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 18.764772146999999, 2024-04-18T14:44:36.247 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.016214016000000001, 2024-04-18T14:44:36.247 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T14:44:36.247 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-04-18T14:44:36.247 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T14:44:36.247 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:36.247 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T14:44:36.247 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:17.430108+0000", 2024-04-18T14:44:36.248 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:44:36.248 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:36.248 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:36.248 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T14:44:36.248 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:17.430108+0000", 2024-04-18T14:44:36.248 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:44:36.248 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:36.248 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:36.248 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T14:44:36.248 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:17.430107+0000", 2024-04-18T14:44:36.248 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-04-18T14:44:36.248 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:36.248 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:36.248 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T14:44:36.248 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:17.430142+0000", 2024-04-18T14:44:36.249 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.5249000000000001e-05 2024-04-18T14:44:36.249 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:36.249 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:36.249 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T14:44:36.249 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:17.430158+0000", 2024-04-18T14:44:36.249 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5610000000000001e-05 2024-04-18T14:44:36.249 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:36.249 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:36.249 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T14:44:36.249 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:17.430167+0000", 2024-04-18T14:44:36.249 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.9870000000000005e-06 2024-04-18T14:44:36.249 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:36.249 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:36.249 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T14:44:36.250 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:17.430286+0000", 2024-04-18T14:44:36.250 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000119484 2024-04-18T14:44:36.250 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:36.250 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:36.250 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_started", 2024-04-18T14:44:36.250 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:17.430310+0000", 2024-04-18T14:44:36.250 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.3487000000000001e-05 2024-04-18T14:44:36.250 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:36.250 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:36.250 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_committed", 2024-04-18T14:44:36.250 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:17.446265+0000", 2024-04-18T14:44:36.250 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.015954601999999998 2024-04-18T14:44:36.250 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:36.250 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:36.250 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T14:44:36.251 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:17.446322+0000", 2024-04-18T14:44:36.251 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.7293000000000002e-05 2024-04-18T14:44:36.251 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:44:36.251 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T14:44:36.251 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:44:36.251 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:36.251 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:36.251 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "MOSDECSubOpWrite(3.6s5 78/70 ECSubWrite(tid=276, reqid=osd.14.0:276, at_version=78'113, trim_to=0'0, roll_forward_to=77'111))", 2024-04-18T14:44:36.251 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T14:44:17.431171+0000", 2024-04-18T14:44:36.251 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 18.763708519000001, 2024-04-18T14:44:36.251 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.016763452000000002, 2024-04-18T14:44:36.251 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T14:44:36.251 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-04-18T14:44:36.251 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T14:44:36.251 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:36.251 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T14:44:36.252 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:17.431171+0000", 2024-04-18T14:44:36.252 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:44:36.252 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:36.252 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:36.252 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T14:44:36.252 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:17.431171+0000", 2024-04-18T14:44:36.252 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:44:36.252 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:36.252 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:36.252 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T14:44:36.252 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:17.431171+0000", 2024-04-18T14:44:36.252 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-18T14:44:36.252 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:36.252 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:36.252 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T14:44:36.253 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:17.431201+0000", 2024-04-18T14:44:36.253 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.0716000000000002e-05 2024-04-18T14:44:36.253 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:36.253 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:36.253 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T14:44:36.253 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:17.431222+0000", 2024-04-18T14:44:36.253 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0891999999999999e-05 2024-04-18T14:44:36.253 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:36.253 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:36.253 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T14:44:36.253 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:17.431235+0000", 2024-04-18T14:44:36.253 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2666999999999999e-05 2024-04-18T14:44:36.253 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:36.253 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:36.253 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T14:44:36.253 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:17.431356+0000", 2024-04-18T14:44:36.254 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000121032 2024-04-18T14:44:36.254 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:36.254 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:36.254 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_started", 2024-04-18T14:44:36.254 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:17.431409+0000", 2024-04-18T14:44:36.254 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.3523000000000002e-05 2024-04-18T14:44:36.254 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:36.254 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:36.254 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_committed", 2024-04-18T14:44:36.254 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:17.447880+0000", 2024-04-18T14:44:36.254 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.016470101000000001 2024-04-18T14:44:36.254 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:36.254 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:36.254 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T14:44:36.255 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:17.447935+0000", 2024-04-18T14:44:36.255 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.5343000000000002e-05 2024-04-18T14:44:36.255 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:44:36.255 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T14:44:36.255 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:44:36.255 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:36.255 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:36.255 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "MOSDECSubOpWrite(3.5s4 78/30 ECSubWrite(tid=41, reqid=osd.15.0:40, at_version=0'0, trim_to=0'0, roll_forward_to=78'34))", 2024-04-18T14:44:36.255 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T14:44:17.433051+0000", 2024-04-18T14:44:36.255 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 18.761828798, 2024-04-18T14:44:36.255 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.015046253000000001, 2024-04-18T14:44:36.255 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T14:44:36.255 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-04-18T14:44:36.255 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T14:44:36.255 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:36.255 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T14:44:36.256 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:17.433051+0000", 2024-04-18T14:44:36.256 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:44:36.256 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:36.256 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:36.256 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T14:44:36.256 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:17.433051+0000", 2024-04-18T14:44:36.256 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:44:36.256 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:36.256 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:36.256 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T14:44:36.256 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:17.433050+0000", 2024-04-18T14:44:36.256 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999986 2024-04-18T14:44:36.256 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:36.256 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:36.256 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T14:44:36.257 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:17.433064+0000", 2024-04-18T14:44:36.257 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3548e-05 2024-04-18T14:44:36.257 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:36.257 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:36.257 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T14:44:36.257 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:17.433077+0000", 2024-04-18T14:44:36.257 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3108000000000001e-05 2024-04-18T14:44:36.257 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:36.257 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:36.257 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T14:44:36.257 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:17.433085+0000", 2024-04-18T14:44:36.257 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.755e-06 2024-04-18T14:44:36.257 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:36.257 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:36.257 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T14:44:36.257 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:17.433421+0000", 2024-04-18T14:44:36.258 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000335216 2024-04-18T14:44:36.258 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:36.258 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:36.258 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_started", 2024-04-18T14:44:36.258 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:17.433429+0000", 2024-04-18T14:44:36.258 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.405e-06 2024-04-18T14:44:36.258 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:36.258 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:36.258 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_committed", 2024-04-18T14:44:36.258 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:17.448064+0000", 2024-04-18T14:44:36.258 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.014634881000000001 2024-04-18T14:44:36.258 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:36.258 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:36.258 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T14:44:36.258 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:17.448097+0000", 2024-04-18T14:44:36.259 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.3532999999999999e-05 2024-04-18T14:44:36.259 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:44:36.259 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T14:44:36.259 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:44:36.259 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:36.259 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:36.259 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "MOSDECSubOpWrite(3.3s1 78/30 ECSubWrite(tid=282, reqid=osd.13.0:282, at_version=78'49, trim_to=0'0, roll_forward_to=69'47))", 2024-04-18T14:44:36.259 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T14:44:17.433192+0000", 2024-04-18T14:44:36.259 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 18.761687545000001, 2024-04-18T14:44:36.259 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.014356789999999999, 2024-04-18T14:44:36.259 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T14:44:36.259 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-04-18T14:44:36.259 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T14:44:36.259 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:36.259 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T14:44:36.260 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:17.433192+0000", 2024-04-18T14:44:36.260 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:44:36.260 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:36.260 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:36.260 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T14:44:36.260 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:17.433192+0000", 2024-04-18T14:44:36.260 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:44:36.260 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:36.260 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:36.260 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T14:44:36.260 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:17.433192+0000", 2024-04-18T14:44:36.260 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967296 2024-04-18T14:44:36.260 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:36.260 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:36.260 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T14:44:36.261 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:17.433214+0000", 2024-04-18T14:44:36.261 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2189e-05 2024-04-18T14:44:36.261 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:36.261 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:36.261 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T14:44:36.261 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:17.433227+0000", 2024-04-18T14:44:36.261 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2167000000000001e-05 2024-04-18T14:44:36.261 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:36.261 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:36.261 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T14:44:36.261 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:17.433236+0000", 2024-04-18T14:44:36.261 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.4339999999999998e-06 2024-04-18T14:44:36.261 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:36.261 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:36.261 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T14:44:36.261 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:17.433297+0000", 2024-04-18T14:44:36.262 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.0577e-05 2024-04-18T14:44:36.262 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:36.262 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:36.262 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_started", 2024-04-18T14:44:36.262 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:17.433303+0000", 2024-04-18T14:44:36.262 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.2580000000000001e-06 2024-04-18T14:44:36.262 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:36.262 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:36.262 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_committed", 2024-04-18T14:44:36.262 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:17.447518+0000", 2024-04-18T14:44:36.262 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.014214625 2024-04-18T14:44:36.262 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:36.262 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:36.262 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T14:44:36.262 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:17.447549+0000", 2024-04-18T14:44:36.263 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.1717999999999997e-05 2024-04-18T14:44:36.263 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:44:36.263 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T14:44:36.263 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:44:36.263 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:36.263 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:36.263 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "MOSDECSubOpWrite(3.bs5 78/70 ECSubWrite(tid=95, reqid=osd.10.0:95, at_version=78'44, trim_to=0'0, roll_forward_to=77'40))", 2024-04-18T14:44:36.263 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T14:44:17.434144+0000", 2024-04-18T14:44:36.263 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 18.760736187999999, 2024-04-18T14:44:36.263 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.013711515000000001, 2024-04-18T14:44:36.263 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T14:44:36.263 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-04-18T14:44:36.263 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T14:44:36.263 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:36.263 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T14:44:36.264 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:17.434144+0000", 2024-04-18T14:44:36.264 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:44:36.264 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:36.264 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:36.264 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T14:44:36.264 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:17.434144+0000", 2024-04-18T14:44:36.264 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:44:36.264 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:36.264 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:36.264 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T14:44:36.264 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:17.434143+0000", 2024-04-18T14:44:36.264 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-18T14:44:36.264 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:36.264 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:36.264 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T14:44:36.265 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:17.434165+0000", 2024-04-18T14:44:36.265 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2215e-05 2024-04-18T14:44:36.265 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:36.265 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:36.265 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T14:44:36.265 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:17.434177+0000", 2024-04-18T14:44:36.265 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1422e-05 2024-04-18T14:44:36.265 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:36.265 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:36.265 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T14:44:36.265 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:17.434186+0000", 2024-04-18T14:44:36.265 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.0399999999999998e-06 2024-04-18T14:44:36.265 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:36.265 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:36.265 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T14:44:36.266 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:17.434294+0000", 2024-04-18T14:44:36.266 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000108613 2024-04-18T14:44:36.266 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:36.266 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:36.266 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_started", 2024-04-18T14:44:36.266 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:17.434318+0000", 2024-04-18T14:44:36.266 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.3606999999999999e-05 2024-04-18T14:44:36.266 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:36.266 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:36.266 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_committed", 2024-04-18T14:44:36.266 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:17.447831+0000", 2024-04-18T14:44:36.266 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.013513103 2024-04-18T14:44:36.266 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:36.267 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:36.267 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T14:44:36.267 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:17.447855+0000", 2024-04-18T14:44:36.267 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.4354000000000001e-05 2024-04-18T14:44:36.267 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:44:36.267 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T14:44:36.267 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:44:36.267 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:36.267 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:36.267 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "MOSDECSubOpWriteReply(3.ds0 77/30 ECSubWriteReply(tid=54, last_complete=78'49, committed=1, applied=1))", 2024-04-18T14:44:36.267 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T14:44:17.434801+0000", 2024-04-18T14:44:36.267 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 18.760078873000001, 2024-04-18T14:44:36.267 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.012801692999999999, 2024-04-18T14:44:36.267 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T14:44:36.267 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-04-18T14:44:36.267 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T14:44:36.268 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:36.268 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T14:44:36.268 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:17.434801+0000", 2024-04-18T14:44:36.268 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:44:36.268 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:36.268 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:36.268 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T14:44:36.268 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:17.434801+0000", 2024-04-18T14:44:36.268 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:44:36.268 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:36.268 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:36.268 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T14:44:36.268 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:17.434800+0000", 2024-04-18T14:44:36.268 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-18T14:44:36.269 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:36.269 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:36.269 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T14:44:36.269 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:17.434807+0000", 2024-04-18T14:44:36.269 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.8929999999999999e-06 2024-04-18T14:44:36.269 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:36.269 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:36.269 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T14:44:36.269 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:17.434819+0000", 2024-04-18T14:44:36.269 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1996e-05 2024-04-18T14:44:36.269 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:36.269 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:36.269 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T14:44:36.269 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:17.434825+0000", 2024-04-18T14:44:36.270 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.1670000000000004e-06 2024-04-18T14:44:36.270 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:36.270 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:36.270 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T14:44:36.270 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:17.447582+0000", 2024-04-18T14:44:36.270 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.012756521999999999 2024-04-18T14:44:36.270 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:36.270 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:36.270 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T14:44:36.270 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:17.447603+0000", 2024-04-18T14:44:36.270 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.1183999999999999e-05 2024-04-18T14:44:36.270 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:44:36.270 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T14:44:36.270 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:44:36.270 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:36.271 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:36.271 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "MOSDECSubOpWriteReply(3.ds0 78/30 ECSubWriteReply(tid=54, last_complete=78'49, committed=1, applied=1))", 2024-04-18T14:44:36.271 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T14:44:17.436302+0000", 2024-04-18T14:44:36.271 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 18.758577659, 2024-04-18T14:44:36.271 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.011353729999999999, 2024-04-18T14:44:36.271 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T14:44:36.271 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-04-18T14:44:36.271 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T14:44:36.271 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:36.271 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T14:44:36.271 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:17.436302+0000", 2024-04-18T14:44:36.271 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:44:36.271 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:36.271 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:36.271 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T14:44:36.272 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:17.436302+0000", 2024-04-18T14:44:36.272 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:44:36.272 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:36.272 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:36.272 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T14:44:36.272 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:17.436300+0000", 2024-04-18T14:44:36.272 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999981 2024-04-18T14:44:36.272 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:36.272 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:36.272 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T14:44:36.272 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:17.436332+0000", 2024-04-18T14:44:36.272 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.1946000000000002e-05 2024-04-18T14:44:36.272 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:36.272 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:36.273 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T14:44:36.273 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:17.436364+0000", 2024-04-18T14:44:36.273 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.2036000000000003e-05 2024-04-18T14:44:36.273 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:36.273 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:36.273 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T14:44:36.273 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:17.436384+0000", 2024-04-18T14:44:36.273 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0044e-05 2024-04-18T14:44:36.273 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:36.273 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:36.273 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T14:44:36.273 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:17.447631+0000", 2024-04-18T14:44:36.273 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.011246808 2024-04-18T14:44:36.273 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:36.273 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:36.273 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T14:44:36.274 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:17.447656+0000", 2024-04-18T14:44:36.274 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.4828999999999999e-05 2024-04-18T14:44:36.274 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:44:36.274 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T14:44:36.274 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:44:36.274 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:36.274 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:36.274 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "MOSDECSubOpWrite(3.bs5 82/70 ECSubWrite(tid=125, reqid=osd.10.0:125, at_version=82'71, trim_to=0'0, roll_forward_to=81'67))", 2024-04-18T14:44:36.274 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T14:44:21.472957+0000", 2024-04-18T14:44:36.274 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 14.721923488, 2024-04-18T14:44:36.274 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.012888603, 2024-04-18T14:44:36.274 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T14:44:36.274 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-04-18T14:44:36.274 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T14:44:36.275 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:36.275 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T14:44:36.275 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:21.472957+0000", 2024-04-18T14:44:36.275 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:44:36.275 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:36.275 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:36.275 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T14:44:36.275 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:21.472957+0000", 2024-04-18T14:44:36.275 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:44:36.275 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:36.275 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:36.275 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T14:44:36.275 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:21.472955+0000", 2024-04-18T14:44:36.275 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999981 2024-04-18T14:44:36.275 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:36.276 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:36.276 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T14:44:36.276 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:21.473010+0000", 2024-04-18T14:44:36.276 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.5680000000000002e-05 2024-04-18T14:44:36.276 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:36.276 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:36.276 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T14:44:36.276 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:21.473043+0000", 2024-04-18T14:44:36.276 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.2786000000000001e-05 2024-04-18T14:44:36.276 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:36.276 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:36.276 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T14:44:36.276 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:21.473069+0000", 2024-04-18T14:44:36.276 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.6097000000000001e-05 2024-04-18T14:44:36.276 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:36.277 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:36.277 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T14:44:36.277 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:21.473255+0000", 2024-04-18T14:44:36.277 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00018633899999999999 2024-04-18T14:44:36.277 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:36.277 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:36.277 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_started", 2024-04-18T14:44:36.277 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:21.473282+0000", 2024-04-18T14:44:36.277 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.6526e-05 2024-04-18T14:44:36.277 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:36.277 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:36.277 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_committed", 2024-04-18T14:44:36.277 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:21.485748+0000", 2024-04-18T14:44:36.277 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.012466352999999999 2024-04-18T14:44:36.277 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:36.278 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:36.278 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T14:44:36.278 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:21.485845+0000", 2024-04-18T14:44:36.278 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.6756000000000007e-05 2024-04-18T14:44:36.278 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:44:36.278 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T14:44:36.278 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:44:36.278 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:36.278 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:36.278 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "MOSDECSubOpWrite(3.3s1 82/30 ECSubWrite(tid=298, reqid=osd.13.0:298, at_version=82'59, trim_to=0'0, roll_forward_to=80'57))", 2024-04-18T14:44:36.278 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T14:44:21.474604+0000", 2024-04-18T14:44:36.278 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 14.720276131, 2024-04-18T14:44:36.278 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.011307528000000001, 2024-04-18T14:44:36.278 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T14:44:36.279 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-04-18T14:44:36.279 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T14:44:36.279 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:36.279 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T14:44:36.279 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:21.474604+0000", 2024-04-18T14:44:36.279 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:44:36.279 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:36.279 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:36.279 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T14:44:36.279 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:21.474604+0000", 2024-04-18T14:44:36.279 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:44:36.279 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:36.279 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:36.279 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T14:44:36.279 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:21.474603+0000", 2024-04-18T14:44:36.280 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-18T14:44:36.280 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:36.280 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:36.280 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T14:44:36.280 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:21.474678+0000", 2024-04-18T14:44:36.280 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.5160000000000005e-05 2024-04-18T14:44:36.280 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:36.280 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:36.280 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T14:44:36.280 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:21.474708+0000", 2024-04-18T14:44:36.280 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.9512000000000001e-05 2024-04-18T14:44:36.280 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:36.280 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:36.280 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T14:44:36.280 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:21.474732+0000", 2024-04-18T14:44:36.280 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.4260000000000002e-05 2024-04-18T14:44:36.281 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:36.281 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:36.281 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T14:44:36.281 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:21.474957+0000", 2024-04-18T14:44:36.281 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000225042 2024-04-18T14:44:36.281 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:36.281 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:36.281 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_started", 2024-04-18T14:44:36.281 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:21.474979+0000", 2024-04-18T14:44:36.281 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.1619000000000001e-05 2024-04-18T14:44:36.281 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:36.281 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:36.281 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_committed", 2024-04-18T14:44:36.281 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:21.485861+0000", 2024-04-18T14:44:36.281 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.010882299999999999 2024-04-18T14:44:36.281 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:36.282 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:36.282 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T14:44:36.282 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:21.485911+0000", 2024-04-18T14:44:36.282 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.0355000000000002e-05 2024-04-18T14:44:36.282 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:44:36.282 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T14:44:36.282 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:44:36.282 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:44:36.282 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T14:44:36.282 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-04-18T14:44:36.283 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.11.asok dump_ops_in_flight 2024-04-18T14:44:36.408 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-04-18T14:44:36.408 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [], 2024-04-18T14:44:36.408 INFO:teuthology.orchestra.run.smithi134.stdout: "num_ops": 0 2024-04-18T14:44:36.408 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-04-18T14:44:36.422 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.11.asok dump_blocked_ops 2024-04-18T14:44:36.540 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-04-18T14:44:36.540 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [], 2024-04-18T14:44:36.540 INFO:teuthology.orchestra.run.smithi134.stdout: "complaint_time": 30, 2024-04-18T14:44:36.540 INFO:teuthology.orchestra.run.smithi134.stdout: "num_blocked_ops": 0 2024-04-18T14:44:36.540 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-04-18T14:44:36.552 INFO:teuthology.orchestra.run.smithi086.stderr:set osd.0 primary-affinity to 1 (8655362) 2024-04-18T14:44:36.554 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.11.asok dump_historic_ops 2024-04-18T14:44:36.577 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 4 1 2024-04-18T14:44:36.681 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-04-18T14:44:36.681 INFO:teuthology.orchestra.run.smithi134.stdout: "size": 20, 2024-04-18T14:44:36.681 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 600, 2024-04-18T14:44:36.681 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [ 2024-04-18T14:44:36.681 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:36.681 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4559.0:248 3.fs0 3:f85be22b:::smithi13430248-15:head [copy-from ver 10] snapc 8=[8,7,4,2] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-04-18T14:44:36.681 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T14:43:40.759371+0000", 2024-04-18T14:44:36.681 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 55.923850086000002, 2024-04-18T14:44:36.681 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.032405762999999997, 2024-04-18T14:44:36.682 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T14:44:36.682 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T14:44:36.682 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-18T14:44:36.682 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4559", 2024-04-18T14:44:36.682 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/3113589487", 2024-04-18T14:44:36.682 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 248 2024-04-18T14:44:36.682 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:36.682 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T14:44:36.682 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:36.682 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T14:44:36.682 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:40.759371+0000", 2024-04-18T14:44:36.682 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:44:36.682 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:36.682 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:36.682 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T14:44:36.683 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:40.759371+0000", 2024-04-18T14:44:36.683 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:44:36.683 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:36.683 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:36.683 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T14:44:36.683 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:40.759369+0000", 2024-04-18T14:44:36.683 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999971 2024-04-18T14:44:36.683 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:36.683 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:36.683 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T14:44:36.683 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:40.759383+0000", 2024-04-18T14:44:36.683 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.4307e-05 2024-04-18T14:44:36.683 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:36.683 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:36.683 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T14:44:36.684 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:40.759418+0000", 2024-04-18T14:44:36.684 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.5154000000000003e-05 2024-04-18T14:44:36.684 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:36.684 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:36.684 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T14:44:36.684 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:40.759440+0000", 2024-04-18T14:44:36.684 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2056999999999999e-05 2024-04-18T14:44:36.684 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:36.684 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:36.684 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T14:44:36.684 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:40.759512+0000", 2024-04-18T14:44:36.684 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.2267000000000005e-05 2024-04-18T14:44:36.684 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:36.684 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:36.684 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op must wait for map", 2024-04-18T14:44:36.685 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:40.759521+0000", 2024-04-18T14:44:36.685 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.6370000000000005e-06 2024-04-18T14:44:36.685 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:36.685 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:36.685 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T14:44:36.685 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:40.764362+0000", 2024-04-18T14:44:36.685 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0048409990000000003 2024-04-18T14:44:36.685 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:36.685 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:36.685 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T14:44:36.685 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:40.764642+0000", 2024-04-18T14:44:36.685 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00028021600000000002 2024-04-18T14:44:36.685 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:36.685 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:36.685 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_started", 2024-04-18T14:44:36.685 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:40.785675+0000", 2024-04-18T14:44:36.686 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.021032894999999999 2024-04-18T14:44:36.686 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:36.686 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:36.686 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_committed", 2024-04-18T14:44:36.686 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:40.789679+0000", 2024-04-18T14:44:36.686 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0040040939999999997 2024-04-18T14:44:36.686 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:36.686 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:36.686 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T14:44:36.686 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:40.791620+0000", 2024-04-18T14:44:36.686 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0019413430000000001 2024-04-18T14:44:36.686 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:36.686 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:36.686 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T14:44:36.686 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:40.791777+0000", 2024-04-18T14:44:36.687 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00015652999999999999 2024-04-18T14:44:36.687 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:44:36.687 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T14:44:36.687 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:44:36.687 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:36.687 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:36.687 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4559.0:249 3.fs0 3:f85be22b:::smithi13430248-15:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e41)", 2024-04-18T14:44:36.687 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T14:43:40.759469+0000", 2024-04-18T14:44:36.688 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 55.923751959999997, 2024-04-18T14:44:36.688 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.028934334999999999, 2024-04-18T14:44:36.688 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T14:44:36.688 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-04-18T14:44:36.688 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-18T14:44:36.688 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4559", 2024-04-18T14:44:36.688 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/3113589487", 2024-04-18T14:44:36.688 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 249 2024-04-18T14:44:36.688 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:36.688 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T14:44:36.688 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:36.688 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T14:44:36.688 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:40.759469+0000", 2024-04-18T14:44:36.688 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:44:36.688 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:36.689 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:36.689 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T14:44:36.689 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:40.759469+0000", 2024-04-18T14:44:36.689 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:44:36.689 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:36.689 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:36.689 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T14:44:36.689 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:40.759468+0000", 2024-04-18T14:44:36.689 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999981 2024-04-18T14:44:36.689 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:36.689 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:36.689 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T14:44:36.689 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:40.759476+0000", 2024-04-18T14:44:36.689 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.0069999999999997e-06 2024-04-18T14:44:36.689 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:36.690 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:36.690 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T14:44:36.690 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:40.759496+0000", 2024-04-18T14:44:36.690 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0287000000000001e-05 2024-04-18T14:44:36.690 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:36.690 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:36.690 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T14:44:36.690 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:40.759512+0000", 2024-04-18T14:44:36.690 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5843999999999999e-05 2024-04-18T14:44:36.690 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:36.690 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:36.690 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T14:44:36.690 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:40.759627+0000", 2024-04-18T14:44:36.690 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000115699 2024-04-18T14:44:36.690 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:36.691 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:36.691 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting_for_map not empty", 2024-04-18T14:44:36.691 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:40.759645+0000", 2024-04-18T14:44:36.691 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8063999999999998e-05 2024-04-18T14:44:36.691 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:36.691 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:36.691 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T14:44:36.691 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:40.765114+0000", 2024-04-18T14:44:36.691 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0054689079999999998 2024-04-18T14:44:36.691 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:36.691 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:36.691 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for blocked object", 2024-04-18T14:44:36.691 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:40.765242+0000", 2024-04-18T14:44:36.691 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00012731999999999999 2024-04-18T14:44:36.691 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:36.692 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:36.692 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T14:44:36.692 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:40.788026+0000", 2024-04-18T14:44:36.692 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.022784764999999998 2024-04-18T14:44:36.692 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:36.692 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:36.692 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T14:44:36.692 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:40.788178+0000", 2024-04-18T14:44:36.692 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000151819 2024-04-18T14:44:36.692 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:36.692 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:36.692 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T14:44:36.692 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:40.788404+0000", 2024-04-18T14:44:36.692 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000225479 2024-04-18T14:44:36.692 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:44:36.692 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T14:44:36.693 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:44:36.693 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:36.693 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:36.693 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4559.0:380 3.cs0 3:32b15d13:::smithi13430248-43:head [copy-from ver 12] snapc 13=[13,11,f,b,a,8,7,2] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-04-18T14:44:36.693 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T14:43:50.410989+0000", 2024-04-18T14:44:36.693 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 46.272232385000002, 2024-04-18T14:44:36.693 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.01842353, 2024-04-18T14:44:36.693 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T14:44:36.693 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T14:44:36.693 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-18T14:44:36.693 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4559", 2024-04-18T14:44:36.693 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/3113589487", 2024-04-18T14:44:36.693 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 380 2024-04-18T14:44:36.693 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:36.693 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T14:44:36.693 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:36.694 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T14:44:36.694 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:50.410989+0000", 2024-04-18T14:44:36.694 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:44:36.694 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:36.694 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:36.694 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T14:44:36.694 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:50.410989+0000", 2024-04-18T14:44:36.694 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:44:36.694 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:36.694 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:36.694 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T14:44:36.694 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:50.410987+0000", 2024-04-18T14:44:36.694 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999976 2024-04-18T14:44:36.695 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:36.695 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:36.695 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T14:44:36.695 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:50.410996+0000", 2024-04-18T14:44:36.695 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.4539999999999996e-06 2024-04-18T14:44:36.695 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:36.695 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:36.695 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T14:44:36.695 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:50.411013+0000", 2024-04-18T14:44:36.695 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6728999999999999e-05 2024-04-18T14:44:36.695 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:36.695 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:36.695 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T14:44:36.695 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:50.411022+0000", 2024-04-18T14:44:36.695 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.7770000000000008e-06 2024-04-18T14:44:36.696 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:36.696 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:36.696 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T14:44:36.696 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:50.411171+0000", 2024-04-18T14:44:36.696 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00014944900000000001 2024-04-18T14:44:36.696 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:36.696 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:36.696 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T14:44:36.696 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:50.411369+0000", 2024-04-18T14:44:36.696 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00019749000000000001 2024-04-18T14:44:36.696 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:36.696 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:36.696 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_started", 2024-04-18T14:44:36.696 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:50.419400+0000", 2024-04-18T14:44:36.696 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0080313759999999998 2024-04-18T14:44:36.697 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:36.697 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:36.697 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_committed", 2024-04-18T14:44:36.697 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:50.423023+0000", 2024-04-18T14:44:36.697 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.003622905 2024-04-18T14:44:36.697 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:36.697 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:36.697 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T14:44:36.697 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:50.429197+0000", 2024-04-18T14:44:36.697 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0061737709999999998 2024-04-18T14:44:36.697 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:36.697 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:36.697 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T14:44:36.697 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:50.429412+0000", 2024-04-18T14:44:36.698 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000215727 2024-04-18T14:44:36.698 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:44:36.698 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T14:44:36.698 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:44:36.698 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:36.698 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:36.698 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4559.0:574 3.cs0 3:32b15d13:::smithi13430248-43:head [append 0~0] snapc 1e=[1e,1d,1c,1a,19,16,14,13,11,b,a,7,2] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-04-18T14:44:36.698 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T14:44:01.409746+0000", 2024-04-18T14:44:36.698 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 35.273475144000003, 2024-04-18T14:44:36.698 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.017790594999999999, 2024-04-18T14:44:36.698 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T14:44:36.698 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T14:44:36.698 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-18T14:44:36.698 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4559", 2024-04-18T14:44:36.698 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/3113589487", 2024-04-18T14:44:36.699 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 574 2024-04-18T14:44:36.699 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:36.699 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T14:44:36.699 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:36.699 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T14:44:36.699 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:01.409746+0000", 2024-04-18T14:44:36.699 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:44:36.699 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:36.699 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:36.699 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T14:44:36.699 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:01.409746+0000", 2024-04-18T14:44:36.699 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:44:36.699 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:36.699 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:36.699 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T14:44:36.700 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:01.409745+0000", 2024-04-18T14:44:36.700 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-18T14:44:36.700 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:36.700 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:36.700 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T14:44:36.700 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:01.409751+0000", 2024-04-18T14:44:36.700 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.127e-06 2024-04-18T14:44:36.700 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:36.700 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:36.700 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T14:44:36.700 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:01.409772+0000", 2024-04-18T14:44:36.700 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0740000000000001e-05 2024-04-18T14:44:36.700 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:36.700 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:36.700 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T14:44:36.701 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:01.409785+0000", 2024-04-18T14:44:36.701 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3125999999999999e-05 2024-04-18T14:44:36.701 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:36.701 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:36.701 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T14:44:36.701 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:01.420898+0000", 2024-04-18T14:44:36.701 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.01111287 2024-04-18T14:44:36.701 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:36.701 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:36.701 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T14:44:36.701 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:01.421157+0000", 2024-04-18T14:44:36.701 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00025946699999999999 2024-04-18T14:44:36.701 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:36.701 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:36.701 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_started", 2024-04-18T14:44:36.701 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:01.422437+0000", 2024-04-18T14:44:36.702 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.001279156 2024-04-18T14:44:36.702 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:36.702 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:36.702 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_committed", 2024-04-18T14:44:36.702 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:01.426477+0000", 2024-04-18T14:44:36.702 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0040404200000000003 2024-04-18T14:44:36.702 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:36.702 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:36.702 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T14:44:36.702 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:01.426662+0000", 2024-04-18T14:44:36.702 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000184935 2024-04-18T14:44:36.702 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:36.702 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:36.702 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T14:44:36.703 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:01.427537+0000", 2024-04-18T14:44:36.703 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00087485099999999995 2024-04-18T14:44:36.703 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:44:36.703 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T14:44:36.703 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:44:36.703 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:36.703 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:36.703 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4559.0:742 3.cs0 3:32b15d13:::smithi13430248-43:head [append 0~507904] snapc 27=[27,26,23,22,1e,1c,1a,16,14,13,11,2] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-04-18T14:44:36.703 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T14:44:11.760334+0000", 2024-04-18T14:44:36.703 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 24.922887674999998, 2024-04-18T14:44:36.703 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.024123056, 2024-04-18T14:44:36.703 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T14:44:36.703 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T14:44:36.703 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-18T14:44:36.703 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4559", 2024-04-18T14:44:36.704 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/3113589487", 2024-04-18T14:44:36.704 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 742 2024-04-18T14:44:36.704 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:36.704 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T14:44:36.704 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:36.704 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T14:44:36.704 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:11.760334+0000", 2024-04-18T14:44:36.704 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:44:36.704 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:36.704 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:36.704 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T14:44:36.704 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:11.760334+0000", 2024-04-18T14:44:36.704 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:44:36.704 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:36.704 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:36.705 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T14:44:36.705 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:11.760331+0000", 2024-04-18T14:44:36.705 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999976 2024-04-18T14:44:36.705 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:36.705 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:36.705 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T14:44:36.705 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:11.760560+0000", 2024-04-18T14:44:36.705 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00022863399999999999 2024-04-18T14:44:36.705 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:36.705 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:36.705 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T14:44:36.705 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:11.760588+0000", 2024-04-18T14:44:36.705 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.8586999999999999e-05 2024-04-18T14:44:36.705 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:36.705 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:36.705 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T14:44:36.706 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:11.760603+0000", 2024-04-18T14:44:36.706 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.4426999999999999e-05 2024-04-18T14:44:36.706 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:36.706 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:36.706 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T14:44:36.706 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:11.760687+0000", 2024-04-18T14:44:36.706 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.4305e-05 2024-04-18T14:44:36.706 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:36.706 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:36.706 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T14:44:36.706 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:11.760819+0000", 2024-04-18T14:44:36.707 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00013166799999999999 2024-04-18T14:44:36.707 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:36.707 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:36.707 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_started", 2024-04-18T14:44:36.707 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:11.762740+0000", 2024-04-18T14:44:36.707 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.001921542 2024-04-18T14:44:36.707 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:36.707 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:36.707 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_committed", 2024-04-18T14:44:36.707 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:11.765776+0000", 2024-04-18T14:44:36.707 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0030356929999999999 2024-04-18T14:44:36.707 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:36.707 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:36.707 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T14:44:36.708 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:11.784400+0000", 2024-04-18T14:44:36.708 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.018623701999999999 2024-04-18T14:44:36.708 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:36.708 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:36.708 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T14:44:36.708 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:11.784457+0000", 2024-04-18T14:44:36.708 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.6907999999999998e-05 2024-04-18T14:44:36.708 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:44:36.708 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T14:44:36.708 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:44:36.708 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:36.708 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:36.708 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4559.0:743 3.cs0 3:32b15d13:::smithi13430248-43:head [append 0~425984] snapc 27=[27,26,23,22,1e,1c,1a,16,14,13,11,2] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-04-18T14:44:36.708 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T14:44:11.763503+0000", 2024-04-18T14:44:36.708 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 24.919718605, 2024-04-18T14:44:36.709 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.021263944999999999, 2024-04-18T14:44:36.709 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T14:44:36.709 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T14:44:36.709 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-18T14:44:36.709 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4559", 2024-04-18T14:44:36.709 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/3113589487", 2024-04-18T14:44:36.709 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 743 2024-04-18T14:44:36.709 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:36.709 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T14:44:36.709 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:36.709 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T14:44:36.709 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:11.763503+0000", 2024-04-18T14:44:36.709 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:44:36.709 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:36.710 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:36.710 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T14:44:36.710 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:11.763503+0000", 2024-04-18T14:44:36.710 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:44:36.710 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:36.710 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:36.710 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T14:44:36.710 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:11.763501+0000", 2024-04-18T14:44:36.710 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999981 2024-04-18T14:44:36.710 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:36.710 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:36.710 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T14:44:36.710 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:11.763749+0000", 2024-04-18T14:44:36.710 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000248361 2024-04-18T14:44:36.711 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:36.711 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:36.711 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T14:44:36.711 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:11.763764+0000", 2024-04-18T14:44:36.711 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.4278e-05 2024-04-18T14:44:36.711 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:36.711 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:36.711 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T14:44:36.711 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:11.763773+0000", 2024-04-18T14:44:36.711 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.7000000000000003e-06 2024-04-18T14:44:36.711 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:36.711 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:36.711 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T14:44:36.711 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:11.764026+0000", 2024-04-18T14:44:36.711 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00025268900000000001 2024-04-18T14:44:36.712 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:36.712 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:36.712 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T14:44:36.712 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:11.764198+0000", 2024-04-18T14:44:36.712 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00017181499999999999 2024-04-18T14:44:36.712 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:36.712 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:36.712 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_started", 2024-04-18T14:44:36.712 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:11.765226+0000", 2024-04-18T14:44:36.712 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.001028202 2024-04-18T14:44:36.712 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:36.712 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:36.712 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_committed", 2024-04-18T14:44:36.712 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:11.768730+0000", 2024-04-18T14:44:36.713 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.003504175 2024-04-18T14:44:36.713 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:36.713 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:36.713 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T14:44:36.713 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:11.784690+0000", 2024-04-18T14:44:36.713 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.015960050999999999 2024-04-18T14:44:36.713 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:36.713 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:36.713 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T14:44:36.713 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:11.784767+0000", 2024-04-18T14:44:36.713 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.6365999999999994e-05 2024-04-18T14:44:36.713 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:44:36.713 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T14:44:36.713 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:44:36.713 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:36.714 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:36.714 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4559.0:744 3.cs0 3:32b15d13:::smithi13430248-43:head [append 0~442368] snapc 27=[27,26,23,22,1e,1c,1a,16,14,13,11,2] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-04-18T14:44:36.714 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T14:44:11.766613+0000", 2024-04-18T14:44:36.714 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 24.916608589999999, 2024-04-18T14:44:36.714 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.022415638000000002, 2024-04-18T14:44:36.714 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T14:44:36.714 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T14:44:36.714 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-18T14:44:36.714 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4559", 2024-04-18T14:44:36.714 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/3113589487", 2024-04-18T14:44:36.714 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 744 2024-04-18T14:44:36.714 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:36.714 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T14:44:36.714 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:36.715 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T14:44:36.715 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:11.766613+0000", 2024-04-18T14:44:36.715 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:44:36.715 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:36.715 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:36.715 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T14:44:36.715 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:11.766613+0000", 2024-04-18T14:44:36.715 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:44:36.715 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:36.715 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:36.715 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T14:44:36.715 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:11.766611+0000", 2024-04-18T14:44:36.715 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999986 2024-04-18T14:44:36.715 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:36.715 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:36.716 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T14:44:36.716 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:11.766825+0000", 2024-04-18T14:44:36.716 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000214286 2024-04-18T14:44:36.716 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:36.716 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:36.716 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T14:44:36.716 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:11.766839+0000", 2024-04-18T14:44:36.716 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3721e-05 2024-04-18T14:44:36.716 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:36.716 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:36.716 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T14:44:36.716 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:11.766847+0000", 2024-04-18T14:44:36.716 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.4880000000000001e-06 2024-04-18T14:44:36.716 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:36.716 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:36.717 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T14:44:36.717 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:11.766907+0000", 2024-04-18T14:44:36.717 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.0726000000000001e-05 2024-04-18T14:44:36.717 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:36.717 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:36.717 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T14:44:36.717 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:11.767093+0000", 2024-04-18T14:44:36.717 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000185355 2024-04-18T14:44:36.717 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:36.717 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:36.717 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_started", 2024-04-18T14:44:36.717 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:11.767963+0000", 2024-04-18T14:44:36.717 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00086985800000000005 2024-04-18T14:44:36.717 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:36.718 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:36.718 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_committed", 2024-04-18T14:44:36.718 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:11.770520+0000", 2024-04-18T14:44:36.718 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0025570929999999999 2024-04-18T14:44:36.718 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:36.718 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:36.718 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T14:44:36.718 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:11.788942+0000", 2024-04-18T14:44:36.718 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.018422706 2024-04-18T14:44:36.718 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:36.718 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:36.718 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T14:44:36.718 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:11.789028+0000", 2024-04-18T14:44:36.718 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.6018000000000002e-05 2024-04-18T14:44:36.719 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:44:36.719 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T14:44:36.719 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:44:36.719 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:36.719 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:36.719 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4559.0:745 3.cs0 3:32b15d13:::smithi13430248-43:head [append 0~540672] snapc 27=[27,26,23,22,1e,1c,1a,16,14,13,11,2] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-04-18T14:44:36.719 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T14:44:11.770451+0000", 2024-04-18T14:44:36.719 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 24.912770299999998, 2024-04-18T14:44:36.719 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.024076914000000001, 2024-04-18T14:44:36.719 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T14:44:36.719 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T14:44:36.719 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-18T14:44:36.719 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4559", 2024-04-18T14:44:36.719 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/3113589487", 2024-04-18T14:44:36.719 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 745 2024-04-18T14:44:36.720 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:36.720 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T14:44:36.720 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:36.720 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T14:44:36.720 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:11.770451+0000", 2024-04-18T14:44:36.720 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:44:36.720 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:36.720 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:36.720 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T14:44:36.720 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:11.770451+0000", 2024-04-18T14:44:36.720 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:44:36.720 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:36.720 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:36.720 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T14:44:36.720 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:11.770450+0000", 2024-04-18T14:44:36.721 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-18T14:44:36.721 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:36.721 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:36.721 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T14:44:36.721 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:11.770664+0000", 2024-04-18T14:44:36.721 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00021399799999999999 2024-04-18T14:44:36.721 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:36.721 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:36.721 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T14:44:36.721 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:11.770678+0000", 2024-04-18T14:44:36.721 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.4402e-05 2024-04-18T14:44:36.721 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:36.721 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:36.721 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T14:44:36.722 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:11.770685+0000", 2024-04-18T14:44:36.722 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.7479999999999996e-06 2024-04-18T14:44:36.722 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:36.722 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:36.722 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T14:44:36.722 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:11.770746+0000", 2024-04-18T14:44:36.722 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.1278999999999994e-05 2024-04-18T14:44:36.722 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:36.722 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:36.722 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T14:44:36.722 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:11.770905+0000", 2024-04-18T14:44:36.722 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00015894600000000001 2024-04-18T14:44:36.723 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:36.723 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:36.723 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_started", 2024-04-18T14:44:36.723 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:11.772027+0000", 2024-04-18T14:44:36.723 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0011219369999999999 2024-04-18T14:44:36.723 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:36.723 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:36.723 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_committed", 2024-04-18T14:44:36.723 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:11.778260+0000", 2024-04-18T14:44:36.723 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0062322250000000001 2024-04-18T14:44:36.723 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:36.723 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:36.723 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T14:44:36.723 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:11.794464+0000", 2024-04-18T14:44:36.724 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.016204070000000001 2024-04-18T14:44:36.724 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:36.724 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:36.724 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T14:44:36.724 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:11.794528+0000", 2024-04-18T14:44:36.724 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.4369000000000007e-05 2024-04-18T14:44:36.724 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:44:36.724 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T14:44:36.724 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:44:36.724 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:36.724 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:36.724 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4559.0:746 3.cs0 3:32b15d13:::smithi13430248-43:head [append 0~147456] snapc 27=[27,26,23,22,1e,1c,1a,16,14,13,11,2] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-04-18T14:44:36.724 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T14:44:11.771460+0000", 2024-04-18T14:44:36.724 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 24.911761402, 2024-04-18T14:44:36.724 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.024755577000000001, 2024-04-18T14:44:36.725 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T14:44:36.725 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T14:44:36.725 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-18T14:44:36.725 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4559", 2024-04-18T14:44:36.725 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/3113589487", 2024-04-18T14:44:36.725 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 746 2024-04-18T14:44:36.725 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:36.725 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T14:44:36.725 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:36.725 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T14:44:36.725 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:11.771460+0000", 2024-04-18T14:44:36.725 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:44:36.725 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:36.725 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:36.726 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T14:44:36.726 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:11.771460+0000", 2024-04-18T14:44:36.726 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:44:36.726 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:36.726 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:36.726 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T14:44:36.726 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:11.771459+0000", 2024-04-18T14:44:36.726 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999986 2024-04-18T14:44:36.726 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:36.726 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:36.726 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T14:44:36.726 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:11.771523+0000", 2024-04-18T14:44:36.726 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.436e-05 2024-04-18T14:44:36.726 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:36.727 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:36.727 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T14:44:36.727 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:11.771537+0000", 2024-04-18T14:44:36.727 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3621999999999999e-05 2024-04-18T14:44:36.727 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:36.727 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:36.727 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T14:44:36.727 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:11.771544+0000", 2024-04-18T14:44:36.727 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.6809999999999998e-06 2024-04-18T14:44:36.727 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:36.727 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:36.727 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T14:44:36.727 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:11.773345+0000", 2024-04-18T14:44:36.727 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.001800893 2024-04-18T14:44:36.728 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:36.728 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:36.728 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T14:44:36.728 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:11.773503+0000", 2024-04-18T14:44:36.728 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000157913 2024-04-18T14:44:36.728 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:36.728 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:36.728 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_started", 2024-04-18T14:44:36.728 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:11.774324+0000", 2024-04-18T14:44:36.728 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00082110099999999997 2024-04-18T14:44:36.728 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:36.728 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:36.728 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_committed", 2024-04-18T14:44:36.728 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:11.780169+0000", 2024-04-18T14:44:36.728 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0058448099999999998 2024-04-18T14:44:36.729 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:36.729 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:36.729 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T14:44:36.729 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:11.796153+0000", 2024-04-18T14:44:36.729 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.015983727 2024-04-18T14:44:36.729 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:36.729 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:36.729 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T14:44:36.729 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:11.796216+0000", 2024-04-18T14:44:36.730 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.2726999999999998e-05 2024-04-18T14:44:36.730 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:44:36.730 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T14:44:36.730 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:44:36.730 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:36.730 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:36.730 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4559.0:747 3.cs0 3:32b15d13:::smithi13430248-43:head [setxattr _header (57) in=7b] snapc 27=[27,26,23,22,1e,1c,1a,16,14,13,11,2] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-04-18T14:44:36.730 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T14:44:11.771566+0000", 2024-04-18T14:44:36.730 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 24.911655827000001, 2024-04-18T14:44:36.730 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.02483633, 2024-04-18T14:44:36.730 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T14:44:36.731 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T14:44:36.731 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-18T14:44:36.731 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4559", 2024-04-18T14:44:36.731 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/3113589487", 2024-04-18T14:44:36.731 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 747 2024-04-18T14:44:36.731 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:36.731 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T14:44:36.731 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:36.731 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T14:44:36.731 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:11.771566+0000", 2024-04-18T14:44:36.731 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:44:36.731 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:36.731 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:36.731 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T14:44:36.731 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:11.771566+0000", 2024-04-18T14:44:36.732 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:44:36.732 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:36.732 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:36.732 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T14:44:36.732 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:11.771565+0000", 2024-04-18T14:44:36.732 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-18T14:44:36.732 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:36.732 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:36.732 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T14:44:36.732 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:11.771569+0000", 2024-04-18T14:44:36.732 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.3290000000000004e-06 2024-04-18T14:44:36.732 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:36.732 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:36.732 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T14:44:36.732 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:11.771578+0000", 2024-04-18T14:44:36.733 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.9779999999999994e-06 2024-04-18T14:44:36.733 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:36.733 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:36.733 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T14:44:36.733 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:11.771583+0000", 2024-04-18T14:44:36.733 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.3419999999999998e-06 2024-04-18T14:44:36.733 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:36.733 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:36.733 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T14:44:36.733 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:11.775090+0000", 2024-04-18T14:44:36.733 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.003506707 2024-04-18T14:44:36.733 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:36.733 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:36.733 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T14:44:36.733 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:11.775150+0000", 2024-04-18T14:44:36.734 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.9546999999999998e-05 2024-04-18T14:44:36.734 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:36.734 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:36.734 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_started", 2024-04-18T14:44:36.734 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:11.775435+0000", 2024-04-18T14:44:36.734 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00028518899999999998 2024-04-18T14:44:36.734 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:36.734 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:36.734 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_committed", 2024-04-18T14:44:36.734 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:11.780172+0000", 2024-04-18T14:44:36.734 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.004737191 2024-04-18T14:44:36.734 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:36.734 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:36.735 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T14:44:36.735 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:11.796320+0000", 2024-04-18T14:44:36.735 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.016147970000000001 2024-04-18T14:44:36.735 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:36.735 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:36.735 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T14:44:36.735 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:11.796402+0000", 2024-04-18T14:44:36.735 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.1878000000000004e-05 2024-04-18T14:44:36.735 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:44:36.735 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T14:44:36.735 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:44:36.735 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:36.735 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:36.735 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4559.0:748 3.cs0 3:32b15d13:::smithi13430248-43:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e72)", 2024-04-18T14:44:36.735 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T14:44:11.771611+0000", 2024-04-18T14:44:36.736 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 24.911610263, 2024-04-18T14:44:36.736 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.029708281999999999, 2024-04-18T14:44:36.736 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T14:44:36.736 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-04-18T14:44:36.736 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-18T14:44:36.736 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4559", 2024-04-18T14:44:36.736 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/3113589487", 2024-04-18T14:44:36.736 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 748 2024-04-18T14:44:36.736 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:36.736 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T14:44:36.736 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:36.736 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T14:44:36.736 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:11.771611+0000", 2024-04-18T14:44:36.736 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:44:36.736 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:36.737 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:36.737 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T14:44:36.737 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:11.771611+0000", 2024-04-18T14:44:36.737 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:44:36.737 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:36.737 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:36.737 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T14:44:36.737 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:11.771611+0000", 2024-04-18T14:44:36.737 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-04-18T14:44:36.737 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:36.737 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:36.737 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T14:44:36.737 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:11.771613+0000", 2024-04-18T14:44:36.737 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.7520000000000001e-06 2024-04-18T14:44:36.738 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:36.738 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:36.738 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T14:44:36.738 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:11.771622+0000", 2024-04-18T14:44:36.738 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.9330000000000007e-06 2024-04-18T14:44:36.738 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:36.738 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:36.738 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T14:44:36.738 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:11.771627+0000", 2024-04-18T14:44:36.738 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.1080000000000001e-06 2024-04-18T14:44:36.738 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:36.738 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:36.738 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T14:44:36.738 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:11.775676+0000", 2024-04-18T14:44:36.738 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0040487199999999996 2024-04-18T14:44:36.739 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:36.739 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:36.739 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for rw locks", 2024-04-18T14:44:36.739 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:11.775776+0000", 2024-04-18T14:44:36.739 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.9429e-05 2024-04-18T14:44:36.739 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:36.739 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:36.739 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T14:44:36.739 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:11.796442+0000", 2024-04-18T14:44:36.739 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.020666753 2024-04-18T14:44:36.739 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:36.739 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:36.739 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T14:44:36.740 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:11.796503+0000", 2024-04-18T14:44:36.740 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.0285999999999998e-05 2024-04-18T14:44:36.740 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:36.740 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:36.740 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T14:44:36.740 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:11.801319+0000", 2024-04-18T14:44:36.740 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0048167590000000003 2024-04-18T14:44:36.740 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:44:36.740 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T14:44:36.740 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:44:36.740 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:36.740 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:36.740 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4559.0:758 3.cs0 3:328b7efa:::smithi13430248-27:head [append 0~524288] snapc 27=[27,26,23,22,1e,1c,1a,16,14,13,11,2] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-04-18T14:44:36.740 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T14:44:11.778300+0000", 2024-04-18T14:44:36.740 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 24.904920875999998, 2024-04-18T14:44:36.741 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.020012121000000001, 2024-04-18T14:44:36.741 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T14:44:36.741 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T14:44:36.741 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-18T14:44:36.741 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4559", 2024-04-18T14:44:36.741 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/3113589487", 2024-04-18T14:44:36.741 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 758 2024-04-18T14:44:36.741 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:36.741 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T14:44:36.741 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:36.741 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T14:44:36.741 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:11.778300+0000", 2024-04-18T14:44:36.741 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:44:36.741 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:36.742 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:36.742 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T14:44:36.742 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:11.778300+0000", 2024-04-18T14:44:36.742 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:44:36.742 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:36.742 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:36.742 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T14:44:36.742 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:11.778299+0000", 2024-04-18T14:44:36.742 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999986 2024-04-18T14:44:36.742 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:36.742 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:36.742 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T14:44:36.742 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:11.778534+0000", 2024-04-18T14:44:36.743 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000234737 2024-04-18T14:44:36.743 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:36.743 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:36.743 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T14:44:36.743 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:11.778545+0000", 2024-04-18T14:44:36.743 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1405e-05 2024-04-18T14:44:36.743 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:36.743 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:36.743 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T14:44:36.743 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:11.778552+0000", 2024-04-18T14:44:36.743 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.348e-06 2024-04-18T14:44:36.743 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:36.743 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:36.743 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T14:44:36.744 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:11.778585+0000", 2024-04-18T14:44:36.744 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.2978999999999997e-05 2024-04-18T14:44:36.744 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:36.744 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:36.744 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T14:44:36.744 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:11.778640+0000", 2024-04-18T14:44:36.744 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.5686999999999997e-05 2024-04-18T14:44:36.744 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:36.744 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:36.744 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_started", 2024-04-18T14:44:36.744 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:11.779401+0000", 2024-04-18T14:44:36.744 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000760789 2024-04-18T14:44:36.744 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:36.744 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:36.745 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_committed", 2024-04-18T14:44:36.745 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:11.780533+0000", 2024-04-18T14:44:36.745 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0011324379999999999 2024-04-18T14:44:36.745 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:36.745 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:36.745 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T14:44:36.745 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:11.798268+0000", 2024-04-18T14:44:36.745 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.017734973000000001 2024-04-18T14:44:36.745 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:36.745 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:36.745 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T14:44:36.745 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:11.798313+0000", 2024-04-18T14:44:36.746 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.4153999999999998e-05 2024-04-18T14:44:36.746 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:44:36.746 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T14:44:36.746 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:44:36.746 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:36.746 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:36.746 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4559.0:827 3.cs0 3:32b15d13:::smithi13430248-43:2c [read 0~2162688,checksum] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e77)", 2024-04-18T14:44:36.746 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T14:44:16.417959+0000", 2024-04-18T14:44:36.746 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 20.265261890000001, 2024-04-18T14:44:36.746 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.017431892000000001, 2024-04-18T14:44:36.746 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T14:44:36.746 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-04-18T14:44:36.746 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-18T14:44:36.746 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4559", 2024-04-18T14:44:36.747 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/3113589487", 2024-04-18T14:44:36.747 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 827 2024-04-18T14:44:36.747 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:36.747 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T14:44:36.747 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:36.747 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T14:44:36.747 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:16.417959+0000", 2024-04-18T14:44:36.747 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:44:36.747 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:36.747 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:36.747 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T14:44:36.747 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:16.417959+0000", 2024-04-18T14:44:36.747 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:44:36.747 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:36.748 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:36.748 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T14:44:36.748 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:16.417959+0000", 2024-04-18T14:44:36.748 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-18T14:44:36.748 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:36.748 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:36.748 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T14:44:36.748 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:16.417964+0000", 2024-04-18T14:44:36.748 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.7169999999999996e-06 2024-04-18T14:44:36.748 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:36.748 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:36.748 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T14:44:36.748 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:16.417976+0000", 2024-04-18T14:44:36.749 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2153e-05 2024-04-18T14:44:36.749 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:36.749 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:36.749 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T14:44:36.749 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:16.417990+0000", 2024-04-18T14:44:36.749 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3152999999999999e-05 2024-04-18T14:44:36.749 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:36.749 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:36.749 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T14:44:36.749 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:16.418088+0000", 2024-04-18T14:44:36.749 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.8505999999999995e-05 2024-04-18T14:44:36.749 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:36.749 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:36.749 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting_for_map not empty", 2024-04-18T14:44:36.750 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:16.418094+0000", 2024-04-18T14:44:36.750 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.7799999999999997e-06 2024-04-18T14:44:36.750 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:36.750 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:36.750 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T14:44:36.750 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:16.423161+0000", 2024-04-18T14:44:36.750 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.005067457 2024-04-18T14:44:36.750 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:36.750 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:36.750 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T14:44:36.750 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:16.423352+0000", 2024-04-18T14:44:36.750 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000191079 2024-04-18T14:44:36.750 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:36.751 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:36.751 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T14:44:36.751 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:16.435391+0000", 2024-04-18T14:44:36.751 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.012038946999999999 2024-04-18T14:44:36.751 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:44:36.751 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T14:44:36.751 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:44:36.751 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:36.751 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:36.751 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4559.0:828 3.cs0 3:32b15d13:::smithi13430248-43:2c [read 0~2162688,checksum] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e77)", 2024-04-18T14:44:36.751 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T14:44:16.418005+0000", 2024-04-18T14:44:36.751 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 20.265216701, 2024-04-18T14:44:36.751 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.020409838999999999, 2024-04-18T14:44:36.752 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T14:44:36.752 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-04-18T14:44:36.752 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-18T14:44:36.752 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4559", 2024-04-18T14:44:36.752 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/3113589487", 2024-04-18T14:44:36.752 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 828 2024-04-18T14:44:36.752 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:36.752 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T14:44:36.752 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:36.752 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T14:44:36.752 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:16.418005+0000", 2024-04-18T14:44:36.752 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:44:36.752 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:36.753 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:36.753 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T14:44:36.753 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:16.418005+0000", 2024-04-18T14:44:36.753 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:44:36.753 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:36.753 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:36.753 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T14:44:36.753 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:16.418003+0000", 2024-04-18T14:44:36.753 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999986 2024-04-18T14:44:36.753 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:36.753 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:36.753 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T14:44:36.753 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:16.418010+0000", 2024-04-18T14:44:36.753 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.9569999999999996e-06 2024-04-18T14:44:36.754 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:36.754 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:36.754 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T14:44:36.754 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:16.418020+0000", 2024-04-18T14:44:36.754 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0216e-05 2024-04-18T14:44:36.754 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:36.754 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:36.754 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T14:44:36.754 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:16.418028+0000", 2024-04-18T14:44:36.754 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.6839999999999996e-06 2024-04-18T14:44:36.754 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:36.754 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:36.754 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T14:44:36.755 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:16.418163+0000", 2024-04-18T14:44:36.755 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00013478900000000001 2024-04-18T14:44:36.755 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:36.755 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:36.755 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting_for_map not empty", 2024-04-18T14:44:36.755 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:16.418173+0000", 2024-04-18T14:44:36.755 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0146000000000001e-05 2024-04-18T14:44:36.755 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:36.755 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:36.755 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T14:44:36.755 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:16.426079+0000", 2024-04-18T14:44:36.755 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0079063499999999995 2024-04-18T14:44:36.755 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:36.755 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:36.756 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T14:44:36.756 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:16.426180+0000", 2024-04-18T14:44:36.756 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00010063799999999999 2024-04-18T14:44:36.756 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:36.756 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:36.756 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T14:44:36.756 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:16.438414+0000", 2024-04-18T14:44:36.756 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.012234602000000001 2024-04-18T14:44:36.756 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:44:36.756 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T14:44:36.756 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:44:36.756 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:36.756 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:36.756 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4559.0:843 3.cs0 3:328b7efa:::smithi13430248-27:head [read 0~2523136,checksum] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e77)", 2024-04-18T14:44:36.756 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T14:44:16.443160+0000", 2024-04-18T14:44:36.757 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 20.240061253, 2024-04-18T14:44:36.757 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.019859727000000001, 2024-04-18T14:44:36.757 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T14:44:36.757 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-04-18T14:44:36.757 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-18T14:44:36.757 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4559", 2024-04-18T14:44:36.757 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/3113589487", 2024-04-18T14:44:36.757 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 843 2024-04-18T14:44:36.757 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:36.757 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T14:44:36.757 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:36.757 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T14:44:36.757 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:16.443160+0000", 2024-04-18T14:44:36.757 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:44:36.758 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:36.758 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:36.758 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T14:44:36.758 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:16.443160+0000", 2024-04-18T14:44:36.758 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:44:36.758 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:36.758 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:36.758 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T14:44:36.758 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:16.443159+0000", 2024-04-18T14:44:36.758 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999986 2024-04-18T14:44:36.758 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:36.759 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:36.759 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T14:44:36.759 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:16.443166+0000", 2024-04-18T14:44:36.759 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.9269999999999999e-06 2024-04-18T14:44:36.759 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:36.759 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:36.759 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T14:44:36.759 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:16.443183+0000", 2024-04-18T14:44:36.759 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.7082999999999999e-05 2024-04-18T14:44:36.759 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:36.759 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:36.759 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T14:44:36.759 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:16.443195+0000", 2024-04-18T14:44:36.759 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2333e-05 2024-04-18T14:44:36.759 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:36.760 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:36.760 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T14:44:36.760 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:16.447650+0000", 2024-04-18T14:44:36.760 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0044547989999999997 2024-04-18T14:44:36.760 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:36.760 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:36.760 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T14:44:36.760 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:16.447875+0000", 2024-04-18T14:44:36.760 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00022536799999999999 2024-04-18T14:44:36.760 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:36.760 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:36.760 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T14:44:36.760 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:16.463020+0000", 2024-04-18T14:44:36.760 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.015144427 2024-04-18T14:44:36.761 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:44:36.761 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T14:44:36.761 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:44:36.761 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:36.761 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:36.761 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "MOSDECSubOpWrite(3.2s6 82/70 ECSubWrite(tid=299, reqid=osd.13.0:299, at_version=82'58, trim_to=0'0, roll_forward_to=80'56))", 2024-04-18T14:44:36.761 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T14:44:21.474211+0000", 2024-04-18T14:44:36.761 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 15.20901007, 2024-04-18T14:44:36.761 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.018164401, 2024-04-18T14:44:36.761 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T14:44:36.761 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-04-18T14:44:36.761 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T14:44:36.761 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:36.761 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T14:44:36.761 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:21.474211+0000", 2024-04-18T14:44:36.762 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:44:36.762 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:36.762 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:36.762 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T14:44:36.762 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:21.474211+0000", 2024-04-18T14:44:36.762 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:44:36.762 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:36.762 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:36.762 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T14:44:36.762 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:21.474211+0000", 2024-04-18T14:44:36.762 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-04-18T14:44:36.762 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:36.762 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:36.762 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T14:44:36.763 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:21.474235+0000", 2024-04-18T14:44:36.763 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.4383e-05 2024-04-18T14:44:36.763 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:36.763 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:36.763 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T14:44:36.763 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:21.474248+0000", 2024-04-18T14:44:36.763 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.254e-05 2024-04-18T14:44:36.763 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:36.763 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:36.763 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T14:44:36.763 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:21.474258+0000", 2024-04-18T14:44:36.763 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.9669999999999996e-06 2024-04-18T14:44:36.763 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:36.763 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:36.764 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T14:44:36.764 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:21.475174+0000", 2024-04-18T14:44:36.764 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00091643900000000001 2024-04-18T14:44:36.764 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:36.764 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:36.764 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_started", 2024-04-18T14:44:36.764 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:21.475202+0000", 2024-04-18T14:44:36.764 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.7673000000000001e-05 2024-04-18T14:44:36.764 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:36.764 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:36.764 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_committed", 2024-04-18T14:44:36.764 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:21.492336+0000", 2024-04-18T14:44:36.764 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.017134089000000002 2024-04-18T14:44:36.764 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:36.764 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:36.765 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T14:44:36.765 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:21.492376+0000", 2024-04-18T14:44:36.765 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.9564000000000003e-05 2024-04-18T14:44:36.765 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:44:36.765 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T14:44:36.765 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:44:36.765 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:36.765 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:36.765 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "MOSDECSubOpWrite(3.2s6 82/70 ECSubWrite(tid=300, reqid=osd.13.0:300, at_version=82'60, trim_to=0'0, roll_forward_to=80'56))", 2024-04-18T14:44:36.765 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T14:44:21.474274+0000", 2024-04-18T14:44:36.765 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 15.20894764, 2024-04-18T14:44:36.765 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.021657707000000002, 2024-04-18T14:44:36.765 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T14:44:36.765 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-04-18T14:44:36.766 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T14:44:36.766 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:36.766 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T14:44:36.766 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:21.474274+0000", 2024-04-18T14:44:36.766 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:44:36.766 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:36.766 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:36.766 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T14:44:36.766 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:21.474274+0000", 2024-04-18T14:44:36.766 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:44:36.766 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:36.766 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:36.766 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T14:44:36.767 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:21.474273+0000", 2024-04-18T14:44:36.767 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-04-18T14:44:36.767 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:36.767 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:36.767 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T14:44:36.767 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:21.474293+0000", 2024-04-18T14:44:36.767 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.9669000000000001e-05 2024-04-18T14:44:36.767 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:36.767 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:36.767 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T14:44:36.767 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:21.474301+0000", 2024-04-18T14:44:36.767 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.2109999999999998e-06 2024-04-18T14:44:36.767 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:36.767 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:36.768 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T14:44:36.768 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:21.474309+0000", 2024-04-18T14:44:36.768 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.4760000000000001e-06 2024-04-18T14:44:36.768 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:36.768 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:36.768 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T14:44:36.768 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:21.480352+0000", 2024-04-18T14:44:36.768 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0060433639999999999 2024-04-18T14:44:36.768 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:36.768 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:36.768 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_started", 2024-04-18T14:44:36.768 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:21.480377+0000", 2024-04-18T14:44:36.768 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.51e-05 2024-04-18T14:44:36.768 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:36.769 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:36.769 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_committed", 2024-04-18T14:44:36.769 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:21.495867+0000", 2024-04-18T14:44:36.769 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.015489508000000001 2024-04-18T14:44:36.769 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:36.769 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:36.769 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T14:44:36.769 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:21.495931+0000", 2024-04-18T14:44:36.769 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.4747999999999997e-05 2024-04-18T14:44:36.769 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:44:36.769 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T14:44:36.769 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:44:36.769 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:36.769 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:36.770 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "MOSDECSubOpWrite(3.as6 82/70 ECSubWrite(tid=112, reqid=osd.3.0:112, at_version=82'79, trim_to=0'0, roll_forward_to=80'75))", 2024-04-18T14:44:36.770 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T14:44:21.479223+0000", 2024-04-18T14:44:36.770 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 15.203998543999999, 2024-04-18T14:44:36.770 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.020700950999999999, 2024-04-18T14:44:36.770 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T14:44:36.770 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-04-18T14:44:36.770 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T14:44:36.770 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:36.770 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T14:44:36.770 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:21.479223+0000", 2024-04-18T14:44:36.770 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:44:36.770 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:36.770 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:36.771 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T14:44:36.771 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:21.479223+0000", 2024-04-18T14:44:36.771 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:44:36.771 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:36.771 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:36.771 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T14:44:36.771 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:21.479221+0000", 2024-04-18T14:44:36.771 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999986 2024-04-18T14:44:36.771 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:36.771 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:36.771 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T14:44:36.771 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:21.479285+0000", 2024-04-18T14:44:36.771 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.3585999999999997e-05 2024-04-18T14:44:36.771 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:36.772 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:36.772 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T14:44:36.772 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:21.479333+0000", 2024-04-18T14:44:36.772 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.7512999999999997e-05 2024-04-18T14:44:36.772 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:36.772 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:36.772 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T14:44:36.772 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:21.479353+0000", 2024-04-18T14:44:36.772 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0095999999999999e-05 2024-04-18T14:44:36.772 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:36.772 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:36.772 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T14:44:36.772 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:21.480275+0000", 2024-04-18T14:44:36.772 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00092263999999999996 2024-04-18T14:44:36.773 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:36.773 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:36.773 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_started", 2024-04-18T14:44:36.773 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:21.480300+0000", 2024-04-18T14:44:36.773 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.4263000000000001e-05 2024-04-18T14:44:36.773 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:36.773 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:36.773 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_committed", 2024-04-18T14:44:36.773 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:21.499863+0000", 2024-04-18T14:44:36.773 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.019563229000000001 2024-04-18T14:44:36.773 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:36.773 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:36.773 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T14:44:36.773 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:21.499924+0000", 2024-04-18T14:44:36.774 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.0937000000000003e-05 2024-04-18T14:44:36.774 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:44:36.774 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T14:44:36.774 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:44:36.774 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:36.774 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:36.774 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "MOSDECSubOpWrite(3.7s6 82/30 ECSubWrite(tid=320, reqid=osd.14.0:320, at_version=82'123, trim_to=0'0, roll_forward_to=80'119))", 2024-04-18T14:44:36.774 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T14:44:21.479820+0000", 2024-04-18T14:44:36.774 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 15.203401308, 2024-04-18T14:44:36.774 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.02026008, 2024-04-18T14:44:36.774 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T14:44:36.774 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-04-18T14:44:36.774 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T14:44:36.774 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:36.775 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T14:44:36.775 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:21.479820+0000", 2024-04-18T14:44:36.775 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:44:36.775 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:36.775 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:36.775 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T14:44:36.775 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:21.479820+0000", 2024-04-18T14:44:36.775 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:44:36.775 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:36.775 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:36.775 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T14:44:36.775 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:21.479818+0000", 2024-04-18T14:44:36.775 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999986 2024-04-18T14:44:36.775 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:36.775 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:36.776 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T14:44:36.776 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:21.479866+0000", 2024-04-18T14:44:36.776 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.8001999999999999e-05 2024-04-18T14:44:36.776 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:36.776 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:36.776 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T14:44:36.776 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:21.479901+0000", 2024-04-18T14:44:36.776 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.5070000000000001e-05 2024-04-18T14:44:36.776 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:36.776 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:36.776 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T14:44:36.776 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:21.479936+0000", 2024-04-18T14:44:36.776 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.4343e-05 2024-04-18T14:44:36.777 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:36.777 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:36.777 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T14:44:36.777 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:21.490197+0000", 2024-04-18T14:44:36.777 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.01026115 2024-04-18T14:44:36.777 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:36.777 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:36.777 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_started", 2024-04-18T14:44:36.777 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:21.490220+0000", 2024-04-18T14:44:36.777 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.3054e-05 2024-04-18T14:44:36.777 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:36.777 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:36.777 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_committed", 2024-04-18T14:44:36.777 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:21.500048+0000", 2024-04-18T14:44:36.778 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0098283710000000007 2024-04-18T14:44:36.778 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:36.778 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:36.778 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T14:44:36.778 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:21.500080+0000", 2024-04-18T14:44:36.778 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.1702999999999998e-05 2024-04-18T14:44:36.778 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:44:36.778 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T14:44:36.778 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:44:36.778 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:36.778 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:36.778 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "MOSDECSubOpWrite(3.7s6 82/30 ECSubWrite(tid=322, reqid=osd.14.0:322, at_version=82'125, trim_to=0'0, roll_forward_to=80'119))", 2024-04-18T14:44:36.778 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T14:44:21.479955+0000", 2024-04-18T14:44:36.779 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 15.203266252000001, 2024-04-18T14:44:36.779 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.024735519000000001, 2024-04-18T14:44:36.779 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T14:44:36.779 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-04-18T14:44:36.779 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T14:44:36.779 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:36.779 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T14:44:36.779 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:21.479955+0000", 2024-04-18T14:44:36.779 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:44:36.779 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:36.779 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:36.779 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T14:44:36.779 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:21.479955+0000", 2024-04-18T14:44:36.779 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:44:36.779 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:36.780 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:36.780 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T14:44:36.780 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:21.479954+0000", 2024-04-18T14:44:36.780 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-18T14:44:36.780 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:36.780 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:36.780 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T14:44:36.780 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:21.480004+0000", 2024-04-18T14:44:36.780 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.9876000000000002e-05 2024-04-18T14:44:36.780 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:36.780 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:36.780 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T14:44:36.780 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:21.480027+0000", 2024-04-18T14:44:36.781 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2826000000000001e-05 2024-04-18T14:44:36.781 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:36.781 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:36.781 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T14:44:36.781 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:21.480047+0000", 2024-04-18T14:44:36.781 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0134000000000001e-05 2024-04-18T14:44:36.781 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:36.781 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:36.781 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T14:44:36.781 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:21.494402+0000", 2024-04-18T14:44:36.781 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.014354294 2024-04-18T14:44:36.781 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:36.781 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:36.781 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_started", 2024-04-18T14:44:36.782 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:21.494425+0000", 2024-04-18T14:44:36.782 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.3980000000000001e-05 2024-04-18T14:44:36.782 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:36.782 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:36.782 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_committed", 2024-04-18T14:44:36.782 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:21.504659+0000", 2024-04-18T14:44:36.782 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.010233124 2024-04-18T14:44:36.782 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:36.782 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:36.782 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T14:44:36.782 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:21.504691+0000", 2024-04-18T14:44:36.782 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.2002000000000003e-05 2024-04-18T14:44:36.782 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:44:36.782 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T14:44:36.783 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:44:36.783 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:44:36.783 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T14:44:36.783 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-04-18T14:44:36.784 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.15.asok dump_ops_in_flight 2024-04-18T14:44:36.909 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-04-18T14:44:36.909 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [], 2024-04-18T14:44:36.909 INFO:teuthology.orchestra.run.smithi134.stdout: "num_ops": 0 2024-04-18T14:44:36.909 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-04-18T14:44:36.923 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.15.asok dump_blocked_ops 2024-04-18T14:44:37.040 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-04-18T14:44:37.040 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [], 2024-04-18T14:44:37.040 INFO:teuthology.orchestra.run.smithi134.stdout: "complaint_time": 30, 2024-04-18T14:44:37.040 INFO:teuthology.orchestra.run.smithi134.stdout: "num_blocked_ops": 0 2024-04-18T14:44:37.041 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-04-18T14:44:37.056 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.15.asok dump_historic_ops 2024-04-18T14:44:37.180 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-04-18T14:44:37.180 INFO:teuthology.orchestra.run.smithi134.stdout: "size": 20, 2024-04-18T14:44:37.180 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 600, 2024-04-18T14:44:37.180 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [ 2024-04-18T14:44:37.180 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:37.181 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4559.0:326 3.5s0 3:ae89639c:::smithi13430248-39:head [copy-from ver 42] snapc f=[f,b,a,8,7,2] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-04-18T14:44:37.181 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T14:43:46.376277+0000", 2024-04-18T14:44:37.181 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 50.806754779999999, 2024-04-18T14:44:37.181 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.025187043999999999, 2024-04-18T14:44:37.181 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T14:44:37.181 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T14:44:37.181 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-18T14:44:37.181 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4559", 2024-04-18T14:44:37.181 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/3113589487", 2024-04-18T14:44:37.181 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 326 2024-04-18T14:44:37.181 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:37.181 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T14:44:37.181 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:37.181 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T14:44:37.181 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:46.376277+0000", 2024-04-18T14:44:37.182 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:44:37.182 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:37.182 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:37.182 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T14:44:37.182 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:46.376277+0000", 2024-04-18T14:44:37.182 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:44:37.182 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:37.182 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:37.182 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T14:44:37.182 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:46.376274+0000", 2024-04-18T14:44:37.182 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999967 2024-04-18T14:44:37.182 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:37.182 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:37.182 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T14:44:37.183 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:46.376290+0000", 2024-04-18T14:44:37.183 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5639999999999999e-05 2024-04-18T14:44:37.183 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:37.183 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:37.183 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T14:44:37.183 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:46.376350+0000", 2024-04-18T14:44:37.183 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.0446999999999999e-05 2024-04-18T14:44:37.183 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:37.183 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:37.183 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T14:44:37.183 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:46.376368+0000", 2024-04-18T14:44:37.183 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.7677e-05 2024-04-18T14:44:37.183 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:37.183 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:37.183 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T14:44:37.184 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:46.376519+0000", 2024-04-18T14:44:37.184 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00015141300000000001 2024-04-18T14:44:37.184 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:37.184 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:37.184 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op must wait for map", 2024-04-18T14:44:37.184 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:46.376542+0000", 2024-04-18T14:44:37.184 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2833999999999999e-05 2024-04-18T14:44:37.184 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:37.184 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:37.184 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T14:44:37.184 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:46.380859+0000", 2024-04-18T14:44:37.184 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0043166309999999996 2024-04-18T14:44:37.184 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:37.184 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:37.184 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T14:44:37.184 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:46.381129+0000", 2024-04-18T14:44:37.185 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00027035200000000002 2024-04-18T14:44:37.185 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:37.185 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:37.185 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_started", 2024-04-18T14:44:37.185 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:46.394910+0000", 2024-04-18T14:44:37.185 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.013780621 2024-04-18T14:44:37.185 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:37.185 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:37.185 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_committed", 2024-04-18T14:44:37.185 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:46.398694+0000", 2024-04-18T14:44:37.185 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0037836419999999998 2024-04-18T14:44:37.185 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:37.185 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:37.185 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T14:44:37.185 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:46.401340+0000", 2024-04-18T14:44:37.186 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0026460899999999998 2024-04-18T14:44:37.186 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:37.186 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:37.186 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T14:44:37.186 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:46.401464+0000", 2024-04-18T14:44:37.186 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000124867 2024-04-18T14:44:37.186 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:44:37.186 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T14:44:37.186 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:44:37.186 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:37.186 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:37.186 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4559.0:327 3.5s0 3:ae89639c:::smithi13430248-39:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e47)", 2024-04-18T14:44:37.186 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T14:43:46.376390+0000", 2024-04-18T14:44:37.186 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 50.806642042, 2024-04-18T14:44:37.186 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.022295908999999999, 2024-04-18T14:44:37.187 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T14:44:37.187 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-04-18T14:44:37.187 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-18T14:44:37.187 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4559", 2024-04-18T14:44:37.187 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/3113589487", 2024-04-18T14:44:37.187 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 327 2024-04-18T14:44:37.187 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:37.187 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T14:44:37.187 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:37.187 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T14:44:37.187 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:46.376390+0000", 2024-04-18T14:44:37.187 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:44:37.187 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:37.187 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:37.187 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T14:44:37.188 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:46.376390+0000", 2024-04-18T14:44:37.188 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:44:37.188 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:37.188 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:37.188 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T14:44:37.188 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:46.376389+0000", 2024-04-18T14:44:37.188 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-18T14:44:37.188 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:37.188 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:37.188 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T14:44:37.188 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:46.376394+0000", 2024-04-18T14:44:37.188 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.3639999999999998e-06 2024-04-18T14:44:37.188 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:37.188 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:37.188 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T14:44:37.189 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:46.376406+0000", 2024-04-18T14:44:37.189 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2055999999999999e-05 2024-04-18T14:44:37.189 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:37.189 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:37.189 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T14:44:37.189 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:46.376417+0000", 2024-04-18T14:44:37.189 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0847e-05 2024-04-18T14:44:37.189 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:37.189 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:37.189 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T14:44:37.189 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:46.376676+0000", 2024-04-18T14:44:37.189 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00025870199999999998 2024-04-18T14:44:37.189 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:37.189 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:37.189 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting_for_map not empty", 2024-04-18T14:44:37.189 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:46.376688+0000", 2024-04-18T14:44:37.190 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1783000000000001e-05 2024-04-18T14:44:37.190 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:37.190 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:37.190 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T14:44:37.190 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:46.381511+0000", 2024-04-18T14:44:37.190 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0048235259999999999 2024-04-18T14:44:37.190 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:37.190 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:37.190 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for blocked object", 2024-04-18T14:44:37.190 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:46.381560+0000", 2024-04-18T14:44:37.190 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.9070999999999998e-05 2024-04-18T14:44:37.190 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:37.190 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:37.190 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T14:44:37.190 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:46.397940+0000", 2024-04-18T14:44:37.191 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.016379946999999999 2024-04-18T14:44:37.191 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:37.191 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:37.191 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T14:44:37.191 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:46.398249+0000", 2024-04-18T14:44:37.191 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00030838799999999999 2024-04-18T14:44:37.191 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:37.191 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:37.191 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T14:44:37.191 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:43:46.398686+0000", 2024-04-18T14:44:37.191 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00043738499999999999 2024-04-18T14:44:37.191 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:44:37.191 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T14:44:37.191 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:44:37.191 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:37.192 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:37.192 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "MOSDECSubOpWrite(3.3s3 63/30 ECSubWrite(tid=231, reqid=osd.13.0:231, at_version=63'29, trim_to=0'0, roll_forward_to=61'27))", 2024-04-18T14:44:37.192 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T14:44:02.398339+0000", 2024-04-18T14:44:37.192 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 34.784692790000001, 2024-04-18T14:44:37.192 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.01375418, 2024-04-18T14:44:37.192 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T14:44:37.192 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-04-18T14:44:37.192 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T14:44:37.192 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:37.192 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T14:44:37.192 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:02.398339+0000", 2024-04-18T14:44:37.192 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:44:37.192 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:37.192 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:37.192 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T14:44:37.193 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:02.398339+0000", 2024-04-18T14:44:37.193 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:44:37.193 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:37.193 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:37.193 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T14:44:37.193 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:02.398339+0000", 2024-04-18T14:44:37.193 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-18T14:44:37.193 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:37.193 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:37.193 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T14:44:37.193 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:02.398392+0000", 2024-04-18T14:44:37.193 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.3430000000000002e-05 2024-04-18T14:44:37.193 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:37.193 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:37.193 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T14:44:37.194 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:02.398419+0000", 2024-04-18T14:44:37.194 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.6775999999999999e-05 2024-04-18T14:44:37.194 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:37.194 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:37.194 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T14:44:37.194 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:02.398441+0000", 2024-04-18T14:44:37.194 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.1710000000000001e-05 2024-04-18T14:44:37.194 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:37.194 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:37.194 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T14:44:37.194 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:02.398584+0000", 2024-04-18T14:44:37.194 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000143616 2024-04-18T14:44:37.194 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:37.194 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:37.194 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_started", 2024-04-18T14:44:37.195 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:02.398611+0000", 2024-04-18T14:44:37.195 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.6869e-05 2024-04-18T14:44:37.195 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:37.195 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:37.195 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_committed", 2024-04-18T14:44:37.195 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:02.412007+0000", 2024-04-18T14:44:37.195 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.013396379 2024-04-18T14:44:37.195 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:37.195 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:37.195 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T14:44:37.195 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:02.412094+0000", 2024-04-18T14:44:37.195 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.6130000000000004e-05 2024-04-18T14:44:37.195 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:44:37.195 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T14:44:37.195 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:44:37.196 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:37.196 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:37.196 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "MOSDECSubOpWrite(3.8s5 63/30 ECSubWrite(tid=99, reqid=osd.5.0:99, at_version=63'73, trim_to=0'0, roll_forward_to=59'70))", 2024-04-18T14:44:37.196 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T14:44:02.399425+0000", 2024-04-18T14:44:37.196 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 34.783606915, 2024-04-18T14:44:37.196 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.015057716000000001, 2024-04-18T14:44:37.196 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T14:44:37.196 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-04-18T14:44:37.196 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T14:44:37.196 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:37.196 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T14:44:37.196 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:02.399425+0000", 2024-04-18T14:44:37.196 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:44:37.196 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:37.196 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:37.196 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T14:44:37.197 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:02.399425+0000", 2024-04-18T14:44:37.197 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:44:37.197 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:37.197 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:37.197 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T14:44:37.197 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:02.399425+0000", 2024-04-18T14:44:37.197 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-04-18T14:44:37.197 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:37.197 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:37.197 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T14:44:37.197 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:02.399488+0000", 2024-04-18T14:44:37.197 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.3788999999999995e-05 2024-04-18T14:44:37.197 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:37.198 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:37.198 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T14:44:37.198 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:02.399521+0000", 2024-04-18T14:44:37.198 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.2243000000000003e-05 2024-04-18T14:44:37.198 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:37.198 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:37.198 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T14:44:37.198 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:02.399544+0000", 2024-04-18T14:44:37.198 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.336e-05 2024-04-18T14:44:37.198 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:37.198 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:37.198 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T14:44:37.198 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:02.399661+0000", 2024-04-18T14:44:37.198 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000117229 2024-04-18T14:44:37.199 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:37.199 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:37.199 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_started", 2024-04-18T14:44:37.199 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:02.399685+0000", 2024-04-18T14:44:37.199 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.3802999999999999e-05 2024-04-18T14:44:37.199 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:37.199 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:37.199 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_committed", 2024-04-18T14:44:37.199 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:02.414425+0000", 2024-04-18T14:44:37.199 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.014740379 2024-04-18T14:44:37.199 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:37.199 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:37.199 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T14:44:37.199 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:02.414483+0000", 2024-04-18T14:44:37.200 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.7596000000000002e-05 2024-04-18T14:44:37.200 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:44:37.200 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T14:44:37.200 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:44:37.200 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:37.200 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:37.200 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "MOSDECSubOpWrite(3.9s4 68/30 ECSubWrite(tid=141, reqid=osd.12.0:141, at_version=68'113, trim_to=0'0, roll_forward_to=67'111))", 2024-04-18T14:44:37.200 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T14:44:07.399101+0000", 2024-04-18T14:44:37.200 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 29.783931661, 2024-04-18T14:44:37.200 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.018196561999999999, 2024-04-18T14:44:37.200 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T14:44:37.200 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-04-18T14:44:37.200 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T14:44:37.200 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:37.201 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T14:44:37.201 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:07.399101+0000", 2024-04-18T14:44:37.201 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:44:37.201 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:37.201 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:37.201 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T14:44:37.201 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:07.399101+0000", 2024-04-18T14:44:37.201 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:44:37.201 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:37.201 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:37.201 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T14:44:37.201 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:07.399099+0000", 2024-04-18T14:44:37.201 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-18T14:44:37.201 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:37.201 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:37.202 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T14:44:37.202 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:07.399154+0000", 2024-04-18T14:44:37.202 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.4379999999999998e-05 2024-04-18T14:44:37.202 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:37.202 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:37.202 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T14:44:37.202 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:07.399182+0000", 2024-04-18T14:44:37.202 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.8013000000000001e-05 2024-04-18T14:44:37.202 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:37.202 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:37.202 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T14:44:37.202 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:07.399204+0000", 2024-04-18T14:44:37.203 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2082e-05 2024-04-18T14:44:37.203 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:37.203 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:37.203 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T14:44:37.203 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:07.399453+0000", 2024-04-18T14:44:37.203 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00024898200000000002 2024-04-18T14:44:37.203 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:37.203 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:37.203 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_started", 2024-04-18T14:44:37.203 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:07.399482+0000", 2024-04-18T14:44:37.203 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.8883000000000001e-05 2024-04-18T14:44:37.204 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:37.204 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:37.204 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_committed", 2024-04-18T14:44:37.204 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:07.417250+0000", 2024-04-18T14:44:37.204 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.017767921999999998 2024-04-18T14:44:37.204 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:37.204 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:37.204 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T14:44:37.204 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:07.417297+0000", 2024-04-18T14:44:37.204 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.7403e-05 2024-04-18T14:44:37.204 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:44:37.204 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T14:44:37.205 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:44:37.205 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:37.205 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:37.205 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "MOSDECSubOpWrite(3.9s4 68/30 ECSubWrite(tid=142, reqid=osd.12.0:142, at_version=68'115, trim_to=0'0, roll_forward_to=67'111))", 2024-04-18T14:44:37.205 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T14:44:07.399244+0000", 2024-04-18T14:44:37.205 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 29.783788611999999, 2024-04-18T14:44:37.205 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.024403233, 2024-04-18T14:44:37.205 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T14:44:37.205 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-04-18T14:44:37.205 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T14:44:37.205 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:37.205 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T14:44:37.205 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:07.399244+0000", 2024-04-18T14:44:37.206 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:44:37.206 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:37.206 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:37.206 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T14:44:37.206 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:07.399244+0000", 2024-04-18T14:44:37.206 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:44:37.206 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:37.206 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:37.206 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T14:44:37.206 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:07.399242+0000", 2024-04-18T14:44:37.206 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-18T14:44:37.207 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:37.207 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:37.207 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T14:44:37.207 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:07.399292+0000", 2024-04-18T14:44:37.207 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.9252999999999998e-05 2024-04-18T14:44:37.207 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:37.207 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:37.207 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T14:44:37.207 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:07.399313+0000", 2024-04-18T14:44:37.207 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.1645999999999999e-05 2024-04-18T14:44:37.207 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:37.208 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:37.208 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T14:44:37.208 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:07.399336+0000", 2024-04-18T14:44:37.208 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2646e-05 2024-04-18T14:44:37.208 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:37.208 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:37.208 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T14:44:37.208 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:07.408814+0000", 2024-04-18T14:44:37.208 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0094779540000000002 2024-04-18T14:44:37.208 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:37.208 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:37.209 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_started", 2024-04-18T14:44:37.209 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:07.408840+0000", 2024-04-18T14:44:37.209 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.6452999999999999e-05 2024-04-18T14:44:37.209 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:37.209 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:37.209 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_committed", 2024-04-18T14:44:37.209 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:07.423578+0000", 2024-04-18T14:44:37.209 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.014737811999999999 2024-04-18T14:44:37.209 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:37.209 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:37.209 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T14:44:37.209 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:07.423647+0000", 2024-04-18T14:44:37.209 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.8602000000000005e-05 2024-04-18T14:44:37.210 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:44:37.210 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T14:44:37.210 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:44:37.210 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:37.210 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:37.210 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "MOSDECSubOpWrite(3.3s3 68/30 ECSubWrite(tid=247, reqid=osd.13.0:247, at_version=68'41, trim_to=0'0, roll_forward_to=65'39))", 2024-04-18T14:44:37.210 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T14:44:07.400499+0000", 2024-04-18T14:44:37.210 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 29.782533459, 2024-04-18T14:44:37.210 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.023442557999999999, 2024-04-18T14:44:37.210 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T14:44:37.211 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-04-18T14:44:37.211 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T14:44:37.211 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:37.211 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T14:44:37.211 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:07.400499+0000", 2024-04-18T14:44:37.211 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:44:37.211 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:37.211 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:37.211 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T14:44:37.211 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:07.400499+0000", 2024-04-18T14:44:37.211 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:44:37.211 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:37.211 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:37.212 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T14:44:37.212 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:07.400497+0000", 2024-04-18T14:44:37.212 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999981 2024-04-18T14:44:37.212 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:37.212 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:37.212 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T14:44:37.212 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:07.400553+0000", 2024-04-18T14:44:37.212 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.6039999999999999e-05 2024-04-18T14:44:37.212 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:37.212 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:37.212 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T14:44:37.212 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:07.400584+0000", 2024-04-18T14:44:37.212 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.1622999999999999e-05 2024-04-18T14:44:37.212 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:37.212 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:37.213 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T14:44:37.213 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:07.400607+0000", 2024-04-18T14:44:37.213 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2223000000000001e-05 2024-04-18T14:44:37.213 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:37.213 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:37.213 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T14:44:37.213 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:07.400803+0000", 2024-04-18T14:44:37.213 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000196725 2024-04-18T14:44:37.213 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:37.213 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:37.213 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_started", 2024-04-18T14:44:37.213 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:07.400829+0000", 2024-04-18T14:44:37.214 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.6020000000000002e-05 2024-04-18T14:44:37.214 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:37.214 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:37.214 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_committed", 2024-04-18T14:44:37.214 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:07.423902+0000", 2024-04-18T14:44:37.214 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.023072397000000001 2024-04-18T14:44:37.214 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:37.214 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:37.214 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T14:44:37.214 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:07.423941+0000", 2024-04-18T14:44:37.214 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.9613000000000002e-05 2024-04-18T14:44:37.214 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:44:37.214 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T14:44:37.215 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:44:37.215 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:37.215 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:37.215 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "MOSDECSubOpWrite(3.8s5 68/30 ECSubWrite(tid=140, reqid=osd.5.0:140, at_version=68'109, trim_to=0'0, roll_forward_to=67'105))", 2024-04-18T14:44:37.215 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T14:44:07.400701+0000", 2024-04-18T14:44:37.215 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 29.782331013, 2024-04-18T14:44:37.215 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.023150075999999999, 2024-04-18T14:44:37.215 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T14:44:37.215 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-04-18T14:44:37.215 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T14:44:37.215 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:37.215 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T14:44:37.215 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:07.400701+0000", 2024-04-18T14:44:37.215 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:44:37.216 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:37.216 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:37.216 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T14:44:37.216 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:07.400701+0000", 2024-04-18T14:44:37.216 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:44:37.216 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:37.216 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:37.216 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T14:44:37.216 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:07.400700+0000", 2024-04-18T14:44:37.216 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-18T14:44:37.216 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:37.216 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:37.216 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T14:44:37.217 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:07.400736+0000", 2024-04-18T14:44:37.217 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.5836e-05 2024-04-18T14:44:37.217 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:37.217 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:37.217 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T14:44:37.217 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:07.400757+0000", 2024-04-18T14:44:37.217 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.1287000000000001e-05 2024-04-18T14:44:37.217 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:37.217 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:37.217 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T14:44:37.217 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:07.400775+0000", 2024-04-18T14:44:37.217 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.7533e-05 2024-04-18T14:44:37.218 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:37.218 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:37.218 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T14:44:37.218 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:07.403766+0000", 2024-04-18T14:44:37.218 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.002991367 2024-04-18T14:44:37.218 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:37.218 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:37.218 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_started", 2024-04-18T14:44:37.218 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:07.403794+0000", 2024-04-18T14:44:37.218 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.724e-05 2024-04-18T14:44:37.218 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:37.218 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:37.218 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_committed", 2024-04-18T14:44:37.219 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:07.423781+0000", 2024-04-18T14:44:37.219 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.019987340999999999 2024-04-18T14:44:37.219 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:37.219 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:37.219 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T14:44:37.219 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:07.423851+0000", 2024-04-18T14:44:37.219 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.0378999999999998e-05 2024-04-18T14:44:37.219 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:44:37.219 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T14:44:37.219 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:44:37.219 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:37.219 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:37.219 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "MOSDECSubOpWrite(3.2s4 68/30 ECSubWrite(tid=248, reqid=osd.13.0:248, at_version=68'39, trim_to=0'0, roll_forward_to=65'35))", 2024-04-18T14:44:37.219 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T14:44:07.401757+0000", 2024-04-18T14:44:37.219 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 29.781275367999999, 2024-04-18T14:44:37.220 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.024779440999999999, 2024-04-18T14:44:37.220 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T14:44:37.220 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-04-18T14:44:37.220 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T14:44:37.220 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:37.220 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T14:44:37.220 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:07.401757+0000", 2024-04-18T14:44:37.220 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:44:37.220 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:37.221 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:37.221 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T14:44:37.221 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:07.401757+0000", 2024-04-18T14:44:37.221 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:44:37.221 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:37.221 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:37.221 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T14:44:37.221 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:07.401755+0000", 2024-04-18T14:44:37.221 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999981 2024-04-18T14:44:37.221 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:37.221 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:37.222 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T14:44:37.222 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:07.401806+0000", 2024-04-18T14:44:37.222 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.0785999999999998e-05 2024-04-18T14:44:37.222 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:37.222 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:37.222 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T14:44:37.222 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:07.401839+0000", 2024-04-18T14:44:37.222 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.2663999999999998e-05 2024-04-18T14:44:37.222 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:37.222 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:37.222 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T14:44:37.222 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:07.401863+0000", 2024-04-18T14:44:37.222 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.41e-05 2024-04-18T14:44:37.223 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:37.223 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:37.223 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T14:44:37.223 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:07.403854+0000", 2024-04-18T14:44:37.223 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0019915200000000001 2024-04-18T14:44:37.223 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:37.223 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:37.223 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_started", 2024-04-18T14:44:37.223 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:07.403878+0000", 2024-04-18T14:44:37.223 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.3966999999999999e-05 2024-04-18T14:44:37.223 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:37.223 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:37.224 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_committed", 2024-04-18T14:44:37.224 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:07.426466+0000", 2024-04-18T14:44:37.224 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.022588177000000001 2024-04-18T14:44:37.224 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:37.224 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:37.224 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T14:44:37.224 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:07.426536+0000", 2024-04-18T14:44:37.224 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.9963999999999996e-05 2024-04-18T14:44:37.224 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:44:37.224 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T14:44:37.224 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:44:37.224 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:37.224 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:37.225 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "MOSDECSubOpWrite(3.3s3 68/30 ECSubWrite(tid=249, reqid=osd.13.0:249, at_version=68'43, trim_to=0'0, roll_forward_to=65'39))", 2024-04-18T14:44:37.225 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T14:44:07.402191+0000", 2024-04-18T14:44:37.225 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 29.780841012, 2024-04-18T14:44:37.225 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.029051054, 2024-04-18T14:44:37.225 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T14:44:37.225 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-04-18T14:44:37.225 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T14:44:37.225 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:37.225 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T14:44:37.225 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:07.402191+0000", 2024-04-18T14:44:37.225 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:44:37.225 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:37.225 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:37.226 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T14:44:37.226 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:07.402191+0000", 2024-04-18T14:44:37.226 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:44:37.226 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:37.226 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:37.226 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T14:44:37.226 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:07.402184+0000", 2024-04-18T14:44:37.226 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999933 2024-04-18T14:44:37.226 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:37.226 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:37.226 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T14:44:37.227 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:07.402242+0000", 2024-04-18T14:44:37.227 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.7689999999999998e-05 2024-04-18T14:44:37.227 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:37.227 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:37.227 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T14:44:37.227 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:07.402275+0000", 2024-04-18T14:44:37.227 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.3115999999999999e-05 2024-04-18T14:44:37.227 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:37.227 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:37.227 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T14:44:37.227 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:07.402303+0000", 2024-04-18T14:44:37.227 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.7710000000000001e-05 2024-04-18T14:44:37.227 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:37.228 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:37.228 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T14:44:37.228 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:07.410513+0000", 2024-04-18T14:44:37.228 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0082100230000000003 2024-04-18T14:44:37.228 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:37.228 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:37.228 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_started", 2024-04-18T14:44:37.228 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:07.410537+0000", 2024-04-18T14:44:37.228 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.4202999999999998e-05 2024-04-18T14:44:37.228 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:37.228 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:37.228 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_committed", 2024-04-18T14:44:37.228 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:07.431171+0000", 2024-04-18T14:44:37.229 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.02063361 2024-04-18T14:44:37.229 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:37.229 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:37.229 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T14:44:37.229 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:07.431242+0000", 2024-04-18T14:44:37.229 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.1454999999999999e-05 2024-04-18T14:44:37.229 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:44:37.229 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T14:44:37.229 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:44:37.229 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:37.229 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:37.229 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "MOSDECSubOpWrite(3.6s3 68/30 ECSubWrite(tid=204, reqid=osd.14.0:202, at_version=0'0, trim_to=0'0, roll_forward_to=68'85))", 2024-04-18T14:44:37.229 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T14:44:07.416670+0000", 2024-04-18T14:44:37.229 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 29.766362020999999, 2024-04-18T14:44:37.230 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.021911661999999998, 2024-04-18T14:44:37.230 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T14:44:37.230 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-04-18T14:44:37.230 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T14:44:37.230 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:37.230 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T14:44:37.230 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:07.416670+0000", 2024-04-18T14:44:37.230 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:44:37.230 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:37.230 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:37.230 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T14:44:37.231 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:07.416670+0000", 2024-04-18T14:44:37.231 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:44:37.231 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:37.231 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:37.231 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T14:44:37.231 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:07.416662+0000", 2024-04-18T14:44:37.231 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999919 2024-04-18T14:44:37.231 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:37.231 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:37.231 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T14:44:37.231 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:07.416699+0000", 2024-04-18T14:44:37.231 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.6726e-05 2024-04-18T14:44:37.231 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:37.232 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:37.232 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T14:44:37.232 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:07.416776+0000", 2024-04-18T14:44:37.232 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.7669999999999993e-05 2024-04-18T14:44:37.232 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:37.232 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:37.232 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T14:44:37.232 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:07.416800+0000", 2024-04-18T14:44:37.232 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.3949999999999999e-05 2024-04-18T14:44:37.232 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:37.232 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:37.232 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T14:44:37.233 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:07.416934+0000", 2024-04-18T14:44:37.233 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00013330199999999999 2024-04-18T14:44:37.233 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:37.233 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:37.233 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_started", 2024-04-18T14:44:37.233 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:07.416960+0000", 2024-04-18T14:44:37.233 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.5976e-05 2024-04-18T14:44:37.233 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:37.233 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:37.233 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_committed", 2024-04-18T14:44:37.233 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:07.438526+0000", 2024-04-18T14:44:37.233 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.021565937 2024-04-18T14:44:37.233 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:37.234 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:37.234 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T14:44:37.234 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:07.438582+0000", 2024-04-18T14:44:37.234 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.6190999999999998e-05 2024-04-18T14:44:37.234 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:44:37.234 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T14:44:37.234 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:44:37.234 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:37.234 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:37.234 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "MOSDECSubOpWrite(3.as5 68/30 ECSubWrite(tid=70, reqid=osd.3.0:70, at_version=68'55, trim_to=0'0, roll_forward_to=65'53))", 2024-04-18T14:44:37.234 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T14:44:07.417277+0000", 2024-04-18T14:44:37.234 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 29.765755405, 2024-04-18T14:44:37.235 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.013926294000000001, 2024-04-18T14:44:37.235 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T14:44:37.235 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-04-18T14:44:37.235 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T14:44:37.235 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:37.235 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T14:44:37.235 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:07.417277+0000", 2024-04-18T14:44:37.235 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:44:37.235 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:37.235 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:37.235 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T14:44:37.235 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:07.417277+0000", 2024-04-18T14:44:37.235 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:44:37.236 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:37.236 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:37.236 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T14:44:37.236 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:07.417276+0000", 2024-04-18T14:44:37.236 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-04-18T14:44:37.236 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:37.236 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:37.236 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T14:44:37.236 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:07.417331+0000", 2024-04-18T14:44:37.236 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.4605000000000003e-05 2024-04-18T14:44:37.236 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:37.236 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:37.236 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T14:44:37.236 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:07.417365+0000", 2024-04-18T14:44:37.236 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.4756999999999999e-05 2024-04-18T14:44:37.237 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:37.237 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:37.237 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T14:44:37.237 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:07.417389+0000", 2024-04-18T14:44:37.237 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.351e-05 2024-04-18T14:44:37.237 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:37.237 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:37.237 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T14:44:37.237 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:07.417536+0000", 2024-04-18T14:44:37.237 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00014692899999999999 2024-04-18T14:44:37.237 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:37.237 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:37.237 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_started", 2024-04-18T14:44:37.238 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:07.417563+0000", 2024-04-18T14:44:37.238 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.7330000000000001e-05 2024-04-18T14:44:37.238 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:37.238 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:37.238 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_committed", 2024-04-18T14:44:37.238 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:07.431137+0000", 2024-04-18T14:44:37.238 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.013573421 2024-04-18T14:44:37.238 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:37.238 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:37.238 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T14:44:37.238 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:07.431203+0000", 2024-04-18T14:44:37.238 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.6412e-05 2024-04-18T14:44:37.238 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:44:37.239 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T14:44:37.239 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:44:37.239 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:37.239 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:37.239 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "MOSDECSubOpWrite(3.as5 68/30 ECSubWrite(tid=71, reqid=osd.3.0:71, at_version=68'57, trim_to=0'0, roll_forward_to=65'53))", 2024-04-18T14:44:37.239 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T14:44:07.417427+0000", 2024-04-18T14:44:37.239 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 29.765605152999999, 2024-04-18T14:44:37.239 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.018224018000000002, 2024-04-18T14:44:37.239 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T14:44:37.239 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-04-18T14:44:37.239 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T14:44:37.239 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:37.239 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T14:44:37.240 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:07.417427+0000", 2024-04-18T14:44:37.240 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:44:37.240 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:37.240 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:37.240 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T14:44:37.240 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:07.417427+0000", 2024-04-18T14:44:37.240 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:44:37.240 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:37.240 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:37.240 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T14:44:37.240 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:07.417426+0000", 2024-04-18T14:44:37.240 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-18T14:44:37.240 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:37.241 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:37.241 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T14:44:37.241 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:07.417479+0000", 2024-04-18T14:44:37.241 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.2386000000000003e-05 2024-04-18T14:44:37.241 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:37.241 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:37.241 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T14:44:37.241 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:07.417501+0000", 2024-04-18T14:44:37.241 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2209999999999999e-05 2024-04-18T14:44:37.241 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:37.241 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:37.241 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T14:44:37.242 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:07.417520+0000", 2024-04-18T14:44:37.242 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.9473000000000001e-05 2024-04-18T14:44:37.242 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:37.242 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:37.242 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T14:44:37.242 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:07.420082+0000", 2024-04-18T14:44:37.242 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0025617029999999998 2024-04-18T14:44:37.242 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:37.242 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:37.242 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_started", 2024-04-18T14:44:37.242 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:07.420107+0000", 2024-04-18T14:44:37.242 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.4870000000000001e-05 2024-04-18T14:44:37.242 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:37.243 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:37.243 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_committed", 2024-04-18T14:44:37.243 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:07.435601+0000", 2024-04-18T14:44:37.243 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.015494459 2024-04-18T14:44:37.243 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:37.243 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:37.243 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T14:44:37.243 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:07.435651+0000", 2024-04-18T14:44:37.243 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.9756999999999998e-05 2024-04-18T14:44:37.243 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:44:37.243 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T14:44:37.243 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:44:37.243 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:37.243 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:37.244 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "MOSDECSubOpWrite(3.6s3 68/30 ECSubWrite(tid=206, reqid=osd.14.0:206, at_version=68'87, trim_to=0'0, roll_forward_to=68'85))", 2024-04-18T14:44:37.244 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T14:44:07.424265+0000", 2024-04-18T14:44:37.244 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 29.758766903000001, 2024-04-18T14:44:37.244 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.014356109000000001, 2024-04-18T14:44:37.244 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T14:44:37.244 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-04-18T14:44:37.244 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T14:44:37.244 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:37.244 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T14:44:37.244 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:07.424265+0000", 2024-04-18T14:44:37.244 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:44:37.244 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:37.245 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:37.245 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T14:44:37.245 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:07.424265+0000", 2024-04-18T14:44:37.245 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:44:37.245 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:37.245 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:37.245 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T14:44:37.245 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:07.424264+0000", 2024-04-18T14:44:37.245 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999986 2024-04-18T14:44:37.245 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:37.245 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:37.245 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T14:44:37.245 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:07.424334+0000", 2024-04-18T14:44:37.245 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.0506000000000006e-05 2024-04-18T14:44:37.245 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:37.246 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:37.246 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T14:44:37.246 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:07.424382+0000", 2024-04-18T14:44:37.246 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.7645999999999997e-05 2024-04-18T14:44:37.246 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:37.246 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:37.246 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T14:44:37.246 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:07.424403+0000", 2024-04-18T14:44:37.246 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0659999999999999e-05 2024-04-18T14:44:37.246 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:37.246 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:37.246 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T14:44:37.246 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:07.424533+0000", 2024-04-18T14:44:37.247 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000130512 2024-04-18T14:44:37.247 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:37.247 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:37.247 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_started", 2024-04-18T14:44:37.247 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:07.424554+0000", 2024-04-18T14:44:37.247 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0962999999999999e-05 2024-04-18T14:44:37.247 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:37.247 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:37.247 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_committed", 2024-04-18T14:44:37.247 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:07.438594+0000", 2024-04-18T14:44:37.247 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.01403977 2024-04-18T14:44:37.247 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:37.247 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:37.247 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T14:44:37.248 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:07.438621+0000", 2024-04-18T14:44:37.248 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.7642000000000001e-05 2024-04-18T14:44:37.248 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:44:37.248 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T14:44:37.248 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:44:37.248 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:37.248 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:37.248 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "MOSDECSubOpWrite(3.8s5 68/30 ECSubWrite(tid=141, reqid=osd.5.0:140, at_version=0'0, trim_to=0'0, roll_forward_to=68'109))", 2024-04-18T14:44:37.248 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T14:44:07.425416+0000", 2024-04-18T14:44:37.248 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 29.757616379000002, 2024-04-18T14:44:37.248 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.013482839999999999, 2024-04-18T14:44:37.248 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T14:44:37.249 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-04-18T14:44:37.249 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T14:44:37.249 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:37.249 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T14:44:37.249 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:07.425416+0000", 2024-04-18T14:44:37.249 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:44:37.249 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:37.249 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:37.249 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T14:44:37.249 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:07.425416+0000", 2024-04-18T14:44:37.249 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:44:37.249 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:37.249 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:37.250 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T14:44:37.250 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:07.425414+0000", 2024-04-18T14:44:37.250 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999981 2024-04-18T14:44:37.250 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:37.250 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:37.250 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T14:44:37.250 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:07.425444+0000", 2024-04-18T14:44:37.250 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.9655999999999999e-05 2024-04-18T14:44:37.250 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:37.250 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:37.250 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T14:44:37.250 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:07.425476+0000", 2024-04-18T14:44:37.250 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.269e-05 2024-04-18T14:44:37.251 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:37.251 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:37.251 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T14:44:37.251 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:07.425499+0000", 2024-04-18T14:44:37.251 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2543000000000001e-05 2024-04-18T14:44:37.251 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:37.251 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:37.251 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T14:44:37.251 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:07.425635+0000", 2024-04-18T14:44:37.251 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00013625900000000001 2024-04-18T14:44:37.251 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:37.251 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:37.252 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_started", 2024-04-18T14:44:37.252 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:07.425661+0000", 2024-04-18T14:44:37.252 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.6270000000000001e-05 2024-04-18T14:44:37.252 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:37.252 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:37.252 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_committed", 2024-04-18T14:44:37.252 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:07.438850+0000", 2024-04-18T14:44:37.252 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.013188356 2024-04-18T14:44:37.252 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:37.252 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:37.252 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T14:44:37.252 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:07.438899+0000", 2024-04-18T14:44:37.252 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.8939e-05 2024-04-18T14:44:37.253 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:44:37.253 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T14:44:37.253 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:44:37.253 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:37.253 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:37.253 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "MOSDECSubOpWrite(3.9s4 68/30 ECSubWrite(tid=144, reqid=osd.12.0:144, at_version=68'117, trim_to=0'0, roll_forward_to=68'115))", 2024-04-18T14:44:37.253 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T14:44:07.426009+0000", 2024-04-18T14:44:37.253 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 29.757023582999999, 2024-04-18T14:44:37.253 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.013679692, 2024-04-18T14:44:37.253 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T14:44:37.253 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-04-18T14:44:37.253 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T14:44:37.253 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:37.253 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T14:44:37.254 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:07.426009+0000", 2024-04-18T14:44:37.254 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:44:37.254 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:37.254 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:37.254 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T14:44:37.254 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:07.426009+0000", 2024-04-18T14:44:37.254 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:44:37.254 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:37.254 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:37.254 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T14:44:37.254 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:07.426007+0000", 2024-04-18T14:44:37.254 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999981 2024-04-18T14:44:37.254 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:37.255 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:37.255 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T14:44:37.255 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:07.426061+0000", 2024-04-18T14:44:37.255 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.4339000000000003e-05 2024-04-18T14:44:37.255 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:37.255 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:37.255 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T14:44:37.255 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:07.426118+0000", 2024-04-18T14:44:37.255 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.6815999999999999e-05 2024-04-18T14:44:37.256 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:37.256 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:37.256 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T14:44:37.256 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:07.426179+0000", 2024-04-18T14:44:37.256 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.0872999999999998e-05 2024-04-18T14:44:37.256 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:37.256 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:37.256 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T14:44:37.256 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:07.426488+0000", 2024-04-18T14:44:37.256 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00030968400000000001 2024-04-18T14:44:37.256 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:37.256 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:37.256 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_started", 2024-04-18T14:44:37.257 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:07.426515+0000", 2024-04-18T14:44:37.257 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.7140000000000001e-05 2024-04-18T14:44:37.257 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:37.257 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:37.257 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_committed", 2024-04-18T14:44:37.257 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:07.439616+0000", 2024-04-18T14:44:37.257 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.013100752 2024-04-18T14:44:37.257 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:37.257 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:37.257 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T14:44:37.257 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:07.439688+0000", 2024-04-18T14:44:37.257 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.2148000000000001e-05 2024-04-18T14:44:37.257 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:44:37.257 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T14:44:37.258 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:44:37.258 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:37.258 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:37.258 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "MOSDECSubOpWrite(3.9s4 68/30 ECSubWrite(tid=145, reqid=osd.12.0:145, at_version=68'119, trim_to=0'0, roll_forward_to=68'115))", 2024-04-18T14:44:37.258 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T14:44:07.426219+0000", 2024-04-18T14:44:37.258 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 29.756813639000001, 2024-04-18T14:44:37.258 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.014723042, 2024-04-18T14:44:37.258 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T14:44:37.258 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-04-18T14:44:37.258 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T14:44:37.258 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:37.258 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T14:44:37.259 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:07.426219+0000", 2024-04-18T14:44:37.259 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:44:37.259 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:37.259 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:37.259 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T14:44:37.259 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:07.426219+0000", 2024-04-18T14:44:37.259 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:44:37.259 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:37.259 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:37.259 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T14:44:37.260 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:07.426217+0000", 2024-04-18T14:44:37.260 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999986 2024-04-18T14:44:37.260 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:37.260 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:37.260 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T14:44:37.260 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:07.426276+0000", 2024-04-18T14:44:37.260 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.9104000000000002e-05 2024-04-18T14:44:37.260 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:37.260 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:37.260 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T14:44:37.260 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:07.426303+0000", 2024-04-18T14:44:37.260 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.6679e-05 2024-04-18T14:44:37.260 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:37.260 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:37.260 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T14:44:37.261 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:07.426322+0000", 2024-04-18T14:44:37.261 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.9242999999999999e-05 2024-04-18T14:44:37.261 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:37.261 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:37.261 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T14:44:37.261 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:07.435724+0000", 2024-04-18T14:44:37.261 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0094019150000000003 2024-04-18T14:44:37.261 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:37.261 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:37.261 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_started", 2024-04-18T14:44:37.261 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:07.435744+0000", 2024-04-18T14:44:37.262 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.9785000000000001e-05 2024-04-18T14:44:37.262 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:37.262 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:37.262 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_committed", 2024-04-18T14:44:37.262 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:07.440880+0000", 2024-04-18T14:44:37.262 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0051361219999999999 2024-04-18T14:44:37.262 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:37.262 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:37.262 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T14:44:37.262 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:07.440942+0000", 2024-04-18T14:44:37.262 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.1713999999999999e-05 2024-04-18T14:44:37.262 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:44:37.262 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T14:44:37.263 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:44:37.263 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:37.263 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:37.263 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4559.0:772 3.5s0 3:ae89639c:::smithi13430248-39:head [create,setxattr [mRaOP^iTabSYNZSRY^bT[tjWRnYaahmhaR]dQsN (1262) in=40b,setxattr NdS[Q`Ys[gRPNWtoZicj_iYlctZjtOTR (875) in=32b,setxattr m^bg`_t^^mfPhoRq`hZaih (875) in=22b,setxattr QSP`hlVUcRehtg`kXcaYbmZtgpdRmQa[pVq`_YPe (315) in=40b,setxattr ajaTlrOQanZ`lk[^nsfObkVfhlcrl[`QgYXZ_a]t (769) in=40b,setxattr cU\\QUerRg (875) in=9b,setxattr pnR\\aZVZSojanelblTcUh\\rUT^tdWs\\cdYhsr[XY (1575) in=40b,setxattr aqbTnohU_aoq[pYrd_qfondhhfVYdZNghWQRVs_e (1926) in=40b,setxattr nmNonb_SPsZrNeX^T^YRStm]_tpsYO^acoqtjsc[ (803) in=40b,setxattr eUSVNcSXoVsbhaWYjcsNtQ[r^cYQifrime_eaX]c (595) in=40b,setxattr anNRfWahTZa\\tOme\\nefYVlW_N`V\\hcjmVhNpZ[h (1226) in=40b,setxattr ZNaa^bfR]YRlUQqQeq\\nkcZ[[mt]YaRQibRreptZ (1121) in=40b,setxattr _P\\t`hZTlh[]\\dc]ZN]Sqrb[le`oRt\\ptYem_Zoh (10596) in=40b,setxattr PXXdYjNVs_UahTRTkfct[ZXbhdne]rronnd[qleR (13964) in=40b,setxattr TdqabrNtRPmeV\\UqinOkWl]oOONngehpSS (875) in=34b,setxattr Y__pUaN[YVk^tpVnUdiPgmRhSq_[XlRPTgasc]Nl (6736) in=40b,setxattr PhkRTP\\TpdSagUarch]\\^pVd^gbTcWTNQXTarkYZ (1259) in=40b,setxattr m_S\\^a[babQpshqNojaVm__OedgcioopVbf`UZjW (1717) in=40b,setxattr gS\\OStP]mjX_jcbPUj\\h_md]Umj]boXVUZZQQlsc (279) in=40b,setxattr YhZY[]pkaU`j`p]theotU`U]VhN_cqf^gbbqcTl] (421) in=40b] snapc 2b=[2b,2a,29,28,27,26,23,22,1e,1c,1a,16,14,13,11,2] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-18T14:44:37.263 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T14:44:15.391712+0000", 2024-04-18T14:44:37.263 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 21.791320198000001, 2024-04-18T14:44:37.263 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.016922168000000001, 2024-04-18T14:44:37.263 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T14:44:37.263 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T14:44:37.263 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-18T14:44:37.263 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4559", 2024-04-18T14:44:37.264 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/3113589487", 2024-04-18T14:44:37.264 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 772 2024-04-18T14:44:37.264 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:37.264 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T14:44:37.264 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:37.264 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T14:44:37.264 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:15.391712+0000", 2024-04-18T14:44:37.264 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:44:37.264 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:37.264 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:37.264 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T14:44:37.264 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:15.391712+0000", 2024-04-18T14:44:37.264 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:44:37.264 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:37.264 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:37.264 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T14:44:37.265 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:15.391709+0000", 2024-04-18T14:44:37.265 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999971 2024-04-18T14:44:37.265 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:37.265 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:37.265 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T14:44:37.265 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:15.391847+0000", 2024-04-18T14:44:37.265 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00013765199999999999 2024-04-18T14:44:37.265 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:37.265 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:37.265 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T14:44:37.265 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:15.391893+0000", 2024-04-18T14:44:37.265 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.6213e-05 2024-04-18T14:44:37.265 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:37.266 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:37.266 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T14:44:37.266 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:15.391922+0000", 2024-04-18T14:44:37.266 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.8955999999999999e-05 2024-04-18T14:44:37.266 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:37.266 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:37.266 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T14:44:37.266 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:15.392051+0000", 2024-04-18T14:44:37.266 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00012886899999999999 2024-04-18T14:44:37.266 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:37.266 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:37.266 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op must wait for map", 2024-04-18T14:44:37.266 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:15.392062+0000", 2024-04-18T14:44:37.266 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1593999999999999e-05 2024-04-18T14:44:37.267 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:37.267 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:37.267 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T14:44:37.267 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:15.399006+0000", 2024-04-18T14:44:37.267 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0069434889999999997 2024-04-18T14:44:37.267 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:37.267 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:37.267 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-18T14:44:37.267 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:15.399332+0000", 2024-04-18T14:44:37.267 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00032655100000000001 2024-04-18T14:44:37.267 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:37.267 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:37.267 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_started", 2024-04-18T14:44:37.267 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:15.401477+0000", 2024-04-18T14:44:37.268 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0021447630000000001 2024-04-18T14:44:37.268 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:37.268 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:37.268 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_committed", 2024-04-18T14:44:37.268 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:15.405255+0000", 2024-04-18T14:44:37.268 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.003777837 2024-04-18T14:44:37.268 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:37.268 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:37.268 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-18T14:44:37.268 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:15.408438+0000", 2024-04-18T14:44:37.268 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0031828020000000002 2024-04-18T14:44:37.268 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:37.268 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:37.269 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T14:44:37.269 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:15.408634+0000", 2024-04-18T14:44:37.269 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00019642499999999999 2024-04-18T14:44:37.269 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:44:37.269 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T14:44:37.269 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:44:37.269 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:37.269 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:37.269 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "MOSDECSubOpWrite(3.8s5 82/73 ECSubWrite(tid=230, reqid=osd.5.0:230, at_version=82'169, trim_to=0'0, roll_forward_to=81'165))", 2024-04-18T14:44:37.269 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T14:44:21.463054+0000", 2024-04-18T14:44:37.269 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 15.719978445000001, 2024-04-18T14:44:37.269 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.015751880999999999, 2024-04-18T14:44:37.269 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T14:44:37.270 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-04-18T14:44:37.270 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T14:44:37.270 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:37.270 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T14:44:37.270 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:21.463054+0000", 2024-04-18T14:44:37.270 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:44:37.270 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:37.270 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:37.270 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T14:44:37.270 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:21.463054+0000", 2024-04-18T14:44:37.270 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:44:37.270 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:37.270 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:37.270 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T14:44:37.271 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:21.463052+0000", 2024-04-18T14:44:37.271 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999986 2024-04-18T14:44:37.271 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:37.271 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:37.271 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T14:44:37.271 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:21.463103+0000", 2024-04-18T14:44:37.271 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.0742999999999999e-05 2024-04-18T14:44:37.271 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:37.271 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:37.271 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T14:44:37.271 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:21.463135+0000", 2024-04-18T14:44:37.271 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.2406000000000001e-05 2024-04-18T14:44:37.271 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:37.271 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:37.271 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T14:44:37.272 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:21.463157+0000", 2024-04-18T14:44:37.272 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.1523e-05 2024-04-18T14:44:37.272 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:37.272 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:37.272 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T14:44:37.272 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:21.463280+0000", 2024-04-18T14:44:37.272 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00012358900000000001 2024-04-18T14:44:37.272 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:37.272 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:37.272 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_started", 2024-04-18T14:44:37.272 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:21.463308+0000", 2024-04-18T14:44:37.272 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.7067e-05 2024-04-18T14:44:37.273 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:37.273 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:37.274 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_committed", 2024-04-18T14:44:37.274 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:21.478731+0000", 2024-04-18T14:44:37.274 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.015423473 2024-04-18T14:44:37.274 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:37.274 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:37.274 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T14:44:37.274 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:21.478806+0000", 2024-04-18T14:44:37.274 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.4655999999999998e-05 2024-04-18T14:44:37.274 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:44:37.274 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T14:44:37.274 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:44:37.274 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:37.274 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:37.274 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "MOSDECSubOpWrite(3.2s4 82/70 ECSubWrite(tid=300, reqid=osd.13.0:300, at_version=82'60, trim_to=0'0, roll_forward_to=80'56))", 2024-04-18T14:44:37.275 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-18T14:44:21.474055+0000", 2024-04-18T14:44:37.275 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 15.708977243, 2024-04-18T14:44:37.275 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.016628016999999998, 2024-04-18T14:44:37.275 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-18T14:44:37.275 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-04-18T14:44:37.275 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-18T14:44:37.275 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:37.275 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-18T14:44:37.275 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:21.474055+0000", 2024-04-18T14:44:37.275 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:44:37.275 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:37.275 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:37.275 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-18T14:44:37.276 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:21.474055+0000", 2024-04-18T14:44:37.276 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-18T14:44:37.276 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:37.276 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:37.276 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-18T14:44:37.276 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:21.474054+0000", 2024-04-18T14:44:37.276 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999986 2024-04-18T14:44:37.276 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:37.276 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:37.276 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-18T14:44:37.276 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:21.474103+0000", 2024-04-18T14:44:37.277 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.9079000000000002e-05 2024-04-18T14:44:37.277 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:37.277 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:37.277 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-18T14:44:37.277 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:21.474130+0000", 2024-04-18T14:44:37.277 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.775e-05 2024-04-18T14:44:37.277 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:37.277 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:37.277 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-18T14:44:37.277 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:21.474156+0000", 2024-04-18T14:44:37.277 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.5919999999999999e-05 2024-04-18T14:44:37.277 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:37.277 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:37.277 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-18T14:44:37.277 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:21.478025+0000", 2024-04-18T14:44:37.278 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0038690439999999999 2024-04-18T14:44:37.278 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:37.278 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:37.278 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_started", 2024-04-18T14:44:37.278 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:21.478052+0000", 2024-04-18T14:44:37.278 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.6726000000000001e-05 2024-04-18T14:44:37.278 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:37.278 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:37.278 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_committed", 2024-04-18T14:44:37.278 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:21.490624+0000", 2024-04-18T14:44:37.278 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.012572072 2024-04-18T14:44:37.278 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-18T14:44:37.279 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-18T14:44:37.279 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-18T14:44:37.279 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-18T14:44:21.490683+0000", 2024-04-18T14:44:37.279 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.8832999999999997e-05 2024-04-18T14:44:37.279 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:44:37.279 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T14:44:37.279 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:44:37.279 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-18T14:44:37.279 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-18T14:44:37.279 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-04-18T14:44:37.556 INFO:teuthology.orchestra.run.smithi086.stderr:reweighted osd.4 to 1 (10000) 2024-04-18T14:44:37.581 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 4 1 2024-04-18T14:44:38.571 INFO:teuthology.orchestra.run.smithi086.stderr:set osd.4 primary-affinity to 1 (8655362) 2024-04-18T14:44:38.594 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 8 1 2024-04-18T14:44:39.581 INFO:teuthology.orchestra.run.smithi086.stderr:reweighted osd.8 to 1 (10000) 2024-04-18T14:44:39.606 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 8 1 2024-04-18T14:44:40.583 INFO:teuthology.orchestra.run.smithi086.stderr:set osd.8 primary-affinity to 1 (8655362) 2024-04-18T14:44:40.610 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 12 1 2024-04-18T14:44:41.600 INFO:teuthology.orchestra.run.smithi086.stderr:reweighted osd.12 to 1 (10000) 2024-04-18T14:44:41.623 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 12 1 2024-04-18T14:44:42.604 INFO:teuthology.orchestra.run.smithi086.stderr:set osd.12 primary-affinity to 1 (8655362) 2024-04-18T14:44:42.627 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 1 1 2024-04-18T14:44:43.620 INFO:teuthology.orchestra.run.smithi086.stderr:reweighted osd.1 to 1 (10000) 2024-04-18T14:44:43.642 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 1 1 2024-04-18T14:44:44.623 INFO:teuthology.orchestra.run.smithi086.stderr:set osd.1 primary-affinity to 1 (8655362) 2024-04-18T14:44:44.650 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 5 1 2024-04-18T14:44:45.636 INFO:teuthology.orchestra.run.smithi086.stderr:reweighted osd.5 to 1 (10000) 2024-04-18T14:44:45.664 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 5 1 2024-04-18T14:44:46.653 INFO:teuthology.orchestra.run.smithi086.stderr:set osd.5 primary-affinity to 1 (8655362) 2024-04-18T14:44:46.679 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 9 1 2024-04-18T14:44:47.657 INFO:teuthology.orchestra.run.smithi086.stderr:reweighted osd.9 to 1 (10000) 2024-04-18T14:44:47.682 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 9 1 2024-04-18T14:44:48.666 INFO:teuthology.orchestra.run.smithi086.stderr:set osd.9 primary-affinity to 1 (8655362) 2024-04-18T14:44:48.689 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 13 1 2024-04-18T14:44:49.677 INFO:teuthology.orchestra.run.smithi086.stderr:reweighted osd.13 to 1 (10000) 2024-04-18T14:44:49.702 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 13 1 2024-04-18T14:44:50.686 INFO:teuthology.orchestra.run.smithi086.stderr:set osd.13 primary-affinity to 1 (8655362) 2024-04-18T14:44:50.712 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 2 1 2024-04-18T14:44:51.702 INFO:teuthology.orchestra.run.smithi086.stderr:reweighted osd.2 to 1 (10000) 2024-04-18T14:44:51.724 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 2 1 2024-04-18T14:44:52.705 INFO:teuthology.orchestra.run.smithi086.stderr:set osd.2 primary-affinity to 1 (8655362) 2024-04-18T14:44:52.729 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 6 1 2024-04-18T14:44:53.715 INFO:teuthology.orchestra.run.smithi086.stderr:reweighted osd.6 to 1 (10000) 2024-04-18T14:44:53.738 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 6 1 2024-04-18T14:44:54.729 INFO:teuthology.orchestra.run.smithi086.stderr:set osd.6 primary-affinity to 1 (8655362) 2024-04-18T14:44:54.754 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 10 1 2024-04-18T14:44:55.732 INFO:teuthology.orchestra.run.smithi086.stderr:reweighted osd.10 to 1 (10000) 2024-04-18T14:44:55.756 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 10 1 2024-04-18T14:44:56.744 INFO:teuthology.orchestra.run.smithi086.stderr:set osd.10 primary-affinity to 1 (8655362) 2024-04-18T14:44:56.772 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 14 1 2024-04-18T14:44:57.760 INFO:teuthology.orchestra.run.smithi086.stderr:reweighted osd.14 to 1 (10000) 2024-04-18T14:44:57.782 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 14 1 2024-04-18T14:44:58.765 INFO:teuthology.orchestra.run.smithi086.stderr:set osd.14 primary-affinity to 1 (8655362) 2024-04-18T14:44:58.791 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 3 1 2024-04-18T14:44:59.784 INFO:teuthology.orchestra.run.smithi086.stderr:reweighted osd.3 to 1 (10000) 2024-04-18T14:44:59.812 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 3 1 2024-04-18T14:45:00.787 INFO:teuthology.orchestra.run.smithi086.stderr:set osd.3 primary-affinity to 1 (8655362) 2024-04-18T14:45:00.814 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 7 1 2024-04-18T14:45:01.807 INFO:teuthology.orchestra.run.smithi086.stderr:reweighted osd.7 to 1 (10000) 2024-04-18T14:45:01.832 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 7 1 2024-04-18T14:45:02.807 INFO:teuthology.orchestra.run.smithi086.stderr:set osd.7 primary-affinity to 1 (8655362) 2024-04-18T14:45:02.833 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 11 1 2024-04-18T14:45:03.819 INFO:teuthology.orchestra.run.smithi086.stderr:reweighted osd.11 to 1 (10000) 2024-04-18T14:45:03.842 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 11 1 2024-04-18T14:45:04.829 INFO:teuthology.orchestra.run.smithi086.stderr:set osd.11 primary-affinity to 1 (8655362) 2024-04-18T14:45:04.853 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 15 1 2024-04-18T14:45:05.840 INFO:teuthology.orchestra.run.smithi086.stderr:reweighted osd.15 to 1 (10000) 2024-04-18T14:45:05.864 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 15 1 2024-04-18T14:45:06.851 INFO:teuthology.orchestra.run.smithi086.stderr:set osd.15 primary-affinity to 1 (8655362) 2024-04-18T14:45:06.874 INFO:tasks.thrashosds.thrasher:joining the do_sighup greenlet 2024-04-18T14:45:06.874 INFO:tasks.thrashosds.thrasher:joining the do_optrack_toggle greenlet 2024-04-18T14:45:06.874 INFO:tasks.thrashosds.thrasher:joining the do_dump_ops greenlet 2024-04-18T14:45:06.874 INFO:tasks.thrashosds.thrasher:joining the do_noscrub_toggle greenlet 2024-04-18T14:45:06.874 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-04-18T14:45:06.874 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-18T14:45:07.173 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-04-18T14:45:07.173 INFO:teuthology.orchestra.run.smithi086.stdout:{"epoch":125,"fsid":"ac90c892-1809-401c-a743-76948b63c51a","created":"2024-04-18T14:43:04.477846+0000","modified":"2024-04-18T14:45:06.846602+0000","last_up_change":"2024-04-18T14:43:19.299757+0000","last_in_change":"2024-04-18T14:44:09.371862+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":16,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-18T14:43:17.412189+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":15.380000114440918,"score_stable":15.380000114440918,"optimal_score":0.12999999523162842,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-04-18T14:43:20.259109+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":3.9900000095367432,"score_stable":3.9900000095367432,"optimal_score":0.68999999761581421,"raw_score_acting":2.75,"raw_score_stable":2.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a2e10d33-3d09-4c39-aa08-15b3f6e81c8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":23,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6804","nonce":24964},{"type":"v1","addr":"172.21.15.86:6806","nonce":24964}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6809","nonce":24964},{"type":"v1","addr":"172.21.15.86:6812","nonce":24964}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6819","nonce":24964},{"type":"v1","addr":"172.21.15.86:6821","nonce":24964}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6814","nonce":24964},{"type":"v1","addr":"172.21.15.86:6817","nonce":24964}]},"public_addr":"172.21.15.86:6806/24964","cluster_addr":"172.21.15.86:6812/24964","heartbeat_back_addr":"172.21.15.86:6821/24964","heartbeat_front_addr":"172.21.15.86:6817/24964","state":["exists","up"]},{"osd":1,"uuid":"9a6146f9-1780-409a-a0a5-e411bc40d674","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6824","nonce":24895},{"type":"v1","addr":"172.21.15.96:6825","nonce":24895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6826","nonce":24895},{"type":"v1","addr":"172.21.15.96:6827","nonce":24895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6830","nonce":24895},{"type":"v1","addr":"172.21.15.96:6831","nonce":24895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6828","nonce":24895},{"type":"v1","addr":"172.21.15.96:6829","nonce":24895}]},"public_addr":"172.21.15.96:6825/24895","cluster_addr":"172.21.15.96:6827/24895","heartbeat_back_addr":"172.21.15.96:6831/24895","heartbeat_front_addr":"172.21.15.96:6829/24895","state":["exists","up"]},{"osd":2,"uuid":"9c040397-fc12-4375-b34c-b7f3b5c299ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6817","nonce":24902},{"type":"v1","addr":"172.21.15.119:6819","nonce":24902}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6821","nonce":24902},{"type":"v1","addr":"172.21.15.119:6823","nonce":24902}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6829","nonce":24902},{"type":"v1","addr":"172.21.15.119:6831","nonce":24902}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6825","nonce":24902},{"type":"v1","addr":"172.21.15.119:6827","nonce":24902}]},"public_addr":"172.21.15.119:6819/24902","cluster_addr":"172.21.15.119:6823/24902","heartbeat_back_addr":"172.21.15.119:6831/24902","heartbeat_front_addr":"172.21.15.119:6827/24902","state":["exists","up"]},{"osd":3,"uuid":"d6f346dc-57cc-4ad0-9db3-352ced49a170","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":23,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":25220},{"type":"v1","addr":"172.21.15.134:6810","nonce":25220}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6816","nonce":25220},{"type":"v1","addr":"172.21.15.134:6820","nonce":25220}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6828","nonce":25220},{"type":"v1","addr":"172.21.15.134:6831","nonce":25220}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6822","nonce":25220},{"type":"v1","addr":"172.21.15.134:6825","nonce":25220}]},"public_addr":"172.21.15.134:6810/25220","cluster_addr":"172.21.15.134:6820/25220","heartbeat_back_addr":"172.21.15.134:6831/25220","heartbeat_front_addr":"172.21.15.134:6825/25220","state":["exists","up"]},{"osd":4,"uuid":"b4a1348c-ca08-4588-8c5e-1b6338672f3f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6805","nonce":24962},{"type":"v1","addr":"172.21.15.86:6808","nonce":24962}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6811","nonce":24962},{"type":"v1","addr":"172.21.15.86:6815","nonce":24962}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6822","nonce":24962},{"type":"v1","addr":"172.21.15.86:6823","nonce":24962}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6818","nonce":24962},{"type":"v1","addr":"172.21.15.86:6820","nonce":24962}]},"public_addr":"172.21.15.86:6808/24962","cluster_addr":"172.21.15.86:6815/24962","heartbeat_back_addr":"172.21.15.86:6823/24962","heartbeat_front_addr":"172.21.15.86:6820/24962","state":["exists","up"]},{"osd":5,"uuid":"2685cc4b-3fea-483c-a6ce-c74feae525a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6813","nonce":24898},{"type":"v1","addr":"172.21.15.96:6815","nonce":24898}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6818","nonce":24898},{"type":"v1","addr":"172.21.15.96:6819","nonce":24898}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6822","nonce":24898},{"type":"v1","addr":"172.21.15.96:6823","nonce":24898}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6820","nonce":24898},{"type":"v1","addr":"172.21.15.96:6821","nonce":24898}]},"public_addr":"172.21.15.96:6815/24898","cluster_addr":"172.21.15.96:6819/24898","heartbeat_back_addr":"172.21.15.96:6823/24898","heartbeat_front_addr":"172.21.15.96:6821/24898","state":["exists","up"]},{"osd":6,"uuid":"a8dab92a-d416-4383-b35f-6ac033677638","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6816","nonce":24903},{"type":"v1","addr":"172.21.15.119:6818","nonce":24903}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6820","nonce":24903},{"type":"v1","addr":"172.21.15.119:6822","nonce":24903}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6828","nonce":24903},{"type":"v1","addr":"172.21.15.119:6830","nonce":24903}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6824","nonce":24903},{"type":"v1","addr":"172.21.15.119:6826","nonce":24903}]},"public_addr":"172.21.15.119:6818/24903","cluster_addr":"172.21.15.119:6822/24903","heartbeat_back_addr":"172.21.15.119:6830/24903","heartbeat_front_addr":"172.21.15.119:6826/24903","state":["exists","up"]},{"osd":7,"uuid":"17e98ed9-593e-46df-82fa-80e4a36e6bf0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":23,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6809","nonce":25221},{"type":"v1","addr":"172.21.15.134:6814","nonce":25221}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6819","nonce":25221},{"type":"v1","addr":"172.21.15.134:6823","nonce":25221}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6832","nonce":25221},{"type":"v1","addr":"172.21.15.134:6833","nonce":25221}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6826","nonce":25221},{"type":"v1","addr":"172.21.15.134:6830","nonce":25221}]},"public_addr":"172.21.15.134:6814/25221","cluster_addr":"172.21.15.134:6823/25221","heartbeat_back_addr":"172.21.15.134:6833/25221","heartbeat_front_addr":"172.21.15.134:6830/25221","state":["exists","up"]},{"osd":8,"uuid":"be2c6ad5-ae83-463b-a8da-b8705b8c9ecd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":23,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6824","nonce":24967},{"type":"v1","addr":"172.21.15.86:6825","nonce":24967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6826","nonce":24967},{"type":"v1","addr":"172.21.15.86:6827","nonce":24967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6830","nonce":24967},{"type":"v1","addr":"172.21.15.86:6831","nonce":24967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6828","nonce":24967},{"type":"v1","addr":"172.21.15.86:6829","nonce":24967}]},"public_addr":"172.21.15.86:6825/24967","cluster_addr":"172.21.15.86:6827/24967","heartbeat_back_addr":"172.21.15.86:6831/24967","heartbeat_front_addr":"172.21.15.86:6829/24967","state":["exists","up"]},{"osd":9,"uuid":"441c6b04-1540-46ea-b180-4b8fceda9c5e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6808","nonce":24896},{"type":"v1","addr":"172.21.15.96:6809","nonce":24896}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6810","nonce":24896},{"type":"v1","addr":"172.21.15.96:6811","nonce":24896}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6816","nonce":24896},{"type":"v1","addr":"172.21.15.96:6817","nonce":24896}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6812","nonce":24896},{"type":"v1","addr":"172.21.15.96:6814","nonce":24896}]},"public_addr":"172.21.15.96:6809/24896","cluster_addr":"172.21.15.96:6811/24896","heartbeat_back_addr":"172.21.15.96:6817/24896","heartbeat_front_addr":"172.21.15.96:6814/24896","state":["exists","up"]},{"osd":10,"uuid":"024a5dc2-0960-4540-89d5-7d40f5c4c2c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6800","nonce":24904},{"type":"v1","addr":"172.21.15.119:6801","nonce":24904}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6802","nonce":24904},{"type":"v1","addr":"172.21.15.119:6803","nonce":24904}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6806","nonce":24904},{"type":"v1","addr":"172.21.15.119:6807","nonce":24904}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6804","nonce":24904},{"type":"v1","addr":"172.21.15.119:6805","nonce":24904}]},"public_addr":"172.21.15.119:6801/24904","cluster_addr":"172.21.15.119:6803/24904","heartbeat_back_addr":"172.21.15.119:6807/24904","heartbeat_front_addr":"172.21.15.119:6805/24904","state":["exists","up"]},{"osd":11,"uuid":"b46de3d2-dc85-4a95-b7d9-9bcdc0cbf035","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":25222},{"type":"v1","addr":"172.21.15.134:6803","nonce":25222}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":25222},{"type":"v1","addr":"172.21.15.134:6805","nonce":25222}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6813","nonce":25222},{"type":"v1","addr":"172.21.15.134:6817","nonce":25222}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6807","nonce":25222},{"type":"v1","addr":"172.21.15.134:6811","nonce":25222}]},"public_addr":"172.21.15.134:6803/25222","cluster_addr":"172.21.15.134:6805/25222","heartbeat_back_addr":"172.21.15.134:6817/25222","heartbeat_front_addr":"172.21.15.134:6811/25222","state":["exists","up"]},{"osd":12,"uuid":"29a50ae9-9c89-459b-b1de-a7f57905a6ca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6800","nonce":24965},{"type":"v1","addr":"172.21.15.86:6801","nonce":24965}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6802","nonce":24965},{"type":"v1","addr":"172.21.15.86:6803","nonce":24965}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6813","nonce":24965},{"type":"v1","addr":"172.21.15.86:6816","nonce":24965}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6807","nonce":24965},{"type":"v1","addr":"172.21.15.86:6810","nonce":24965}]},"public_addr":"172.21.15.86:6801/24965","cluster_addr":"172.21.15.86:6803/24965","heartbeat_back_addr":"172.21.15.86:6816/24965","heartbeat_front_addr":"172.21.15.86:6810/24965","state":["exists","up"]},{"osd":13,"uuid":"4afcbb15-5c72-4b5f-bbd1-bddeba50b262","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6800","nonce":24897},{"type":"v1","addr":"172.21.15.96:6801","nonce":24897}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6802","nonce":24897},{"type":"v1","addr":"172.21.15.96:6803","nonce":24897}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6806","nonce":24897},{"type":"v1","addr":"172.21.15.96:6807","nonce":24897}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6804","nonce":24897},{"type":"v1","addr":"172.21.15.96:6805","nonce":24897}]},"public_addr":"172.21.15.96:6801/24897","cluster_addr":"172.21.15.96:6803/24897","heartbeat_back_addr":"172.21.15.96:6807/24897","heartbeat_front_addr":"172.21.15.96:6805/24897","state":["exists","up"]},{"osd":14,"uuid":"d713adf7-4bce-443c-873c-3226cd6e5a50","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":117,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6808","nonce":24905},{"type":"v1","addr":"172.21.15.119:6809","nonce":24905}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6810","nonce":24905},{"type":"v1","addr":"172.21.15.119:6811","nonce":24905}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6814","nonce":24905},{"type":"v1","addr":"172.21.15.119:6815","nonce":24905}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6812","nonce":24905},{"type":"v1","addr":"172.21.15.119:6813","nonce":24905}]},"public_addr":"172.21.15.119:6809/24905","cluster_addr":"172.21.15.119:6811/24905","heartbeat_back_addr":"172.21.15.119:6815/24905","heartbeat_front_addr":"172.21.15.119:6813/24905","state":["exists","up"]},{"osd":15,"uuid":"abfd15ca-bea7-4ed9-890d-c9d4add42879","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":23,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6808","nonce":25223},{"type":"v1","addr":"172.21.15.134:6812","nonce":25223}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6815","nonce":25223},{"type":"v1","addr":"172.21.15.134:6818","nonce":25223}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6827","nonce":25223},{"type":"v1","addr":"172.21.15.134:6829","nonce":25223}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6821","nonce":25223},{"type":"v1","addr":"172.21.15.134:6824","nonce":25223}]},"public_addr":"172.21.15.134:6812/25223","cluster_addr":"172.21.15.134:6818/25223","heartbeat_back_addr":"172.21.15.134:6829/25223","heartbeat_front_addr":"172.21.15.134:6824/25223","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T14:44:24.729842+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T14:44:46.394899+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T14:44:16.473504+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T14:44:44.146495+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T14:44:20.295466+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T14:44:38.668015+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T14:44:30.387548+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T14:44:34.701085+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T14:44:32.965730+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T14:44:39.252049+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T14:44:33.304425+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T14:44:23.484251+0000","dead_epoch":0},{"osd":12,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T14:44:19.461153+0000","dead_epoch":0},{"osd":13,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T14:44:22.805253+0000","dead_epoch":0},{"osd":14,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T14:44:42.332316+0000","dead_epoch":0},{"osd":15,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T14:44:36.344995+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"},"shecprofile":{"c":"2","crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","k":"4","m":"3","name":"shecprofile","plugin":"shec","technique":"multiple"}},"removed_snaps_queue":[{"pool":3,"snaps":[{"begin":39,"length":1}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-18T14:45:07.193 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-04-18T14:45:07.193 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-18T14:45:07.489 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-04-18T14:45:07.490 INFO:teuthology.orchestra.run.smithi086.stdout:{"epoch":125,"fsid":"ac90c892-1809-401c-a743-76948b63c51a","created":"2024-04-18T14:43:04.477846+0000","modified":"2024-04-18T14:45:06.846602+0000","last_up_change":"2024-04-18T14:43:19.299757+0000","last_in_change":"2024-04-18T14:44:09.371862+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":16,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-18T14:43:17.412189+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":15.380000114440918,"score_stable":15.380000114440918,"optimal_score":0.12999999523162842,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-04-18T14:43:20.259109+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":3.9900000095367432,"score_stable":3.9900000095367432,"optimal_score":0.68999999761581421,"raw_score_acting":2.75,"raw_score_stable":2.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a2e10d33-3d09-4c39-aa08-15b3f6e81c8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":23,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6804","nonce":24964},{"type":"v1","addr":"172.21.15.86:6806","nonce":24964}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6809","nonce":24964},{"type":"v1","addr":"172.21.15.86:6812","nonce":24964}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6819","nonce":24964},{"type":"v1","addr":"172.21.15.86:6821","nonce":24964}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6814","nonce":24964},{"type":"v1","addr":"172.21.15.86:6817","nonce":24964}]},"public_addr":"172.21.15.86:6806/24964","cluster_addr":"172.21.15.86:6812/24964","heartbeat_back_addr":"172.21.15.86:6821/24964","heartbeat_front_addr":"172.21.15.86:6817/24964","state":["exists","up"]},{"osd":1,"uuid":"9a6146f9-1780-409a-a0a5-e411bc40d674","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6824","nonce":24895},{"type":"v1","addr":"172.21.15.96:6825","nonce":24895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6826","nonce":24895},{"type":"v1","addr":"172.21.15.96:6827","nonce":24895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6830","nonce":24895},{"type":"v1","addr":"172.21.15.96:6831","nonce":24895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6828","nonce":24895},{"type":"v1","addr":"172.21.15.96:6829","nonce":24895}]},"public_addr":"172.21.15.96:6825/24895","cluster_addr":"172.21.15.96:6827/24895","heartbeat_back_addr":"172.21.15.96:6831/24895","heartbeat_front_addr":"172.21.15.96:6829/24895","state":["exists","up"]},{"osd":2,"uuid":"9c040397-fc12-4375-b34c-b7f3b5c299ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6817","nonce":24902},{"type":"v1","addr":"172.21.15.119:6819","nonce":24902}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6821","nonce":24902},{"type":"v1","addr":"172.21.15.119:6823","nonce":24902}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6829","nonce":24902},{"type":"v1","addr":"172.21.15.119:6831","nonce":24902}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6825","nonce":24902},{"type":"v1","addr":"172.21.15.119:6827","nonce":24902}]},"public_addr":"172.21.15.119:6819/24902","cluster_addr":"172.21.15.119:6823/24902","heartbeat_back_addr":"172.21.15.119:6831/24902","heartbeat_front_addr":"172.21.15.119:6827/24902","state":["exists","up"]},{"osd":3,"uuid":"d6f346dc-57cc-4ad0-9db3-352ced49a170","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":23,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":25220},{"type":"v1","addr":"172.21.15.134:6810","nonce":25220}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6816","nonce":25220},{"type":"v1","addr":"172.21.15.134:6820","nonce":25220}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6828","nonce":25220},{"type":"v1","addr":"172.21.15.134:6831","nonce":25220}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6822","nonce":25220},{"type":"v1","addr":"172.21.15.134:6825","nonce":25220}]},"public_addr":"172.21.15.134:6810/25220","cluster_addr":"172.21.15.134:6820/25220","heartbeat_back_addr":"172.21.15.134:6831/25220","heartbeat_front_addr":"172.21.15.134:6825/25220","state":["exists","up"]},{"osd":4,"uuid":"b4a1348c-ca08-4588-8c5e-1b6338672f3f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6805","nonce":24962},{"type":"v1","addr":"172.21.15.86:6808","nonce":24962}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6811","nonce":24962},{"type":"v1","addr":"172.21.15.86:6815","nonce":24962}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6822","nonce":24962},{"type":"v1","addr":"172.21.15.86:6823","nonce":24962}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6818","nonce":24962},{"type":"v1","addr":"172.21.15.86:6820","nonce":24962}]},"public_addr":"172.21.15.86:6808/24962","cluster_addr":"172.21.15.86:6815/24962","heartbeat_back_addr":"172.21.15.86:6823/24962","heartbeat_front_addr":"172.21.15.86:6820/24962","state":["exists","up"]},{"osd":5,"uuid":"2685cc4b-3fea-483c-a6ce-c74feae525a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6813","nonce":24898},{"type":"v1","addr":"172.21.15.96:6815","nonce":24898}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6818","nonce":24898},{"type":"v1","addr":"172.21.15.96:6819","nonce":24898}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6822","nonce":24898},{"type":"v1","addr":"172.21.15.96:6823","nonce":24898}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6820","nonce":24898},{"type":"v1","addr":"172.21.15.96:6821","nonce":24898}]},"public_addr":"172.21.15.96:6815/24898","cluster_addr":"172.21.15.96:6819/24898","heartbeat_back_addr":"172.21.15.96:6823/24898","heartbeat_front_addr":"172.21.15.96:6821/24898","state":["exists","up"]},{"osd":6,"uuid":"a8dab92a-d416-4383-b35f-6ac033677638","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6816","nonce":24903},{"type":"v1","addr":"172.21.15.119:6818","nonce":24903}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6820","nonce":24903},{"type":"v1","addr":"172.21.15.119:6822","nonce":24903}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6828","nonce":24903},{"type":"v1","addr":"172.21.15.119:6830","nonce":24903}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6824","nonce":24903},{"type":"v1","addr":"172.21.15.119:6826","nonce":24903}]},"public_addr":"172.21.15.119:6818/24903","cluster_addr":"172.21.15.119:6822/24903","heartbeat_back_addr":"172.21.15.119:6830/24903","heartbeat_front_addr":"172.21.15.119:6826/24903","state":["exists","up"]},{"osd":7,"uuid":"17e98ed9-593e-46df-82fa-80e4a36e6bf0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":23,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6809","nonce":25221},{"type":"v1","addr":"172.21.15.134:6814","nonce":25221}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6819","nonce":25221},{"type":"v1","addr":"172.21.15.134:6823","nonce":25221}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6832","nonce":25221},{"type":"v1","addr":"172.21.15.134:6833","nonce":25221}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6826","nonce":25221},{"type":"v1","addr":"172.21.15.134:6830","nonce":25221}]},"public_addr":"172.21.15.134:6814/25221","cluster_addr":"172.21.15.134:6823/25221","heartbeat_back_addr":"172.21.15.134:6833/25221","heartbeat_front_addr":"172.21.15.134:6830/25221","state":["exists","up"]},{"osd":8,"uuid":"be2c6ad5-ae83-463b-a8da-b8705b8c9ecd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":23,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6824","nonce":24967},{"type":"v1","addr":"172.21.15.86:6825","nonce":24967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6826","nonce":24967},{"type":"v1","addr":"172.21.15.86:6827","nonce":24967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6830","nonce":24967},{"type":"v1","addr":"172.21.15.86:6831","nonce":24967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6828","nonce":24967},{"type":"v1","addr":"172.21.15.86:6829","nonce":24967}]},"public_addr":"172.21.15.86:6825/24967","cluster_addr":"172.21.15.86:6827/24967","heartbeat_back_addr":"172.21.15.86:6831/24967","heartbeat_front_addr":"172.21.15.86:6829/24967","state":["exists","up"]},{"osd":9,"uuid":"441c6b04-1540-46ea-b180-4b8fceda9c5e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6808","nonce":24896},{"type":"v1","addr":"172.21.15.96:6809","nonce":24896}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6810","nonce":24896},{"type":"v1","addr":"172.21.15.96:6811","nonce":24896}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6816","nonce":24896},{"type":"v1","addr":"172.21.15.96:6817","nonce":24896}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6812","nonce":24896},{"type":"v1","addr":"172.21.15.96:6814","nonce":24896}]},"public_addr":"172.21.15.96:6809/24896","cluster_addr":"172.21.15.96:6811/24896","heartbeat_back_addr":"172.21.15.96:6817/24896","heartbeat_front_addr":"172.21.15.96:6814/24896","state":["exists","up"]},{"osd":10,"uuid":"024a5dc2-0960-4540-89d5-7d40f5c4c2c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6800","nonce":24904},{"type":"v1","addr":"172.21.15.119:6801","nonce":24904}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6802","nonce":24904},{"type":"v1","addr":"172.21.15.119:6803","nonce":24904}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6806","nonce":24904},{"type":"v1","addr":"172.21.15.119:6807","nonce":24904}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6804","nonce":24904},{"type":"v1","addr":"172.21.15.119:6805","nonce":24904}]},"public_addr":"172.21.15.119:6801/24904","cluster_addr":"172.21.15.119:6803/24904","heartbeat_back_addr":"172.21.15.119:6807/24904","heartbeat_front_addr":"172.21.15.119:6805/24904","state":["exists","up"]},{"osd":11,"uuid":"b46de3d2-dc85-4a95-b7d9-9bcdc0cbf035","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":25222},{"type":"v1","addr":"172.21.15.134:6803","nonce":25222}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":25222},{"type":"v1","addr":"172.21.15.134:6805","nonce":25222}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6813","nonce":25222},{"type":"v1","addr":"172.21.15.134:6817","nonce":25222}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6807","nonce":25222},{"type":"v1","addr":"172.21.15.134:6811","nonce":25222}]},"public_addr":"172.21.15.134:6803/25222","cluster_addr":"172.21.15.134:6805/25222","heartbeat_back_addr":"172.21.15.134:6817/25222","heartbeat_front_addr":"172.21.15.134:6811/25222","state":["exists","up"]},{"osd":12,"uuid":"29a50ae9-9c89-459b-b1de-a7f57905a6ca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6800","nonce":24965},{"type":"v1","addr":"172.21.15.86:6801","nonce":24965}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6802","nonce":24965},{"type":"v1","addr":"172.21.15.86:6803","nonce":24965}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6813","nonce":24965},{"type":"v1","addr":"172.21.15.86:6816","nonce":24965}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6807","nonce":24965},{"type":"v1","addr":"172.21.15.86:6810","nonce":24965}]},"public_addr":"172.21.15.86:6801/24965","cluster_addr":"172.21.15.86:6803/24965","heartbeat_back_addr":"172.21.15.86:6816/24965","heartbeat_front_addr":"172.21.15.86:6810/24965","state":["exists","up"]},{"osd":13,"uuid":"4afcbb15-5c72-4b5f-bbd1-bddeba50b262","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6800","nonce":24897},{"type":"v1","addr":"172.21.15.96:6801","nonce":24897}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6802","nonce":24897},{"type":"v1","addr":"172.21.15.96:6803","nonce":24897}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6806","nonce":24897},{"type":"v1","addr":"172.21.15.96:6807","nonce":24897}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6804","nonce":24897},{"type":"v1","addr":"172.21.15.96:6805","nonce":24897}]},"public_addr":"172.21.15.96:6801/24897","cluster_addr":"172.21.15.96:6803/24897","heartbeat_back_addr":"172.21.15.96:6807/24897","heartbeat_front_addr":"172.21.15.96:6805/24897","state":["exists","up"]},{"osd":14,"uuid":"d713adf7-4bce-443c-873c-3226cd6e5a50","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":117,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6808","nonce":24905},{"type":"v1","addr":"172.21.15.119:6809","nonce":24905}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6810","nonce":24905},{"type":"v1","addr":"172.21.15.119:6811","nonce":24905}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6814","nonce":24905},{"type":"v1","addr":"172.21.15.119:6815","nonce":24905}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6812","nonce":24905},{"type":"v1","addr":"172.21.15.119:6813","nonce":24905}]},"public_addr":"172.21.15.119:6809/24905","cluster_addr":"172.21.15.119:6811/24905","heartbeat_back_addr":"172.21.15.119:6815/24905","heartbeat_front_addr":"172.21.15.119:6813/24905","state":["exists","up"]},{"osd":15,"uuid":"abfd15ca-bea7-4ed9-890d-c9d4add42879","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":23,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6808","nonce":25223},{"type":"v1","addr":"172.21.15.134:6812","nonce":25223}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6815","nonce":25223},{"type":"v1","addr":"172.21.15.134:6818","nonce":25223}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6827","nonce":25223},{"type":"v1","addr":"172.21.15.134:6829","nonce":25223}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6821","nonce":25223},{"type":"v1","addr":"172.21.15.134:6824","nonce":25223}]},"public_addr":"172.21.15.134:6812/25223","cluster_addr":"172.21.15.134:6818/25223","heartbeat_back_addr":"172.21.15.134:6829/25223","heartbeat_front_addr":"172.21.15.134:6824/25223","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T14:44:24.729842+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T14:44:46.394899+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T14:44:16.473504+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T14:44:44.146495+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T14:44:20.295466+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T14:44:38.668015+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T14:44:30.387548+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T14:44:34.701085+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T14:44:32.965730+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T14:44:39.252049+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T14:44:33.304425+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T14:44:23.484251+0000","dead_epoch":0},{"osd":12,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T14:44:19.461153+0000","dead_epoch":0},{"osd":13,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T14:44:22.805253+0000","dead_epoch":0},{"osd":14,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T14:44:42.332316+0000","dead_epoch":0},{"osd":15,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T14:44:36.344995+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"},"shecprofile":{"c":"2","crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","k":"4","m":"3","name":"shecprofile","plugin":"shec","technique":"multiple"}},"removed_snaps_queue":[{"pool":3,"snaps":[{"begin":39,"length":1}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-18T14:45:07.509 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-04-18T14:45:07.509 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-04-18T14:45:07.510 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-04-18T14:45:07.510 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-04-18T14:45:07.510 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2024-04-18T14:45:07.511 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2024-04-18T14:45:07.511 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2024-04-18T14:45:07.512 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2024-04-18T14:45:07.512 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.8 flush_pg_stats 2024-04-18T14:45:07.512 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.9 flush_pg_stats 2024-04-18T14:45:07.513 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.10 flush_pg_stats 2024-04-18T14:45:07.513 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.11 flush_pg_stats 2024-04-18T14:45:07.514 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.12 flush_pg_stats 2024-04-18T14:45:07.514 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.13 flush_pg_stats 2024-04-18T14:45:07.514 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.14 flush_pg_stats 2024-04-18T14:45:07.515 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.15 flush_pg_stats 2024-04-18T14:45:07.963 INFO:teuthology.orchestra.run.smithi086.stdout:94489280537 2024-04-18T14:45:07.964 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-04-18T14:45:07.972 INFO:teuthology.orchestra.run.smithi086.stdout:103079215130 2024-04-18T14:45:07.973 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.9 2024-04-18T14:45:07.973 INFO:teuthology.orchestra.run.smithi086.stdout:94489280538 2024-04-18T14:45:07.974 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-04-18T14:45:07.997 INFO:teuthology.orchestra.run.smithi086.stdout:94489280537 2024-04-18T14:45:07.998 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-04-18T14:45:08.004 INFO:teuthology.orchestra.run.smithi086.stdout:103079215131 2024-04-18T14:45:08.004 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-04-18T14:45:08.013 INFO:teuthology.orchestra.run.smithi086.stdout:94489280538 2024-04-18T14:45:08.013 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.12 2024-04-18T14:45:08.015 INFO:teuthology.orchestra.run.smithi086.stdout:98784247835 2024-04-18T14:45:08.015 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-04-18T14:45:08.016 INFO:teuthology.orchestra.run.smithi086.stdout:98784247835 2024-04-18T14:45:08.017 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.15 2024-04-18T14:45:08.018 INFO:teuthology.orchestra.run.smithi086.stdout:103079215129 2024-04-18T14:45:08.019 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.13 2024-04-18T14:45:08.027 INFO:teuthology.orchestra.run.smithi086.stdout:94489280538 2024-04-18T14:45:08.028 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.11 2024-04-18T14:45:08.039 INFO:teuthology.orchestra.run.smithi086.stdout:103079215131 2024-04-18T14:45:08.039 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-04-18T14:45:08.040 INFO:teuthology.orchestra.run.smithi086.stdout:90194313243 2024-04-18T14:45:08.040 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.14 2024-04-18T14:45:08.045 INFO:teuthology.orchestra.run.smithi086.stdout:98784247834 2024-04-18T14:45:08.046 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-04-18T14:45:08.054 INFO:teuthology.orchestra.run.smithi086.stdout:94489280538 2024-04-18T14:45:08.054 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.10 2024-04-18T14:45:08.109 INFO:teuthology.orchestra.run.smithi086.stdout:98784247833 2024-04-18T14:45:08.109 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-04-18T14:45:08.112 INFO:teuthology.orchestra.run.smithi086.stdout:98784247835 2024-04-18T14:45:08.113 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.8 2024-04-18T14:45:08.890 INFO:teuthology.orchestra.run.smithi086.stdout:94489280536 2024-04-18T14:45:08.951 INFO:tasks.ceph.ceph_manager.ceph:need seq 94489280537 got 94489280536 for osd.6 2024-04-18T14:45:08.966 INFO:teuthology.orchestra.run.smithi086.stdout:103079215130 2024-04-18T14:45:08.973 INFO:teuthology.orchestra.run.smithi086.stdout:94489280537 2024-04-18T14:45:08.982 INFO:teuthology.orchestra.run.smithi086.stdout:90194313242 2024-04-18T14:45:09.027 INFO:tasks.ceph.ceph_manager.ceph:need seq 94489280538 got 94489280537 for osd.12 2024-04-18T14:45:09.028 INFO:tasks.ceph.ceph_manager.ceph:need seq 103079215131 got 103079215130 for osd.5 2024-04-18T14:45:09.041 INFO:tasks.ceph.ceph_manager.ceph:need seq 90194313243 got 90194313242 for osd.14 2024-04-18T14:45:09.043 INFO:teuthology.orchestra.run.smithi086.stdout:94489280536 2024-04-18T14:45:09.058 INFO:teuthology.orchestra.run.smithi086.stdout:98784247833 2024-04-18T14:45:09.068 INFO:teuthology.orchestra.run.smithi086.stdout:98784247834 2024-04-18T14:45:09.076 INFO:tasks.ceph.ceph_manager.ceph:need seq 94489280537 got 94489280536 for osd.4 2024-04-18T14:45:09.081 INFO:teuthology.orchestra.run.smithi086.stdout:94489280537 2024-04-18T14:45:09.085 INFO:teuthology.orchestra.run.smithi086.stdout:98784247834 2024-04-18T14:45:09.092 INFO:teuthology.orchestra.run.smithi086.stdout:94489280537 2024-04-18T14:45:09.092 INFO:teuthology.orchestra.run.smithi086.stdout:103079215130 2024-04-18T14:45:09.096 INFO:teuthology.orchestra.run.smithi086.stdout:103079215129 2024-04-18T14:45:09.106 INFO:tasks.ceph.ceph_manager.ceph:need seq 98784247835 got 98784247834 for osd.15 2024-04-18T14:45:09.112 INFO:tasks.ceph.ceph_manager.ceph:need seq 98784247834 got 98784247833 for osd.0 2024-04-18T14:45:09.114 INFO:teuthology.orchestra.run.smithi086.stdout:94489280537 2024-04-18T14:45:09.114 INFO:teuthology.orchestra.run.smithi086.stdout:103079215128 2024-04-18T14:45:09.116 INFO:tasks.ceph.ceph_manager.ceph:need seq 94489280538 got 94489280537 for osd.2 2024-04-18T14:45:09.123 INFO:teuthology.orchestra.run.smithi086.stdout:98784247832 2024-04-18T14:45:09.133 INFO:tasks.ceph.ceph_manager.ceph:need seq 98784247835 got 98784247834 for osd.7 2024-04-18T14:45:09.140 INFO:tasks.ceph.ceph_manager.ceph:need seq 103079215131 got 103079215130 for osd.1 2024-04-18T14:45:09.143 INFO:tasks.ceph.ceph_manager.ceph:need seq 94489280538 got 94489280537 for osd.10 2024-04-18T14:45:09.144 INFO:teuthology.orchestra.run.smithi086.stdout:98784247834 2024-04-18T14:45:09.150 INFO:tasks.ceph.ceph_manager.ceph:need seq 103079215129 got 103079215128 for osd.13 2024-04-18T14:45:09.151 INFO:tasks.ceph.ceph_manager.ceph:need seq 94489280538 got 94489280537 for osd.11 2024-04-18T14:45:09.155 INFO:tasks.ceph.ceph_manager.ceph:need seq 103079215130 got 103079215129 for osd.9 2024-04-18T14:45:09.156 INFO:tasks.ceph.ceph_manager.ceph:need seq 98784247833 got 98784247832 for osd.3 2024-04-18T14:45:09.165 INFO:tasks.ceph.ceph_manager.ceph:need seq 98784247835 got 98784247834 for osd.8 2024-04-18T14:45:09.952 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-04-18T14:45:10.028 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.12 2024-04-18T14:45:10.029 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-04-18T14:45:10.042 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.14 2024-04-18T14:45:10.077 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-04-18T14:45:10.107 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.15 2024-04-18T14:45:10.112 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-04-18T14:45:10.117 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-04-18T14:45:10.133 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-04-18T14:45:10.140 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-04-18T14:45:10.144 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.10 2024-04-18T14:45:10.151 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.13 2024-04-18T14:45:10.152 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.11 2024-04-18T14:45:10.156 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.9 2024-04-18T14:45:10.156 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-04-18T14:45:10.166 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.8 2024-04-18T14:45:10.557 INFO:teuthology.orchestra.run.smithi086.stdout:94489280538 2024-04-18T14:45:10.621 INFO:tasks.ceph.ceph_manager.ceph:need seq 94489280537 got 94489280538 for osd.6 2024-04-18T14:45:10.621 DEBUG:teuthology.parallel:result is None 2024-04-18T14:45:10.727 INFO:teuthology.orchestra.run.smithi086.stdout:94489280539 2024-04-18T14:45:10.793 INFO:tasks.ceph.ceph_manager.ceph:need seq 94489280538 got 94489280539 for osd.12 2024-04-18T14:45:10.793 DEBUG:teuthology.parallel:result is None 2024-04-18T14:45:10.859 INFO:teuthology.orchestra.run.smithi086.stdout:98784247835 2024-04-18T14:45:10.865 INFO:teuthology.orchestra.run.smithi086.stdout:98784247836 2024-04-18T14:45:10.895 INFO:tasks.ceph.ceph_manager.ceph:need seq 98784247834 got 98784247835 for osd.0 2024-04-18T14:45:10.896 DEBUG:teuthology.parallel:result is None 2024-04-18T14:45:10.905 INFO:teuthology.orchestra.run.smithi086.stdout:90194313243 2024-04-18T14:45:10.931 INFO:tasks.ceph.ceph_manager.ceph:need seq 98784247835 got 98784247836 for osd.15 2024-04-18T14:45:10.931 DEBUG:teuthology.parallel:result is None 2024-04-18T14:45:10.962 INFO:teuthology.orchestra.run.smithi086.stdout:103079215130 2024-04-18T14:45:10.963 INFO:tasks.ceph.ceph_manager.ceph:need seq 90194313243 got 90194313243 for osd.14 2024-04-18T14:45:10.963 DEBUG:teuthology.parallel:result is None 2024-04-18T14:45:11.003 INFO:tasks.ceph.ceph_manager.ceph:need seq 103079215130 got 103079215130 for osd.9 2024-04-18T14:45:11.003 DEBUG:teuthology.parallel:result is None 2024-04-18T14:45:11.022 INFO:teuthology.orchestra.run.smithi086.stdout:103079215131 2024-04-18T14:45:11.054 INFO:teuthology.orchestra.run.smithi086.stdout:94489280539 2024-04-18T14:45:11.059 INFO:teuthology.orchestra.run.smithi086.stdout:94489280538 2024-04-18T14:45:11.061 INFO:tasks.ceph.ceph_manager.ceph:need seq 103079215131 got 103079215131 for osd.5 2024-04-18T14:45:11.061 INFO:teuthology.orchestra.run.smithi086.stdout:98784247834 2024-04-18T14:45:11.061 DEBUG:teuthology.parallel:result is None 2024-04-18T14:45:11.064 INFO:teuthology.orchestra.run.smithi086.stdout:94489280539 2024-04-18T14:45:11.092 INFO:tasks.ceph.ceph_manager.ceph:need seq 94489280538 got 94489280539 for osd.10 2024-04-18T14:45:11.092 DEBUG:teuthology.parallel:result is None 2024-04-18T14:45:11.093 INFO:tasks.ceph.ceph_manager.ceph:need seq 98784247833 got 98784247834 for osd.3 2024-04-18T14:45:11.093 DEBUG:teuthology.parallel:result is None 2024-04-18T14:45:11.103 INFO:tasks.ceph.ceph_manager.ceph:need seq 94489280538 got 94489280539 for osd.2 2024-04-18T14:45:11.103 DEBUG:teuthology.parallel:result is None 2024-04-18T14:45:11.105 INFO:teuthology.orchestra.run.smithi086.stdout:98784247836 2024-04-18T14:45:11.108 INFO:tasks.ceph.ceph_manager.ceph:need seq 94489280537 got 94489280538 for osd.4 2024-04-18T14:45:11.108 DEBUG:teuthology.parallel:result is None 2024-04-18T14:45:11.129 INFO:tasks.ceph.ceph_manager.ceph:need seq 98784247835 got 98784247836 for osd.7 2024-04-18T14:45:11.129 DEBUG:teuthology.parallel:result is None 2024-04-18T14:45:11.130 INFO:teuthology.orchestra.run.smithi086.stdout:103079215129 2024-04-18T14:45:11.130 INFO:teuthology.orchestra.run.smithi086.stdout:98784247836 2024-04-18T14:45:11.148 INFO:teuthology.orchestra.run.smithi086.stdout:103079215131 2024-04-18T14:45:11.150 INFO:tasks.ceph.ceph_manager.ceph:need seq 98784247835 got 98784247836 for osd.8 2024-04-18T14:45:11.150 DEBUG:teuthology.parallel:result is None 2024-04-18T14:45:11.151 INFO:tasks.ceph.ceph_manager.ceph:need seq 103079215129 got 103079215129 for osd.13 2024-04-18T14:45:11.151 DEBUG:teuthology.parallel:result is None 2024-04-18T14:45:11.162 INFO:teuthology.orchestra.run.smithi086.stdout:94489280539 2024-04-18T14:45:11.165 INFO:tasks.ceph.ceph_manager.ceph:need seq 103079215131 got 103079215131 for osd.1 2024-04-18T14:45:11.165 DEBUG:teuthology.parallel:result is None 2024-04-18T14:45:11.179 INFO:tasks.ceph.ceph_manager.ceph:need seq 94489280538 got 94489280539 for osd.11 2024-04-18T14:45:11.179 DEBUG:teuthology.parallel:result is None 2024-04-18T14:45:11.179 INFO:tasks.ceph.ceph_manager.ceph:waiting for recovery to complete 2024-04-18T14:45:11.180 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-18T14:45:11.513 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-04-18T14:45:11.514 INFO:teuthology.orchestra.run.smithi086.stderr:dumped all 2024-04-18T14:45:11.530 INFO:teuthology.orchestra.run.smithi086.stdout:{"pg_ready":true,"pg_map":{"version":171,"stamp":"2024-04-18T14:45:11.370991+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":16,"num_per_pool_osds":16,"num_per_pool_omap_osds":11,"kb":1509949440,"kb_used":560224,"kb_used_data":30316,"kb_used_omap":24,"kb_used_meta":529639,"kb_avail":1509389216,"statfs":{"total":1546188226560,"available":1545614557184,"internally_reserved":0,"allocated":31043584,"data_stored":18422684,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":25506,"internal_metadata":542350430},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.538435"},"pg_stats":[{"pgid":"1.0","version":"26'157","reported_seq":308,"reported_epoch":124,"state":"active+clean","last_fresh":"2024-04-18T14:45:07.185100+0000","last_change":"2024-04-18T14:44:37.152954+0000","last_active":"2024-04-18T14:45:07.185100+0000","last_peered":"2024-04-18T14:45:07.185100+0000","last_clean":"2024-04-18T14:45:07.185100+0000","last_became_active":"2024-04-18T14:43:20.323133+0000","last_became_peered":"2024-04-18T14:43:20.323133+0000","last_unstale":"2024-04-18T14:45:07.185100+0000","last_undegraded":"2024-04-18T14:45:07.185100+0000","last_fullsized":"2024-04-18T14:45:07.185100+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'157","last_scrub_stamp":"2024-04-18T14:44:37.152696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T14:43:18.296821+0000","last_clean_scrub_stamp":"2024-04-18T14:44:37.152696+0000","objects_scrubbed":2,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T14:45:43.293239+0000","scrub_duration":0.0049794150000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[13,0],"acting":[13,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":13,"acting_primary":13,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":114,"reported_epoch":124,"state":"active+clean","last_fresh":"2024-04-18T14:45:05.843355+0000","last_change":"2024-04-18T14:44:23.449444+0000","last_active":"2024-04-18T14:45:05.843355+0000","last_peered":"2024-04-18T14:45:05.843355+0000","last_clean":"2024-04-18T14:45:05.843355+0000","last_became_active":"2024-04-18T14:43:21.327764+0000","last_became_peered":"2024-04-18T14:43:21.327764+0000","last_unstale":"2024-04-18T14:45:05.843355+0000","last_undegraded":"2024-04-18T14:45:05.843355+0000","last_fullsized":"2024-04-18T14:45:05.843355+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T14:44:23.449241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T14:43:20.303322+0000","last_clean_scrub_stamp":"2024-04-18T14:44:23.449241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T14:45:36.175611+0000","scrub_duration":0.0029048670000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,15],"acting":[5,15],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":111,"reported_epoch":124,"state":"active+clean","last_fresh":"2024-04-18T14:45:05.845686+0000","last_change":"2024-04-18T14:44:37.374487+0000","last_active":"2024-04-18T14:45:05.845686+0000","last_peered":"2024-04-18T14:45:05.845686+0000","last_clean":"2024-04-18T14:45:05.845686+0000","last_became_active":"2024-04-18T14:43:21.414060+0000","last_became_peered":"2024-04-18T14:43:21.414060+0000","last_unstale":"2024-04-18T14:45:05.845686+0000","last_undegraded":"2024-04-18T14:45:05.845686+0000","last_fullsized":"2024-04-18T14:45:05.845686+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T14:44:37.374221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T14:43:20.303322+0000","last_clean_scrub_stamp":"2024-04-18T14:44:37.374221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T14:45:58.651147+0000","scrub_duration":0.0042134670000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":111,"reported_epoch":124,"state":"active+clean","last_fresh":"2024-04-18T14:45:07.185035+0000","last_change":"2024-04-18T14:44:24.148269+0000","last_active":"2024-04-18T14:45:07.185035+0000","last_peered":"2024-04-18T14:45:07.185035+0000","last_clean":"2024-04-18T14:45:07.185035+0000","last_became_active":"2024-04-18T14:43:21.328534+0000","last_became_peered":"2024-04-18T14:43:21.328534+0000","last_unstale":"2024-04-18T14:45:07.185035+0000","last_undegraded":"2024-04-18T14:45:07.185035+0000","last_fullsized":"2024-04-18T14:45:07.185035+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T14:44:24.148141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T14:43:20.303322+0000","last_clean_scrub_stamp":"2024-04-18T14:44:24.148141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T14:45:30.466689+0000","scrub_duration":0.001593882,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[13,5],"acting":[13,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":13,"acting_primary":13,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":111,"reported_epoch":124,"state":"active+clean","last_fresh":"2024-04-18T14:45:05.845692+0000","last_change":"2024-04-18T14:44:47.245574+0000","last_active":"2024-04-18T14:45:05.845692+0000","last_peered":"2024-04-18T14:45:05.845692+0000","last_clean":"2024-04-18T14:45:05.845692+0000","last_became_active":"2024-04-18T14:43:21.465481+0000","last_became_peered":"2024-04-18T14:43:21.465481+0000","last_unstale":"2024-04-18T14:45:05.845692+0000","last_undegraded":"2024-04-18T14:45:05.845692+0000","last_fullsized":"2024-04-18T14:45:05.845692+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T14:44:47.245297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T14:44:47.245297+0000","last_clean_scrub_stamp":"2024-04-18T14:44:47.245297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T14:46:02.649852+0000","scrub_duration":0.0038839159999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10],"acting":[3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":114,"reported_epoch":124,"state":"active+clean","last_fresh":"2024-04-18T14:45:07.345184+0000","last_change":"2024-04-18T14:44:38.485354+0000","last_active":"2024-04-18T14:45:07.345184+0000","last_peered":"2024-04-18T14:45:07.345184+0000","last_clean":"2024-04-18T14:45:07.345184+0000","last_became_active":"2024-04-18T14:43:21.348012+0000","last_became_peered":"2024-04-18T14:43:21.348012+0000","last_unstale":"2024-04-18T14:45:07.345184+0000","last_undegraded":"2024-04-18T14:45:07.345184+0000","last_fullsized":"2024-04-18T14:45:07.345184+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T14:44:38.485106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T14:43:20.303322+0000","last_clean_scrub_stamp":"2024-04-18T14:44:38.485106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T14:45:48.039171+0000","scrub_duration":0.0043932759999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,12],"acting":[6,12],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":111,"reported_epoch":124,"state":"active+clean","last_fresh":"2024-04-18T14:45:06.469135+0000","last_change":"2024-04-18T14:44:38.516905+0000","last_active":"2024-04-18T14:45:06.469135+0000","last_peered":"2024-04-18T14:45:06.469135+0000","last_clean":"2024-04-18T14:45:06.469135+0000","last_became_active":"2024-04-18T14:43:21.422468+0000","last_became_peered":"2024-04-18T14:43:21.422468+0000","last_unstale":"2024-04-18T14:45:06.469135+0000","last_undegraded":"2024-04-18T14:45:06.469135+0000","last_fullsized":"2024-04-18T14:45:06.469135+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T14:44:38.516629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T14:43:20.303322+0000","last_clean_scrub_stamp":"2024-04-18T14:44:38.516629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T14:45:46.715258+0000","scrub_duration":0.0039045249999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2],"acting":[8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":102,"reported_epoch":124,"state":"active+clean","last_fresh":"2024-04-18T14:45:06.548847+0000","last_change":"2024-04-18T14:44:59.929678+0000","last_active":"2024-04-18T14:45:06.548847+0000","last_peered":"2024-04-18T14:45:06.548847+0000","last_clean":"2024-04-18T14:45:06.548847+0000","last_became_active":"2024-04-18T14:44:59.929195+0000","last_became_peered":"2024-04-18T14:44:59.929195+0000","last_unstale":"2024-04-18T14:45:06.548847+0000","last_undegraded":"2024-04-18T14:45:06.548847+0000","last_fullsized":"2024-04-18T14:45:06.548847+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T14:44:36.901318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T14:43:20.303322+0000","last_clean_scrub_stamp":"2024-04-18T14:44:36.901318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T14:45:49.599440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[14,0],"acting":[14,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":14,"acting_primary":14,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":114,"reported_epoch":124,"state":"active+clean","last_fresh":"2024-04-18T14:45:06.548333+0000","last_change":"2024-04-18T14:44:22.508764+0000","last_active":"2024-04-18T14:45:06.548333+0000","last_peered":"2024-04-18T14:45:06.548333+0000","last_clean":"2024-04-18T14:45:06.548333+0000","last_became_active":"2024-04-18T14:43:21.328185+0000","last_became_peered":"2024-04-18T14:43:21.328185+0000","last_unstale":"2024-04-18T14:45:06.548333+0000","last_undegraded":"2024-04-18T14:45:06.548333+0000","last_fullsized":"2024-04-18T14:45:06.548333+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T14:44:22.508567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T14:43:20.303322+0000","last_clean_scrub_stamp":"2024-04-18T14:44:22.508567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T14:45:46.236519+0000","scrub_duration":0.0031913549999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[15,13],"acting":[15,13],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":15,"acting_primary":15,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":11},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1064960,"data_stored":1057856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":13,"up_from":24,"seq":103079215130,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33476,"kb_used_data":2356,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94338364,"statfs":{"total":96636764160,"available":96602484736,"internally_reserved":0,"allocated":2412544,"data_stored":1617083,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,2,3,4,5,7,11,12,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Apr 18 14:44:21 2024","interfaces":[{"interface":"back","average":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"min":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":1.792,"5min":1.792,"15min":1.792},"last":0.67100000000000004},{"interface":"front","average":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"min":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":2.0600000000000001,"5min":2.0600000000000001,"15min":2.0600000000000001},"last":0.71299999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84099999999999997}]},{"osd":2,"last update":"Thu Apr 18 14:44:21 2024","interfaces":[{"interface":"back","average":{"1min":1.0389999999999999,"5min":1.0389999999999999,"15min":1.0389999999999999},"min":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"max":{"1min":1.974,"5min":1.974,"15min":1.974},"last":0.98599999999999999},{"interface":"front","average":{"1min":1,"5min":1,"15min":1},"min":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.9910000000000001,"5min":1.9910000000000001,"15min":1.9910000000000001},"last":0.79200000000000004}]},{"osd":3,"last update":"Thu Apr 18 14:44:21 2024","interfaces":[{"interface":"back","average":{"1min":0.91500000000000004,"5min":0.91500000000000004,"15min":0.91500000000000004},"min":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"max":{"1min":1.2110000000000001,"5min":1.2110000000000001,"15min":1.2110000000000001},"last":1.0369999999999999},{"interface":"front","average":{"1min":1.0489999999999999,"5min":1.0489999999999999,"15min":1.0489999999999999},"min":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":1.4430000000000001,"5min":1.4430000000000001,"15min":1.4430000000000001},"last":1.113}]},{"osd":4,"last update":"Thu Apr 18 14:44:21 2024","interfaces":[{"interface":"back","average":{"1min":0.98099999999999998,"5min":0.98099999999999998,"15min":0.98099999999999998},"min":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.3919999999999999,"5min":1.3919999999999999,"15min":1.3919999999999999},"last":0.878},{"interface":"front","average":{"1min":0.90100000000000002,"5min":0.90100000000000002,"15min":0.90100000000000002},"min":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":1.306,"5min":1.306,"15min":1.306},"last":1.1559999999999999}]},{"osd":5,"last update":"Thu Apr 18 14:44:21 2024","interfaces":[{"interface":"back","average":{"1min":0.96399999999999997,"5min":0.96399999999999997,"15min":0.96399999999999997},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":1.5860000000000001,"5min":1.5860000000000001,"15min":1.5860000000000001},"last":0.95699999999999996},{"interface":"front","average":{"1min":1.0780000000000001,"5min":1.0780000000000001,"15min":1.0780000000000001},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.536,"5min":1.536,"15min":1.536},"last":0.93200000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1950000000000001}]},{"osd":7,"last update":"Thu Apr 18 14:44:32 2024","interfaces":[{"interface":"back","average":{"1min":1.1639999999999999,"5min":1.1639999999999999,"15min":1.1639999999999999},"min":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":2.4359999999999999,"5min":2.4359999999999999,"15min":2.4359999999999999},"last":1.079},{"interface":"front","average":{"1min":1.206,"5min":1.206,"15min":1.206},"min":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"max":{"1min":3.532,"5min":3.532,"15min":3.532},"last":1.177}]},{"osd":11,"last update":"Thu Apr 18 14:44:32 2024","interfaces":[{"interface":"back","average":{"1min":1.2350000000000001,"5min":1.2350000000000001,"15min":1.2350000000000001},"min":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"max":{"1min":1.8069999999999999,"5min":1.8069999999999999,"15min":1.8069999999999999},"last":1.1399999999999999},{"interface":"front","average":{"1min":1.2809999999999999,"5min":1.2809999999999999,"15min":1.2809999999999999},"min":{"1min":0.84799999999999998,"5min":0.84799999999999998,"15min":0.84799999999999998},"max":{"1min":2.2669999999999999,"5min":2.2669999999999999,"15min":2.2669999999999999},"last":1.2190000000000001}]},{"osd":12,"last update":"Thu Apr 18 14:44:21 2024","interfaces":[{"interface":"back","average":{"1min":1.2709999999999999,"5min":1.2709999999999999,"15min":1.2709999999999999},"min":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"max":{"1min":1.911,"5min":1.911,"15min":1.911},"last":1.018},{"interface":"front","average":{"1min":1.3140000000000001,"5min":1.3140000000000001,"15min":1.3140000000000001},"min":{"1min":0.755,"5min":0.755,"15min":0.755},"max":{"1min":2.504,"5min":2.504,"15min":2.504},"last":1.2909999999999999}]},{"osd":14,"last update":"Thu Apr 18 14:44:21 2024","interfaces":[{"interface":"back","average":{"1min":1.2909999999999999,"5min":1.2909999999999999,"15min":1.2909999999999999},"min":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"max":{"1min":3.6240000000000001,"5min":3.6240000000000001,"15min":3.6240000000000001},"last":1.24},{"interface":"front","average":{"1min":1.357,"5min":1.357,"15min":1.357},"min":{"1min":0.627,"5min":0.627,"15min":0.627},"max":{"1min":2.1960000000000002,"5min":2.1960000000000002,"15min":2.1960000000000002},"last":1.2030000000000001}]},{"osd":15,"last update":"Thu Apr 18 14:44:21 2024","interfaces":[{"interface":"back","average":{"1min":1.3560000000000001,"5min":1.3560000000000001,"15min":1.3560000000000001},"min":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"max":{"1min":2.1080000000000001,"5min":2.1080000000000001,"15min":2.1080000000000001},"last":1.3600000000000001},{"interface":"front","average":{"1min":1.26,"5min":1.26,"15min":1.26},"min":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"max":{"1min":1.8380000000000001,"5min":1.8380000000000001,"15min":1.8380000000000001},"last":1.323}]}]},{"osd":9,"up_from":24,"seq":103079215131,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32956,"kb_used_data":1836,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94338884,"statfs":{"total":96636764160,"available":96603017216,"internally_reserved":0,"allocated":1880064,"data_stored":1088155,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1599,"internal_metadata":31848897},"hb_peers":[0,1,3,8,10,11,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Apr 18 14:44:20 2024","interfaces":[{"interface":"back","average":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":1.0429999999999999,"5min":1.0429999999999999,"15min":1.0429999999999999},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.95199999999999996,"5min":0.95199999999999996,"15min":0.95199999999999996},"min":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"max":{"1min":1.6559999999999999,"5min":1.6559999999999999,"15min":1.6559999999999999},"last":0.68500000000000005}]},{"osd":1,"last update":"Thu Apr 18 14:44:20 2024","interfaces":[{"interface":"back","average":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"min":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":1.3200000000000001,"5min":1.3200000000000001,"15min":1.3200000000000001},"last":0.80400000000000005},{"interface":"front","average":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.2509999999999999,"5min":1.2509999999999999,"15min":1.2509999999999999},"last":0.91600000000000004}]},{"osd":3,"last update":"Thu Apr 18 14:44:20 2024","interfaces":[{"interface":"back","average":{"1min":1.032,"5min":1.032,"15min":1.032},"min":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"max":{"1min":1.5980000000000001,"5min":1.5980000000000001,"15min":1.5980000000000001},"last":0.98799999999999999},{"interface":"front","average":{"1min":1.1539999999999999,"5min":1.1539999999999999,"15min":1.1539999999999999},"min":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"max":{"1min":1.722,"5min":1.722,"15min":1.722},"last":0.95899999999999996}]},{"osd":8,"last update":"Thu Apr 18 14:44:20 2024","interfaces":[{"interface":"back","average":{"1min":0.94899999999999995,"5min":0.94899999999999995,"15min":0.94899999999999995},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":1.6899999999999999,"5min":1.6899999999999999,"15min":1.6899999999999999},"last":0.75800000000000001},{"interface":"front","average":{"1min":1.3380000000000001,"5min":1.3380000000000001,"15min":1.3380000000000001},"min":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"max":{"1min":5.4989999999999997,"5min":5.4989999999999997,"15min":5.4989999999999997},"last":0.84499999999999997}]},{"osd":10,"last update":"Thu Apr 18 14:44:20 2024","interfaces":[{"interface":"back","average":{"1min":1.196,"5min":1.196,"15min":1.196},"min":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"max":{"1min":1.5429999999999999,"5min":1.5429999999999999,"15min":1.5429999999999999},"last":1.2849999999999999},{"interface":"front","average":{"1min":1.117,"5min":1.117,"15min":1.117},"min":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"max":{"1min":1.7689999999999999,"5min":1.7689999999999999,"15min":1.7689999999999999},"last":1.091}]},{"osd":11,"last update":"Thu Apr 18 14:44:20 2024","interfaces":[{"interface":"back","average":{"1min":1.1279999999999999,"5min":1.1279999999999999,"15min":1.1279999999999999},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.849,"5min":1.849,"15min":1.849},"last":1.0189999999999999},{"interface":"front","average":{"1min":1.2310000000000001,"5min":1.2310000000000001,"15min":1.2310000000000001},"min":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"max":{"1min":1.8109999999999999,"5min":1.8109999999999999,"15min":1.8109999999999999},"last":1.119}]},{"osd":12,"last update":"Thu Apr 18 14:44:20 2024","interfaces":[{"interface":"back","average":{"1min":1.2989999999999999,"5min":1.2989999999999999,"15min":1.2989999999999999},"min":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"max":{"1min":2.1560000000000001,"5min":2.1560000000000001,"15min":2.1560000000000001},"last":0.88100000000000001},{"interface":"front","average":{"1min":1.29,"5min":1.29,"15min":1.29},"min":{"1min":0.748,"5min":0.748,"15min":0.748},"max":{"1min":2.6930000000000001,"5min":2.6930000000000001,"15min":2.6930000000000001},"last":1.1539999999999999}]},{"osd":13,"last update":"Thu Apr 18 14:44:20 2024","interfaces":[{"interface":"back","average":{"1min":1.4079999999999999,"5min":1.4079999999999999,"15min":1.4079999999999999},"min":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"max":{"1min":2.6030000000000002,"5min":2.6030000000000002,"15min":2.6030000000000002},"last":1.0580000000000001},{"interface":"front","average":{"1min":1.4710000000000001,"5min":1.4710000000000001,"15min":1.4710000000000001},"min":{"1min":0.92100000000000004,"5min":0.92100000000000004,"15min":0.92100000000000004},"max":{"1min":2.472,"5min":2.472,"15min":2.472},"last":1.179}]},{"osd":14,"last update":"Thu Apr 18 14:44:20 2024","interfaces":[{"interface":"back","average":{"1min":1.456,"5min":1.456,"15min":1.456},"min":{"1min":0.88400000000000001,"5min":0.88400000000000001,"15min":0.88400000000000001},"max":{"1min":2.3180000000000001,"5min":2.3180000000000001,"15min":2.3180000000000001},"last":1.26},{"interface":"front","average":{"1min":1.5389999999999999,"5min":1.5389999999999999,"15min":1.5389999999999999},"min":{"1min":1.016,"5min":1.016,"15min":1.016},"max":{"1min":2.6549999999999998,"5min":2.6549999999999998,"15min":2.6549999999999998},"last":1.204}]},{"osd":15,"last update":"Thu Apr 18 14:44:20 2024","interfaces":[{"interface":"back","average":{"1min":1.4119999999999999,"5min":1.4119999999999999,"15min":1.4119999999999999},"min":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"max":{"1min":2.7789999999999999,"5min":2.7789999999999999,"15min":2.7789999999999999},"last":1.2310000000000001},{"interface":"front","average":{"1min":1.4359999999999999,"5min":1.4359999999999999,"15min":1.4359999999999999},"min":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"max":{"1min":1.923,"5min":1.923,"15min":1.923},"last":1.3080000000000001}]}]},{"osd":5,"up_from":24,"seq":103079215132,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32956,"kb_used_data":1836,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94338884,"statfs":{"total":96636764160,"available":96603017216,"internally_reserved":0,"allocated":1880064,"data_stored":1088155,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,3,4,6,10,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Apr 18 14:44:31 2024","interfaces":[{"interface":"back","average":{"1min":0.90900000000000003,"5min":0.90900000000000003,"15min":0.90900000000000003},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.339,"5min":1.339,"15min":1.339},"last":1.083},{"interface":"front","average":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":1.175,"5min":1.175,"15min":1.175},"last":0.78900000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67600000000000005}]},{"osd":3,"last update":"Thu Apr 18 14:44:24 2024","interfaces":[{"interface":"back","average":{"1min":1.024,"5min":1.024,"15min":1.024},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":1.4650000000000001,"5min":1.4650000000000001,"15min":1.4650000000000001},"last":1.26},{"interface":"front","average":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":0.94999999999999996},"min":{"1min":0.621,"5min":0.621,"15min":0.621},"max":{"1min":1.8460000000000001,"5min":1.8460000000000001,"15min":1.8460000000000001},"last":0.81200000000000006}]},{"osd":4,"last update":"Thu Apr 18 14:44:24 2024","interfaces":[{"interface":"back","average":{"1min":0.89400000000000002,"5min":0.89400000000000002,"15min":0.89400000000000002},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":1.968,"5min":1.968,"15min":1.968},"last":0.88700000000000001},{"interface":"front","average":{"1min":1.016,"5min":1.016,"15min":1.016},"min":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"max":{"1min":1.819,"5min":1.819,"15min":1.819},"last":1.1679999999999999}]},{"osd":6,"last update":"Thu Apr 18 14:44:24 2024","interfaces":[{"interface":"back","average":{"1min":1.0629999999999999,"5min":1.0629999999999999,"15min":1.0629999999999999},"min":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"max":{"1min":2.0760000000000001,"5min":2.0760000000000001,"15min":2.0760000000000001},"last":0.94799999999999995},{"interface":"front","average":{"1min":1.101,"5min":1.101,"15min":1.101},"min":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"max":{"1min":1.694,"5min":1.694,"15min":1.694},"last":0.97999999999999998}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2330000000000001}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96599999999999997}]},{"osd":10,"last update":"Thu Apr 18 14:44:24 2024","interfaces":[{"interface":"back","average":{"1min":1.232,"5min":1.232,"15min":1.232},"min":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"max":{"1min":2.2709999999999999,"5min":2.2709999999999999,"15min":2.2709999999999999},"last":1.3360000000000001},{"interface":"front","average":{"1min":1.2569999999999999,"5min":1.2569999999999999,"15min":1.2569999999999999},"min":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"max":{"1min":2.4470000000000001,"5min":2.4470000000000001,"15min":2.4470000000000001},"last":1.03}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.256}]},{"osd":12,"last update":"Thu Apr 18 14:44:24 2024","interfaces":[{"interface":"back","average":{"1min":1.1140000000000001,"5min":1.1140000000000001,"15min":1.1140000000000001},"min":{"1min":0.625,"5min":0.625,"15min":0.625},"max":{"1min":1.728,"5min":1.728,"15min":1.728},"last":0.83899999999999997},{"interface":"front","average":{"1min":1.339,"5min":1.339,"15min":1.339},"min":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"max":{"1min":2.008,"5min":2.008,"15min":2.008},"last":1.4059999999999999}]},{"osd":13,"last update":"Thu Apr 18 14:44:24 2024","interfaces":[{"interface":"back","average":{"1min":1.355,"5min":1.355,"15min":1.355},"min":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":2.5070000000000001,"5min":2.5070000000000001,"15min":2.5070000000000001},"last":1.478},{"interface":"front","average":{"1min":1.2949999999999999,"5min":1.2949999999999999,"15min":1.2949999999999999},"min":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":2.992,"5min":2.992,"15min":2.992},"last":1.1299999999999999}]},{"osd":14,"last update":"Thu Apr 18 14:44:31 2024","interfaces":[{"interface":"back","average":{"1min":1.401,"5min":1.401,"15min":1.401},"min":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.85099999999999998},"max":{"1min":2.1190000000000002,"5min":2.1190000000000002,"15min":2.1190000000000002},"last":1.5469999999999999},{"interface":"front","average":{"1min":1.2629999999999999,"5min":1.2629999999999999,"15min":1.2629999999999999},"min":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"max":{"1min":2.496,"5min":2.496,"15min":2.496},"last":1.1919999999999999}]},{"osd":15,"last update":"Thu Apr 18 14:44:24 2024","interfaces":[{"interface":"back","average":{"1min":1.486,"5min":1.486,"15min":1.486},"min":{"1min":0.879,"5min":0.879,"15min":0.879},"max":{"1min":2.415,"5min":2.415,"15min":2.415},"last":1.615},{"interface":"front","average":{"1min":1.4470000000000001,"5min":1.4470000000000001,"15min":1.4470000000000001},"min":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"max":{"1min":2.7799999999999998,"5min":2.7799999999999998,"15min":2.7799999999999998},"last":1.236}]}]},{"osd":14,"up_from":21,"seq":90194313243,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51008,"kb_used_data":1836,"kb_used_omap":1,"kb_used_meta":49150,"kb_avail":94320832,"statfs":{"total":96636764160,"available":96584531968,"internally_reserved":0,"allocated":1880064,"data_stored":1088155,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":50330054},"hb_peers":[0,4,5,6,7,8,9,11,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Apr 18 14:44:21 2024","interfaces":[{"interface":"back","average":{"1min":0.96899999999999997,"5min":0.96899999999999997,"15min":0.96899999999999997},"min":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"max":{"1min":1.454,"5min":1.454,"15min":1.454},"last":0.83999999999999997},{"interface":"front","average":{"1min":1.0660000000000001,"5min":1.0660000000000001,"15min":1.0660000000000001},"min":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"max":{"1min":1.9390000000000001,"5min":1.9390000000000001,"15min":1.9390000000000001},"last":1.0940000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.472}]},{"osd":2,"last update":"Thu Apr 18 14:44:31 2024","interfaces":[{"interface":"back","average":{"1min":0.89500000000000002,"5min":0.89500000000000002,"15min":0.89500000000000002},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":1.468,"5min":1.468,"15min":1.468},"last":0.64400000000000002},{"interface":"front","average":{"1min":1.131,"5min":1.131,"15min":1.131},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.8540000000000001,"5min":1.8540000000000001,"15min":1.8540000000000001},"last":1.032}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94499999999999995}]},{"osd":4,"last update":"Thu Apr 18 14:44:20 2024","interfaces":[{"interface":"back","average":{"1min":0.95099999999999996,"5min":0.95099999999999996,"15min":0.95099999999999996},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.296,"5min":1.296,"15min":1.296},"last":0.69499999999999995},{"interface":"front","average":{"1min":0.97599999999999998,"5min":0.97599999999999998,"15min":0.97599999999999998},"min":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"max":{"1min":1.5129999999999999,"5min":1.5129999999999999,"15min":1.5129999999999999},"last":0.74099999999999999}]},{"osd":5,"last update":"Thu Apr 18 14:44:20 2024","interfaces":[{"interface":"back","average":{"1min":1.218,"5min":1.218,"15min":1.218},"min":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"max":{"1min":2.1269999999999998,"5min":2.1269999999999998,"15min":2.1269999999999998},"last":1.1910000000000001},{"interface":"front","average":{"1min":1.1679999999999999,"5min":1.1679999999999999,"15min":1.1679999999999999},"min":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"max":{"1min":1.5920000000000001,"5min":1.5920000000000001,"15min":1.5920000000000001},"last":0.95299999999999996}]},{"osd":6,"last update":"Thu Apr 18 14:44:20 2024","interfaces":[{"interface":"back","average":{"1min":0.94699999999999995,"5min":0.94699999999999995,"15min":0.94699999999999995},"min":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"max":{"1min":1.3160000000000001,"5min":1.3160000000000001,"15min":1.3160000000000001},"last":1.0509999999999999},{"interface":"front","average":{"1min":1.163,"5min":1.163,"15min":1.163},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":1.7689999999999999,"5min":1.7689999999999999,"15min":1.7689999999999999},"last":0.875}]},{"osd":7,"last update":"Thu Apr 18 14:44:20 2024","interfaces":[{"interface":"back","average":{"1min":1.234,"5min":1.234,"15min":1.234},"min":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"max":{"1min":1.7529999999999999,"5min":1.7529999999999999,"15min":1.7529999999999999},"last":1.018},{"interface":"front","average":{"1min":1.1759999999999999,"5min":1.1759999999999999,"15min":1.1759999999999999},"min":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"max":{"1min":1.587,"5min":1.587,"15min":1.587},"last":0.90900000000000003}]},{"osd":8,"last update":"Thu Apr 18 14:44:20 2024","interfaces":[{"interface":"back","average":{"1min":1.292,"5min":1.292,"15min":1.292},"min":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"max":{"1min":2.0569999999999999,"5min":2.0569999999999999,"15min":2.0569999999999999},"last":1.3720000000000001},{"interface":"front","average":{"1min":1.2509999999999999,"5min":1.2509999999999999,"15min":1.2509999999999999},"min":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"max":{"1min":1.8740000000000001,"5min":1.8740000000000001,"15min":1.8740000000000001},"last":1.0740000000000001}]},{"osd":9,"last update":"Thu Apr 18 14:44:31 2024","interfaces":[{"interface":"back","average":{"1min":1.4590000000000001,"5min":1.4590000000000001,"15min":1.4590000000000001},"min":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"max":{"1min":2.1899999999999999,"5min":2.1899999999999999,"15min":2.1899999999999999},"last":1.4550000000000001},{"interface":"front","average":{"1min":1.3999999999999999,"5min":1.3999999999999999,"15min":1.3999999999999999},"min":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"max":{"1min":1.9930000000000001,"5min":1.9930000000000001,"15min":1.9930000000000001},"last":1.163}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4219999999999999}]},{"osd":11,"last update":"Thu Apr 18 14:44:31 2024","interfaces":[{"interface":"back","average":{"1min":1.4319999999999999,"5min":1.4319999999999999,"15min":1.4319999999999999},"min":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"max":{"1min":2.0059999999999998,"5min":2.0059999999999998,"15min":2.0059999999999998},"last":1.1279999999999999},{"interface":"front","average":{"1min":1.3640000000000001,"5min":1.3640000000000001,"15min":1.3640000000000001},"min":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"max":{"1min":1.903,"5min":1.903,"15min":1.903},"last":1.5349999999999999}]},{"osd":12,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.016}]},{"osd":13,"last update":"Thu Apr 18 14:44:20 2024","interfaces":[{"interface":"back","average":{"1min":1.464,"5min":1.464,"15min":1.464},"min":{"1min":0.86799999999999999,"5min":0.86799999999999999,"15min":0.86799999999999999},"max":{"1min":1.8620000000000001,"5min":1.8620000000000001,"15min":1.8620000000000001},"last":1.2410000000000001},{"interface":"front","average":{"1min":1.5349999999999999,"5min":1.5349999999999999,"15min":1.5349999999999999},"min":{"1min":0.94299999999999995,"5min":0.94299999999999995,"15min":0.94299999999999995},"max":{"1min":2.452,"5min":2.452,"15min":2.452},"last":1.5780000000000001}]},{"osd":15,"last update":"Thu Apr 18 14:44:20 2024","interfaces":[{"interface":"back","average":{"1min":1.5129999999999999,"5min":1.5129999999999999,"15min":1.5129999999999999},"min":{"1min":0.95699999999999996,"5min":0.95699999999999996,"15min":0.95699999999999996},"max":{"1min":2.2549999999999999,"5min":2.2549999999999999,"15min":2.2549999999999999},"last":1.2170000000000001},{"interface":"front","average":{"1min":1.476,"5min":1.476,"15min":1.476},"min":{"1min":0.89800000000000002,"5min":0.89800000000000002,"15min":0.89800000000000002},"max":{"1min":1.9550000000000001,"5min":1.9550000000000001,"15min":1.9550000000000001},"last":1.4910000000000001}]}]},{"osd":1,"up_from":24,"seq":103079215132,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32952,"kb_used_data":1832,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94338888,"statfs":{"total":96636764160,"available":96603021312,"internally_reserved":0,"allocated":1875968,"data_stored":1087311,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,2,3,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Apr 18 14:44:25 2024","interfaces":[{"interface":"back","average":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":1.165,"5min":1.165,"15min":1.165},"last":1.1519999999999999},{"interface":"front","average":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"min":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":1.292,"5min":1.292,"15min":1.292},"last":0.92700000000000005}]},{"osd":2,"last update":"Thu Apr 18 14:44:25 2024","interfaces":[{"interface":"back","average":{"1min":0.93899999999999995,"5min":0.93899999999999995,"15min":0.93899999999999995},"min":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"max":{"1min":1.3180000000000001,"5min":1.3180000000000001,"15min":1.3180000000000001},"last":1.0960000000000001},{"interface":"front","average":{"1min":0.95199999999999996,"5min":0.95199999999999996,"15min":0.95199999999999996},"min":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":1.345,"5min":1.345,"15min":1.345},"last":0.98099999999999998}]},{"osd":3,"last update":"Thu Apr 18 14:44:25 2024","interfaces":[{"interface":"back","average":{"1min":1.0760000000000001,"5min":1.0760000000000001,"15min":1.0760000000000001},"min":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":1.486,"5min":1.486,"15min":1.486},"last":1.526},{"interface":"front","average":{"1min":1.1679999999999999,"5min":1.1679999999999999,"15min":1.1679999999999999},"min":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"max":{"1min":1.7789999999999999,"5min":1.7789999999999999,"15min":1.7789999999999999},"last":1.1719999999999999}]},{"osd":4,"last update":"Thu Apr 18 14:44:25 2024","interfaces":[{"interface":"back","average":{"1min":0.98299999999999998,"5min":0.98299999999999998,"15min":0.98299999999999998},"min":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"max":{"1min":1.728,"5min":1.728,"15min":1.728},"last":1.1950000000000001},{"interface":"front","average":{"1min":0.93700000000000006,"5min":0.93700000000000006,"15min":0.93700000000000006},"min":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"max":{"1min":1.6950000000000001,"5min":1.6950000000000001,"15min":1.6950000000000001},"last":1.248}]},{"osd":5,"last update":"Thu Apr 18 14:44:25 2024","interfaces":[{"interface":"back","average":{"1min":1.0089999999999999,"5min":1.0089999999999999,"15min":1.0089999999999999},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":1.819,"5min":1.819,"15min":1.819},"last":0.80900000000000005},{"interface":"front","average":{"1min":1.083,"5min":1.083,"15min":1.083},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":1.841,"5min":1.841,"15min":1.841},"last":1.034}]},{"osd":6,"last update":"Thu Apr 18 14:44:25 2024","interfaces":[{"interface":"back","average":{"1min":1.2529999999999999,"5min":1.2529999999999999,"15min":1.2529999999999999},"min":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"max":{"1min":2.3639999999999999,"5min":2.3639999999999999,"15min":2.3639999999999999},"last":1.0720000000000001},{"interface":"front","average":{"1min":1.1839999999999999,"5min":1.1839999999999999,"15min":1.1839999999999999},"min":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"max":{"1min":1.9419999999999999,"5min":1.9419999999999999,"15min":1.9419999999999999},"last":1.1220000000000001}]},{"osd":7,"last update":"Thu Apr 18 14:44:25 2024","interfaces":[{"interface":"back","average":{"1min":1.2050000000000001,"5min":1.2050000000000001,"15min":1.2050000000000001},"min":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"max":{"1min":1.96,"5min":1.96,"15min":1.96},"last":0.86499999999999999},{"interface":"front","average":{"1min":1.2509999999999999,"5min":1.2509999999999999,"15min":1.2509999999999999},"min":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"max":{"1min":2.4399999999999999,"5min":2.4399999999999999,"15min":2.4399999999999999},"last":1.218}]},{"osd":8,"last update":"Thu Apr 18 14:44:25 2024","interfaces":[{"interface":"back","average":{"1min":1.2330000000000001,"5min":1.2330000000000001,"15min":1.2330000000000001},"min":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"max":{"1min":1.881,"5min":1.881,"15min":1.881},"last":1.3080000000000001},{"interface":"front","average":{"1min":1.26,"5min":1.26,"15min":1.26},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":2.5169999999999999,"5min":2.5169999999999999,"15min":2.5169999999999999},"last":1.3680000000000001}]},{"osd":9,"last update":"Thu Apr 18 14:44:25 2024","interfaces":[{"interface":"back","average":{"1min":1.3280000000000001,"5min":1.3280000000000001,"15min":1.3280000000000001},"min":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":2.4780000000000002,"5min":2.4780000000000002,"15min":2.4780000000000002},"last":1.706},{"interface":"front","average":{"1min":1.3129999999999999,"5min":1.3129999999999999,"15min":1.3129999999999999},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":2.161,"5min":2.161,"15min":2.161},"last":1.3919999999999999}]},{"osd":10,"last update":"Thu Apr 18 14:44:25 2024","interfaces":[{"interface":"back","average":{"1min":1.407,"5min":1.407,"15min":1.407},"min":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"max":{"1min":2.625,"5min":2.625,"15min":2.625},"last":1.4370000000000001},{"interface":"front","average":{"1min":1.446,"5min":1.446,"15min":1.446},"min":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"max":{"1min":2.5529999999999999,"5min":2.5529999999999999,"15min":2.5529999999999999},"last":1.7829999999999999}]}]},{"osd":2,"up_from":22,"seq":94489280539,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28840,"kb_used_data":1820,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343000,"statfs":{"total":96636764160,"available":96607232000,"internally_reserved":0,"allocated":1863680,"data_stored":1078641,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,3,5,6,7,8,10,11,12,14],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Apr 18 14:44:22 2024","interfaces":[{"interface":"back","average":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"min":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"max":{"1min":1.175,"5min":1.175,"15min":1.175},"last":1.2210000000000001},{"interface":"front","average":{"1min":0.90900000000000003,"5min":0.90900000000000003,"15min":0.90900000000000003},"min":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"max":{"1min":1.3740000000000001,"5min":1.3740000000000001,"15min":1.3740000000000001},"last":1.47}]},{"osd":3,"last update":"Thu Apr 18 14:44:22 2024","interfaces":[{"interface":"back","average":{"1min":1.0409999999999999,"5min":1.0409999999999999,"15min":1.0409999999999999},"min":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"max":{"1min":1.6830000000000001,"5min":1.6830000000000001,"15min":1.6830000000000001},"last":1.0740000000000001},{"interface":"front","average":{"1min":1.0700000000000001,"5min":1.0700000000000001,"15min":1.0700000000000001},"min":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"max":{"1min":1.8839999999999999,"5min":1.8839999999999999,"15min":1.8839999999999999},"last":1.3080000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96699999999999997}]},{"osd":5,"last update":"Thu Apr 18 14:44:22 2024","interfaces":[{"interface":"back","average":{"1min":0.98799999999999999,"5min":0.98799999999999999,"15min":0.98799999999999999},"min":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"max":{"1min":1.5469999999999999,"5min":1.5469999999999999,"15min":1.5469999999999999},"last":0.63100000000000001},{"interface":"front","average":{"1min":0.92500000000000004,"5min":0.92500000000000004,"15min":0.92500000000000004},"min":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":1.333,"5min":1.333,"15min":1.333},"last":1.359}]},{"osd":6,"last update":"Thu Apr 18 14:44:19 2024","interfaces":[{"interface":"back","average":{"1min":1.115,"5min":1.115,"15min":1.115},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":2.0529999999999999,"5min":2.0529999999999999,"15min":2.0529999999999999},"last":1.26},{"interface":"front","average":{"1min":1.089,"5min":1.089,"15min":1.089},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.8069999999999999,"5min":1.8069999999999999,"15min":1.8069999999999999},"last":1.155}]},{"osd":7,"last update":"Thu Apr 18 14:44:22 2024","interfaces":[{"interface":"back","average":{"1min":1.165,"5min":1.165,"15min":1.165},"min":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"max":{"1min":2.012,"5min":2.012,"15min":2.012},"last":0.97299999999999998},{"interface":"front","average":{"1min":1.2949999999999999,"5min":1.2949999999999999,"15min":1.2949999999999999},"min":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"max":{"1min":2.1419999999999999,"5min":2.1419999999999999,"15min":2.1419999999999999},"last":1.0229999999999999}]},{"osd":8,"last update":"Thu Apr 18 14:44:22 2024","interfaces":[{"interface":"back","average":{"1min":1.224,"5min":1.224,"15min":1.224},"min":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"max":{"1min":1.988,"5min":1.988,"15min":1.988},"last":1.55},{"interface":"front","average":{"1min":1.3120000000000001,"5min":1.3120000000000001,"15min":1.3120000000000001},"min":{"1min":0.84999999999999998,"5min":0.84999999999999998,"15min":0.84999999999999998},"max":{"1min":2.2240000000000002,"5min":2.2240000000000002,"15min":2.2240000000000002},"last":1.657}]},{"osd":10,"last update":"Thu Apr 18 14:44:19 2024","interfaces":[{"interface":"back","average":{"1min":1.365,"5min":1.365,"15min":1.365},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":2.319,"5min":2.319,"15min":2.319},"last":2.8170000000000002},{"interface":"front","average":{"1min":1.3879999999999999,"5min":1.3879999999999999,"15min":1.3879999999999999},"min":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"max":{"1min":2.27,"5min":2.27,"15min":2.27},"last":3.0110000000000001}]},{"osd":11,"last update":"Thu Apr 18 14:44:19 2024","interfaces":[{"interface":"back","average":{"1min":1.49,"5min":1.49,"15min":1.49},"min":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"max":{"1min":2.4950000000000001,"5min":2.4950000000000001,"15min":2.4950000000000001},"last":1.78},{"interface":"front","average":{"1min":1.4590000000000001,"5min":1.4590000000000001,"15min":1.4590000000000001},"min":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"max":{"1min":2.411,"5min":2.411,"15min":2.411},"last":1.736}]},{"osd":12,"last update":"Thu Apr 18 14:44:19 2024","interfaces":[{"interface":"back","average":{"1min":1.4910000000000001,"5min":1.4910000000000001,"15min":1.4910000000000001},"min":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":0.88500000000000001},"max":{"1min":2.2669999999999999,"5min":2.2669999999999999,"15min":2.2669999999999999},"last":1.8220000000000001},{"interface":"front","average":{"1min":1.514,"5min":1.514,"15min":1.514},"min":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"max":{"1min":2.3719999999999999,"5min":2.3719999999999999,"15min":2.3719999999999999},"last":1.861}]},{"osd":14,"last update":"Thu Apr 18 14:44:19 2024","interfaces":[{"interface":"back","average":{"1min":1.4390000000000001,"5min":1.4390000000000001,"15min":1.4390000000000001},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":2.3050000000000002,"5min":2.3050000000000002,"15min":2.3050000000000002},"last":1.9770000000000001},{"interface":"front","average":{"1min":1.5069999999999999,"5min":1.5069999999999999,"15min":1.5069999999999999},"min":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":2.4020000000000001,"5min":2.4020000000000001,"15min":2.4020000000000001},"last":1.9350000000000001}]}]},{"osd":15,"up_from":23,"seq":98784247836,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32952,"kb_used_data":1832,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94338888,"statfs":{"total":96636764160,"available":96603021312,"internally_reserved":0,"allocated":1875968,"data_stored":1087311,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31848903},"hb_peers":[0,4,5,6,7,8,10,11,13,14],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Apr 18 14:44:19 2024","interfaces":[{"interface":"back","average":{"1min":0.94699999999999995,"5min":0.94699999999999995,"15min":0.94699999999999995},"min":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"max":{"1min":1.405,"5min":1.405,"15min":1.405},"last":0.997},{"interface":"front","average":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"min":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":1.0569999999999999,"5min":1.0569999999999999,"15min":1.0569999999999999},"last":0.63200000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2050000000000001}]},{"osd":4,"last update":"Thu Apr 18 14:44:19 2024","interfaces":[{"interface":"back","average":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.85099999999999998},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.2669999999999999,"5min":1.2669999999999999,"15min":1.2669999999999999},"last":0.73499999999999999},{"interface":"front","average":{"1min":0.877,"5min":0.877,"15min":0.877},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.2410000000000001,"5min":1.2410000000000001,"15min":1.2410000000000001},"last":0.87}]},{"osd":5,"last update":"Thu Apr 18 14:44:22 2024","interfaces":[{"interface":"back","average":{"1min":1.0209999999999999,"5min":1.0209999999999999,"15min":1.0209999999999999},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":2.0579999999999998,"5min":2.0579999999999998,"15min":2.0579999999999998},"last":0.93400000000000005},{"interface":"front","average":{"1min":1.089,"5min":1.089,"15min":1.089},"min":{"1min":0.75,"5min":0.75,"15min":0.75},"max":{"1min":1.9259999999999999,"5min":1.9259999999999999,"15min":1.9259999999999999},"last":1.1339999999999999}]},{"osd":6,"last update":"Thu Apr 18 14:44:19 2024","interfaces":[{"interface":"back","average":{"1min":1.1379999999999999,"5min":1.1379999999999999,"15min":1.1379999999999999},"min":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"max":{"1min":1.8680000000000001,"5min":1.8680000000000001,"15min":1.8680000000000001},"last":1.034},{"interface":"front","average":{"1min":1.228,"5min":1.228,"15min":1.228},"min":{"1min":0.86499999999999999,"5min":0.86499999999999999,"15min":0.86499999999999999},"max":{"1min":1.79,"5min":1.79,"15min":1.79},"last":1.429}]},{"osd":7,"last update":"Thu Apr 18 14:44:19 2024","interfaces":[{"interface":"back","average":{"1min":1.0549999999999999,"5min":1.0549999999999999,"15min":1.0549999999999999},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":1.488,"5min":1.488,"15min":1.488},"last":1.504},{"interface":"front","average":{"1min":1.1830000000000001,"5min":1.1830000000000001,"15min":1.1830000000000001},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":1.976,"5min":1.976,"15min":1.976},"last":1.1859999999999999}]},{"osd":8,"last update":"Thu Apr 18 14:44:19 2024","interfaces":[{"interface":"back","average":{"1min":1.1879999999999999,"5min":1.1879999999999999,"15min":1.1879999999999999},"min":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"max":{"1min":2.004,"5min":2.004,"15min":2.004},"last":1.2370000000000001},{"interface":"front","average":{"1min":1.222,"5min":1.222,"15min":1.222},"min":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"max":{"1min":1.786,"5min":1.786,"15min":1.786},"last":1.381}]},{"osd":10,"last update":"Thu Apr 18 14:44:19 2024","interfaces":[{"interface":"back","average":{"1min":1.3360000000000001,"5min":1.3360000000000001,"15min":1.3360000000000001},"min":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"max":{"1min":2.403,"5min":2.403,"15min":2.403},"last":1.4710000000000001},{"interface":"front","average":{"1min":1.331,"5min":1.331,"15min":1.331},"min":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"max":{"1min":2.2549999999999999,"5min":2.2549999999999999,"15min":2.2549999999999999},"last":1.6459999999999999}]},{"osd":11,"last update":"Thu Apr 18 14:44:19 2024","interfaces":[{"interface":"back","average":{"1min":1.399,"5min":1.399,"15min":1.399},"min":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"max":{"1min":2.2109999999999999,"5min":2.2109999999999999,"15min":2.2109999999999999},"last":1.6990000000000001},{"interface":"front","average":{"1min":1.4490000000000001,"5min":1.4490000000000001,"15min":1.4490000000000001},"min":{"1min":0.629,"5min":0.629,"15min":0.629},"max":{"1min":2.1589999999999998,"5min":2.1589999999999998,"15min":2.1589999999999998},"last":1.3109999999999999}]},{"osd":13,"last update":"Thu Apr 18 14:44:22 2024","interfaces":[{"interface":"back","average":{"1min":1.391,"5min":1.391,"15min":1.391},"min":{"1min":1.0109999999999999,"5min":1.0109999999999999,"15min":1.0109999999999999},"max":{"1min":1.9419999999999999,"5min":1.9419999999999999,"15min":1.9419999999999999},"last":1.748},{"interface":"front","average":{"1min":1.387,"5min":1.387,"15min":1.387},"min":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"max":{"1min":1.8959999999999999,"5min":1.8959999999999999,"15min":1.8959999999999999},"last":1.8720000000000001}]},{"osd":14,"last update":"Thu Apr 18 14:44:19 2024","interfaces":[{"interface":"back","average":{"1min":1.4279999999999999,"5min":1.4279999999999999,"15min":1.4279999999999999},"min":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"max":{"1min":2.351,"5min":2.351,"15min":2.351},"last":1.611},{"interface":"front","average":{"1min":1.454,"5min":1.454,"15min":1.454},"min":{"1min":0.84299999999999997,"5min":0.84299999999999997,"15min":0.84299999999999997},"max":{"1min":2.766,"5min":2.766,"15min":2.766},"last":1.782}]}]},{"osd":4,"up_from":22,"seq":94489280538,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":51000,"kb_used_data":1832,"kb_used_omap":1,"kb_used_meta":49150,"kb_avail":94320840,"statfs":{"total":96636764160,"available":96584540160,"internally_reserved":0,"allocated":1875968,"data_stored":1087311,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":50330054},"hb_peers":[2,3,5,6,10,11,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":2,"last update":"Thu Apr 18 14:44:20 2024","interfaces":[{"interface":"back","average":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":1.2330000000000001,"5min":1.2330000000000001,"15min":1.2330000000000001},"last":1.171},{"interface":"front","average":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":1.306,"5min":1.306,"15min":1.306},"last":1.21}]},{"osd":3,"last update":"Thu Apr 18 14:44:20 2024","interfaces":[{"interface":"back","average":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":1.1499999999999999,"5min":1.1499999999999999,"15min":1.1499999999999999},"last":0.92900000000000005},{"interface":"front","average":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":1.0169999999999999,"5min":1.0169999999999999,"15min":1.0169999999999999},"last":1.054}]},{"osd":5,"last update":"Thu Apr 18 14:44:20 2024","interfaces":[{"interface":"back","average":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":1.0609999999999999,"5min":1.0609999999999999,"15min":1.0609999999999999},"last":0.99399999999999999},{"interface":"front","average":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":1.2190000000000001,"5min":1.2190000000000001,"15min":1.2190000000000001},"last":1.135}]},{"osd":6,"last update":"Thu Apr 18 14:44:20 2024","interfaces":[{"interface":"back","average":{"1min":0.84999999999999998,"5min":0.84999999999999998,"15min":0.84999999999999998},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":1.1930000000000001,"5min":1.1930000000000001,"15min":1.1930000000000001},"last":1.446},{"interface":"front","average":{"1min":0.88,"5min":0.88,"15min":0.88},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.337,"5min":1.337,"15min":1.337},"last":1.304}]},{"osd":10,"last update":"Thu Apr 18 14:44:20 2024","interfaces":[{"interface":"back","average":{"1min":0.876,"5min":0.876,"15min":0.876},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":1.49,"5min":1.49,"15min":1.49},"last":1.8009999999999999},{"interface":"front","average":{"1min":0.90900000000000003,"5min":0.90900000000000003,"15min":0.90900000000000003},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.5700000000000001,"5min":1.5700000000000001,"15min":1.5700000000000001},"last":1.3660000000000001}]},{"osd":11,"last update":"Thu Apr 18 14:44:20 2024","interfaces":[{"interface":"back","average":{"1min":0.86499999999999999,"5min":0.86499999999999999,"15min":0.86499999999999999},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":1.2130000000000001,"5min":1.2130000000000001,"15min":1.2130000000000001},"last":1.3400000000000001},{"interface":"front","average":{"1min":0.90100000000000002,"5min":0.90100000000000002,"15min":0.90100000000000002},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.365,"5min":1.365,"15min":1.365},"last":1.6719999999999999}]},{"osd":12,"last update":"Thu Apr 18 14:44:20 2024","interfaces":[{"interface":"back","average":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":1.1879999999999999,"5min":1.1879999999999999,"15min":1.1879999999999999},"last":1.276},{"interface":"front","average":{"1min":0.86099999999999999,"5min":0.86099999999999999,"15min":0.86099999999999999},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":1.2949999999999999,"5min":1.2949999999999999,"15min":1.2949999999999999},"last":1.901}]},{"osd":13,"last update":"Thu Apr 18 14:44:20 2024","interfaces":[{"interface":"back","average":{"1min":0.95999999999999996,"5min":0.95999999999999996,"15min":0.95999999999999996},"min":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.4279999999999999,"5min":1.4279999999999999,"15min":1.4279999999999999},"last":1.974},{"interface":"front","average":{"1min":0.89900000000000002,"5min":0.89900000000000002,"15min":0.89900000000000002},"min":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"max":{"1min":1.3360000000000001,"5min":1.3360000000000001,"15min":1.3360000000000001},"last":1.75}]},{"osd":14,"last update":"Thu Apr 18 14:44:20 2024","interfaces":[{"interface":"back","average":{"1min":1.022,"5min":1.022,"15min":1.022},"min":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":1.4730000000000001,"5min":1.4730000000000001,"15min":1.4730000000000001},"last":1.601},{"interface":"front","average":{"1min":1.0429999999999999,"5min":1.0429999999999999,"15min":1.0429999999999999},"min":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"max":{"1min":1.369,"5min":1.369,"15min":1.369},"last":1.5660000000000001}]},{"osd":15,"last update":"Thu Apr 18 14:44:20 2024","interfaces":[{"interface":"back","average":{"1min":1.016,"5min":1.016,"15min":1.016},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.5980000000000001,"5min":1.5980000000000001,"15min":1.5980000000000001},"last":1.639},{"interface":"front","average":{"1min":1.02,"5min":1.02,"15min":1.02},"min":{"1min":0.624,"5min":0.624,"15min":0.624},"max":{"1min":1.5649999999999999,"5min":1.5649999999999999,"15min":1.5649999999999999},"last":2.0369999999999999}]}]},{"osd":6,"up_from":22,"seq":94489280538,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32936,"kb_used_data":1820,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94338904,"statfs":{"total":96636764160,"available":96603037696,"internally_reserved":0,"allocated":1863680,"data_stored":1078641,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31848903},"hb_peers":[0,1,5,7,8,9,11,12,13,14],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Apr 18 14:44:30 2024","interfaces":[{"interface":"back","average":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":1.5629999999999999,"5min":1.5629999999999999,"15min":1.5629999999999999},"last":0.55200000000000005},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":1.006,"5min":1.006,"15min":1.006},"last":0.59499999999999997}]},{"osd":1,"last update":"Thu Apr 18 14:44:19 2024","interfaces":[{"interface":"back","average":{"1min":1.0329999999999999,"5min":1.0329999999999999,"15min":1.0329999999999999},"min":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"max":{"1min":1.633,"5min":1.633,"15min":1.633},"last":0.88600000000000001},{"interface":"front","average":{"1min":1.129,"5min":1.129,"15min":1.129},"min":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"max":{"1min":1.585,"5min":1.585,"15min":1.585},"last":1.345}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95399999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86599999999999999}]},{"osd":5,"last update":"Thu Apr 18 14:44:19 2024","interfaces":[{"interface":"back","average":{"1min":0.96399999999999997,"5min":0.96399999999999997,"15min":0.96399999999999997},"min":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":1.627,"5min":1.627,"15min":1.627},"last":0.69399999999999995},{"interface":"front","average":{"1min":0.98199999999999998,"5min":0.98199999999999998,"15min":0.98199999999999998},"min":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"max":{"1min":1.246,"5min":1.246,"15min":1.246},"last":1.2210000000000001}]},{"osd":7,"last update":"Thu Apr 18 14:44:19 2024","interfaces":[{"interface":"back","average":{"1min":1.1399999999999999,"5min":1.1399999999999999,"15min":1.1399999999999999},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.5860000000000001,"5min":1.5860000000000001,"15min":1.5860000000000001},"last":1.4059999999999999},{"interface":"front","average":{"1min":1.022,"5min":1.022,"15min":1.022},"min":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":1.482,"5min":1.482,"15min":1.482},"last":1.0569999999999999}]},{"osd":8,"last update":"Thu Apr 18 14:44:19 2024","interfaces":[{"interface":"back","average":{"1min":0.99299999999999999,"5min":0.99299999999999999,"15min":0.99299999999999999},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.3380000000000001,"5min":1.3380000000000001,"15min":1.3380000000000001},"last":0.753},{"interface":"front","average":{"1min":1.163,"5min":1.163,"15min":1.163},"min":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"max":{"1min":1.673,"5min":1.673,"15min":1.673},"last":0.84699999999999998}]},{"osd":9,"last update":"Thu Apr 18 14:44:30 2024","interfaces":[{"interface":"back","average":{"1min":1.1279999999999999,"5min":1.1279999999999999,"15min":1.1279999999999999},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.3859999999999999,"5min":1.3859999999999999,"15min":1.3859999999999999},"last":0.80300000000000005},{"interface":"front","average":{"1min":1.1870000000000001,"5min":1.1870000000000001,"15min":1.1870000000000001},"min":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"max":{"1min":1.5640000000000001,"5min":1.5640000000000001,"15min":1.5640000000000001},"last":1.298}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3240000000000001}]},{"osd":11,"last update":"Thu Apr 18 14:44:17 2024","interfaces":[{"interface":"back","average":{"1min":1.359,"5min":1.359,"15min":1.359},"min":{"1min":1.0229999999999999,"5min":1.0229999999999999,"15min":1.0229999999999999},"max":{"1min":2.3610000000000002,"5min":2.3610000000000002,"15min":2.3610000000000002},"last":1.151},{"interface":"front","average":{"1min":1.1439999999999999,"5min":1.1439999999999999,"15min":1.1439999999999999},"min":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"max":{"1min":1.698,"5min":1.698,"15min":1.698},"last":1.1859999999999999}]},{"osd":12,"last update":"Thu Apr 18 14:44:17 2024","interfaces":[{"interface":"back","average":{"1min":1.1950000000000001,"5min":1.1950000000000001,"15min":1.1950000000000001},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.5189999999999999,"5min":1.5189999999999999,"15min":1.5189999999999999},"last":1.0860000000000001},{"interface":"front","average":{"1min":1.3400000000000001,"5min":1.3400000000000001,"15min":1.3400000000000001},"min":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"max":{"1min":2.1920000000000002,"5min":2.1920000000000002,"15min":2.1920000000000002},"last":1.272}]},{"osd":13,"last update":"Thu Apr 18 14:44:30 2024","interfaces":[{"interface":"back","average":{"1min":1.4139999999999999,"5min":1.4139999999999999,"15min":1.4139999999999999},"min":{"1min":1.0309999999999999,"5min":1.0309999999999999,"15min":1.0309999999999999},"max":{"1min":1.794,"5min":1.794,"15min":1.794},"last":1.498},{"interface":"front","average":{"1min":1.29,"5min":1.29,"15min":1.29},"min":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":0.94599999999999995},"max":{"1min":1.591,"5min":1.591,"15min":1.591},"last":1.2470000000000001}]},{"osd":14,"last update":"Thu Apr 18 14:44:17 2024","interfaces":[{"interface":"back","average":{"1min":1.3280000000000001,"5min":1.3280000000000001,"15min":1.3280000000000001},"min":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"max":{"1min":1.8580000000000001,"5min":1.8580000000000001,"15min":1.8580000000000001},"last":1.5600000000000001},{"interface":"front","average":{"1min":1.347,"5min":1.347,"15min":1.347},"min":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":1.712,"5min":1.712,"15min":1.712},"last":1.325}]}]},{"osd":10,"up_from":22,"seq":94489280539,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32952,"kb_used_data":1832,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94338888,"statfs":{"total":96636764160,"available":96603021312,"internally_reserved":0,"allocated":1875968,"data_stored":1087311,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1599,"internal_metadata":31848897},"hb_peers":[1,6,7,8,9,11,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89700000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.371}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.117}]},{"osd":6,"last update":"Thu Apr 18 14:44:20 2024","interfaces":[{"interface":"back","average":{"1min":1.1830000000000001,"5min":1.1830000000000001,"15min":1.1830000000000001},"min":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"max":{"1min":3.9830000000000001,"5min":3.9830000000000001,"15min":3.9830000000000001},"last":0.83899999999999997},{"interface":"front","average":{"1min":1.0309999999999999,"5min":1.0309999999999999,"15min":1.0309999999999999},"min":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"max":{"1min":2.9420000000000002,"5min":2.9420000000000002,"15min":2.9420000000000002},"last":0.93899999999999995}]},{"osd":7,"last update":"Thu Apr 18 14:44:32 2024","interfaces":[{"interface":"back","average":{"1min":1.1870000000000001,"5min":1.1870000000000001,"15min":1.1870000000000001},"min":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":3.3679999999999999,"5min":3.3679999999999999,"15min":3.3679999999999999},"last":1.1080000000000001},{"interface":"front","average":{"1min":1.2190000000000001,"5min":1.2190000000000001,"15min":1.2190000000000001},"min":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"max":{"1min":3.1669999999999998,"5min":3.1669999999999998,"15min":3.1669999999999998},"last":1.357}]},{"osd":8,"last update":"Thu Apr 18 14:44:20 2024","interfaces":[{"interface":"back","average":{"1min":1.091,"5min":1.091,"15min":1.091},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":4.0439999999999996,"5min":4.0439999999999996,"15min":4.0439999999999996},"last":1.0800000000000001},{"interface":"front","average":{"1min":1.4390000000000001,"5min":1.4390000000000001,"15min":1.4390000000000001},"min":{"1min":0.89500000000000002,"5min":0.89500000000000002,"15min":0.89500000000000002},"max":{"1min":4.4900000000000002,"5min":4.4900000000000002,"15min":4.4900000000000002},"last":1.167}]},{"osd":9,"last update":"Thu Apr 18 14:44:20 2024","interfaces":[{"interface":"back","average":{"1min":1.3580000000000001,"5min":1.3580000000000001,"15min":1.3580000000000001},"min":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"max":{"1min":3.8439999999999999,"5min":3.8439999999999999,"15min":3.8439999999999999},"last":1.4570000000000001},{"interface":"front","average":{"1min":1.361,"5min":1.361,"15min":1.361},"min":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"max":{"1min":4.2880000000000003,"5min":4.2880000000000003,"15min":4.2880000000000003},"last":1.286}]},{"osd":11,"last update":"Thu Apr 18 14:44:20 2024","interfaces":[{"interface":"back","average":{"1min":1.4159999999999999,"5min":1.4159999999999999,"15min":1.4159999999999999},"min":{"1min":0.755,"5min":0.755,"15min":0.755},"max":{"1min":4.3399999999999999,"5min":4.3399999999999999,"15min":4.3399999999999999},"last":1.4039999999999999},{"interface":"front","average":{"1min":1.5740000000000001,"5min":1.5740000000000001,"15min":1.5740000000000001},"min":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"max":{"1min":4.4450000000000003,"5min":4.4450000000000003,"15min":4.4450000000000003},"last":1.7130000000000001}]},{"osd":12,"last update":"Thu Apr 18 14:44:20 2024","interfaces":[{"interface":"back","average":{"1min":1.3440000000000001,"5min":1.3440000000000001,"15min":1.3440000000000001},"min":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"max":{"1min":3.5539999999999998,"5min":3.5539999999999998,"15min":3.5539999999999998},"last":1.774},{"interface":"front","average":{"1min":1.431,"5min":1.431,"15min":1.431},"min":{"1min":0.621,"5min":0.621,"15min":0.621},"max":{"1min":4.125,"5min":4.125,"15min":4.125},"last":1.546}]},{"osd":13,"last update":"Thu Apr 18 14:44:20 2024","interfaces":[{"interface":"back","average":{"1min":1.71,"5min":1.71,"15min":1.71},"min":{"1min":1.1160000000000001,"5min":1.1160000000000001,"15min":1.1160000000000001},"max":{"1min":4.5359999999999996,"5min":4.5359999999999996,"15min":4.5359999999999996},"last":1.506},{"interface":"front","average":{"1min":1.5429999999999999,"5min":1.5429999999999999,"15min":1.5429999999999999},"min":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.85599999999999998},"max":{"1min":4.0049999999999999,"5min":4.0049999999999999,"15min":4.0049999999999999},"last":1.847}]},{"osd":14,"last update":"Thu Apr 18 14:44:20 2024","interfaces":[{"interface":"back","average":{"1min":1.7090000000000001,"5min":1.7090000000000001,"15min":1.7090000000000001},"min":{"1min":1.073,"5min":1.073,"15min":1.073},"max":{"1min":4.3940000000000001,"5min":4.3940000000000001,"15min":4.3940000000000001},"last":1.879},{"interface":"front","average":{"1min":1.5680000000000001,"5min":1.5680000000000001,"15min":1.5680000000000001},"min":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"max":{"1min":3.73,"5min":3.73,"15min":3.73},"last":1.897}]},{"osd":15,"last update":"Thu Apr 18 14:44:20 2024","interfaces":[{"interface":"back","average":{"1min":1.5629999999999999,"5min":1.5629999999999999,"15min":1.5629999999999999},"min":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":0.94999999999999996},"max":{"1min":4.1959999999999997,"5min":4.1959999999999997,"15min":4.1959999999999997},"last":1.748},{"interface":"front","average":{"1min":1.802,"5min":1.802,"15min":1.802},"min":{"1min":1.1579999999999999,"5min":1.1579999999999999,"15min":1.1579999999999999},"max":{"1min":4.577,"5min":4.577,"15min":4.577},"last":1.8100000000000001}]}]},{"osd":11,"up_from":22,"seq":94489280539,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32932,"kb_used_data":1816,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94338908,"statfs":{"total":96636764160,"available":96603041792,"internally_reserved":0,"allocated":1859584,"data_stored":1077797,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31848901},"hb_peers":[2,4,5,6,8,10,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":2,"last update":"Thu Apr 18 14:44:18 2024","interfaces":[{"interface":"back","average":{"1min":0.93899999999999995,"5min":0.93899999999999995,"15min":0.93899999999999995},"min":{"1min":0.503,"5min":0.503,"15min":0.503},"max":{"1min":1.367,"5min":1.367,"15min":1.367},"last":1.224},{"interface":"front","average":{"1min":1.0229999999999999,"5min":1.0229999999999999,"15min":1.0229999999999999},"min":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":2.863,"5min":2.863,"15min":2.863},"last":0.86099999999999999}]},{"osd":4,"last update":"Thu Apr 18 14:44:18 2024","interfaces":[{"interface":"back","average":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"min":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":1.1259999999999999,"5min":1.1259999999999999,"15min":1.1259999999999999},"last":0.79000000000000004},{"interface":"front","average":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.129,"5min":1.129,"15min":1.129},"last":0.66700000000000004}]},{"osd":5,"last update":"Thu Apr 18 14:44:23 2024","interfaces":[{"interface":"back","average":{"1min":0.98999999999999999,"5min":0.98999999999999999,"15min":0.98999999999999999},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":1.5840000000000001,"5min":1.5840000000000001,"15min":1.5840000000000001},"last":1.2729999999999999},{"interface":"front","average":{"1min":0.97199999999999998,"5min":0.97199999999999998,"15min":0.97199999999999998},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.619,"5min":1.619,"15min":1.619},"last":1.4330000000000001}]},{"osd":6,"last update":"Thu Apr 18 14:44:18 2024","interfaces":[{"interface":"back","average":{"1min":1.1319999999999999,"5min":1.1319999999999999,"15min":1.1319999999999999},"min":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"max":{"1min":2.9199999999999999,"5min":2.9199999999999999,"15min":2.9199999999999999},"last":1.464},{"interface":"front","average":{"1min":1,"5min":1,"15min":1},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.9510000000000001,"5min":1.9510000000000001,"15min":1.9510000000000001},"last":1.363}]},{"osd":8,"last update":"Thu Apr 18 14:44:23 2024","interfaces":[{"interface":"back","average":{"1min":0.97799999999999998,"5min":0.97799999999999998,"15min":0.97799999999999998},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.452,"5min":1.452,"15min":1.452},"last":0.96599999999999997},{"interface":"front","average":{"1min":1.006,"5min":1.006,"15min":1.006},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":1.383,"5min":1.383,"15min":1.383},"last":1.5669999999999999}]},{"osd":10,"last update":"Thu Apr 18 14:44:18 2024","interfaces":[{"interface":"back","average":{"1min":1.234,"5min":1.234,"15min":1.234},"min":{"1min":0.745,"5min":0.745,"15min":0.745},"max":{"1min":2.774,"5min":2.774,"15min":2.774},"last":1.595},{"interface":"front","average":{"1min":1.105,"5min":1.105,"15min":1.105},"min":{"1min":0.627,"5min":0.627,"15min":0.627},"max":{"1min":1.6890000000000001,"5min":1.6890000000000001,"15min":1.6890000000000001},"last":1.4990000000000001}]},{"osd":12,"last update":"Thu Apr 18 14:44:18 2024","interfaces":[{"interface":"back","average":{"1min":1.1639999999999999,"5min":1.1639999999999999,"15min":1.1639999999999999},"min":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.6719999999999999,"5min":1.6719999999999999,"15min":1.6719999999999999},"last":2.0270000000000001},{"interface":"front","average":{"1min":1.2729999999999999,"5min":1.2729999999999999,"15min":1.2729999999999999},"min":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"max":{"1min":3.4169999999999998,"5min":3.4169999999999998,"15min":3.4169999999999998},"last":1.738}]},{"osd":13,"last update":"Thu Apr 18 14:44:23 2024","interfaces":[{"interface":"back","average":{"1min":1.367,"5min":1.367,"15min":1.367},"min":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"max":{"1min":3.3239999999999998,"5min":3.3239999999999998,"15min":3.3239999999999998},"last":1.9410000000000001},{"interface":"front","average":{"1min":1.1639999999999999,"5min":1.1639999999999999,"15min":1.1639999999999999},"min":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"max":{"1min":1.746,"5min":1.746,"15min":1.746},"last":1.6619999999999999}]},{"osd":14,"last update":"Thu Apr 18 14:44:18 2024","interfaces":[{"interface":"back","average":{"1min":1.1950000000000001,"5min":1.1950000000000001,"15min":1.1950000000000001},"min":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"max":{"1min":1.6619999999999999,"5min":1.6619999999999999,"15min":1.6619999999999999},"last":1.8899999999999999},{"interface":"front","average":{"1min":1.2450000000000001,"5min":1.2450000000000001,"15min":1.2450000000000001},"min":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"max":{"1min":1.7210000000000001,"5min":1.7210000000000001,"15min":1.7210000000000001},"last":1.9750000000000001}]},{"osd":15,"last update":"Thu Apr 18 14:44:23 2024","interfaces":[{"interface":"back","average":{"1min":1.284,"5min":1.284,"15min":1.284},"min":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"max":{"1min":1.851,"5min":1.851,"15min":1.851},"last":1.8320000000000001},{"interface":"front","average":{"1min":1.409,"5min":1.409,"15min":1.409},"min":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"max":{"1min":3.3769999999999998,"5min":3.3769999999999998,"15min":3.3769999999999998},"last":2.1520000000000001}]}]},{"osd":12,"up_from":22,"seq":94489280539,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32932,"kb_used_data":1816,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94338908,"statfs":{"total":96636764160,"available":96603041792,"internally_reserved":0,"allocated":1859584,"data_stored":1077797,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[1,3,4,5,6,10,11,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Apr 18 14:44:30 2024","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":1.3400000000000001,"5min":1.3400000000000001,"15min":1.3400000000000001},"last":0.68100000000000005},{"interface":"front","average":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":1.2310000000000001,"5min":1.2310000000000001,"15min":1.2310000000000001},"last":0.78900000000000003}]},{"osd":1,"last update":"Thu Apr 18 14:44:20 2024","interfaces":[{"interface":"back","average":{"1min":0.93999999999999995,"5min":0.93999999999999995,"15min":0.93999999999999995},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.5449999999999999,"5min":1.5449999999999999,"15min":1.5449999999999999},"last":0.61799999999999999},{"interface":"front","average":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":1.2649999999999999,"5min":1.2649999999999999,"15min":1.2649999999999999},"last":0.85399999999999998}]},{"osd":3,"last update":"Thu Apr 18 14:44:20 2024","interfaces":[{"interface":"back","average":{"1min":0.93999999999999995,"5min":0.93999999999999995,"15min":0.93999999999999995},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":1.4930000000000001,"5min":1.4930000000000001,"15min":1.4930000000000001},"last":0.81200000000000006},{"interface":"front","average":{"1min":0.91500000000000004,"5min":0.91500000000000004,"15min":0.91500000000000004},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.4319999999999999,"5min":1.4319999999999999,"15min":1.4319999999999999},"last":0.95299999999999996}]},{"osd":4,"last update":"Thu Apr 18 14:44:20 2024","interfaces":[{"interface":"back","average":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":1.383,"5min":1.383,"15min":1.383},"last":0.76300000000000001},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":1.335,"5min":1.335,"15min":1.335},"last":0.57699999999999996}]},{"osd":5,"last update":"Thu Apr 18 14:44:30 2024","interfaces":[{"interface":"back","average":{"1min":0.93100000000000005,"5min":0.93100000000000005,"15min":0.93100000000000005},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.4710000000000001,"5min":1.4710000000000001,"15min":1.4710000000000001},"last":0.99399999999999999},{"interface":"front","average":{"1min":1.03,"5min":1.03,"15min":1.03},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.784,"5min":1.784,"15min":1.784},"last":1.284}]},{"osd":6,"last update":"Thu Apr 18 14:44:20 2024","interfaces":[{"interface":"back","average":{"1min":1.0289999999999999,"5min":1.0289999999999999,"15min":1.0289999999999999},"min":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":1.6060000000000001,"5min":1.6060000000000001,"15min":1.6060000000000001},"last":0.92800000000000005},{"interface":"front","average":{"1min":1.0820000000000001,"5min":1.0820000000000001,"15min":1.0820000000000001},"min":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"max":{"1min":1.5620000000000001,"5min":1.5620000000000001,"15min":1.5620000000000001},"last":1.022}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1539999999999999}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4119999999999999}]},{"osd":10,"last update":"Thu Apr 18 14:44:20 2024","interfaces":[{"interface":"back","average":{"1min":1.137,"5min":1.137,"15min":1.137},"min":{"1min":0.626,"5min":0.626,"15min":0.626},"max":{"1min":1.6919999999999999,"5min":1.6919999999999999,"15min":1.6919999999999999},"last":0.89800000000000002},{"interface":"front","average":{"1min":1.1100000000000001,"5min":1.1100000000000001,"15min":1.1100000000000001},"min":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"max":{"1min":1.8899999999999999,"5min":1.8899999999999999,"15min":1.8899999999999999},"last":1.0680000000000001}]},{"osd":11,"last update":"Thu Apr 18 14:44:20 2024","interfaces":[{"interface":"back","average":{"1min":1.1890000000000001,"5min":1.1890000000000001,"15min":1.1890000000000001},"min":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"max":{"1min":2.04,"5min":2.04,"15min":2.04},"last":1.1519999999999999},{"interface":"front","average":{"1min":1.1599999999999999,"5min":1.1599999999999999,"15min":1.1599999999999999},"min":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"max":{"1min":1.8660000000000001,"5min":1.8660000000000001,"15min":1.8660000000000001},"last":1.093}]},{"osd":13,"last update":"Thu Apr 18 14:44:20 2024","interfaces":[{"interface":"back","average":{"1min":1.181,"5min":1.181,"15min":1.181},"min":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"max":{"1min":1.8080000000000001,"5min":1.8080000000000001,"15min":1.8080000000000001},"last":1.1120000000000001},{"interface":"front","average":{"1min":1.228,"5min":1.228,"15min":1.228},"min":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"max":{"1min":2.133,"5min":2.133,"15min":2.133},"last":1.2529999999999999}]},{"osd":14,"last update":"Thu Apr 18 14:44:20 2024","interfaces":[{"interface":"back","average":{"1min":1.226,"5min":1.226,"15min":1.226},"min":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"max":{"1min":1.7410000000000001,"5min":1.7410000000000001,"15min":1.7410000000000001},"last":1.1919999999999999},{"interface":"front","average":{"1min":1.232,"5min":1.232,"15min":1.232},"min":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"max":{"1min":1.966,"5min":1.966,"15min":1.966},"last":1.319}]},{"osd":15,"last update":"Thu Apr 18 14:44:20 2024","interfaces":[{"interface":"back","average":{"1min":1.2190000000000001,"5min":1.2190000000000001,"15min":1.2190000000000001},"min":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"max":{"1min":1.802,"5min":1.802,"15min":1.802},"last":1.1739999999999999},{"interface":"front","average":{"1min":1.2889999999999999,"5min":1.2889999999999999,"15min":1.2889999999999999},"min":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"max":{"1min":1.8580000000000001,"5min":1.8580000000000001,"15min":1.8580000000000001},"last":1.3620000000000001}]}]},{"osd":0,"up_from":23,"seq":98784247835,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33468,"kb_used_data":2352,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94338372,"statfs":{"total":96636764160,"available":96602492928,"internally_reserved":0,"allocated":2408448,"data_stored":1616239,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[1,4,6,7,8,10,11,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Apr 18 14:44:23 2024","interfaces":[{"interface":"back","average":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":1.218,"5min":1.218,"15min":1.218},"last":1.026},{"interface":"front","average":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.47,"5min":1.47,"15min":1.47},"last":1.056}]},{"osd":4,"last update":"Thu Apr 18 14:44:19 2024","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":1.5409999999999999,"5min":1.5409999999999999,"15min":1.5409999999999999},"last":0.61499999999999999},{"interface":"front","average":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":1.903,"5min":1.903,"15min":1.903},"last":0.64000000000000001}]},{"osd":6,"last update":"Thu Apr 18 14:44:19 2024","interfaces":[{"interface":"back","average":{"1min":0.90200000000000002,"5min":0.90200000000000002,"15min":0.90200000000000002},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":2.5009999999999999,"5min":2.5009999999999999,"15min":2.5009999999999999},"last":0.96399999999999997},{"interface":"front","average":{"1min":0.89500000000000002,"5min":0.89500000000000002,"15min":0.89500000000000002},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":1.6240000000000001,"5min":1.6240000000000001,"15min":1.6240000000000001},"last":0.91100000000000003}]},{"osd":7,"last update":"Thu Apr 18 14:44:19 2024","interfaces":[{"interface":"back","average":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":1.2350000000000001,"5min":1.2350000000000001,"15min":1.2350000000000001},"last":0.71499999999999997},{"interface":"front","average":{"1min":0.93899999999999995,"5min":0.93899999999999995,"15min":0.93899999999999995},"min":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"max":{"1min":1.5860000000000001,"5min":1.5860000000000001,"15min":1.5860000000000001},"last":0.78800000000000003}]},{"osd":8,"last update":"Thu Apr 18 14:44:19 2024","interfaces":[{"interface":"back","average":{"1min":1.734,"5min":1.734,"15min":1.734},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":18.015999999999998,"5min":18.015999999999998,"15min":18.015999999999998},"last":0.73099999999999998},{"interface":"front","average":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":1.6599999999999999,"5min":1.6599999999999999,"15min":1.6599999999999999},"last":0.57499999999999996}]},{"osd":10,"last update":"Thu Apr 18 14:44:19 2024","interfaces":[{"interface":"back","average":{"1min":1.0960000000000001,"5min":1.0960000000000001,"15min":1.0960000000000001},"min":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"max":{"1min":2.1339999999999999,"5min":2.1339999999999999,"15min":2.1339999999999999},"last":1.1020000000000001},{"interface":"front","average":{"1min":1.119,"5min":1.119,"15min":1.119},"min":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"max":{"1min":1.8540000000000001,"5min":1.8540000000000001,"15min":1.8540000000000001},"last":0.94999999999999996}]},{"osd":11,"last update":"Thu Apr 18 14:44:19 2024","interfaces":[{"interface":"back","average":{"1min":2.9990000000000001,"5min":2.9990000000000001,"15min":2.9990000000000001},"min":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":41.195999999999998,"5min":41.195999999999998,"15min":41.195999999999998},"last":0.85699999999999998},{"interface":"front","average":{"1min":3.1339999999999999,"5min":3.1339999999999999,"15min":3.1339999999999999},"min":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"max":{"1min":41.216999999999999,"5min":41.216999999999999,"15min":41.216999999999999},"last":1}]},{"osd":13,"last update":"Thu Apr 18 14:44:23 2024","interfaces":[{"interface":"back","average":{"1min":0.95099999999999996,"5min":0.95099999999999996,"15min":0.95099999999999996},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":1.881,"5min":1.881,"15min":1.881},"last":0.748},{"interface":"front","average":{"1min":1.091,"5min":1.091,"15min":1.091},"min":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":1.8720000000000001,"5min":1.8720000000000001,"15min":1.8720000000000001},"last":0.82299999999999995}]},{"osd":14,"last update":"Thu Apr 18 14:44:19 2024","interfaces":[{"interface":"back","average":{"1min":1.103,"5min":1.103,"15min":1.103},"min":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"max":{"1min":1.95,"5min":1.95,"15min":1.95},"last":0.77400000000000002},{"interface":"front","average":{"1min":1.095,"5min":1.095,"15min":1.095},"min":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"max":{"1min":2.1219999999999999,"5min":2.1219999999999999,"15min":2.1219999999999999},"last":0.89000000000000001}]},{"osd":15,"last update":"Thu Apr 18 14:44:19 2024","interfaces":[{"interface":"back","average":{"1min":1.224,"5min":1.224,"15min":1.224},"min":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"max":{"1min":1.929,"5min":1.929,"15min":1.929},"last":0.93000000000000005},{"interface":"front","average":{"1min":1.179,"5min":1.179,"15min":1.179},"min":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":2.056,"5min":2.056,"15min":2.056},"last":0.97799999999999998}]}]},{"osd":3,"up_from":23,"seq":98784247834,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32956,"kb_used_data":1836,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94338884,"statfs":{"total":96636764160,"available":96603017216,"internally_reserved":0,"allocated":1880064,"data_stored":1088155,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31848904},"hb_peers":[0,2,4,5,8,9,10,11,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Apr 18 14:44:20 2024","interfaces":[{"interface":"back","average":{"1min":0.88200000000000001,"5min":0.88200000000000001,"15min":0.88200000000000001},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":1.4510000000000001,"5min":1.4510000000000001,"15min":1.4510000000000001},"last":1.387},{"interface":"front","average":{"1min":1,"5min":1,"15min":1},"min":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"max":{"1min":1.4850000000000001,"5min":1.4850000000000001,"15min":1.4850000000000001},"last":1.1719999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4590000000000001}]},{"osd":2,"last update":"Thu Apr 18 14:44:20 2024","interfaces":[{"interface":"back","average":{"1min":0.98599999999999999,"5min":0.98599999999999999,"15min":0.98599999999999999},"min":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.5469999999999999,"5min":1.5469999999999999,"15min":1.5469999999999999},"last":0.70399999999999996},{"interface":"front","average":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":0.94999999999999996},"min":{"1min":0.623,"5min":0.623,"15min":0.623},"max":{"1min":1.425,"5min":1.425,"15min":1.425},"last":0.95899999999999996}]},{"osd":4,"last update":"Thu Apr 18 14:44:20 2024","interfaces":[{"interface":"back","average":{"1min":1.008,"5min":1.008,"15min":1.008},"min":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.7030000000000001,"5min":1.7030000000000001,"15min":1.7030000000000001},"last":0.80000000000000004},{"interface":"front","average":{"1min":0.98699999999999999,"5min":0.98699999999999999,"15min":0.98699999999999999},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":1.5309999999999999,"5min":1.5309999999999999,"15min":1.5309999999999999},"last":0.92200000000000004}]},{"osd":5,"last update":"Thu Apr 18 14:44:20 2024","interfaces":[{"interface":"back","average":{"1min":1.087,"5min":1.087,"15min":1.087},"min":{"1min":0.624,"5min":0.624,"15min":0.624},"max":{"1min":1.663,"5min":1.663,"15min":1.663},"last":1.1379999999999999},{"interface":"front","average":{"1min":1.206,"5min":1.206,"15min":1.206},"min":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":1.6779999999999999,"5min":1.6779999999999999,"15min":1.6779999999999999},"last":1.2609999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.472}]},{"osd":7,"last update":"Thu Apr 18 14:44:20 2024","interfaces":[{"interface":"back","average":{"1min":1.157,"5min":1.157,"15min":1.157},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.645,"5min":1.645,"15min":1.645},"last":0.82199999999999995},{"interface":"front","average":{"1min":1.115,"5min":1.115,"15min":1.115},"min":{"1min":0.503,"5min":0.503,"15min":0.503},"max":{"1min":1.6419999999999999,"5min":1.6419999999999999,"15min":1.6419999999999999},"last":0.90800000000000003}]},{"osd":8,"last update":"Thu Apr 18 14:44:20 2024","interfaces":[{"interface":"back","average":{"1min":1.1339999999999999,"5min":1.1339999999999999,"15min":1.1339999999999999},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.7529999999999999,"5min":1.7529999999999999,"15min":1.7529999999999999},"last":1.232},{"interface":"front","average":{"1min":1.304,"5min":1.304,"15min":1.304},"min":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"max":{"1min":1.7430000000000001,"5min":1.7430000000000001,"15min":1.7430000000000001},"last":1.359}]},{"osd":9,"last update":"Thu Apr 18 14:44:33 2024","interfaces":[{"interface":"back","average":{"1min":1.3,"5min":1.3,"15min":1.3},"min":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"max":{"1min":1.879,"5min":1.879,"15min":1.879},"last":1.0069999999999999},{"interface":"front","average":{"1min":1.254,"5min":1.254,"15min":1.254},"min":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"max":{"1min":1.8260000000000001,"5min":1.8260000000000001,"15min":1.8260000000000001},"last":1.4750000000000001}]},{"osd":10,"last update":"Thu Apr 18 14:44:20 2024","interfaces":[{"interface":"back","average":{"1min":1.327,"5min":1.327,"15min":1.327},"min":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"max":{"1min":1.883,"5min":1.883,"15min":1.883},"last":1.2889999999999999},{"interface":"front","average":{"1min":1.3660000000000001,"5min":1.3660000000000001,"15min":1.3660000000000001},"min":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"max":{"1min":2.161,"5min":2.161,"15min":2.161},"last":1.663}]},{"osd":11,"last update":"Thu Apr 18 14:44:20 2024","interfaces":[{"interface":"back","average":{"1min":1.4330000000000001,"5min":1.4330000000000001,"15min":1.4330000000000001},"min":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"max":{"1min":1.8959999999999999,"5min":1.8959999999999999,"15min":1.8959999999999999},"last":1.419},{"interface":"front","average":{"1min":1.381,"5min":1.381,"15min":1.381},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":2.1160000000000001,"5min":2.1160000000000001,"15min":2.1160000000000001},"last":1.0720000000000001}]},{"osd":12,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.8740000000000001}]},{"osd":14,"last update":"Thu Apr 18 14:44:20 2024","interfaces":[{"interface":"back","average":{"1min":1.512,"5min":1.512,"15min":1.512},"min":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":0.94999999999999996},"max":{"1min":2.2879999999999998,"5min":2.2879999999999998,"15min":2.2879999999999998},"last":1.5760000000000001},{"interface":"front","average":{"1min":1.4139999999999999,"5min":1.4139999999999999,"15min":1.4139999999999999},"min":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"max":{"1min":2.0179999999999998,"5min":2.0179999999999998,"15min":2.0179999999999998},"last":1.7270000000000001}]},{"osd":15,"last update":"Thu Apr 18 14:44:33 2024","interfaces":[{"interface":"back","average":{"1min":1.4730000000000001,"5min":1.4730000000000001,"15min":1.4730000000000001},"min":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"max":{"1min":2.1120000000000001,"5min":2.1120000000000001,"15min":2.1120000000000001},"last":1.786},{"interface":"front","average":{"1min":1.452,"5min":1.452,"15min":1.452},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.9299999999999999,"5min":1.9299999999999999,"15min":1.9299999999999999},"last":1.496}]}]},{"osd":7,"up_from":23,"seq":98784247836,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32952,"kb_used_data":1832,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94338888,"statfs":{"total":96636764160,"available":96603021312,"internally_reserved":0,"allocated":1875968,"data_stored":1087311,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":31848907},"hb_peers":[0,2,3,4,5,6,8,10,12,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Apr 18 14:44:34 2024","interfaces":[{"interface":"back","average":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":1.109,"5min":1.109,"15min":1.109},"last":0.70199999999999996},{"interface":"front","average":{"1min":0.873,"5min":0.873,"15min":0.873},"min":{"1min":0.505,"5min":0.505,"15min":0.505},"max":{"1min":1.7589999999999999,"5min":1.7589999999999999,"15min":1.7589999999999999},"last":0.67400000000000004}]},{"osd":2,"last update":"Thu Apr 18 14:44:21 2024","interfaces":[{"interface":"back","average":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"min":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":1.1519999999999999,"5min":1.1519999999999999,"15min":1.1519999999999999},"last":0.78900000000000003},{"interface":"front","average":{"1min":0.97599999999999998,"5min":0.97599999999999998,"15min":0.97599999999999998},"min":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"max":{"1min":1.891,"5min":1.891,"15min":1.891},"last":0.91900000000000004}]},{"osd":3,"last update":"Thu Apr 18 14:44:34 2024","interfaces":[{"interface":"back","average":{"1min":0.88200000000000001,"5min":0.88200000000000001,"15min":0.88200000000000001},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.5920000000000001,"5min":1.5920000000000001,"15min":1.5920000000000001},"last":0.58499999999999996},{"interface":"front","average":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":1.2330000000000001,"5min":1.2330000000000001,"15min":1.2330000000000001},"last":0.875}]},{"osd":4,"last update":"Thu Apr 18 14:44:21 2024","interfaces":[{"interface":"back","average":{"1min":0.95699999999999996,"5min":0.95699999999999996,"15min":0.95699999999999996},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.258,"5min":1.258,"15min":1.258},"last":1.091},{"interface":"front","average":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":1.2170000000000001,"5min":1.2170000000000001,"15min":1.2170000000000001},"last":1.0620000000000001}]},{"osd":5,"last update":"Thu Apr 18 14:44:21 2024","interfaces":[{"interface":"back","average":{"1min":1.1140000000000001,"5min":1.1140000000000001,"15min":1.1140000000000001},"min":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"max":{"1min":1.8580000000000001,"5min":1.8580000000000001,"15min":1.8580000000000001},"last":1.022},{"interface":"front","average":{"1min":1.1120000000000001,"5min":1.1120000000000001,"15min":1.1120000000000001},"min":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"max":{"1min":1.53,"5min":1.53,"15min":1.53},"last":0.95299999999999996}]},{"osd":6,"last update":"Thu Apr 18 14:44:21 2024","interfaces":[{"interface":"back","average":{"1min":1.139,"5min":1.139,"15min":1.139},"min":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"max":{"1min":1.8759999999999999,"5min":1.8759999999999999,"15min":1.8759999999999999},"last":1.1160000000000001},{"interface":"front","average":{"1min":1.171,"5min":1.171,"15min":1.171},"min":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"max":{"1min":1.4570000000000001,"5min":1.4570000000000001,"15min":1.4570000000000001},"last":0.84699999999999998}]},{"osd":8,"last update":"Thu Apr 18 14:44:21 2024","interfaces":[{"interface":"back","average":{"1min":1.095,"5min":1.095,"15min":1.095},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":1.4159999999999999,"5min":1.4159999999999999,"15min":1.4159999999999999},"last":0.622},{"interface":"front","average":{"1min":1.274,"5min":1.274,"15min":1.274},"min":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"max":{"1min":1.821,"5min":1.821,"15min":1.821},"last":0.753}]},{"osd":10,"last update":"Thu Apr 18 14:44:21 2024","interfaces":[{"interface":"back","average":{"1min":1.151,"5min":1.151,"15min":1.151},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.831,"5min":1.831,"15min":1.831},"last":0.97699999999999998},{"interface":"front","average":{"1min":1.278,"5min":1.278,"15min":1.278},"min":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"max":{"1min":1.53,"5min":1.53,"15min":1.53},"last":0.996}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71699999999999997}]},{"osd":12,"last update":"Thu Apr 18 14:44:21 2024","interfaces":[{"interface":"back","average":{"1min":1.2270000000000001,"5min":1.2270000000000001,"15min":1.2270000000000001},"min":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.7549999999999999,"5min":1.7549999999999999,"15min":1.7549999999999999},"last":0.73099999999999998},{"interface":"front","average":{"1min":1.4039999999999999,"5min":1.4039999999999999,"15min":1.4039999999999999},"min":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"max":{"1min":2.0960000000000001,"5min":2.0960000000000001,"15min":2.0960000000000001},"last":0.81799999999999995}]},{"osd":14,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3819999999999999}]},{"osd":15,"last update":"Thu Apr 18 14:44:21 2024","interfaces":[{"interface":"back","average":{"1min":1.4330000000000001,"5min":1.4330000000000001,"15min":1.4330000000000001},"min":{"1min":0.874,"5min":0.874,"15min":0.874},"max":{"1min":2.6699999999999999,"5min":2.6699999999999999,"15min":2.6699999999999999},"last":1.1639999999999999},{"interface":"front","average":{"1min":1.401,"5min":1.401,"15min":1.401},"min":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":2.516,"5min":2.516,"15min":2.516},"last":1.1399999999999999}]}]},{"osd":8,"up_from":23,"seq":98784247836,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32956,"kb_used_data":1832,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94338884,"statfs":{"total":96636764160,"available":96603017216,"internally_reserved":0,"allocated":1875968,"data_stored":1087311,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[1,2,3,4,5,7,9,11,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Apr 18 14:44:32 2024","interfaces":[{"interface":"back","average":{"1min":0.746,"5min":0.746,"15min":0.746},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":1.7290000000000001,"5min":1.7290000000000001,"15min":1.7290000000000001},"last":2.4540000000000002},{"interface":"front","average":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":2.48,"5min":2.48,"15min":2.48},"last":2.1669999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72999999999999998}]},{"osd":2,"last update":"Thu Apr 18 14:44:22 2024","interfaces":[{"interface":"back","average":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":1.1339999999999999,"5min":1.1339999999999999,"15min":1.1339999999999999},"last":0.76600000000000001},{"interface":"front","average":{"1min":0.996,"5min":0.996,"15min":0.996},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":2.54,"5min":2.54,"15min":2.54},"last":0.50700000000000001}]},{"osd":3,"last update":"Thu Apr 18 14:44:32 2024","interfaces":[{"interface":"back","average":{"1min":0.88800000000000001,"5min":0.88800000000000001,"15min":0.88800000000000001},"min":{"1min":0.628,"5min":0.628,"15min":0.628},"max":{"1min":1.137,"5min":1.137,"15min":1.137},"last":0.70199999999999996},{"interface":"front","average":{"1min":1.0209999999999999,"5min":1.0209999999999999,"15min":1.0209999999999999},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":2.6779999999999999,"5min":2.6779999999999999,"15min":2.6779999999999999},"last":0.58999999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46899999999999997}]},{"osd":5,"last update":"Thu Apr 18 14:44:22 2024","interfaces":[{"interface":"back","average":{"1min":1.0549999999999999,"5min":1.0549999999999999,"15min":1.0549999999999999},"min":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":2.7810000000000001,"5min":2.7810000000000001,"15min":2.7810000000000001},"last":0.753},{"interface":"front","average":{"1min":0.91800000000000004,"5min":0.91800000000000004,"15min":0.91800000000000004},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.5309999999999999,"5min":1.5309999999999999,"15min":1.5309999999999999},"last":0.55500000000000005}]},{"osd":7,"last update":"Thu Apr 18 14:44:22 2024","interfaces":[{"interface":"back","average":{"1min":1.042,"5min":1.042,"15min":1.042},"min":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":1.925,"5min":1.925,"15min":1.925},"last":0.63400000000000001},{"interface":"front","average":{"1min":1.0800000000000001,"5min":1.0800000000000001,"15min":1.0800000000000001},"min":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"max":{"1min":1.669,"5min":1.669,"15min":1.669},"last":0.84199999999999997}]},{"osd":9,"last update":"Thu Apr 18 14:44:22 2024","interfaces":[{"interface":"back","average":{"1min":1.0249999999999999,"5min":1.0249999999999999,"15min":1.0249999999999999},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":1.6479999999999999,"5min":1.6479999999999999,"15min":1.6479999999999999},"last":0.64400000000000002},{"interface":"front","average":{"1min":1.163,"5min":1.163,"15min":1.163},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":2.9319999999999999,"5min":2.9319999999999999,"15min":2.9319999999999999},"last":0.53800000000000003}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.665}]},{"osd":11,"last update":"Thu Apr 18 14:44:22 2024","interfaces":[{"interface":"back","average":{"1min":1.206,"5min":1.206,"15min":1.206},"min":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"max":{"1min":2.1139999999999999,"5min":2.1139999999999999,"15min":2.1139999999999999},"last":0.85599999999999998},{"interface":"front","average":{"1min":1.2929999999999999,"5min":1.2929999999999999,"15min":1.2929999999999999},"min":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"max":{"1min":2.25,"5min":2.25,"15min":2.25},"last":0.79800000000000004}]},{"osd":12,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5629999999999999}]},{"osd":14,"last update":"Thu Apr 18 14:44:22 2024","interfaces":[{"interface":"back","average":{"1min":1.341,"5min":1.341,"15min":1.341},"min":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"max":{"1min":2.5800000000000001,"5min":2.5800000000000001,"15min":2.5800000000000001},"last":0.81999999999999995},{"interface":"front","average":{"1min":1.3919999999999999,"5min":1.3919999999999999,"15min":1.3919999999999999},"min":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"max":{"1min":3.0739999999999998,"5min":3.0739999999999998,"15min":3.0739999999999998},"last":0.81299999999999994}]},{"osd":15,"last update":"Thu Apr 18 14:44:22 2024","interfaces":[{"interface":"back","average":{"1min":1.355,"5min":1.355,"15min":1.355},"min":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"max":{"1min":2.4740000000000002,"5min":2.4740000000000002,"15min":2.4740000000000002},"last":0.878},{"interface":"front","average":{"1min":1.4159999999999999,"5min":1.4159999999999999,"15min":1.4159999999999999},"min":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"max":{"1min":2.8620000000000001,"5min":2.8620000000000001,"15min":2.8620000000000001},"last":0.78500000000000003}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":13,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":12,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":13,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":14,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":15,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-18T14:45:11.534 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-18T14:45:11.820 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-04-18T14:45:11.821 INFO:teuthology.orchestra.run.smithi086.stderr:dumped all 2024-04-18T14:45:11.837 INFO:teuthology.orchestra.run.smithi086.stdout:{"pg_ready":true,"pg_map":{"version":171,"stamp":"2024-04-18T14:45:11.370991+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":16,"num_per_pool_osds":16,"num_per_pool_omap_osds":11,"kb":1509949440,"kb_used":560224,"kb_used_data":30316,"kb_used_omap":24,"kb_used_meta":529639,"kb_avail":1509389216,"statfs":{"total":1546188226560,"available":1545614557184,"internally_reserved":0,"allocated":31043584,"data_stored":18422684,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":25506,"internal_metadata":542350430},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.538435"},"pg_stats":[{"pgid":"1.0","version":"26'157","reported_seq":308,"reported_epoch":124,"state":"active+clean","last_fresh":"2024-04-18T14:45:07.185100+0000","last_change":"2024-04-18T14:44:37.152954+0000","last_active":"2024-04-18T14:45:07.185100+0000","last_peered":"2024-04-18T14:45:07.185100+0000","last_clean":"2024-04-18T14:45:07.185100+0000","last_became_active":"2024-04-18T14:43:20.323133+0000","last_became_peered":"2024-04-18T14:43:20.323133+0000","last_unstale":"2024-04-18T14:45:07.185100+0000","last_undegraded":"2024-04-18T14:45:07.185100+0000","last_fullsized":"2024-04-18T14:45:07.185100+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'157","last_scrub_stamp":"2024-04-18T14:44:37.152696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T14:43:18.296821+0000","last_clean_scrub_stamp":"2024-04-18T14:44:37.152696+0000","objects_scrubbed":2,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T14:45:43.293239+0000","scrub_duration":0.0049794150000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[13,0],"acting":[13,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":13,"acting_primary":13,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":114,"reported_epoch":124,"state":"active+clean","last_fresh":"2024-04-18T14:45:05.843355+0000","last_change":"2024-04-18T14:44:23.449444+0000","last_active":"2024-04-18T14:45:05.843355+0000","last_peered":"2024-04-18T14:45:05.843355+0000","last_clean":"2024-04-18T14:45:05.843355+0000","last_became_active":"2024-04-18T14:43:21.327764+0000","last_became_peered":"2024-04-18T14:43:21.327764+0000","last_unstale":"2024-04-18T14:45:05.843355+0000","last_undegraded":"2024-04-18T14:45:05.843355+0000","last_fullsized":"2024-04-18T14:45:05.843355+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T14:44:23.449241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T14:43:20.303322+0000","last_clean_scrub_stamp":"2024-04-18T14:44:23.449241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T14:45:36.175611+0000","scrub_duration":0.0029048670000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,15],"acting":[5,15],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":111,"reported_epoch":124,"state":"active+clean","last_fresh":"2024-04-18T14:45:05.845686+0000","last_change":"2024-04-18T14:44:37.374487+0000","last_active":"2024-04-18T14:45:05.845686+0000","last_peered":"2024-04-18T14:45:05.845686+0000","last_clean":"2024-04-18T14:45:05.845686+0000","last_became_active":"2024-04-18T14:43:21.414060+0000","last_became_peered":"2024-04-18T14:43:21.414060+0000","last_unstale":"2024-04-18T14:45:05.845686+0000","last_undegraded":"2024-04-18T14:45:05.845686+0000","last_fullsized":"2024-04-18T14:45:05.845686+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T14:44:37.374221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T14:43:20.303322+0000","last_clean_scrub_stamp":"2024-04-18T14:44:37.374221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T14:45:58.651147+0000","scrub_duration":0.0042134670000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":111,"reported_epoch":124,"state":"active+clean","last_fresh":"2024-04-18T14:45:07.185035+0000","last_change":"2024-04-18T14:44:24.148269+0000","last_active":"2024-04-18T14:45:07.185035+0000","last_peered":"2024-04-18T14:45:07.185035+0000","last_clean":"2024-04-18T14:45:07.185035+0000","last_became_active":"2024-04-18T14:43:21.328534+0000","last_became_peered":"2024-04-18T14:43:21.328534+0000","last_unstale":"2024-04-18T14:45:07.185035+0000","last_undegraded":"2024-04-18T14:45:07.185035+0000","last_fullsized":"2024-04-18T14:45:07.185035+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T14:44:24.148141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T14:43:20.303322+0000","last_clean_scrub_stamp":"2024-04-18T14:44:24.148141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T14:45:30.466689+0000","scrub_duration":0.001593882,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[13,5],"acting":[13,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":13,"acting_primary":13,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":111,"reported_epoch":124,"state":"active+clean","last_fresh":"2024-04-18T14:45:05.845692+0000","last_change":"2024-04-18T14:44:47.245574+0000","last_active":"2024-04-18T14:45:05.845692+0000","last_peered":"2024-04-18T14:45:05.845692+0000","last_clean":"2024-04-18T14:45:05.845692+0000","last_became_active":"2024-04-18T14:43:21.465481+0000","last_became_peered":"2024-04-18T14:43:21.465481+0000","last_unstale":"2024-04-18T14:45:05.845692+0000","last_undegraded":"2024-04-18T14:45:05.845692+0000","last_fullsized":"2024-04-18T14:45:05.845692+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T14:44:47.245297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T14:44:47.245297+0000","last_clean_scrub_stamp":"2024-04-18T14:44:47.245297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T14:46:02.649852+0000","scrub_duration":0.0038839159999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10],"acting":[3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":114,"reported_epoch":124,"state":"active+clean","last_fresh":"2024-04-18T14:45:07.345184+0000","last_change":"2024-04-18T14:44:38.485354+0000","last_active":"2024-04-18T14:45:07.345184+0000","last_peered":"2024-04-18T14:45:07.345184+0000","last_clean":"2024-04-18T14:45:07.345184+0000","last_became_active":"2024-04-18T14:43:21.348012+0000","last_became_peered":"2024-04-18T14:43:21.348012+0000","last_unstale":"2024-04-18T14:45:07.345184+0000","last_undegraded":"2024-04-18T14:45:07.345184+0000","last_fullsized":"2024-04-18T14:45:07.345184+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T14:44:38.485106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T14:43:20.303322+0000","last_clean_scrub_stamp":"2024-04-18T14:44:38.485106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T14:45:48.039171+0000","scrub_duration":0.0043932759999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,12],"acting":[6,12],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":111,"reported_epoch":124,"state":"active+clean","last_fresh":"2024-04-18T14:45:06.469135+0000","last_change":"2024-04-18T14:44:38.516905+0000","last_active":"2024-04-18T14:45:06.469135+0000","last_peered":"2024-04-18T14:45:06.469135+0000","last_clean":"2024-04-18T14:45:06.469135+0000","last_became_active":"2024-04-18T14:43:21.422468+0000","last_became_peered":"2024-04-18T14:43:21.422468+0000","last_unstale":"2024-04-18T14:45:06.469135+0000","last_undegraded":"2024-04-18T14:45:06.469135+0000","last_fullsized":"2024-04-18T14:45:06.469135+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T14:44:38.516629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T14:43:20.303322+0000","last_clean_scrub_stamp":"2024-04-18T14:44:38.516629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T14:45:46.715258+0000","scrub_duration":0.0039045249999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2],"acting":[8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":102,"reported_epoch":124,"state":"active+clean","last_fresh":"2024-04-18T14:45:06.548847+0000","last_change":"2024-04-18T14:44:59.929678+0000","last_active":"2024-04-18T14:45:06.548847+0000","last_peered":"2024-04-18T14:45:06.548847+0000","last_clean":"2024-04-18T14:45:06.548847+0000","last_became_active":"2024-04-18T14:44:59.929195+0000","last_became_peered":"2024-04-18T14:44:59.929195+0000","last_unstale":"2024-04-18T14:45:06.548847+0000","last_undegraded":"2024-04-18T14:45:06.548847+0000","last_fullsized":"2024-04-18T14:45:06.548847+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T14:44:36.901318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T14:43:20.303322+0000","last_clean_scrub_stamp":"2024-04-18T14:44:36.901318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T14:45:49.599440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[14,0],"acting":[14,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":14,"acting_primary":14,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":114,"reported_epoch":124,"state":"active+clean","last_fresh":"2024-04-18T14:45:06.548333+0000","last_change":"2024-04-18T14:44:22.508764+0000","last_active":"2024-04-18T14:45:06.548333+0000","last_peered":"2024-04-18T14:45:06.548333+0000","last_clean":"2024-04-18T14:45:06.548333+0000","last_became_active":"2024-04-18T14:43:21.328185+0000","last_became_peered":"2024-04-18T14:43:21.328185+0000","last_unstale":"2024-04-18T14:45:06.548333+0000","last_undegraded":"2024-04-18T14:45:06.548333+0000","last_fullsized":"2024-04-18T14:45:06.548333+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T14:44:22.508567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T14:43:20.303322+0000","last_clean_scrub_stamp":"2024-04-18T14:44:22.508567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T14:45:46.236519+0000","scrub_duration":0.0031913549999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[15,13],"acting":[15,13],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":15,"acting_primary":15,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":11},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1064960,"data_stored":1057856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":13,"up_from":24,"seq":103079215130,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33476,"kb_used_data":2356,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94338364,"statfs":{"total":96636764160,"available":96602484736,"internally_reserved":0,"allocated":2412544,"data_stored":1617083,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,2,3,4,5,7,11,12,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Apr 18 14:44:21 2024","interfaces":[{"interface":"back","average":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"min":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":1.792,"5min":1.792,"15min":1.792},"last":0.67100000000000004},{"interface":"front","average":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"min":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":2.0600000000000001,"5min":2.0600000000000001,"15min":2.0600000000000001},"last":0.71299999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84099999999999997}]},{"osd":2,"last update":"Thu Apr 18 14:44:21 2024","interfaces":[{"interface":"back","average":{"1min":1.0389999999999999,"5min":1.0389999999999999,"15min":1.0389999999999999},"min":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"max":{"1min":1.974,"5min":1.974,"15min":1.974},"last":0.98599999999999999},{"interface":"front","average":{"1min":1,"5min":1,"15min":1},"min":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.9910000000000001,"5min":1.9910000000000001,"15min":1.9910000000000001},"last":0.79200000000000004}]},{"osd":3,"last update":"Thu Apr 18 14:44:21 2024","interfaces":[{"interface":"back","average":{"1min":0.91500000000000004,"5min":0.91500000000000004,"15min":0.91500000000000004},"min":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"max":{"1min":1.2110000000000001,"5min":1.2110000000000001,"15min":1.2110000000000001},"last":1.0369999999999999},{"interface":"front","average":{"1min":1.0489999999999999,"5min":1.0489999999999999,"15min":1.0489999999999999},"min":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":1.4430000000000001,"5min":1.4430000000000001,"15min":1.4430000000000001},"last":1.113}]},{"osd":4,"last update":"Thu Apr 18 14:44:21 2024","interfaces":[{"interface":"back","average":{"1min":0.98099999999999998,"5min":0.98099999999999998,"15min":0.98099999999999998},"min":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.3919999999999999,"5min":1.3919999999999999,"15min":1.3919999999999999},"last":0.878},{"interface":"front","average":{"1min":0.90100000000000002,"5min":0.90100000000000002,"15min":0.90100000000000002},"min":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":1.306,"5min":1.306,"15min":1.306},"last":1.1559999999999999}]},{"osd":5,"last update":"Thu Apr 18 14:44:21 2024","interfaces":[{"interface":"back","average":{"1min":0.96399999999999997,"5min":0.96399999999999997,"15min":0.96399999999999997},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":1.5860000000000001,"5min":1.5860000000000001,"15min":1.5860000000000001},"last":0.95699999999999996},{"interface":"front","average":{"1min":1.0780000000000001,"5min":1.0780000000000001,"15min":1.0780000000000001},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.536,"5min":1.536,"15min":1.536},"last":0.93200000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1950000000000001}]},{"osd":7,"last update":"Thu Apr 18 14:44:32 2024","interfaces":[{"interface":"back","average":{"1min":1.1639999999999999,"5min":1.1639999999999999,"15min":1.1639999999999999},"min":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":2.4359999999999999,"5min":2.4359999999999999,"15min":2.4359999999999999},"last":1.079},{"interface":"front","average":{"1min":1.206,"5min":1.206,"15min":1.206},"min":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"max":{"1min":3.532,"5min":3.532,"15min":3.532},"last":1.177}]},{"osd":11,"last update":"Thu Apr 18 14:44:32 2024","interfaces":[{"interface":"back","average":{"1min":1.2350000000000001,"5min":1.2350000000000001,"15min":1.2350000000000001},"min":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"max":{"1min":1.8069999999999999,"5min":1.8069999999999999,"15min":1.8069999999999999},"last":1.1399999999999999},{"interface":"front","average":{"1min":1.2809999999999999,"5min":1.2809999999999999,"15min":1.2809999999999999},"min":{"1min":0.84799999999999998,"5min":0.84799999999999998,"15min":0.84799999999999998},"max":{"1min":2.2669999999999999,"5min":2.2669999999999999,"15min":2.2669999999999999},"last":1.2190000000000001}]},{"osd":12,"last update":"Thu Apr 18 14:44:21 2024","interfaces":[{"interface":"back","average":{"1min":1.2709999999999999,"5min":1.2709999999999999,"15min":1.2709999999999999},"min":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"max":{"1min":1.911,"5min":1.911,"15min":1.911},"last":1.018},{"interface":"front","average":{"1min":1.3140000000000001,"5min":1.3140000000000001,"15min":1.3140000000000001},"min":{"1min":0.755,"5min":0.755,"15min":0.755},"max":{"1min":2.504,"5min":2.504,"15min":2.504},"last":1.2909999999999999}]},{"osd":14,"last update":"Thu Apr 18 14:44:21 2024","interfaces":[{"interface":"back","average":{"1min":1.2909999999999999,"5min":1.2909999999999999,"15min":1.2909999999999999},"min":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"max":{"1min":3.6240000000000001,"5min":3.6240000000000001,"15min":3.6240000000000001},"last":1.24},{"interface":"front","average":{"1min":1.357,"5min":1.357,"15min":1.357},"min":{"1min":0.627,"5min":0.627,"15min":0.627},"max":{"1min":2.1960000000000002,"5min":2.1960000000000002,"15min":2.1960000000000002},"last":1.2030000000000001}]},{"osd":15,"last update":"Thu Apr 18 14:44:21 2024","interfaces":[{"interface":"back","average":{"1min":1.3560000000000001,"5min":1.3560000000000001,"15min":1.3560000000000001},"min":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"max":{"1min":2.1080000000000001,"5min":2.1080000000000001,"15min":2.1080000000000001},"last":1.3600000000000001},{"interface":"front","average":{"1min":1.26,"5min":1.26,"15min":1.26},"min":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"max":{"1min":1.8380000000000001,"5min":1.8380000000000001,"15min":1.8380000000000001},"last":1.323}]}]},{"osd":9,"up_from":24,"seq":103079215131,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32956,"kb_used_data":1836,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94338884,"statfs":{"total":96636764160,"available":96603017216,"internally_reserved":0,"allocated":1880064,"data_stored":1088155,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1599,"internal_metadata":31848897},"hb_peers":[0,1,3,8,10,11,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Apr 18 14:44:20 2024","interfaces":[{"interface":"back","average":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":1.0429999999999999,"5min":1.0429999999999999,"15min":1.0429999999999999},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.95199999999999996,"5min":0.95199999999999996,"15min":0.95199999999999996},"min":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"max":{"1min":1.6559999999999999,"5min":1.6559999999999999,"15min":1.6559999999999999},"last":0.68500000000000005}]},{"osd":1,"last update":"Thu Apr 18 14:44:20 2024","interfaces":[{"interface":"back","average":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"min":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":1.3200000000000001,"5min":1.3200000000000001,"15min":1.3200000000000001},"last":0.80400000000000005},{"interface":"front","average":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.2509999999999999,"5min":1.2509999999999999,"15min":1.2509999999999999},"last":0.91600000000000004}]},{"osd":3,"last update":"Thu Apr 18 14:44:20 2024","interfaces":[{"interface":"back","average":{"1min":1.032,"5min":1.032,"15min":1.032},"min":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"max":{"1min":1.5980000000000001,"5min":1.5980000000000001,"15min":1.5980000000000001},"last":0.98799999999999999},{"interface":"front","average":{"1min":1.1539999999999999,"5min":1.1539999999999999,"15min":1.1539999999999999},"min":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"max":{"1min":1.722,"5min":1.722,"15min":1.722},"last":0.95899999999999996}]},{"osd":8,"last update":"Thu Apr 18 14:44:20 2024","interfaces":[{"interface":"back","average":{"1min":0.94899999999999995,"5min":0.94899999999999995,"15min":0.94899999999999995},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":1.6899999999999999,"5min":1.6899999999999999,"15min":1.6899999999999999},"last":0.75800000000000001},{"interface":"front","average":{"1min":1.3380000000000001,"5min":1.3380000000000001,"15min":1.3380000000000001},"min":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"max":{"1min":5.4989999999999997,"5min":5.4989999999999997,"15min":5.4989999999999997},"last":0.84499999999999997}]},{"osd":10,"last update":"Thu Apr 18 14:44:20 2024","interfaces":[{"interface":"back","average":{"1min":1.196,"5min":1.196,"15min":1.196},"min":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"max":{"1min":1.5429999999999999,"5min":1.5429999999999999,"15min":1.5429999999999999},"last":1.2849999999999999},{"interface":"front","average":{"1min":1.117,"5min":1.117,"15min":1.117},"min":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"max":{"1min":1.7689999999999999,"5min":1.7689999999999999,"15min":1.7689999999999999},"last":1.091}]},{"osd":11,"last update":"Thu Apr 18 14:44:20 2024","interfaces":[{"interface":"back","average":{"1min":1.1279999999999999,"5min":1.1279999999999999,"15min":1.1279999999999999},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.849,"5min":1.849,"15min":1.849},"last":1.0189999999999999},{"interface":"front","average":{"1min":1.2310000000000001,"5min":1.2310000000000001,"15min":1.2310000000000001},"min":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"max":{"1min":1.8109999999999999,"5min":1.8109999999999999,"15min":1.8109999999999999},"last":1.119}]},{"osd":12,"last update":"Thu Apr 18 14:44:20 2024","interfaces":[{"interface":"back","average":{"1min":1.2989999999999999,"5min":1.2989999999999999,"15min":1.2989999999999999},"min":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"max":{"1min":2.1560000000000001,"5min":2.1560000000000001,"15min":2.1560000000000001},"last":0.88100000000000001},{"interface":"front","average":{"1min":1.29,"5min":1.29,"15min":1.29},"min":{"1min":0.748,"5min":0.748,"15min":0.748},"max":{"1min":2.6930000000000001,"5min":2.6930000000000001,"15min":2.6930000000000001},"last":1.1539999999999999}]},{"osd":13,"last update":"Thu Apr 18 14:44:20 2024","interfaces":[{"interface":"back","average":{"1min":1.4079999999999999,"5min":1.4079999999999999,"15min":1.4079999999999999},"min":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"max":{"1min":2.6030000000000002,"5min":2.6030000000000002,"15min":2.6030000000000002},"last":1.0580000000000001},{"interface":"front","average":{"1min":1.4710000000000001,"5min":1.4710000000000001,"15min":1.4710000000000001},"min":{"1min":0.92100000000000004,"5min":0.92100000000000004,"15min":0.92100000000000004},"max":{"1min":2.472,"5min":2.472,"15min":2.472},"last":1.179}]},{"osd":14,"last update":"Thu Apr 18 14:44:20 2024","interfaces":[{"interface":"back","average":{"1min":1.456,"5min":1.456,"15min":1.456},"min":{"1min":0.88400000000000001,"5min":0.88400000000000001,"15min":0.88400000000000001},"max":{"1min":2.3180000000000001,"5min":2.3180000000000001,"15min":2.3180000000000001},"last":1.26},{"interface":"front","average":{"1min":1.5389999999999999,"5min":1.5389999999999999,"15min":1.5389999999999999},"min":{"1min":1.016,"5min":1.016,"15min":1.016},"max":{"1min":2.6549999999999998,"5min":2.6549999999999998,"15min":2.6549999999999998},"last":1.204}]},{"osd":15,"last update":"Thu Apr 18 14:44:20 2024","interfaces":[{"interface":"back","average":{"1min":1.4119999999999999,"5min":1.4119999999999999,"15min":1.4119999999999999},"min":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"max":{"1min":2.7789999999999999,"5min":2.7789999999999999,"15min":2.7789999999999999},"last":1.2310000000000001},{"interface":"front","average":{"1min":1.4359999999999999,"5min":1.4359999999999999,"15min":1.4359999999999999},"min":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"max":{"1min":1.923,"5min":1.923,"15min":1.923},"last":1.3080000000000001}]}]},{"osd":5,"up_from":24,"seq":103079215132,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32956,"kb_used_data":1836,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94338884,"statfs":{"total":96636764160,"available":96603017216,"internally_reserved":0,"allocated":1880064,"data_stored":1088155,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,3,4,6,10,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Apr 18 14:44:31 2024","interfaces":[{"interface":"back","average":{"1min":0.90900000000000003,"5min":0.90900000000000003,"15min":0.90900000000000003},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.339,"5min":1.339,"15min":1.339},"last":1.083},{"interface":"front","average":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":1.175,"5min":1.175,"15min":1.175},"last":0.78900000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67600000000000005}]},{"osd":3,"last update":"Thu Apr 18 14:44:24 2024","interfaces":[{"interface":"back","average":{"1min":1.024,"5min":1.024,"15min":1.024},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":1.4650000000000001,"5min":1.4650000000000001,"15min":1.4650000000000001},"last":1.26},{"interface":"front","average":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":0.94999999999999996},"min":{"1min":0.621,"5min":0.621,"15min":0.621},"max":{"1min":1.8460000000000001,"5min":1.8460000000000001,"15min":1.8460000000000001},"last":0.81200000000000006}]},{"osd":4,"last update":"Thu Apr 18 14:44:24 2024","interfaces":[{"interface":"back","average":{"1min":0.89400000000000002,"5min":0.89400000000000002,"15min":0.89400000000000002},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":1.968,"5min":1.968,"15min":1.968},"last":0.88700000000000001},{"interface":"front","average":{"1min":1.016,"5min":1.016,"15min":1.016},"min":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"max":{"1min":1.819,"5min":1.819,"15min":1.819},"last":1.1679999999999999}]},{"osd":6,"last update":"Thu Apr 18 14:44:24 2024","interfaces":[{"interface":"back","average":{"1min":1.0629999999999999,"5min":1.0629999999999999,"15min":1.0629999999999999},"min":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"max":{"1min":2.0760000000000001,"5min":2.0760000000000001,"15min":2.0760000000000001},"last":0.94799999999999995},{"interface":"front","average":{"1min":1.101,"5min":1.101,"15min":1.101},"min":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"max":{"1min":1.694,"5min":1.694,"15min":1.694},"last":0.97999999999999998}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2330000000000001}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96599999999999997}]},{"osd":10,"last update":"Thu Apr 18 14:44:24 2024","interfaces":[{"interface":"back","average":{"1min":1.232,"5min":1.232,"15min":1.232},"min":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"max":{"1min":2.2709999999999999,"5min":2.2709999999999999,"15min":2.2709999999999999},"last":1.3360000000000001},{"interface":"front","average":{"1min":1.2569999999999999,"5min":1.2569999999999999,"15min":1.2569999999999999},"min":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"max":{"1min":2.4470000000000001,"5min":2.4470000000000001,"15min":2.4470000000000001},"last":1.03}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.256}]},{"osd":12,"last update":"Thu Apr 18 14:44:24 2024","interfaces":[{"interface":"back","average":{"1min":1.1140000000000001,"5min":1.1140000000000001,"15min":1.1140000000000001},"min":{"1min":0.625,"5min":0.625,"15min":0.625},"max":{"1min":1.728,"5min":1.728,"15min":1.728},"last":0.83899999999999997},{"interface":"front","average":{"1min":1.339,"5min":1.339,"15min":1.339},"min":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"max":{"1min":2.008,"5min":2.008,"15min":2.008},"last":1.4059999999999999}]},{"osd":13,"last update":"Thu Apr 18 14:44:24 2024","interfaces":[{"interface":"back","average":{"1min":1.355,"5min":1.355,"15min":1.355},"min":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":2.5070000000000001,"5min":2.5070000000000001,"15min":2.5070000000000001},"last":1.478},{"interface":"front","average":{"1min":1.2949999999999999,"5min":1.2949999999999999,"15min":1.2949999999999999},"min":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":2.992,"5min":2.992,"15min":2.992},"last":1.1299999999999999}]},{"osd":14,"last update":"Thu Apr 18 14:44:31 2024","interfaces":[{"interface":"back","average":{"1min":1.401,"5min":1.401,"15min":1.401},"min":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.85099999999999998},"max":{"1min":2.1190000000000002,"5min":2.1190000000000002,"15min":2.1190000000000002},"last":1.5469999999999999},{"interface":"front","average":{"1min":1.2629999999999999,"5min":1.2629999999999999,"15min":1.2629999999999999},"min":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"max":{"1min":2.496,"5min":2.496,"15min":2.496},"last":1.1919999999999999}]},{"osd":15,"last update":"Thu Apr 18 14:44:24 2024","interfaces":[{"interface":"back","average":{"1min":1.486,"5min":1.486,"15min":1.486},"min":{"1min":0.879,"5min":0.879,"15min":0.879},"max":{"1min":2.415,"5min":2.415,"15min":2.415},"last":1.615},{"interface":"front","average":{"1min":1.4470000000000001,"5min":1.4470000000000001,"15min":1.4470000000000001},"min":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"max":{"1min":2.7799999999999998,"5min":2.7799999999999998,"15min":2.7799999999999998},"last":1.236}]}]},{"osd":14,"up_from":21,"seq":90194313243,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51008,"kb_used_data":1836,"kb_used_omap":1,"kb_used_meta":49150,"kb_avail":94320832,"statfs":{"total":96636764160,"available":96584531968,"internally_reserved":0,"allocated":1880064,"data_stored":1088155,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":50330054},"hb_peers":[0,4,5,6,7,8,9,11,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Apr 18 14:44:21 2024","interfaces":[{"interface":"back","average":{"1min":0.96899999999999997,"5min":0.96899999999999997,"15min":0.96899999999999997},"min":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"max":{"1min":1.454,"5min":1.454,"15min":1.454},"last":0.83999999999999997},{"interface":"front","average":{"1min":1.0660000000000001,"5min":1.0660000000000001,"15min":1.0660000000000001},"min":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"max":{"1min":1.9390000000000001,"5min":1.9390000000000001,"15min":1.9390000000000001},"last":1.0940000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.472}]},{"osd":2,"last update":"Thu Apr 18 14:44:31 2024","interfaces":[{"interface":"back","average":{"1min":0.89500000000000002,"5min":0.89500000000000002,"15min":0.89500000000000002},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":1.468,"5min":1.468,"15min":1.468},"last":0.64400000000000002},{"interface":"front","average":{"1min":1.131,"5min":1.131,"15min":1.131},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.8540000000000001,"5min":1.8540000000000001,"15min":1.8540000000000001},"last":1.032}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94499999999999995}]},{"osd":4,"last update":"Thu Apr 18 14:44:20 2024","interfaces":[{"interface":"back","average":{"1min":0.95099999999999996,"5min":0.95099999999999996,"15min":0.95099999999999996},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.296,"5min":1.296,"15min":1.296},"last":0.69499999999999995},{"interface":"front","average":{"1min":0.97599999999999998,"5min":0.97599999999999998,"15min":0.97599999999999998},"min":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"max":{"1min":1.5129999999999999,"5min":1.5129999999999999,"15min":1.5129999999999999},"last":0.74099999999999999}]},{"osd":5,"last update":"Thu Apr 18 14:44:20 2024","interfaces":[{"interface":"back","average":{"1min":1.218,"5min":1.218,"15min":1.218},"min":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"max":{"1min":2.1269999999999998,"5min":2.1269999999999998,"15min":2.1269999999999998},"last":1.1910000000000001},{"interface":"front","average":{"1min":1.1679999999999999,"5min":1.1679999999999999,"15min":1.1679999999999999},"min":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"max":{"1min":1.5920000000000001,"5min":1.5920000000000001,"15min":1.5920000000000001},"last":0.95299999999999996}]},{"osd":6,"last update":"Thu Apr 18 14:44:20 2024","interfaces":[{"interface":"back","average":{"1min":0.94699999999999995,"5min":0.94699999999999995,"15min":0.94699999999999995},"min":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"max":{"1min":1.3160000000000001,"5min":1.3160000000000001,"15min":1.3160000000000001},"last":1.0509999999999999},{"interface":"front","average":{"1min":1.163,"5min":1.163,"15min":1.163},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":1.7689999999999999,"5min":1.7689999999999999,"15min":1.7689999999999999},"last":0.875}]},{"osd":7,"last update":"Thu Apr 18 14:44:20 2024","interfaces":[{"interface":"back","average":{"1min":1.234,"5min":1.234,"15min":1.234},"min":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"max":{"1min":1.7529999999999999,"5min":1.7529999999999999,"15min":1.7529999999999999},"last":1.018},{"interface":"front","average":{"1min":1.1759999999999999,"5min":1.1759999999999999,"15min":1.1759999999999999},"min":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"max":{"1min":1.587,"5min":1.587,"15min":1.587},"last":0.90900000000000003}]},{"osd":8,"last update":"Thu Apr 18 14:44:20 2024","interfaces":[{"interface":"back","average":{"1min":1.292,"5min":1.292,"15min":1.292},"min":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"max":{"1min":2.0569999999999999,"5min":2.0569999999999999,"15min":2.0569999999999999},"last":1.3720000000000001},{"interface":"front","average":{"1min":1.2509999999999999,"5min":1.2509999999999999,"15min":1.2509999999999999},"min":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"max":{"1min":1.8740000000000001,"5min":1.8740000000000001,"15min":1.8740000000000001},"last":1.0740000000000001}]},{"osd":9,"last update":"Thu Apr 18 14:44:31 2024","interfaces":[{"interface":"back","average":{"1min":1.4590000000000001,"5min":1.4590000000000001,"15min":1.4590000000000001},"min":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"max":{"1min":2.1899999999999999,"5min":2.1899999999999999,"15min":2.1899999999999999},"last":1.4550000000000001},{"interface":"front","average":{"1min":1.3999999999999999,"5min":1.3999999999999999,"15min":1.3999999999999999},"min":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"max":{"1min":1.9930000000000001,"5min":1.9930000000000001,"15min":1.9930000000000001},"last":1.163}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4219999999999999}]},{"osd":11,"last update":"Thu Apr 18 14:44:31 2024","interfaces":[{"interface":"back","average":{"1min":1.4319999999999999,"5min":1.4319999999999999,"15min":1.4319999999999999},"min":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"max":{"1min":2.0059999999999998,"5min":2.0059999999999998,"15min":2.0059999999999998},"last":1.1279999999999999},{"interface":"front","average":{"1min":1.3640000000000001,"5min":1.3640000000000001,"15min":1.3640000000000001},"min":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"max":{"1min":1.903,"5min":1.903,"15min":1.903},"last":1.5349999999999999}]},{"osd":12,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.016}]},{"osd":13,"last update":"Thu Apr 18 14:44:20 2024","interfaces":[{"interface":"back","average":{"1min":1.464,"5min":1.464,"15min":1.464},"min":{"1min":0.86799999999999999,"5min":0.86799999999999999,"15min":0.86799999999999999},"max":{"1min":1.8620000000000001,"5min":1.8620000000000001,"15min":1.8620000000000001},"last":1.2410000000000001},{"interface":"front","average":{"1min":1.5349999999999999,"5min":1.5349999999999999,"15min":1.5349999999999999},"min":{"1min":0.94299999999999995,"5min":0.94299999999999995,"15min":0.94299999999999995},"max":{"1min":2.452,"5min":2.452,"15min":2.452},"last":1.5780000000000001}]},{"osd":15,"last update":"Thu Apr 18 14:44:20 2024","interfaces":[{"interface":"back","average":{"1min":1.5129999999999999,"5min":1.5129999999999999,"15min":1.5129999999999999},"min":{"1min":0.95699999999999996,"5min":0.95699999999999996,"15min":0.95699999999999996},"max":{"1min":2.2549999999999999,"5min":2.2549999999999999,"15min":2.2549999999999999},"last":1.2170000000000001},{"interface":"front","average":{"1min":1.476,"5min":1.476,"15min":1.476},"min":{"1min":0.89800000000000002,"5min":0.89800000000000002,"15min":0.89800000000000002},"max":{"1min":1.9550000000000001,"5min":1.9550000000000001,"15min":1.9550000000000001},"last":1.4910000000000001}]}]},{"osd":1,"up_from":24,"seq":103079215132,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32952,"kb_used_data":1832,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94338888,"statfs":{"total":96636764160,"available":96603021312,"internally_reserved":0,"allocated":1875968,"data_stored":1087311,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,2,3,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Apr 18 14:44:25 2024","interfaces":[{"interface":"back","average":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":1.165,"5min":1.165,"15min":1.165},"last":1.1519999999999999},{"interface":"front","average":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"min":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":1.292,"5min":1.292,"15min":1.292},"last":0.92700000000000005}]},{"osd":2,"last update":"Thu Apr 18 14:44:25 2024","interfaces":[{"interface":"back","average":{"1min":0.93899999999999995,"5min":0.93899999999999995,"15min":0.93899999999999995},"min":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"max":{"1min":1.3180000000000001,"5min":1.3180000000000001,"15min":1.3180000000000001},"last":1.0960000000000001},{"interface":"front","average":{"1min":0.95199999999999996,"5min":0.95199999999999996,"15min":0.95199999999999996},"min":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":1.345,"5min":1.345,"15min":1.345},"last":0.98099999999999998}]},{"osd":3,"last update":"Thu Apr 18 14:44:25 2024","interfaces":[{"interface":"back","average":{"1min":1.0760000000000001,"5min":1.0760000000000001,"15min":1.0760000000000001},"min":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":1.486,"5min":1.486,"15min":1.486},"last":1.526},{"interface":"front","average":{"1min":1.1679999999999999,"5min":1.1679999999999999,"15min":1.1679999999999999},"min":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"max":{"1min":1.7789999999999999,"5min":1.7789999999999999,"15min":1.7789999999999999},"last":1.1719999999999999}]},{"osd":4,"last update":"Thu Apr 18 14:44:25 2024","interfaces":[{"interface":"back","average":{"1min":0.98299999999999998,"5min":0.98299999999999998,"15min":0.98299999999999998},"min":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"max":{"1min":1.728,"5min":1.728,"15min":1.728},"last":1.1950000000000001},{"interface":"front","average":{"1min":0.93700000000000006,"5min":0.93700000000000006,"15min":0.93700000000000006},"min":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"max":{"1min":1.6950000000000001,"5min":1.6950000000000001,"15min":1.6950000000000001},"last":1.248}]},{"osd":5,"last update":"Thu Apr 18 14:44:25 2024","interfaces":[{"interface":"back","average":{"1min":1.0089999999999999,"5min":1.0089999999999999,"15min":1.0089999999999999},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":1.819,"5min":1.819,"15min":1.819},"last":0.80900000000000005},{"interface":"front","average":{"1min":1.083,"5min":1.083,"15min":1.083},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":1.841,"5min":1.841,"15min":1.841},"last":1.034}]},{"osd":6,"last update":"Thu Apr 18 14:44:25 2024","interfaces":[{"interface":"back","average":{"1min":1.2529999999999999,"5min":1.2529999999999999,"15min":1.2529999999999999},"min":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"max":{"1min":2.3639999999999999,"5min":2.3639999999999999,"15min":2.3639999999999999},"last":1.0720000000000001},{"interface":"front","average":{"1min":1.1839999999999999,"5min":1.1839999999999999,"15min":1.1839999999999999},"min":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"max":{"1min":1.9419999999999999,"5min":1.9419999999999999,"15min":1.9419999999999999},"last":1.1220000000000001}]},{"osd":7,"last update":"Thu Apr 18 14:44:25 2024","interfaces":[{"interface":"back","average":{"1min":1.2050000000000001,"5min":1.2050000000000001,"15min":1.2050000000000001},"min":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"max":{"1min":1.96,"5min":1.96,"15min":1.96},"last":0.86499999999999999},{"interface":"front","average":{"1min":1.2509999999999999,"5min":1.2509999999999999,"15min":1.2509999999999999},"min":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"max":{"1min":2.4399999999999999,"5min":2.4399999999999999,"15min":2.4399999999999999},"last":1.218}]},{"osd":8,"last update":"Thu Apr 18 14:44:25 2024","interfaces":[{"interface":"back","average":{"1min":1.2330000000000001,"5min":1.2330000000000001,"15min":1.2330000000000001},"min":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"max":{"1min":1.881,"5min":1.881,"15min":1.881},"last":1.3080000000000001},{"interface":"front","average":{"1min":1.26,"5min":1.26,"15min":1.26},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":2.5169999999999999,"5min":2.5169999999999999,"15min":2.5169999999999999},"last":1.3680000000000001}]},{"osd":9,"last update":"Thu Apr 18 14:44:25 2024","interfaces":[{"interface":"back","average":{"1min":1.3280000000000001,"5min":1.3280000000000001,"15min":1.3280000000000001},"min":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":2.4780000000000002,"5min":2.4780000000000002,"15min":2.4780000000000002},"last":1.706},{"interface":"front","average":{"1min":1.3129999999999999,"5min":1.3129999999999999,"15min":1.3129999999999999},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":2.161,"5min":2.161,"15min":2.161},"last":1.3919999999999999}]},{"osd":10,"last update":"Thu Apr 18 14:44:25 2024","interfaces":[{"interface":"back","average":{"1min":1.407,"5min":1.407,"15min":1.407},"min":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"max":{"1min":2.625,"5min":2.625,"15min":2.625},"last":1.4370000000000001},{"interface":"front","average":{"1min":1.446,"5min":1.446,"15min":1.446},"min":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"max":{"1min":2.5529999999999999,"5min":2.5529999999999999,"15min":2.5529999999999999},"last":1.7829999999999999}]}]},{"osd":2,"up_from":22,"seq":94489280539,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28840,"kb_used_data":1820,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343000,"statfs":{"total":96636764160,"available":96607232000,"internally_reserved":0,"allocated":1863680,"data_stored":1078641,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,3,5,6,7,8,10,11,12,14],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Apr 18 14:44:22 2024","interfaces":[{"interface":"back","average":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"min":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"max":{"1min":1.175,"5min":1.175,"15min":1.175},"last":1.2210000000000001},{"interface":"front","average":{"1min":0.90900000000000003,"5min":0.90900000000000003,"15min":0.90900000000000003},"min":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"max":{"1min":1.3740000000000001,"5min":1.3740000000000001,"15min":1.3740000000000001},"last":1.47}]},{"osd":3,"last update":"Thu Apr 18 14:44:22 2024","interfaces":[{"interface":"back","average":{"1min":1.0409999999999999,"5min":1.0409999999999999,"15min":1.0409999999999999},"min":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"max":{"1min":1.6830000000000001,"5min":1.6830000000000001,"15min":1.6830000000000001},"last":1.0740000000000001},{"interface":"front","average":{"1min":1.0700000000000001,"5min":1.0700000000000001,"15min":1.0700000000000001},"min":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"max":{"1min":1.8839999999999999,"5min":1.8839999999999999,"15min":1.8839999999999999},"last":1.3080000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96699999999999997}]},{"osd":5,"last update":"Thu Apr 18 14:44:22 2024","interfaces":[{"interface":"back","average":{"1min":0.98799999999999999,"5min":0.98799999999999999,"15min":0.98799999999999999},"min":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"max":{"1min":1.5469999999999999,"5min":1.5469999999999999,"15min":1.5469999999999999},"last":0.63100000000000001},{"interface":"front","average":{"1min":0.92500000000000004,"5min":0.92500000000000004,"15min":0.92500000000000004},"min":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":1.333,"5min":1.333,"15min":1.333},"last":1.359}]},{"osd":6,"last update":"Thu Apr 18 14:44:19 2024","interfaces":[{"interface":"back","average":{"1min":1.115,"5min":1.115,"15min":1.115},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":2.0529999999999999,"5min":2.0529999999999999,"15min":2.0529999999999999},"last":1.26},{"interface":"front","average":{"1min":1.089,"5min":1.089,"15min":1.089},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.8069999999999999,"5min":1.8069999999999999,"15min":1.8069999999999999},"last":1.155}]},{"osd":7,"last update":"Thu Apr 18 14:44:22 2024","interfaces":[{"interface":"back","average":{"1min":1.165,"5min":1.165,"15min":1.165},"min":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"max":{"1min":2.012,"5min":2.012,"15min":2.012},"last":0.97299999999999998},{"interface":"front","average":{"1min":1.2949999999999999,"5min":1.2949999999999999,"15min":1.2949999999999999},"min":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"max":{"1min":2.1419999999999999,"5min":2.1419999999999999,"15min":2.1419999999999999},"last":1.0229999999999999}]},{"osd":8,"last update":"Thu Apr 18 14:44:22 2024","interfaces":[{"interface":"back","average":{"1min":1.224,"5min":1.224,"15min":1.224},"min":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"max":{"1min":1.988,"5min":1.988,"15min":1.988},"last":1.55},{"interface":"front","average":{"1min":1.3120000000000001,"5min":1.3120000000000001,"15min":1.3120000000000001},"min":{"1min":0.84999999999999998,"5min":0.84999999999999998,"15min":0.84999999999999998},"max":{"1min":2.2240000000000002,"5min":2.2240000000000002,"15min":2.2240000000000002},"last":1.657}]},{"osd":10,"last update":"Thu Apr 18 14:44:19 2024","interfaces":[{"interface":"back","average":{"1min":1.365,"5min":1.365,"15min":1.365},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":2.319,"5min":2.319,"15min":2.319},"last":2.8170000000000002},{"interface":"front","average":{"1min":1.3879999999999999,"5min":1.3879999999999999,"15min":1.3879999999999999},"min":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"max":{"1min":2.27,"5min":2.27,"15min":2.27},"last":3.0110000000000001}]},{"osd":11,"last update":"Thu Apr 18 14:44:19 2024","interfaces":[{"interface":"back","average":{"1min":1.49,"5min":1.49,"15min":1.49},"min":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"max":{"1min":2.4950000000000001,"5min":2.4950000000000001,"15min":2.4950000000000001},"last":1.78},{"interface":"front","average":{"1min":1.4590000000000001,"5min":1.4590000000000001,"15min":1.4590000000000001},"min":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"max":{"1min":2.411,"5min":2.411,"15min":2.411},"last":1.736}]},{"osd":12,"last update":"Thu Apr 18 14:44:19 2024","interfaces":[{"interface":"back","average":{"1min":1.4910000000000001,"5min":1.4910000000000001,"15min":1.4910000000000001},"min":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":0.88500000000000001},"max":{"1min":2.2669999999999999,"5min":2.2669999999999999,"15min":2.2669999999999999},"last":1.8220000000000001},{"interface":"front","average":{"1min":1.514,"5min":1.514,"15min":1.514},"min":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"max":{"1min":2.3719999999999999,"5min":2.3719999999999999,"15min":2.3719999999999999},"last":1.861}]},{"osd":14,"last update":"Thu Apr 18 14:44:19 2024","interfaces":[{"interface":"back","average":{"1min":1.4390000000000001,"5min":1.4390000000000001,"15min":1.4390000000000001},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":2.3050000000000002,"5min":2.3050000000000002,"15min":2.3050000000000002},"last":1.9770000000000001},{"interface":"front","average":{"1min":1.5069999999999999,"5min":1.5069999999999999,"15min":1.5069999999999999},"min":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":2.4020000000000001,"5min":2.4020000000000001,"15min":2.4020000000000001},"last":1.9350000000000001}]}]},{"osd":15,"up_from":23,"seq":98784247836,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32952,"kb_used_data":1832,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94338888,"statfs":{"total":96636764160,"available":96603021312,"internally_reserved":0,"allocated":1875968,"data_stored":1087311,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31848903},"hb_peers":[0,4,5,6,7,8,10,11,13,14],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Apr 18 14:44:19 2024","interfaces":[{"interface":"back","average":{"1min":0.94699999999999995,"5min":0.94699999999999995,"15min":0.94699999999999995},"min":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"max":{"1min":1.405,"5min":1.405,"15min":1.405},"last":0.997},{"interface":"front","average":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"min":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":1.0569999999999999,"5min":1.0569999999999999,"15min":1.0569999999999999},"last":0.63200000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2050000000000001}]},{"osd":4,"last update":"Thu Apr 18 14:44:19 2024","interfaces":[{"interface":"back","average":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.85099999999999998},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.2669999999999999,"5min":1.2669999999999999,"15min":1.2669999999999999},"last":0.73499999999999999},{"interface":"front","average":{"1min":0.877,"5min":0.877,"15min":0.877},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.2410000000000001,"5min":1.2410000000000001,"15min":1.2410000000000001},"last":0.87}]},{"osd":5,"last update":"Thu Apr 18 14:44:22 2024","interfaces":[{"interface":"back","average":{"1min":1.0209999999999999,"5min":1.0209999999999999,"15min":1.0209999999999999},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":2.0579999999999998,"5min":2.0579999999999998,"15min":2.0579999999999998},"last":0.93400000000000005},{"interface":"front","average":{"1min":1.089,"5min":1.089,"15min":1.089},"min":{"1min":0.75,"5min":0.75,"15min":0.75},"max":{"1min":1.9259999999999999,"5min":1.9259999999999999,"15min":1.9259999999999999},"last":1.1339999999999999}]},{"osd":6,"last update":"Thu Apr 18 14:44:19 2024","interfaces":[{"interface":"back","average":{"1min":1.1379999999999999,"5min":1.1379999999999999,"15min":1.1379999999999999},"min":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"max":{"1min":1.8680000000000001,"5min":1.8680000000000001,"15min":1.8680000000000001},"last":1.034},{"interface":"front","average":{"1min":1.228,"5min":1.228,"15min":1.228},"min":{"1min":0.86499999999999999,"5min":0.86499999999999999,"15min":0.86499999999999999},"max":{"1min":1.79,"5min":1.79,"15min":1.79},"last":1.429}]},{"osd":7,"last update":"Thu Apr 18 14:44:19 2024","interfaces":[{"interface":"back","average":{"1min":1.0549999999999999,"5min":1.0549999999999999,"15min":1.0549999999999999},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":1.488,"5min":1.488,"15min":1.488},"last":1.504},{"interface":"front","average":{"1min":1.1830000000000001,"5min":1.1830000000000001,"15min":1.1830000000000001},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":1.976,"5min":1.976,"15min":1.976},"last":1.1859999999999999}]},{"osd":8,"last update":"Thu Apr 18 14:44:19 2024","interfaces":[{"interface":"back","average":{"1min":1.1879999999999999,"5min":1.1879999999999999,"15min":1.1879999999999999},"min":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"max":{"1min":2.004,"5min":2.004,"15min":2.004},"last":1.2370000000000001},{"interface":"front","average":{"1min":1.222,"5min":1.222,"15min":1.222},"min":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"max":{"1min":1.786,"5min":1.786,"15min":1.786},"last":1.381}]},{"osd":10,"last update":"Thu Apr 18 14:44:19 2024","interfaces":[{"interface":"back","average":{"1min":1.3360000000000001,"5min":1.3360000000000001,"15min":1.3360000000000001},"min":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"max":{"1min":2.403,"5min":2.403,"15min":2.403},"last":1.4710000000000001},{"interface":"front","average":{"1min":1.331,"5min":1.331,"15min":1.331},"min":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"max":{"1min":2.2549999999999999,"5min":2.2549999999999999,"15min":2.2549999999999999},"last":1.6459999999999999}]},{"osd":11,"last update":"Thu Apr 18 14:44:19 2024","interfaces":[{"interface":"back","average":{"1min":1.399,"5min":1.399,"15min":1.399},"min":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"max":{"1min":2.2109999999999999,"5min":2.2109999999999999,"15min":2.2109999999999999},"last":1.6990000000000001},{"interface":"front","average":{"1min":1.4490000000000001,"5min":1.4490000000000001,"15min":1.4490000000000001},"min":{"1min":0.629,"5min":0.629,"15min":0.629},"max":{"1min":2.1589999999999998,"5min":2.1589999999999998,"15min":2.1589999999999998},"last":1.3109999999999999}]},{"osd":13,"last update":"Thu Apr 18 14:44:22 2024","interfaces":[{"interface":"back","average":{"1min":1.391,"5min":1.391,"15min":1.391},"min":{"1min":1.0109999999999999,"5min":1.0109999999999999,"15min":1.0109999999999999},"max":{"1min":1.9419999999999999,"5min":1.9419999999999999,"15min":1.9419999999999999},"last":1.748},{"interface":"front","average":{"1min":1.387,"5min":1.387,"15min":1.387},"min":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"max":{"1min":1.8959999999999999,"5min":1.8959999999999999,"15min":1.8959999999999999},"last":1.8720000000000001}]},{"osd":14,"last update":"Thu Apr 18 14:44:19 2024","interfaces":[{"interface":"back","average":{"1min":1.4279999999999999,"5min":1.4279999999999999,"15min":1.4279999999999999},"min":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"max":{"1min":2.351,"5min":2.351,"15min":2.351},"last":1.611},{"interface":"front","average":{"1min":1.454,"5min":1.454,"15min":1.454},"min":{"1min":0.84299999999999997,"5min":0.84299999999999997,"15min":0.84299999999999997},"max":{"1min":2.766,"5min":2.766,"15min":2.766},"last":1.782}]}]},{"osd":4,"up_from":22,"seq":94489280538,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":51000,"kb_used_data":1832,"kb_used_omap":1,"kb_used_meta":49150,"kb_avail":94320840,"statfs":{"total":96636764160,"available":96584540160,"internally_reserved":0,"allocated":1875968,"data_stored":1087311,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":50330054},"hb_peers":[2,3,5,6,10,11,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":2,"last update":"Thu Apr 18 14:44:20 2024","interfaces":[{"interface":"back","average":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":1.2330000000000001,"5min":1.2330000000000001,"15min":1.2330000000000001},"last":1.171},{"interface":"front","average":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":1.306,"5min":1.306,"15min":1.306},"last":1.21}]},{"osd":3,"last update":"Thu Apr 18 14:44:20 2024","interfaces":[{"interface":"back","average":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":1.1499999999999999,"5min":1.1499999999999999,"15min":1.1499999999999999},"last":0.92900000000000005},{"interface":"front","average":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":1.0169999999999999,"5min":1.0169999999999999,"15min":1.0169999999999999},"last":1.054}]},{"osd":5,"last update":"Thu Apr 18 14:44:20 2024","interfaces":[{"interface":"back","average":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":1.0609999999999999,"5min":1.0609999999999999,"15min":1.0609999999999999},"last":0.99399999999999999},{"interface":"front","average":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":1.2190000000000001,"5min":1.2190000000000001,"15min":1.2190000000000001},"last":1.135}]},{"osd":6,"last update":"Thu Apr 18 14:44:20 2024","interfaces":[{"interface":"back","average":{"1min":0.84999999999999998,"5min":0.84999999999999998,"15min":0.84999999999999998},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":1.1930000000000001,"5min":1.1930000000000001,"15min":1.1930000000000001},"last":1.446},{"interface":"front","average":{"1min":0.88,"5min":0.88,"15min":0.88},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.337,"5min":1.337,"15min":1.337},"last":1.304}]},{"osd":10,"last update":"Thu Apr 18 14:44:20 2024","interfaces":[{"interface":"back","average":{"1min":0.876,"5min":0.876,"15min":0.876},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":1.49,"5min":1.49,"15min":1.49},"last":1.8009999999999999},{"interface":"front","average":{"1min":0.90900000000000003,"5min":0.90900000000000003,"15min":0.90900000000000003},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.5700000000000001,"5min":1.5700000000000001,"15min":1.5700000000000001},"last":1.3660000000000001}]},{"osd":11,"last update":"Thu Apr 18 14:44:20 2024","interfaces":[{"interface":"back","average":{"1min":0.86499999999999999,"5min":0.86499999999999999,"15min":0.86499999999999999},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":1.2130000000000001,"5min":1.2130000000000001,"15min":1.2130000000000001},"last":1.3400000000000001},{"interface":"front","average":{"1min":0.90100000000000002,"5min":0.90100000000000002,"15min":0.90100000000000002},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.365,"5min":1.365,"15min":1.365},"last":1.6719999999999999}]},{"osd":12,"last update":"Thu Apr 18 14:44:20 2024","interfaces":[{"interface":"back","average":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":1.1879999999999999,"5min":1.1879999999999999,"15min":1.1879999999999999},"last":1.276},{"interface":"front","average":{"1min":0.86099999999999999,"5min":0.86099999999999999,"15min":0.86099999999999999},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":1.2949999999999999,"5min":1.2949999999999999,"15min":1.2949999999999999},"last":1.901}]},{"osd":13,"last update":"Thu Apr 18 14:44:20 2024","interfaces":[{"interface":"back","average":{"1min":0.95999999999999996,"5min":0.95999999999999996,"15min":0.95999999999999996},"min":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.4279999999999999,"5min":1.4279999999999999,"15min":1.4279999999999999},"last":1.974},{"interface":"front","average":{"1min":0.89900000000000002,"5min":0.89900000000000002,"15min":0.89900000000000002},"min":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"max":{"1min":1.3360000000000001,"5min":1.3360000000000001,"15min":1.3360000000000001},"last":1.75}]},{"osd":14,"last update":"Thu Apr 18 14:44:20 2024","interfaces":[{"interface":"back","average":{"1min":1.022,"5min":1.022,"15min":1.022},"min":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":1.4730000000000001,"5min":1.4730000000000001,"15min":1.4730000000000001},"last":1.601},{"interface":"front","average":{"1min":1.0429999999999999,"5min":1.0429999999999999,"15min":1.0429999999999999},"min":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"max":{"1min":1.369,"5min":1.369,"15min":1.369},"last":1.5660000000000001}]},{"osd":15,"last update":"Thu Apr 18 14:44:20 2024","interfaces":[{"interface":"back","average":{"1min":1.016,"5min":1.016,"15min":1.016},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.5980000000000001,"5min":1.5980000000000001,"15min":1.5980000000000001},"last":1.639},{"interface":"front","average":{"1min":1.02,"5min":1.02,"15min":1.02},"min":{"1min":0.624,"5min":0.624,"15min":0.624},"max":{"1min":1.5649999999999999,"5min":1.5649999999999999,"15min":1.5649999999999999},"last":2.0369999999999999}]}]},{"osd":6,"up_from":22,"seq":94489280538,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32936,"kb_used_data":1820,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94338904,"statfs":{"total":96636764160,"available":96603037696,"internally_reserved":0,"allocated":1863680,"data_stored":1078641,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31848903},"hb_peers":[0,1,5,7,8,9,11,12,13,14],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Apr 18 14:44:30 2024","interfaces":[{"interface":"back","average":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":1.5629999999999999,"5min":1.5629999999999999,"15min":1.5629999999999999},"last":0.55200000000000005},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":1.006,"5min":1.006,"15min":1.006},"last":0.59499999999999997}]},{"osd":1,"last update":"Thu Apr 18 14:44:19 2024","interfaces":[{"interface":"back","average":{"1min":1.0329999999999999,"5min":1.0329999999999999,"15min":1.0329999999999999},"min":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"max":{"1min":1.633,"5min":1.633,"15min":1.633},"last":0.88600000000000001},{"interface":"front","average":{"1min":1.129,"5min":1.129,"15min":1.129},"min":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"max":{"1min":1.585,"5min":1.585,"15min":1.585},"last":1.345}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95399999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86599999999999999}]},{"osd":5,"last update":"Thu Apr 18 14:44:19 2024","interfaces":[{"interface":"back","average":{"1min":0.96399999999999997,"5min":0.96399999999999997,"15min":0.96399999999999997},"min":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":1.627,"5min":1.627,"15min":1.627},"last":0.69399999999999995},{"interface":"front","average":{"1min":0.98199999999999998,"5min":0.98199999999999998,"15min":0.98199999999999998},"min":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"max":{"1min":1.246,"5min":1.246,"15min":1.246},"last":1.2210000000000001}]},{"osd":7,"last update":"Thu Apr 18 14:44:19 2024","interfaces":[{"interface":"back","average":{"1min":1.1399999999999999,"5min":1.1399999999999999,"15min":1.1399999999999999},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.5860000000000001,"5min":1.5860000000000001,"15min":1.5860000000000001},"last":1.4059999999999999},{"interface":"front","average":{"1min":1.022,"5min":1.022,"15min":1.022},"min":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":1.482,"5min":1.482,"15min":1.482},"last":1.0569999999999999}]},{"osd":8,"last update":"Thu Apr 18 14:44:19 2024","interfaces":[{"interface":"back","average":{"1min":0.99299999999999999,"5min":0.99299999999999999,"15min":0.99299999999999999},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.3380000000000001,"5min":1.3380000000000001,"15min":1.3380000000000001},"last":0.753},{"interface":"front","average":{"1min":1.163,"5min":1.163,"15min":1.163},"min":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"max":{"1min":1.673,"5min":1.673,"15min":1.673},"last":0.84699999999999998}]},{"osd":9,"last update":"Thu Apr 18 14:44:30 2024","interfaces":[{"interface":"back","average":{"1min":1.1279999999999999,"5min":1.1279999999999999,"15min":1.1279999999999999},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.3859999999999999,"5min":1.3859999999999999,"15min":1.3859999999999999},"last":0.80300000000000005},{"interface":"front","average":{"1min":1.1870000000000001,"5min":1.1870000000000001,"15min":1.1870000000000001},"min":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"max":{"1min":1.5640000000000001,"5min":1.5640000000000001,"15min":1.5640000000000001},"last":1.298}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3240000000000001}]},{"osd":11,"last update":"Thu Apr 18 14:44:17 2024","interfaces":[{"interface":"back","average":{"1min":1.359,"5min":1.359,"15min":1.359},"min":{"1min":1.0229999999999999,"5min":1.0229999999999999,"15min":1.0229999999999999},"max":{"1min":2.3610000000000002,"5min":2.3610000000000002,"15min":2.3610000000000002},"last":1.151},{"interface":"front","average":{"1min":1.1439999999999999,"5min":1.1439999999999999,"15min":1.1439999999999999},"min":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"max":{"1min":1.698,"5min":1.698,"15min":1.698},"last":1.1859999999999999}]},{"osd":12,"last update":"Thu Apr 18 14:44:17 2024","interfaces":[{"interface":"back","average":{"1min":1.1950000000000001,"5min":1.1950000000000001,"15min":1.1950000000000001},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.5189999999999999,"5min":1.5189999999999999,"15min":1.5189999999999999},"last":1.0860000000000001},{"interface":"front","average":{"1min":1.3400000000000001,"5min":1.3400000000000001,"15min":1.3400000000000001},"min":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"max":{"1min":2.1920000000000002,"5min":2.1920000000000002,"15min":2.1920000000000002},"last":1.272}]},{"osd":13,"last update":"Thu Apr 18 14:44:30 2024","interfaces":[{"interface":"back","average":{"1min":1.4139999999999999,"5min":1.4139999999999999,"15min":1.4139999999999999},"min":{"1min":1.0309999999999999,"5min":1.0309999999999999,"15min":1.0309999999999999},"max":{"1min":1.794,"5min":1.794,"15min":1.794},"last":1.498},{"interface":"front","average":{"1min":1.29,"5min":1.29,"15min":1.29},"min":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":0.94599999999999995},"max":{"1min":1.591,"5min":1.591,"15min":1.591},"last":1.2470000000000001}]},{"osd":14,"last update":"Thu Apr 18 14:44:17 2024","interfaces":[{"interface":"back","average":{"1min":1.3280000000000001,"5min":1.3280000000000001,"15min":1.3280000000000001},"min":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"max":{"1min":1.8580000000000001,"5min":1.8580000000000001,"15min":1.8580000000000001},"last":1.5600000000000001},{"interface":"front","average":{"1min":1.347,"5min":1.347,"15min":1.347},"min":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":1.712,"5min":1.712,"15min":1.712},"last":1.325}]}]},{"osd":10,"up_from":22,"seq":94489280539,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32952,"kb_used_data":1832,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94338888,"statfs":{"total":96636764160,"available":96603021312,"internally_reserved":0,"allocated":1875968,"data_stored":1087311,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1599,"internal_metadata":31848897},"hb_peers":[1,6,7,8,9,11,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89700000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.371}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.117}]},{"osd":6,"last update":"Thu Apr 18 14:44:20 2024","interfaces":[{"interface":"back","average":{"1min":1.1830000000000001,"5min":1.1830000000000001,"15min":1.1830000000000001},"min":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"max":{"1min":3.9830000000000001,"5min":3.9830000000000001,"15min":3.9830000000000001},"last":0.83899999999999997},{"interface":"front","average":{"1min":1.0309999999999999,"5min":1.0309999999999999,"15min":1.0309999999999999},"min":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"max":{"1min":2.9420000000000002,"5min":2.9420000000000002,"15min":2.9420000000000002},"last":0.93899999999999995}]},{"osd":7,"last update":"Thu Apr 18 14:44:32 2024","interfaces":[{"interface":"back","average":{"1min":1.1870000000000001,"5min":1.1870000000000001,"15min":1.1870000000000001},"min":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":3.3679999999999999,"5min":3.3679999999999999,"15min":3.3679999999999999},"last":1.1080000000000001},{"interface":"front","average":{"1min":1.2190000000000001,"5min":1.2190000000000001,"15min":1.2190000000000001},"min":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"max":{"1min":3.1669999999999998,"5min":3.1669999999999998,"15min":3.1669999999999998},"last":1.357}]},{"osd":8,"last update":"Thu Apr 18 14:44:20 2024","interfaces":[{"interface":"back","average":{"1min":1.091,"5min":1.091,"15min":1.091},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":4.0439999999999996,"5min":4.0439999999999996,"15min":4.0439999999999996},"last":1.0800000000000001},{"interface":"front","average":{"1min":1.4390000000000001,"5min":1.4390000000000001,"15min":1.4390000000000001},"min":{"1min":0.89500000000000002,"5min":0.89500000000000002,"15min":0.89500000000000002},"max":{"1min":4.4900000000000002,"5min":4.4900000000000002,"15min":4.4900000000000002},"last":1.167}]},{"osd":9,"last update":"Thu Apr 18 14:44:20 2024","interfaces":[{"interface":"back","average":{"1min":1.3580000000000001,"5min":1.3580000000000001,"15min":1.3580000000000001},"min":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"max":{"1min":3.8439999999999999,"5min":3.8439999999999999,"15min":3.8439999999999999},"last":1.4570000000000001},{"interface":"front","average":{"1min":1.361,"5min":1.361,"15min":1.361},"min":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"max":{"1min":4.2880000000000003,"5min":4.2880000000000003,"15min":4.2880000000000003},"last":1.286}]},{"osd":11,"last update":"Thu Apr 18 14:44:20 2024","interfaces":[{"interface":"back","average":{"1min":1.4159999999999999,"5min":1.4159999999999999,"15min":1.4159999999999999},"min":{"1min":0.755,"5min":0.755,"15min":0.755},"max":{"1min":4.3399999999999999,"5min":4.3399999999999999,"15min":4.3399999999999999},"last":1.4039999999999999},{"interface":"front","average":{"1min":1.5740000000000001,"5min":1.5740000000000001,"15min":1.5740000000000001},"min":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"max":{"1min":4.4450000000000003,"5min":4.4450000000000003,"15min":4.4450000000000003},"last":1.7130000000000001}]},{"osd":12,"last update":"Thu Apr 18 14:44:20 2024","interfaces":[{"interface":"back","average":{"1min":1.3440000000000001,"5min":1.3440000000000001,"15min":1.3440000000000001},"min":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"max":{"1min":3.5539999999999998,"5min":3.5539999999999998,"15min":3.5539999999999998},"last":1.774},{"interface":"front","average":{"1min":1.431,"5min":1.431,"15min":1.431},"min":{"1min":0.621,"5min":0.621,"15min":0.621},"max":{"1min":4.125,"5min":4.125,"15min":4.125},"last":1.546}]},{"osd":13,"last update":"Thu Apr 18 14:44:20 2024","interfaces":[{"interface":"back","average":{"1min":1.71,"5min":1.71,"15min":1.71},"min":{"1min":1.1160000000000001,"5min":1.1160000000000001,"15min":1.1160000000000001},"max":{"1min":4.5359999999999996,"5min":4.5359999999999996,"15min":4.5359999999999996},"last":1.506},{"interface":"front","average":{"1min":1.5429999999999999,"5min":1.5429999999999999,"15min":1.5429999999999999},"min":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.85599999999999998},"max":{"1min":4.0049999999999999,"5min":4.0049999999999999,"15min":4.0049999999999999},"last":1.847}]},{"osd":14,"last update":"Thu Apr 18 14:44:20 2024","interfaces":[{"interface":"back","average":{"1min":1.7090000000000001,"5min":1.7090000000000001,"15min":1.7090000000000001},"min":{"1min":1.073,"5min":1.073,"15min":1.073},"max":{"1min":4.3940000000000001,"5min":4.3940000000000001,"15min":4.3940000000000001},"last":1.879},{"interface":"front","average":{"1min":1.5680000000000001,"5min":1.5680000000000001,"15min":1.5680000000000001},"min":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"max":{"1min":3.73,"5min":3.73,"15min":3.73},"last":1.897}]},{"osd":15,"last update":"Thu Apr 18 14:44:20 2024","interfaces":[{"interface":"back","average":{"1min":1.5629999999999999,"5min":1.5629999999999999,"15min":1.5629999999999999},"min":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":0.94999999999999996},"max":{"1min":4.1959999999999997,"5min":4.1959999999999997,"15min":4.1959999999999997},"last":1.748},{"interface":"front","average":{"1min":1.802,"5min":1.802,"15min":1.802},"min":{"1min":1.1579999999999999,"5min":1.1579999999999999,"15min":1.1579999999999999},"max":{"1min":4.577,"5min":4.577,"15min":4.577},"last":1.8100000000000001}]}]},{"osd":11,"up_from":22,"seq":94489280539,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32932,"kb_used_data":1816,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94338908,"statfs":{"total":96636764160,"available":96603041792,"internally_reserved":0,"allocated":1859584,"data_stored":1077797,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31848901},"hb_peers":[2,4,5,6,8,10,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":2,"last update":"Thu Apr 18 14:44:18 2024","interfaces":[{"interface":"back","average":{"1min":0.93899999999999995,"5min":0.93899999999999995,"15min":0.93899999999999995},"min":{"1min":0.503,"5min":0.503,"15min":0.503},"max":{"1min":1.367,"5min":1.367,"15min":1.367},"last":1.224},{"interface":"front","average":{"1min":1.0229999999999999,"5min":1.0229999999999999,"15min":1.0229999999999999},"min":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":2.863,"5min":2.863,"15min":2.863},"last":0.86099999999999999}]},{"osd":4,"last update":"Thu Apr 18 14:44:18 2024","interfaces":[{"interface":"back","average":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"min":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":1.1259999999999999,"5min":1.1259999999999999,"15min":1.1259999999999999},"last":0.79000000000000004},{"interface":"front","average":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.129,"5min":1.129,"15min":1.129},"last":0.66700000000000004}]},{"osd":5,"last update":"Thu Apr 18 14:44:23 2024","interfaces":[{"interface":"back","average":{"1min":0.98999999999999999,"5min":0.98999999999999999,"15min":0.98999999999999999},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":1.5840000000000001,"5min":1.5840000000000001,"15min":1.5840000000000001},"last":1.2729999999999999},{"interface":"front","average":{"1min":0.97199999999999998,"5min":0.97199999999999998,"15min":0.97199999999999998},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.619,"5min":1.619,"15min":1.619},"last":1.4330000000000001}]},{"osd":6,"last update":"Thu Apr 18 14:44:18 2024","interfaces":[{"interface":"back","average":{"1min":1.1319999999999999,"5min":1.1319999999999999,"15min":1.1319999999999999},"min":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"max":{"1min":2.9199999999999999,"5min":2.9199999999999999,"15min":2.9199999999999999},"last":1.464},{"interface":"front","average":{"1min":1,"5min":1,"15min":1},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.9510000000000001,"5min":1.9510000000000001,"15min":1.9510000000000001},"last":1.363}]},{"osd":8,"last update":"Thu Apr 18 14:44:23 2024","interfaces":[{"interface":"back","average":{"1min":0.97799999999999998,"5min":0.97799999999999998,"15min":0.97799999999999998},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.452,"5min":1.452,"15min":1.452},"last":0.96599999999999997},{"interface":"front","average":{"1min":1.006,"5min":1.006,"15min":1.006},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":1.383,"5min":1.383,"15min":1.383},"last":1.5669999999999999}]},{"osd":10,"last update":"Thu Apr 18 14:44:18 2024","interfaces":[{"interface":"back","average":{"1min":1.234,"5min":1.234,"15min":1.234},"min":{"1min":0.745,"5min":0.745,"15min":0.745},"max":{"1min":2.774,"5min":2.774,"15min":2.774},"last":1.595},{"interface":"front","average":{"1min":1.105,"5min":1.105,"15min":1.105},"min":{"1min":0.627,"5min":0.627,"15min":0.627},"max":{"1min":1.6890000000000001,"5min":1.6890000000000001,"15min":1.6890000000000001},"last":1.4990000000000001}]},{"osd":12,"last update":"Thu Apr 18 14:44:18 2024","interfaces":[{"interface":"back","average":{"1min":1.1639999999999999,"5min":1.1639999999999999,"15min":1.1639999999999999},"min":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.6719999999999999,"5min":1.6719999999999999,"15min":1.6719999999999999},"last":2.0270000000000001},{"interface":"front","average":{"1min":1.2729999999999999,"5min":1.2729999999999999,"15min":1.2729999999999999},"min":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"max":{"1min":3.4169999999999998,"5min":3.4169999999999998,"15min":3.4169999999999998},"last":1.738}]},{"osd":13,"last update":"Thu Apr 18 14:44:23 2024","interfaces":[{"interface":"back","average":{"1min":1.367,"5min":1.367,"15min":1.367},"min":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"max":{"1min":3.3239999999999998,"5min":3.3239999999999998,"15min":3.3239999999999998},"last":1.9410000000000001},{"interface":"front","average":{"1min":1.1639999999999999,"5min":1.1639999999999999,"15min":1.1639999999999999},"min":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"max":{"1min":1.746,"5min":1.746,"15min":1.746},"last":1.6619999999999999}]},{"osd":14,"last update":"Thu Apr 18 14:44:18 2024","interfaces":[{"interface":"back","average":{"1min":1.1950000000000001,"5min":1.1950000000000001,"15min":1.1950000000000001},"min":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"max":{"1min":1.6619999999999999,"5min":1.6619999999999999,"15min":1.6619999999999999},"last":1.8899999999999999},{"interface":"front","average":{"1min":1.2450000000000001,"5min":1.2450000000000001,"15min":1.2450000000000001},"min":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"max":{"1min":1.7210000000000001,"5min":1.7210000000000001,"15min":1.7210000000000001},"last":1.9750000000000001}]},{"osd":15,"last update":"Thu Apr 18 14:44:23 2024","interfaces":[{"interface":"back","average":{"1min":1.284,"5min":1.284,"15min":1.284},"min":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"max":{"1min":1.851,"5min":1.851,"15min":1.851},"last":1.8320000000000001},{"interface":"front","average":{"1min":1.409,"5min":1.409,"15min":1.409},"min":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"max":{"1min":3.3769999999999998,"5min":3.3769999999999998,"15min":3.3769999999999998},"last":2.1520000000000001}]}]},{"osd":12,"up_from":22,"seq":94489280539,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32932,"kb_used_data":1816,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94338908,"statfs":{"total":96636764160,"available":96603041792,"internally_reserved":0,"allocated":1859584,"data_stored":1077797,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[1,3,4,5,6,10,11,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Apr 18 14:44:30 2024","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":1.3400000000000001,"5min":1.3400000000000001,"15min":1.3400000000000001},"last":0.68100000000000005},{"interface":"front","average":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":1.2310000000000001,"5min":1.2310000000000001,"15min":1.2310000000000001},"last":0.78900000000000003}]},{"osd":1,"last update":"Thu Apr 18 14:44:20 2024","interfaces":[{"interface":"back","average":{"1min":0.93999999999999995,"5min":0.93999999999999995,"15min":0.93999999999999995},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.5449999999999999,"5min":1.5449999999999999,"15min":1.5449999999999999},"last":0.61799999999999999},{"interface":"front","average":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":1.2649999999999999,"5min":1.2649999999999999,"15min":1.2649999999999999},"last":0.85399999999999998}]},{"osd":3,"last update":"Thu Apr 18 14:44:20 2024","interfaces":[{"interface":"back","average":{"1min":0.93999999999999995,"5min":0.93999999999999995,"15min":0.93999999999999995},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":1.4930000000000001,"5min":1.4930000000000001,"15min":1.4930000000000001},"last":0.81200000000000006},{"interface":"front","average":{"1min":0.91500000000000004,"5min":0.91500000000000004,"15min":0.91500000000000004},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.4319999999999999,"5min":1.4319999999999999,"15min":1.4319999999999999},"last":0.95299999999999996}]},{"osd":4,"last update":"Thu Apr 18 14:44:20 2024","interfaces":[{"interface":"back","average":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":1.383,"5min":1.383,"15min":1.383},"last":0.76300000000000001},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":1.335,"5min":1.335,"15min":1.335},"last":0.57699999999999996}]},{"osd":5,"last update":"Thu Apr 18 14:44:30 2024","interfaces":[{"interface":"back","average":{"1min":0.93100000000000005,"5min":0.93100000000000005,"15min":0.93100000000000005},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.4710000000000001,"5min":1.4710000000000001,"15min":1.4710000000000001},"last":0.99399999999999999},{"interface":"front","average":{"1min":1.03,"5min":1.03,"15min":1.03},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.784,"5min":1.784,"15min":1.784},"last":1.284}]},{"osd":6,"last update":"Thu Apr 18 14:44:20 2024","interfaces":[{"interface":"back","average":{"1min":1.0289999999999999,"5min":1.0289999999999999,"15min":1.0289999999999999},"min":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":1.6060000000000001,"5min":1.6060000000000001,"15min":1.6060000000000001},"last":0.92800000000000005},{"interface":"front","average":{"1min":1.0820000000000001,"5min":1.0820000000000001,"15min":1.0820000000000001},"min":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"max":{"1min":1.5620000000000001,"5min":1.5620000000000001,"15min":1.5620000000000001},"last":1.022}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1539999999999999}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4119999999999999}]},{"osd":10,"last update":"Thu Apr 18 14:44:20 2024","interfaces":[{"interface":"back","average":{"1min":1.137,"5min":1.137,"15min":1.137},"min":{"1min":0.626,"5min":0.626,"15min":0.626},"max":{"1min":1.6919999999999999,"5min":1.6919999999999999,"15min":1.6919999999999999},"last":0.89800000000000002},{"interface":"front","average":{"1min":1.1100000000000001,"5min":1.1100000000000001,"15min":1.1100000000000001},"min":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"max":{"1min":1.8899999999999999,"5min":1.8899999999999999,"15min":1.8899999999999999},"last":1.0680000000000001}]},{"osd":11,"last update":"Thu Apr 18 14:44:20 2024","interfaces":[{"interface":"back","average":{"1min":1.1890000000000001,"5min":1.1890000000000001,"15min":1.1890000000000001},"min":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"max":{"1min":2.04,"5min":2.04,"15min":2.04},"last":1.1519999999999999},{"interface":"front","average":{"1min":1.1599999999999999,"5min":1.1599999999999999,"15min":1.1599999999999999},"min":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"max":{"1min":1.8660000000000001,"5min":1.8660000000000001,"15min":1.8660000000000001},"last":1.093}]},{"osd":13,"last update":"Thu Apr 18 14:44:20 2024","interfaces":[{"interface":"back","average":{"1min":1.181,"5min":1.181,"15min":1.181},"min":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"max":{"1min":1.8080000000000001,"5min":1.8080000000000001,"15min":1.8080000000000001},"last":1.1120000000000001},{"interface":"front","average":{"1min":1.228,"5min":1.228,"15min":1.228},"min":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"max":{"1min":2.133,"5min":2.133,"15min":2.133},"last":1.2529999999999999}]},{"osd":14,"last update":"Thu Apr 18 14:44:20 2024","interfaces":[{"interface":"back","average":{"1min":1.226,"5min":1.226,"15min":1.226},"min":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"max":{"1min":1.7410000000000001,"5min":1.7410000000000001,"15min":1.7410000000000001},"last":1.1919999999999999},{"interface":"front","average":{"1min":1.232,"5min":1.232,"15min":1.232},"min":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"max":{"1min":1.966,"5min":1.966,"15min":1.966},"last":1.319}]},{"osd":15,"last update":"Thu Apr 18 14:44:20 2024","interfaces":[{"interface":"back","average":{"1min":1.2190000000000001,"5min":1.2190000000000001,"15min":1.2190000000000001},"min":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"max":{"1min":1.802,"5min":1.802,"15min":1.802},"last":1.1739999999999999},{"interface":"front","average":{"1min":1.2889999999999999,"5min":1.2889999999999999,"15min":1.2889999999999999},"min":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"max":{"1min":1.8580000000000001,"5min":1.8580000000000001,"15min":1.8580000000000001},"last":1.3620000000000001}]}]},{"osd":0,"up_from":23,"seq":98784247835,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33468,"kb_used_data":2352,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94338372,"statfs":{"total":96636764160,"available":96602492928,"internally_reserved":0,"allocated":2408448,"data_stored":1616239,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[1,4,6,7,8,10,11,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Apr 18 14:44:23 2024","interfaces":[{"interface":"back","average":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":1.218,"5min":1.218,"15min":1.218},"last":1.026},{"interface":"front","average":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.47,"5min":1.47,"15min":1.47},"last":1.056}]},{"osd":4,"last update":"Thu Apr 18 14:44:19 2024","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":1.5409999999999999,"5min":1.5409999999999999,"15min":1.5409999999999999},"last":0.61499999999999999},{"interface":"front","average":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":1.903,"5min":1.903,"15min":1.903},"last":0.64000000000000001}]},{"osd":6,"last update":"Thu Apr 18 14:44:19 2024","interfaces":[{"interface":"back","average":{"1min":0.90200000000000002,"5min":0.90200000000000002,"15min":0.90200000000000002},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":2.5009999999999999,"5min":2.5009999999999999,"15min":2.5009999999999999},"last":0.96399999999999997},{"interface":"front","average":{"1min":0.89500000000000002,"5min":0.89500000000000002,"15min":0.89500000000000002},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":1.6240000000000001,"5min":1.6240000000000001,"15min":1.6240000000000001},"last":0.91100000000000003}]},{"osd":7,"last update":"Thu Apr 18 14:44:19 2024","interfaces":[{"interface":"back","average":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":1.2350000000000001,"5min":1.2350000000000001,"15min":1.2350000000000001},"last":0.71499999999999997},{"interface":"front","average":{"1min":0.93899999999999995,"5min":0.93899999999999995,"15min":0.93899999999999995},"min":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"max":{"1min":1.5860000000000001,"5min":1.5860000000000001,"15min":1.5860000000000001},"last":0.78800000000000003}]},{"osd":8,"last update":"Thu Apr 18 14:44:19 2024","interfaces":[{"interface":"back","average":{"1min":1.734,"5min":1.734,"15min":1.734},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":18.015999999999998,"5min":18.015999999999998,"15min":18.015999999999998},"last":0.73099999999999998},{"interface":"front","average":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":1.6599999999999999,"5min":1.6599999999999999,"15min":1.6599999999999999},"last":0.57499999999999996}]},{"osd":10,"last update":"Thu Apr 18 14:44:19 2024","interfaces":[{"interface":"back","average":{"1min":1.0960000000000001,"5min":1.0960000000000001,"15min":1.0960000000000001},"min":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"max":{"1min":2.1339999999999999,"5min":2.1339999999999999,"15min":2.1339999999999999},"last":1.1020000000000001},{"interface":"front","average":{"1min":1.119,"5min":1.119,"15min":1.119},"min":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"max":{"1min":1.8540000000000001,"5min":1.8540000000000001,"15min":1.8540000000000001},"last":0.94999999999999996}]},{"osd":11,"last update":"Thu Apr 18 14:44:19 2024","interfaces":[{"interface":"back","average":{"1min":2.9990000000000001,"5min":2.9990000000000001,"15min":2.9990000000000001},"min":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":41.195999999999998,"5min":41.195999999999998,"15min":41.195999999999998},"last":0.85699999999999998},{"interface":"front","average":{"1min":3.1339999999999999,"5min":3.1339999999999999,"15min":3.1339999999999999},"min":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"max":{"1min":41.216999999999999,"5min":41.216999999999999,"15min":41.216999999999999},"last":1}]},{"osd":13,"last update":"Thu Apr 18 14:44:23 2024","interfaces":[{"interface":"back","average":{"1min":0.95099999999999996,"5min":0.95099999999999996,"15min":0.95099999999999996},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":1.881,"5min":1.881,"15min":1.881},"last":0.748},{"interface":"front","average":{"1min":1.091,"5min":1.091,"15min":1.091},"min":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":1.8720000000000001,"5min":1.8720000000000001,"15min":1.8720000000000001},"last":0.82299999999999995}]},{"osd":14,"last update":"Thu Apr 18 14:44:19 2024","interfaces":[{"interface":"back","average":{"1min":1.103,"5min":1.103,"15min":1.103},"min":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"max":{"1min":1.95,"5min":1.95,"15min":1.95},"last":0.77400000000000002},{"interface":"front","average":{"1min":1.095,"5min":1.095,"15min":1.095},"min":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"max":{"1min":2.1219999999999999,"5min":2.1219999999999999,"15min":2.1219999999999999},"last":0.89000000000000001}]},{"osd":15,"last update":"Thu Apr 18 14:44:19 2024","interfaces":[{"interface":"back","average":{"1min":1.224,"5min":1.224,"15min":1.224},"min":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"max":{"1min":1.929,"5min":1.929,"15min":1.929},"last":0.93000000000000005},{"interface":"front","average":{"1min":1.179,"5min":1.179,"15min":1.179},"min":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":2.056,"5min":2.056,"15min":2.056},"last":0.97799999999999998}]}]},{"osd":3,"up_from":23,"seq":98784247834,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32956,"kb_used_data":1836,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94338884,"statfs":{"total":96636764160,"available":96603017216,"internally_reserved":0,"allocated":1880064,"data_stored":1088155,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31848904},"hb_peers":[0,2,4,5,8,9,10,11,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Apr 18 14:44:20 2024","interfaces":[{"interface":"back","average":{"1min":0.88200000000000001,"5min":0.88200000000000001,"15min":0.88200000000000001},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":1.4510000000000001,"5min":1.4510000000000001,"15min":1.4510000000000001},"last":1.387},{"interface":"front","average":{"1min":1,"5min":1,"15min":1},"min":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"max":{"1min":1.4850000000000001,"5min":1.4850000000000001,"15min":1.4850000000000001},"last":1.1719999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4590000000000001}]},{"osd":2,"last update":"Thu Apr 18 14:44:20 2024","interfaces":[{"interface":"back","average":{"1min":0.98599999999999999,"5min":0.98599999999999999,"15min":0.98599999999999999},"min":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.5469999999999999,"5min":1.5469999999999999,"15min":1.5469999999999999},"last":0.70399999999999996},{"interface":"front","average":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":0.94999999999999996},"min":{"1min":0.623,"5min":0.623,"15min":0.623},"max":{"1min":1.425,"5min":1.425,"15min":1.425},"last":0.95899999999999996}]},{"osd":4,"last update":"Thu Apr 18 14:44:20 2024","interfaces":[{"interface":"back","average":{"1min":1.008,"5min":1.008,"15min":1.008},"min":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.7030000000000001,"5min":1.7030000000000001,"15min":1.7030000000000001},"last":0.80000000000000004},{"interface":"front","average":{"1min":0.98699999999999999,"5min":0.98699999999999999,"15min":0.98699999999999999},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":1.5309999999999999,"5min":1.5309999999999999,"15min":1.5309999999999999},"last":0.92200000000000004}]},{"osd":5,"last update":"Thu Apr 18 14:44:20 2024","interfaces":[{"interface":"back","average":{"1min":1.087,"5min":1.087,"15min":1.087},"min":{"1min":0.624,"5min":0.624,"15min":0.624},"max":{"1min":1.663,"5min":1.663,"15min":1.663},"last":1.1379999999999999},{"interface":"front","average":{"1min":1.206,"5min":1.206,"15min":1.206},"min":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":1.6779999999999999,"5min":1.6779999999999999,"15min":1.6779999999999999},"last":1.2609999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.472}]},{"osd":7,"last update":"Thu Apr 18 14:44:20 2024","interfaces":[{"interface":"back","average":{"1min":1.157,"5min":1.157,"15min":1.157},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.645,"5min":1.645,"15min":1.645},"last":0.82199999999999995},{"interface":"front","average":{"1min":1.115,"5min":1.115,"15min":1.115},"min":{"1min":0.503,"5min":0.503,"15min":0.503},"max":{"1min":1.6419999999999999,"5min":1.6419999999999999,"15min":1.6419999999999999},"last":0.90800000000000003}]},{"osd":8,"last update":"Thu Apr 18 14:44:20 2024","interfaces":[{"interface":"back","average":{"1min":1.1339999999999999,"5min":1.1339999999999999,"15min":1.1339999999999999},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.7529999999999999,"5min":1.7529999999999999,"15min":1.7529999999999999},"last":1.232},{"interface":"front","average":{"1min":1.304,"5min":1.304,"15min":1.304},"min":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"max":{"1min":1.7430000000000001,"5min":1.7430000000000001,"15min":1.7430000000000001},"last":1.359}]},{"osd":9,"last update":"Thu Apr 18 14:44:33 2024","interfaces":[{"interface":"back","average":{"1min":1.3,"5min":1.3,"15min":1.3},"min":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"max":{"1min":1.879,"5min":1.879,"15min":1.879},"last":1.0069999999999999},{"interface":"front","average":{"1min":1.254,"5min":1.254,"15min":1.254},"min":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"max":{"1min":1.8260000000000001,"5min":1.8260000000000001,"15min":1.8260000000000001},"last":1.4750000000000001}]},{"osd":10,"last update":"Thu Apr 18 14:44:20 2024","interfaces":[{"interface":"back","average":{"1min":1.327,"5min":1.327,"15min":1.327},"min":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"max":{"1min":1.883,"5min":1.883,"15min":1.883},"last":1.2889999999999999},{"interface":"front","average":{"1min":1.3660000000000001,"5min":1.3660000000000001,"15min":1.3660000000000001},"min":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"max":{"1min":2.161,"5min":2.161,"15min":2.161},"last":1.663}]},{"osd":11,"last update":"Thu Apr 18 14:44:20 2024","interfaces":[{"interface":"back","average":{"1min":1.4330000000000001,"5min":1.4330000000000001,"15min":1.4330000000000001},"min":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"max":{"1min":1.8959999999999999,"5min":1.8959999999999999,"15min":1.8959999999999999},"last":1.419},{"interface":"front","average":{"1min":1.381,"5min":1.381,"15min":1.381},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":2.1160000000000001,"5min":2.1160000000000001,"15min":2.1160000000000001},"last":1.0720000000000001}]},{"osd":12,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.8740000000000001}]},{"osd":14,"last update":"Thu Apr 18 14:44:20 2024","interfaces":[{"interface":"back","average":{"1min":1.512,"5min":1.512,"15min":1.512},"min":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":0.94999999999999996},"max":{"1min":2.2879999999999998,"5min":2.2879999999999998,"15min":2.2879999999999998},"last":1.5760000000000001},{"interface":"front","average":{"1min":1.4139999999999999,"5min":1.4139999999999999,"15min":1.4139999999999999},"min":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"max":{"1min":2.0179999999999998,"5min":2.0179999999999998,"15min":2.0179999999999998},"last":1.7270000000000001}]},{"osd":15,"last update":"Thu Apr 18 14:44:33 2024","interfaces":[{"interface":"back","average":{"1min":1.4730000000000001,"5min":1.4730000000000001,"15min":1.4730000000000001},"min":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"max":{"1min":2.1120000000000001,"5min":2.1120000000000001,"15min":2.1120000000000001},"last":1.786},{"interface":"front","average":{"1min":1.452,"5min":1.452,"15min":1.452},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.9299999999999999,"5min":1.9299999999999999,"15min":1.9299999999999999},"last":1.496}]}]},{"osd":7,"up_from":23,"seq":98784247836,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32952,"kb_used_data":1832,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94338888,"statfs":{"total":96636764160,"available":96603021312,"internally_reserved":0,"allocated":1875968,"data_stored":1087311,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":31848907},"hb_peers":[0,2,3,4,5,6,8,10,12,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Apr 18 14:44:34 2024","interfaces":[{"interface":"back","average":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":1.109,"5min":1.109,"15min":1.109},"last":0.70199999999999996},{"interface":"front","average":{"1min":0.873,"5min":0.873,"15min":0.873},"min":{"1min":0.505,"5min":0.505,"15min":0.505},"max":{"1min":1.7589999999999999,"5min":1.7589999999999999,"15min":1.7589999999999999},"last":0.67400000000000004}]},{"osd":2,"last update":"Thu Apr 18 14:44:21 2024","interfaces":[{"interface":"back","average":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"min":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":1.1519999999999999,"5min":1.1519999999999999,"15min":1.1519999999999999},"last":0.78900000000000003},{"interface":"front","average":{"1min":0.97599999999999998,"5min":0.97599999999999998,"15min":0.97599999999999998},"min":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"max":{"1min":1.891,"5min":1.891,"15min":1.891},"last":0.91900000000000004}]},{"osd":3,"last update":"Thu Apr 18 14:44:34 2024","interfaces":[{"interface":"back","average":{"1min":0.88200000000000001,"5min":0.88200000000000001,"15min":0.88200000000000001},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.5920000000000001,"5min":1.5920000000000001,"15min":1.5920000000000001},"last":0.58499999999999996},{"interface":"front","average":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":1.2330000000000001,"5min":1.2330000000000001,"15min":1.2330000000000001},"last":0.875}]},{"osd":4,"last update":"Thu Apr 18 14:44:21 2024","interfaces":[{"interface":"back","average":{"1min":0.95699999999999996,"5min":0.95699999999999996,"15min":0.95699999999999996},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.258,"5min":1.258,"15min":1.258},"last":1.091},{"interface":"front","average":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":1.2170000000000001,"5min":1.2170000000000001,"15min":1.2170000000000001},"last":1.0620000000000001}]},{"osd":5,"last update":"Thu Apr 18 14:44:21 2024","interfaces":[{"interface":"back","average":{"1min":1.1140000000000001,"5min":1.1140000000000001,"15min":1.1140000000000001},"min":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"max":{"1min":1.8580000000000001,"5min":1.8580000000000001,"15min":1.8580000000000001},"last":1.022},{"interface":"front","average":{"1min":1.1120000000000001,"5min":1.1120000000000001,"15min":1.1120000000000001},"min":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"max":{"1min":1.53,"5min":1.53,"15min":1.53},"last":0.95299999999999996}]},{"osd":6,"last update":"Thu Apr 18 14:44:21 2024","interfaces":[{"interface":"back","average":{"1min":1.139,"5min":1.139,"15min":1.139},"min":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"max":{"1min":1.8759999999999999,"5min":1.8759999999999999,"15min":1.8759999999999999},"last":1.1160000000000001},{"interface":"front","average":{"1min":1.171,"5min":1.171,"15min":1.171},"min":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"max":{"1min":1.4570000000000001,"5min":1.4570000000000001,"15min":1.4570000000000001},"last":0.84699999999999998}]},{"osd":8,"last update":"Thu Apr 18 14:44:21 2024","interfaces":[{"interface":"back","average":{"1min":1.095,"5min":1.095,"15min":1.095},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":1.4159999999999999,"5min":1.4159999999999999,"15min":1.4159999999999999},"last":0.622},{"interface":"front","average":{"1min":1.274,"5min":1.274,"15min":1.274},"min":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"max":{"1min":1.821,"5min":1.821,"15min":1.821},"last":0.753}]},{"osd":10,"last update":"Thu Apr 18 14:44:21 2024","interfaces":[{"interface":"back","average":{"1min":1.151,"5min":1.151,"15min":1.151},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.831,"5min":1.831,"15min":1.831},"last":0.97699999999999998},{"interface":"front","average":{"1min":1.278,"5min":1.278,"15min":1.278},"min":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"max":{"1min":1.53,"5min":1.53,"15min":1.53},"last":0.996}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71699999999999997}]},{"osd":12,"last update":"Thu Apr 18 14:44:21 2024","interfaces":[{"interface":"back","average":{"1min":1.2270000000000001,"5min":1.2270000000000001,"15min":1.2270000000000001},"min":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.7549999999999999,"5min":1.7549999999999999,"15min":1.7549999999999999},"last":0.73099999999999998},{"interface":"front","average":{"1min":1.4039999999999999,"5min":1.4039999999999999,"15min":1.4039999999999999},"min":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"max":{"1min":2.0960000000000001,"5min":2.0960000000000001,"15min":2.0960000000000001},"last":0.81799999999999995}]},{"osd":14,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3819999999999999}]},{"osd":15,"last update":"Thu Apr 18 14:44:21 2024","interfaces":[{"interface":"back","average":{"1min":1.4330000000000001,"5min":1.4330000000000001,"15min":1.4330000000000001},"min":{"1min":0.874,"5min":0.874,"15min":0.874},"max":{"1min":2.6699999999999999,"5min":2.6699999999999999,"15min":2.6699999999999999},"last":1.1639999999999999},{"interface":"front","average":{"1min":1.401,"5min":1.401,"15min":1.401},"min":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":2.516,"5min":2.516,"15min":2.516},"last":1.1399999999999999}]}]},{"osd":8,"up_from":23,"seq":98784247836,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32956,"kb_used_data":1832,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94338884,"statfs":{"total":96636764160,"available":96603017216,"internally_reserved":0,"allocated":1875968,"data_stored":1087311,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[1,2,3,4,5,7,9,11,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Apr 18 14:44:32 2024","interfaces":[{"interface":"back","average":{"1min":0.746,"5min":0.746,"15min":0.746},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":1.7290000000000001,"5min":1.7290000000000001,"15min":1.7290000000000001},"last":2.4540000000000002},{"interface":"front","average":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":2.48,"5min":2.48,"15min":2.48},"last":2.1669999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72999999999999998}]},{"osd":2,"last update":"Thu Apr 18 14:44:22 2024","interfaces":[{"interface":"back","average":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":1.1339999999999999,"5min":1.1339999999999999,"15min":1.1339999999999999},"last":0.76600000000000001},{"interface":"front","average":{"1min":0.996,"5min":0.996,"15min":0.996},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":2.54,"5min":2.54,"15min":2.54},"last":0.50700000000000001}]},{"osd":3,"last update":"Thu Apr 18 14:44:32 2024","interfaces":[{"interface":"back","average":{"1min":0.88800000000000001,"5min":0.88800000000000001,"15min":0.88800000000000001},"min":{"1min":0.628,"5min":0.628,"15min":0.628},"max":{"1min":1.137,"5min":1.137,"15min":1.137},"last":0.70199999999999996},{"interface":"front","average":{"1min":1.0209999999999999,"5min":1.0209999999999999,"15min":1.0209999999999999},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":2.6779999999999999,"5min":2.6779999999999999,"15min":2.6779999999999999},"last":0.58999999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46899999999999997}]},{"osd":5,"last update":"Thu Apr 18 14:44:22 2024","interfaces":[{"interface":"back","average":{"1min":1.0549999999999999,"5min":1.0549999999999999,"15min":1.0549999999999999},"min":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":2.7810000000000001,"5min":2.7810000000000001,"15min":2.7810000000000001},"last":0.753},{"interface":"front","average":{"1min":0.91800000000000004,"5min":0.91800000000000004,"15min":0.91800000000000004},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.5309999999999999,"5min":1.5309999999999999,"15min":1.5309999999999999},"last":0.55500000000000005}]},{"osd":7,"last update":"Thu Apr 18 14:44:22 2024","interfaces":[{"interface":"back","average":{"1min":1.042,"5min":1.042,"15min":1.042},"min":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":1.925,"5min":1.925,"15min":1.925},"last":0.63400000000000001},{"interface":"front","average":{"1min":1.0800000000000001,"5min":1.0800000000000001,"15min":1.0800000000000001},"min":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"max":{"1min":1.669,"5min":1.669,"15min":1.669},"last":0.84199999999999997}]},{"osd":9,"last update":"Thu Apr 18 14:44:22 2024","interfaces":[{"interface":"back","average":{"1min":1.0249999999999999,"5min":1.0249999999999999,"15min":1.0249999999999999},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":1.6479999999999999,"5min":1.6479999999999999,"15min":1.6479999999999999},"last":0.64400000000000002},{"interface":"front","average":{"1min":1.163,"5min":1.163,"15min":1.163},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":2.9319999999999999,"5min":2.9319999999999999,"15min":2.9319999999999999},"last":0.53800000000000003}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.665}]},{"osd":11,"last update":"Thu Apr 18 14:44:22 2024","interfaces":[{"interface":"back","average":{"1min":1.206,"5min":1.206,"15min":1.206},"min":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"max":{"1min":2.1139999999999999,"5min":2.1139999999999999,"15min":2.1139999999999999},"last":0.85599999999999998},{"interface":"front","average":{"1min":1.2929999999999999,"5min":1.2929999999999999,"15min":1.2929999999999999},"min":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"max":{"1min":2.25,"5min":2.25,"15min":2.25},"last":0.79800000000000004}]},{"osd":12,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5629999999999999}]},{"osd":14,"last update":"Thu Apr 18 14:44:22 2024","interfaces":[{"interface":"back","average":{"1min":1.341,"5min":1.341,"15min":1.341},"min":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"max":{"1min":2.5800000000000001,"5min":2.5800000000000001,"15min":2.5800000000000001},"last":0.81999999999999995},{"interface":"front","average":{"1min":1.3919999999999999,"5min":1.3919999999999999,"15min":1.3919999999999999},"min":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"max":{"1min":3.0739999999999998,"5min":3.0739999999999998,"15min":3.0739999999999998},"last":0.81299999999999994}]},{"osd":15,"last update":"Thu Apr 18 14:44:22 2024","interfaces":[{"interface":"back","average":{"1min":1.355,"5min":1.355,"15min":1.355},"min":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"max":{"1min":2.4740000000000002,"5min":2.4740000000000002,"15min":2.4740000000000002},"last":0.878},{"interface":"front","average":{"1min":1.4159999999999999,"5min":1.4159999999999999,"15min":1.4159999999999999},"min":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"max":{"1min":2.8620000000000001,"5min":2.8620000000000001,"15min":2.8620000000000001},"last":0.78500000000000003}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":13,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":12,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":13,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":14,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":15,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-18T14:45:11.840 INFO:tasks.ceph.ceph_manager.ceph:recovered! 2024-04-18T14:45:11.841 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-04-18T14:45:11.849 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-04-18T14:45:11.850 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-18T14:45:12.138 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-04-18T14:45:12.139 INFO:teuthology.orchestra.run.smithi086.stderr:dumped all 2024-04-18T14:45:12.155 INFO:teuthology.orchestra.run.smithi086.stdout:{"pg_ready":true,"pg_map":{"version":171,"stamp":"2024-04-18T14:45:11.370991+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":16,"num_per_pool_osds":16,"num_per_pool_omap_osds":11,"kb":1509949440,"kb_used":560224,"kb_used_data":30316,"kb_used_omap":24,"kb_used_meta":529639,"kb_avail":1509389216,"statfs":{"total":1546188226560,"available":1545614557184,"internally_reserved":0,"allocated":31043584,"data_stored":18422684,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":25506,"internal_metadata":542350430},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.538435"},"pg_stats":[{"pgid":"1.0","version":"26'157","reported_seq":308,"reported_epoch":124,"state":"active+clean","last_fresh":"2024-04-18T14:45:07.185100+0000","last_change":"2024-04-18T14:44:37.152954+0000","last_active":"2024-04-18T14:45:07.185100+0000","last_peered":"2024-04-18T14:45:07.185100+0000","last_clean":"2024-04-18T14:45:07.185100+0000","last_became_active":"2024-04-18T14:43:20.323133+0000","last_became_peered":"2024-04-18T14:43:20.323133+0000","last_unstale":"2024-04-18T14:45:07.185100+0000","last_undegraded":"2024-04-18T14:45:07.185100+0000","last_fullsized":"2024-04-18T14:45:07.185100+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'157","last_scrub_stamp":"2024-04-18T14:44:37.152696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T14:43:18.296821+0000","last_clean_scrub_stamp":"2024-04-18T14:44:37.152696+0000","objects_scrubbed":2,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T14:45:43.293239+0000","scrub_duration":0.0049794150000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[13,0],"acting":[13,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":13,"acting_primary":13,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":114,"reported_epoch":124,"state":"active+clean","last_fresh":"2024-04-18T14:45:05.843355+0000","last_change":"2024-04-18T14:44:23.449444+0000","last_active":"2024-04-18T14:45:05.843355+0000","last_peered":"2024-04-18T14:45:05.843355+0000","last_clean":"2024-04-18T14:45:05.843355+0000","last_became_active":"2024-04-18T14:43:21.327764+0000","last_became_peered":"2024-04-18T14:43:21.327764+0000","last_unstale":"2024-04-18T14:45:05.843355+0000","last_undegraded":"2024-04-18T14:45:05.843355+0000","last_fullsized":"2024-04-18T14:45:05.843355+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T14:44:23.449241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T14:43:20.303322+0000","last_clean_scrub_stamp":"2024-04-18T14:44:23.449241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T14:45:36.175611+0000","scrub_duration":0.0029048670000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,15],"acting":[5,15],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":111,"reported_epoch":124,"state":"active+clean","last_fresh":"2024-04-18T14:45:05.845686+0000","last_change":"2024-04-18T14:44:37.374487+0000","last_active":"2024-04-18T14:45:05.845686+0000","last_peered":"2024-04-18T14:45:05.845686+0000","last_clean":"2024-04-18T14:45:05.845686+0000","last_became_active":"2024-04-18T14:43:21.414060+0000","last_became_peered":"2024-04-18T14:43:21.414060+0000","last_unstale":"2024-04-18T14:45:05.845686+0000","last_undegraded":"2024-04-18T14:45:05.845686+0000","last_fullsized":"2024-04-18T14:45:05.845686+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T14:44:37.374221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T14:43:20.303322+0000","last_clean_scrub_stamp":"2024-04-18T14:44:37.374221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T14:45:58.651147+0000","scrub_duration":0.0042134670000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":111,"reported_epoch":124,"state":"active+clean","last_fresh":"2024-04-18T14:45:07.185035+0000","last_change":"2024-04-18T14:44:24.148269+0000","last_active":"2024-04-18T14:45:07.185035+0000","last_peered":"2024-04-18T14:45:07.185035+0000","last_clean":"2024-04-18T14:45:07.185035+0000","last_became_active":"2024-04-18T14:43:21.328534+0000","last_became_peered":"2024-04-18T14:43:21.328534+0000","last_unstale":"2024-04-18T14:45:07.185035+0000","last_undegraded":"2024-04-18T14:45:07.185035+0000","last_fullsized":"2024-04-18T14:45:07.185035+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T14:44:24.148141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T14:43:20.303322+0000","last_clean_scrub_stamp":"2024-04-18T14:44:24.148141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T14:45:30.466689+0000","scrub_duration":0.001593882,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[13,5],"acting":[13,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":13,"acting_primary":13,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":111,"reported_epoch":124,"state":"active+clean","last_fresh":"2024-04-18T14:45:05.845692+0000","last_change":"2024-04-18T14:44:47.245574+0000","last_active":"2024-04-18T14:45:05.845692+0000","last_peered":"2024-04-18T14:45:05.845692+0000","last_clean":"2024-04-18T14:45:05.845692+0000","last_became_active":"2024-04-18T14:43:21.465481+0000","last_became_peered":"2024-04-18T14:43:21.465481+0000","last_unstale":"2024-04-18T14:45:05.845692+0000","last_undegraded":"2024-04-18T14:45:05.845692+0000","last_fullsized":"2024-04-18T14:45:05.845692+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T14:44:47.245297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T14:44:47.245297+0000","last_clean_scrub_stamp":"2024-04-18T14:44:47.245297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T14:46:02.649852+0000","scrub_duration":0.0038839159999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10],"acting":[3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":114,"reported_epoch":124,"state":"active+clean","last_fresh":"2024-04-18T14:45:07.345184+0000","last_change":"2024-04-18T14:44:38.485354+0000","last_active":"2024-04-18T14:45:07.345184+0000","last_peered":"2024-04-18T14:45:07.345184+0000","last_clean":"2024-04-18T14:45:07.345184+0000","last_became_active":"2024-04-18T14:43:21.348012+0000","last_became_peered":"2024-04-18T14:43:21.348012+0000","last_unstale":"2024-04-18T14:45:07.345184+0000","last_undegraded":"2024-04-18T14:45:07.345184+0000","last_fullsized":"2024-04-18T14:45:07.345184+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T14:44:38.485106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T14:43:20.303322+0000","last_clean_scrub_stamp":"2024-04-18T14:44:38.485106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T14:45:48.039171+0000","scrub_duration":0.0043932759999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,12],"acting":[6,12],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":111,"reported_epoch":124,"state":"active+clean","last_fresh":"2024-04-18T14:45:06.469135+0000","last_change":"2024-04-18T14:44:38.516905+0000","last_active":"2024-04-18T14:45:06.469135+0000","last_peered":"2024-04-18T14:45:06.469135+0000","last_clean":"2024-04-18T14:45:06.469135+0000","last_became_active":"2024-04-18T14:43:21.422468+0000","last_became_peered":"2024-04-18T14:43:21.422468+0000","last_unstale":"2024-04-18T14:45:06.469135+0000","last_undegraded":"2024-04-18T14:45:06.469135+0000","last_fullsized":"2024-04-18T14:45:06.469135+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T14:44:38.516629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T14:43:20.303322+0000","last_clean_scrub_stamp":"2024-04-18T14:44:38.516629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T14:45:46.715258+0000","scrub_duration":0.0039045249999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2],"acting":[8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":102,"reported_epoch":124,"state":"active+clean","last_fresh":"2024-04-18T14:45:06.548847+0000","last_change":"2024-04-18T14:44:59.929678+0000","last_active":"2024-04-18T14:45:06.548847+0000","last_peered":"2024-04-18T14:45:06.548847+0000","last_clean":"2024-04-18T14:45:06.548847+0000","last_became_active":"2024-04-18T14:44:59.929195+0000","last_became_peered":"2024-04-18T14:44:59.929195+0000","last_unstale":"2024-04-18T14:45:06.548847+0000","last_undegraded":"2024-04-18T14:45:06.548847+0000","last_fullsized":"2024-04-18T14:45:06.548847+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T14:44:36.901318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T14:43:20.303322+0000","last_clean_scrub_stamp":"2024-04-18T14:44:36.901318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T14:45:49.599440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[14,0],"acting":[14,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":14,"acting_primary":14,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":114,"reported_epoch":124,"state":"active+clean","last_fresh":"2024-04-18T14:45:06.548333+0000","last_change":"2024-04-18T14:44:22.508764+0000","last_active":"2024-04-18T14:45:06.548333+0000","last_peered":"2024-04-18T14:45:06.548333+0000","last_clean":"2024-04-18T14:45:06.548333+0000","last_became_active":"2024-04-18T14:43:21.328185+0000","last_became_peered":"2024-04-18T14:43:21.328185+0000","last_unstale":"2024-04-18T14:45:06.548333+0000","last_undegraded":"2024-04-18T14:45:06.548333+0000","last_fullsized":"2024-04-18T14:45:06.548333+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T14:44:22.508567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T14:43:20.303322+0000","last_clean_scrub_stamp":"2024-04-18T14:44:22.508567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T14:45:46.236519+0000","scrub_duration":0.0031913549999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[15,13],"acting":[15,13],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":15,"acting_primary":15,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":11},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1064960,"data_stored":1057856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":13,"up_from":24,"seq":103079215130,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33476,"kb_used_data":2356,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94338364,"statfs":{"total":96636764160,"available":96602484736,"internally_reserved":0,"allocated":2412544,"data_stored":1617083,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,2,3,4,5,7,11,12,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Apr 18 14:44:21 2024","interfaces":[{"interface":"back","average":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"min":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":1.792,"5min":1.792,"15min":1.792},"last":0.67100000000000004},{"interface":"front","average":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"min":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":2.0600000000000001,"5min":2.0600000000000001,"15min":2.0600000000000001},"last":0.71299999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84099999999999997}]},{"osd":2,"last update":"Thu Apr 18 14:44:21 2024","interfaces":[{"interface":"back","average":{"1min":1.0389999999999999,"5min":1.0389999999999999,"15min":1.0389999999999999},"min":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"max":{"1min":1.974,"5min":1.974,"15min":1.974},"last":0.98599999999999999},{"interface":"front","average":{"1min":1,"5min":1,"15min":1},"min":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.9910000000000001,"5min":1.9910000000000001,"15min":1.9910000000000001},"last":0.79200000000000004}]},{"osd":3,"last update":"Thu Apr 18 14:44:21 2024","interfaces":[{"interface":"back","average":{"1min":0.91500000000000004,"5min":0.91500000000000004,"15min":0.91500000000000004},"min":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"max":{"1min":1.2110000000000001,"5min":1.2110000000000001,"15min":1.2110000000000001},"last":1.0369999999999999},{"interface":"front","average":{"1min":1.0489999999999999,"5min":1.0489999999999999,"15min":1.0489999999999999},"min":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":1.4430000000000001,"5min":1.4430000000000001,"15min":1.4430000000000001},"last":1.113}]},{"osd":4,"last update":"Thu Apr 18 14:44:21 2024","interfaces":[{"interface":"back","average":{"1min":0.98099999999999998,"5min":0.98099999999999998,"15min":0.98099999999999998},"min":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.3919999999999999,"5min":1.3919999999999999,"15min":1.3919999999999999},"last":0.878},{"interface":"front","average":{"1min":0.90100000000000002,"5min":0.90100000000000002,"15min":0.90100000000000002},"min":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":1.306,"5min":1.306,"15min":1.306},"last":1.1559999999999999}]},{"osd":5,"last update":"Thu Apr 18 14:44:21 2024","interfaces":[{"interface":"back","average":{"1min":0.96399999999999997,"5min":0.96399999999999997,"15min":0.96399999999999997},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":1.5860000000000001,"5min":1.5860000000000001,"15min":1.5860000000000001},"last":0.95699999999999996},{"interface":"front","average":{"1min":1.0780000000000001,"5min":1.0780000000000001,"15min":1.0780000000000001},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.536,"5min":1.536,"15min":1.536},"last":0.93200000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1950000000000001}]},{"osd":7,"last update":"Thu Apr 18 14:44:32 2024","interfaces":[{"interface":"back","average":{"1min":1.1639999999999999,"5min":1.1639999999999999,"15min":1.1639999999999999},"min":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":2.4359999999999999,"5min":2.4359999999999999,"15min":2.4359999999999999},"last":1.079},{"interface":"front","average":{"1min":1.206,"5min":1.206,"15min":1.206},"min":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"max":{"1min":3.532,"5min":3.532,"15min":3.532},"last":1.177}]},{"osd":11,"last update":"Thu Apr 18 14:44:32 2024","interfaces":[{"interface":"back","average":{"1min":1.2350000000000001,"5min":1.2350000000000001,"15min":1.2350000000000001},"min":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"max":{"1min":1.8069999999999999,"5min":1.8069999999999999,"15min":1.8069999999999999},"last":1.1399999999999999},{"interface":"front","average":{"1min":1.2809999999999999,"5min":1.2809999999999999,"15min":1.2809999999999999},"min":{"1min":0.84799999999999998,"5min":0.84799999999999998,"15min":0.84799999999999998},"max":{"1min":2.2669999999999999,"5min":2.2669999999999999,"15min":2.2669999999999999},"last":1.2190000000000001}]},{"osd":12,"last update":"Thu Apr 18 14:44:21 2024","interfaces":[{"interface":"back","average":{"1min":1.2709999999999999,"5min":1.2709999999999999,"15min":1.2709999999999999},"min":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"max":{"1min":1.911,"5min":1.911,"15min":1.911},"last":1.018},{"interface":"front","average":{"1min":1.3140000000000001,"5min":1.3140000000000001,"15min":1.3140000000000001},"min":{"1min":0.755,"5min":0.755,"15min":0.755},"max":{"1min":2.504,"5min":2.504,"15min":2.504},"last":1.2909999999999999}]},{"osd":14,"last update":"Thu Apr 18 14:44:21 2024","interfaces":[{"interface":"back","average":{"1min":1.2909999999999999,"5min":1.2909999999999999,"15min":1.2909999999999999},"min":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"max":{"1min":3.6240000000000001,"5min":3.6240000000000001,"15min":3.6240000000000001},"last":1.24},{"interface":"front","average":{"1min":1.357,"5min":1.357,"15min":1.357},"min":{"1min":0.627,"5min":0.627,"15min":0.627},"max":{"1min":2.1960000000000002,"5min":2.1960000000000002,"15min":2.1960000000000002},"last":1.2030000000000001}]},{"osd":15,"last update":"Thu Apr 18 14:44:21 2024","interfaces":[{"interface":"back","average":{"1min":1.3560000000000001,"5min":1.3560000000000001,"15min":1.3560000000000001},"min":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"max":{"1min":2.1080000000000001,"5min":2.1080000000000001,"15min":2.1080000000000001},"last":1.3600000000000001},{"interface":"front","average":{"1min":1.26,"5min":1.26,"15min":1.26},"min":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"max":{"1min":1.8380000000000001,"5min":1.8380000000000001,"15min":1.8380000000000001},"last":1.323}]}]},{"osd":9,"up_from":24,"seq":103079215131,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32956,"kb_used_data":1836,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94338884,"statfs":{"total":96636764160,"available":96603017216,"internally_reserved":0,"allocated":1880064,"data_stored":1088155,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1599,"internal_metadata":31848897},"hb_peers":[0,1,3,8,10,11,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Apr 18 14:44:20 2024","interfaces":[{"interface":"back","average":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":1.0429999999999999,"5min":1.0429999999999999,"15min":1.0429999999999999},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.95199999999999996,"5min":0.95199999999999996,"15min":0.95199999999999996},"min":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"max":{"1min":1.6559999999999999,"5min":1.6559999999999999,"15min":1.6559999999999999},"last":0.68500000000000005}]},{"osd":1,"last update":"Thu Apr 18 14:44:20 2024","interfaces":[{"interface":"back","average":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"min":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":1.3200000000000001,"5min":1.3200000000000001,"15min":1.3200000000000001},"last":0.80400000000000005},{"interface":"front","average":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.2509999999999999,"5min":1.2509999999999999,"15min":1.2509999999999999},"last":0.91600000000000004}]},{"osd":3,"last update":"Thu Apr 18 14:44:20 2024","interfaces":[{"interface":"back","average":{"1min":1.032,"5min":1.032,"15min":1.032},"min":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"max":{"1min":1.5980000000000001,"5min":1.5980000000000001,"15min":1.5980000000000001},"last":0.98799999999999999},{"interface":"front","average":{"1min":1.1539999999999999,"5min":1.1539999999999999,"15min":1.1539999999999999},"min":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"max":{"1min":1.722,"5min":1.722,"15min":1.722},"last":0.95899999999999996}]},{"osd":8,"last update":"Thu Apr 18 14:44:20 2024","interfaces":[{"interface":"back","average":{"1min":0.94899999999999995,"5min":0.94899999999999995,"15min":0.94899999999999995},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":1.6899999999999999,"5min":1.6899999999999999,"15min":1.6899999999999999},"last":0.75800000000000001},{"interface":"front","average":{"1min":1.3380000000000001,"5min":1.3380000000000001,"15min":1.3380000000000001},"min":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"max":{"1min":5.4989999999999997,"5min":5.4989999999999997,"15min":5.4989999999999997},"last":0.84499999999999997}]},{"osd":10,"last update":"Thu Apr 18 14:44:20 2024","interfaces":[{"interface":"back","average":{"1min":1.196,"5min":1.196,"15min":1.196},"min":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"max":{"1min":1.5429999999999999,"5min":1.5429999999999999,"15min":1.5429999999999999},"last":1.2849999999999999},{"interface":"front","average":{"1min":1.117,"5min":1.117,"15min":1.117},"min":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"max":{"1min":1.7689999999999999,"5min":1.7689999999999999,"15min":1.7689999999999999},"last":1.091}]},{"osd":11,"last update":"Thu Apr 18 14:44:20 2024","interfaces":[{"interface":"back","average":{"1min":1.1279999999999999,"5min":1.1279999999999999,"15min":1.1279999999999999},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.849,"5min":1.849,"15min":1.849},"last":1.0189999999999999},{"interface":"front","average":{"1min":1.2310000000000001,"5min":1.2310000000000001,"15min":1.2310000000000001},"min":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"max":{"1min":1.8109999999999999,"5min":1.8109999999999999,"15min":1.8109999999999999},"last":1.119}]},{"osd":12,"last update":"Thu Apr 18 14:44:20 2024","interfaces":[{"interface":"back","average":{"1min":1.2989999999999999,"5min":1.2989999999999999,"15min":1.2989999999999999},"min":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"max":{"1min":2.1560000000000001,"5min":2.1560000000000001,"15min":2.1560000000000001},"last":0.88100000000000001},{"interface":"front","average":{"1min":1.29,"5min":1.29,"15min":1.29},"min":{"1min":0.748,"5min":0.748,"15min":0.748},"max":{"1min":2.6930000000000001,"5min":2.6930000000000001,"15min":2.6930000000000001},"last":1.1539999999999999}]},{"osd":13,"last update":"Thu Apr 18 14:44:20 2024","interfaces":[{"interface":"back","average":{"1min":1.4079999999999999,"5min":1.4079999999999999,"15min":1.4079999999999999},"min":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"max":{"1min":2.6030000000000002,"5min":2.6030000000000002,"15min":2.6030000000000002},"last":1.0580000000000001},{"interface":"front","average":{"1min":1.4710000000000001,"5min":1.4710000000000001,"15min":1.4710000000000001},"min":{"1min":0.92100000000000004,"5min":0.92100000000000004,"15min":0.92100000000000004},"max":{"1min":2.472,"5min":2.472,"15min":2.472},"last":1.179}]},{"osd":14,"last update":"Thu Apr 18 14:44:20 2024","interfaces":[{"interface":"back","average":{"1min":1.456,"5min":1.456,"15min":1.456},"min":{"1min":0.88400000000000001,"5min":0.88400000000000001,"15min":0.88400000000000001},"max":{"1min":2.3180000000000001,"5min":2.3180000000000001,"15min":2.3180000000000001},"last":1.26},{"interface":"front","average":{"1min":1.5389999999999999,"5min":1.5389999999999999,"15min":1.5389999999999999},"min":{"1min":1.016,"5min":1.016,"15min":1.016},"max":{"1min":2.6549999999999998,"5min":2.6549999999999998,"15min":2.6549999999999998},"last":1.204}]},{"osd":15,"last update":"Thu Apr 18 14:44:20 2024","interfaces":[{"interface":"back","average":{"1min":1.4119999999999999,"5min":1.4119999999999999,"15min":1.4119999999999999},"min":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"max":{"1min":2.7789999999999999,"5min":2.7789999999999999,"15min":2.7789999999999999},"last":1.2310000000000001},{"interface":"front","average":{"1min":1.4359999999999999,"5min":1.4359999999999999,"15min":1.4359999999999999},"min":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"max":{"1min":1.923,"5min":1.923,"15min":1.923},"last":1.3080000000000001}]}]},{"osd":5,"up_from":24,"seq":103079215132,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32956,"kb_used_data":1836,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94338884,"statfs":{"total":96636764160,"available":96603017216,"internally_reserved":0,"allocated":1880064,"data_stored":1088155,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,3,4,6,10,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Apr 18 14:44:31 2024","interfaces":[{"interface":"back","average":{"1min":0.90900000000000003,"5min":0.90900000000000003,"15min":0.90900000000000003},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.339,"5min":1.339,"15min":1.339},"last":1.083},{"interface":"front","average":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":1.175,"5min":1.175,"15min":1.175},"last":0.78900000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67600000000000005}]},{"osd":3,"last update":"Thu Apr 18 14:44:24 2024","interfaces":[{"interface":"back","average":{"1min":1.024,"5min":1.024,"15min":1.024},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":1.4650000000000001,"5min":1.4650000000000001,"15min":1.4650000000000001},"last":1.26},{"interface":"front","average":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":0.94999999999999996},"min":{"1min":0.621,"5min":0.621,"15min":0.621},"max":{"1min":1.8460000000000001,"5min":1.8460000000000001,"15min":1.8460000000000001},"last":0.81200000000000006}]},{"osd":4,"last update":"Thu Apr 18 14:44:24 2024","interfaces":[{"interface":"back","average":{"1min":0.89400000000000002,"5min":0.89400000000000002,"15min":0.89400000000000002},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":1.968,"5min":1.968,"15min":1.968},"last":0.88700000000000001},{"interface":"front","average":{"1min":1.016,"5min":1.016,"15min":1.016},"min":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"max":{"1min":1.819,"5min":1.819,"15min":1.819},"last":1.1679999999999999}]},{"osd":6,"last update":"Thu Apr 18 14:44:24 2024","interfaces":[{"interface":"back","average":{"1min":1.0629999999999999,"5min":1.0629999999999999,"15min":1.0629999999999999},"min":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"max":{"1min":2.0760000000000001,"5min":2.0760000000000001,"15min":2.0760000000000001},"last":0.94799999999999995},{"interface":"front","average":{"1min":1.101,"5min":1.101,"15min":1.101},"min":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"max":{"1min":1.694,"5min":1.694,"15min":1.694},"last":0.97999999999999998}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2330000000000001}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96599999999999997}]},{"osd":10,"last update":"Thu Apr 18 14:44:24 2024","interfaces":[{"interface":"back","average":{"1min":1.232,"5min":1.232,"15min":1.232},"min":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"max":{"1min":2.2709999999999999,"5min":2.2709999999999999,"15min":2.2709999999999999},"last":1.3360000000000001},{"interface":"front","average":{"1min":1.2569999999999999,"5min":1.2569999999999999,"15min":1.2569999999999999},"min":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"max":{"1min":2.4470000000000001,"5min":2.4470000000000001,"15min":2.4470000000000001},"last":1.03}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.256}]},{"osd":12,"last update":"Thu Apr 18 14:44:24 2024","interfaces":[{"interface":"back","average":{"1min":1.1140000000000001,"5min":1.1140000000000001,"15min":1.1140000000000001},"min":{"1min":0.625,"5min":0.625,"15min":0.625},"max":{"1min":1.728,"5min":1.728,"15min":1.728},"last":0.83899999999999997},{"interface":"front","average":{"1min":1.339,"5min":1.339,"15min":1.339},"min":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"max":{"1min":2.008,"5min":2.008,"15min":2.008},"last":1.4059999999999999}]},{"osd":13,"last update":"Thu Apr 18 14:44:24 2024","interfaces":[{"interface":"back","average":{"1min":1.355,"5min":1.355,"15min":1.355},"min":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":2.5070000000000001,"5min":2.5070000000000001,"15min":2.5070000000000001},"last":1.478},{"interface":"front","average":{"1min":1.2949999999999999,"5min":1.2949999999999999,"15min":1.2949999999999999},"min":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":2.992,"5min":2.992,"15min":2.992},"last":1.1299999999999999}]},{"osd":14,"last update":"Thu Apr 18 14:44:31 2024","interfaces":[{"interface":"back","average":{"1min":1.401,"5min":1.401,"15min":1.401},"min":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.85099999999999998},"max":{"1min":2.1190000000000002,"5min":2.1190000000000002,"15min":2.1190000000000002},"last":1.5469999999999999},{"interface":"front","average":{"1min":1.2629999999999999,"5min":1.2629999999999999,"15min":1.2629999999999999},"min":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"max":{"1min":2.496,"5min":2.496,"15min":2.496},"last":1.1919999999999999}]},{"osd":15,"last update":"Thu Apr 18 14:44:24 2024","interfaces":[{"interface":"back","average":{"1min":1.486,"5min":1.486,"15min":1.486},"min":{"1min":0.879,"5min":0.879,"15min":0.879},"max":{"1min":2.415,"5min":2.415,"15min":2.415},"last":1.615},{"interface":"front","average":{"1min":1.4470000000000001,"5min":1.4470000000000001,"15min":1.4470000000000001},"min":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"max":{"1min":2.7799999999999998,"5min":2.7799999999999998,"15min":2.7799999999999998},"last":1.236}]}]},{"osd":14,"up_from":21,"seq":90194313243,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51008,"kb_used_data":1836,"kb_used_omap":1,"kb_used_meta":49150,"kb_avail":94320832,"statfs":{"total":96636764160,"available":96584531968,"internally_reserved":0,"allocated":1880064,"data_stored":1088155,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":50330054},"hb_peers":[0,4,5,6,7,8,9,11,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Apr 18 14:44:21 2024","interfaces":[{"interface":"back","average":{"1min":0.96899999999999997,"5min":0.96899999999999997,"15min":0.96899999999999997},"min":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"max":{"1min":1.454,"5min":1.454,"15min":1.454},"last":0.83999999999999997},{"interface":"front","average":{"1min":1.0660000000000001,"5min":1.0660000000000001,"15min":1.0660000000000001},"min":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"max":{"1min":1.9390000000000001,"5min":1.9390000000000001,"15min":1.9390000000000001},"last":1.0940000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.472}]},{"osd":2,"last update":"Thu Apr 18 14:44:31 2024","interfaces":[{"interface":"back","average":{"1min":0.89500000000000002,"5min":0.89500000000000002,"15min":0.89500000000000002},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":1.468,"5min":1.468,"15min":1.468},"last":0.64400000000000002},{"interface":"front","average":{"1min":1.131,"5min":1.131,"15min":1.131},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.8540000000000001,"5min":1.8540000000000001,"15min":1.8540000000000001},"last":1.032}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94499999999999995}]},{"osd":4,"last update":"Thu Apr 18 14:44:20 2024","interfaces":[{"interface":"back","average":{"1min":0.95099999999999996,"5min":0.95099999999999996,"15min":0.95099999999999996},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.296,"5min":1.296,"15min":1.296},"last":0.69499999999999995},{"interface":"front","average":{"1min":0.97599999999999998,"5min":0.97599999999999998,"15min":0.97599999999999998},"min":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"max":{"1min":1.5129999999999999,"5min":1.5129999999999999,"15min":1.5129999999999999},"last":0.74099999999999999}]},{"osd":5,"last update":"Thu Apr 18 14:44:20 2024","interfaces":[{"interface":"back","average":{"1min":1.218,"5min":1.218,"15min":1.218},"min":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"max":{"1min":2.1269999999999998,"5min":2.1269999999999998,"15min":2.1269999999999998},"last":1.1910000000000001},{"interface":"front","average":{"1min":1.1679999999999999,"5min":1.1679999999999999,"15min":1.1679999999999999},"min":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"max":{"1min":1.5920000000000001,"5min":1.5920000000000001,"15min":1.5920000000000001},"last":0.95299999999999996}]},{"osd":6,"last update":"Thu Apr 18 14:44:20 2024","interfaces":[{"interface":"back","average":{"1min":0.94699999999999995,"5min":0.94699999999999995,"15min":0.94699999999999995},"min":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"max":{"1min":1.3160000000000001,"5min":1.3160000000000001,"15min":1.3160000000000001},"last":1.0509999999999999},{"interface":"front","average":{"1min":1.163,"5min":1.163,"15min":1.163},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":1.7689999999999999,"5min":1.7689999999999999,"15min":1.7689999999999999},"last":0.875}]},{"osd":7,"last update":"Thu Apr 18 14:44:20 2024","interfaces":[{"interface":"back","average":{"1min":1.234,"5min":1.234,"15min":1.234},"min":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"max":{"1min":1.7529999999999999,"5min":1.7529999999999999,"15min":1.7529999999999999},"last":1.018},{"interface":"front","average":{"1min":1.1759999999999999,"5min":1.1759999999999999,"15min":1.1759999999999999},"min":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"max":{"1min":1.587,"5min":1.587,"15min":1.587},"last":0.90900000000000003}]},{"osd":8,"last update":"Thu Apr 18 14:44:20 2024","interfaces":[{"interface":"back","average":{"1min":1.292,"5min":1.292,"15min":1.292},"min":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"max":{"1min":2.0569999999999999,"5min":2.0569999999999999,"15min":2.0569999999999999},"last":1.3720000000000001},{"interface":"front","average":{"1min":1.2509999999999999,"5min":1.2509999999999999,"15min":1.2509999999999999},"min":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"max":{"1min":1.8740000000000001,"5min":1.8740000000000001,"15min":1.8740000000000001},"last":1.0740000000000001}]},{"osd":9,"last update":"Thu Apr 18 14:44:31 2024","interfaces":[{"interface":"back","average":{"1min":1.4590000000000001,"5min":1.4590000000000001,"15min":1.4590000000000001},"min":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"max":{"1min":2.1899999999999999,"5min":2.1899999999999999,"15min":2.1899999999999999},"last":1.4550000000000001},{"interface":"front","average":{"1min":1.3999999999999999,"5min":1.3999999999999999,"15min":1.3999999999999999},"min":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"max":{"1min":1.9930000000000001,"5min":1.9930000000000001,"15min":1.9930000000000001},"last":1.163}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4219999999999999}]},{"osd":11,"last update":"Thu Apr 18 14:44:31 2024","interfaces":[{"interface":"back","average":{"1min":1.4319999999999999,"5min":1.4319999999999999,"15min":1.4319999999999999},"min":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"max":{"1min":2.0059999999999998,"5min":2.0059999999999998,"15min":2.0059999999999998},"last":1.1279999999999999},{"interface":"front","average":{"1min":1.3640000000000001,"5min":1.3640000000000001,"15min":1.3640000000000001},"min":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"max":{"1min":1.903,"5min":1.903,"15min":1.903},"last":1.5349999999999999}]},{"osd":12,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.016}]},{"osd":13,"last update":"Thu Apr 18 14:44:20 2024","interfaces":[{"interface":"back","average":{"1min":1.464,"5min":1.464,"15min":1.464},"min":{"1min":0.86799999999999999,"5min":0.86799999999999999,"15min":0.86799999999999999},"max":{"1min":1.8620000000000001,"5min":1.8620000000000001,"15min":1.8620000000000001},"last":1.2410000000000001},{"interface":"front","average":{"1min":1.5349999999999999,"5min":1.5349999999999999,"15min":1.5349999999999999},"min":{"1min":0.94299999999999995,"5min":0.94299999999999995,"15min":0.94299999999999995},"max":{"1min":2.452,"5min":2.452,"15min":2.452},"last":1.5780000000000001}]},{"osd":15,"last update":"Thu Apr 18 14:44:20 2024","interfaces":[{"interface":"back","average":{"1min":1.5129999999999999,"5min":1.5129999999999999,"15min":1.5129999999999999},"min":{"1min":0.95699999999999996,"5min":0.95699999999999996,"15min":0.95699999999999996},"max":{"1min":2.2549999999999999,"5min":2.2549999999999999,"15min":2.2549999999999999},"last":1.2170000000000001},{"interface":"front","average":{"1min":1.476,"5min":1.476,"15min":1.476},"min":{"1min":0.89800000000000002,"5min":0.89800000000000002,"15min":0.89800000000000002},"max":{"1min":1.9550000000000001,"5min":1.9550000000000001,"15min":1.9550000000000001},"last":1.4910000000000001}]}]},{"osd":1,"up_from":24,"seq":103079215132,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32952,"kb_used_data":1832,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94338888,"statfs":{"total":96636764160,"available":96603021312,"internally_reserved":0,"allocated":1875968,"data_stored":1087311,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,2,3,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Apr 18 14:44:25 2024","interfaces":[{"interface":"back","average":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":1.165,"5min":1.165,"15min":1.165},"last":1.1519999999999999},{"interface":"front","average":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"min":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":1.292,"5min":1.292,"15min":1.292},"last":0.92700000000000005}]},{"osd":2,"last update":"Thu Apr 18 14:44:25 2024","interfaces":[{"interface":"back","average":{"1min":0.93899999999999995,"5min":0.93899999999999995,"15min":0.93899999999999995},"min":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"max":{"1min":1.3180000000000001,"5min":1.3180000000000001,"15min":1.3180000000000001},"last":1.0960000000000001},{"interface":"front","average":{"1min":0.95199999999999996,"5min":0.95199999999999996,"15min":0.95199999999999996},"min":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":1.345,"5min":1.345,"15min":1.345},"last":0.98099999999999998}]},{"osd":3,"last update":"Thu Apr 18 14:44:25 2024","interfaces":[{"interface":"back","average":{"1min":1.0760000000000001,"5min":1.0760000000000001,"15min":1.0760000000000001},"min":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":1.486,"5min":1.486,"15min":1.486},"last":1.526},{"interface":"front","average":{"1min":1.1679999999999999,"5min":1.1679999999999999,"15min":1.1679999999999999},"min":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"max":{"1min":1.7789999999999999,"5min":1.7789999999999999,"15min":1.7789999999999999},"last":1.1719999999999999}]},{"osd":4,"last update":"Thu Apr 18 14:44:25 2024","interfaces":[{"interface":"back","average":{"1min":0.98299999999999998,"5min":0.98299999999999998,"15min":0.98299999999999998},"min":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"max":{"1min":1.728,"5min":1.728,"15min":1.728},"last":1.1950000000000001},{"interface":"front","average":{"1min":0.93700000000000006,"5min":0.93700000000000006,"15min":0.93700000000000006},"min":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"max":{"1min":1.6950000000000001,"5min":1.6950000000000001,"15min":1.6950000000000001},"last":1.248}]},{"osd":5,"last update":"Thu Apr 18 14:44:25 2024","interfaces":[{"interface":"back","average":{"1min":1.0089999999999999,"5min":1.0089999999999999,"15min":1.0089999999999999},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":1.819,"5min":1.819,"15min":1.819},"last":0.80900000000000005},{"interface":"front","average":{"1min":1.083,"5min":1.083,"15min":1.083},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":1.841,"5min":1.841,"15min":1.841},"last":1.034}]},{"osd":6,"last update":"Thu Apr 18 14:44:25 2024","interfaces":[{"interface":"back","average":{"1min":1.2529999999999999,"5min":1.2529999999999999,"15min":1.2529999999999999},"min":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"max":{"1min":2.3639999999999999,"5min":2.3639999999999999,"15min":2.3639999999999999},"last":1.0720000000000001},{"interface":"front","average":{"1min":1.1839999999999999,"5min":1.1839999999999999,"15min":1.1839999999999999},"min":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"max":{"1min":1.9419999999999999,"5min":1.9419999999999999,"15min":1.9419999999999999},"last":1.1220000000000001}]},{"osd":7,"last update":"Thu Apr 18 14:44:25 2024","interfaces":[{"interface":"back","average":{"1min":1.2050000000000001,"5min":1.2050000000000001,"15min":1.2050000000000001},"min":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"max":{"1min":1.96,"5min":1.96,"15min":1.96},"last":0.86499999999999999},{"interface":"front","average":{"1min":1.2509999999999999,"5min":1.2509999999999999,"15min":1.2509999999999999},"min":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"max":{"1min":2.4399999999999999,"5min":2.4399999999999999,"15min":2.4399999999999999},"last":1.218}]},{"osd":8,"last update":"Thu Apr 18 14:44:25 2024","interfaces":[{"interface":"back","average":{"1min":1.2330000000000001,"5min":1.2330000000000001,"15min":1.2330000000000001},"min":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"max":{"1min":1.881,"5min":1.881,"15min":1.881},"last":1.3080000000000001},{"interface":"front","average":{"1min":1.26,"5min":1.26,"15min":1.26},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":2.5169999999999999,"5min":2.5169999999999999,"15min":2.5169999999999999},"last":1.3680000000000001}]},{"osd":9,"last update":"Thu Apr 18 14:44:25 2024","interfaces":[{"interface":"back","average":{"1min":1.3280000000000001,"5min":1.3280000000000001,"15min":1.3280000000000001},"min":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":2.4780000000000002,"5min":2.4780000000000002,"15min":2.4780000000000002},"last":1.706},{"interface":"front","average":{"1min":1.3129999999999999,"5min":1.3129999999999999,"15min":1.3129999999999999},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":2.161,"5min":2.161,"15min":2.161},"last":1.3919999999999999}]},{"osd":10,"last update":"Thu Apr 18 14:44:25 2024","interfaces":[{"interface":"back","average":{"1min":1.407,"5min":1.407,"15min":1.407},"min":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"max":{"1min":2.625,"5min":2.625,"15min":2.625},"last":1.4370000000000001},{"interface":"front","average":{"1min":1.446,"5min":1.446,"15min":1.446},"min":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"max":{"1min":2.5529999999999999,"5min":2.5529999999999999,"15min":2.5529999999999999},"last":1.7829999999999999}]}]},{"osd":2,"up_from":22,"seq":94489280539,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28840,"kb_used_data":1820,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343000,"statfs":{"total":96636764160,"available":96607232000,"internally_reserved":0,"allocated":1863680,"data_stored":1078641,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,3,5,6,7,8,10,11,12,14],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Apr 18 14:44:22 2024","interfaces":[{"interface":"back","average":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"min":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"max":{"1min":1.175,"5min":1.175,"15min":1.175},"last":1.2210000000000001},{"interface":"front","average":{"1min":0.90900000000000003,"5min":0.90900000000000003,"15min":0.90900000000000003},"min":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"max":{"1min":1.3740000000000001,"5min":1.3740000000000001,"15min":1.3740000000000001},"last":1.47}]},{"osd":3,"last update":"Thu Apr 18 14:44:22 2024","interfaces":[{"interface":"back","average":{"1min":1.0409999999999999,"5min":1.0409999999999999,"15min":1.0409999999999999},"min":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"max":{"1min":1.6830000000000001,"5min":1.6830000000000001,"15min":1.6830000000000001},"last":1.0740000000000001},{"interface":"front","average":{"1min":1.0700000000000001,"5min":1.0700000000000001,"15min":1.0700000000000001},"min":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"max":{"1min":1.8839999999999999,"5min":1.8839999999999999,"15min":1.8839999999999999},"last":1.3080000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96699999999999997}]},{"osd":5,"last update":"Thu Apr 18 14:44:22 2024","interfaces":[{"interface":"back","average":{"1min":0.98799999999999999,"5min":0.98799999999999999,"15min":0.98799999999999999},"min":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"max":{"1min":1.5469999999999999,"5min":1.5469999999999999,"15min":1.5469999999999999},"last":0.63100000000000001},{"interface":"front","average":{"1min":0.92500000000000004,"5min":0.92500000000000004,"15min":0.92500000000000004},"min":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":1.333,"5min":1.333,"15min":1.333},"last":1.359}]},{"osd":6,"last update":"Thu Apr 18 14:44:19 2024","interfaces":[{"interface":"back","average":{"1min":1.115,"5min":1.115,"15min":1.115},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":2.0529999999999999,"5min":2.0529999999999999,"15min":2.0529999999999999},"last":1.26},{"interface":"front","average":{"1min":1.089,"5min":1.089,"15min":1.089},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.8069999999999999,"5min":1.8069999999999999,"15min":1.8069999999999999},"last":1.155}]},{"osd":7,"last update":"Thu Apr 18 14:44:22 2024","interfaces":[{"interface":"back","average":{"1min":1.165,"5min":1.165,"15min":1.165},"min":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"max":{"1min":2.012,"5min":2.012,"15min":2.012},"last":0.97299999999999998},{"interface":"front","average":{"1min":1.2949999999999999,"5min":1.2949999999999999,"15min":1.2949999999999999},"min":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"max":{"1min":2.1419999999999999,"5min":2.1419999999999999,"15min":2.1419999999999999},"last":1.0229999999999999}]},{"osd":8,"last update":"Thu Apr 18 14:44:22 2024","interfaces":[{"interface":"back","average":{"1min":1.224,"5min":1.224,"15min":1.224},"min":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"max":{"1min":1.988,"5min":1.988,"15min":1.988},"last":1.55},{"interface":"front","average":{"1min":1.3120000000000001,"5min":1.3120000000000001,"15min":1.3120000000000001},"min":{"1min":0.84999999999999998,"5min":0.84999999999999998,"15min":0.84999999999999998},"max":{"1min":2.2240000000000002,"5min":2.2240000000000002,"15min":2.2240000000000002},"last":1.657}]},{"osd":10,"last update":"Thu Apr 18 14:44:19 2024","interfaces":[{"interface":"back","average":{"1min":1.365,"5min":1.365,"15min":1.365},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":2.319,"5min":2.319,"15min":2.319},"last":2.8170000000000002},{"interface":"front","average":{"1min":1.3879999999999999,"5min":1.3879999999999999,"15min":1.3879999999999999},"min":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"max":{"1min":2.27,"5min":2.27,"15min":2.27},"last":3.0110000000000001}]},{"osd":11,"last update":"Thu Apr 18 14:44:19 2024","interfaces":[{"interface":"back","average":{"1min":1.49,"5min":1.49,"15min":1.49},"min":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"max":{"1min":2.4950000000000001,"5min":2.4950000000000001,"15min":2.4950000000000001},"last":1.78},{"interface":"front","average":{"1min":1.4590000000000001,"5min":1.4590000000000001,"15min":1.4590000000000001},"min":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"max":{"1min":2.411,"5min":2.411,"15min":2.411},"last":1.736}]},{"osd":12,"last update":"Thu Apr 18 14:44:19 2024","interfaces":[{"interface":"back","average":{"1min":1.4910000000000001,"5min":1.4910000000000001,"15min":1.4910000000000001},"min":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":0.88500000000000001},"max":{"1min":2.2669999999999999,"5min":2.2669999999999999,"15min":2.2669999999999999},"last":1.8220000000000001},{"interface":"front","average":{"1min":1.514,"5min":1.514,"15min":1.514},"min":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"max":{"1min":2.3719999999999999,"5min":2.3719999999999999,"15min":2.3719999999999999},"last":1.861}]},{"osd":14,"last update":"Thu Apr 18 14:44:19 2024","interfaces":[{"interface":"back","average":{"1min":1.4390000000000001,"5min":1.4390000000000001,"15min":1.4390000000000001},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":2.3050000000000002,"5min":2.3050000000000002,"15min":2.3050000000000002},"last":1.9770000000000001},{"interface":"front","average":{"1min":1.5069999999999999,"5min":1.5069999999999999,"15min":1.5069999999999999},"min":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":2.4020000000000001,"5min":2.4020000000000001,"15min":2.4020000000000001},"last":1.9350000000000001}]}]},{"osd":15,"up_from":23,"seq":98784247836,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32952,"kb_used_data":1832,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94338888,"statfs":{"total":96636764160,"available":96603021312,"internally_reserved":0,"allocated":1875968,"data_stored":1087311,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31848903},"hb_peers":[0,4,5,6,7,8,10,11,13,14],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Apr 18 14:44:19 2024","interfaces":[{"interface":"back","average":{"1min":0.94699999999999995,"5min":0.94699999999999995,"15min":0.94699999999999995},"min":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"max":{"1min":1.405,"5min":1.405,"15min":1.405},"last":0.997},{"interface":"front","average":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"min":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":1.0569999999999999,"5min":1.0569999999999999,"15min":1.0569999999999999},"last":0.63200000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2050000000000001}]},{"osd":4,"last update":"Thu Apr 18 14:44:19 2024","interfaces":[{"interface":"back","average":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.85099999999999998},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.2669999999999999,"5min":1.2669999999999999,"15min":1.2669999999999999},"last":0.73499999999999999},{"interface":"front","average":{"1min":0.877,"5min":0.877,"15min":0.877},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.2410000000000001,"5min":1.2410000000000001,"15min":1.2410000000000001},"last":0.87}]},{"osd":5,"last update":"Thu Apr 18 14:44:22 2024","interfaces":[{"interface":"back","average":{"1min":1.0209999999999999,"5min":1.0209999999999999,"15min":1.0209999999999999},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":2.0579999999999998,"5min":2.0579999999999998,"15min":2.0579999999999998},"last":0.93400000000000005},{"interface":"front","average":{"1min":1.089,"5min":1.089,"15min":1.089},"min":{"1min":0.75,"5min":0.75,"15min":0.75},"max":{"1min":1.9259999999999999,"5min":1.9259999999999999,"15min":1.9259999999999999},"last":1.1339999999999999}]},{"osd":6,"last update":"Thu Apr 18 14:44:19 2024","interfaces":[{"interface":"back","average":{"1min":1.1379999999999999,"5min":1.1379999999999999,"15min":1.1379999999999999},"min":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"max":{"1min":1.8680000000000001,"5min":1.8680000000000001,"15min":1.8680000000000001},"last":1.034},{"interface":"front","average":{"1min":1.228,"5min":1.228,"15min":1.228},"min":{"1min":0.86499999999999999,"5min":0.86499999999999999,"15min":0.86499999999999999},"max":{"1min":1.79,"5min":1.79,"15min":1.79},"last":1.429}]},{"osd":7,"last update":"Thu Apr 18 14:44:19 2024","interfaces":[{"interface":"back","average":{"1min":1.0549999999999999,"5min":1.0549999999999999,"15min":1.0549999999999999},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":1.488,"5min":1.488,"15min":1.488},"last":1.504},{"interface":"front","average":{"1min":1.1830000000000001,"5min":1.1830000000000001,"15min":1.1830000000000001},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":1.976,"5min":1.976,"15min":1.976},"last":1.1859999999999999}]},{"osd":8,"last update":"Thu Apr 18 14:44:19 2024","interfaces":[{"interface":"back","average":{"1min":1.1879999999999999,"5min":1.1879999999999999,"15min":1.1879999999999999},"min":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"max":{"1min":2.004,"5min":2.004,"15min":2.004},"last":1.2370000000000001},{"interface":"front","average":{"1min":1.222,"5min":1.222,"15min":1.222},"min":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"max":{"1min":1.786,"5min":1.786,"15min":1.786},"last":1.381}]},{"osd":10,"last update":"Thu Apr 18 14:44:19 2024","interfaces":[{"interface":"back","average":{"1min":1.3360000000000001,"5min":1.3360000000000001,"15min":1.3360000000000001},"min":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"max":{"1min":2.403,"5min":2.403,"15min":2.403},"last":1.4710000000000001},{"interface":"front","average":{"1min":1.331,"5min":1.331,"15min":1.331},"min":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"max":{"1min":2.2549999999999999,"5min":2.2549999999999999,"15min":2.2549999999999999},"last":1.6459999999999999}]},{"osd":11,"last update":"Thu Apr 18 14:44:19 2024","interfaces":[{"interface":"back","average":{"1min":1.399,"5min":1.399,"15min":1.399},"min":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"max":{"1min":2.2109999999999999,"5min":2.2109999999999999,"15min":2.2109999999999999},"last":1.6990000000000001},{"interface":"front","average":{"1min":1.4490000000000001,"5min":1.4490000000000001,"15min":1.4490000000000001},"min":{"1min":0.629,"5min":0.629,"15min":0.629},"max":{"1min":2.1589999999999998,"5min":2.1589999999999998,"15min":2.1589999999999998},"last":1.3109999999999999}]},{"osd":13,"last update":"Thu Apr 18 14:44:22 2024","interfaces":[{"interface":"back","average":{"1min":1.391,"5min":1.391,"15min":1.391},"min":{"1min":1.0109999999999999,"5min":1.0109999999999999,"15min":1.0109999999999999},"max":{"1min":1.9419999999999999,"5min":1.9419999999999999,"15min":1.9419999999999999},"last":1.748},{"interface":"front","average":{"1min":1.387,"5min":1.387,"15min":1.387},"min":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"max":{"1min":1.8959999999999999,"5min":1.8959999999999999,"15min":1.8959999999999999},"last":1.8720000000000001}]},{"osd":14,"last update":"Thu Apr 18 14:44:19 2024","interfaces":[{"interface":"back","average":{"1min":1.4279999999999999,"5min":1.4279999999999999,"15min":1.4279999999999999},"min":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"max":{"1min":2.351,"5min":2.351,"15min":2.351},"last":1.611},{"interface":"front","average":{"1min":1.454,"5min":1.454,"15min":1.454},"min":{"1min":0.84299999999999997,"5min":0.84299999999999997,"15min":0.84299999999999997},"max":{"1min":2.766,"5min":2.766,"15min":2.766},"last":1.782}]}]},{"osd":4,"up_from":22,"seq":94489280538,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":51000,"kb_used_data":1832,"kb_used_omap":1,"kb_used_meta":49150,"kb_avail":94320840,"statfs":{"total":96636764160,"available":96584540160,"internally_reserved":0,"allocated":1875968,"data_stored":1087311,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":50330054},"hb_peers":[2,3,5,6,10,11,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":2,"last update":"Thu Apr 18 14:44:20 2024","interfaces":[{"interface":"back","average":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":1.2330000000000001,"5min":1.2330000000000001,"15min":1.2330000000000001},"last":1.171},{"interface":"front","average":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":1.306,"5min":1.306,"15min":1.306},"last":1.21}]},{"osd":3,"last update":"Thu Apr 18 14:44:20 2024","interfaces":[{"interface":"back","average":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":1.1499999999999999,"5min":1.1499999999999999,"15min":1.1499999999999999},"last":0.92900000000000005},{"interface":"front","average":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":1.0169999999999999,"5min":1.0169999999999999,"15min":1.0169999999999999},"last":1.054}]},{"osd":5,"last update":"Thu Apr 18 14:44:20 2024","interfaces":[{"interface":"back","average":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":1.0609999999999999,"5min":1.0609999999999999,"15min":1.0609999999999999},"last":0.99399999999999999},{"interface":"front","average":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":1.2190000000000001,"5min":1.2190000000000001,"15min":1.2190000000000001},"last":1.135}]},{"osd":6,"last update":"Thu Apr 18 14:44:20 2024","interfaces":[{"interface":"back","average":{"1min":0.84999999999999998,"5min":0.84999999999999998,"15min":0.84999999999999998},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":1.1930000000000001,"5min":1.1930000000000001,"15min":1.1930000000000001},"last":1.446},{"interface":"front","average":{"1min":0.88,"5min":0.88,"15min":0.88},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.337,"5min":1.337,"15min":1.337},"last":1.304}]},{"osd":10,"last update":"Thu Apr 18 14:44:20 2024","interfaces":[{"interface":"back","average":{"1min":0.876,"5min":0.876,"15min":0.876},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":1.49,"5min":1.49,"15min":1.49},"last":1.8009999999999999},{"interface":"front","average":{"1min":0.90900000000000003,"5min":0.90900000000000003,"15min":0.90900000000000003},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.5700000000000001,"5min":1.5700000000000001,"15min":1.5700000000000001},"last":1.3660000000000001}]},{"osd":11,"last update":"Thu Apr 18 14:44:20 2024","interfaces":[{"interface":"back","average":{"1min":0.86499999999999999,"5min":0.86499999999999999,"15min":0.86499999999999999},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":1.2130000000000001,"5min":1.2130000000000001,"15min":1.2130000000000001},"last":1.3400000000000001},{"interface":"front","average":{"1min":0.90100000000000002,"5min":0.90100000000000002,"15min":0.90100000000000002},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.365,"5min":1.365,"15min":1.365},"last":1.6719999999999999}]},{"osd":12,"last update":"Thu Apr 18 14:44:20 2024","interfaces":[{"interface":"back","average":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":1.1879999999999999,"5min":1.1879999999999999,"15min":1.1879999999999999},"last":1.276},{"interface":"front","average":{"1min":0.86099999999999999,"5min":0.86099999999999999,"15min":0.86099999999999999},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":1.2949999999999999,"5min":1.2949999999999999,"15min":1.2949999999999999},"last":1.901}]},{"osd":13,"last update":"Thu Apr 18 14:44:20 2024","interfaces":[{"interface":"back","average":{"1min":0.95999999999999996,"5min":0.95999999999999996,"15min":0.95999999999999996},"min":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.4279999999999999,"5min":1.4279999999999999,"15min":1.4279999999999999},"last":1.974},{"interface":"front","average":{"1min":0.89900000000000002,"5min":0.89900000000000002,"15min":0.89900000000000002},"min":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"max":{"1min":1.3360000000000001,"5min":1.3360000000000001,"15min":1.3360000000000001},"last":1.75}]},{"osd":14,"last update":"Thu Apr 18 14:44:20 2024","interfaces":[{"interface":"back","average":{"1min":1.022,"5min":1.022,"15min":1.022},"min":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":1.4730000000000001,"5min":1.4730000000000001,"15min":1.4730000000000001},"last":1.601},{"interface":"front","average":{"1min":1.0429999999999999,"5min":1.0429999999999999,"15min":1.0429999999999999},"min":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"max":{"1min":1.369,"5min":1.369,"15min":1.369},"last":1.5660000000000001}]},{"osd":15,"last update":"Thu Apr 18 14:44:20 2024","interfaces":[{"interface":"back","average":{"1min":1.016,"5min":1.016,"15min":1.016},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.5980000000000001,"5min":1.5980000000000001,"15min":1.5980000000000001},"last":1.639},{"interface":"front","average":{"1min":1.02,"5min":1.02,"15min":1.02},"min":{"1min":0.624,"5min":0.624,"15min":0.624},"max":{"1min":1.5649999999999999,"5min":1.5649999999999999,"15min":1.5649999999999999},"last":2.0369999999999999}]}]},{"osd":6,"up_from":22,"seq":94489280538,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32936,"kb_used_data":1820,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94338904,"statfs":{"total":96636764160,"available":96603037696,"internally_reserved":0,"allocated":1863680,"data_stored":1078641,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31848903},"hb_peers":[0,1,5,7,8,9,11,12,13,14],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Apr 18 14:44:30 2024","interfaces":[{"interface":"back","average":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":1.5629999999999999,"5min":1.5629999999999999,"15min":1.5629999999999999},"last":0.55200000000000005},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":1.006,"5min":1.006,"15min":1.006},"last":0.59499999999999997}]},{"osd":1,"last update":"Thu Apr 18 14:44:19 2024","interfaces":[{"interface":"back","average":{"1min":1.0329999999999999,"5min":1.0329999999999999,"15min":1.0329999999999999},"min":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"max":{"1min":1.633,"5min":1.633,"15min":1.633},"last":0.88600000000000001},{"interface":"front","average":{"1min":1.129,"5min":1.129,"15min":1.129},"min":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"max":{"1min":1.585,"5min":1.585,"15min":1.585},"last":1.345}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95399999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86599999999999999}]},{"osd":5,"last update":"Thu Apr 18 14:44:19 2024","interfaces":[{"interface":"back","average":{"1min":0.96399999999999997,"5min":0.96399999999999997,"15min":0.96399999999999997},"min":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":1.627,"5min":1.627,"15min":1.627},"last":0.69399999999999995},{"interface":"front","average":{"1min":0.98199999999999998,"5min":0.98199999999999998,"15min":0.98199999999999998},"min":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"max":{"1min":1.246,"5min":1.246,"15min":1.246},"last":1.2210000000000001}]},{"osd":7,"last update":"Thu Apr 18 14:44:19 2024","interfaces":[{"interface":"back","average":{"1min":1.1399999999999999,"5min":1.1399999999999999,"15min":1.1399999999999999},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.5860000000000001,"5min":1.5860000000000001,"15min":1.5860000000000001},"last":1.4059999999999999},{"interface":"front","average":{"1min":1.022,"5min":1.022,"15min":1.022},"min":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":1.482,"5min":1.482,"15min":1.482},"last":1.0569999999999999}]},{"osd":8,"last update":"Thu Apr 18 14:44:19 2024","interfaces":[{"interface":"back","average":{"1min":0.99299999999999999,"5min":0.99299999999999999,"15min":0.99299999999999999},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.3380000000000001,"5min":1.3380000000000001,"15min":1.3380000000000001},"last":0.753},{"interface":"front","average":{"1min":1.163,"5min":1.163,"15min":1.163},"min":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"max":{"1min":1.673,"5min":1.673,"15min":1.673},"last":0.84699999999999998}]},{"osd":9,"last update":"Thu Apr 18 14:44:30 2024","interfaces":[{"interface":"back","average":{"1min":1.1279999999999999,"5min":1.1279999999999999,"15min":1.1279999999999999},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.3859999999999999,"5min":1.3859999999999999,"15min":1.3859999999999999},"last":0.80300000000000005},{"interface":"front","average":{"1min":1.1870000000000001,"5min":1.1870000000000001,"15min":1.1870000000000001},"min":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"max":{"1min":1.5640000000000001,"5min":1.5640000000000001,"15min":1.5640000000000001},"last":1.298}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3240000000000001}]},{"osd":11,"last update":"Thu Apr 18 14:44:17 2024","interfaces":[{"interface":"back","average":{"1min":1.359,"5min":1.359,"15min":1.359},"min":{"1min":1.0229999999999999,"5min":1.0229999999999999,"15min":1.0229999999999999},"max":{"1min":2.3610000000000002,"5min":2.3610000000000002,"15min":2.3610000000000002},"last":1.151},{"interface":"front","average":{"1min":1.1439999999999999,"5min":1.1439999999999999,"15min":1.1439999999999999},"min":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"max":{"1min":1.698,"5min":1.698,"15min":1.698},"last":1.1859999999999999}]},{"osd":12,"last update":"Thu Apr 18 14:44:17 2024","interfaces":[{"interface":"back","average":{"1min":1.1950000000000001,"5min":1.1950000000000001,"15min":1.1950000000000001},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.5189999999999999,"5min":1.5189999999999999,"15min":1.5189999999999999},"last":1.0860000000000001},{"interface":"front","average":{"1min":1.3400000000000001,"5min":1.3400000000000001,"15min":1.3400000000000001},"min":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"max":{"1min":2.1920000000000002,"5min":2.1920000000000002,"15min":2.1920000000000002},"last":1.272}]},{"osd":13,"last update":"Thu Apr 18 14:44:30 2024","interfaces":[{"interface":"back","average":{"1min":1.4139999999999999,"5min":1.4139999999999999,"15min":1.4139999999999999},"min":{"1min":1.0309999999999999,"5min":1.0309999999999999,"15min":1.0309999999999999},"max":{"1min":1.794,"5min":1.794,"15min":1.794},"last":1.498},{"interface":"front","average":{"1min":1.29,"5min":1.29,"15min":1.29},"min":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":0.94599999999999995},"max":{"1min":1.591,"5min":1.591,"15min":1.591},"last":1.2470000000000001}]},{"osd":14,"last update":"Thu Apr 18 14:44:17 2024","interfaces":[{"interface":"back","average":{"1min":1.3280000000000001,"5min":1.3280000000000001,"15min":1.3280000000000001},"min":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"max":{"1min":1.8580000000000001,"5min":1.8580000000000001,"15min":1.8580000000000001},"last":1.5600000000000001},{"interface":"front","average":{"1min":1.347,"5min":1.347,"15min":1.347},"min":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":1.712,"5min":1.712,"15min":1.712},"last":1.325}]}]},{"osd":10,"up_from":22,"seq":94489280539,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32952,"kb_used_data":1832,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94338888,"statfs":{"total":96636764160,"available":96603021312,"internally_reserved":0,"allocated":1875968,"data_stored":1087311,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1599,"internal_metadata":31848897},"hb_peers":[1,6,7,8,9,11,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89700000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.371}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.117}]},{"osd":6,"last update":"Thu Apr 18 14:44:20 2024","interfaces":[{"interface":"back","average":{"1min":1.1830000000000001,"5min":1.1830000000000001,"15min":1.1830000000000001},"min":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"max":{"1min":3.9830000000000001,"5min":3.9830000000000001,"15min":3.9830000000000001},"last":0.83899999999999997},{"interface":"front","average":{"1min":1.0309999999999999,"5min":1.0309999999999999,"15min":1.0309999999999999},"min":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"max":{"1min":2.9420000000000002,"5min":2.9420000000000002,"15min":2.9420000000000002},"last":0.93899999999999995}]},{"osd":7,"last update":"Thu Apr 18 14:44:32 2024","interfaces":[{"interface":"back","average":{"1min":1.1870000000000001,"5min":1.1870000000000001,"15min":1.1870000000000001},"min":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":3.3679999999999999,"5min":3.3679999999999999,"15min":3.3679999999999999},"last":1.1080000000000001},{"interface":"front","average":{"1min":1.2190000000000001,"5min":1.2190000000000001,"15min":1.2190000000000001},"min":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"max":{"1min":3.1669999999999998,"5min":3.1669999999999998,"15min":3.1669999999999998},"last":1.357}]},{"osd":8,"last update":"Thu Apr 18 14:44:20 2024","interfaces":[{"interface":"back","average":{"1min":1.091,"5min":1.091,"15min":1.091},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":4.0439999999999996,"5min":4.0439999999999996,"15min":4.0439999999999996},"last":1.0800000000000001},{"interface":"front","average":{"1min":1.4390000000000001,"5min":1.4390000000000001,"15min":1.4390000000000001},"min":{"1min":0.89500000000000002,"5min":0.89500000000000002,"15min":0.89500000000000002},"max":{"1min":4.4900000000000002,"5min":4.4900000000000002,"15min":4.4900000000000002},"last":1.167}]},{"osd":9,"last update":"Thu Apr 18 14:44:20 2024","interfaces":[{"interface":"back","average":{"1min":1.3580000000000001,"5min":1.3580000000000001,"15min":1.3580000000000001},"min":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"max":{"1min":3.8439999999999999,"5min":3.8439999999999999,"15min":3.8439999999999999},"last":1.4570000000000001},{"interface":"front","average":{"1min":1.361,"5min":1.361,"15min":1.361},"min":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"max":{"1min":4.2880000000000003,"5min":4.2880000000000003,"15min":4.2880000000000003},"last":1.286}]},{"osd":11,"last update":"Thu Apr 18 14:44:20 2024","interfaces":[{"interface":"back","average":{"1min":1.4159999999999999,"5min":1.4159999999999999,"15min":1.4159999999999999},"min":{"1min":0.755,"5min":0.755,"15min":0.755},"max":{"1min":4.3399999999999999,"5min":4.3399999999999999,"15min":4.3399999999999999},"last":1.4039999999999999},{"interface":"front","average":{"1min":1.5740000000000001,"5min":1.5740000000000001,"15min":1.5740000000000001},"min":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"max":{"1min":4.4450000000000003,"5min":4.4450000000000003,"15min":4.4450000000000003},"last":1.7130000000000001}]},{"osd":12,"last update":"Thu Apr 18 14:44:20 2024","interfaces":[{"interface":"back","average":{"1min":1.3440000000000001,"5min":1.3440000000000001,"15min":1.3440000000000001},"min":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"max":{"1min":3.5539999999999998,"5min":3.5539999999999998,"15min":3.5539999999999998},"last":1.774},{"interface":"front","average":{"1min":1.431,"5min":1.431,"15min":1.431},"min":{"1min":0.621,"5min":0.621,"15min":0.621},"max":{"1min":4.125,"5min":4.125,"15min":4.125},"last":1.546}]},{"osd":13,"last update":"Thu Apr 18 14:44:20 2024","interfaces":[{"interface":"back","average":{"1min":1.71,"5min":1.71,"15min":1.71},"min":{"1min":1.1160000000000001,"5min":1.1160000000000001,"15min":1.1160000000000001},"max":{"1min":4.5359999999999996,"5min":4.5359999999999996,"15min":4.5359999999999996},"last":1.506},{"interface":"front","average":{"1min":1.5429999999999999,"5min":1.5429999999999999,"15min":1.5429999999999999},"min":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.85599999999999998},"max":{"1min":4.0049999999999999,"5min":4.0049999999999999,"15min":4.0049999999999999},"last":1.847}]},{"osd":14,"last update":"Thu Apr 18 14:44:20 2024","interfaces":[{"interface":"back","average":{"1min":1.7090000000000001,"5min":1.7090000000000001,"15min":1.7090000000000001},"min":{"1min":1.073,"5min":1.073,"15min":1.073},"max":{"1min":4.3940000000000001,"5min":4.3940000000000001,"15min":4.3940000000000001},"last":1.879},{"interface":"front","average":{"1min":1.5680000000000001,"5min":1.5680000000000001,"15min":1.5680000000000001},"min":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"max":{"1min":3.73,"5min":3.73,"15min":3.73},"last":1.897}]},{"osd":15,"last update":"Thu Apr 18 14:44:20 2024","interfaces":[{"interface":"back","average":{"1min":1.5629999999999999,"5min":1.5629999999999999,"15min":1.5629999999999999},"min":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":0.94999999999999996},"max":{"1min":4.1959999999999997,"5min":4.1959999999999997,"15min":4.1959999999999997},"last":1.748},{"interface":"front","average":{"1min":1.802,"5min":1.802,"15min":1.802},"min":{"1min":1.1579999999999999,"5min":1.1579999999999999,"15min":1.1579999999999999},"max":{"1min":4.577,"5min":4.577,"15min":4.577},"last":1.8100000000000001}]}]},{"osd":11,"up_from":22,"seq":94489280539,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32932,"kb_used_data":1816,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94338908,"statfs":{"total":96636764160,"available":96603041792,"internally_reserved":0,"allocated":1859584,"data_stored":1077797,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31848901},"hb_peers":[2,4,5,6,8,10,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":2,"last update":"Thu Apr 18 14:44:18 2024","interfaces":[{"interface":"back","average":{"1min":0.93899999999999995,"5min":0.93899999999999995,"15min":0.93899999999999995},"min":{"1min":0.503,"5min":0.503,"15min":0.503},"max":{"1min":1.367,"5min":1.367,"15min":1.367},"last":1.224},{"interface":"front","average":{"1min":1.0229999999999999,"5min":1.0229999999999999,"15min":1.0229999999999999},"min":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":2.863,"5min":2.863,"15min":2.863},"last":0.86099999999999999}]},{"osd":4,"last update":"Thu Apr 18 14:44:18 2024","interfaces":[{"interface":"back","average":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"min":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":1.1259999999999999,"5min":1.1259999999999999,"15min":1.1259999999999999},"last":0.79000000000000004},{"interface":"front","average":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.129,"5min":1.129,"15min":1.129},"last":0.66700000000000004}]},{"osd":5,"last update":"Thu Apr 18 14:44:23 2024","interfaces":[{"interface":"back","average":{"1min":0.98999999999999999,"5min":0.98999999999999999,"15min":0.98999999999999999},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":1.5840000000000001,"5min":1.5840000000000001,"15min":1.5840000000000001},"last":1.2729999999999999},{"interface":"front","average":{"1min":0.97199999999999998,"5min":0.97199999999999998,"15min":0.97199999999999998},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.619,"5min":1.619,"15min":1.619},"last":1.4330000000000001}]},{"osd":6,"last update":"Thu Apr 18 14:44:18 2024","interfaces":[{"interface":"back","average":{"1min":1.1319999999999999,"5min":1.1319999999999999,"15min":1.1319999999999999},"min":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"max":{"1min":2.9199999999999999,"5min":2.9199999999999999,"15min":2.9199999999999999},"last":1.464},{"interface":"front","average":{"1min":1,"5min":1,"15min":1},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.9510000000000001,"5min":1.9510000000000001,"15min":1.9510000000000001},"last":1.363}]},{"osd":8,"last update":"Thu Apr 18 14:44:23 2024","interfaces":[{"interface":"back","average":{"1min":0.97799999999999998,"5min":0.97799999999999998,"15min":0.97799999999999998},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.452,"5min":1.452,"15min":1.452},"last":0.96599999999999997},{"interface":"front","average":{"1min":1.006,"5min":1.006,"15min":1.006},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":1.383,"5min":1.383,"15min":1.383},"last":1.5669999999999999}]},{"osd":10,"last update":"Thu Apr 18 14:44:18 2024","interfaces":[{"interface":"back","average":{"1min":1.234,"5min":1.234,"15min":1.234},"min":{"1min":0.745,"5min":0.745,"15min":0.745},"max":{"1min":2.774,"5min":2.774,"15min":2.774},"last":1.595},{"interface":"front","average":{"1min":1.105,"5min":1.105,"15min":1.105},"min":{"1min":0.627,"5min":0.627,"15min":0.627},"max":{"1min":1.6890000000000001,"5min":1.6890000000000001,"15min":1.6890000000000001},"last":1.4990000000000001}]},{"osd":12,"last update":"Thu Apr 18 14:44:18 2024","interfaces":[{"interface":"back","average":{"1min":1.1639999999999999,"5min":1.1639999999999999,"15min":1.1639999999999999},"min":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.6719999999999999,"5min":1.6719999999999999,"15min":1.6719999999999999},"last":2.0270000000000001},{"interface":"front","average":{"1min":1.2729999999999999,"5min":1.2729999999999999,"15min":1.2729999999999999},"min":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"max":{"1min":3.4169999999999998,"5min":3.4169999999999998,"15min":3.4169999999999998},"last":1.738}]},{"osd":13,"last update":"Thu Apr 18 14:44:23 2024","interfaces":[{"interface":"back","average":{"1min":1.367,"5min":1.367,"15min":1.367},"min":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"max":{"1min":3.3239999999999998,"5min":3.3239999999999998,"15min":3.3239999999999998},"last":1.9410000000000001},{"interface":"front","average":{"1min":1.1639999999999999,"5min":1.1639999999999999,"15min":1.1639999999999999},"min":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"max":{"1min":1.746,"5min":1.746,"15min":1.746},"last":1.6619999999999999}]},{"osd":14,"last update":"Thu Apr 18 14:44:18 2024","interfaces":[{"interface":"back","average":{"1min":1.1950000000000001,"5min":1.1950000000000001,"15min":1.1950000000000001},"min":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"max":{"1min":1.6619999999999999,"5min":1.6619999999999999,"15min":1.6619999999999999},"last":1.8899999999999999},{"interface":"front","average":{"1min":1.2450000000000001,"5min":1.2450000000000001,"15min":1.2450000000000001},"min":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"max":{"1min":1.7210000000000001,"5min":1.7210000000000001,"15min":1.7210000000000001},"last":1.9750000000000001}]},{"osd":15,"last update":"Thu Apr 18 14:44:23 2024","interfaces":[{"interface":"back","average":{"1min":1.284,"5min":1.284,"15min":1.284},"min":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"max":{"1min":1.851,"5min":1.851,"15min":1.851},"last":1.8320000000000001},{"interface":"front","average":{"1min":1.409,"5min":1.409,"15min":1.409},"min":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"max":{"1min":3.3769999999999998,"5min":3.3769999999999998,"15min":3.3769999999999998},"last":2.1520000000000001}]}]},{"osd":12,"up_from":22,"seq":94489280539,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32932,"kb_used_data":1816,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94338908,"statfs":{"total":96636764160,"available":96603041792,"internally_reserved":0,"allocated":1859584,"data_stored":1077797,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[1,3,4,5,6,10,11,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Apr 18 14:44:30 2024","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":1.3400000000000001,"5min":1.3400000000000001,"15min":1.3400000000000001},"last":0.68100000000000005},{"interface":"front","average":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":1.2310000000000001,"5min":1.2310000000000001,"15min":1.2310000000000001},"last":0.78900000000000003}]},{"osd":1,"last update":"Thu Apr 18 14:44:20 2024","interfaces":[{"interface":"back","average":{"1min":0.93999999999999995,"5min":0.93999999999999995,"15min":0.93999999999999995},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.5449999999999999,"5min":1.5449999999999999,"15min":1.5449999999999999},"last":0.61799999999999999},{"interface":"front","average":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":1.2649999999999999,"5min":1.2649999999999999,"15min":1.2649999999999999},"last":0.85399999999999998}]},{"osd":3,"last update":"Thu Apr 18 14:44:20 2024","interfaces":[{"interface":"back","average":{"1min":0.93999999999999995,"5min":0.93999999999999995,"15min":0.93999999999999995},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":1.4930000000000001,"5min":1.4930000000000001,"15min":1.4930000000000001},"last":0.81200000000000006},{"interface":"front","average":{"1min":0.91500000000000004,"5min":0.91500000000000004,"15min":0.91500000000000004},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.4319999999999999,"5min":1.4319999999999999,"15min":1.4319999999999999},"last":0.95299999999999996}]},{"osd":4,"last update":"Thu Apr 18 14:44:20 2024","interfaces":[{"interface":"back","average":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":1.383,"5min":1.383,"15min":1.383},"last":0.76300000000000001},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":1.335,"5min":1.335,"15min":1.335},"last":0.57699999999999996}]},{"osd":5,"last update":"Thu Apr 18 14:44:30 2024","interfaces":[{"interface":"back","average":{"1min":0.93100000000000005,"5min":0.93100000000000005,"15min":0.93100000000000005},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.4710000000000001,"5min":1.4710000000000001,"15min":1.4710000000000001},"last":0.99399999999999999},{"interface":"front","average":{"1min":1.03,"5min":1.03,"15min":1.03},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.784,"5min":1.784,"15min":1.784},"last":1.284}]},{"osd":6,"last update":"Thu Apr 18 14:44:20 2024","interfaces":[{"interface":"back","average":{"1min":1.0289999999999999,"5min":1.0289999999999999,"15min":1.0289999999999999},"min":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":1.6060000000000001,"5min":1.6060000000000001,"15min":1.6060000000000001},"last":0.92800000000000005},{"interface":"front","average":{"1min":1.0820000000000001,"5min":1.0820000000000001,"15min":1.0820000000000001},"min":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"max":{"1min":1.5620000000000001,"5min":1.5620000000000001,"15min":1.5620000000000001},"last":1.022}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1539999999999999}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4119999999999999}]},{"osd":10,"last update":"Thu Apr 18 14:44:20 2024","interfaces":[{"interface":"back","average":{"1min":1.137,"5min":1.137,"15min":1.137},"min":{"1min":0.626,"5min":0.626,"15min":0.626},"max":{"1min":1.6919999999999999,"5min":1.6919999999999999,"15min":1.6919999999999999},"last":0.89800000000000002},{"interface":"front","average":{"1min":1.1100000000000001,"5min":1.1100000000000001,"15min":1.1100000000000001},"min":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"max":{"1min":1.8899999999999999,"5min":1.8899999999999999,"15min":1.8899999999999999},"last":1.0680000000000001}]},{"osd":11,"last update":"Thu Apr 18 14:44:20 2024","interfaces":[{"interface":"back","average":{"1min":1.1890000000000001,"5min":1.1890000000000001,"15min":1.1890000000000001},"min":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"max":{"1min":2.04,"5min":2.04,"15min":2.04},"last":1.1519999999999999},{"interface":"front","average":{"1min":1.1599999999999999,"5min":1.1599999999999999,"15min":1.1599999999999999},"min":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"max":{"1min":1.8660000000000001,"5min":1.8660000000000001,"15min":1.8660000000000001},"last":1.093}]},{"osd":13,"last update":"Thu Apr 18 14:44:20 2024","interfaces":[{"interface":"back","average":{"1min":1.181,"5min":1.181,"15min":1.181},"min":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"max":{"1min":1.8080000000000001,"5min":1.8080000000000001,"15min":1.8080000000000001},"last":1.1120000000000001},{"interface":"front","average":{"1min":1.228,"5min":1.228,"15min":1.228},"min":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"max":{"1min":2.133,"5min":2.133,"15min":2.133},"last":1.2529999999999999}]},{"osd":14,"last update":"Thu Apr 18 14:44:20 2024","interfaces":[{"interface":"back","average":{"1min":1.226,"5min":1.226,"15min":1.226},"min":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"max":{"1min":1.7410000000000001,"5min":1.7410000000000001,"15min":1.7410000000000001},"last":1.1919999999999999},{"interface":"front","average":{"1min":1.232,"5min":1.232,"15min":1.232},"min":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"max":{"1min":1.966,"5min":1.966,"15min":1.966},"last":1.319}]},{"osd":15,"last update":"Thu Apr 18 14:44:20 2024","interfaces":[{"interface":"back","average":{"1min":1.2190000000000001,"5min":1.2190000000000001,"15min":1.2190000000000001},"min":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"max":{"1min":1.802,"5min":1.802,"15min":1.802},"last":1.1739999999999999},{"interface":"front","average":{"1min":1.2889999999999999,"5min":1.2889999999999999,"15min":1.2889999999999999},"min":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"max":{"1min":1.8580000000000001,"5min":1.8580000000000001,"15min":1.8580000000000001},"last":1.3620000000000001}]}]},{"osd":0,"up_from":23,"seq":98784247835,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33468,"kb_used_data":2352,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94338372,"statfs":{"total":96636764160,"available":96602492928,"internally_reserved":0,"allocated":2408448,"data_stored":1616239,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[1,4,6,7,8,10,11,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Apr 18 14:44:23 2024","interfaces":[{"interface":"back","average":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":1.218,"5min":1.218,"15min":1.218},"last":1.026},{"interface":"front","average":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.47,"5min":1.47,"15min":1.47},"last":1.056}]},{"osd":4,"last update":"Thu Apr 18 14:44:19 2024","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":1.5409999999999999,"5min":1.5409999999999999,"15min":1.5409999999999999},"last":0.61499999999999999},{"interface":"front","average":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":1.903,"5min":1.903,"15min":1.903},"last":0.64000000000000001}]},{"osd":6,"last update":"Thu Apr 18 14:44:19 2024","interfaces":[{"interface":"back","average":{"1min":0.90200000000000002,"5min":0.90200000000000002,"15min":0.90200000000000002},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":2.5009999999999999,"5min":2.5009999999999999,"15min":2.5009999999999999},"last":0.96399999999999997},{"interface":"front","average":{"1min":0.89500000000000002,"5min":0.89500000000000002,"15min":0.89500000000000002},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":1.6240000000000001,"5min":1.6240000000000001,"15min":1.6240000000000001},"last":0.91100000000000003}]},{"osd":7,"last update":"Thu Apr 18 14:44:19 2024","interfaces":[{"interface":"back","average":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":1.2350000000000001,"5min":1.2350000000000001,"15min":1.2350000000000001},"last":0.71499999999999997},{"interface":"front","average":{"1min":0.93899999999999995,"5min":0.93899999999999995,"15min":0.93899999999999995},"min":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"max":{"1min":1.5860000000000001,"5min":1.5860000000000001,"15min":1.5860000000000001},"last":0.78800000000000003}]},{"osd":8,"last update":"Thu Apr 18 14:44:19 2024","interfaces":[{"interface":"back","average":{"1min":1.734,"5min":1.734,"15min":1.734},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":18.015999999999998,"5min":18.015999999999998,"15min":18.015999999999998},"last":0.73099999999999998},{"interface":"front","average":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":1.6599999999999999,"5min":1.6599999999999999,"15min":1.6599999999999999},"last":0.57499999999999996}]},{"osd":10,"last update":"Thu Apr 18 14:44:19 2024","interfaces":[{"interface":"back","average":{"1min":1.0960000000000001,"5min":1.0960000000000001,"15min":1.0960000000000001},"min":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"max":{"1min":2.1339999999999999,"5min":2.1339999999999999,"15min":2.1339999999999999},"last":1.1020000000000001},{"interface":"front","average":{"1min":1.119,"5min":1.119,"15min":1.119},"min":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"max":{"1min":1.8540000000000001,"5min":1.8540000000000001,"15min":1.8540000000000001},"last":0.94999999999999996}]},{"osd":11,"last update":"Thu Apr 18 14:44:19 2024","interfaces":[{"interface":"back","average":{"1min":2.9990000000000001,"5min":2.9990000000000001,"15min":2.9990000000000001},"min":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":41.195999999999998,"5min":41.195999999999998,"15min":41.195999999999998},"last":0.85699999999999998},{"interface":"front","average":{"1min":3.1339999999999999,"5min":3.1339999999999999,"15min":3.1339999999999999},"min":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"max":{"1min":41.216999999999999,"5min":41.216999999999999,"15min":41.216999999999999},"last":1}]},{"osd":13,"last update":"Thu Apr 18 14:44:23 2024","interfaces":[{"interface":"back","average":{"1min":0.95099999999999996,"5min":0.95099999999999996,"15min":0.95099999999999996},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":1.881,"5min":1.881,"15min":1.881},"last":0.748},{"interface":"front","average":{"1min":1.091,"5min":1.091,"15min":1.091},"min":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":1.8720000000000001,"5min":1.8720000000000001,"15min":1.8720000000000001},"last":0.82299999999999995}]},{"osd":14,"last update":"Thu Apr 18 14:44:19 2024","interfaces":[{"interface":"back","average":{"1min":1.103,"5min":1.103,"15min":1.103},"min":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"max":{"1min":1.95,"5min":1.95,"15min":1.95},"last":0.77400000000000002},{"interface":"front","average":{"1min":1.095,"5min":1.095,"15min":1.095},"min":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"max":{"1min":2.1219999999999999,"5min":2.1219999999999999,"15min":2.1219999999999999},"last":0.89000000000000001}]},{"osd":15,"last update":"Thu Apr 18 14:44:19 2024","interfaces":[{"interface":"back","average":{"1min":1.224,"5min":1.224,"15min":1.224},"min":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"max":{"1min":1.929,"5min":1.929,"15min":1.929},"last":0.93000000000000005},{"interface":"front","average":{"1min":1.179,"5min":1.179,"15min":1.179},"min":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":2.056,"5min":2.056,"15min":2.056},"last":0.97799999999999998}]}]},{"osd":3,"up_from":23,"seq":98784247834,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32956,"kb_used_data":1836,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94338884,"statfs":{"total":96636764160,"available":96603017216,"internally_reserved":0,"allocated":1880064,"data_stored":1088155,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31848904},"hb_peers":[0,2,4,5,8,9,10,11,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Apr 18 14:44:20 2024","interfaces":[{"interface":"back","average":{"1min":0.88200000000000001,"5min":0.88200000000000001,"15min":0.88200000000000001},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":1.4510000000000001,"5min":1.4510000000000001,"15min":1.4510000000000001},"last":1.387},{"interface":"front","average":{"1min":1,"5min":1,"15min":1},"min":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"max":{"1min":1.4850000000000001,"5min":1.4850000000000001,"15min":1.4850000000000001},"last":1.1719999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4590000000000001}]},{"osd":2,"last update":"Thu Apr 18 14:44:20 2024","interfaces":[{"interface":"back","average":{"1min":0.98599999999999999,"5min":0.98599999999999999,"15min":0.98599999999999999},"min":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.5469999999999999,"5min":1.5469999999999999,"15min":1.5469999999999999},"last":0.70399999999999996},{"interface":"front","average":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":0.94999999999999996},"min":{"1min":0.623,"5min":0.623,"15min":0.623},"max":{"1min":1.425,"5min":1.425,"15min":1.425},"last":0.95899999999999996}]},{"osd":4,"last update":"Thu Apr 18 14:44:20 2024","interfaces":[{"interface":"back","average":{"1min":1.008,"5min":1.008,"15min":1.008},"min":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.7030000000000001,"5min":1.7030000000000001,"15min":1.7030000000000001},"last":0.80000000000000004},{"interface":"front","average":{"1min":0.98699999999999999,"5min":0.98699999999999999,"15min":0.98699999999999999},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":1.5309999999999999,"5min":1.5309999999999999,"15min":1.5309999999999999},"last":0.92200000000000004}]},{"osd":5,"last update":"Thu Apr 18 14:44:20 2024","interfaces":[{"interface":"back","average":{"1min":1.087,"5min":1.087,"15min":1.087},"min":{"1min":0.624,"5min":0.624,"15min":0.624},"max":{"1min":1.663,"5min":1.663,"15min":1.663},"last":1.1379999999999999},{"interface":"front","average":{"1min":1.206,"5min":1.206,"15min":1.206},"min":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":1.6779999999999999,"5min":1.6779999999999999,"15min":1.6779999999999999},"last":1.2609999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.472}]},{"osd":7,"last update":"Thu Apr 18 14:44:20 2024","interfaces":[{"interface":"back","average":{"1min":1.157,"5min":1.157,"15min":1.157},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.645,"5min":1.645,"15min":1.645},"last":0.82199999999999995},{"interface":"front","average":{"1min":1.115,"5min":1.115,"15min":1.115},"min":{"1min":0.503,"5min":0.503,"15min":0.503},"max":{"1min":1.6419999999999999,"5min":1.6419999999999999,"15min":1.6419999999999999},"last":0.90800000000000003}]},{"osd":8,"last update":"Thu Apr 18 14:44:20 2024","interfaces":[{"interface":"back","average":{"1min":1.1339999999999999,"5min":1.1339999999999999,"15min":1.1339999999999999},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.7529999999999999,"5min":1.7529999999999999,"15min":1.7529999999999999},"last":1.232},{"interface":"front","average":{"1min":1.304,"5min":1.304,"15min":1.304},"min":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"max":{"1min":1.7430000000000001,"5min":1.7430000000000001,"15min":1.7430000000000001},"last":1.359}]},{"osd":9,"last update":"Thu Apr 18 14:44:33 2024","interfaces":[{"interface":"back","average":{"1min":1.3,"5min":1.3,"15min":1.3},"min":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"max":{"1min":1.879,"5min":1.879,"15min":1.879},"last":1.0069999999999999},{"interface":"front","average":{"1min":1.254,"5min":1.254,"15min":1.254},"min":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"max":{"1min":1.8260000000000001,"5min":1.8260000000000001,"15min":1.8260000000000001},"last":1.4750000000000001}]},{"osd":10,"last update":"Thu Apr 18 14:44:20 2024","interfaces":[{"interface":"back","average":{"1min":1.327,"5min":1.327,"15min":1.327},"min":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"max":{"1min":1.883,"5min":1.883,"15min":1.883},"last":1.2889999999999999},{"interface":"front","average":{"1min":1.3660000000000001,"5min":1.3660000000000001,"15min":1.3660000000000001},"min":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"max":{"1min":2.161,"5min":2.161,"15min":2.161},"last":1.663}]},{"osd":11,"last update":"Thu Apr 18 14:44:20 2024","interfaces":[{"interface":"back","average":{"1min":1.4330000000000001,"5min":1.4330000000000001,"15min":1.4330000000000001},"min":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"max":{"1min":1.8959999999999999,"5min":1.8959999999999999,"15min":1.8959999999999999},"last":1.419},{"interface":"front","average":{"1min":1.381,"5min":1.381,"15min":1.381},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":2.1160000000000001,"5min":2.1160000000000001,"15min":2.1160000000000001},"last":1.0720000000000001}]},{"osd":12,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.8740000000000001}]},{"osd":14,"last update":"Thu Apr 18 14:44:20 2024","interfaces":[{"interface":"back","average":{"1min":1.512,"5min":1.512,"15min":1.512},"min":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":0.94999999999999996},"max":{"1min":2.2879999999999998,"5min":2.2879999999999998,"15min":2.2879999999999998},"last":1.5760000000000001},{"interface":"front","average":{"1min":1.4139999999999999,"5min":1.4139999999999999,"15min":1.4139999999999999},"min":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"max":{"1min":2.0179999999999998,"5min":2.0179999999999998,"15min":2.0179999999999998},"last":1.7270000000000001}]},{"osd":15,"last update":"Thu Apr 18 14:44:33 2024","interfaces":[{"interface":"back","average":{"1min":1.4730000000000001,"5min":1.4730000000000001,"15min":1.4730000000000001},"min":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"max":{"1min":2.1120000000000001,"5min":2.1120000000000001,"15min":2.1120000000000001},"last":1.786},{"interface":"front","average":{"1min":1.452,"5min":1.452,"15min":1.452},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.9299999999999999,"5min":1.9299999999999999,"15min":1.9299999999999999},"last":1.496}]}]},{"osd":7,"up_from":23,"seq":98784247836,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32952,"kb_used_data":1832,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94338888,"statfs":{"total":96636764160,"available":96603021312,"internally_reserved":0,"allocated":1875968,"data_stored":1087311,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":31848907},"hb_peers":[0,2,3,4,5,6,8,10,12,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Apr 18 14:44:34 2024","interfaces":[{"interface":"back","average":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":1.109,"5min":1.109,"15min":1.109},"last":0.70199999999999996},{"interface":"front","average":{"1min":0.873,"5min":0.873,"15min":0.873},"min":{"1min":0.505,"5min":0.505,"15min":0.505},"max":{"1min":1.7589999999999999,"5min":1.7589999999999999,"15min":1.7589999999999999},"last":0.67400000000000004}]},{"osd":2,"last update":"Thu Apr 18 14:44:21 2024","interfaces":[{"interface":"back","average":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"min":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":1.1519999999999999,"5min":1.1519999999999999,"15min":1.1519999999999999},"last":0.78900000000000003},{"interface":"front","average":{"1min":0.97599999999999998,"5min":0.97599999999999998,"15min":0.97599999999999998},"min":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"max":{"1min":1.891,"5min":1.891,"15min":1.891},"last":0.91900000000000004}]},{"osd":3,"last update":"Thu Apr 18 14:44:34 2024","interfaces":[{"interface":"back","average":{"1min":0.88200000000000001,"5min":0.88200000000000001,"15min":0.88200000000000001},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.5920000000000001,"5min":1.5920000000000001,"15min":1.5920000000000001},"last":0.58499999999999996},{"interface":"front","average":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":1.2330000000000001,"5min":1.2330000000000001,"15min":1.2330000000000001},"last":0.875}]},{"osd":4,"last update":"Thu Apr 18 14:44:21 2024","interfaces":[{"interface":"back","average":{"1min":0.95699999999999996,"5min":0.95699999999999996,"15min":0.95699999999999996},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.258,"5min":1.258,"15min":1.258},"last":1.091},{"interface":"front","average":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":1.2170000000000001,"5min":1.2170000000000001,"15min":1.2170000000000001},"last":1.0620000000000001}]},{"osd":5,"last update":"Thu Apr 18 14:44:21 2024","interfaces":[{"interface":"back","average":{"1min":1.1140000000000001,"5min":1.1140000000000001,"15min":1.1140000000000001},"min":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"max":{"1min":1.8580000000000001,"5min":1.8580000000000001,"15min":1.8580000000000001},"last":1.022},{"interface":"front","average":{"1min":1.1120000000000001,"5min":1.1120000000000001,"15min":1.1120000000000001},"min":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"max":{"1min":1.53,"5min":1.53,"15min":1.53},"last":0.95299999999999996}]},{"osd":6,"last update":"Thu Apr 18 14:44:21 2024","interfaces":[{"interface":"back","average":{"1min":1.139,"5min":1.139,"15min":1.139},"min":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"max":{"1min":1.8759999999999999,"5min":1.8759999999999999,"15min":1.8759999999999999},"last":1.1160000000000001},{"interface":"front","average":{"1min":1.171,"5min":1.171,"15min":1.171},"min":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"max":{"1min":1.4570000000000001,"5min":1.4570000000000001,"15min":1.4570000000000001},"last":0.84699999999999998}]},{"osd":8,"last update":"Thu Apr 18 14:44:21 2024","interfaces":[{"interface":"back","average":{"1min":1.095,"5min":1.095,"15min":1.095},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":1.4159999999999999,"5min":1.4159999999999999,"15min":1.4159999999999999},"last":0.622},{"interface":"front","average":{"1min":1.274,"5min":1.274,"15min":1.274},"min":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"max":{"1min":1.821,"5min":1.821,"15min":1.821},"last":0.753}]},{"osd":10,"last update":"Thu Apr 18 14:44:21 2024","interfaces":[{"interface":"back","average":{"1min":1.151,"5min":1.151,"15min":1.151},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.831,"5min":1.831,"15min":1.831},"last":0.97699999999999998},{"interface":"front","average":{"1min":1.278,"5min":1.278,"15min":1.278},"min":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"max":{"1min":1.53,"5min":1.53,"15min":1.53},"last":0.996}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71699999999999997}]},{"osd":12,"last update":"Thu Apr 18 14:44:21 2024","interfaces":[{"interface":"back","average":{"1min":1.2270000000000001,"5min":1.2270000000000001,"15min":1.2270000000000001},"min":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.7549999999999999,"5min":1.7549999999999999,"15min":1.7549999999999999},"last":0.73099999999999998},{"interface":"front","average":{"1min":1.4039999999999999,"5min":1.4039999999999999,"15min":1.4039999999999999},"min":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"max":{"1min":2.0960000000000001,"5min":2.0960000000000001,"15min":2.0960000000000001},"last":0.81799999999999995}]},{"osd":14,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3819999999999999}]},{"osd":15,"last update":"Thu Apr 18 14:44:21 2024","interfaces":[{"interface":"back","average":{"1min":1.4330000000000001,"5min":1.4330000000000001,"15min":1.4330000000000001},"min":{"1min":0.874,"5min":0.874,"15min":0.874},"max":{"1min":2.6699999999999999,"5min":2.6699999999999999,"15min":2.6699999999999999},"last":1.1639999999999999},{"interface":"front","average":{"1min":1.401,"5min":1.401,"15min":1.401},"min":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":2.516,"5min":2.516,"15min":2.516},"last":1.1399999999999999}]}]},{"osd":8,"up_from":23,"seq":98784247836,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32956,"kb_used_data":1832,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94338884,"statfs":{"total":96636764160,"available":96603017216,"internally_reserved":0,"allocated":1875968,"data_stored":1087311,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[1,2,3,4,5,7,9,11,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Apr 18 14:44:32 2024","interfaces":[{"interface":"back","average":{"1min":0.746,"5min":0.746,"15min":0.746},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":1.7290000000000001,"5min":1.7290000000000001,"15min":1.7290000000000001},"last":2.4540000000000002},{"interface":"front","average":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":2.48,"5min":2.48,"15min":2.48},"last":2.1669999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72999999999999998}]},{"osd":2,"last update":"Thu Apr 18 14:44:22 2024","interfaces":[{"interface":"back","average":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":1.1339999999999999,"5min":1.1339999999999999,"15min":1.1339999999999999},"last":0.76600000000000001},{"interface":"front","average":{"1min":0.996,"5min":0.996,"15min":0.996},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":2.54,"5min":2.54,"15min":2.54},"last":0.50700000000000001}]},{"osd":3,"last update":"Thu Apr 18 14:44:32 2024","interfaces":[{"interface":"back","average":{"1min":0.88800000000000001,"5min":0.88800000000000001,"15min":0.88800000000000001},"min":{"1min":0.628,"5min":0.628,"15min":0.628},"max":{"1min":1.137,"5min":1.137,"15min":1.137},"last":0.70199999999999996},{"interface":"front","average":{"1min":1.0209999999999999,"5min":1.0209999999999999,"15min":1.0209999999999999},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":2.6779999999999999,"5min":2.6779999999999999,"15min":2.6779999999999999},"last":0.58999999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46899999999999997}]},{"osd":5,"last update":"Thu Apr 18 14:44:22 2024","interfaces":[{"interface":"back","average":{"1min":1.0549999999999999,"5min":1.0549999999999999,"15min":1.0549999999999999},"min":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":2.7810000000000001,"5min":2.7810000000000001,"15min":2.7810000000000001},"last":0.753},{"interface":"front","average":{"1min":0.91800000000000004,"5min":0.91800000000000004,"15min":0.91800000000000004},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.5309999999999999,"5min":1.5309999999999999,"15min":1.5309999999999999},"last":0.55500000000000005}]},{"osd":7,"last update":"Thu Apr 18 14:44:22 2024","interfaces":[{"interface":"back","average":{"1min":1.042,"5min":1.042,"15min":1.042},"min":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":1.925,"5min":1.925,"15min":1.925},"last":0.63400000000000001},{"interface":"front","average":{"1min":1.0800000000000001,"5min":1.0800000000000001,"15min":1.0800000000000001},"min":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"max":{"1min":1.669,"5min":1.669,"15min":1.669},"last":0.84199999999999997}]},{"osd":9,"last update":"Thu Apr 18 14:44:22 2024","interfaces":[{"interface":"back","average":{"1min":1.0249999999999999,"5min":1.0249999999999999,"15min":1.0249999999999999},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":1.6479999999999999,"5min":1.6479999999999999,"15min":1.6479999999999999},"last":0.64400000000000002},{"interface":"front","average":{"1min":1.163,"5min":1.163,"15min":1.163},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":2.9319999999999999,"5min":2.9319999999999999,"15min":2.9319999999999999},"last":0.53800000000000003}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.665}]},{"osd":11,"last update":"Thu Apr 18 14:44:22 2024","interfaces":[{"interface":"back","average":{"1min":1.206,"5min":1.206,"15min":1.206},"min":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"max":{"1min":2.1139999999999999,"5min":2.1139999999999999,"15min":2.1139999999999999},"last":0.85599999999999998},{"interface":"front","average":{"1min":1.2929999999999999,"5min":1.2929999999999999,"15min":1.2929999999999999},"min":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"max":{"1min":2.25,"5min":2.25,"15min":2.25},"last":0.79800000000000004}]},{"osd":12,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5629999999999999}]},{"osd":14,"last update":"Thu Apr 18 14:44:22 2024","interfaces":[{"interface":"back","average":{"1min":1.341,"5min":1.341,"15min":1.341},"min":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"max":{"1min":2.5800000000000001,"5min":2.5800000000000001,"15min":2.5800000000000001},"last":0.81999999999999995},{"interface":"front","average":{"1min":1.3919999999999999,"5min":1.3919999999999999,"15min":1.3919999999999999},"min":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"max":{"1min":3.0739999999999998,"5min":3.0739999999999998,"15min":3.0739999999999998},"last":0.81299999999999994}]},{"osd":15,"last update":"Thu Apr 18 14:44:22 2024","interfaces":[{"interface":"back","average":{"1min":1.355,"5min":1.355,"15min":1.355},"min":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"max":{"1min":2.4740000000000002,"5min":2.4740000000000002,"15min":2.4740000000000002},"last":0.878},{"interface":"front","average":{"1min":1.4159999999999999,"5min":1.4159999999999999,"15min":1.4159999999999999},"min":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"max":{"1min":2.8620000000000001,"5min":2.8620000000000001,"15min":2.8620000000000001},"last":0.78500000000000003}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":13,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":12,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":13,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":14,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":15,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-18T14:45:12.158 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-18T14:45:12.443 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-04-18T14:45:12.445 INFO:teuthology.orchestra.run.smithi086.stderr:dumped all 2024-04-18T14:45:12.459 INFO:teuthology.orchestra.run.smithi086.stdout:{"pg_ready":true,"pg_map":{"version":171,"stamp":"2024-04-18T14:45:11.370991+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":16,"num_per_pool_osds":16,"num_per_pool_omap_osds":11,"kb":1509949440,"kb_used":560224,"kb_used_data":30316,"kb_used_omap":24,"kb_used_meta":529639,"kb_avail":1509389216,"statfs":{"total":1546188226560,"available":1545614557184,"internally_reserved":0,"allocated":31043584,"data_stored":18422684,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":25506,"internal_metadata":542350430},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.538435"},"pg_stats":[{"pgid":"1.0","version":"26'157","reported_seq":308,"reported_epoch":124,"state":"active+clean","last_fresh":"2024-04-18T14:45:07.185100+0000","last_change":"2024-04-18T14:44:37.152954+0000","last_active":"2024-04-18T14:45:07.185100+0000","last_peered":"2024-04-18T14:45:07.185100+0000","last_clean":"2024-04-18T14:45:07.185100+0000","last_became_active":"2024-04-18T14:43:20.323133+0000","last_became_peered":"2024-04-18T14:43:20.323133+0000","last_unstale":"2024-04-18T14:45:07.185100+0000","last_undegraded":"2024-04-18T14:45:07.185100+0000","last_fullsized":"2024-04-18T14:45:07.185100+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'157","last_scrub_stamp":"2024-04-18T14:44:37.152696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T14:43:18.296821+0000","last_clean_scrub_stamp":"2024-04-18T14:44:37.152696+0000","objects_scrubbed":2,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T14:45:43.293239+0000","scrub_duration":0.0049794150000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[13,0],"acting":[13,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":13,"acting_primary":13,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":114,"reported_epoch":124,"state":"active+clean","last_fresh":"2024-04-18T14:45:05.843355+0000","last_change":"2024-04-18T14:44:23.449444+0000","last_active":"2024-04-18T14:45:05.843355+0000","last_peered":"2024-04-18T14:45:05.843355+0000","last_clean":"2024-04-18T14:45:05.843355+0000","last_became_active":"2024-04-18T14:43:21.327764+0000","last_became_peered":"2024-04-18T14:43:21.327764+0000","last_unstale":"2024-04-18T14:45:05.843355+0000","last_undegraded":"2024-04-18T14:45:05.843355+0000","last_fullsized":"2024-04-18T14:45:05.843355+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T14:44:23.449241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T14:43:20.303322+0000","last_clean_scrub_stamp":"2024-04-18T14:44:23.449241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T14:45:36.175611+0000","scrub_duration":0.0029048670000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,15],"acting":[5,15],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":111,"reported_epoch":124,"state":"active+clean","last_fresh":"2024-04-18T14:45:05.845686+0000","last_change":"2024-04-18T14:44:37.374487+0000","last_active":"2024-04-18T14:45:05.845686+0000","last_peered":"2024-04-18T14:45:05.845686+0000","last_clean":"2024-04-18T14:45:05.845686+0000","last_became_active":"2024-04-18T14:43:21.414060+0000","last_became_peered":"2024-04-18T14:43:21.414060+0000","last_unstale":"2024-04-18T14:45:05.845686+0000","last_undegraded":"2024-04-18T14:45:05.845686+0000","last_fullsized":"2024-04-18T14:45:05.845686+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T14:44:37.374221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T14:43:20.303322+0000","last_clean_scrub_stamp":"2024-04-18T14:44:37.374221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T14:45:58.651147+0000","scrub_duration":0.0042134670000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":111,"reported_epoch":124,"state":"active+clean","last_fresh":"2024-04-18T14:45:07.185035+0000","last_change":"2024-04-18T14:44:24.148269+0000","last_active":"2024-04-18T14:45:07.185035+0000","last_peered":"2024-04-18T14:45:07.185035+0000","last_clean":"2024-04-18T14:45:07.185035+0000","last_became_active":"2024-04-18T14:43:21.328534+0000","last_became_peered":"2024-04-18T14:43:21.328534+0000","last_unstale":"2024-04-18T14:45:07.185035+0000","last_undegraded":"2024-04-18T14:45:07.185035+0000","last_fullsized":"2024-04-18T14:45:07.185035+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T14:44:24.148141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T14:43:20.303322+0000","last_clean_scrub_stamp":"2024-04-18T14:44:24.148141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T14:45:30.466689+0000","scrub_duration":0.001593882,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[13,5],"acting":[13,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":13,"acting_primary":13,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":111,"reported_epoch":124,"state":"active+clean","last_fresh":"2024-04-18T14:45:05.845692+0000","last_change":"2024-04-18T14:44:47.245574+0000","last_active":"2024-04-18T14:45:05.845692+0000","last_peered":"2024-04-18T14:45:05.845692+0000","last_clean":"2024-04-18T14:45:05.845692+0000","last_became_active":"2024-04-18T14:43:21.465481+0000","last_became_peered":"2024-04-18T14:43:21.465481+0000","last_unstale":"2024-04-18T14:45:05.845692+0000","last_undegraded":"2024-04-18T14:45:05.845692+0000","last_fullsized":"2024-04-18T14:45:05.845692+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T14:44:47.245297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T14:44:47.245297+0000","last_clean_scrub_stamp":"2024-04-18T14:44:47.245297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T14:46:02.649852+0000","scrub_duration":0.0038839159999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10],"acting":[3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":114,"reported_epoch":124,"state":"active+clean","last_fresh":"2024-04-18T14:45:07.345184+0000","last_change":"2024-04-18T14:44:38.485354+0000","last_active":"2024-04-18T14:45:07.345184+0000","last_peered":"2024-04-18T14:45:07.345184+0000","last_clean":"2024-04-18T14:45:07.345184+0000","last_became_active":"2024-04-18T14:43:21.348012+0000","last_became_peered":"2024-04-18T14:43:21.348012+0000","last_unstale":"2024-04-18T14:45:07.345184+0000","last_undegraded":"2024-04-18T14:45:07.345184+0000","last_fullsized":"2024-04-18T14:45:07.345184+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T14:44:38.485106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T14:43:20.303322+0000","last_clean_scrub_stamp":"2024-04-18T14:44:38.485106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T14:45:48.039171+0000","scrub_duration":0.0043932759999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,12],"acting":[6,12],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":111,"reported_epoch":124,"state":"active+clean","last_fresh":"2024-04-18T14:45:06.469135+0000","last_change":"2024-04-18T14:44:38.516905+0000","last_active":"2024-04-18T14:45:06.469135+0000","last_peered":"2024-04-18T14:45:06.469135+0000","last_clean":"2024-04-18T14:45:06.469135+0000","last_became_active":"2024-04-18T14:43:21.422468+0000","last_became_peered":"2024-04-18T14:43:21.422468+0000","last_unstale":"2024-04-18T14:45:06.469135+0000","last_undegraded":"2024-04-18T14:45:06.469135+0000","last_fullsized":"2024-04-18T14:45:06.469135+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T14:44:38.516629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T14:43:20.303322+0000","last_clean_scrub_stamp":"2024-04-18T14:44:38.516629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T14:45:46.715258+0000","scrub_duration":0.0039045249999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2],"acting":[8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":102,"reported_epoch":124,"state":"active+clean","last_fresh":"2024-04-18T14:45:06.548847+0000","last_change":"2024-04-18T14:44:59.929678+0000","last_active":"2024-04-18T14:45:06.548847+0000","last_peered":"2024-04-18T14:45:06.548847+0000","last_clean":"2024-04-18T14:45:06.548847+0000","last_became_active":"2024-04-18T14:44:59.929195+0000","last_became_peered":"2024-04-18T14:44:59.929195+0000","last_unstale":"2024-04-18T14:45:06.548847+0000","last_undegraded":"2024-04-18T14:45:06.548847+0000","last_fullsized":"2024-04-18T14:45:06.548847+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T14:44:36.901318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T14:43:20.303322+0000","last_clean_scrub_stamp":"2024-04-18T14:44:36.901318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T14:45:49.599440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[14,0],"acting":[14,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":14,"acting_primary":14,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":114,"reported_epoch":124,"state":"active+clean","last_fresh":"2024-04-18T14:45:06.548333+0000","last_change":"2024-04-18T14:44:22.508764+0000","last_active":"2024-04-18T14:45:06.548333+0000","last_peered":"2024-04-18T14:45:06.548333+0000","last_clean":"2024-04-18T14:45:06.548333+0000","last_became_active":"2024-04-18T14:43:21.328185+0000","last_became_peered":"2024-04-18T14:43:21.328185+0000","last_unstale":"2024-04-18T14:45:06.548333+0000","last_undegraded":"2024-04-18T14:45:06.548333+0000","last_fullsized":"2024-04-18T14:45:06.548333+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T14:44:22.508567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T14:43:20.303322+0000","last_clean_scrub_stamp":"2024-04-18T14:44:22.508567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T14:45:46.236519+0000","scrub_duration":0.0031913549999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[15,13],"acting":[15,13],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":15,"acting_primary":15,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":11},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1064960,"data_stored":1057856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":13,"up_from":24,"seq":103079215130,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33476,"kb_used_data":2356,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94338364,"statfs":{"total":96636764160,"available":96602484736,"internally_reserved":0,"allocated":2412544,"data_stored":1617083,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,2,3,4,5,7,11,12,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Apr 18 14:44:21 2024","interfaces":[{"interface":"back","average":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"min":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":1.792,"5min":1.792,"15min":1.792},"last":0.67100000000000004},{"interface":"front","average":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"min":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":2.0600000000000001,"5min":2.0600000000000001,"15min":2.0600000000000001},"last":0.71299999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84099999999999997}]},{"osd":2,"last update":"Thu Apr 18 14:44:21 2024","interfaces":[{"interface":"back","average":{"1min":1.0389999999999999,"5min":1.0389999999999999,"15min":1.0389999999999999},"min":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"max":{"1min":1.974,"5min":1.974,"15min":1.974},"last":0.98599999999999999},{"interface":"front","average":{"1min":1,"5min":1,"15min":1},"min":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.9910000000000001,"5min":1.9910000000000001,"15min":1.9910000000000001},"last":0.79200000000000004}]},{"osd":3,"last update":"Thu Apr 18 14:44:21 2024","interfaces":[{"interface":"back","average":{"1min":0.91500000000000004,"5min":0.91500000000000004,"15min":0.91500000000000004},"min":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"max":{"1min":1.2110000000000001,"5min":1.2110000000000001,"15min":1.2110000000000001},"last":1.0369999999999999},{"interface":"front","average":{"1min":1.0489999999999999,"5min":1.0489999999999999,"15min":1.0489999999999999},"min":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":1.4430000000000001,"5min":1.4430000000000001,"15min":1.4430000000000001},"last":1.113}]},{"osd":4,"last update":"Thu Apr 18 14:44:21 2024","interfaces":[{"interface":"back","average":{"1min":0.98099999999999998,"5min":0.98099999999999998,"15min":0.98099999999999998},"min":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.3919999999999999,"5min":1.3919999999999999,"15min":1.3919999999999999},"last":0.878},{"interface":"front","average":{"1min":0.90100000000000002,"5min":0.90100000000000002,"15min":0.90100000000000002},"min":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":1.306,"5min":1.306,"15min":1.306},"last":1.1559999999999999}]},{"osd":5,"last update":"Thu Apr 18 14:44:21 2024","interfaces":[{"interface":"back","average":{"1min":0.96399999999999997,"5min":0.96399999999999997,"15min":0.96399999999999997},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":1.5860000000000001,"5min":1.5860000000000001,"15min":1.5860000000000001},"last":0.95699999999999996},{"interface":"front","average":{"1min":1.0780000000000001,"5min":1.0780000000000001,"15min":1.0780000000000001},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.536,"5min":1.536,"15min":1.536},"last":0.93200000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1950000000000001}]},{"osd":7,"last update":"Thu Apr 18 14:44:32 2024","interfaces":[{"interface":"back","average":{"1min":1.1639999999999999,"5min":1.1639999999999999,"15min":1.1639999999999999},"min":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":2.4359999999999999,"5min":2.4359999999999999,"15min":2.4359999999999999},"last":1.079},{"interface":"front","average":{"1min":1.206,"5min":1.206,"15min":1.206},"min":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"max":{"1min":3.532,"5min":3.532,"15min":3.532},"last":1.177}]},{"osd":11,"last update":"Thu Apr 18 14:44:32 2024","interfaces":[{"interface":"back","average":{"1min":1.2350000000000001,"5min":1.2350000000000001,"15min":1.2350000000000001},"min":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"max":{"1min":1.8069999999999999,"5min":1.8069999999999999,"15min":1.8069999999999999},"last":1.1399999999999999},{"interface":"front","average":{"1min":1.2809999999999999,"5min":1.2809999999999999,"15min":1.2809999999999999},"min":{"1min":0.84799999999999998,"5min":0.84799999999999998,"15min":0.84799999999999998},"max":{"1min":2.2669999999999999,"5min":2.2669999999999999,"15min":2.2669999999999999},"last":1.2190000000000001}]},{"osd":12,"last update":"Thu Apr 18 14:44:21 2024","interfaces":[{"interface":"back","average":{"1min":1.2709999999999999,"5min":1.2709999999999999,"15min":1.2709999999999999},"min":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"max":{"1min":1.911,"5min":1.911,"15min":1.911},"last":1.018},{"interface":"front","average":{"1min":1.3140000000000001,"5min":1.3140000000000001,"15min":1.3140000000000001},"min":{"1min":0.755,"5min":0.755,"15min":0.755},"max":{"1min":2.504,"5min":2.504,"15min":2.504},"last":1.2909999999999999}]},{"osd":14,"last update":"Thu Apr 18 14:44:21 2024","interfaces":[{"interface":"back","average":{"1min":1.2909999999999999,"5min":1.2909999999999999,"15min":1.2909999999999999},"min":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"max":{"1min":3.6240000000000001,"5min":3.6240000000000001,"15min":3.6240000000000001},"last":1.24},{"interface":"front","average":{"1min":1.357,"5min":1.357,"15min":1.357},"min":{"1min":0.627,"5min":0.627,"15min":0.627},"max":{"1min":2.1960000000000002,"5min":2.1960000000000002,"15min":2.1960000000000002},"last":1.2030000000000001}]},{"osd":15,"last update":"Thu Apr 18 14:44:21 2024","interfaces":[{"interface":"back","average":{"1min":1.3560000000000001,"5min":1.3560000000000001,"15min":1.3560000000000001},"min":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"max":{"1min":2.1080000000000001,"5min":2.1080000000000001,"15min":2.1080000000000001},"last":1.3600000000000001},{"interface":"front","average":{"1min":1.26,"5min":1.26,"15min":1.26},"min":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"max":{"1min":1.8380000000000001,"5min":1.8380000000000001,"15min":1.8380000000000001},"last":1.323}]}]},{"osd":9,"up_from":24,"seq":103079215131,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32956,"kb_used_data":1836,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94338884,"statfs":{"total":96636764160,"available":96603017216,"internally_reserved":0,"allocated":1880064,"data_stored":1088155,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1599,"internal_metadata":31848897},"hb_peers":[0,1,3,8,10,11,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Apr 18 14:44:20 2024","interfaces":[{"interface":"back","average":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":1.0429999999999999,"5min":1.0429999999999999,"15min":1.0429999999999999},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.95199999999999996,"5min":0.95199999999999996,"15min":0.95199999999999996},"min":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"max":{"1min":1.6559999999999999,"5min":1.6559999999999999,"15min":1.6559999999999999},"last":0.68500000000000005}]},{"osd":1,"last update":"Thu Apr 18 14:44:20 2024","interfaces":[{"interface":"back","average":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"min":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":1.3200000000000001,"5min":1.3200000000000001,"15min":1.3200000000000001},"last":0.80400000000000005},{"interface":"front","average":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.2509999999999999,"5min":1.2509999999999999,"15min":1.2509999999999999},"last":0.91600000000000004}]},{"osd":3,"last update":"Thu Apr 18 14:44:20 2024","interfaces":[{"interface":"back","average":{"1min":1.032,"5min":1.032,"15min":1.032},"min":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"max":{"1min":1.5980000000000001,"5min":1.5980000000000001,"15min":1.5980000000000001},"last":0.98799999999999999},{"interface":"front","average":{"1min":1.1539999999999999,"5min":1.1539999999999999,"15min":1.1539999999999999},"min":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"max":{"1min":1.722,"5min":1.722,"15min":1.722},"last":0.95899999999999996}]},{"osd":8,"last update":"Thu Apr 18 14:44:20 2024","interfaces":[{"interface":"back","average":{"1min":0.94899999999999995,"5min":0.94899999999999995,"15min":0.94899999999999995},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":1.6899999999999999,"5min":1.6899999999999999,"15min":1.6899999999999999},"last":0.75800000000000001},{"interface":"front","average":{"1min":1.3380000000000001,"5min":1.3380000000000001,"15min":1.3380000000000001},"min":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"max":{"1min":5.4989999999999997,"5min":5.4989999999999997,"15min":5.4989999999999997},"last":0.84499999999999997}]},{"osd":10,"last update":"Thu Apr 18 14:44:20 2024","interfaces":[{"interface":"back","average":{"1min":1.196,"5min":1.196,"15min":1.196},"min":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"max":{"1min":1.5429999999999999,"5min":1.5429999999999999,"15min":1.5429999999999999},"last":1.2849999999999999},{"interface":"front","average":{"1min":1.117,"5min":1.117,"15min":1.117},"min":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"max":{"1min":1.7689999999999999,"5min":1.7689999999999999,"15min":1.7689999999999999},"last":1.091}]},{"osd":11,"last update":"Thu Apr 18 14:44:20 2024","interfaces":[{"interface":"back","average":{"1min":1.1279999999999999,"5min":1.1279999999999999,"15min":1.1279999999999999},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.849,"5min":1.849,"15min":1.849},"last":1.0189999999999999},{"interface":"front","average":{"1min":1.2310000000000001,"5min":1.2310000000000001,"15min":1.2310000000000001},"min":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"max":{"1min":1.8109999999999999,"5min":1.8109999999999999,"15min":1.8109999999999999},"last":1.119}]},{"osd":12,"last update":"Thu Apr 18 14:44:20 2024","interfaces":[{"interface":"back","average":{"1min":1.2989999999999999,"5min":1.2989999999999999,"15min":1.2989999999999999},"min":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"max":{"1min":2.1560000000000001,"5min":2.1560000000000001,"15min":2.1560000000000001},"last":0.88100000000000001},{"interface":"front","average":{"1min":1.29,"5min":1.29,"15min":1.29},"min":{"1min":0.748,"5min":0.748,"15min":0.748},"max":{"1min":2.6930000000000001,"5min":2.6930000000000001,"15min":2.6930000000000001},"last":1.1539999999999999}]},{"osd":13,"last update":"Thu Apr 18 14:44:20 2024","interfaces":[{"interface":"back","average":{"1min":1.4079999999999999,"5min":1.4079999999999999,"15min":1.4079999999999999},"min":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"max":{"1min":2.6030000000000002,"5min":2.6030000000000002,"15min":2.6030000000000002},"last":1.0580000000000001},{"interface":"front","average":{"1min":1.4710000000000001,"5min":1.4710000000000001,"15min":1.4710000000000001},"min":{"1min":0.92100000000000004,"5min":0.92100000000000004,"15min":0.92100000000000004},"max":{"1min":2.472,"5min":2.472,"15min":2.472},"last":1.179}]},{"osd":14,"last update":"Thu Apr 18 14:44:20 2024","interfaces":[{"interface":"back","average":{"1min":1.456,"5min":1.456,"15min":1.456},"min":{"1min":0.88400000000000001,"5min":0.88400000000000001,"15min":0.88400000000000001},"max":{"1min":2.3180000000000001,"5min":2.3180000000000001,"15min":2.3180000000000001},"last":1.26},{"interface":"front","average":{"1min":1.5389999999999999,"5min":1.5389999999999999,"15min":1.5389999999999999},"min":{"1min":1.016,"5min":1.016,"15min":1.016},"max":{"1min":2.6549999999999998,"5min":2.6549999999999998,"15min":2.6549999999999998},"last":1.204}]},{"osd":15,"last update":"Thu Apr 18 14:44:20 2024","interfaces":[{"interface":"back","average":{"1min":1.4119999999999999,"5min":1.4119999999999999,"15min":1.4119999999999999},"min":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"max":{"1min":2.7789999999999999,"5min":2.7789999999999999,"15min":2.7789999999999999},"last":1.2310000000000001},{"interface":"front","average":{"1min":1.4359999999999999,"5min":1.4359999999999999,"15min":1.4359999999999999},"min":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"max":{"1min":1.923,"5min":1.923,"15min":1.923},"last":1.3080000000000001}]}]},{"osd":5,"up_from":24,"seq":103079215132,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32956,"kb_used_data":1836,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94338884,"statfs":{"total":96636764160,"available":96603017216,"internally_reserved":0,"allocated":1880064,"data_stored":1088155,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,3,4,6,10,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Apr 18 14:44:31 2024","interfaces":[{"interface":"back","average":{"1min":0.90900000000000003,"5min":0.90900000000000003,"15min":0.90900000000000003},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.339,"5min":1.339,"15min":1.339},"last":1.083},{"interface":"front","average":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":1.175,"5min":1.175,"15min":1.175},"last":0.78900000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67600000000000005}]},{"osd":3,"last update":"Thu Apr 18 14:44:24 2024","interfaces":[{"interface":"back","average":{"1min":1.024,"5min":1.024,"15min":1.024},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":1.4650000000000001,"5min":1.4650000000000001,"15min":1.4650000000000001},"last":1.26},{"interface":"front","average":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":0.94999999999999996},"min":{"1min":0.621,"5min":0.621,"15min":0.621},"max":{"1min":1.8460000000000001,"5min":1.8460000000000001,"15min":1.8460000000000001},"last":0.81200000000000006}]},{"osd":4,"last update":"Thu Apr 18 14:44:24 2024","interfaces":[{"interface":"back","average":{"1min":0.89400000000000002,"5min":0.89400000000000002,"15min":0.89400000000000002},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":1.968,"5min":1.968,"15min":1.968},"last":0.88700000000000001},{"interface":"front","average":{"1min":1.016,"5min":1.016,"15min":1.016},"min":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"max":{"1min":1.819,"5min":1.819,"15min":1.819},"last":1.1679999999999999}]},{"osd":6,"last update":"Thu Apr 18 14:44:24 2024","interfaces":[{"interface":"back","average":{"1min":1.0629999999999999,"5min":1.0629999999999999,"15min":1.0629999999999999},"min":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"max":{"1min":2.0760000000000001,"5min":2.0760000000000001,"15min":2.0760000000000001},"last":0.94799999999999995},{"interface":"front","average":{"1min":1.101,"5min":1.101,"15min":1.101},"min":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"max":{"1min":1.694,"5min":1.694,"15min":1.694},"last":0.97999999999999998}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2330000000000001}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96599999999999997}]},{"osd":10,"last update":"Thu Apr 18 14:44:24 2024","interfaces":[{"interface":"back","average":{"1min":1.232,"5min":1.232,"15min":1.232},"min":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"max":{"1min":2.2709999999999999,"5min":2.2709999999999999,"15min":2.2709999999999999},"last":1.3360000000000001},{"interface":"front","average":{"1min":1.2569999999999999,"5min":1.2569999999999999,"15min":1.2569999999999999},"min":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"max":{"1min":2.4470000000000001,"5min":2.4470000000000001,"15min":2.4470000000000001},"last":1.03}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.256}]},{"osd":12,"last update":"Thu Apr 18 14:44:24 2024","interfaces":[{"interface":"back","average":{"1min":1.1140000000000001,"5min":1.1140000000000001,"15min":1.1140000000000001},"min":{"1min":0.625,"5min":0.625,"15min":0.625},"max":{"1min":1.728,"5min":1.728,"15min":1.728},"last":0.83899999999999997},{"interface":"front","average":{"1min":1.339,"5min":1.339,"15min":1.339},"min":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"max":{"1min":2.008,"5min":2.008,"15min":2.008},"last":1.4059999999999999}]},{"osd":13,"last update":"Thu Apr 18 14:44:24 2024","interfaces":[{"interface":"back","average":{"1min":1.355,"5min":1.355,"15min":1.355},"min":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":2.5070000000000001,"5min":2.5070000000000001,"15min":2.5070000000000001},"last":1.478},{"interface":"front","average":{"1min":1.2949999999999999,"5min":1.2949999999999999,"15min":1.2949999999999999},"min":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":2.992,"5min":2.992,"15min":2.992},"last":1.1299999999999999}]},{"osd":14,"last update":"Thu Apr 18 14:44:31 2024","interfaces":[{"interface":"back","average":{"1min":1.401,"5min":1.401,"15min":1.401},"min":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.85099999999999998},"max":{"1min":2.1190000000000002,"5min":2.1190000000000002,"15min":2.1190000000000002},"last":1.5469999999999999},{"interface":"front","average":{"1min":1.2629999999999999,"5min":1.2629999999999999,"15min":1.2629999999999999},"min":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"max":{"1min":2.496,"5min":2.496,"15min":2.496},"last":1.1919999999999999}]},{"osd":15,"last update":"Thu Apr 18 14:44:24 2024","interfaces":[{"interface":"back","average":{"1min":1.486,"5min":1.486,"15min":1.486},"min":{"1min":0.879,"5min":0.879,"15min":0.879},"max":{"1min":2.415,"5min":2.415,"15min":2.415},"last":1.615},{"interface":"front","average":{"1min":1.4470000000000001,"5min":1.4470000000000001,"15min":1.4470000000000001},"min":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"max":{"1min":2.7799999999999998,"5min":2.7799999999999998,"15min":2.7799999999999998},"last":1.236}]}]},{"osd":14,"up_from":21,"seq":90194313243,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51008,"kb_used_data":1836,"kb_used_omap":1,"kb_used_meta":49150,"kb_avail":94320832,"statfs":{"total":96636764160,"available":96584531968,"internally_reserved":0,"allocated":1880064,"data_stored":1088155,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":50330054},"hb_peers":[0,4,5,6,7,8,9,11,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Apr 18 14:44:21 2024","interfaces":[{"interface":"back","average":{"1min":0.96899999999999997,"5min":0.96899999999999997,"15min":0.96899999999999997},"min":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"max":{"1min":1.454,"5min":1.454,"15min":1.454},"last":0.83999999999999997},{"interface":"front","average":{"1min":1.0660000000000001,"5min":1.0660000000000001,"15min":1.0660000000000001},"min":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"max":{"1min":1.9390000000000001,"5min":1.9390000000000001,"15min":1.9390000000000001},"last":1.0940000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.472}]},{"osd":2,"last update":"Thu Apr 18 14:44:31 2024","interfaces":[{"interface":"back","average":{"1min":0.89500000000000002,"5min":0.89500000000000002,"15min":0.89500000000000002},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":1.468,"5min":1.468,"15min":1.468},"last":0.64400000000000002},{"interface":"front","average":{"1min":1.131,"5min":1.131,"15min":1.131},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.8540000000000001,"5min":1.8540000000000001,"15min":1.8540000000000001},"last":1.032}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94499999999999995}]},{"osd":4,"last update":"Thu Apr 18 14:44:20 2024","interfaces":[{"interface":"back","average":{"1min":0.95099999999999996,"5min":0.95099999999999996,"15min":0.95099999999999996},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.296,"5min":1.296,"15min":1.296},"last":0.69499999999999995},{"interface":"front","average":{"1min":0.97599999999999998,"5min":0.97599999999999998,"15min":0.97599999999999998},"min":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"max":{"1min":1.5129999999999999,"5min":1.5129999999999999,"15min":1.5129999999999999},"last":0.74099999999999999}]},{"osd":5,"last update":"Thu Apr 18 14:44:20 2024","interfaces":[{"interface":"back","average":{"1min":1.218,"5min":1.218,"15min":1.218},"min":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"max":{"1min":2.1269999999999998,"5min":2.1269999999999998,"15min":2.1269999999999998},"last":1.1910000000000001},{"interface":"front","average":{"1min":1.1679999999999999,"5min":1.1679999999999999,"15min":1.1679999999999999},"min":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"max":{"1min":1.5920000000000001,"5min":1.5920000000000001,"15min":1.5920000000000001},"last":0.95299999999999996}]},{"osd":6,"last update":"Thu Apr 18 14:44:20 2024","interfaces":[{"interface":"back","average":{"1min":0.94699999999999995,"5min":0.94699999999999995,"15min":0.94699999999999995},"min":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"max":{"1min":1.3160000000000001,"5min":1.3160000000000001,"15min":1.3160000000000001},"last":1.0509999999999999},{"interface":"front","average":{"1min":1.163,"5min":1.163,"15min":1.163},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":1.7689999999999999,"5min":1.7689999999999999,"15min":1.7689999999999999},"last":0.875}]},{"osd":7,"last update":"Thu Apr 18 14:44:20 2024","interfaces":[{"interface":"back","average":{"1min":1.234,"5min":1.234,"15min":1.234},"min":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"max":{"1min":1.7529999999999999,"5min":1.7529999999999999,"15min":1.7529999999999999},"last":1.018},{"interface":"front","average":{"1min":1.1759999999999999,"5min":1.1759999999999999,"15min":1.1759999999999999},"min":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"max":{"1min":1.587,"5min":1.587,"15min":1.587},"last":0.90900000000000003}]},{"osd":8,"last update":"Thu Apr 18 14:44:20 2024","interfaces":[{"interface":"back","average":{"1min":1.292,"5min":1.292,"15min":1.292},"min":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"max":{"1min":2.0569999999999999,"5min":2.0569999999999999,"15min":2.0569999999999999},"last":1.3720000000000001},{"interface":"front","average":{"1min":1.2509999999999999,"5min":1.2509999999999999,"15min":1.2509999999999999},"min":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"max":{"1min":1.8740000000000001,"5min":1.8740000000000001,"15min":1.8740000000000001},"last":1.0740000000000001}]},{"osd":9,"last update":"Thu Apr 18 14:44:31 2024","interfaces":[{"interface":"back","average":{"1min":1.4590000000000001,"5min":1.4590000000000001,"15min":1.4590000000000001},"min":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"max":{"1min":2.1899999999999999,"5min":2.1899999999999999,"15min":2.1899999999999999},"last":1.4550000000000001},{"interface":"front","average":{"1min":1.3999999999999999,"5min":1.3999999999999999,"15min":1.3999999999999999},"min":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"max":{"1min":1.9930000000000001,"5min":1.9930000000000001,"15min":1.9930000000000001},"last":1.163}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4219999999999999}]},{"osd":11,"last update":"Thu Apr 18 14:44:31 2024","interfaces":[{"interface":"back","average":{"1min":1.4319999999999999,"5min":1.4319999999999999,"15min":1.4319999999999999},"min":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"max":{"1min":2.0059999999999998,"5min":2.0059999999999998,"15min":2.0059999999999998},"last":1.1279999999999999},{"interface":"front","average":{"1min":1.3640000000000001,"5min":1.3640000000000001,"15min":1.3640000000000001},"min":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"max":{"1min":1.903,"5min":1.903,"15min":1.903},"last":1.5349999999999999}]},{"osd":12,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.016}]},{"osd":13,"last update":"Thu Apr 18 14:44:20 2024","interfaces":[{"interface":"back","average":{"1min":1.464,"5min":1.464,"15min":1.464},"min":{"1min":0.86799999999999999,"5min":0.86799999999999999,"15min":0.86799999999999999},"max":{"1min":1.8620000000000001,"5min":1.8620000000000001,"15min":1.8620000000000001},"last":1.2410000000000001},{"interface":"front","average":{"1min":1.5349999999999999,"5min":1.5349999999999999,"15min":1.5349999999999999},"min":{"1min":0.94299999999999995,"5min":0.94299999999999995,"15min":0.94299999999999995},"max":{"1min":2.452,"5min":2.452,"15min":2.452},"last":1.5780000000000001}]},{"osd":15,"last update":"Thu Apr 18 14:44:20 2024","interfaces":[{"interface":"back","average":{"1min":1.5129999999999999,"5min":1.5129999999999999,"15min":1.5129999999999999},"min":{"1min":0.95699999999999996,"5min":0.95699999999999996,"15min":0.95699999999999996},"max":{"1min":2.2549999999999999,"5min":2.2549999999999999,"15min":2.2549999999999999},"last":1.2170000000000001},{"interface":"front","average":{"1min":1.476,"5min":1.476,"15min":1.476},"min":{"1min":0.89800000000000002,"5min":0.89800000000000002,"15min":0.89800000000000002},"max":{"1min":1.9550000000000001,"5min":1.9550000000000001,"15min":1.9550000000000001},"last":1.4910000000000001}]}]},{"osd":1,"up_from":24,"seq":103079215132,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32952,"kb_used_data":1832,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94338888,"statfs":{"total":96636764160,"available":96603021312,"internally_reserved":0,"allocated":1875968,"data_stored":1087311,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,2,3,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Apr 18 14:44:25 2024","interfaces":[{"interface":"back","average":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":1.165,"5min":1.165,"15min":1.165},"last":1.1519999999999999},{"interface":"front","average":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"min":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":1.292,"5min":1.292,"15min":1.292},"last":0.92700000000000005}]},{"osd":2,"last update":"Thu Apr 18 14:44:25 2024","interfaces":[{"interface":"back","average":{"1min":0.93899999999999995,"5min":0.93899999999999995,"15min":0.93899999999999995},"min":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"max":{"1min":1.3180000000000001,"5min":1.3180000000000001,"15min":1.3180000000000001},"last":1.0960000000000001},{"interface":"front","average":{"1min":0.95199999999999996,"5min":0.95199999999999996,"15min":0.95199999999999996},"min":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":1.345,"5min":1.345,"15min":1.345},"last":0.98099999999999998}]},{"osd":3,"last update":"Thu Apr 18 14:44:25 2024","interfaces":[{"interface":"back","average":{"1min":1.0760000000000001,"5min":1.0760000000000001,"15min":1.0760000000000001},"min":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":1.486,"5min":1.486,"15min":1.486},"last":1.526},{"interface":"front","average":{"1min":1.1679999999999999,"5min":1.1679999999999999,"15min":1.1679999999999999},"min":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"max":{"1min":1.7789999999999999,"5min":1.7789999999999999,"15min":1.7789999999999999},"last":1.1719999999999999}]},{"osd":4,"last update":"Thu Apr 18 14:44:25 2024","interfaces":[{"interface":"back","average":{"1min":0.98299999999999998,"5min":0.98299999999999998,"15min":0.98299999999999998},"min":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"max":{"1min":1.728,"5min":1.728,"15min":1.728},"last":1.1950000000000001},{"interface":"front","average":{"1min":0.93700000000000006,"5min":0.93700000000000006,"15min":0.93700000000000006},"min":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"max":{"1min":1.6950000000000001,"5min":1.6950000000000001,"15min":1.6950000000000001},"last":1.248}]},{"osd":5,"last update":"Thu Apr 18 14:44:25 2024","interfaces":[{"interface":"back","average":{"1min":1.0089999999999999,"5min":1.0089999999999999,"15min":1.0089999999999999},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":1.819,"5min":1.819,"15min":1.819},"last":0.80900000000000005},{"interface":"front","average":{"1min":1.083,"5min":1.083,"15min":1.083},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":1.841,"5min":1.841,"15min":1.841},"last":1.034}]},{"osd":6,"last update":"Thu Apr 18 14:44:25 2024","interfaces":[{"interface":"back","average":{"1min":1.2529999999999999,"5min":1.2529999999999999,"15min":1.2529999999999999},"min":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"max":{"1min":2.3639999999999999,"5min":2.3639999999999999,"15min":2.3639999999999999},"last":1.0720000000000001},{"interface":"front","average":{"1min":1.1839999999999999,"5min":1.1839999999999999,"15min":1.1839999999999999},"min":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"max":{"1min":1.9419999999999999,"5min":1.9419999999999999,"15min":1.9419999999999999},"last":1.1220000000000001}]},{"osd":7,"last update":"Thu Apr 18 14:44:25 2024","interfaces":[{"interface":"back","average":{"1min":1.2050000000000001,"5min":1.2050000000000001,"15min":1.2050000000000001},"min":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"max":{"1min":1.96,"5min":1.96,"15min":1.96},"last":0.86499999999999999},{"interface":"front","average":{"1min":1.2509999999999999,"5min":1.2509999999999999,"15min":1.2509999999999999},"min":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"max":{"1min":2.4399999999999999,"5min":2.4399999999999999,"15min":2.4399999999999999},"last":1.218}]},{"osd":8,"last update":"Thu Apr 18 14:44:25 2024","interfaces":[{"interface":"back","average":{"1min":1.2330000000000001,"5min":1.2330000000000001,"15min":1.2330000000000001},"min":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"max":{"1min":1.881,"5min":1.881,"15min":1.881},"last":1.3080000000000001},{"interface":"front","average":{"1min":1.26,"5min":1.26,"15min":1.26},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":2.5169999999999999,"5min":2.5169999999999999,"15min":2.5169999999999999},"last":1.3680000000000001}]},{"osd":9,"last update":"Thu Apr 18 14:44:25 2024","interfaces":[{"interface":"back","average":{"1min":1.3280000000000001,"5min":1.3280000000000001,"15min":1.3280000000000001},"min":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":2.4780000000000002,"5min":2.4780000000000002,"15min":2.4780000000000002},"last":1.706},{"interface":"front","average":{"1min":1.3129999999999999,"5min":1.3129999999999999,"15min":1.3129999999999999},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":2.161,"5min":2.161,"15min":2.161},"last":1.3919999999999999}]},{"osd":10,"last update":"Thu Apr 18 14:44:25 2024","interfaces":[{"interface":"back","average":{"1min":1.407,"5min":1.407,"15min":1.407},"min":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"max":{"1min":2.625,"5min":2.625,"15min":2.625},"last":1.4370000000000001},{"interface":"front","average":{"1min":1.446,"5min":1.446,"15min":1.446},"min":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"max":{"1min":2.5529999999999999,"5min":2.5529999999999999,"15min":2.5529999999999999},"last":1.7829999999999999}]}]},{"osd":2,"up_from":22,"seq":94489280539,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28840,"kb_used_data":1820,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343000,"statfs":{"total":96636764160,"available":96607232000,"internally_reserved":0,"allocated":1863680,"data_stored":1078641,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,3,5,6,7,8,10,11,12,14],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Apr 18 14:44:22 2024","interfaces":[{"interface":"back","average":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"min":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"max":{"1min":1.175,"5min":1.175,"15min":1.175},"last":1.2210000000000001},{"interface":"front","average":{"1min":0.90900000000000003,"5min":0.90900000000000003,"15min":0.90900000000000003},"min":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"max":{"1min":1.3740000000000001,"5min":1.3740000000000001,"15min":1.3740000000000001},"last":1.47}]},{"osd":3,"last update":"Thu Apr 18 14:44:22 2024","interfaces":[{"interface":"back","average":{"1min":1.0409999999999999,"5min":1.0409999999999999,"15min":1.0409999999999999},"min":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"max":{"1min":1.6830000000000001,"5min":1.6830000000000001,"15min":1.6830000000000001},"last":1.0740000000000001},{"interface":"front","average":{"1min":1.0700000000000001,"5min":1.0700000000000001,"15min":1.0700000000000001},"min":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"max":{"1min":1.8839999999999999,"5min":1.8839999999999999,"15min":1.8839999999999999},"last":1.3080000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96699999999999997}]},{"osd":5,"last update":"Thu Apr 18 14:44:22 2024","interfaces":[{"interface":"back","average":{"1min":0.98799999999999999,"5min":0.98799999999999999,"15min":0.98799999999999999},"min":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"max":{"1min":1.5469999999999999,"5min":1.5469999999999999,"15min":1.5469999999999999},"last":0.63100000000000001},{"interface":"front","average":{"1min":0.92500000000000004,"5min":0.92500000000000004,"15min":0.92500000000000004},"min":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":1.333,"5min":1.333,"15min":1.333},"last":1.359}]},{"osd":6,"last update":"Thu Apr 18 14:44:19 2024","interfaces":[{"interface":"back","average":{"1min":1.115,"5min":1.115,"15min":1.115},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":2.0529999999999999,"5min":2.0529999999999999,"15min":2.0529999999999999},"last":1.26},{"interface":"front","average":{"1min":1.089,"5min":1.089,"15min":1.089},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.8069999999999999,"5min":1.8069999999999999,"15min":1.8069999999999999},"last":1.155}]},{"osd":7,"last update":"Thu Apr 18 14:44:22 2024","interfaces":[{"interface":"back","average":{"1min":1.165,"5min":1.165,"15min":1.165},"min":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"max":{"1min":2.012,"5min":2.012,"15min":2.012},"last":0.97299999999999998},{"interface":"front","average":{"1min":1.2949999999999999,"5min":1.2949999999999999,"15min":1.2949999999999999},"min":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"max":{"1min":2.1419999999999999,"5min":2.1419999999999999,"15min":2.1419999999999999},"last":1.0229999999999999}]},{"osd":8,"last update":"Thu Apr 18 14:44:22 2024","interfaces":[{"interface":"back","average":{"1min":1.224,"5min":1.224,"15min":1.224},"min":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"max":{"1min":1.988,"5min":1.988,"15min":1.988},"last":1.55},{"interface":"front","average":{"1min":1.3120000000000001,"5min":1.3120000000000001,"15min":1.3120000000000001},"min":{"1min":0.84999999999999998,"5min":0.84999999999999998,"15min":0.84999999999999998},"max":{"1min":2.2240000000000002,"5min":2.2240000000000002,"15min":2.2240000000000002},"last":1.657}]},{"osd":10,"last update":"Thu Apr 18 14:44:19 2024","interfaces":[{"interface":"back","average":{"1min":1.365,"5min":1.365,"15min":1.365},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":2.319,"5min":2.319,"15min":2.319},"last":2.8170000000000002},{"interface":"front","average":{"1min":1.3879999999999999,"5min":1.3879999999999999,"15min":1.3879999999999999},"min":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"max":{"1min":2.27,"5min":2.27,"15min":2.27},"last":3.0110000000000001}]},{"osd":11,"last update":"Thu Apr 18 14:44:19 2024","interfaces":[{"interface":"back","average":{"1min":1.49,"5min":1.49,"15min":1.49},"min":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"max":{"1min":2.4950000000000001,"5min":2.4950000000000001,"15min":2.4950000000000001},"last":1.78},{"interface":"front","average":{"1min":1.4590000000000001,"5min":1.4590000000000001,"15min":1.4590000000000001},"min":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"max":{"1min":2.411,"5min":2.411,"15min":2.411},"last":1.736}]},{"osd":12,"last update":"Thu Apr 18 14:44:19 2024","interfaces":[{"interface":"back","average":{"1min":1.4910000000000001,"5min":1.4910000000000001,"15min":1.4910000000000001},"min":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":0.88500000000000001},"max":{"1min":2.2669999999999999,"5min":2.2669999999999999,"15min":2.2669999999999999},"last":1.8220000000000001},{"interface":"front","average":{"1min":1.514,"5min":1.514,"15min":1.514},"min":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"max":{"1min":2.3719999999999999,"5min":2.3719999999999999,"15min":2.3719999999999999},"last":1.861}]},{"osd":14,"last update":"Thu Apr 18 14:44:19 2024","interfaces":[{"interface":"back","average":{"1min":1.4390000000000001,"5min":1.4390000000000001,"15min":1.4390000000000001},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":2.3050000000000002,"5min":2.3050000000000002,"15min":2.3050000000000002},"last":1.9770000000000001},{"interface":"front","average":{"1min":1.5069999999999999,"5min":1.5069999999999999,"15min":1.5069999999999999},"min":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":2.4020000000000001,"5min":2.4020000000000001,"15min":2.4020000000000001},"last":1.9350000000000001}]}]},{"osd":15,"up_from":23,"seq":98784247836,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32952,"kb_used_data":1832,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94338888,"statfs":{"total":96636764160,"available":96603021312,"internally_reserved":0,"allocated":1875968,"data_stored":1087311,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31848903},"hb_peers":[0,4,5,6,7,8,10,11,13,14],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Apr 18 14:44:19 2024","interfaces":[{"interface":"back","average":{"1min":0.94699999999999995,"5min":0.94699999999999995,"15min":0.94699999999999995},"min":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"max":{"1min":1.405,"5min":1.405,"15min":1.405},"last":0.997},{"interface":"front","average":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"min":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":1.0569999999999999,"5min":1.0569999999999999,"15min":1.0569999999999999},"last":0.63200000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2050000000000001}]},{"osd":4,"last update":"Thu Apr 18 14:44:19 2024","interfaces":[{"interface":"back","average":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.85099999999999998},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.2669999999999999,"5min":1.2669999999999999,"15min":1.2669999999999999},"last":0.73499999999999999},{"interface":"front","average":{"1min":0.877,"5min":0.877,"15min":0.877},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.2410000000000001,"5min":1.2410000000000001,"15min":1.2410000000000001},"last":0.87}]},{"osd":5,"last update":"Thu Apr 18 14:44:22 2024","interfaces":[{"interface":"back","average":{"1min":1.0209999999999999,"5min":1.0209999999999999,"15min":1.0209999999999999},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":2.0579999999999998,"5min":2.0579999999999998,"15min":2.0579999999999998},"last":0.93400000000000005},{"interface":"front","average":{"1min":1.089,"5min":1.089,"15min":1.089},"min":{"1min":0.75,"5min":0.75,"15min":0.75},"max":{"1min":1.9259999999999999,"5min":1.9259999999999999,"15min":1.9259999999999999},"last":1.1339999999999999}]},{"osd":6,"last update":"Thu Apr 18 14:44:19 2024","interfaces":[{"interface":"back","average":{"1min":1.1379999999999999,"5min":1.1379999999999999,"15min":1.1379999999999999},"min":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"max":{"1min":1.8680000000000001,"5min":1.8680000000000001,"15min":1.8680000000000001},"last":1.034},{"interface":"front","average":{"1min":1.228,"5min":1.228,"15min":1.228},"min":{"1min":0.86499999999999999,"5min":0.86499999999999999,"15min":0.86499999999999999},"max":{"1min":1.79,"5min":1.79,"15min":1.79},"last":1.429}]},{"osd":7,"last update":"Thu Apr 18 14:44:19 2024","interfaces":[{"interface":"back","average":{"1min":1.0549999999999999,"5min":1.0549999999999999,"15min":1.0549999999999999},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":1.488,"5min":1.488,"15min":1.488},"last":1.504},{"interface":"front","average":{"1min":1.1830000000000001,"5min":1.1830000000000001,"15min":1.1830000000000001},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":1.976,"5min":1.976,"15min":1.976},"last":1.1859999999999999}]},{"osd":8,"last update":"Thu Apr 18 14:44:19 2024","interfaces":[{"interface":"back","average":{"1min":1.1879999999999999,"5min":1.1879999999999999,"15min":1.1879999999999999},"min":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"max":{"1min":2.004,"5min":2.004,"15min":2.004},"last":1.2370000000000001},{"interface":"front","average":{"1min":1.222,"5min":1.222,"15min":1.222},"min":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"max":{"1min":1.786,"5min":1.786,"15min":1.786},"last":1.381}]},{"osd":10,"last update":"Thu Apr 18 14:44:19 2024","interfaces":[{"interface":"back","average":{"1min":1.3360000000000001,"5min":1.3360000000000001,"15min":1.3360000000000001},"min":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"max":{"1min":2.403,"5min":2.403,"15min":2.403},"last":1.4710000000000001},{"interface":"front","average":{"1min":1.331,"5min":1.331,"15min":1.331},"min":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"max":{"1min":2.2549999999999999,"5min":2.2549999999999999,"15min":2.2549999999999999},"last":1.6459999999999999}]},{"osd":11,"last update":"Thu Apr 18 14:44:19 2024","interfaces":[{"interface":"back","average":{"1min":1.399,"5min":1.399,"15min":1.399},"min":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"max":{"1min":2.2109999999999999,"5min":2.2109999999999999,"15min":2.2109999999999999},"last":1.6990000000000001},{"interface":"front","average":{"1min":1.4490000000000001,"5min":1.4490000000000001,"15min":1.4490000000000001},"min":{"1min":0.629,"5min":0.629,"15min":0.629},"max":{"1min":2.1589999999999998,"5min":2.1589999999999998,"15min":2.1589999999999998},"last":1.3109999999999999}]},{"osd":13,"last update":"Thu Apr 18 14:44:22 2024","interfaces":[{"interface":"back","average":{"1min":1.391,"5min":1.391,"15min":1.391},"min":{"1min":1.0109999999999999,"5min":1.0109999999999999,"15min":1.0109999999999999},"max":{"1min":1.9419999999999999,"5min":1.9419999999999999,"15min":1.9419999999999999},"last":1.748},{"interface":"front","average":{"1min":1.387,"5min":1.387,"15min":1.387},"min":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"max":{"1min":1.8959999999999999,"5min":1.8959999999999999,"15min":1.8959999999999999},"last":1.8720000000000001}]},{"osd":14,"last update":"Thu Apr 18 14:44:19 2024","interfaces":[{"interface":"back","average":{"1min":1.4279999999999999,"5min":1.4279999999999999,"15min":1.4279999999999999},"min":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"max":{"1min":2.351,"5min":2.351,"15min":2.351},"last":1.611},{"interface":"front","average":{"1min":1.454,"5min":1.454,"15min":1.454},"min":{"1min":0.84299999999999997,"5min":0.84299999999999997,"15min":0.84299999999999997},"max":{"1min":2.766,"5min":2.766,"15min":2.766},"last":1.782}]}]},{"osd":4,"up_from":22,"seq":94489280538,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":51000,"kb_used_data":1832,"kb_used_omap":1,"kb_used_meta":49150,"kb_avail":94320840,"statfs":{"total":96636764160,"available":96584540160,"internally_reserved":0,"allocated":1875968,"data_stored":1087311,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":50330054},"hb_peers":[2,3,5,6,10,11,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":2,"last update":"Thu Apr 18 14:44:20 2024","interfaces":[{"interface":"back","average":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":1.2330000000000001,"5min":1.2330000000000001,"15min":1.2330000000000001},"last":1.171},{"interface":"front","average":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":1.306,"5min":1.306,"15min":1.306},"last":1.21}]},{"osd":3,"last update":"Thu Apr 18 14:44:20 2024","interfaces":[{"interface":"back","average":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":1.1499999999999999,"5min":1.1499999999999999,"15min":1.1499999999999999},"last":0.92900000000000005},{"interface":"front","average":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":1.0169999999999999,"5min":1.0169999999999999,"15min":1.0169999999999999},"last":1.054}]},{"osd":5,"last update":"Thu Apr 18 14:44:20 2024","interfaces":[{"interface":"back","average":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":1.0609999999999999,"5min":1.0609999999999999,"15min":1.0609999999999999},"last":0.99399999999999999},{"interface":"front","average":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":1.2190000000000001,"5min":1.2190000000000001,"15min":1.2190000000000001},"last":1.135}]},{"osd":6,"last update":"Thu Apr 18 14:44:20 2024","interfaces":[{"interface":"back","average":{"1min":0.84999999999999998,"5min":0.84999999999999998,"15min":0.84999999999999998},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":1.1930000000000001,"5min":1.1930000000000001,"15min":1.1930000000000001},"last":1.446},{"interface":"front","average":{"1min":0.88,"5min":0.88,"15min":0.88},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.337,"5min":1.337,"15min":1.337},"last":1.304}]},{"osd":10,"last update":"Thu Apr 18 14:44:20 2024","interfaces":[{"interface":"back","average":{"1min":0.876,"5min":0.876,"15min":0.876},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":1.49,"5min":1.49,"15min":1.49},"last":1.8009999999999999},{"interface":"front","average":{"1min":0.90900000000000003,"5min":0.90900000000000003,"15min":0.90900000000000003},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.5700000000000001,"5min":1.5700000000000001,"15min":1.5700000000000001},"last":1.3660000000000001}]},{"osd":11,"last update":"Thu Apr 18 14:44:20 2024","interfaces":[{"interface":"back","average":{"1min":0.86499999999999999,"5min":0.86499999999999999,"15min":0.86499999999999999},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":1.2130000000000001,"5min":1.2130000000000001,"15min":1.2130000000000001},"last":1.3400000000000001},{"interface":"front","average":{"1min":0.90100000000000002,"5min":0.90100000000000002,"15min":0.90100000000000002},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.365,"5min":1.365,"15min":1.365},"last":1.6719999999999999}]},{"osd":12,"last update":"Thu Apr 18 14:44:20 2024","interfaces":[{"interface":"back","average":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":1.1879999999999999,"5min":1.1879999999999999,"15min":1.1879999999999999},"last":1.276},{"interface":"front","average":{"1min":0.86099999999999999,"5min":0.86099999999999999,"15min":0.86099999999999999},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":1.2949999999999999,"5min":1.2949999999999999,"15min":1.2949999999999999},"last":1.901}]},{"osd":13,"last update":"Thu Apr 18 14:44:20 2024","interfaces":[{"interface":"back","average":{"1min":0.95999999999999996,"5min":0.95999999999999996,"15min":0.95999999999999996},"min":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.4279999999999999,"5min":1.4279999999999999,"15min":1.4279999999999999},"last":1.974},{"interface":"front","average":{"1min":0.89900000000000002,"5min":0.89900000000000002,"15min":0.89900000000000002},"min":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"max":{"1min":1.3360000000000001,"5min":1.3360000000000001,"15min":1.3360000000000001},"last":1.75}]},{"osd":14,"last update":"Thu Apr 18 14:44:20 2024","interfaces":[{"interface":"back","average":{"1min":1.022,"5min":1.022,"15min":1.022},"min":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":1.4730000000000001,"5min":1.4730000000000001,"15min":1.4730000000000001},"last":1.601},{"interface":"front","average":{"1min":1.0429999999999999,"5min":1.0429999999999999,"15min":1.0429999999999999},"min":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"max":{"1min":1.369,"5min":1.369,"15min":1.369},"last":1.5660000000000001}]},{"osd":15,"last update":"Thu Apr 18 14:44:20 2024","interfaces":[{"interface":"back","average":{"1min":1.016,"5min":1.016,"15min":1.016},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.5980000000000001,"5min":1.5980000000000001,"15min":1.5980000000000001},"last":1.639},{"interface":"front","average":{"1min":1.02,"5min":1.02,"15min":1.02},"min":{"1min":0.624,"5min":0.624,"15min":0.624},"max":{"1min":1.5649999999999999,"5min":1.5649999999999999,"15min":1.5649999999999999},"last":2.0369999999999999}]}]},{"osd":6,"up_from":22,"seq":94489280538,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32936,"kb_used_data":1820,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94338904,"statfs":{"total":96636764160,"available":96603037696,"internally_reserved":0,"allocated":1863680,"data_stored":1078641,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31848903},"hb_peers":[0,1,5,7,8,9,11,12,13,14],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Apr 18 14:44:30 2024","interfaces":[{"interface":"back","average":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":1.5629999999999999,"5min":1.5629999999999999,"15min":1.5629999999999999},"last":0.55200000000000005},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":1.006,"5min":1.006,"15min":1.006},"last":0.59499999999999997}]},{"osd":1,"last update":"Thu Apr 18 14:44:19 2024","interfaces":[{"interface":"back","average":{"1min":1.0329999999999999,"5min":1.0329999999999999,"15min":1.0329999999999999},"min":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"max":{"1min":1.633,"5min":1.633,"15min":1.633},"last":0.88600000000000001},{"interface":"front","average":{"1min":1.129,"5min":1.129,"15min":1.129},"min":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"max":{"1min":1.585,"5min":1.585,"15min":1.585},"last":1.345}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95399999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86599999999999999}]},{"osd":5,"last update":"Thu Apr 18 14:44:19 2024","interfaces":[{"interface":"back","average":{"1min":0.96399999999999997,"5min":0.96399999999999997,"15min":0.96399999999999997},"min":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":1.627,"5min":1.627,"15min":1.627},"last":0.69399999999999995},{"interface":"front","average":{"1min":0.98199999999999998,"5min":0.98199999999999998,"15min":0.98199999999999998},"min":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"max":{"1min":1.246,"5min":1.246,"15min":1.246},"last":1.2210000000000001}]},{"osd":7,"last update":"Thu Apr 18 14:44:19 2024","interfaces":[{"interface":"back","average":{"1min":1.1399999999999999,"5min":1.1399999999999999,"15min":1.1399999999999999},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.5860000000000001,"5min":1.5860000000000001,"15min":1.5860000000000001},"last":1.4059999999999999},{"interface":"front","average":{"1min":1.022,"5min":1.022,"15min":1.022},"min":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":1.482,"5min":1.482,"15min":1.482},"last":1.0569999999999999}]},{"osd":8,"last update":"Thu Apr 18 14:44:19 2024","interfaces":[{"interface":"back","average":{"1min":0.99299999999999999,"5min":0.99299999999999999,"15min":0.99299999999999999},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.3380000000000001,"5min":1.3380000000000001,"15min":1.3380000000000001},"last":0.753},{"interface":"front","average":{"1min":1.163,"5min":1.163,"15min":1.163},"min":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"max":{"1min":1.673,"5min":1.673,"15min":1.673},"last":0.84699999999999998}]},{"osd":9,"last update":"Thu Apr 18 14:44:30 2024","interfaces":[{"interface":"back","average":{"1min":1.1279999999999999,"5min":1.1279999999999999,"15min":1.1279999999999999},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.3859999999999999,"5min":1.3859999999999999,"15min":1.3859999999999999},"last":0.80300000000000005},{"interface":"front","average":{"1min":1.1870000000000001,"5min":1.1870000000000001,"15min":1.1870000000000001},"min":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"max":{"1min":1.5640000000000001,"5min":1.5640000000000001,"15min":1.5640000000000001},"last":1.298}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3240000000000001}]},{"osd":11,"last update":"Thu Apr 18 14:44:17 2024","interfaces":[{"interface":"back","average":{"1min":1.359,"5min":1.359,"15min":1.359},"min":{"1min":1.0229999999999999,"5min":1.0229999999999999,"15min":1.0229999999999999},"max":{"1min":2.3610000000000002,"5min":2.3610000000000002,"15min":2.3610000000000002},"last":1.151},{"interface":"front","average":{"1min":1.1439999999999999,"5min":1.1439999999999999,"15min":1.1439999999999999},"min":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"max":{"1min":1.698,"5min":1.698,"15min":1.698},"last":1.1859999999999999}]},{"osd":12,"last update":"Thu Apr 18 14:44:17 2024","interfaces":[{"interface":"back","average":{"1min":1.1950000000000001,"5min":1.1950000000000001,"15min":1.1950000000000001},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.5189999999999999,"5min":1.5189999999999999,"15min":1.5189999999999999},"last":1.0860000000000001},{"interface":"front","average":{"1min":1.3400000000000001,"5min":1.3400000000000001,"15min":1.3400000000000001},"min":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"max":{"1min":2.1920000000000002,"5min":2.1920000000000002,"15min":2.1920000000000002},"last":1.272}]},{"osd":13,"last update":"Thu Apr 18 14:44:30 2024","interfaces":[{"interface":"back","average":{"1min":1.4139999999999999,"5min":1.4139999999999999,"15min":1.4139999999999999},"min":{"1min":1.0309999999999999,"5min":1.0309999999999999,"15min":1.0309999999999999},"max":{"1min":1.794,"5min":1.794,"15min":1.794},"last":1.498},{"interface":"front","average":{"1min":1.29,"5min":1.29,"15min":1.29},"min":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":0.94599999999999995},"max":{"1min":1.591,"5min":1.591,"15min":1.591},"last":1.2470000000000001}]},{"osd":14,"last update":"Thu Apr 18 14:44:17 2024","interfaces":[{"interface":"back","average":{"1min":1.3280000000000001,"5min":1.3280000000000001,"15min":1.3280000000000001},"min":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"max":{"1min":1.8580000000000001,"5min":1.8580000000000001,"15min":1.8580000000000001},"last":1.5600000000000001},{"interface":"front","average":{"1min":1.347,"5min":1.347,"15min":1.347},"min":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":1.712,"5min":1.712,"15min":1.712},"last":1.325}]}]},{"osd":10,"up_from":22,"seq":94489280539,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32952,"kb_used_data":1832,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94338888,"statfs":{"total":96636764160,"available":96603021312,"internally_reserved":0,"allocated":1875968,"data_stored":1087311,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1599,"internal_metadata":31848897},"hb_peers":[1,6,7,8,9,11,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89700000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.371}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.117}]},{"osd":6,"last update":"Thu Apr 18 14:44:20 2024","interfaces":[{"interface":"back","average":{"1min":1.1830000000000001,"5min":1.1830000000000001,"15min":1.1830000000000001},"min":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"max":{"1min":3.9830000000000001,"5min":3.9830000000000001,"15min":3.9830000000000001},"last":0.83899999999999997},{"interface":"front","average":{"1min":1.0309999999999999,"5min":1.0309999999999999,"15min":1.0309999999999999},"min":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"max":{"1min":2.9420000000000002,"5min":2.9420000000000002,"15min":2.9420000000000002},"last":0.93899999999999995}]},{"osd":7,"last update":"Thu Apr 18 14:44:32 2024","interfaces":[{"interface":"back","average":{"1min":1.1870000000000001,"5min":1.1870000000000001,"15min":1.1870000000000001},"min":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":3.3679999999999999,"5min":3.3679999999999999,"15min":3.3679999999999999},"last":1.1080000000000001},{"interface":"front","average":{"1min":1.2190000000000001,"5min":1.2190000000000001,"15min":1.2190000000000001},"min":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"max":{"1min":3.1669999999999998,"5min":3.1669999999999998,"15min":3.1669999999999998},"last":1.357}]},{"osd":8,"last update":"Thu Apr 18 14:44:20 2024","interfaces":[{"interface":"back","average":{"1min":1.091,"5min":1.091,"15min":1.091},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":4.0439999999999996,"5min":4.0439999999999996,"15min":4.0439999999999996},"last":1.0800000000000001},{"interface":"front","average":{"1min":1.4390000000000001,"5min":1.4390000000000001,"15min":1.4390000000000001},"min":{"1min":0.89500000000000002,"5min":0.89500000000000002,"15min":0.89500000000000002},"max":{"1min":4.4900000000000002,"5min":4.4900000000000002,"15min":4.4900000000000002},"last":1.167}]},{"osd":9,"last update":"Thu Apr 18 14:44:20 2024","interfaces":[{"interface":"back","average":{"1min":1.3580000000000001,"5min":1.3580000000000001,"15min":1.3580000000000001},"min":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"max":{"1min":3.8439999999999999,"5min":3.8439999999999999,"15min":3.8439999999999999},"last":1.4570000000000001},{"interface":"front","average":{"1min":1.361,"5min":1.361,"15min":1.361},"min":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"max":{"1min":4.2880000000000003,"5min":4.2880000000000003,"15min":4.2880000000000003},"last":1.286}]},{"osd":11,"last update":"Thu Apr 18 14:44:20 2024","interfaces":[{"interface":"back","average":{"1min":1.4159999999999999,"5min":1.4159999999999999,"15min":1.4159999999999999},"min":{"1min":0.755,"5min":0.755,"15min":0.755},"max":{"1min":4.3399999999999999,"5min":4.3399999999999999,"15min":4.3399999999999999},"last":1.4039999999999999},{"interface":"front","average":{"1min":1.5740000000000001,"5min":1.5740000000000001,"15min":1.5740000000000001},"min":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"max":{"1min":4.4450000000000003,"5min":4.4450000000000003,"15min":4.4450000000000003},"last":1.7130000000000001}]},{"osd":12,"last update":"Thu Apr 18 14:44:20 2024","interfaces":[{"interface":"back","average":{"1min":1.3440000000000001,"5min":1.3440000000000001,"15min":1.3440000000000001},"min":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"max":{"1min":3.5539999999999998,"5min":3.5539999999999998,"15min":3.5539999999999998},"last":1.774},{"interface":"front","average":{"1min":1.431,"5min":1.431,"15min":1.431},"min":{"1min":0.621,"5min":0.621,"15min":0.621},"max":{"1min":4.125,"5min":4.125,"15min":4.125},"last":1.546}]},{"osd":13,"last update":"Thu Apr 18 14:44:20 2024","interfaces":[{"interface":"back","average":{"1min":1.71,"5min":1.71,"15min":1.71},"min":{"1min":1.1160000000000001,"5min":1.1160000000000001,"15min":1.1160000000000001},"max":{"1min":4.5359999999999996,"5min":4.5359999999999996,"15min":4.5359999999999996},"last":1.506},{"interface":"front","average":{"1min":1.5429999999999999,"5min":1.5429999999999999,"15min":1.5429999999999999},"min":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.85599999999999998},"max":{"1min":4.0049999999999999,"5min":4.0049999999999999,"15min":4.0049999999999999},"last":1.847}]},{"osd":14,"last update":"Thu Apr 18 14:44:20 2024","interfaces":[{"interface":"back","average":{"1min":1.7090000000000001,"5min":1.7090000000000001,"15min":1.7090000000000001},"min":{"1min":1.073,"5min":1.073,"15min":1.073},"max":{"1min":4.3940000000000001,"5min":4.3940000000000001,"15min":4.3940000000000001},"last":1.879},{"interface":"front","average":{"1min":1.5680000000000001,"5min":1.5680000000000001,"15min":1.5680000000000001},"min":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"max":{"1min":3.73,"5min":3.73,"15min":3.73},"last":1.897}]},{"osd":15,"last update":"Thu Apr 18 14:44:20 2024","interfaces":[{"interface":"back","average":{"1min":1.5629999999999999,"5min":1.5629999999999999,"15min":1.5629999999999999},"min":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":0.94999999999999996},"max":{"1min":4.1959999999999997,"5min":4.1959999999999997,"15min":4.1959999999999997},"last":1.748},{"interface":"front","average":{"1min":1.802,"5min":1.802,"15min":1.802},"min":{"1min":1.1579999999999999,"5min":1.1579999999999999,"15min":1.1579999999999999},"max":{"1min":4.577,"5min":4.577,"15min":4.577},"last":1.8100000000000001}]}]},{"osd":11,"up_from":22,"seq":94489280539,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32932,"kb_used_data":1816,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94338908,"statfs":{"total":96636764160,"available":96603041792,"internally_reserved":0,"allocated":1859584,"data_stored":1077797,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31848901},"hb_peers":[2,4,5,6,8,10,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":2,"last update":"Thu Apr 18 14:44:18 2024","interfaces":[{"interface":"back","average":{"1min":0.93899999999999995,"5min":0.93899999999999995,"15min":0.93899999999999995},"min":{"1min":0.503,"5min":0.503,"15min":0.503},"max":{"1min":1.367,"5min":1.367,"15min":1.367},"last":1.224},{"interface":"front","average":{"1min":1.0229999999999999,"5min":1.0229999999999999,"15min":1.0229999999999999},"min":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":2.863,"5min":2.863,"15min":2.863},"last":0.86099999999999999}]},{"osd":4,"last update":"Thu Apr 18 14:44:18 2024","interfaces":[{"interface":"back","average":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"min":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":1.1259999999999999,"5min":1.1259999999999999,"15min":1.1259999999999999},"last":0.79000000000000004},{"interface":"front","average":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.129,"5min":1.129,"15min":1.129},"last":0.66700000000000004}]},{"osd":5,"last update":"Thu Apr 18 14:44:23 2024","interfaces":[{"interface":"back","average":{"1min":0.98999999999999999,"5min":0.98999999999999999,"15min":0.98999999999999999},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":1.5840000000000001,"5min":1.5840000000000001,"15min":1.5840000000000001},"last":1.2729999999999999},{"interface":"front","average":{"1min":0.97199999999999998,"5min":0.97199999999999998,"15min":0.97199999999999998},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.619,"5min":1.619,"15min":1.619},"last":1.4330000000000001}]},{"osd":6,"last update":"Thu Apr 18 14:44:18 2024","interfaces":[{"interface":"back","average":{"1min":1.1319999999999999,"5min":1.1319999999999999,"15min":1.1319999999999999},"min":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"max":{"1min":2.9199999999999999,"5min":2.9199999999999999,"15min":2.9199999999999999},"last":1.464},{"interface":"front","average":{"1min":1,"5min":1,"15min":1},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.9510000000000001,"5min":1.9510000000000001,"15min":1.9510000000000001},"last":1.363}]},{"osd":8,"last update":"Thu Apr 18 14:44:23 2024","interfaces":[{"interface":"back","average":{"1min":0.97799999999999998,"5min":0.97799999999999998,"15min":0.97799999999999998},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.452,"5min":1.452,"15min":1.452},"last":0.96599999999999997},{"interface":"front","average":{"1min":1.006,"5min":1.006,"15min":1.006},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":1.383,"5min":1.383,"15min":1.383},"last":1.5669999999999999}]},{"osd":10,"last update":"Thu Apr 18 14:44:18 2024","interfaces":[{"interface":"back","average":{"1min":1.234,"5min":1.234,"15min":1.234},"min":{"1min":0.745,"5min":0.745,"15min":0.745},"max":{"1min":2.774,"5min":2.774,"15min":2.774},"last":1.595},{"interface":"front","average":{"1min":1.105,"5min":1.105,"15min":1.105},"min":{"1min":0.627,"5min":0.627,"15min":0.627},"max":{"1min":1.6890000000000001,"5min":1.6890000000000001,"15min":1.6890000000000001},"last":1.4990000000000001}]},{"osd":12,"last update":"Thu Apr 18 14:44:18 2024","interfaces":[{"interface":"back","average":{"1min":1.1639999999999999,"5min":1.1639999999999999,"15min":1.1639999999999999},"min":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.6719999999999999,"5min":1.6719999999999999,"15min":1.6719999999999999},"last":2.0270000000000001},{"interface":"front","average":{"1min":1.2729999999999999,"5min":1.2729999999999999,"15min":1.2729999999999999},"min":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"max":{"1min":3.4169999999999998,"5min":3.4169999999999998,"15min":3.4169999999999998},"last":1.738}]},{"osd":13,"last update":"Thu Apr 18 14:44:23 2024","interfaces":[{"interface":"back","average":{"1min":1.367,"5min":1.367,"15min":1.367},"min":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"max":{"1min":3.3239999999999998,"5min":3.3239999999999998,"15min":3.3239999999999998},"last":1.9410000000000001},{"interface":"front","average":{"1min":1.1639999999999999,"5min":1.1639999999999999,"15min":1.1639999999999999},"min":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"max":{"1min":1.746,"5min":1.746,"15min":1.746},"last":1.6619999999999999}]},{"osd":14,"last update":"Thu Apr 18 14:44:18 2024","interfaces":[{"interface":"back","average":{"1min":1.1950000000000001,"5min":1.1950000000000001,"15min":1.1950000000000001},"min":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"max":{"1min":1.6619999999999999,"5min":1.6619999999999999,"15min":1.6619999999999999},"last":1.8899999999999999},{"interface":"front","average":{"1min":1.2450000000000001,"5min":1.2450000000000001,"15min":1.2450000000000001},"min":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"max":{"1min":1.7210000000000001,"5min":1.7210000000000001,"15min":1.7210000000000001},"last":1.9750000000000001}]},{"osd":15,"last update":"Thu Apr 18 14:44:23 2024","interfaces":[{"interface":"back","average":{"1min":1.284,"5min":1.284,"15min":1.284},"min":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"max":{"1min":1.851,"5min":1.851,"15min":1.851},"last":1.8320000000000001},{"interface":"front","average":{"1min":1.409,"5min":1.409,"15min":1.409},"min":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"max":{"1min":3.3769999999999998,"5min":3.3769999999999998,"15min":3.3769999999999998},"last":2.1520000000000001}]}]},{"osd":12,"up_from":22,"seq":94489280539,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32932,"kb_used_data":1816,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94338908,"statfs":{"total":96636764160,"available":96603041792,"internally_reserved":0,"allocated":1859584,"data_stored":1077797,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[1,3,4,5,6,10,11,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Apr 18 14:44:30 2024","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":1.3400000000000001,"5min":1.3400000000000001,"15min":1.3400000000000001},"last":0.68100000000000005},{"interface":"front","average":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":1.2310000000000001,"5min":1.2310000000000001,"15min":1.2310000000000001},"last":0.78900000000000003}]},{"osd":1,"last update":"Thu Apr 18 14:44:20 2024","interfaces":[{"interface":"back","average":{"1min":0.93999999999999995,"5min":0.93999999999999995,"15min":0.93999999999999995},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.5449999999999999,"5min":1.5449999999999999,"15min":1.5449999999999999},"last":0.61799999999999999},{"interface":"front","average":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":1.2649999999999999,"5min":1.2649999999999999,"15min":1.2649999999999999},"last":0.85399999999999998}]},{"osd":3,"last update":"Thu Apr 18 14:44:20 2024","interfaces":[{"interface":"back","average":{"1min":0.93999999999999995,"5min":0.93999999999999995,"15min":0.93999999999999995},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":1.4930000000000001,"5min":1.4930000000000001,"15min":1.4930000000000001},"last":0.81200000000000006},{"interface":"front","average":{"1min":0.91500000000000004,"5min":0.91500000000000004,"15min":0.91500000000000004},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.4319999999999999,"5min":1.4319999999999999,"15min":1.4319999999999999},"last":0.95299999999999996}]},{"osd":4,"last update":"Thu Apr 18 14:44:20 2024","interfaces":[{"interface":"back","average":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":1.383,"5min":1.383,"15min":1.383},"last":0.76300000000000001},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":1.335,"5min":1.335,"15min":1.335},"last":0.57699999999999996}]},{"osd":5,"last update":"Thu Apr 18 14:44:30 2024","interfaces":[{"interface":"back","average":{"1min":0.93100000000000005,"5min":0.93100000000000005,"15min":0.93100000000000005},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.4710000000000001,"5min":1.4710000000000001,"15min":1.4710000000000001},"last":0.99399999999999999},{"interface":"front","average":{"1min":1.03,"5min":1.03,"15min":1.03},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.784,"5min":1.784,"15min":1.784},"last":1.284}]},{"osd":6,"last update":"Thu Apr 18 14:44:20 2024","interfaces":[{"interface":"back","average":{"1min":1.0289999999999999,"5min":1.0289999999999999,"15min":1.0289999999999999},"min":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":1.6060000000000001,"5min":1.6060000000000001,"15min":1.6060000000000001},"last":0.92800000000000005},{"interface":"front","average":{"1min":1.0820000000000001,"5min":1.0820000000000001,"15min":1.0820000000000001},"min":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"max":{"1min":1.5620000000000001,"5min":1.5620000000000001,"15min":1.5620000000000001},"last":1.022}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1539999999999999}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4119999999999999}]},{"osd":10,"last update":"Thu Apr 18 14:44:20 2024","interfaces":[{"interface":"back","average":{"1min":1.137,"5min":1.137,"15min":1.137},"min":{"1min":0.626,"5min":0.626,"15min":0.626},"max":{"1min":1.6919999999999999,"5min":1.6919999999999999,"15min":1.6919999999999999},"last":0.89800000000000002},{"interface":"front","average":{"1min":1.1100000000000001,"5min":1.1100000000000001,"15min":1.1100000000000001},"min":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"max":{"1min":1.8899999999999999,"5min":1.8899999999999999,"15min":1.8899999999999999},"last":1.0680000000000001}]},{"osd":11,"last update":"Thu Apr 18 14:44:20 2024","interfaces":[{"interface":"back","average":{"1min":1.1890000000000001,"5min":1.1890000000000001,"15min":1.1890000000000001},"min":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"max":{"1min":2.04,"5min":2.04,"15min":2.04},"last":1.1519999999999999},{"interface":"front","average":{"1min":1.1599999999999999,"5min":1.1599999999999999,"15min":1.1599999999999999},"min":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"max":{"1min":1.8660000000000001,"5min":1.8660000000000001,"15min":1.8660000000000001},"last":1.093}]},{"osd":13,"last update":"Thu Apr 18 14:44:20 2024","interfaces":[{"interface":"back","average":{"1min":1.181,"5min":1.181,"15min":1.181},"min":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"max":{"1min":1.8080000000000001,"5min":1.8080000000000001,"15min":1.8080000000000001},"last":1.1120000000000001},{"interface":"front","average":{"1min":1.228,"5min":1.228,"15min":1.228},"min":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"max":{"1min":2.133,"5min":2.133,"15min":2.133},"last":1.2529999999999999}]},{"osd":14,"last update":"Thu Apr 18 14:44:20 2024","interfaces":[{"interface":"back","average":{"1min":1.226,"5min":1.226,"15min":1.226},"min":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"max":{"1min":1.7410000000000001,"5min":1.7410000000000001,"15min":1.7410000000000001},"last":1.1919999999999999},{"interface":"front","average":{"1min":1.232,"5min":1.232,"15min":1.232},"min":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"max":{"1min":1.966,"5min":1.966,"15min":1.966},"last":1.319}]},{"osd":15,"last update":"Thu Apr 18 14:44:20 2024","interfaces":[{"interface":"back","average":{"1min":1.2190000000000001,"5min":1.2190000000000001,"15min":1.2190000000000001},"min":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"max":{"1min":1.802,"5min":1.802,"15min":1.802},"last":1.1739999999999999},{"interface":"front","average":{"1min":1.2889999999999999,"5min":1.2889999999999999,"15min":1.2889999999999999},"min":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"max":{"1min":1.8580000000000001,"5min":1.8580000000000001,"15min":1.8580000000000001},"last":1.3620000000000001}]}]},{"osd":0,"up_from":23,"seq":98784247835,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33468,"kb_used_data":2352,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94338372,"statfs":{"total":96636764160,"available":96602492928,"internally_reserved":0,"allocated":2408448,"data_stored":1616239,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[1,4,6,7,8,10,11,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Apr 18 14:44:23 2024","interfaces":[{"interface":"back","average":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":1.218,"5min":1.218,"15min":1.218},"last":1.026},{"interface":"front","average":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.47,"5min":1.47,"15min":1.47},"last":1.056}]},{"osd":4,"last update":"Thu Apr 18 14:44:19 2024","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":1.5409999999999999,"5min":1.5409999999999999,"15min":1.5409999999999999},"last":0.61499999999999999},{"interface":"front","average":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":1.903,"5min":1.903,"15min":1.903},"last":0.64000000000000001}]},{"osd":6,"last update":"Thu Apr 18 14:44:19 2024","interfaces":[{"interface":"back","average":{"1min":0.90200000000000002,"5min":0.90200000000000002,"15min":0.90200000000000002},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":2.5009999999999999,"5min":2.5009999999999999,"15min":2.5009999999999999},"last":0.96399999999999997},{"interface":"front","average":{"1min":0.89500000000000002,"5min":0.89500000000000002,"15min":0.89500000000000002},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":1.6240000000000001,"5min":1.6240000000000001,"15min":1.6240000000000001},"last":0.91100000000000003}]},{"osd":7,"last update":"Thu Apr 18 14:44:19 2024","interfaces":[{"interface":"back","average":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":1.2350000000000001,"5min":1.2350000000000001,"15min":1.2350000000000001},"last":0.71499999999999997},{"interface":"front","average":{"1min":0.93899999999999995,"5min":0.93899999999999995,"15min":0.93899999999999995},"min":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"max":{"1min":1.5860000000000001,"5min":1.5860000000000001,"15min":1.5860000000000001},"last":0.78800000000000003}]},{"osd":8,"last update":"Thu Apr 18 14:44:19 2024","interfaces":[{"interface":"back","average":{"1min":1.734,"5min":1.734,"15min":1.734},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":18.015999999999998,"5min":18.015999999999998,"15min":18.015999999999998},"last":0.73099999999999998},{"interface":"front","average":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":1.6599999999999999,"5min":1.6599999999999999,"15min":1.6599999999999999},"last":0.57499999999999996}]},{"osd":10,"last update":"Thu Apr 18 14:44:19 2024","interfaces":[{"interface":"back","average":{"1min":1.0960000000000001,"5min":1.0960000000000001,"15min":1.0960000000000001},"min":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"max":{"1min":2.1339999999999999,"5min":2.1339999999999999,"15min":2.1339999999999999},"last":1.1020000000000001},{"interface":"front","average":{"1min":1.119,"5min":1.119,"15min":1.119},"min":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"max":{"1min":1.8540000000000001,"5min":1.8540000000000001,"15min":1.8540000000000001},"last":0.94999999999999996}]},{"osd":11,"last update":"Thu Apr 18 14:44:19 2024","interfaces":[{"interface":"back","average":{"1min":2.9990000000000001,"5min":2.9990000000000001,"15min":2.9990000000000001},"min":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":41.195999999999998,"5min":41.195999999999998,"15min":41.195999999999998},"last":0.85699999999999998},{"interface":"front","average":{"1min":3.1339999999999999,"5min":3.1339999999999999,"15min":3.1339999999999999},"min":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"max":{"1min":41.216999999999999,"5min":41.216999999999999,"15min":41.216999999999999},"last":1}]},{"osd":13,"last update":"Thu Apr 18 14:44:23 2024","interfaces":[{"interface":"back","average":{"1min":0.95099999999999996,"5min":0.95099999999999996,"15min":0.95099999999999996},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":1.881,"5min":1.881,"15min":1.881},"last":0.748},{"interface":"front","average":{"1min":1.091,"5min":1.091,"15min":1.091},"min":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":1.8720000000000001,"5min":1.8720000000000001,"15min":1.8720000000000001},"last":0.82299999999999995}]},{"osd":14,"last update":"Thu Apr 18 14:44:19 2024","interfaces":[{"interface":"back","average":{"1min":1.103,"5min":1.103,"15min":1.103},"min":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"max":{"1min":1.95,"5min":1.95,"15min":1.95},"last":0.77400000000000002},{"interface":"front","average":{"1min":1.095,"5min":1.095,"15min":1.095},"min":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"max":{"1min":2.1219999999999999,"5min":2.1219999999999999,"15min":2.1219999999999999},"last":0.89000000000000001}]},{"osd":15,"last update":"Thu Apr 18 14:44:19 2024","interfaces":[{"interface":"back","average":{"1min":1.224,"5min":1.224,"15min":1.224},"min":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"max":{"1min":1.929,"5min":1.929,"15min":1.929},"last":0.93000000000000005},{"interface":"front","average":{"1min":1.179,"5min":1.179,"15min":1.179},"min":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":2.056,"5min":2.056,"15min":2.056},"last":0.97799999999999998}]}]},{"osd":3,"up_from":23,"seq":98784247834,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32956,"kb_used_data":1836,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94338884,"statfs":{"total":96636764160,"available":96603017216,"internally_reserved":0,"allocated":1880064,"data_stored":1088155,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31848904},"hb_peers":[0,2,4,5,8,9,10,11,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Apr 18 14:44:20 2024","interfaces":[{"interface":"back","average":{"1min":0.88200000000000001,"5min":0.88200000000000001,"15min":0.88200000000000001},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":1.4510000000000001,"5min":1.4510000000000001,"15min":1.4510000000000001},"last":1.387},{"interface":"front","average":{"1min":1,"5min":1,"15min":1},"min":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"max":{"1min":1.4850000000000001,"5min":1.4850000000000001,"15min":1.4850000000000001},"last":1.1719999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4590000000000001}]},{"osd":2,"last update":"Thu Apr 18 14:44:20 2024","interfaces":[{"interface":"back","average":{"1min":0.98599999999999999,"5min":0.98599999999999999,"15min":0.98599999999999999},"min":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.5469999999999999,"5min":1.5469999999999999,"15min":1.5469999999999999},"last":0.70399999999999996},{"interface":"front","average":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":0.94999999999999996},"min":{"1min":0.623,"5min":0.623,"15min":0.623},"max":{"1min":1.425,"5min":1.425,"15min":1.425},"last":0.95899999999999996}]},{"osd":4,"last update":"Thu Apr 18 14:44:20 2024","interfaces":[{"interface":"back","average":{"1min":1.008,"5min":1.008,"15min":1.008},"min":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.7030000000000001,"5min":1.7030000000000001,"15min":1.7030000000000001},"last":0.80000000000000004},{"interface":"front","average":{"1min":0.98699999999999999,"5min":0.98699999999999999,"15min":0.98699999999999999},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":1.5309999999999999,"5min":1.5309999999999999,"15min":1.5309999999999999},"last":0.92200000000000004}]},{"osd":5,"last update":"Thu Apr 18 14:44:20 2024","interfaces":[{"interface":"back","average":{"1min":1.087,"5min":1.087,"15min":1.087},"min":{"1min":0.624,"5min":0.624,"15min":0.624},"max":{"1min":1.663,"5min":1.663,"15min":1.663},"last":1.1379999999999999},{"interface":"front","average":{"1min":1.206,"5min":1.206,"15min":1.206},"min":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":1.6779999999999999,"5min":1.6779999999999999,"15min":1.6779999999999999},"last":1.2609999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.472}]},{"osd":7,"last update":"Thu Apr 18 14:44:20 2024","interfaces":[{"interface":"back","average":{"1min":1.157,"5min":1.157,"15min":1.157},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.645,"5min":1.645,"15min":1.645},"last":0.82199999999999995},{"interface":"front","average":{"1min":1.115,"5min":1.115,"15min":1.115},"min":{"1min":0.503,"5min":0.503,"15min":0.503},"max":{"1min":1.6419999999999999,"5min":1.6419999999999999,"15min":1.6419999999999999},"last":0.90800000000000003}]},{"osd":8,"last update":"Thu Apr 18 14:44:20 2024","interfaces":[{"interface":"back","average":{"1min":1.1339999999999999,"5min":1.1339999999999999,"15min":1.1339999999999999},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.7529999999999999,"5min":1.7529999999999999,"15min":1.7529999999999999},"last":1.232},{"interface":"front","average":{"1min":1.304,"5min":1.304,"15min":1.304},"min":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"max":{"1min":1.7430000000000001,"5min":1.7430000000000001,"15min":1.7430000000000001},"last":1.359}]},{"osd":9,"last update":"Thu Apr 18 14:44:33 2024","interfaces":[{"interface":"back","average":{"1min":1.3,"5min":1.3,"15min":1.3},"min":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"max":{"1min":1.879,"5min":1.879,"15min":1.879},"last":1.0069999999999999},{"interface":"front","average":{"1min":1.254,"5min":1.254,"15min":1.254},"min":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"max":{"1min":1.8260000000000001,"5min":1.8260000000000001,"15min":1.8260000000000001},"last":1.4750000000000001}]},{"osd":10,"last update":"Thu Apr 18 14:44:20 2024","interfaces":[{"interface":"back","average":{"1min":1.327,"5min":1.327,"15min":1.327},"min":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"max":{"1min":1.883,"5min":1.883,"15min":1.883},"last":1.2889999999999999},{"interface":"front","average":{"1min":1.3660000000000001,"5min":1.3660000000000001,"15min":1.3660000000000001},"min":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"max":{"1min":2.161,"5min":2.161,"15min":2.161},"last":1.663}]},{"osd":11,"last update":"Thu Apr 18 14:44:20 2024","interfaces":[{"interface":"back","average":{"1min":1.4330000000000001,"5min":1.4330000000000001,"15min":1.4330000000000001},"min":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"max":{"1min":1.8959999999999999,"5min":1.8959999999999999,"15min":1.8959999999999999},"last":1.419},{"interface":"front","average":{"1min":1.381,"5min":1.381,"15min":1.381},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":2.1160000000000001,"5min":2.1160000000000001,"15min":2.1160000000000001},"last":1.0720000000000001}]},{"osd":12,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.8740000000000001}]},{"osd":14,"last update":"Thu Apr 18 14:44:20 2024","interfaces":[{"interface":"back","average":{"1min":1.512,"5min":1.512,"15min":1.512},"min":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":0.94999999999999996},"max":{"1min":2.2879999999999998,"5min":2.2879999999999998,"15min":2.2879999999999998},"last":1.5760000000000001},{"interface":"front","average":{"1min":1.4139999999999999,"5min":1.4139999999999999,"15min":1.4139999999999999},"min":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"max":{"1min":2.0179999999999998,"5min":2.0179999999999998,"15min":2.0179999999999998},"last":1.7270000000000001}]},{"osd":15,"last update":"Thu Apr 18 14:44:33 2024","interfaces":[{"interface":"back","average":{"1min":1.4730000000000001,"5min":1.4730000000000001,"15min":1.4730000000000001},"min":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"max":{"1min":2.1120000000000001,"5min":2.1120000000000001,"15min":2.1120000000000001},"last":1.786},{"interface":"front","average":{"1min":1.452,"5min":1.452,"15min":1.452},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.9299999999999999,"5min":1.9299999999999999,"15min":1.9299999999999999},"last":1.496}]}]},{"osd":7,"up_from":23,"seq":98784247836,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32952,"kb_used_data":1832,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94338888,"statfs":{"total":96636764160,"available":96603021312,"internally_reserved":0,"allocated":1875968,"data_stored":1087311,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":31848907},"hb_peers":[0,2,3,4,5,6,8,10,12,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Apr 18 14:44:34 2024","interfaces":[{"interface":"back","average":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":1.109,"5min":1.109,"15min":1.109},"last":0.70199999999999996},{"interface":"front","average":{"1min":0.873,"5min":0.873,"15min":0.873},"min":{"1min":0.505,"5min":0.505,"15min":0.505},"max":{"1min":1.7589999999999999,"5min":1.7589999999999999,"15min":1.7589999999999999},"last":0.67400000000000004}]},{"osd":2,"last update":"Thu Apr 18 14:44:21 2024","interfaces":[{"interface":"back","average":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"min":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":1.1519999999999999,"5min":1.1519999999999999,"15min":1.1519999999999999},"last":0.78900000000000003},{"interface":"front","average":{"1min":0.97599999999999998,"5min":0.97599999999999998,"15min":0.97599999999999998},"min":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"max":{"1min":1.891,"5min":1.891,"15min":1.891},"last":0.91900000000000004}]},{"osd":3,"last update":"Thu Apr 18 14:44:34 2024","interfaces":[{"interface":"back","average":{"1min":0.88200000000000001,"5min":0.88200000000000001,"15min":0.88200000000000001},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.5920000000000001,"5min":1.5920000000000001,"15min":1.5920000000000001},"last":0.58499999999999996},{"interface":"front","average":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":1.2330000000000001,"5min":1.2330000000000001,"15min":1.2330000000000001},"last":0.875}]},{"osd":4,"last update":"Thu Apr 18 14:44:21 2024","interfaces":[{"interface":"back","average":{"1min":0.95699999999999996,"5min":0.95699999999999996,"15min":0.95699999999999996},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.258,"5min":1.258,"15min":1.258},"last":1.091},{"interface":"front","average":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":1.2170000000000001,"5min":1.2170000000000001,"15min":1.2170000000000001},"last":1.0620000000000001}]},{"osd":5,"last update":"Thu Apr 18 14:44:21 2024","interfaces":[{"interface":"back","average":{"1min":1.1140000000000001,"5min":1.1140000000000001,"15min":1.1140000000000001},"min":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"max":{"1min":1.8580000000000001,"5min":1.8580000000000001,"15min":1.8580000000000001},"last":1.022},{"interface":"front","average":{"1min":1.1120000000000001,"5min":1.1120000000000001,"15min":1.1120000000000001},"min":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"max":{"1min":1.53,"5min":1.53,"15min":1.53},"last":0.95299999999999996}]},{"osd":6,"last update":"Thu Apr 18 14:44:21 2024","interfaces":[{"interface":"back","average":{"1min":1.139,"5min":1.139,"15min":1.139},"min":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"max":{"1min":1.8759999999999999,"5min":1.8759999999999999,"15min":1.8759999999999999},"last":1.1160000000000001},{"interface":"front","average":{"1min":1.171,"5min":1.171,"15min":1.171},"min":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"max":{"1min":1.4570000000000001,"5min":1.4570000000000001,"15min":1.4570000000000001},"last":0.84699999999999998}]},{"osd":8,"last update":"Thu Apr 18 14:44:21 2024","interfaces":[{"interface":"back","average":{"1min":1.095,"5min":1.095,"15min":1.095},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":1.4159999999999999,"5min":1.4159999999999999,"15min":1.4159999999999999},"last":0.622},{"interface":"front","average":{"1min":1.274,"5min":1.274,"15min":1.274},"min":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"max":{"1min":1.821,"5min":1.821,"15min":1.821},"last":0.753}]},{"osd":10,"last update":"Thu Apr 18 14:44:21 2024","interfaces":[{"interface":"back","average":{"1min":1.151,"5min":1.151,"15min":1.151},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.831,"5min":1.831,"15min":1.831},"last":0.97699999999999998},{"interface":"front","average":{"1min":1.278,"5min":1.278,"15min":1.278},"min":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"max":{"1min":1.53,"5min":1.53,"15min":1.53},"last":0.996}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71699999999999997}]},{"osd":12,"last update":"Thu Apr 18 14:44:21 2024","interfaces":[{"interface":"back","average":{"1min":1.2270000000000001,"5min":1.2270000000000001,"15min":1.2270000000000001},"min":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.7549999999999999,"5min":1.7549999999999999,"15min":1.7549999999999999},"last":0.73099999999999998},{"interface":"front","average":{"1min":1.4039999999999999,"5min":1.4039999999999999,"15min":1.4039999999999999},"min":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"max":{"1min":2.0960000000000001,"5min":2.0960000000000001,"15min":2.0960000000000001},"last":0.81799999999999995}]},{"osd":14,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3819999999999999}]},{"osd":15,"last update":"Thu Apr 18 14:44:21 2024","interfaces":[{"interface":"back","average":{"1min":1.4330000000000001,"5min":1.4330000000000001,"15min":1.4330000000000001},"min":{"1min":0.874,"5min":0.874,"15min":0.874},"max":{"1min":2.6699999999999999,"5min":2.6699999999999999,"15min":2.6699999999999999},"last":1.1639999999999999},{"interface":"front","average":{"1min":1.401,"5min":1.401,"15min":1.401},"min":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":2.516,"5min":2.516,"15min":2.516},"last":1.1399999999999999}]}]},{"osd":8,"up_from":23,"seq":98784247836,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32956,"kb_used_data":1832,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94338884,"statfs":{"total":96636764160,"available":96603017216,"internally_reserved":0,"allocated":1875968,"data_stored":1087311,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[1,2,3,4,5,7,9,11,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Apr 18 14:44:32 2024","interfaces":[{"interface":"back","average":{"1min":0.746,"5min":0.746,"15min":0.746},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":1.7290000000000001,"5min":1.7290000000000001,"15min":1.7290000000000001},"last":2.4540000000000002},{"interface":"front","average":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":2.48,"5min":2.48,"15min":2.48},"last":2.1669999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72999999999999998}]},{"osd":2,"last update":"Thu Apr 18 14:44:22 2024","interfaces":[{"interface":"back","average":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":1.1339999999999999,"5min":1.1339999999999999,"15min":1.1339999999999999},"last":0.76600000000000001},{"interface":"front","average":{"1min":0.996,"5min":0.996,"15min":0.996},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":2.54,"5min":2.54,"15min":2.54},"last":0.50700000000000001}]},{"osd":3,"last update":"Thu Apr 18 14:44:32 2024","interfaces":[{"interface":"back","average":{"1min":0.88800000000000001,"5min":0.88800000000000001,"15min":0.88800000000000001},"min":{"1min":0.628,"5min":0.628,"15min":0.628},"max":{"1min":1.137,"5min":1.137,"15min":1.137},"last":0.70199999999999996},{"interface":"front","average":{"1min":1.0209999999999999,"5min":1.0209999999999999,"15min":1.0209999999999999},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":2.6779999999999999,"5min":2.6779999999999999,"15min":2.6779999999999999},"last":0.58999999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46899999999999997}]},{"osd":5,"last update":"Thu Apr 18 14:44:22 2024","interfaces":[{"interface":"back","average":{"1min":1.0549999999999999,"5min":1.0549999999999999,"15min":1.0549999999999999},"min":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":2.7810000000000001,"5min":2.7810000000000001,"15min":2.7810000000000001},"last":0.753},{"interface":"front","average":{"1min":0.91800000000000004,"5min":0.91800000000000004,"15min":0.91800000000000004},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.5309999999999999,"5min":1.5309999999999999,"15min":1.5309999999999999},"last":0.55500000000000005}]},{"osd":7,"last update":"Thu Apr 18 14:44:22 2024","interfaces":[{"interface":"back","average":{"1min":1.042,"5min":1.042,"15min":1.042},"min":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":1.925,"5min":1.925,"15min":1.925},"last":0.63400000000000001},{"interface":"front","average":{"1min":1.0800000000000001,"5min":1.0800000000000001,"15min":1.0800000000000001},"min":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"max":{"1min":1.669,"5min":1.669,"15min":1.669},"last":0.84199999999999997}]},{"osd":9,"last update":"Thu Apr 18 14:44:22 2024","interfaces":[{"interface":"back","average":{"1min":1.0249999999999999,"5min":1.0249999999999999,"15min":1.0249999999999999},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":1.6479999999999999,"5min":1.6479999999999999,"15min":1.6479999999999999},"last":0.64400000000000002},{"interface":"front","average":{"1min":1.163,"5min":1.163,"15min":1.163},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":2.9319999999999999,"5min":2.9319999999999999,"15min":2.9319999999999999},"last":0.53800000000000003}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.665}]},{"osd":11,"last update":"Thu Apr 18 14:44:22 2024","interfaces":[{"interface":"back","average":{"1min":1.206,"5min":1.206,"15min":1.206},"min":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"max":{"1min":2.1139999999999999,"5min":2.1139999999999999,"15min":2.1139999999999999},"last":0.85599999999999998},{"interface":"front","average":{"1min":1.2929999999999999,"5min":1.2929999999999999,"15min":1.2929999999999999},"min":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"max":{"1min":2.25,"5min":2.25,"15min":2.25},"last":0.79800000000000004}]},{"osd":12,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5629999999999999}]},{"osd":14,"last update":"Thu Apr 18 14:44:22 2024","interfaces":[{"interface":"back","average":{"1min":1.341,"5min":1.341,"15min":1.341},"min":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"max":{"1min":2.5800000000000001,"5min":2.5800000000000001,"15min":2.5800000000000001},"last":0.81999999999999995},{"interface":"front","average":{"1min":1.3919999999999999,"5min":1.3919999999999999,"15min":1.3919999999999999},"min":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"max":{"1min":3.0739999999999998,"5min":3.0739999999999998,"15min":3.0739999999999998},"last":0.81299999999999994}]},{"osd":15,"last update":"Thu Apr 18 14:44:22 2024","interfaces":[{"interface":"back","average":{"1min":1.355,"5min":1.355,"15min":1.355},"min":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"max":{"1min":2.4740000000000002,"5min":2.4740000000000002,"15min":2.4740000000000002},"last":0.878},{"interface":"front","average":{"1min":1.4159999999999999,"5min":1.4159999999999999,"15min":1.4159999999999999},"min":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"max":{"1min":2.8620000000000001,"5min":2.8620000000000001,"15min":2.8620000000000001},"last":0.78500000000000003}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":13,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":12,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":13,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":14,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":15,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-18T14:45:12.464 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-04-18T14:45:12.464 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-18T14:45:12.747 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-04-18T14:45:12.748 INFO:teuthology.orchestra.run.smithi086.stderr:dumped all 2024-04-18T14:45:12.763 INFO:teuthology.orchestra.run.smithi086.stdout:{"pg_ready":true,"pg_map":{"version":171,"stamp":"2024-04-18T14:45:11.370991+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":16,"num_per_pool_osds":16,"num_per_pool_omap_osds":11,"kb":1509949440,"kb_used":560224,"kb_used_data":30316,"kb_used_omap":24,"kb_used_meta":529639,"kb_avail":1509389216,"statfs":{"total":1546188226560,"available":1545614557184,"internally_reserved":0,"allocated":31043584,"data_stored":18422684,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":25506,"internal_metadata":542350430},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.538435"},"pg_stats":[{"pgid":"1.0","version":"26'157","reported_seq":308,"reported_epoch":124,"state":"active+clean","last_fresh":"2024-04-18T14:45:07.185100+0000","last_change":"2024-04-18T14:44:37.152954+0000","last_active":"2024-04-18T14:45:07.185100+0000","last_peered":"2024-04-18T14:45:07.185100+0000","last_clean":"2024-04-18T14:45:07.185100+0000","last_became_active":"2024-04-18T14:43:20.323133+0000","last_became_peered":"2024-04-18T14:43:20.323133+0000","last_unstale":"2024-04-18T14:45:07.185100+0000","last_undegraded":"2024-04-18T14:45:07.185100+0000","last_fullsized":"2024-04-18T14:45:07.185100+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'157","last_scrub_stamp":"2024-04-18T14:44:37.152696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T14:43:18.296821+0000","last_clean_scrub_stamp":"2024-04-18T14:44:37.152696+0000","objects_scrubbed":2,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T14:45:43.293239+0000","scrub_duration":0.0049794150000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[13,0],"acting":[13,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":13,"acting_primary":13,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":114,"reported_epoch":124,"state":"active+clean","last_fresh":"2024-04-18T14:45:05.843355+0000","last_change":"2024-04-18T14:44:23.449444+0000","last_active":"2024-04-18T14:45:05.843355+0000","last_peered":"2024-04-18T14:45:05.843355+0000","last_clean":"2024-04-18T14:45:05.843355+0000","last_became_active":"2024-04-18T14:43:21.327764+0000","last_became_peered":"2024-04-18T14:43:21.327764+0000","last_unstale":"2024-04-18T14:45:05.843355+0000","last_undegraded":"2024-04-18T14:45:05.843355+0000","last_fullsized":"2024-04-18T14:45:05.843355+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T14:44:23.449241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T14:43:20.303322+0000","last_clean_scrub_stamp":"2024-04-18T14:44:23.449241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T14:45:36.175611+0000","scrub_duration":0.0029048670000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,15],"acting":[5,15],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":111,"reported_epoch":124,"state":"active+clean","last_fresh":"2024-04-18T14:45:05.845686+0000","last_change":"2024-04-18T14:44:37.374487+0000","last_active":"2024-04-18T14:45:05.845686+0000","last_peered":"2024-04-18T14:45:05.845686+0000","last_clean":"2024-04-18T14:45:05.845686+0000","last_became_active":"2024-04-18T14:43:21.414060+0000","last_became_peered":"2024-04-18T14:43:21.414060+0000","last_unstale":"2024-04-18T14:45:05.845686+0000","last_undegraded":"2024-04-18T14:45:05.845686+0000","last_fullsized":"2024-04-18T14:45:05.845686+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T14:44:37.374221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T14:43:20.303322+0000","last_clean_scrub_stamp":"2024-04-18T14:44:37.374221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T14:45:58.651147+0000","scrub_duration":0.0042134670000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":111,"reported_epoch":124,"state":"active+clean","last_fresh":"2024-04-18T14:45:07.185035+0000","last_change":"2024-04-18T14:44:24.148269+0000","last_active":"2024-04-18T14:45:07.185035+0000","last_peered":"2024-04-18T14:45:07.185035+0000","last_clean":"2024-04-18T14:45:07.185035+0000","last_became_active":"2024-04-18T14:43:21.328534+0000","last_became_peered":"2024-04-18T14:43:21.328534+0000","last_unstale":"2024-04-18T14:45:07.185035+0000","last_undegraded":"2024-04-18T14:45:07.185035+0000","last_fullsized":"2024-04-18T14:45:07.185035+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T14:44:24.148141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T14:43:20.303322+0000","last_clean_scrub_stamp":"2024-04-18T14:44:24.148141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T14:45:30.466689+0000","scrub_duration":0.001593882,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[13,5],"acting":[13,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":13,"acting_primary":13,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":111,"reported_epoch":124,"state":"active+clean","last_fresh":"2024-04-18T14:45:05.845692+0000","last_change":"2024-04-18T14:44:47.245574+0000","last_active":"2024-04-18T14:45:05.845692+0000","last_peered":"2024-04-18T14:45:05.845692+0000","last_clean":"2024-04-18T14:45:05.845692+0000","last_became_active":"2024-04-18T14:43:21.465481+0000","last_became_peered":"2024-04-18T14:43:21.465481+0000","last_unstale":"2024-04-18T14:45:05.845692+0000","last_undegraded":"2024-04-18T14:45:05.845692+0000","last_fullsized":"2024-04-18T14:45:05.845692+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T14:44:47.245297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T14:44:47.245297+0000","last_clean_scrub_stamp":"2024-04-18T14:44:47.245297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T14:46:02.649852+0000","scrub_duration":0.0038839159999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10],"acting":[3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":114,"reported_epoch":124,"state":"active+clean","last_fresh":"2024-04-18T14:45:07.345184+0000","last_change":"2024-04-18T14:44:38.485354+0000","last_active":"2024-04-18T14:45:07.345184+0000","last_peered":"2024-04-18T14:45:07.345184+0000","last_clean":"2024-04-18T14:45:07.345184+0000","last_became_active":"2024-04-18T14:43:21.348012+0000","last_became_peered":"2024-04-18T14:43:21.348012+0000","last_unstale":"2024-04-18T14:45:07.345184+0000","last_undegraded":"2024-04-18T14:45:07.345184+0000","last_fullsized":"2024-04-18T14:45:07.345184+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T14:44:38.485106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T14:43:20.303322+0000","last_clean_scrub_stamp":"2024-04-18T14:44:38.485106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T14:45:48.039171+0000","scrub_duration":0.0043932759999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,12],"acting":[6,12],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":111,"reported_epoch":124,"state":"active+clean","last_fresh":"2024-04-18T14:45:06.469135+0000","last_change":"2024-04-18T14:44:38.516905+0000","last_active":"2024-04-18T14:45:06.469135+0000","last_peered":"2024-04-18T14:45:06.469135+0000","last_clean":"2024-04-18T14:45:06.469135+0000","last_became_active":"2024-04-18T14:43:21.422468+0000","last_became_peered":"2024-04-18T14:43:21.422468+0000","last_unstale":"2024-04-18T14:45:06.469135+0000","last_undegraded":"2024-04-18T14:45:06.469135+0000","last_fullsized":"2024-04-18T14:45:06.469135+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T14:44:38.516629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T14:43:20.303322+0000","last_clean_scrub_stamp":"2024-04-18T14:44:38.516629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T14:45:46.715258+0000","scrub_duration":0.0039045249999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2],"acting":[8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":102,"reported_epoch":124,"state":"active+clean","last_fresh":"2024-04-18T14:45:06.548847+0000","last_change":"2024-04-18T14:44:59.929678+0000","last_active":"2024-04-18T14:45:06.548847+0000","last_peered":"2024-04-18T14:45:06.548847+0000","last_clean":"2024-04-18T14:45:06.548847+0000","last_became_active":"2024-04-18T14:44:59.929195+0000","last_became_peered":"2024-04-18T14:44:59.929195+0000","last_unstale":"2024-04-18T14:45:06.548847+0000","last_undegraded":"2024-04-18T14:45:06.548847+0000","last_fullsized":"2024-04-18T14:45:06.548847+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T14:44:36.901318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T14:43:20.303322+0000","last_clean_scrub_stamp":"2024-04-18T14:44:36.901318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T14:45:49.599440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[14,0],"acting":[14,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":14,"acting_primary":14,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":114,"reported_epoch":124,"state":"active+clean","last_fresh":"2024-04-18T14:45:06.548333+0000","last_change":"2024-04-18T14:44:22.508764+0000","last_active":"2024-04-18T14:45:06.548333+0000","last_peered":"2024-04-18T14:45:06.548333+0000","last_clean":"2024-04-18T14:45:06.548333+0000","last_became_active":"2024-04-18T14:43:21.328185+0000","last_became_peered":"2024-04-18T14:43:21.328185+0000","last_unstale":"2024-04-18T14:45:06.548333+0000","last_undegraded":"2024-04-18T14:45:06.548333+0000","last_fullsized":"2024-04-18T14:45:06.548333+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T14:44:22.508567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T14:43:20.303322+0000","last_clean_scrub_stamp":"2024-04-18T14:44:22.508567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T14:45:46.236519+0000","scrub_duration":0.0031913549999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[15,13],"acting":[15,13],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":15,"acting_primary":15,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":11},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1064960,"data_stored":1057856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":13,"up_from":24,"seq":103079215130,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33476,"kb_used_data":2356,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94338364,"statfs":{"total":96636764160,"available":96602484736,"internally_reserved":0,"allocated":2412544,"data_stored":1617083,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,2,3,4,5,7,11,12,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Apr 18 14:44:21 2024","interfaces":[{"interface":"back","average":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"min":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":1.792,"5min":1.792,"15min":1.792},"last":0.67100000000000004},{"interface":"front","average":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"min":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":2.0600000000000001,"5min":2.0600000000000001,"15min":2.0600000000000001},"last":0.71299999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84099999999999997}]},{"osd":2,"last update":"Thu Apr 18 14:44:21 2024","interfaces":[{"interface":"back","average":{"1min":1.0389999999999999,"5min":1.0389999999999999,"15min":1.0389999999999999},"min":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"max":{"1min":1.974,"5min":1.974,"15min":1.974},"last":0.98599999999999999},{"interface":"front","average":{"1min":1,"5min":1,"15min":1},"min":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.9910000000000001,"5min":1.9910000000000001,"15min":1.9910000000000001},"last":0.79200000000000004}]},{"osd":3,"last update":"Thu Apr 18 14:44:21 2024","interfaces":[{"interface":"back","average":{"1min":0.91500000000000004,"5min":0.91500000000000004,"15min":0.91500000000000004},"min":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"max":{"1min":1.2110000000000001,"5min":1.2110000000000001,"15min":1.2110000000000001},"last":1.0369999999999999},{"interface":"front","average":{"1min":1.0489999999999999,"5min":1.0489999999999999,"15min":1.0489999999999999},"min":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":1.4430000000000001,"5min":1.4430000000000001,"15min":1.4430000000000001},"last":1.113}]},{"osd":4,"last update":"Thu Apr 18 14:44:21 2024","interfaces":[{"interface":"back","average":{"1min":0.98099999999999998,"5min":0.98099999999999998,"15min":0.98099999999999998},"min":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.3919999999999999,"5min":1.3919999999999999,"15min":1.3919999999999999},"last":0.878},{"interface":"front","average":{"1min":0.90100000000000002,"5min":0.90100000000000002,"15min":0.90100000000000002},"min":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":1.306,"5min":1.306,"15min":1.306},"last":1.1559999999999999}]},{"osd":5,"last update":"Thu Apr 18 14:44:21 2024","interfaces":[{"interface":"back","average":{"1min":0.96399999999999997,"5min":0.96399999999999997,"15min":0.96399999999999997},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":1.5860000000000001,"5min":1.5860000000000001,"15min":1.5860000000000001},"last":0.95699999999999996},{"interface":"front","average":{"1min":1.0780000000000001,"5min":1.0780000000000001,"15min":1.0780000000000001},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.536,"5min":1.536,"15min":1.536},"last":0.93200000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1950000000000001}]},{"osd":7,"last update":"Thu Apr 18 14:44:32 2024","interfaces":[{"interface":"back","average":{"1min":1.1639999999999999,"5min":1.1639999999999999,"15min":1.1639999999999999},"min":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":2.4359999999999999,"5min":2.4359999999999999,"15min":2.4359999999999999},"last":1.079},{"interface":"front","average":{"1min":1.206,"5min":1.206,"15min":1.206},"min":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"max":{"1min":3.532,"5min":3.532,"15min":3.532},"last":1.177}]},{"osd":11,"last update":"Thu Apr 18 14:44:32 2024","interfaces":[{"interface":"back","average":{"1min":1.2350000000000001,"5min":1.2350000000000001,"15min":1.2350000000000001},"min":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"max":{"1min":1.8069999999999999,"5min":1.8069999999999999,"15min":1.8069999999999999},"last":1.1399999999999999},{"interface":"front","average":{"1min":1.2809999999999999,"5min":1.2809999999999999,"15min":1.2809999999999999},"min":{"1min":0.84799999999999998,"5min":0.84799999999999998,"15min":0.84799999999999998},"max":{"1min":2.2669999999999999,"5min":2.2669999999999999,"15min":2.2669999999999999},"last":1.2190000000000001}]},{"osd":12,"last update":"Thu Apr 18 14:44:21 2024","interfaces":[{"interface":"back","average":{"1min":1.2709999999999999,"5min":1.2709999999999999,"15min":1.2709999999999999},"min":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"max":{"1min":1.911,"5min":1.911,"15min":1.911},"last":1.018},{"interface":"front","average":{"1min":1.3140000000000001,"5min":1.3140000000000001,"15min":1.3140000000000001},"min":{"1min":0.755,"5min":0.755,"15min":0.755},"max":{"1min":2.504,"5min":2.504,"15min":2.504},"last":1.2909999999999999}]},{"osd":14,"last update":"Thu Apr 18 14:44:21 2024","interfaces":[{"interface":"back","average":{"1min":1.2909999999999999,"5min":1.2909999999999999,"15min":1.2909999999999999},"min":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"max":{"1min":3.6240000000000001,"5min":3.6240000000000001,"15min":3.6240000000000001},"last":1.24},{"interface":"front","average":{"1min":1.357,"5min":1.357,"15min":1.357},"min":{"1min":0.627,"5min":0.627,"15min":0.627},"max":{"1min":2.1960000000000002,"5min":2.1960000000000002,"15min":2.1960000000000002},"last":1.2030000000000001}]},{"osd":15,"last update":"Thu Apr 18 14:44:21 2024","interfaces":[{"interface":"back","average":{"1min":1.3560000000000001,"5min":1.3560000000000001,"15min":1.3560000000000001},"min":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"max":{"1min":2.1080000000000001,"5min":2.1080000000000001,"15min":2.1080000000000001},"last":1.3600000000000001},{"interface":"front","average":{"1min":1.26,"5min":1.26,"15min":1.26},"min":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"max":{"1min":1.8380000000000001,"5min":1.8380000000000001,"15min":1.8380000000000001},"last":1.323}]}]},{"osd":9,"up_from":24,"seq":103079215131,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32956,"kb_used_data":1836,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94338884,"statfs":{"total":96636764160,"available":96603017216,"internally_reserved":0,"allocated":1880064,"data_stored":1088155,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1599,"internal_metadata":31848897},"hb_peers":[0,1,3,8,10,11,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Apr 18 14:44:20 2024","interfaces":[{"interface":"back","average":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":1.0429999999999999,"5min":1.0429999999999999,"15min":1.0429999999999999},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.95199999999999996,"5min":0.95199999999999996,"15min":0.95199999999999996},"min":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"max":{"1min":1.6559999999999999,"5min":1.6559999999999999,"15min":1.6559999999999999},"last":0.68500000000000005}]},{"osd":1,"last update":"Thu Apr 18 14:44:20 2024","interfaces":[{"interface":"back","average":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"min":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":1.3200000000000001,"5min":1.3200000000000001,"15min":1.3200000000000001},"last":0.80400000000000005},{"interface":"front","average":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.2509999999999999,"5min":1.2509999999999999,"15min":1.2509999999999999},"last":0.91600000000000004}]},{"osd":3,"last update":"Thu Apr 18 14:44:20 2024","interfaces":[{"interface":"back","average":{"1min":1.032,"5min":1.032,"15min":1.032},"min":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"max":{"1min":1.5980000000000001,"5min":1.5980000000000001,"15min":1.5980000000000001},"last":0.98799999999999999},{"interface":"front","average":{"1min":1.1539999999999999,"5min":1.1539999999999999,"15min":1.1539999999999999},"min":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"max":{"1min":1.722,"5min":1.722,"15min":1.722},"last":0.95899999999999996}]},{"osd":8,"last update":"Thu Apr 18 14:44:20 2024","interfaces":[{"interface":"back","average":{"1min":0.94899999999999995,"5min":0.94899999999999995,"15min":0.94899999999999995},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":1.6899999999999999,"5min":1.6899999999999999,"15min":1.6899999999999999},"last":0.75800000000000001},{"interface":"front","average":{"1min":1.3380000000000001,"5min":1.3380000000000001,"15min":1.3380000000000001},"min":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"max":{"1min":5.4989999999999997,"5min":5.4989999999999997,"15min":5.4989999999999997},"last":0.84499999999999997}]},{"osd":10,"last update":"Thu Apr 18 14:44:20 2024","interfaces":[{"interface":"back","average":{"1min":1.196,"5min":1.196,"15min":1.196},"min":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"max":{"1min":1.5429999999999999,"5min":1.5429999999999999,"15min":1.5429999999999999},"last":1.2849999999999999},{"interface":"front","average":{"1min":1.117,"5min":1.117,"15min":1.117},"min":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"max":{"1min":1.7689999999999999,"5min":1.7689999999999999,"15min":1.7689999999999999},"last":1.091}]},{"osd":11,"last update":"Thu Apr 18 14:44:20 2024","interfaces":[{"interface":"back","average":{"1min":1.1279999999999999,"5min":1.1279999999999999,"15min":1.1279999999999999},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.849,"5min":1.849,"15min":1.849},"last":1.0189999999999999},{"interface":"front","average":{"1min":1.2310000000000001,"5min":1.2310000000000001,"15min":1.2310000000000001},"min":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"max":{"1min":1.8109999999999999,"5min":1.8109999999999999,"15min":1.8109999999999999},"last":1.119}]},{"osd":12,"last update":"Thu Apr 18 14:44:20 2024","interfaces":[{"interface":"back","average":{"1min":1.2989999999999999,"5min":1.2989999999999999,"15min":1.2989999999999999},"min":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"max":{"1min":2.1560000000000001,"5min":2.1560000000000001,"15min":2.1560000000000001},"last":0.88100000000000001},{"interface":"front","average":{"1min":1.29,"5min":1.29,"15min":1.29},"min":{"1min":0.748,"5min":0.748,"15min":0.748},"max":{"1min":2.6930000000000001,"5min":2.6930000000000001,"15min":2.6930000000000001},"last":1.1539999999999999}]},{"osd":13,"last update":"Thu Apr 18 14:44:20 2024","interfaces":[{"interface":"back","average":{"1min":1.4079999999999999,"5min":1.4079999999999999,"15min":1.4079999999999999},"min":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"max":{"1min":2.6030000000000002,"5min":2.6030000000000002,"15min":2.6030000000000002},"last":1.0580000000000001},{"interface":"front","average":{"1min":1.4710000000000001,"5min":1.4710000000000001,"15min":1.4710000000000001},"min":{"1min":0.92100000000000004,"5min":0.92100000000000004,"15min":0.92100000000000004},"max":{"1min":2.472,"5min":2.472,"15min":2.472},"last":1.179}]},{"osd":14,"last update":"Thu Apr 18 14:44:20 2024","interfaces":[{"interface":"back","average":{"1min":1.456,"5min":1.456,"15min":1.456},"min":{"1min":0.88400000000000001,"5min":0.88400000000000001,"15min":0.88400000000000001},"max":{"1min":2.3180000000000001,"5min":2.3180000000000001,"15min":2.3180000000000001},"last":1.26},{"interface":"front","average":{"1min":1.5389999999999999,"5min":1.5389999999999999,"15min":1.5389999999999999},"min":{"1min":1.016,"5min":1.016,"15min":1.016},"max":{"1min":2.6549999999999998,"5min":2.6549999999999998,"15min":2.6549999999999998},"last":1.204}]},{"osd":15,"last update":"Thu Apr 18 14:44:20 2024","interfaces":[{"interface":"back","average":{"1min":1.4119999999999999,"5min":1.4119999999999999,"15min":1.4119999999999999},"min":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"max":{"1min":2.7789999999999999,"5min":2.7789999999999999,"15min":2.7789999999999999},"last":1.2310000000000001},{"interface":"front","average":{"1min":1.4359999999999999,"5min":1.4359999999999999,"15min":1.4359999999999999},"min":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"max":{"1min":1.923,"5min":1.923,"15min":1.923},"last":1.3080000000000001}]}]},{"osd":5,"up_from":24,"seq":103079215132,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32956,"kb_used_data":1836,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94338884,"statfs":{"total":96636764160,"available":96603017216,"internally_reserved":0,"allocated":1880064,"data_stored":1088155,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,3,4,6,10,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Apr 18 14:44:31 2024","interfaces":[{"interface":"back","average":{"1min":0.90900000000000003,"5min":0.90900000000000003,"15min":0.90900000000000003},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.339,"5min":1.339,"15min":1.339},"last":1.083},{"interface":"front","average":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":1.175,"5min":1.175,"15min":1.175},"last":0.78900000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67600000000000005}]},{"osd":3,"last update":"Thu Apr 18 14:44:24 2024","interfaces":[{"interface":"back","average":{"1min":1.024,"5min":1.024,"15min":1.024},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":1.4650000000000001,"5min":1.4650000000000001,"15min":1.4650000000000001},"last":1.26},{"interface":"front","average":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":0.94999999999999996},"min":{"1min":0.621,"5min":0.621,"15min":0.621},"max":{"1min":1.8460000000000001,"5min":1.8460000000000001,"15min":1.8460000000000001},"last":0.81200000000000006}]},{"osd":4,"last update":"Thu Apr 18 14:44:24 2024","interfaces":[{"interface":"back","average":{"1min":0.89400000000000002,"5min":0.89400000000000002,"15min":0.89400000000000002},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":1.968,"5min":1.968,"15min":1.968},"last":0.88700000000000001},{"interface":"front","average":{"1min":1.016,"5min":1.016,"15min":1.016},"min":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"max":{"1min":1.819,"5min":1.819,"15min":1.819},"last":1.1679999999999999}]},{"osd":6,"last update":"Thu Apr 18 14:44:24 2024","interfaces":[{"interface":"back","average":{"1min":1.0629999999999999,"5min":1.0629999999999999,"15min":1.0629999999999999},"min":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"max":{"1min":2.0760000000000001,"5min":2.0760000000000001,"15min":2.0760000000000001},"last":0.94799999999999995},{"interface":"front","average":{"1min":1.101,"5min":1.101,"15min":1.101},"min":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"max":{"1min":1.694,"5min":1.694,"15min":1.694},"last":0.97999999999999998}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2330000000000001}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96599999999999997}]},{"osd":10,"last update":"Thu Apr 18 14:44:24 2024","interfaces":[{"interface":"back","average":{"1min":1.232,"5min":1.232,"15min":1.232},"min":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"max":{"1min":2.2709999999999999,"5min":2.2709999999999999,"15min":2.2709999999999999},"last":1.3360000000000001},{"interface":"front","average":{"1min":1.2569999999999999,"5min":1.2569999999999999,"15min":1.2569999999999999},"min":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"max":{"1min":2.4470000000000001,"5min":2.4470000000000001,"15min":2.4470000000000001},"last":1.03}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.256}]},{"osd":12,"last update":"Thu Apr 18 14:44:24 2024","interfaces":[{"interface":"back","average":{"1min":1.1140000000000001,"5min":1.1140000000000001,"15min":1.1140000000000001},"min":{"1min":0.625,"5min":0.625,"15min":0.625},"max":{"1min":1.728,"5min":1.728,"15min":1.728},"last":0.83899999999999997},{"interface":"front","average":{"1min":1.339,"5min":1.339,"15min":1.339},"min":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"max":{"1min":2.008,"5min":2.008,"15min":2.008},"last":1.4059999999999999}]},{"osd":13,"last update":"Thu Apr 18 14:44:24 2024","interfaces":[{"interface":"back","average":{"1min":1.355,"5min":1.355,"15min":1.355},"min":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":2.5070000000000001,"5min":2.5070000000000001,"15min":2.5070000000000001},"last":1.478},{"interface":"front","average":{"1min":1.2949999999999999,"5min":1.2949999999999999,"15min":1.2949999999999999},"min":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":2.992,"5min":2.992,"15min":2.992},"last":1.1299999999999999}]},{"osd":14,"last update":"Thu Apr 18 14:44:31 2024","interfaces":[{"interface":"back","average":{"1min":1.401,"5min":1.401,"15min":1.401},"min":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.85099999999999998},"max":{"1min":2.1190000000000002,"5min":2.1190000000000002,"15min":2.1190000000000002},"last":1.5469999999999999},{"interface":"front","average":{"1min":1.2629999999999999,"5min":1.2629999999999999,"15min":1.2629999999999999},"min":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"max":{"1min":2.496,"5min":2.496,"15min":2.496},"last":1.1919999999999999}]},{"osd":15,"last update":"Thu Apr 18 14:44:24 2024","interfaces":[{"interface":"back","average":{"1min":1.486,"5min":1.486,"15min":1.486},"min":{"1min":0.879,"5min":0.879,"15min":0.879},"max":{"1min":2.415,"5min":2.415,"15min":2.415},"last":1.615},{"interface":"front","average":{"1min":1.4470000000000001,"5min":1.4470000000000001,"15min":1.4470000000000001},"min":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"max":{"1min":2.7799999999999998,"5min":2.7799999999999998,"15min":2.7799999999999998},"last":1.236}]}]},{"osd":14,"up_from":21,"seq":90194313243,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51008,"kb_used_data":1836,"kb_used_omap":1,"kb_used_meta":49150,"kb_avail":94320832,"statfs":{"total":96636764160,"available":96584531968,"internally_reserved":0,"allocated":1880064,"data_stored":1088155,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":50330054},"hb_peers":[0,4,5,6,7,8,9,11,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Apr 18 14:44:21 2024","interfaces":[{"interface":"back","average":{"1min":0.96899999999999997,"5min":0.96899999999999997,"15min":0.96899999999999997},"min":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"max":{"1min":1.454,"5min":1.454,"15min":1.454},"last":0.83999999999999997},{"interface":"front","average":{"1min":1.0660000000000001,"5min":1.0660000000000001,"15min":1.0660000000000001},"min":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"max":{"1min":1.9390000000000001,"5min":1.9390000000000001,"15min":1.9390000000000001},"last":1.0940000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.472}]},{"osd":2,"last update":"Thu Apr 18 14:44:31 2024","interfaces":[{"interface":"back","average":{"1min":0.89500000000000002,"5min":0.89500000000000002,"15min":0.89500000000000002},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":1.468,"5min":1.468,"15min":1.468},"last":0.64400000000000002},{"interface":"front","average":{"1min":1.131,"5min":1.131,"15min":1.131},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.8540000000000001,"5min":1.8540000000000001,"15min":1.8540000000000001},"last":1.032}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94499999999999995}]},{"osd":4,"last update":"Thu Apr 18 14:44:20 2024","interfaces":[{"interface":"back","average":{"1min":0.95099999999999996,"5min":0.95099999999999996,"15min":0.95099999999999996},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.296,"5min":1.296,"15min":1.296},"last":0.69499999999999995},{"interface":"front","average":{"1min":0.97599999999999998,"5min":0.97599999999999998,"15min":0.97599999999999998},"min":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"max":{"1min":1.5129999999999999,"5min":1.5129999999999999,"15min":1.5129999999999999},"last":0.74099999999999999}]},{"osd":5,"last update":"Thu Apr 18 14:44:20 2024","interfaces":[{"interface":"back","average":{"1min":1.218,"5min":1.218,"15min":1.218},"min":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"max":{"1min":2.1269999999999998,"5min":2.1269999999999998,"15min":2.1269999999999998},"last":1.1910000000000001},{"interface":"front","average":{"1min":1.1679999999999999,"5min":1.1679999999999999,"15min":1.1679999999999999},"min":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"max":{"1min":1.5920000000000001,"5min":1.5920000000000001,"15min":1.5920000000000001},"last":0.95299999999999996}]},{"osd":6,"last update":"Thu Apr 18 14:44:20 2024","interfaces":[{"interface":"back","average":{"1min":0.94699999999999995,"5min":0.94699999999999995,"15min":0.94699999999999995},"min":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"max":{"1min":1.3160000000000001,"5min":1.3160000000000001,"15min":1.3160000000000001},"last":1.0509999999999999},{"interface":"front","average":{"1min":1.163,"5min":1.163,"15min":1.163},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":1.7689999999999999,"5min":1.7689999999999999,"15min":1.7689999999999999},"last":0.875}]},{"osd":7,"last update":"Thu Apr 18 14:44:20 2024","interfaces":[{"interface":"back","average":{"1min":1.234,"5min":1.234,"15min":1.234},"min":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"max":{"1min":1.7529999999999999,"5min":1.7529999999999999,"15min":1.7529999999999999},"last":1.018},{"interface":"front","average":{"1min":1.1759999999999999,"5min":1.1759999999999999,"15min":1.1759999999999999},"min":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"max":{"1min":1.587,"5min":1.587,"15min":1.587},"last":0.90900000000000003}]},{"osd":8,"last update":"Thu Apr 18 14:44:20 2024","interfaces":[{"interface":"back","average":{"1min":1.292,"5min":1.292,"15min":1.292},"min":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"max":{"1min":2.0569999999999999,"5min":2.0569999999999999,"15min":2.0569999999999999},"last":1.3720000000000001},{"interface":"front","average":{"1min":1.2509999999999999,"5min":1.2509999999999999,"15min":1.2509999999999999},"min":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"max":{"1min":1.8740000000000001,"5min":1.8740000000000001,"15min":1.8740000000000001},"last":1.0740000000000001}]},{"osd":9,"last update":"Thu Apr 18 14:44:31 2024","interfaces":[{"interface":"back","average":{"1min":1.4590000000000001,"5min":1.4590000000000001,"15min":1.4590000000000001},"min":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"max":{"1min":2.1899999999999999,"5min":2.1899999999999999,"15min":2.1899999999999999},"last":1.4550000000000001},{"interface":"front","average":{"1min":1.3999999999999999,"5min":1.3999999999999999,"15min":1.3999999999999999},"min":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"max":{"1min":1.9930000000000001,"5min":1.9930000000000001,"15min":1.9930000000000001},"last":1.163}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4219999999999999}]},{"osd":11,"last update":"Thu Apr 18 14:44:31 2024","interfaces":[{"interface":"back","average":{"1min":1.4319999999999999,"5min":1.4319999999999999,"15min":1.4319999999999999},"min":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"max":{"1min":2.0059999999999998,"5min":2.0059999999999998,"15min":2.0059999999999998},"last":1.1279999999999999},{"interface":"front","average":{"1min":1.3640000000000001,"5min":1.3640000000000001,"15min":1.3640000000000001},"min":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"max":{"1min":1.903,"5min":1.903,"15min":1.903},"last":1.5349999999999999}]},{"osd":12,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.016}]},{"osd":13,"last update":"Thu Apr 18 14:44:20 2024","interfaces":[{"interface":"back","average":{"1min":1.464,"5min":1.464,"15min":1.464},"min":{"1min":0.86799999999999999,"5min":0.86799999999999999,"15min":0.86799999999999999},"max":{"1min":1.8620000000000001,"5min":1.8620000000000001,"15min":1.8620000000000001},"last":1.2410000000000001},{"interface":"front","average":{"1min":1.5349999999999999,"5min":1.5349999999999999,"15min":1.5349999999999999},"min":{"1min":0.94299999999999995,"5min":0.94299999999999995,"15min":0.94299999999999995},"max":{"1min":2.452,"5min":2.452,"15min":2.452},"last":1.5780000000000001}]},{"osd":15,"last update":"Thu Apr 18 14:44:20 2024","interfaces":[{"interface":"back","average":{"1min":1.5129999999999999,"5min":1.5129999999999999,"15min":1.5129999999999999},"min":{"1min":0.95699999999999996,"5min":0.95699999999999996,"15min":0.95699999999999996},"max":{"1min":2.2549999999999999,"5min":2.2549999999999999,"15min":2.2549999999999999},"last":1.2170000000000001},{"interface":"front","average":{"1min":1.476,"5min":1.476,"15min":1.476},"min":{"1min":0.89800000000000002,"5min":0.89800000000000002,"15min":0.89800000000000002},"max":{"1min":1.9550000000000001,"5min":1.9550000000000001,"15min":1.9550000000000001},"last":1.4910000000000001}]}]},{"osd":1,"up_from":24,"seq":103079215132,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32952,"kb_used_data":1832,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94338888,"statfs":{"total":96636764160,"available":96603021312,"internally_reserved":0,"allocated":1875968,"data_stored":1087311,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,2,3,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Apr 18 14:44:25 2024","interfaces":[{"interface":"back","average":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":1.165,"5min":1.165,"15min":1.165},"last":1.1519999999999999},{"interface":"front","average":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"min":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":1.292,"5min":1.292,"15min":1.292},"last":0.92700000000000005}]},{"osd":2,"last update":"Thu Apr 18 14:44:25 2024","interfaces":[{"interface":"back","average":{"1min":0.93899999999999995,"5min":0.93899999999999995,"15min":0.93899999999999995},"min":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"max":{"1min":1.3180000000000001,"5min":1.3180000000000001,"15min":1.3180000000000001},"last":1.0960000000000001},{"interface":"front","average":{"1min":0.95199999999999996,"5min":0.95199999999999996,"15min":0.95199999999999996},"min":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":1.345,"5min":1.345,"15min":1.345},"last":0.98099999999999998}]},{"osd":3,"last update":"Thu Apr 18 14:44:25 2024","interfaces":[{"interface":"back","average":{"1min":1.0760000000000001,"5min":1.0760000000000001,"15min":1.0760000000000001},"min":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":1.486,"5min":1.486,"15min":1.486},"last":1.526},{"interface":"front","average":{"1min":1.1679999999999999,"5min":1.1679999999999999,"15min":1.1679999999999999},"min":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"max":{"1min":1.7789999999999999,"5min":1.7789999999999999,"15min":1.7789999999999999},"last":1.1719999999999999}]},{"osd":4,"last update":"Thu Apr 18 14:44:25 2024","interfaces":[{"interface":"back","average":{"1min":0.98299999999999998,"5min":0.98299999999999998,"15min":0.98299999999999998},"min":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"max":{"1min":1.728,"5min":1.728,"15min":1.728},"last":1.1950000000000001},{"interface":"front","average":{"1min":0.93700000000000006,"5min":0.93700000000000006,"15min":0.93700000000000006},"min":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"max":{"1min":1.6950000000000001,"5min":1.6950000000000001,"15min":1.6950000000000001},"last":1.248}]},{"osd":5,"last update":"Thu Apr 18 14:44:25 2024","interfaces":[{"interface":"back","average":{"1min":1.0089999999999999,"5min":1.0089999999999999,"15min":1.0089999999999999},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":1.819,"5min":1.819,"15min":1.819},"last":0.80900000000000005},{"interface":"front","average":{"1min":1.083,"5min":1.083,"15min":1.083},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":1.841,"5min":1.841,"15min":1.841},"last":1.034}]},{"osd":6,"last update":"Thu Apr 18 14:44:25 2024","interfaces":[{"interface":"back","average":{"1min":1.2529999999999999,"5min":1.2529999999999999,"15min":1.2529999999999999},"min":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"max":{"1min":2.3639999999999999,"5min":2.3639999999999999,"15min":2.3639999999999999},"last":1.0720000000000001},{"interface":"front","average":{"1min":1.1839999999999999,"5min":1.1839999999999999,"15min":1.1839999999999999},"min":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"max":{"1min":1.9419999999999999,"5min":1.9419999999999999,"15min":1.9419999999999999},"last":1.1220000000000001}]},{"osd":7,"last update":"Thu Apr 18 14:44:25 2024","interfaces":[{"interface":"back","average":{"1min":1.2050000000000001,"5min":1.2050000000000001,"15min":1.2050000000000001},"min":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"max":{"1min":1.96,"5min":1.96,"15min":1.96},"last":0.86499999999999999},{"interface":"front","average":{"1min":1.2509999999999999,"5min":1.2509999999999999,"15min":1.2509999999999999},"min":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"max":{"1min":2.4399999999999999,"5min":2.4399999999999999,"15min":2.4399999999999999},"last":1.218}]},{"osd":8,"last update":"Thu Apr 18 14:44:25 2024","interfaces":[{"interface":"back","average":{"1min":1.2330000000000001,"5min":1.2330000000000001,"15min":1.2330000000000001},"min":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"max":{"1min":1.881,"5min":1.881,"15min":1.881},"last":1.3080000000000001},{"interface":"front","average":{"1min":1.26,"5min":1.26,"15min":1.26},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":2.5169999999999999,"5min":2.5169999999999999,"15min":2.5169999999999999},"last":1.3680000000000001}]},{"osd":9,"last update":"Thu Apr 18 14:44:25 2024","interfaces":[{"interface":"back","average":{"1min":1.3280000000000001,"5min":1.3280000000000001,"15min":1.3280000000000001},"min":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":2.4780000000000002,"5min":2.4780000000000002,"15min":2.4780000000000002},"last":1.706},{"interface":"front","average":{"1min":1.3129999999999999,"5min":1.3129999999999999,"15min":1.3129999999999999},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":2.161,"5min":2.161,"15min":2.161},"last":1.3919999999999999}]},{"osd":10,"last update":"Thu Apr 18 14:44:25 2024","interfaces":[{"interface":"back","average":{"1min":1.407,"5min":1.407,"15min":1.407},"min":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"max":{"1min":2.625,"5min":2.625,"15min":2.625},"last":1.4370000000000001},{"interface":"front","average":{"1min":1.446,"5min":1.446,"15min":1.446},"min":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"max":{"1min":2.5529999999999999,"5min":2.5529999999999999,"15min":2.5529999999999999},"last":1.7829999999999999}]}]},{"osd":2,"up_from":22,"seq":94489280539,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28840,"kb_used_data":1820,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343000,"statfs":{"total":96636764160,"available":96607232000,"internally_reserved":0,"allocated":1863680,"data_stored":1078641,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,3,5,6,7,8,10,11,12,14],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Apr 18 14:44:22 2024","interfaces":[{"interface":"back","average":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"min":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"max":{"1min":1.175,"5min":1.175,"15min":1.175},"last":1.2210000000000001},{"interface":"front","average":{"1min":0.90900000000000003,"5min":0.90900000000000003,"15min":0.90900000000000003},"min":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"max":{"1min":1.3740000000000001,"5min":1.3740000000000001,"15min":1.3740000000000001},"last":1.47}]},{"osd":3,"last update":"Thu Apr 18 14:44:22 2024","interfaces":[{"interface":"back","average":{"1min":1.0409999999999999,"5min":1.0409999999999999,"15min":1.0409999999999999},"min":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"max":{"1min":1.6830000000000001,"5min":1.6830000000000001,"15min":1.6830000000000001},"last":1.0740000000000001},{"interface":"front","average":{"1min":1.0700000000000001,"5min":1.0700000000000001,"15min":1.0700000000000001},"min":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"max":{"1min":1.8839999999999999,"5min":1.8839999999999999,"15min":1.8839999999999999},"last":1.3080000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96699999999999997}]},{"osd":5,"last update":"Thu Apr 18 14:44:22 2024","interfaces":[{"interface":"back","average":{"1min":0.98799999999999999,"5min":0.98799999999999999,"15min":0.98799999999999999},"min":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"max":{"1min":1.5469999999999999,"5min":1.5469999999999999,"15min":1.5469999999999999},"last":0.63100000000000001},{"interface":"front","average":{"1min":0.92500000000000004,"5min":0.92500000000000004,"15min":0.92500000000000004},"min":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":1.333,"5min":1.333,"15min":1.333},"last":1.359}]},{"osd":6,"last update":"Thu Apr 18 14:44:19 2024","interfaces":[{"interface":"back","average":{"1min":1.115,"5min":1.115,"15min":1.115},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":2.0529999999999999,"5min":2.0529999999999999,"15min":2.0529999999999999},"last":1.26},{"interface":"front","average":{"1min":1.089,"5min":1.089,"15min":1.089},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.8069999999999999,"5min":1.8069999999999999,"15min":1.8069999999999999},"last":1.155}]},{"osd":7,"last update":"Thu Apr 18 14:44:22 2024","interfaces":[{"interface":"back","average":{"1min":1.165,"5min":1.165,"15min":1.165},"min":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"max":{"1min":2.012,"5min":2.012,"15min":2.012},"last":0.97299999999999998},{"interface":"front","average":{"1min":1.2949999999999999,"5min":1.2949999999999999,"15min":1.2949999999999999},"min":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"max":{"1min":2.1419999999999999,"5min":2.1419999999999999,"15min":2.1419999999999999},"last":1.0229999999999999}]},{"osd":8,"last update":"Thu Apr 18 14:44:22 2024","interfaces":[{"interface":"back","average":{"1min":1.224,"5min":1.224,"15min":1.224},"min":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"max":{"1min":1.988,"5min":1.988,"15min":1.988},"last":1.55},{"interface":"front","average":{"1min":1.3120000000000001,"5min":1.3120000000000001,"15min":1.3120000000000001},"min":{"1min":0.84999999999999998,"5min":0.84999999999999998,"15min":0.84999999999999998},"max":{"1min":2.2240000000000002,"5min":2.2240000000000002,"15min":2.2240000000000002},"last":1.657}]},{"osd":10,"last update":"Thu Apr 18 14:44:19 2024","interfaces":[{"interface":"back","average":{"1min":1.365,"5min":1.365,"15min":1.365},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":2.319,"5min":2.319,"15min":2.319},"last":2.8170000000000002},{"interface":"front","average":{"1min":1.3879999999999999,"5min":1.3879999999999999,"15min":1.3879999999999999},"min":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"max":{"1min":2.27,"5min":2.27,"15min":2.27},"last":3.0110000000000001}]},{"osd":11,"last update":"Thu Apr 18 14:44:19 2024","interfaces":[{"interface":"back","average":{"1min":1.49,"5min":1.49,"15min":1.49},"min":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"max":{"1min":2.4950000000000001,"5min":2.4950000000000001,"15min":2.4950000000000001},"last":1.78},{"interface":"front","average":{"1min":1.4590000000000001,"5min":1.4590000000000001,"15min":1.4590000000000001},"min":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"max":{"1min":2.411,"5min":2.411,"15min":2.411},"last":1.736}]},{"osd":12,"last update":"Thu Apr 18 14:44:19 2024","interfaces":[{"interface":"back","average":{"1min":1.4910000000000001,"5min":1.4910000000000001,"15min":1.4910000000000001},"min":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":0.88500000000000001},"max":{"1min":2.2669999999999999,"5min":2.2669999999999999,"15min":2.2669999999999999},"last":1.8220000000000001},{"interface":"front","average":{"1min":1.514,"5min":1.514,"15min":1.514},"min":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"max":{"1min":2.3719999999999999,"5min":2.3719999999999999,"15min":2.3719999999999999},"last":1.861}]},{"osd":14,"last update":"Thu Apr 18 14:44:19 2024","interfaces":[{"interface":"back","average":{"1min":1.4390000000000001,"5min":1.4390000000000001,"15min":1.4390000000000001},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":2.3050000000000002,"5min":2.3050000000000002,"15min":2.3050000000000002},"last":1.9770000000000001},{"interface":"front","average":{"1min":1.5069999999999999,"5min":1.5069999999999999,"15min":1.5069999999999999},"min":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":2.4020000000000001,"5min":2.4020000000000001,"15min":2.4020000000000001},"last":1.9350000000000001}]}]},{"osd":15,"up_from":23,"seq":98784247836,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32952,"kb_used_data":1832,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94338888,"statfs":{"total":96636764160,"available":96603021312,"internally_reserved":0,"allocated":1875968,"data_stored":1087311,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31848903},"hb_peers":[0,4,5,6,7,8,10,11,13,14],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Apr 18 14:44:19 2024","interfaces":[{"interface":"back","average":{"1min":0.94699999999999995,"5min":0.94699999999999995,"15min":0.94699999999999995},"min":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"max":{"1min":1.405,"5min":1.405,"15min":1.405},"last":0.997},{"interface":"front","average":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"min":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":1.0569999999999999,"5min":1.0569999999999999,"15min":1.0569999999999999},"last":0.63200000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2050000000000001}]},{"osd":4,"last update":"Thu Apr 18 14:44:19 2024","interfaces":[{"interface":"back","average":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.85099999999999998},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.2669999999999999,"5min":1.2669999999999999,"15min":1.2669999999999999},"last":0.73499999999999999},{"interface":"front","average":{"1min":0.877,"5min":0.877,"15min":0.877},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.2410000000000001,"5min":1.2410000000000001,"15min":1.2410000000000001},"last":0.87}]},{"osd":5,"last update":"Thu Apr 18 14:44:22 2024","interfaces":[{"interface":"back","average":{"1min":1.0209999999999999,"5min":1.0209999999999999,"15min":1.0209999999999999},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":2.0579999999999998,"5min":2.0579999999999998,"15min":2.0579999999999998},"last":0.93400000000000005},{"interface":"front","average":{"1min":1.089,"5min":1.089,"15min":1.089},"min":{"1min":0.75,"5min":0.75,"15min":0.75},"max":{"1min":1.9259999999999999,"5min":1.9259999999999999,"15min":1.9259999999999999},"last":1.1339999999999999}]},{"osd":6,"last update":"Thu Apr 18 14:44:19 2024","interfaces":[{"interface":"back","average":{"1min":1.1379999999999999,"5min":1.1379999999999999,"15min":1.1379999999999999},"min":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"max":{"1min":1.8680000000000001,"5min":1.8680000000000001,"15min":1.8680000000000001},"last":1.034},{"interface":"front","average":{"1min":1.228,"5min":1.228,"15min":1.228},"min":{"1min":0.86499999999999999,"5min":0.86499999999999999,"15min":0.86499999999999999},"max":{"1min":1.79,"5min":1.79,"15min":1.79},"last":1.429}]},{"osd":7,"last update":"Thu Apr 18 14:44:19 2024","interfaces":[{"interface":"back","average":{"1min":1.0549999999999999,"5min":1.0549999999999999,"15min":1.0549999999999999},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":1.488,"5min":1.488,"15min":1.488},"last":1.504},{"interface":"front","average":{"1min":1.1830000000000001,"5min":1.1830000000000001,"15min":1.1830000000000001},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":1.976,"5min":1.976,"15min":1.976},"last":1.1859999999999999}]},{"osd":8,"last update":"Thu Apr 18 14:44:19 2024","interfaces":[{"interface":"back","average":{"1min":1.1879999999999999,"5min":1.1879999999999999,"15min":1.1879999999999999},"min":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"max":{"1min":2.004,"5min":2.004,"15min":2.004},"last":1.2370000000000001},{"interface":"front","average":{"1min":1.222,"5min":1.222,"15min":1.222},"min":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"max":{"1min":1.786,"5min":1.786,"15min":1.786},"last":1.381}]},{"osd":10,"last update":"Thu Apr 18 14:44:19 2024","interfaces":[{"interface":"back","average":{"1min":1.3360000000000001,"5min":1.3360000000000001,"15min":1.3360000000000001},"min":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"max":{"1min":2.403,"5min":2.403,"15min":2.403},"last":1.4710000000000001},{"interface":"front","average":{"1min":1.331,"5min":1.331,"15min":1.331},"min":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"max":{"1min":2.2549999999999999,"5min":2.2549999999999999,"15min":2.2549999999999999},"last":1.6459999999999999}]},{"osd":11,"last update":"Thu Apr 18 14:44:19 2024","interfaces":[{"interface":"back","average":{"1min":1.399,"5min":1.399,"15min":1.399},"min":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"max":{"1min":2.2109999999999999,"5min":2.2109999999999999,"15min":2.2109999999999999},"last":1.6990000000000001},{"interface":"front","average":{"1min":1.4490000000000001,"5min":1.4490000000000001,"15min":1.4490000000000001},"min":{"1min":0.629,"5min":0.629,"15min":0.629},"max":{"1min":2.1589999999999998,"5min":2.1589999999999998,"15min":2.1589999999999998},"last":1.3109999999999999}]},{"osd":13,"last update":"Thu Apr 18 14:44:22 2024","interfaces":[{"interface":"back","average":{"1min":1.391,"5min":1.391,"15min":1.391},"min":{"1min":1.0109999999999999,"5min":1.0109999999999999,"15min":1.0109999999999999},"max":{"1min":1.9419999999999999,"5min":1.9419999999999999,"15min":1.9419999999999999},"last":1.748},{"interface":"front","average":{"1min":1.387,"5min":1.387,"15min":1.387},"min":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"max":{"1min":1.8959999999999999,"5min":1.8959999999999999,"15min":1.8959999999999999},"last":1.8720000000000001}]},{"osd":14,"last update":"Thu Apr 18 14:44:19 2024","interfaces":[{"interface":"back","average":{"1min":1.4279999999999999,"5min":1.4279999999999999,"15min":1.4279999999999999},"min":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"max":{"1min":2.351,"5min":2.351,"15min":2.351},"last":1.611},{"interface":"front","average":{"1min":1.454,"5min":1.454,"15min":1.454},"min":{"1min":0.84299999999999997,"5min":0.84299999999999997,"15min":0.84299999999999997},"max":{"1min":2.766,"5min":2.766,"15min":2.766},"last":1.782}]}]},{"osd":4,"up_from":22,"seq":94489280538,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":51000,"kb_used_data":1832,"kb_used_omap":1,"kb_used_meta":49150,"kb_avail":94320840,"statfs":{"total":96636764160,"available":96584540160,"internally_reserved":0,"allocated":1875968,"data_stored":1087311,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":50330054},"hb_peers":[2,3,5,6,10,11,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":2,"last update":"Thu Apr 18 14:44:20 2024","interfaces":[{"interface":"back","average":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":1.2330000000000001,"5min":1.2330000000000001,"15min":1.2330000000000001},"last":1.171},{"interface":"front","average":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":1.306,"5min":1.306,"15min":1.306},"last":1.21}]},{"osd":3,"last update":"Thu Apr 18 14:44:20 2024","interfaces":[{"interface":"back","average":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":1.1499999999999999,"5min":1.1499999999999999,"15min":1.1499999999999999},"last":0.92900000000000005},{"interface":"front","average":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":1.0169999999999999,"5min":1.0169999999999999,"15min":1.0169999999999999},"last":1.054}]},{"osd":5,"last update":"Thu Apr 18 14:44:20 2024","interfaces":[{"interface":"back","average":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":1.0609999999999999,"5min":1.0609999999999999,"15min":1.0609999999999999},"last":0.99399999999999999},{"interface":"front","average":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":1.2190000000000001,"5min":1.2190000000000001,"15min":1.2190000000000001},"last":1.135}]},{"osd":6,"last update":"Thu Apr 18 14:44:20 2024","interfaces":[{"interface":"back","average":{"1min":0.84999999999999998,"5min":0.84999999999999998,"15min":0.84999999999999998},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":1.1930000000000001,"5min":1.1930000000000001,"15min":1.1930000000000001},"last":1.446},{"interface":"front","average":{"1min":0.88,"5min":0.88,"15min":0.88},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.337,"5min":1.337,"15min":1.337},"last":1.304}]},{"osd":10,"last update":"Thu Apr 18 14:44:20 2024","interfaces":[{"interface":"back","average":{"1min":0.876,"5min":0.876,"15min":0.876},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":1.49,"5min":1.49,"15min":1.49},"last":1.8009999999999999},{"interface":"front","average":{"1min":0.90900000000000003,"5min":0.90900000000000003,"15min":0.90900000000000003},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.5700000000000001,"5min":1.5700000000000001,"15min":1.5700000000000001},"last":1.3660000000000001}]},{"osd":11,"last update":"Thu Apr 18 14:44:20 2024","interfaces":[{"interface":"back","average":{"1min":0.86499999999999999,"5min":0.86499999999999999,"15min":0.86499999999999999},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":1.2130000000000001,"5min":1.2130000000000001,"15min":1.2130000000000001},"last":1.3400000000000001},{"interface":"front","average":{"1min":0.90100000000000002,"5min":0.90100000000000002,"15min":0.90100000000000002},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.365,"5min":1.365,"15min":1.365},"last":1.6719999999999999}]},{"osd":12,"last update":"Thu Apr 18 14:44:20 2024","interfaces":[{"interface":"back","average":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":1.1879999999999999,"5min":1.1879999999999999,"15min":1.1879999999999999},"last":1.276},{"interface":"front","average":{"1min":0.86099999999999999,"5min":0.86099999999999999,"15min":0.86099999999999999},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":1.2949999999999999,"5min":1.2949999999999999,"15min":1.2949999999999999},"last":1.901}]},{"osd":13,"last update":"Thu Apr 18 14:44:20 2024","interfaces":[{"interface":"back","average":{"1min":0.95999999999999996,"5min":0.95999999999999996,"15min":0.95999999999999996},"min":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.4279999999999999,"5min":1.4279999999999999,"15min":1.4279999999999999},"last":1.974},{"interface":"front","average":{"1min":0.89900000000000002,"5min":0.89900000000000002,"15min":0.89900000000000002},"min":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"max":{"1min":1.3360000000000001,"5min":1.3360000000000001,"15min":1.3360000000000001},"last":1.75}]},{"osd":14,"last update":"Thu Apr 18 14:44:20 2024","interfaces":[{"interface":"back","average":{"1min":1.022,"5min":1.022,"15min":1.022},"min":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":1.4730000000000001,"5min":1.4730000000000001,"15min":1.4730000000000001},"last":1.601},{"interface":"front","average":{"1min":1.0429999999999999,"5min":1.0429999999999999,"15min":1.0429999999999999},"min":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"max":{"1min":1.369,"5min":1.369,"15min":1.369},"last":1.5660000000000001}]},{"osd":15,"last update":"Thu Apr 18 14:44:20 2024","interfaces":[{"interface":"back","average":{"1min":1.016,"5min":1.016,"15min":1.016},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.5980000000000001,"5min":1.5980000000000001,"15min":1.5980000000000001},"last":1.639},{"interface":"front","average":{"1min":1.02,"5min":1.02,"15min":1.02},"min":{"1min":0.624,"5min":0.624,"15min":0.624},"max":{"1min":1.5649999999999999,"5min":1.5649999999999999,"15min":1.5649999999999999},"last":2.0369999999999999}]}]},{"osd":6,"up_from":22,"seq":94489280538,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32936,"kb_used_data":1820,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94338904,"statfs":{"total":96636764160,"available":96603037696,"internally_reserved":0,"allocated":1863680,"data_stored":1078641,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31848903},"hb_peers":[0,1,5,7,8,9,11,12,13,14],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Apr 18 14:44:30 2024","interfaces":[{"interface":"back","average":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":1.5629999999999999,"5min":1.5629999999999999,"15min":1.5629999999999999},"last":0.55200000000000005},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":1.006,"5min":1.006,"15min":1.006},"last":0.59499999999999997}]},{"osd":1,"last update":"Thu Apr 18 14:44:19 2024","interfaces":[{"interface":"back","average":{"1min":1.0329999999999999,"5min":1.0329999999999999,"15min":1.0329999999999999},"min":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"max":{"1min":1.633,"5min":1.633,"15min":1.633},"last":0.88600000000000001},{"interface":"front","average":{"1min":1.129,"5min":1.129,"15min":1.129},"min":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"max":{"1min":1.585,"5min":1.585,"15min":1.585},"last":1.345}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95399999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86599999999999999}]},{"osd":5,"last update":"Thu Apr 18 14:44:19 2024","interfaces":[{"interface":"back","average":{"1min":0.96399999999999997,"5min":0.96399999999999997,"15min":0.96399999999999997},"min":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":1.627,"5min":1.627,"15min":1.627},"last":0.69399999999999995},{"interface":"front","average":{"1min":0.98199999999999998,"5min":0.98199999999999998,"15min":0.98199999999999998},"min":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"max":{"1min":1.246,"5min":1.246,"15min":1.246},"last":1.2210000000000001}]},{"osd":7,"last update":"Thu Apr 18 14:44:19 2024","interfaces":[{"interface":"back","average":{"1min":1.1399999999999999,"5min":1.1399999999999999,"15min":1.1399999999999999},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.5860000000000001,"5min":1.5860000000000001,"15min":1.5860000000000001},"last":1.4059999999999999},{"interface":"front","average":{"1min":1.022,"5min":1.022,"15min":1.022},"min":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":1.482,"5min":1.482,"15min":1.482},"last":1.0569999999999999}]},{"osd":8,"last update":"Thu Apr 18 14:44:19 2024","interfaces":[{"interface":"back","average":{"1min":0.99299999999999999,"5min":0.99299999999999999,"15min":0.99299999999999999},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.3380000000000001,"5min":1.3380000000000001,"15min":1.3380000000000001},"last":0.753},{"interface":"front","average":{"1min":1.163,"5min":1.163,"15min":1.163},"min":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"max":{"1min":1.673,"5min":1.673,"15min":1.673},"last":0.84699999999999998}]},{"osd":9,"last update":"Thu Apr 18 14:44:30 2024","interfaces":[{"interface":"back","average":{"1min":1.1279999999999999,"5min":1.1279999999999999,"15min":1.1279999999999999},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.3859999999999999,"5min":1.3859999999999999,"15min":1.3859999999999999},"last":0.80300000000000005},{"interface":"front","average":{"1min":1.1870000000000001,"5min":1.1870000000000001,"15min":1.1870000000000001},"min":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"max":{"1min":1.5640000000000001,"5min":1.5640000000000001,"15min":1.5640000000000001},"last":1.298}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3240000000000001}]},{"osd":11,"last update":"Thu Apr 18 14:44:17 2024","interfaces":[{"interface":"back","average":{"1min":1.359,"5min":1.359,"15min":1.359},"min":{"1min":1.0229999999999999,"5min":1.0229999999999999,"15min":1.0229999999999999},"max":{"1min":2.3610000000000002,"5min":2.3610000000000002,"15min":2.3610000000000002},"last":1.151},{"interface":"front","average":{"1min":1.1439999999999999,"5min":1.1439999999999999,"15min":1.1439999999999999},"min":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"max":{"1min":1.698,"5min":1.698,"15min":1.698},"last":1.1859999999999999}]},{"osd":12,"last update":"Thu Apr 18 14:44:17 2024","interfaces":[{"interface":"back","average":{"1min":1.1950000000000001,"5min":1.1950000000000001,"15min":1.1950000000000001},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.5189999999999999,"5min":1.5189999999999999,"15min":1.5189999999999999},"last":1.0860000000000001},{"interface":"front","average":{"1min":1.3400000000000001,"5min":1.3400000000000001,"15min":1.3400000000000001},"min":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"max":{"1min":2.1920000000000002,"5min":2.1920000000000002,"15min":2.1920000000000002},"last":1.272}]},{"osd":13,"last update":"Thu Apr 18 14:44:30 2024","interfaces":[{"interface":"back","average":{"1min":1.4139999999999999,"5min":1.4139999999999999,"15min":1.4139999999999999},"min":{"1min":1.0309999999999999,"5min":1.0309999999999999,"15min":1.0309999999999999},"max":{"1min":1.794,"5min":1.794,"15min":1.794},"last":1.498},{"interface":"front","average":{"1min":1.29,"5min":1.29,"15min":1.29},"min":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":0.94599999999999995},"max":{"1min":1.591,"5min":1.591,"15min":1.591},"last":1.2470000000000001}]},{"osd":14,"last update":"Thu Apr 18 14:44:17 2024","interfaces":[{"interface":"back","average":{"1min":1.3280000000000001,"5min":1.3280000000000001,"15min":1.3280000000000001},"min":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"max":{"1min":1.8580000000000001,"5min":1.8580000000000001,"15min":1.8580000000000001},"last":1.5600000000000001},{"interface":"front","average":{"1min":1.347,"5min":1.347,"15min":1.347},"min":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":1.712,"5min":1.712,"15min":1.712},"last":1.325}]}]},{"osd":10,"up_from":22,"seq":94489280539,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32952,"kb_used_data":1832,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94338888,"statfs":{"total":96636764160,"available":96603021312,"internally_reserved":0,"allocated":1875968,"data_stored":1087311,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1599,"internal_metadata":31848897},"hb_peers":[1,6,7,8,9,11,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89700000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.371}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.117}]},{"osd":6,"last update":"Thu Apr 18 14:44:20 2024","interfaces":[{"interface":"back","average":{"1min":1.1830000000000001,"5min":1.1830000000000001,"15min":1.1830000000000001},"min":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"max":{"1min":3.9830000000000001,"5min":3.9830000000000001,"15min":3.9830000000000001},"last":0.83899999999999997},{"interface":"front","average":{"1min":1.0309999999999999,"5min":1.0309999999999999,"15min":1.0309999999999999},"min":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"max":{"1min":2.9420000000000002,"5min":2.9420000000000002,"15min":2.9420000000000002},"last":0.93899999999999995}]},{"osd":7,"last update":"Thu Apr 18 14:44:32 2024","interfaces":[{"interface":"back","average":{"1min":1.1870000000000001,"5min":1.1870000000000001,"15min":1.1870000000000001},"min":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":3.3679999999999999,"5min":3.3679999999999999,"15min":3.3679999999999999},"last":1.1080000000000001},{"interface":"front","average":{"1min":1.2190000000000001,"5min":1.2190000000000001,"15min":1.2190000000000001},"min":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"max":{"1min":3.1669999999999998,"5min":3.1669999999999998,"15min":3.1669999999999998},"last":1.357}]},{"osd":8,"last update":"Thu Apr 18 14:44:20 2024","interfaces":[{"interface":"back","average":{"1min":1.091,"5min":1.091,"15min":1.091},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":4.0439999999999996,"5min":4.0439999999999996,"15min":4.0439999999999996},"last":1.0800000000000001},{"interface":"front","average":{"1min":1.4390000000000001,"5min":1.4390000000000001,"15min":1.4390000000000001},"min":{"1min":0.89500000000000002,"5min":0.89500000000000002,"15min":0.89500000000000002},"max":{"1min":4.4900000000000002,"5min":4.4900000000000002,"15min":4.4900000000000002},"last":1.167}]},{"osd":9,"last update":"Thu Apr 18 14:44:20 2024","interfaces":[{"interface":"back","average":{"1min":1.3580000000000001,"5min":1.3580000000000001,"15min":1.3580000000000001},"min":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"max":{"1min":3.8439999999999999,"5min":3.8439999999999999,"15min":3.8439999999999999},"last":1.4570000000000001},{"interface":"front","average":{"1min":1.361,"5min":1.361,"15min":1.361},"min":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"max":{"1min":4.2880000000000003,"5min":4.2880000000000003,"15min":4.2880000000000003},"last":1.286}]},{"osd":11,"last update":"Thu Apr 18 14:44:20 2024","interfaces":[{"interface":"back","average":{"1min":1.4159999999999999,"5min":1.4159999999999999,"15min":1.4159999999999999},"min":{"1min":0.755,"5min":0.755,"15min":0.755},"max":{"1min":4.3399999999999999,"5min":4.3399999999999999,"15min":4.3399999999999999},"last":1.4039999999999999},{"interface":"front","average":{"1min":1.5740000000000001,"5min":1.5740000000000001,"15min":1.5740000000000001},"min":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"max":{"1min":4.4450000000000003,"5min":4.4450000000000003,"15min":4.4450000000000003},"last":1.7130000000000001}]},{"osd":12,"last update":"Thu Apr 18 14:44:20 2024","interfaces":[{"interface":"back","average":{"1min":1.3440000000000001,"5min":1.3440000000000001,"15min":1.3440000000000001},"min":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"max":{"1min":3.5539999999999998,"5min":3.5539999999999998,"15min":3.5539999999999998},"last":1.774},{"interface":"front","average":{"1min":1.431,"5min":1.431,"15min":1.431},"min":{"1min":0.621,"5min":0.621,"15min":0.621},"max":{"1min":4.125,"5min":4.125,"15min":4.125},"last":1.546}]},{"osd":13,"last update":"Thu Apr 18 14:44:20 2024","interfaces":[{"interface":"back","average":{"1min":1.71,"5min":1.71,"15min":1.71},"min":{"1min":1.1160000000000001,"5min":1.1160000000000001,"15min":1.1160000000000001},"max":{"1min":4.5359999999999996,"5min":4.5359999999999996,"15min":4.5359999999999996},"last":1.506},{"interface":"front","average":{"1min":1.5429999999999999,"5min":1.5429999999999999,"15min":1.5429999999999999},"min":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.85599999999999998},"max":{"1min":4.0049999999999999,"5min":4.0049999999999999,"15min":4.0049999999999999},"last":1.847}]},{"osd":14,"last update":"Thu Apr 18 14:44:20 2024","interfaces":[{"interface":"back","average":{"1min":1.7090000000000001,"5min":1.7090000000000001,"15min":1.7090000000000001},"min":{"1min":1.073,"5min":1.073,"15min":1.073},"max":{"1min":4.3940000000000001,"5min":4.3940000000000001,"15min":4.3940000000000001},"last":1.879},{"interface":"front","average":{"1min":1.5680000000000001,"5min":1.5680000000000001,"15min":1.5680000000000001},"min":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"max":{"1min":3.73,"5min":3.73,"15min":3.73},"last":1.897}]},{"osd":15,"last update":"Thu Apr 18 14:44:20 2024","interfaces":[{"interface":"back","average":{"1min":1.5629999999999999,"5min":1.5629999999999999,"15min":1.5629999999999999},"min":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":0.94999999999999996},"max":{"1min":4.1959999999999997,"5min":4.1959999999999997,"15min":4.1959999999999997},"last":1.748},{"interface":"front","average":{"1min":1.802,"5min":1.802,"15min":1.802},"min":{"1min":1.1579999999999999,"5min":1.1579999999999999,"15min":1.1579999999999999},"max":{"1min":4.577,"5min":4.577,"15min":4.577},"last":1.8100000000000001}]}]},{"osd":11,"up_from":22,"seq":94489280539,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32932,"kb_used_data":1816,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94338908,"statfs":{"total":96636764160,"available":96603041792,"internally_reserved":0,"allocated":1859584,"data_stored":1077797,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31848901},"hb_peers":[2,4,5,6,8,10,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":2,"last update":"Thu Apr 18 14:44:18 2024","interfaces":[{"interface":"back","average":{"1min":0.93899999999999995,"5min":0.93899999999999995,"15min":0.93899999999999995},"min":{"1min":0.503,"5min":0.503,"15min":0.503},"max":{"1min":1.367,"5min":1.367,"15min":1.367},"last":1.224},{"interface":"front","average":{"1min":1.0229999999999999,"5min":1.0229999999999999,"15min":1.0229999999999999},"min":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":2.863,"5min":2.863,"15min":2.863},"last":0.86099999999999999}]},{"osd":4,"last update":"Thu Apr 18 14:44:18 2024","interfaces":[{"interface":"back","average":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"min":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":1.1259999999999999,"5min":1.1259999999999999,"15min":1.1259999999999999},"last":0.79000000000000004},{"interface":"front","average":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.129,"5min":1.129,"15min":1.129},"last":0.66700000000000004}]},{"osd":5,"last update":"Thu Apr 18 14:44:23 2024","interfaces":[{"interface":"back","average":{"1min":0.98999999999999999,"5min":0.98999999999999999,"15min":0.98999999999999999},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":1.5840000000000001,"5min":1.5840000000000001,"15min":1.5840000000000001},"last":1.2729999999999999},{"interface":"front","average":{"1min":0.97199999999999998,"5min":0.97199999999999998,"15min":0.97199999999999998},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.619,"5min":1.619,"15min":1.619},"last":1.4330000000000001}]},{"osd":6,"last update":"Thu Apr 18 14:44:18 2024","interfaces":[{"interface":"back","average":{"1min":1.1319999999999999,"5min":1.1319999999999999,"15min":1.1319999999999999},"min":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"max":{"1min":2.9199999999999999,"5min":2.9199999999999999,"15min":2.9199999999999999},"last":1.464},{"interface":"front","average":{"1min":1,"5min":1,"15min":1},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.9510000000000001,"5min":1.9510000000000001,"15min":1.9510000000000001},"last":1.363}]},{"osd":8,"last update":"Thu Apr 18 14:44:23 2024","interfaces":[{"interface":"back","average":{"1min":0.97799999999999998,"5min":0.97799999999999998,"15min":0.97799999999999998},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.452,"5min":1.452,"15min":1.452},"last":0.96599999999999997},{"interface":"front","average":{"1min":1.006,"5min":1.006,"15min":1.006},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":1.383,"5min":1.383,"15min":1.383},"last":1.5669999999999999}]},{"osd":10,"last update":"Thu Apr 18 14:44:18 2024","interfaces":[{"interface":"back","average":{"1min":1.234,"5min":1.234,"15min":1.234},"min":{"1min":0.745,"5min":0.745,"15min":0.745},"max":{"1min":2.774,"5min":2.774,"15min":2.774},"last":1.595},{"interface":"front","average":{"1min":1.105,"5min":1.105,"15min":1.105},"min":{"1min":0.627,"5min":0.627,"15min":0.627},"max":{"1min":1.6890000000000001,"5min":1.6890000000000001,"15min":1.6890000000000001},"last":1.4990000000000001}]},{"osd":12,"last update":"Thu Apr 18 14:44:18 2024","interfaces":[{"interface":"back","average":{"1min":1.1639999999999999,"5min":1.1639999999999999,"15min":1.1639999999999999},"min":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.6719999999999999,"5min":1.6719999999999999,"15min":1.6719999999999999},"last":2.0270000000000001},{"interface":"front","average":{"1min":1.2729999999999999,"5min":1.2729999999999999,"15min":1.2729999999999999},"min":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"max":{"1min":3.4169999999999998,"5min":3.4169999999999998,"15min":3.4169999999999998},"last":1.738}]},{"osd":13,"last update":"Thu Apr 18 14:44:23 2024","interfaces":[{"interface":"back","average":{"1min":1.367,"5min":1.367,"15min":1.367},"min":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"max":{"1min":3.3239999999999998,"5min":3.3239999999999998,"15min":3.3239999999999998},"last":1.9410000000000001},{"interface":"front","average":{"1min":1.1639999999999999,"5min":1.1639999999999999,"15min":1.1639999999999999},"min":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"max":{"1min":1.746,"5min":1.746,"15min":1.746},"last":1.6619999999999999}]},{"osd":14,"last update":"Thu Apr 18 14:44:18 2024","interfaces":[{"interface":"back","average":{"1min":1.1950000000000001,"5min":1.1950000000000001,"15min":1.1950000000000001},"min":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"max":{"1min":1.6619999999999999,"5min":1.6619999999999999,"15min":1.6619999999999999},"last":1.8899999999999999},{"interface":"front","average":{"1min":1.2450000000000001,"5min":1.2450000000000001,"15min":1.2450000000000001},"min":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"max":{"1min":1.7210000000000001,"5min":1.7210000000000001,"15min":1.7210000000000001},"last":1.9750000000000001}]},{"osd":15,"last update":"Thu Apr 18 14:44:23 2024","interfaces":[{"interface":"back","average":{"1min":1.284,"5min":1.284,"15min":1.284},"min":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"max":{"1min":1.851,"5min":1.851,"15min":1.851},"last":1.8320000000000001},{"interface":"front","average":{"1min":1.409,"5min":1.409,"15min":1.409},"min":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"max":{"1min":3.3769999999999998,"5min":3.3769999999999998,"15min":3.3769999999999998},"last":2.1520000000000001}]}]},{"osd":12,"up_from":22,"seq":94489280539,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32932,"kb_used_data":1816,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94338908,"statfs":{"total":96636764160,"available":96603041792,"internally_reserved":0,"allocated":1859584,"data_stored":1077797,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[1,3,4,5,6,10,11,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Apr 18 14:44:30 2024","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":1.3400000000000001,"5min":1.3400000000000001,"15min":1.3400000000000001},"last":0.68100000000000005},{"interface":"front","average":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":1.2310000000000001,"5min":1.2310000000000001,"15min":1.2310000000000001},"last":0.78900000000000003}]},{"osd":1,"last update":"Thu Apr 18 14:44:20 2024","interfaces":[{"interface":"back","average":{"1min":0.93999999999999995,"5min":0.93999999999999995,"15min":0.93999999999999995},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.5449999999999999,"5min":1.5449999999999999,"15min":1.5449999999999999},"last":0.61799999999999999},{"interface":"front","average":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":1.2649999999999999,"5min":1.2649999999999999,"15min":1.2649999999999999},"last":0.85399999999999998}]},{"osd":3,"last update":"Thu Apr 18 14:44:20 2024","interfaces":[{"interface":"back","average":{"1min":0.93999999999999995,"5min":0.93999999999999995,"15min":0.93999999999999995},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":1.4930000000000001,"5min":1.4930000000000001,"15min":1.4930000000000001},"last":0.81200000000000006},{"interface":"front","average":{"1min":0.91500000000000004,"5min":0.91500000000000004,"15min":0.91500000000000004},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.4319999999999999,"5min":1.4319999999999999,"15min":1.4319999999999999},"last":0.95299999999999996}]},{"osd":4,"last update":"Thu Apr 18 14:44:20 2024","interfaces":[{"interface":"back","average":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":1.383,"5min":1.383,"15min":1.383},"last":0.76300000000000001},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":1.335,"5min":1.335,"15min":1.335},"last":0.57699999999999996}]},{"osd":5,"last update":"Thu Apr 18 14:44:30 2024","interfaces":[{"interface":"back","average":{"1min":0.93100000000000005,"5min":0.93100000000000005,"15min":0.93100000000000005},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.4710000000000001,"5min":1.4710000000000001,"15min":1.4710000000000001},"last":0.99399999999999999},{"interface":"front","average":{"1min":1.03,"5min":1.03,"15min":1.03},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.784,"5min":1.784,"15min":1.784},"last":1.284}]},{"osd":6,"last update":"Thu Apr 18 14:44:20 2024","interfaces":[{"interface":"back","average":{"1min":1.0289999999999999,"5min":1.0289999999999999,"15min":1.0289999999999999},"min":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":1.6060000000000001,"5min":1.6060000000000001,"15min":1.6060000000000001},"last":0.92800000000000005},{"interface":"front","average":{"1min":1.0820000000000001,"5min":1.0820000000000001,"15min":1.0820000000000001},"min":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"max":{"1min":1.5620000000000001,"5min":1.5620000000000001,"15min":1.5620000000000001},"last":1.022}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1539999999999999}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4119999999999999}]},{"osd":10,"last update":"Thu Apr 18 14:44:20 2024","interfaces":[{"interface":"back","average":{"1min":1.137,"5min":1.137,"15min":1.137},"min":{"1min":0.626,"5min":0.626,"15min":0.626},"max":{"1min":1.6919999999999999,"5min":1.6919999999999999,"15min":1.6919999999999999},"last":0.89800000000000002},{"interface":"front","average":{"1min":1.1100000000000001,"5min":1.1100000000000001,"15min":1.1100000000000001},"min":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"max":{"1min":1.8899999999999999,"5min":1.8899999999999999,"15min":1.8899999999999999},"last":1.0680000000000001}]},{"osd":11,"last update":"Thu Apr 18 14:44:20 2024","interfaces":[{"interface":"back","average":{"1min":1.1890000000000001,"5min":1.1890000000000001,"15min":1.1890000000000001},"min":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"max":{"1min":2.04,"5min":2.04,"15min":2.04},"last":1.1519999999999999},{"interface":"front","average":{"1min":1.1599999999999999,"5min":1.1599999999999999,"15min":1.1599999999999999},"min":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"max":{"1min":1.8660000000000001,"5min":1.8660000000000001,"15min":1.8660000000000001},"last":1.093}]},{"osd":13,"last update":"Thu Apr 18 14:44:20 2024","interfaces":[{"interface":"back","average":{"1min":1.181,"5min":1.181,"15min":1.181},"min":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"max":{"1min":1.8080000000000001,"5min":1.8080000000000001,"15min":1.8080000000000001},"last":1.1120000000000001},{"interface":"front","average":{"1min":1.228,"5min":1.228,"15min":1.228},"min":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"max":{"1min":2.133,"5min":2.133,"15min":2.133},"last":1.2529999999999999}]},{"osd":14,"last update":"Thu Apr 18 14:44:20 2024","interfaces":[{"interface":"back","average":{"1min":1.226,"5min":1.226,"15min":1.226},"min":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"max":{"1min":1.7410000000000001,"5min":1.7410000000000001,"15min":1.7410000000000001},"last":1.1919999999999999},{"interface":"front","average":{"1min":1.232,"5min":1.232,"15min":1.232},"min":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"max":{"1min":1.966,"5min":1.966,"15min":1.966},"last":1.319}]},{"osd":15,"last update":"Thu Apr 18 14:44:20 2024","interfaces":[{"interface":"back","average":{"1min":1.2190000000000001,"5min":1.2190000000000001,"15min":1.2190000000000001},"min":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"max":{"1min":1.802,"5min":1.802,"15min":1.802},"last":1.1739999999999999},{"interface":"front","average":{"1min":1.2889999999999999,"5min":1.2889999999999999,"15min":1.2889999999999999},"min":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"max":{"1min":1.8580000000000001,"5min":1.8580000000000001,"15min":1.8580000000000001},"last":1.3620000000000001}]}]},{"osd":0,"up_from":23,"seq":98784247835,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33468,"kb_used_data":2352,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94338372,"statfs":{"total":96636764160,"available":96602492928,"internally_reserved":0,"allocated":2408448,"data_stored":1616239,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[1,4,6,7,8,10,11,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Apr 18 14:44:23 2024","interfaces":[{"interface":"back","average":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":1.218,"5min":1.218,"15min":1.218},"last":1.026},{"interface":"front","average":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.47,"5min":1.47,"15min":1.47},"last":1.056}]},{"osd":4,"last update":"Thu Apr 18 14:44:19 2024","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":1.5409999999999999,"5min":1.5409999999999999,"15min":1.5409999999999999},"last":0.61499999999999999},{"interface":"front","average":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":1.903,"5min":1.903,"15min":1.903},"last":0.64000000000000001}]},{"osd":6,"last update":"Thu Apr 18 14:44:19 2024","interfaces":[{"interface":"back","average":{"1min":0.90200000000000002,"5min":0.90200000000000002,"15min":0.90200000000000002},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":2.5009999999999999,"5min":2.5009999999999999,"15min":2.5009999999999999},"last":0.96399999999999997},{"interface":"front","average":{"1min":0.89500000000000002,"5min":0.89500000000000002,"15min":0.89500000000000002},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":1.6240000000000001,"5min":1.6240000000000001,"15min":1.6240000000000001},"last":0.91100000000000003}]},{"osd":7,"last update":"Thu Apr 18 14:44:19 2024","interfaces":[{"interface":"back","average":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":1.2350000000000001,"5min":1.2350000000000001,"15min":1.2350000000000001},"last":0.71499999999999997},{"interface":"front","average":{"1min":0.93899999999999995,"5min":0.93899999999999995,"15min":0.93899999999999995},"min":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"max":{"1min":1.5860000000000001,"5min":1.5860000000000001,"15min":1.5860000000000001},"last":0.78800000000000003}]},{"osd":8,"last update":"Thu Apr 18 14:44:19 2024","interfaces":[{"interface":"back","average":{"1min":1.734,"5min":1.734,"15min":1.734},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":18.015999999999998,"5min":18.015999999999998,"15min":18.015999999999998},"last":0.73099999999999998},{"interface":"front","average":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":1.6599999999999999,"5min":1.6599999999999999,"15min":1.6599999999999999},"last":0.57499999999999996}]},{"osd":10,"last update":"Thu Apr 18 14:44:19 2024","interfaces":[{"interface":"back","average":{"1min":1.0960000000000001,"5min":1.0960000000000001,"15min":1.0960000000000001},"min":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"max":{"1min":2.1339999999999999,"5min":2.1339999999999999,"15min":2.1339999999999999},"last":1.1020000000000001},{"interface":"front","average":{"1min":1.119,"5min":1.119,"15min":1.119},"min":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"max":{"1min":1.8540000000000001,"5min":1.8540000000000001,"15min":1.8540000000000001},"last":0.94999999999999996}]},{"osd":11,"last update":"Thu Apr 18 14:44:19 2024","interfaces":[{"interface":"back","average":{"1min":2.9990000000000001,"5min":2.9990000000000001,"15min":2.9990000000000001},"min":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":41.195999999999998,"5min":41.195999999999998,"15min":41.195999999999998},"last":0.85699999999999998},{"interface":"front","average":{"1min":3.1339999999999999,"5min":3.1339999999999999,"15min":3.1339999999999999},"min":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"max":{"1min":41.216999999999999,"5min":41.216999999999999,"15min":41.216999999999999},"last":1}]},{"osd":13,"last update":"Thu Apr 18 14:44:23 2024","interfaces":[{"interface":"back","average":{"1min":0.95099999999999996,"5min":0.95099999999999996,"15min":0.95099999999999996},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":1.881,"5min":1.881,"15min":1.881},"last":0.748},{"interface":"front","average":{"1min":1.091,"5min":1.091,"15min":1.091},"min":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":1.8720000000000001,"5min":1.8720000000000001,"15min":1.8720000000000001},"last":0.82299999999999995}]},{"osd":14,"last update":"Thu Apr 18 14:44:19 2024","interfaces":[{"interface":"back","average":{"1min":1.103,"5min":1.103,"15min":1.103},"min":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"max":{"1min":1.95,"5min":1.95,"15min":1.95},"last":0.77400000000000002},{"interface":"front","average":{"1min":1.095,"5min":1.095,"15min":1.095},"min":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"max":{"1min":2.1219999999999999,"5min":2.1219999999999999,"15min":2.1219999999999999},"last":0.89000000000000001}]},{"osd":15,"last update":"Thu Apr 18 14:44:19 2024","interfaces":[{"interface":"back","average":{"1min":1.224,"5min":1.224,"15min":1.224},"min":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"max":{"1min":1.929,"5min":1.929,"15min":1.929},"last":0.93000000000000005},{"interface":"front","average":{"1min":1.179,"5min":1.179,"15min":1.179},"min":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":2.056,"5min":2.056,"15min":2.056},"last":0.97799999999999998}]}]},{"osd":3,"up_from":23,"seq":98784247834,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32956,"kb_used_data":1836,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94338884,"statfs":{"total":96636764160,"available":96603017216,"internally_reserved":0,"allocated":1880064,"data_stored":1088155,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31848904},"hb_peers":[0,2,4,5,8,9,10,11,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Apr 18 14:44:20 2024","interfaces":[{"interface":"back","average":{"1min":0.88200000000000001,"5min":0.88200000000000001,"15min":0.88200000000000001},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":1.4510000000000001,"5min":1.4510000000000001,"15min":1.4510000000000001},"last":1.387},{"interface":"front","average":{"1min":1,"5min":1,"15min":1},"min":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"max":{"1min":1.4850000000000001,"5min":1.4850000000000001,"15min":1.4850000000000001},"last":1.1719999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4590000000000001}]},{"osd":2,"last update":"Thu Apr 18 14:44:20 2024","interfaces":[{"interface":"back","average":{"1min":0.98599999999999999,"5min":0.98599999999999999,"15min":0.98599999999999999},"min":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.5469999999999999,"5min":1.5469999999999999,"15min":1.5469999999999999},"last":0.70399999999999996},{"interface":"front","average":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":0.94999999999999996},"min":{"1min":0.623,"5min":0.623,"15min":0.623},"max":{"1min":1.425,"5min":1.425,"15min":1.425},"last":0.95899999999999996}]},{"osd":4,"last update":"Thu Apr 18 14:44:20 2024","interfaces":[{"interface":"back","average":{"1min":1.008,"5min":1.008,"15min":1.008},"min":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.7030000000000001,"5min":1.7030000000000001,"15min":1.7030000000000001},"last":0.80000000000000004},{"interface":"front","average":{"1min":0.98699999999999999,"5min":0.98699999999999999,"15min":0.98699999999999999},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":1.5309999999999999,"5min":1.5309999999999999,"15min":1.5309999999999999},"last":0.92200000000000004}]},{"osd":5,"last update":"Thu Apr 18 14:44:20 2024","interfaces":[{"interface":"back","average":{"1min":1.087,"5min":1.087,"15min":1.087},"min":{"1min":0.624,"5min":0.624,"15min":0.624},"max":{"1min":1.663,"5min":1.663,"15min":1.663},"last":1.1379999999999999},{"interface":"front","average":{"1min":1.206,"5min":1.206,"15min":1.206},"min":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":1.6779999999999999,"5min":1.6779999999999999,"15min":1.6779999999999999},"last":1.2609999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.472}]},{"osd":7,"last update":"Thu Apr 18 14:44:20 2024","interfaces":[{"interface":"back","average":{"1min":1.157,"5min":1.157,"15min":1.157},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.645,"5min":1.645,"15min":1.645},"last":0.82199999999999995},{"interface":"front","average":{"1min":1.115,"5min":1.115,"15min":1.115},"min":{"1min":0.503,"5min":0.503,"15min":0.503},"max":{"1min":1.6419999999999999,"5min":1.6419999999999999,"15min":1.6419999999999999},"last":0.90800000000000003}]},{"osd":8,"last update":"Thu Apr 18 14:44:20 2024","interfaces":[{"interface":"back","average":{"1min":1.1339999999999999,"5min":1.1339999999999999,"15min":1.1339999999999999},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.7529999999999999,"5min":1.7529999999999999,"15min":1.7529999999999999},"last":1.232},{"interface":"front","average":{"1min":1.304,"5min":1.304,"15min":1.304},"min":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"max":{"1min":1.7430000000000001,"5min":1.7430000000000001,"15min":1.7430000000000001},"last":1.359}]},{"osd":9,"last update":"Thu Apr 18 14:44:33 2024","interfaces":[{"interface":"back","average":{"1min":1.3,"5min":1.3,"15min":1.3},"min":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"max":{"1min":1.879,"5min":1.879,"15min":1.879},"last":1.0069999999999999},{"interface":"front","average":{"1min":1.254,"5min":1.254,"15min":1.254},"min":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"max":{"1min":1.8260000000000001,"5min":1.8260000000000001,"15min":1.8260000000000001},"last":1.4750000000000001}]},{"osd":10,"last update":"Thu Apr 18 14:44:20 2024","interfaces":[{"interface":"back","average":{"1min":1.327,"5min":1.327,"15min":1.327},"min":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"max":{"1min":1.883,"5min":1.883,"15min":1.883},"last":1.2889999999999999},{"interface":"front","average":{"1min":1.3660000000000001,"5min":1.3660000000000001,"15min":1.3660000000000001},"min":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"max":{"1min":2.161,"5min":2.161,"15min":2.161},"last":1.663}]},{"osd":11,"last update":"Thu Apr 18 14:44:20 2024","interfaces":[{"interface":"back","average":{"1min":1.4330000000000001,"5min":1.4330000000000001,"15min":1.4330000000000001},"min":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"max":{"1min":1.8959999999999999,"5min":1.8959999999999999,"15min":1.8959999999999999},"last":1.419},{"interface":"front","average":{"1min":1.381,"5min":1.381,"15min":1.381},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":2.1160000000000001,"5min":2.1160000000000001,"15min":2.1160000000000001},"last":1.0720000000000001}]},{"osd":12,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.8740000000000001}]},{"osd":14,"last update":"Thu Apr 18 14:44:20 2024","interfaces":[{"interface":"back","average":{"1min":1.512,"5min":1.512,"15min":1.512},"min":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":0.94999999999999996},"max":{"1min":2.2879999999999998,"5min":2.2879999999999998,"15min":2.2879999999999998},"last":1.5760000000000001},{"interface":"front","average":{"1min":1.4139999999999999,"5min":1.4139999999999999,"15min":1.4139999999999999},"min":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"max":{"1min":2.0179999999999998,"5min":2.0179999999999998,"15min":2.0179999999999998},"last":1.7270000000000001}]},{"osd":15,"last update":"Thu Apr 18 14:44:33 2024","interfaces":[{"interface":"back","average":{"1min":1.4730000000000001,"5min":1.4730000000000001,"15min":1.4730000000000001},"min":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"max":{"1min":2.1120000000000001,"5min":2.1120000000000001,"15min":2.1120000000000001},"last":1.786},{"interface":"front","average":{"1min":1.452,"5min":1.452,"15min":1.452},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.9299999999999999,"5min":1.9299999999999999,"15min":1.9299999999999999},"last":1.496}]}]},{"osd":7,"up_from":23,"seq":98784247836,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32952,"kb_used_data":1832,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94338888,"statfs":{"total":96636764160,"available":96603021312,"internally_reserved":0,"allocated":1875968,"data_stored":1087311,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":31848907},"hb_peers":[0,2,3,4,5,6,8,10,12,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Apr 18 14:44:34 2024","interfaces":[{"interface":"back","average":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":1.109,"5min":1.109,"15min":1.109},"last":0.70199999999999996},{"interface":"front","average":{"1min":0.873,"5min":0.873,"15min":0.873},"min":{"1min":0.505,"5min":0.505,"15min":0.505},"max":{"1min":1.7589999999999999,"5min":1.7589999999999999,"15min":1.7589999999999999},"last":0.67400000000000004}]},{"osd":2,"last update":"Thu Apr 18 14:44:21 2024","interfaces":[{"interface":"back","average":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"min":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":1.1519999999999999,"5min":1.1519999999999999,"15min":1.1519999999999999},"last":0.78900000000000003},{"interface":"front","average":{"1min":0.97599999999999998,"5min":0.97599999999999998,"15min":0.97599999999999998},"min":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"max":{"1min":1.891,"5min":1.891,"15min":1.891},"last":0.91900000000000004}]},{"osd":3,"last update":"Thu Apr 18 14:44:34 2024","interfaces":[{"interface":"back","average":{"1min":0.88200000000000001,"5min":0.88200000000000001,"15min":0.88200000000000001},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.5920000000000001,"5min":1.5920000000000001,"15min":1.5920000000000001},"last":0.58499999999999996},{"interface":"front","average":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":1.2330000000000001,"5min":1.2330000000000001,"15min":1.2330000000000001},"last":0.875}]},{"osd":4,"last update":"Thu Apr 18 14:44:21 2024","interfaces":[{"interface":"back","average":{"1min":0.95699999999999996,"5min":0.95699999999999996,"15min":0.95699999999999996},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.258,"5min":1.258,"15min":1.258},"last":1.091},{"interface":"front","average":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":1.2170000000000001,"5min":1.2170000000000001,"15min":1.2170000000000001},"last":1.0620000000000001}]},{"osd":5,"last update":"Thu Apr 18 14:44:21 2024","interfaces":[{"interface":"back","average":{"1min":1.1140000000000001,"5min":1.1140000000000001,"15min":1.1140000000000001},"min":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"max":{"1min":1.8580000000000001,"5min":1.8580000000000001,"15min":1.8580000000000001},"last":1.022},{"interface":"front","average":{"1min":1.1120000000000001,"5min":1.1120000000000001,"15min":1.1120000000000001},"min":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"max":{"1min":1.53,"5min":1.53,"15min":1.53},"last":0.95299999999999996}]},{"osd":6,"last update":"Thu Apr 18 14:44:21 2024","interfaces":[{"interface":"back","average":{"1min":1.139,"5min":1.139,"15min":1.139},"min":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"max":{"1min":1.8759999999999999,"5min":1.8759999999999999,"15min":1.8759999999999999},"last":1.1160000000000001},{"interface":"front","average":{"1min":1.171,"5min":1.171,"15min":1.171},"min":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"max":{"1min":1.4570000000000001,"5min":1.4570000000000001,"15min":1.4570000000000001},"last":0.84699999999999998}]},{"osd":8,"last update":"Thu Apr 18 14:44:21 2024","interfaces":[{"interface":"back","average":{"1min":1.095,"5min":1.095,"15min":1.095},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":1.4159999999999999,"5min":1.4159999999999999,"15min":1.4159999999999999},"last":0.622},{"interface":"front","average":{"1min":1.274,"5min":1.274,"15min":1.274},"min":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"max":{"1min":1.821,"5min":1.821,"15min":1.821},"last":0.753}]},{"osd":10,"last update":"Thu Apr 18 14:44:21 2024","interfaces":[{"interface":"back","average":{"1min":1.151,"5min":1.151,"15min":1.151},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.831,"5min":1.831,"15min":1.831},"last":0.97699999999999998},{"interface":"front","average":{"1min":1.278,"5min":1.278,"15min":1.278},"min":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"max":{"1min":1.53,"5min":1.53,"15min":1.53},"last":0.996}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71699999999999997}]},{"osd":12,"last update":"Thu Apr 18 14:44:21 2024","interfaces":[{"interface":"back","average":{"1min":1.2270000000000001,"5min":1.2270000000000001,"15min":1.2270000000000001},"min":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.7549999999999999,"5min":1.7549999999999999,"15min":1.7549999999999999},"last":0.73099999999999998},{"interface":"front","average":{"1min":1.4039999999999999,"5min":1.4039999999999999,"15min":1.4039999999999999},"min":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"max":{"1min":2.0960000000000001,"5min":2.0960000000000001,"15min":2.0960000000000001},"last":0.81799999999999995}]},{"osd":14,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3819999999999999}]},{"osd":15,"last update":"Thu Apr 18 14:44:21 2024","interfaces":[{"interface":"back","average":{"1min":1.4330000000000001,"5min":1.4330000000000001,"15min":1.4330000000000001},"min":{"1min":0.874,"5min":0.874,"15min":0.874},"max":{"1min":2.6699999999999999,"5min":2.6699999999999999,"15min":2.6699999999999999},"last":1.1639999999999999},{"interface":"front","average":{"1min":1.401,"5min":1.401,"15min":1.401},"min":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":2.516,"5min":2.516,"15min":2.516},"last":1.1399999999999999}]}]},{"osd":8,"up_from":23,"seq":98784247836,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32956,"kb_used_data":1832,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94338884,"statfs":{"total":96636764160,"available":96603017216,"internally_reserved":0,"allocated":1875968,"data_stored":1087311,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[1,2,3,4,5,7,9,11,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Apr 18 14:44:32 2024","interfaces":[{"interface":"back","average":{"1min":0.746,"5min":0.746,"15min":0.746},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":1.7290000000000001,"5min":1.7290000000000001,"15min":1.7290000000000001},"last":2.4540000000000002},{"interface":"front","average":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":2.48,"5min":2.48,"15min":2.48},"last":2.1669999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72999999999999998}]},{"osd":2,"last update":"Thu Apr 18 14:44:22 2024","interfaces":[{"interface":"back","average":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":1.1339999999999999,"5min":1.1339999999999999,"15min":1.1339999999999999},"last":0.76600000000000001},{"interface":"front","average":{"1min":0.996,"5min":0.996,"15min":0.996},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":2.54,"5min":2.54,"15min":2.54},"last":0.50700000000000001}]},{"osd":3,"last update":"Thu Apr 18 14:44:32 2024","interfaces":[{"interface":"back","average":{"1min":0.88800000000000001,"5min":0.88800000000000001,"15min":0.88800000000000001},"min":{"1min":0.628,"5min":0.628,"15min":0.628},"max":{"1min":1.137,"5min":1.137,"15min":1.137},"last":0.70199999999999996},{"interface":"front","average":{"1min":1.0209999999999999,"5min":1.0209999999999999,"15min":1.0209999999999999},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":2.6779999999999999,"5min":2.6779999999999999,"15min":2.6779999999999999},"last":0.58999999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46899999999999997}]},{"osd":5,"last update":"Thu Apr 18 14:44:22 2024","interfaces":[{"interface":"back","average":{"1min":1.0549999999999999,"5min":1.0549999999999999,"15min":1.0549999999999999},"min":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":2.7810000000000001,"5min":2.7810000000000001,"15min":2.7810000000000001},"last":0.753},{"interface":"front","average":{"1min":0.91800000000000004,"5min":0.91800000000000004,"15min":0.91800000000000004},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.5309999999999999,"5min":1.5309999999999999,"15min":1.5309999999999999},"last":0.55500000000000005}]},{"osd":7,"last update":"Thu Apr 18 14:44:22 2024","interfaces":[{"interface":"back","average":{"1min":1.042,"5min":1.042,"15min":1.042},"min":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":1.925,"5min":1.925,"15min":1.925},"last":0.63400000000000001},{"interface":"front","average":{"1min":1.0800000000000001,"5min":1.0800000000000001,"15min":1.0800000000000001},"min":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"max":{"1min":1.669,"5min":1.669,"15min":1.669},"last":0.84199999999999997}]},{"osd":9,"last update":"Thu Apr 18 14:44:22 2024","interfaces":[{"interface":"back","average":{"1min":1.0249999999999999,"5min":1.0249999999999999,"15min":1.0249999999999999},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":1.6479999999999999,"5min":1.6479999999999999,"15min":1.6479999999999999},"last":0.64400000000000002},{"interface":"front","average":{"1min":1.163,"5min":1.163,"15min":1.163},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":2.9319999999999999,"5min":2.9319999999999999,"15min":2.9319999999999999},"last":0.53800000000000003}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.665}]},{"osd":11,"last update":"Thu Apr 18 14:44:22 2024","interfaces":[{"interface":"back","average":{"1min":1.206,"5min":1.206,"15min":1.206},"min":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"max":{"1min":2.1139999999999999,"5min":2.1139999999999999,"15min":2.1139999999999999},"last":0.85599999999999998},{"interface":"front","average":{"1min":1.2929999999999999,"5min":1.2929999999999999,"15min":1.2929999999999999},"min":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"max":{"1min":2.25,"5min":2.25,"15min":2.25},"last":0.79800000000000004}]},{"osd":12,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5629999999999999}]},{"osd":14,"last update":"Thu Apr 18 14:44:22 2024","interfaces":[{"interface":"back","average":{"1min":1.341,"5min":1.341,"15min":1.341},"min":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"max":{"1min":2.5800000000000001,"5min":2.5800000000000001,"15min":2.5800000000000001},"last":0.81999999999999995},{"interface":"front","average":{"1min":1.3919999999999999,"5min":1.3919999999999999,"15min":1.3919999999999999},"min":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"max":{"1min":3.0739999999999998,"5min":3.0739999999999998,"15min":3.0739999999999998},"last":0.81299999999999994}]},{"osd":15,"last update":"Thu Apr 18 14:44:22 2024","interfaces":[{"interface":"back","average":{"1min":1.355,"5min":1.355,"15min":1.355},"min":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"max":{"1min":2.4740000000000002,"5min":2.4740000000000002,"15min":2.4740000000000002},"last":0.878},{"interface":"front","average":{"1min":1.4159999999999999,"5min":1.4159999999999999,"15min":1.4159999999999999},"min":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"max":{"1min":2.8620000000000001,"5min":2.8620000000000001,"15min":2.8620000000000001},"last":0.78500000000000003}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":13,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":12,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":13,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":14,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":15,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-18T14:45:12.798 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-18T14:45:13.070 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-04-18T14:45:13.071 INFO:teuthology.orchestra.run.smithi086.stdout:{"epoch":125,"fsid":"ac90c892-1809-401c-a743-76948b63c51a","created":"2024-04-18T14:43:04.477846+0000","modified":"2024-04-18T14:45:06.846602+0000","last_up_change":"2024-04-18T14:43:19.299757+0000","last_in_change":"2024-04-18T14:44:09.371862+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":16,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-18T14:43:17.412189+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":15.380000114440918,"score_stable":15.380000114440918,"optimal_score":0.12999999523162842,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-04-18T14:43:20.259109+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":3.9900000095367432,"score_stable":3.9900000095367432,"optimal_score":0.68999999761581421,"raw_score_acting":2.75,"raw_score_stable":2.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a2e10d33-3d09-4c39-aa08-15b3f6e81c8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":23,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6804","nonce":24964},{"type":"v1","addr":"172.21.15.86:6806","nonce":24964}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6809","nonce":24964},{"type":"v1","addr":"172.21.15.86:6812","nonce":24964}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6819","nonce":24964},{"type":"v1","addr":"172.21.15.86:6821","nonce":24964}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6814","nonce":24964},{"type":"v1","addr":"172.21.15.86:6817","nonce":24964}]},"public_addr":"172.21.15.86:6806/24964","cluster_addr":"172.21.15.86:6812/24964","heartbeat_back_addr":"172.21.15.86:6821/24964","heartbeat_front_addr":"172.21.15.86:6817/24964","state":["exists","up"]},{"osd":1,"uuid":"9a6146f9-1780-409a-a0a5-e411bc40d674","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6824","nonce":24895},{"type":"v1","addr":"172.21.15.96:6825","nonce":24895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6826","nonce":24895},{"type":"v1","addr":"172.21.15.96:6827","nonce":24895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6830","nonce":24895},{"type":"v1","addr":"172.21.15.96:6831","nonce":24895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6828","nonce":24895},{"type":"v1","addr":"172.21.15.96:6829","nonce":24895}]},"public_addr":"172.21.15.96:6825/24895","cluster_addr":"172.21.15.96:6827/24895","heartbeat_back_addr":"172.21.15.96:6831/24895","heartbeat_front_addr":"172.21.15.96:6829/24895","state":["exists","up"]},{"osd":2,"uuid":"9c040397-fc12-4375-b34c-b7f3b5c299ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6817","nonce":24902},{"type":"v1","addr":"172.21.15.119:6819","nonce":24902}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6821","nonce":24902},{"type":"v1","addr":"172.21.15.119:6823","nonce":24902}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6829","nonce":24902},{"type":"v1","addr":"172.21.15.119:6831","nonce":24902}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6825","nonce":24902},{"type":"v1","addr":"172.21.15.119:6827","nonce":24902}]},"public_addr":"172.21.15.119:6819/24902","cluster_addr":"172.21.15.119:6823/24902","heartbeat_back_addr":"172.21.15.119:6831/24902","heartbeat_front_addr":"172.21.15.119:6827/24902","state":["exists","up"]},{"osd":3,"uuid":"d6f346dc-57cc-4ad0-9db3-352ced49a170","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":23,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":25220},{"type":"v1","addr":"172.21.15.134:6810","nonce":25220}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6816","nonce":25220},{"type":"v1","addr":"172.21.15.134:6820","nonce":25220}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6828","nonce":25220},{"type":"v1","addr":"172.21.15.134:6831","nonce":25220}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6822","nonce":25220},{"type":"v1","addr":"172.21.15.134:6825","nonce":25220}]},"public_addr":"172.21.15.134:6810/25220","cluster_addr":"172.21.15.134:6820/25220","heartbeat_back_addr":"172.21.15.134:6831/25220","heartbeat_front_addr":"172.21.15.134:6825/25220","state":["exists","up"]},{"osd":4,"uuid":"b4a1348c-ca08-4588-8c5e-1b6338672f3f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6805","nonce":24962},{"type":"v1","addr":"172.21.15.86:6808","nonce":24962}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6811","nonce":24962},{"type":"v1","addr":"172.21.15.86:6815","nonce":24962}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6822","nonce":24962},{"type":"v1","addr":"172.21.15.86:6823","nonce":24962}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6818","nonce":24962},{"type":"v1","addr":"172.21.15.86:6820","nonce":24962}]},"public_addr":"172.21.15.86:6808/24962","cluster_addr":"172.21.15.86:6815/24962","heartbeat_back_addr":"172.21.15.86:6823/24962","heartbeat_front_addr":"172.21.15.86:6820/24962","state":["exists","up"]},{"osd":5,"uuid":"2685cc4b-3fea-483c-a6ce-c74feae525a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6813","nonce":24898},{"type":"v1","addr":"172.21.15.96:6815","nonce":24898}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6818","nonce":24898},{"type":"v1","addr":"172.21.15.96:6819","nonce":24898}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6822","nonce":24898},{"type":"v1","addr":"172.21.15.96:6823","nonce":24898}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6820","nonce":24898},{"type":"v1","addr":"172.21.15.96:6821","nonce":24898}]},"public_addr":"172.21.15.96:6815/24898","cluster_addr":"172.21.15.96:6819/24898","heartbeat_back_addr":"172.21.15.96:6823/24898","heartbeat_front_addr":"172.21.15.96:6821/24898","state":["exists","up"]},{"osd":6,"uuid":"a8dab92a-d416-4383-b35f-6ac033677638","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6816","nonce":24903},{"type":"v1","addr":"172.21.15.119:6818","nonce":24903}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6820","nonce":24903},{"type":"v1","addr":"172.21.15.119:6822","nonce":24903}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6828","nonce":24903},{"type":"v1","addr":"172.21.15.119:6830","nonce":24903}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6824","nonce":24903},{"type":"v1","addr":"172.21.15.119:6826","nonce":24903}]},"public_addr":"172.21.15.119:6818/24903","cluster_addr":"172.21.15.119:6822/24903","heartbeat_back_addr":"172.21.15.119:6830/24903","heartbeat_front_addr":"172.21.15.119:6826/24903","state":["exists","up"]},{"osd":7,"uuid":"17e98ed9-593e-46df-82fa-80e4a36e6bf0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":23,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6809","nonce":25221},{"type":"v1","addr":"172.21.15.134:6814","nonce":25221}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6819","nonce":25221},{"type":"v1","addr":"172.21.15.134:6823","nonce":25221}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6832","nonce":25221},{"type":"v1","addr":"172.21.15.134:6833","nonce":25221}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6826","nonce":25221},{"type":"v1","addr":"172.21.15.134:6830","nonce":25221}]},"public_addr":"172.21.15.134:6814/25221","cluster_addr":"172.21.15.134:6823/25221","heartbeat_back_addr":"172.21.15.134:6833/25221","heartbeat_front_addr":"172.21.15.134:6830/25221","state":["exists","up"]},{"osd":8,"uuid":"be2c6ad5-ae83-463b-a8da-b8705b8c9ecd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":23,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6824","nonce":24967},{"type":"v1","addr":"172.21.15.86:6825","nonce":24967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6826","nonce":24967},{"type":"v1","addr":"172.21.15.86:6827","nonce":24967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6830","nonce":24967},{"type":"v1","addr":"172.21.15.86:6831","nonce":24967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6828","nonce":24967},{"type":"v1","addr":"172.21.15.86:6829","nonce":24967}]},"public_addr":"172.21.15.86:6825/24967","cluster_addr":"172.21.15.86:6827/24967","heartbeat_back_addr":"172.21.15.86:6831/24967","heartbeat_front_addr":"172.21.15.86:6829/24967","state":["exists","up"]},{"osd":9,"uuid":"441c6b04-1540-46ea-b180-4b8fceda9c5e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6808","nonce":24896},{"type":"v1","addr":"172.21.15.96:6809","nonce":24896}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6810","nonce":24896},{"type":"v1","addr":"172.21.15.96:6811","nonce":24896}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6816","nonce":24896},{"type":"v1","addr":"172.21.15.96:6817","nonce":24896}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6812","nonce":24896},{"type":"v1","addr":"172.21.15.96:6814","nonce":24896}]},"public_addr":"172.21.15.96:6809/24896","cluster_addr":"172.21.15.96:6811/24896","heartbeat_back_addr":"172.21.15.96:6817/24896","heartbeat_front_addr":"172.21.15.96:6814/24896","state":["exists","up"]},{"osd":10,"uuid":"024a5dc2-0960-4540-89d5-7d40f5c4c2c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6800","nonce":24904},{"type":"v1","addr":"172.21.15.119:6801","nonce":24904}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6802","nonce":24904},{"type":"v1","addr":"172.21.15.119:6803","nonce":24904}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6806","nonce":24904},{"type":"v1","addr":"172.21.15.119:6807","nonce":24904}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6804","nonce":24904},{"type":"v1","addr":"172.21.15.119:6805","nonce":24904}]},"public_addr":"172.21.15.119:6801/24904","cluster_addr":"172.21.15.119:6803/24904","heartbeat_back_addr":"172.21.15.119:6807/24904","heartbeat_front_addr":"172.21.15.119:6805/24904","state":["exists","up"]},{"osd":11,"uuid":"b46de3d2-dc85-4a95-b7d9-9bcdc0cbf035","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":25222},{"type":"v1","addr":"172.21.15.134:6803","nonce":25222}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":25222},{"type":"v1","addr":"172.21.15.134:6805","nonce":25222}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6813","nonce":25222},{"type":"v1","addr":"172.21.15.134:6817","nonce":25222}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6807","nonce":25222},{"type":"v1","addr":"172.21.15.134:6811","nonce":25222}]},"public_addr":"172.21.15.134:6803/25222","cluster_addr":"172.21.15.134:6805/25222","heartbeat_back_addr":"172.21.15.134:6817/25222","heartbeat_front_addr":"172.21.15.134:6811/25222","state":["exists","up"]},{"osd":12,"uuid":"29a50ae9-9c89-459b-b1de-a7f57905a6ca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6800","nonce":24965},{"type":"v1","addr":"172.21.15.86:6801","nonce":24965}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6802","nonce":24965},{"type":"v1","addr":"172.21.15.86:6803","nonce":24965}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6813","nonce":24965},{"type":"v1","addr":"172.21.15.86:6816","nonce":24965}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6807","nonce":24965},{"type":"v1","addr":"172.21.15.86:6810","nonce":24965}]},"public_addr":"172.21.15.86:6801/24965","cluster_addr":"172.21.15.86:6803/24965","heartbeat_back_addr":"172.21.15.86:6816/24965","heartbeat_front_addr":"172.21.15.86:6810/24965","state":["exists","up"]},{"osd":13,"uuid":"4afcbb15-5c72-4b5f-bbd1-bddeba50b262","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6800","nonce":24897},{"type":"v1","addr":"172.21.15.96:6801","nonce":24897}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6802","nonce":24897},{"type":"v1","addr":"172.21.15.96:6803","nonce":24897}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6806","nonce":24897},{"type":"v1","addr":"172.21.15.96:6807","nonce":24897}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6804","nonce":24897},{"type":"v1","addr":"172.21.15.96:6805","nonce":24897}]},"public_addr":"172.21.15.96:6801/24897","cluster_addr":"172.21.15.96:6803/24897","heartbeat_back_addr":"172.21.15.96:6807/24897","heartbeat_front_addr":"172.21.15.96:6805/24897","state":["exists","up"]},{"osd":14,"uuid":"d713adf7-4bce-443c-873c-3226cd6e5a50","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":117,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6808","nonce":24905},{"type":"v1","addr":"172.21.15.119:6809","nonce":24905}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6810","nonce":24905},{"type":"v1","addr":"172.21.15.119:6811","nonce":24905}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6814","nonce":24905},{"type":"v1","addr":"172.21.15.119:6815","nonce":24905}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6812","nonce":24905},{"type":"v1","addr":"172.21.15.119:6813","nonce":24905}]},"public_addr":"172.21.15.119:6809/24905","cluster_addr":"172.21.15.119:6811/24905","heartbeat_back_addr":"172.21.15.119:6815/24905","heartbeat_front_addr":"172.21.15.119:6813/24905","state":["exists","up"]},{"osd":15,"uuid":"abfd15ca-bea7-4ed9-890d-c9d4add42879","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":23,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6808","nonce":25223},{"type":"v1","addr":"172.21.15.134:6812","nonce":25223}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6815","nonce":25223},{"type":"v1","addr":"172.21.15.134:6818","nonce":25223}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6827","nonce":25223},{"type":"v1","addr":"172.21.15.134:6829","nonce":25223}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6821","nonce":25223},{"type":"v1","addr":"172.21.15.134:6824","nonce":25223}]},"public_addr":"172.21.15.134:6812/25223","cluster_addr":"172.21.15.134:6818/25223","heartbeat_back_addr":"172.21.15.134:6829/25223","heartbeat_front_addr":"172.21.15.134:6824/25223","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T14:44:24.729842+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T14:44:46.394899+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T14:44:16.473504+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T14:44:44.146495+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T14:44:20.295466+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T14:44:38.668015+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T14:44:30.387548+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T14:44:34.701085+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T14:44:32.965730+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T14:44:39.252049+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T14:44:33.304425+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T14:44:23.484251+0000","dead_epoch":0},{"osd":12,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T14:44:19.461153+0000","dead_epoch":0},{"osd":13,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T14:44:22.805253+0000","dead_epoch":0},{"osd":14,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T14:44:42.332316+0000","dead_epoch":0},{"osd":15,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T14:44:36.344995+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"},"shecprofile":{"c":"2","crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","k":"4","m":"3","name":"shecprofile","plugin":"shec","technique":"multiple"}},"removed_snaps_queue":[{"pool":3,"snaps":[{"begin":39,"length":1}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-18T14:45:14.088 INFO:tasks.ceph:Scrubbing osd.0 2024-04-18T14:45:14.089 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-04-18T14:45:14.251 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-04-18T14:45:14.251 INFO:teuthology.orchestra.run.smithi086.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-18T14:45:14.251 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-04-18T14:45:14.267 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-04-18T14:45:14.535 INFO:teuthology.orchestra.run.smithi086.stderr:instructed osd(s) 0 to deep-scrub 2024-04-18T14:45:14.552 INFO:tasks.ceph:Scrubbing osd.4 2024-04-18T14:45:14.553 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2024-04-18T14:45:14.694 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-04-18T14:45:14.695 INFO:teuthology.orchestra.run.smithi086.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-18T14:45:14.695 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-04-18T14:45:14.709 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2024-04-18T14:45:14.979 INFO:teuthology.orchestra.run.smithi086.stderr:instructed osd(s) 4 to deep-scrub 2024-04-18T14:45:14.997 INFO:tasks.ceph:Scrubbing osd.8 2024-04-18T14:45:14.997 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.8 config set osd_debug_deep_scrub_sleep 0 2024-04-18T14:45:15.150 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-04-18T14:45:15.150 INFO:teuthology.orchestra.run.smithi086.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-18T14:45:15.150 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-04-18T14:45:15.165 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 8 2024-04-18T14:45:15.443 INFO:teuthology.orchestra.run.smithi086.stderr:instructed osd(s) 8 to deep-scrub 2024-04-18T14:45:15.462 INFO:tasks.ceph:Scrubbing osd.12 2024-04-18T14:45:15.463 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.12 config set osd_debug_deep_scrub_sleep 0 2024-04-18T14:45:15.599 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-04-18T14:45:15.599 INFO:teuthology.orchestra.run.smithi086.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-18T14:45:15.599 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-04-18T14:45:15.614 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 12 2024-04-18T14:45:15.877 INFO:teuthology.orchestra.run.smithi086.stderr:instructed osd(s) 12 to deep-scrub 2024-04-18T14:45:15.894 INFO:tasks.ceph:Scrubbing osd.1 2024-04-18T14:45:15.894 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-04-18T14:45:16.044 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-04-18T14:45:16.044 INFO:teuthology.orchestra.run.smithi086.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-18T14:45:16.044 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-04-18T14:45:16.059 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-04-18T14:45:16.333 INFO:teuthology.orchestra.run.smithi086.stderr:instructed osd(s) 1 to deep-scrub 2024-04-18T14:45:16.351 INFO:tasks.ceph:Scrubbing osd.5 2024-04-18T14:45:16.351 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2024-04-18T14:45:16.493 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-04-18T14:45:16.493 INFO:teuthology.orchestra.run.smithi086.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-18T14:45:16.493 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-04-18T14:45:16.508 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2024-04-18T14:45:16.784 INFO:teuthology.orchestra.run.smithi086.stderr:instructed osd(s) 5 to deep-scrub 2024-04-18T14:45:16.802 INFO:tasks.ceph:Scrubbing osd.9 2024-04-18T14:45:16.802 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.9 config set osd_debug_deep_scrub_sleep 0 2024-04-18T14:45:16.944 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-04-18T14:45:16.944 INFO:teuthology.orchestra.run.smithi086.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-18T14:45:16.944 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-04-18T14:45:16.958 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 9 2024-04-18T14:45:17.235 INFO:teuthology.orchestra.run.smithi086.stderr:instructed osd(s) 9 to deep-scrub 2024-04-18T14:45:17.252 INFO:tasks.ceph:Scrubbing osd.13 2024-04-18T14:45:17.253 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.13 config set osd_debug_deep_scrub_sleep 0 2024-04-18T14:45:17.390 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-04-18T14:45:17.390 INFO:teuthology.orchestra.run.smithi086.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-18T14:45:17.390 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-04-18T14:45:17.404 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 13 2024-04-18T14:45:17.673 INFO:teuthology.orchestra.run.smithi086.stderr:instructed osd(s) 13 to deep-scrub 2024-04-18T14:45:17.690 INFO:tasks.ceph:Scrubbing osd.2 2024-04-18T14:45:17.690 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-04-18T14:45:17.824 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-04-18T14:45:17.824 INFO:teuthology.orchestra.run.smithi086.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-18T14:45:17.825 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-04-18T14:45:17.839 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-04-18T14:45:18.104 INFO:teuthology.orchestra.run.smithi086.stderr:instructed osd(s) 2 to deep-scrub 2024-04-18T14:45:18.122 INFO:tasks.ceph:Scrubbing osd.6 2024-04-18T14:45:18.122 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2024-04-18T14:45:18.269 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-04-18T14:45:18.269 INFO:teuthology.orchestra.run.smithi086.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-18T14:45:18.269 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-04-18T14:45:18.284 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2024-04-18T14:45:18.554 INFO:teuthology.orchestra.run.smithi086.stderr:instructed osd(s) 6 to deep-scrub 2024-04-18T14:45:18.572 INFO:tasks.ceph:Scrubbing osd.10 2024-04-18T14:45:18.572 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.10 config set osd_debug_deep_scrub_sleep 0 2024-04-18T14:45:18.716 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-04-18T14:45:18.716 INFO:teuthology.orchestra.run.smithi086.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-18T14:45:18.716 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-04-18T14:45:18.731 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 10 2024-04-18T14:45:19.010 INFO:teuthology.orchestra.run.smithi086.stderr:instructed osd(s) 10 to deep-scrub 2024-04-18T14:45:19.029 INFO:tasks.ceph:Scrubbing osd.14 2024-04-18T14:45:19.029 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.14 config set osd_debug_deep_scrub_sleep 0 2024-04-18T14:45:19.178 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-04-18T14:45:19.178 INFO:teuthology.orchestra.run.smithi086.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-18T14:45:19.178 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-04-18T14:45:19.193 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 14 2024-04-18T14:45:19.474 INFO:teuthology.orchestra.run.smithi086.stderr:instructed osd(s) 14 to deep-scrub 2024-04-18T14:45:19.492 INFO:tasks.ceph:Scrubbing osd.3 2024-04-18T14:45:19.492 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2024-04-18T14:45:19.628 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-04-18T14:45:19.628 INFO:teuthology.orchestra.run.smithi086.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-18T14:45:19.628 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-04-18T14:45:19.642 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2024-04-18T14:45:19.909 INFO:teuthology.orchestra.run.smithi086.stderr:instructed osd(s) 3 to deep-scrub 2024-04-18T14:45:19.927 INFO:tasks.ceph:Scrubbing osd.7 2024-04-18T14:45:19.927 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2024-04-18T14:45:20.064 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-04-18T14:45:20.065 INFO:teuthology.orchestra.run.smithi086.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-18T14:45:20.065 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-04-18T14:45:20.079 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2024-04-18T14:45:20.343 INFO:teuthology.orchestra.run.smithi086.stderr:instructed osd(s) 7 to deep-scrub 2024-04-18T14:45:20.360 INFO:tasks.ceph:Scrubbing osd.11 2024-04-18T14:45:20.361 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.11 config set osd_debug_deep_scrub_sleep 0 2024-04-18T14:45:20.498 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-04-18T14:45:20.498 INFO:teuthology.orchestra.run.smithi086.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-18T14:45:20.498 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-04-18T14:45:20.513 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 11 2024-04-18T14:45:20.786 INFO:teuthology.orchestra.run.smithi086.stderr:instructed osd(s) 11 to deep-scrub 2024-04-18T14:45:20.801 INFO:tasks.ceph:Scrubbing osd.15 2024-04-18T14:45:20.802 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.15 config set osd_debug_deep_scrub_sleep 0 2024-04-18T14:45:20.945 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-04-18T14:45:20.946 INFO:teuthology.orchestra.run.smithi086.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-18T14:45:20.946 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-04-18T14:45:20.960 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 15 2024-04-18T14:45:21.230 INFO:teuthology.orchestra.run.smithi086.stderr:instructed osd(s) 15 to deep-scrub 2024-04-18T14:45:21.248 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-18T14:45:21.539 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-04-18T14:45:21.540 INFO:teuthology.orchestra.run.smithi086.stderr:dumped all 2024-04-18T14:45:21.555 INFO:teuthology.orchestra.run.smithi086.stdout:{"pg_ready":true,"pg_map":{"version":176,"stamp":"2024-04-18T14:45:21.373965+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":159,"ondisk_log_size":159,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":16,"num_per_pool_osds":16,"num_per_pool_omap_osds":11,"kb":1509949440,"kb_used":560280,"kb_used_data":30380,"kb_used_omap":24,"kb_used_meta":529639,"kb_avail":1509389160,"statfs":{"total":1546188226560,"available":1545614499840,"internally_reserved":0,"allocated":31109120,"data_stored":18460740,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":25506,"internal_metadata":542350430},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003708"},"pg_stats":[{"pgid":"1.0","version":"125'159","reported_seq":323,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-04-18T14:45:17.800175+0000","last_change":"2024-04-18T14:45:17.800175+0000","last_active":"2024-04-18T14:45:17.800175+0000","last_peered":"2024-04-18T14:45:17.800175+0000","last_clean":"2024-04-18T14:45:17.800175+0000","last_became_active":"2024-04-18T14:43:20.323133+0000","last_became_peered":"2024-04-18T14:43:20.323133+0000","last_unstale":"2024-04-18T14:45:17.800175+0000","last_undegraded":"2024-04-18T14:45:17.800175+0000","last_fullsized":"2024-04-18T14:45:17.800175+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"125'159","last_scrub_stamp":"2024-04-18T14:45:17.799901+0000","last_deep_scrub":"125'159","last_deep_scrub_stamp":"2024-04-18T14:45:17.799901+0000","last_clean_scrub_stamp":"2024-04-18T14:45:17.799901+0000","objects_scrubbed":2,"log_size":159,"log_dups_size":0,"ondisk_log_size":159,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T14:46:35.508901+0000","scrub_duration":0.0080611450000000005,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[13,0],"acting":[13,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":13,"acting_primary":13,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":126,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-04-18T14:45:19.731375+0000","last_change":"2024-04-18T14:45:19.731564+0000","last_active":"2024-04-18T14:45:19.731375+0000","last_peered":"2024-04-18T14:45:19.731375+0000","last_clean":"2024-04-18T14:45:19.731375+0000","last_became_active":"2024-04-18T14:43:21.327764+0000","last_became_peered":"2024-04-18T14:43:21.327764+0000","last_unstale":"2024-04-18T14:45:19.731375+0000","last_undegraded":"2024-04-18T14:45:19.731375+0000","last_fullsized":"2024-04-18T14:45:19.731375+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T14:45:19.731326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T14:45:19.731326+0000","last_clean_scrub_stamp":"2024-04-18T14:45:19.731326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T14:46:29.997744+0000","scrub_duration":0.0042827619999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,15],"acting":[5,15],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":111,"reported_epoch":124,"state":"active+clean","last_fresh":"2024-04-18T14:45:05.845686+0000","last_change":"2024-04-18T14:44:37.374487+0000","last_active":"2024-04-18T14:45:05.845686+0000","last_peered":"2024-04-18T14:45:05.845686+0000","last_clean":"2024-04-18T14:45:05.845686+0000","last_became_active":"2024-04-18T14:43:21.414060+0000","last_became_peered":"2024-04-18T14:43:21.414060+0000","last_unstale":"2024-04-18T14:45:05.845686+0000","last_undegraded":"2024-04-18T14:45:05.845686+0000","last_fullsized":"2024-04-18T14:45:05.845686+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T14:44:37.374221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T14:43:20.303322+0000","last_clean_scrub_stamp":"2024-04-18T14:44:37.374221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T14:45:58.651147+0000","scrub_duration":0.0042134670000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":123,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-04-18T14:45:18.772038+0000","last_change":"2024-04-18T14:45:18.772225+0000","last_active":"2024-04-18T14:45:18.772038+0000","last_peered":"2024-04-18T14:45:18.772038+0000","last_clean":"2024-04-18T14:45:18.772038+0000","last_became_active":"2024-04-18T14:43:21.328534+0000","last_became_peered":"2024-04-18T14:43:21.328534+0000","last_unstale":"2024-04-18T14:45:18.772038+0000","last_undegraded":"2024-04-18T14:45:18.772038+0000","last_fullsized":"2024-04-18T14:45:18.772038+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T14:45:18.771988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T14:45:18.771988+0000","last_clean_scrub_stamp":"2024-04-18T14:45:18.771988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T14:46:18.894566+0000","scrub_duration":0.0033455770000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[13,5],"acting":[13,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":13,"acting_primary":13,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":111,"reported_epoch":124,"state":"active+clean","last_fresh":"2024-04-18T14:45:05.845692+0000","last_change":"2024-04-18T14:44:47.245574+0000","last_active":"2024-04-18T14:45:05.845692+0000","last_peered":"2024-04-18T14:45:05.845692+0000","last_clean":"2024-04-18T14:45:05.845692+0000","last_became_active":"2024-04-18T14:43:21.465481+0000","last_became_peered":"2024-04-18T14:43:21.465481+0000","last_unstale":"2024-04-18T14:45:05.845692+0000","last_undegraded":"2024-04-18T14:45:05.845692+0000","last_fullsized":"2024-04-18T14:45:05.845692+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T14:44:47.245297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T14:44:47.245297+0000","last_clean_scrub_stamp":"2024-04-18T14:44:47.245297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T14:46:02.649852+0000","scrub_duration":0.0038839159999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10],"acting":[3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":114,"reported_epoch":124,"state":"active+clean","last_fresh":"2024-04-18T14:45:07.345184+0000","last_change":"2024-04-18T14:44:38.485354+0000","last_active":"2024-04-18T14:45:07.345184+0000","last_peered":"2024-04-18T14:45:07.345184+0000","last_clean":"2024-04-18T14:45:07.345184+0000","last_became_active":"2024-04-18T14:43:21.348012+0000","last_became_peered":"2024-04-18T14:43:21.348012+0000","last_unstale":"2024-04-18T14:45:07.345184+0000","last_undegraded":"2024-04-18T14:45:07.345184+0000","last_fullsized":"2024-04-18T14:45:07.345184+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T14:44:38.485106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T14:43:20.303322+0000","last_clean_scrub_stamp":"2024-04-18T14:44:38.485106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T14:45:48.039171+0000","scrub_duration":0.0043932759999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,12],"acting":[6,12],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":123,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-04-18T14:45:17.519938+0000","last_change":"2024-04-18T14:45:17.520027+0000","last_active":"2024-04-18T14:45:17.519938+0000","last_peered":"2024-04-18T14:45:17.519938+0000","last_clean":"2024-04-18T14:45:17.519938+0000","last_became_active":"2024-04-18T14:43:21.422468+0000","last_became_peered":"2024-04-18T14:43:21.422468+0000","last_unstale":"2024-04-18T14:45:17.519938+0000","last_undegraded":"2024-04-18T14:45:17.519938+0000","last_fullsized":"2024-04-18T14:45:17.519938+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T14:45:17.519918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T14:45:17.519918+0000","last_clean_scrub_stamp":"2024-04-18T14:45:17.519918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T14:46:19.973404+0000","scrub_duration":0.002702627,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2],"acting":[8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":102,"reported_epoch":124,"state":"active+clean","last_fresh":"2024-04-18T14:45:06.548847+0000","last_change":"2024-04-18T14:44:59.929678+0000","last_active":"2024-04-18T14:45:06.548847+0000","last_peered":"2024-04-18T14:45:06.548847+0000","last_clean":"2024-04-18T14:45:06.548847+0000","last_became_active":"2024-04-18T14:44:59.929195+0000","last_became_peered":"2024-04-18T14:44:59.929195+0000","last_unstale":"2024-04-18T14:45:06.548847+0000","last_undegraded":"2024-04-18T14:45:06.548847+0000","last_fullsized":"2024-04-18T14:45:06.548847+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T14:44:36.901318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T14:43:20.303322+0000","last_clean_scrub_stamp":"2024-04-18T14:44:36.901318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T14:45:49.599440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[14,0],"acting":[14,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":14,"acting_primary":14,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":114,"reported_epoch":124,"state":"active+clean","last_fresh":"2024-04-18T14:45:06.548333+0000","last_change":"2024-04-18T14:44:22.508764+0000","last_active":"2024-04-18T14:45:06.548333+0000","last_peered":"2024-04-18T14:45:06.548333+0000","last_clean":"2024-04-18T14:45:06.548333+0000","last_became_active":"2024-04-18T14:43:21.328185+0000","last_became_peered":"2024-04-18T14:43:21.328185+0000","last_unstale":"2024-04-18T14:45:06.548333+0000","last_undegraded":"2024-04-18T14:45:06.548333+0000","last_fullsized":"2024-04-18T14:45:06.548333+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T14:44:22.508567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T14:43:20.303322+0000","last_clean_scrub_stamp":"2024-04-18T14:44:22.508567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T14:45:46.236519+0000","scrub_duration":0.0031913549999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[15,13],"acting":[15,13],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":15,"acting_primary":15,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":11},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1064960,"data_stored":1057856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":159,"ondisk_log_size":159,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":13,"up_from":24,"seq":103079215132,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33468,"kb_used_data":2356,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94338372,"statfs":{"total":96636764160,"available":96602492928,"internally_reserved":0,"allocated":2412544,"data_stored":1617083,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,2,3,4,5,7,11,12,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Apr 18 14:44:21 2024","interfaces":[{"interface":"back","average":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"min":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":1.792,"5min":1.792,"15min":1.792},"last":0.629},{"interface":"front","average":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"min":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":2.0600000000000001,"5min":2.0600000000000001,"15min":2.0600000000000001},"last":0.53800000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84099999999999997}]},{"osd":2,"last update":"Thu Apr 18 14:44:21 2024","interfaces":[{"interface":"back","average":{"1min":1.0389999999999999,"5min":1.0389999999999999,"15min":1.0389999999999999},"min":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"max":{"1min":1.974,"5min":1.974,"15min":1.974},"last":1.014},{"interface":"front","average":{"1min":1,"5min":1,"15min":1},"min":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.9910000000000001,"5min":1.9910000000000001,"15min":1.9910000000000001},"last":1.044}]},{"osd":3,"last update":"Thu Apr 18 14:44:21 2024","interfaces":[{"interface":"back","average":{"1min":0.91500000000000004,"5min":0.91500000000000004,"15min":0.91500000000000004},"min":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"max":{"1min":1.2110000000000001,"5min":1.2110000000000001,"15min":1.2110000000000001},"last":0.98799999999999999},{"interface":"front","average":{"1min":1.0489999999999999,"5min":1.0489999999999999,"15min":1.0489999999999999},"min":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":1.4430000000000001,"5min":1.4430000000000001,"15min":1.4430000000000001},"last":1.1040000000000001}]},{"osd":4,"last update":"Thu Apr 18 14:44:21 2024","interfaces":[{"interface":"back","average":{"1min":0.98099999999999998,"5min":0.98099999999999998,"15min":0.98099999999999998},"min":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.3919999999999999,"5min":1.3919999999999999,"15min":1.3919999999999999},"last":0.57799999999999996},{"interface":"front","average":{"1min":0.90100000000000002,"5min":0.90100000000000002,"15min":0.90100000000000002},"min":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":1.306,"5min":1.306,"15min":1.306},"last":0.69199999999999995}]},{"osd":5,"last update":"Thu Apr 18 14:44:21 2024","interfaces":[{"interface":"back","average":{"1min":0.96399999999999997,"5min":0.96399999999999997,"15min":0.96399999999999997},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":1.5860000000000001,"5min":1.5860000000000001,"15min":1.5860000000000001},"last":1.2470000000000001},{"interface":"front","average":{"1min":1.0780000000000001,"5min":1.0780000000000001,"15min":1.0780000000000001},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.536,"5min":1.536,"15min":1.536},"last":0.86299999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1950000000000001}]},{"osd":7,"last update":"Thu Apr 18 14:44:32 2024","interfaces":[{"interface":"back","average":{"1min":1.1639999999999999,"5min":1.1639999999999999,"15min":1.1639999999999999},"min":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":2.4359999999999999,"5min":2.4359999999999999,"15min":2.4359999999999999},"last":0.89300000000000002},{"interface":"front","average":{"1min":1.206,"5min":1.206,"15min":1.206},"min":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"max":{"1min":3.532,"5min":3.532,"15min":3.532},"last":0.80000000000000004}]},{"osd":11,"last update":"Thu Apr 18 14:44:32 2024","interfaces":[{"interface":"back","average":{"1min":1.2350000000000001,"5min":1.2350000000000001,"15min":1.2350000000000001},"min":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"max":{"1min":1.8069999999999999,"5min":1.8069999999999999,"15min":1.8069999999999999},"last":1.2170000000000001},{"interface":"front","average":{"1min":1.2809999999999999,"5min":1.2809999999999999,"15min":1.2809999999999999},"min":{"1min":0.84799999999999998,"5min":0.84799999999999998,"15min":0.84799999999999998},"max":{"1min":2.2669999999999999,"5min":2.2669999999999999,"15min":2.2669999999999999},"last":1.0780000000000001}]},{"osd":12,"last update":"Thu Apr 18 14:44:21 2024","interfaces":[{"interface":"back","average":{"1min":1.2709999999999999,"5min":1.2709999999999999,"15min":1.2709999999999999},"min":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"max":{"1min":1.911,"5min":1.911,"15min":1.911},"last":0.95399999999999996},{"interface":"front","average":{"1min":1.3140000000000001,"5min":1.3140000000000001,"15min":1.3140000000000001},"min":{"1min":0.755,"5min":0.755,"15min":0.755},"max":{"1min":2.504,"5min":2.504,"15min":2.504},"last":0.77100000000000002}]},{"osd":14,"last update":"Thu Apr 18 14:44:21 2024","interfaces":[{"interface":"back","average":{"1min":1.2909999999999999,"5min":1.2909999999999999,"15min":1.2909999999999999},"min":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"max":{"1min":3.6240000000000001,"5min":3.6240000000000001,"15min":3.6240000000000001},"last":0.92600000000000005},{"interface":"front","average":{"1min":1.357,"5min":1.357,"15min":1.357},"min":{"1min":0.627,"5min":0.627,"15min":0.627},"max":{"1min":2.1960000000000002,"5min":2.1960000000000002,"15min":2.1960000000000002},"last":1.139}]},{"osd":15,"last update":"Thu Apr 18 14:44:21 2024","interfaces":[{"interface":"back","average":{"1min":1.3560000000000001,"5min":1.3560000000000001,"15min":1.3560000000000001},"min":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"max":{"1min":2.1080000000000001,"5min":2.1080000000000001,"15min":2.1080000000000001},"last":1.163},{"interface":"front","average":{"1min":1.26,"5min":1.26,"15min":1.26},"min":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"max":{"1min":1.8380000000000001,"5min":1.8380000000000001,"15min":1.8380000000000001},"last":1.1899999999999999}]}]},{"osd":9,"up_from":24,"seq":103079215133,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32956,"kb_used_data":1836,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94338884,"statfs":{"total":96636764160,"available":96603017216,"internally_reserved":0,"allocated":1880064,"data_stored":1088155,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1599,"internal_metadata":31848897},"hb_peers":[0,1,3,8,10,11,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Apr 18 14:44:20 2024","interfaces":[{"interface":"back","average":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":1.0429999999999999,"5min":1.0429999999999999,"15min":1.0429999999999999},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.95199999999999996,"5min":0.95199999999999996,"15min":0.95199999999999996},"min":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"max":{"1min":1.6559999999999999,"5min":1.6559999999999999,"15min":1.6559999999999999},"last":0.69299999999999995}]},{"osd":1,"last update":"Thu Apr 18 14:44:20 2024","interfaces":[{"interface":"back","average":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"min":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":1.3200000000000001,"5min":1.3200000000000001,"15min":1.3200000000000001},"last":0.98999999999999999},{"interface":"front","average":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.2509999999999999,"5min":1.2509999999999999,"15min":1.2509999999999999},"last":0.749}]},{"osd":3,"last update":"Thu Apr 18 14:44:20 2024","interfaces":[{"interface":"back","average":{"1min":1.032,"5min":1.032,"15min":1.032},"min":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"max":{"1min":1.5980000000000001,"5min":1.5980000000000001,"15min":1.5980000000000001},"last":0.95899999999999996},{"interface":"front","average":{"1min":1.1539999999999999,"5min":1.1539999999999999,"15min":1.1539999999999999},"min":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"max":{"1min":1.722,"5min":1.722,"15min":1.722},"last":1.1559999999999999}]},{"osd":8,"last update":"Thu Apr 18 14:44:20 2024","interfaces":[{"interface":"back","average":{"1min":0.94899999999999995,"5min":0.94899999999999995,"15min":0.94899999999999995},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":1.6899999999999999,"5min":1.6899999999999999,"15min":1.6899999999999999},"last":0.92800000000000005},{"interface":"front","average":{"1min":1.3380000000000001,"5min":1.3380000000000001,"15min":1.3380000000000001},"min":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"max":{"1min":5.4989999999999997,"5min":5.4989999999999997,"15min":5.4989999999999997},"last":0.874}]},{"osd":10,"last update":"Thu Apr 18 14:44:20 2024","interfaces":[{"interface":"back","average":{"1min":1.196,"5min":1.196,"15min":1.196},"min":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"max":{"1min":1.5429999999999999,"5min":1.5429999999999999,"15min":1.5429999999999999},"last":1.2629999999999999},{"interface":"front","average":{"1min":1.117,"5min":1.117,"15min":1.117},"min":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"max":{"1min":1.7689999999999999,"5min":1.7689999999999999,"15min":1.7689999999999999},"last":1.1220000000000001}]},{"osd":11,"last update":"Thu Apr 18 14:44:20 2024","interfaces":[{"interface":"back","average":{"1min":1.1279999999999999,"5min":1.1279999999999999,"15min":1.1279999999999999},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.849,"5min":1.849,"15min":1.849},"last":1.21},{"interface":"front","average":{"1min":1.2310000000000001,"5min":1.2310000000000001,"15min":1.2310000000000001},"min":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"max":{"1min":1.8109999999999999,"5min":1.8109999999999999,"15min":1.8109999999999999},"last":1.1850000000000001}]},{"osd":12,"last update":"Thu Apr 18 14:44:20 2024","interfaces":[{"interface":"back","average":{"1min":1.2989999999999999,"5min":1.2989999999999999,"15min":1.2989999999999999},"min":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"max":{"1min":2.1560000000000001,"5min":2.1560000000000001,"15min":2.1560000000000001},"last":1.3220000000000001},{"interface":"front","average":{"1min":1.29,"5min":1.29,"15min":1.29},"min":{"1min":0.748,"5min":0.748,"15min":0.748},"max":{"1min":2.6930000000000001,"5min":2.6930000000000001,"15min":2.6930000000000001},"last":1.024}]},{"osd":13,"last update":"Thu Apr 18 14:44:20 2024","interfaces":[{"interface":"back","average":{"1min":1.4079999999999999,"5min":1.4079999999999999,"15min":1.4079999999999999},"min":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"max":{"1min":2.6030000000000002,"5min":2.6030000000000002,"15min":2.6030000000000002},"last":1.4059999999999999},{"interface":"front","average":{"1min":1.4710000000000001,"5min":1.4710000000000001,"15min":1.4710000000000001},"min":{"1min":0.92100000000000004,"5min":0.92100000000000004,"15min":0.92100000000000004},"max":{"1min":2.472,"5min":2.472,"15min":2.472},"last":1.0580000000000001}]},{"osd":14,"last update":"Thu Apr 18 14:44:20 2024","interfaces":[{"interface":"back","average":{"1min":1.456,"5min":1.456,"15min":1.456},"min":{"1min":0.88400000000000001,"5min":0.88400000000000001,"15min":0.88400000000000001},"max":{"1min":2.3180000000000001,"5min":2.3180000000000001,"15min":2.3180000000000001},"last":1.2450000000000001},{"interface":"front","average":{"1min":1.5389999999999999,"5min":1.5389999999999999,"15min":1.5389999999999999},"min":{"1min":1.016,"5min":1.016,"15min":1.016},"max":{"1min":2.6549999999999998,"5min":2.6549999999999998,"15min":2.6549999999999998},"last":1.365}]},{"osd":15,"last update":"Thu Apr 18 14:44:20 2024","interfaces":[{"interface":"back","average":{"1min":1.4119999999999999,"5min":1.4119999999999999,"15min":1.4119999999999999},"min":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"max":{"1min":2.7789999999999999,"5min":2.7789999999999999,"15min":2.7789999999999999},"last":1.302},{"interface":"front","average":{"1min":1.4359999999999999,"5min":1.4359999999999999,"15min":1.4359999999999999},"min":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"max":{"1min":1.923,"5min":1.923,"15min":1.923},"last":1.286}]}]},{"osd":5,"up_from":24,"seq":103079215134,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32956,"kb_used_data":1836,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94338884,"statfs":{"total":96636764160,"available":96603017216,"internally_reserved":0,"allocated":1880064,"data_stored":1088155,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,3,4,6,10,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Apr 18 14:44:31 2024","interfaces":[{"interface":"back","average":{"1min":0.90900000000000003,"5min":0.90900000000000003,"15min":0.90900000000000003},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.339,"5min":1.339,"15min":1.339},"last":0.99399999999999999},{"interface":"front","average":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":1.175,"5min":1.175,"15min":1.175},"last":0.69899999999999995}]},{"osd":1,"last update":"Thu Apr 18 14:45:12 2024","interfaces":[{"interface":"back","average":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":1.2370000000000001,"5min":1.2370000000000001,"15min":1.2370000000000001},"last":0.93300000000000005},{"interface":"front","average":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":1.526,"5min":1.526,"15min":1.526},"last":0.746}]},{"osd":3,"last update":"Thu Apr 18 14:44:24 2024","interfaces":[{"interface":"back","average":{"1min":1.024,"5min":1.024,"15min":1.024},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":1.4650000000000001,"5min":1.4650000000000001,"15min":1.4650000000000001},"last":1.1910000000000001},{"interface":"front","average":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":0.94999999999999996},"min":{"1min":0.621,"5min":0.621,"15min":0.621},"max":{"1min":1.8460000000000001,"5min":1.8460000000000001,"15min":1.8460000000000001},"last":0.82699999999999996}]},{"osd":4,"last update":"Thu Apr 18 14:44:24 2024","interfaces":[{"interface":"back","average":{"1min":0.89400000000000002,"5min":0.89400000000000002,"15min":0.89400000000000002},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":1.968,"5min":1.968,"15min":1.968},"last":0.86099999999999999},{"interface":"front","average":{"1min":1.016,"5min":1.016,"15min":1.016},"min":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"max":{"1min":1.819,"5min":1.819,"15min":1.819},"last":1.1060000000000001}]},{"osd":6,"last update":"Thu Apr 18 14:44:24 2024","interfaces":[{"interface":"back","average":{"1min":1.0629999999999999,"5min":1.0629999999999999,"15min":1.0629999999999999},"min":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"max":{"1min":2.0760000000000001,"5min":2.0760000000000001,"15min":2.0760000000000001},"last":1.163},{"interface":"front","average":{"1min":1.101,"5min":1.101,"15min":1.101},"min":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"max":{"1min":1.694,"5min":1.694,"15min":1.694},"last":1.04}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2330000000000001}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96599999999999997}]},{"osd":10,"last update":"Thu Apr 18 14:44:24 2024","interfaces":[{"interface":"back","average":{"1min":1.232,"5min":1.232,"15min":1.232},"min":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"max":{"1min":2.2709999999999999,"5min":2.2709999999999999,"15min":2.2709999999999999},"last":1.2569999999999999},{"interface":"front","average":{"1min":1.2569999999999999,"5min":1.2569999999999999,"15min":1.2569999999999999},"min":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"max":{"1min":2.4470000000000001,"5min":2.4470000000000001,"15min":2.4470000000000001},"last":1.071}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.256}]},{"osd":12,"last update":"Thu Apr 18 14:44:24 2024","interfaces":[{"interface":"back","average":{"1min":1.1140000000000001,"5min":1.1140000000000001,"15min":1.1140000000000001},"min":{"1min":0.625,"5min":0.625,"15min":0.625},"max":{"1min":1.728,"5min":1.728,"15min":1.728},"last":1.22},{"interface":"front","average":{"1min":1.339,"5min":1.339,"15min":1.339},"min":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"max":{"1min":2.008,"5min":2.008,"15min":2.008},"last":1.3320000000000001}]},{"osd":13,"last update":"Thu Apr 18 14:44:24 2024","interfaces":[{"interface":"back","average":{"1min":1.355,"5min":1.355,"15min":1.355},"min":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":2.5070000000000001,"5min":2.5070000000000001,"15min":2.5070000000000001},"last":1.468},{"interface":"front","average":{"1min":1.2949999999999999,"5min":1.2949999999999999,"15min":1.2949999999999999},"min":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":2.992,"5min":2.992,"15min":2.992},"last":1.2809999999999999}]},{"osd":14,"last update":"Thu Apr 18 14:44:31 2024","interfaces":[{"interface":"back","average":{"1min":1.401,"5min":1.401,"15min":1.401},"min":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.85099999999999998},"max":{"1min":2.1190000000000002,"5min":2.1190000000000002,"15min":2.1190000000000002},"last":1.401},{"interface":"front","average":{"1min":1.2629999999999999,"5min":1.2629999999999999,"15min":1.2629999999999999},"min":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"max":{"1min":2.496,"5min":2.496,"15min":2.496},"last":1.365}]},{"osd":15,"last update":"Thu Apr 18 14:44:24 2024","interfaces":[{"interface":"back","average":{"1min":1.486,"5min":1.486,"15min":1.486},"min":{"1min":0.879,"5min":0.879,"15min":0.879},"max":{"1min":2.415,"5min":2.415,"15min":2.415},"last":1.512},{"interface":"front","average":{"1min":1.4470000000000001,"5min":1.4470000000000001,"15min":1.4470000000000001},"min":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"max":{"1min":2.7799999999999998,"5min":2.7799999999999998,"15min":2.7799999999999998},"last":1.4330000000000001}]}]},{"osd":14,"up_from":21,"seq":90194313245,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51008,"kb_used_data":1836,"kb_used_omap":1,"kb_used_meta":49150,"kb_avail":94320832,"statfs":{"total":96636764160,"available":96584531968,"internally_reserved":0,"allocated":1880064,"data_stored":1088155,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":50330054},"hb_peers":[0,4,5,6,7,8,9,11,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Apr 18 14:44:21 2024","interfaces":[{"interface":"back","average":{"1min":0.96899999999999997,"5min":0.96899999999999997,"15min":0.96899999999999997},"min":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"max":{"1min":1.454,"5min":1.454,"15min":1.454},"last":0.51000000000000001},{"interface":"front","average":{"1min":1.0660000000000001,"5min":1.0660000000000001,"15min":1.0660000000000001},"min":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"max":{"1min":1.9390000000000001,"5min":1.9390000000000001,"15min":1.9390000000000001},"last":0.70899999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.472}]},{"osd":2,"last update":"Thu Apr 18 14:44:31 2024","interfaces":[{"interface":"back","average":{"1min":0.89500000000000002,"5min":0.89500000000000002,"15min":0.89500000000000002},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":1.468,"5min":1.468,"15min":1.468},"last":0.64400000000000002},{"interface":"front","average":{"1min":1.131,"5min":1.131,"15min":1.131},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.8540000000000001,"5min":1.8540000000000001,"15min":1.8540000000000001},"last":1.032}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94499999999999995}]},{"osd":4,"last update":"Thu Apr 18 14:44:20 2024","interfaces":[{"interface":"back","average":{"1min":0.95099999999999996,"5min":0.95099999999999996,"15min":0.95099999999999996},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.296,"5min":1.296,"15min":1.296},"last":0.63700000000000001},{"interface":"front","average":{"1min":0.97599999999999998,"5min":0.97599999999999998,"15min":0.97599999999999998},"min":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"max":{"1min":1.5129999999999999,"5min":1.5129999999999999,"15min":1.5129999999999999},"last":0.58899999999999997}]},{"osd":5,"last update":"Thu Apr 18 14:44:20 2024","interfaces":[{"interface":"back","average":{"1min":1.218,"5min":1.218,"15min":1.218},"min":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"max":{"1min":2.1269999999999998,"5min":2.1269999999999998,"15min":2.1269999999999998},"last":1.1679999999999999},{"interface":"front","average":{"1min":1.1679999999999999,"5min":1.1679999999999999,"15min":1.1679999999999999},"min":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"max":{"1min":1.5920000000000001,"5min":1.5920000000000001,"15min":1.5920000000000001},"last":1.157}]},{"osd":6,"last update":"Thu Apr 18 14:44:20 2024","interfaces":[{"interface":"back","average":{"1min":0.94699999999999995,"5min":0.94699999999999995,"15min":0.94699999999999995},"min":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"max":{"1min":1.3160000000000001,"5min":1.3160000000000001,"15min":1.3160000000000001},"last":0.67400000000000004},{"interface":"front","average":{"1min":1.163,"5min":1.163,"15min":1.163},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":1.7689999999999999,"5min":1.7689999999999999,"15min":1.7689999999999999},"last":1.1020000000000001}]},{"osd":7,"last update":"Thu Apr 18 14:44:20 2024","interfaces":[{"interface":"back","average":{"1min":1.234,"5min":1.234,"15min":1.234},"min":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"max":{"1min":1.7529999999999999,"5min":1.7529999999999999,"15min":1.7529999999999999},"last":0.92300000000000004},{"interface":"front","average":{"1min":1.1759999999999999,"5min":1.1759999999999999,"15min":1.1759999999999999},"min":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"max":{"1min":1.587,"5min":1.587,"15min":1.587},"last":0.80200000000000005}]},{"osd":8,"last update":"Thu Apr 18 14:44:20 2024","interfaces":[{"interface":"back","average":{"1min":1.292,"5min":1.292,"15min":1.292},"min":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"max":{"1min":2.0569999999999999,"5min":2.0569999999999999,"15min":2.0569999999999999},"last":1.0189999999999999},{"interface":"front","average":{"1min":1.2509999999999999,"5min":1.2509999999999999,"15min":1.2509999999999999},"min":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"max":{"1min":1.8740000000000001,"5min":1.8740000000000001,"15min":1.8740000000000001},"last":0.82599999999999996}]},{"osd":9,"last update":"Thu Apr 18 14:44:31 2024","interfaces":[{"interface":"back","average":{"1min":1.4590000000000001,"5min":1.4590000000000001,"15min":1.4590000000000001},"min":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"max":{"1min":2.1899999999999999,"5min":2.1899999999999999,"15min":2.1899999999999999},"last":1.2390000000000001},{"interface":"front","average":{"1min":1.3999999999999999,"5min":1.3999999999999999,"15min":1.3999999999999999},"min":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"max":{"1min":1.9930000000000001,"5min":1.9930000000000001,"15min":1.9930000000000001},"last":1.0800000000000001}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4219999999999999}]},{"osd":11,"last update":"Thu Apr 18 14:44:31 2024","interfaces":[{"interface":"back","average":{"1min":1.4319999999999999,"5min":1.4319999999999999,"15min":1.4319999999999999},"min":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"max":{"1min":2.0059999999999998,"5min":2.0059999999999998,"15min":2.0059999999999998},"last":0.87},{"interface":"front","average":{"1min":1.3640000000000001,"5min":1.3640000000000001,"15min":1.3640000000000001},"min":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"max":{"1min":1.903,"5min":1.903,"15min":1.903},"last":1.3049999999999999}]},{"osd":12,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.016}]},{"osd":13,"last update":"Thu Apr 18 14:44:20 2024","interfaces":[{"interface":"back","average":{"1min":1.464,"5min":1.464,"15min":1.464},"min":{"1min":0.86799999999999999,"5min":0.86799999999999999,"15min":0.86799999999999999},"max":{"1min":1.8620000000000001,"5min":1.8620000000000001,"15min":1.8620000000000001},"last":0.98899999999999999},{"interface":"front","average":{"1min":1.5349999999999999,"5min":1.5349999999999999,"15min":1.5349999999999999},"min":{"1min":0.94299999999999995,"5min":0.94299999999999995,"15min":0.94299999999999995},"max":{"1min":2.452,"5min":2.452,"15min":2.452},"last":1.3720000000000001}]},{"osd":15,"last update":"Thu Apr 18 14:44:20 2024","interfaces":[{"interface":"back","average":{"1min":1.5129999999999999,"5min":1.5129999999999999,"15min":1.5129999999999999},"min":{"1min":0.95699999999999996,"5min":0.95699999999999996,"15min":0.95699999999999996},"max":{"1min":2.2549999999999999,"5min":2.2549999999999999,"15min":2.2549999999999999},"last":1.196},{"interface":"front","average":{"1min":1.476,"5min":1.476,"15min":1.476},"min":{"1min":0.89800000000000002,"5min":0.89800000000000002,"15min":0.89800000000000002},"max":{"1min":1.9550000000000001,"5min":1.9550000000000001,"15min":1.9550000000000001},"last":1.052}]}]},{"osd":1,"up_from":24,"seq":103079215134,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32952,"kb_used_data":1832,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94338888,"statfs":{"total":96636764160,"available":96603021312,"internally_reserved":0,"allocated":1875968,"data_stored":1087311,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,2,3,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Apr 18 14:44:25 2024","interfaces":[{"interface":"back","average":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":1.165,"5min":1.165,"15min":1.165},"last":0.80200000000000005},{"interface":"front","average":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"min":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":1.292,"5min":1.292,"15min":1.292},"last":0.83599999999999997}]},{"osd":2,"last update":"Thu Apr 18 14:44:25 2024","interfaces":[{"interface":"back","average":{"1min":0.93899999999999995,"5min":0.93899999999999995,"15min":0.93899999999999995},"min":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"max":{"1min":1.3180000000000001,"5min":1.3180000000000001,"15min":1.3180000000000001},"last":0.88400000000000001},{"interface":"front","average":{"1min":0.95199999999999996,"5min":0.95199999999999996,"15min":0.95199999999999996},"min":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":1.345,"5min":1.345,"15min":1.345},"last":0.97299999999999998}]},{"osd":3,"last update":"Thu Apr 18 14:44:25 2024","interfaces":[{"interface":"back","average":{"1min":1.0760000000000001,"5min":1.0760000000000001,"15min":1.0760000000000001},"min":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":1.486,"5min":1.486,"15min":1.486},"last":1.242},{"interface":"front","average":{"1min":1.1679999999999999,"5min":1.1679999999999999,"15min":1.1679999999999999},"min":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"max":{"1min":1.7789999999999999,"5min":1.7789999999999999,"15min":1.7789999999999999},"last":1.208}]},{"osd":4,"last update":"Thu Apr 18 14:44:25 2024","interfaces":[{"interface":"back","average":{"1min":0.98299999999999998,"5min":0.98299999999999998,"15min":0.98299999999999998},"min":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"max":{"1min":1.728,"5min":1.728,"15min":1.728},"last":1.0800000000000001},{"interface":"front","average":{"1min":0.93700000000000006,"5min":0.93700000000000006,"15min":0.93700000000000006},"min":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"max":{"1min":1.6950000000000001,"5min":1.6950000000000001,"15min":1.6950000000000001},"last":1.1240000000000001}]},{"osd":5,"last update":"Thu Apr 18 14:44:25 2024","interfaces":[{"interface":"back","average":{"1min":1.0089999999999999,"5min":1.0089999999999999,"15min":1.0089999999999999},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":1.819,"5min":1.819,"15min":1.819},"last":1.042},{"interface":"front","average":{"1min":1.083,"5min":1.083,"15min":1.083},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":1.841,"5min":1.841,"15min":1.841},"last":1.171}]},{"osd":6,"last update":"Thu Apr 18 14:44:25 2024","interfaces":[{"interface":"back","average":{"1min":1.2529999999999999,"5min":1.2529999999999999,"15min":1.2529999999999999},"min":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"max":{"1min":2.3639999999999999,"5min":2.3639999999999999,"15min":2.3639999999999999},"last":1.5369999999999999},{"interface":"front","average":{"1min":1.1839999999999999,"5min":1.1839999999999999,"15min":1.1839999999999999},"min":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"max":{"1min":1.9419999999999999,"5min":1.9419999999999999,"15min":1.9419999999999999},"last":1.484}]},{"osd":7,"last update":"Thu Apr 18 14:44:25 2024","interfaces":[{"interface":"back","average":{"1min":1.2050000000000001,"5min":1.2050000000000001,"15min":1.2050000000000001},"min":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"max":{"1min":1.96,"5min":1.96,"15min":1.96},"last":1.3500000000000001},{"interface":"front","average":{"1min":1.2509999999999999,"5min":1.2509999999999999,"15min":1.2509999999999999},"min":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"max":{"1min":2.4399999999999999,"5min":2.4399999999999999,"15min":2.4399999999999999},"last":1.431}]},{"osd":8,"last update":"Thu Apr 18 14:44:25 2024","interfaces":[{"interface":"back","average":{"1min":1.2330000000000001,"5min":1.2330000000000001,"15min":1.2330000000000001},"min":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"max":{"1min":1.881,"5min":1.881,"15min":1.881},"last":1.284},{"interface":"front","average":{"1min":1.26,"5min":1.26,"15min":1.26},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":2.5169999999999999,"5min":2.5169999999999999,"15min":2.5169999999999999},"last":1.3660000000000001}]},{"osd":9,"last update":"Thu Apr 18 14:44:25 2024","interfaces":[{"interface":"back","average":{"1min":1.3280000000000001,"5min":1.3280000000000001,"15min":1.3280000000000001},"min":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":2.4780000000000002,"5min":2.4780000000000002,"15min":2.4780000000000002},"last":1.3149999999999999},{"interface":"front","average":{"1min":1.3129999999999999,"5min":1.3129999999999999,"15min":1.3129999999999999},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":2.161,"5min":2.161,"15min":2.161},"last":1.452}]},{"osd":10,"last update":"Thu Apr 18 14:44:25 2024","interfaces":[{"interface":"back","average":{"1min":1.407,"5min":1.407,"15min":1.407},"min":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"max":{"1min":2.625,"5min":2.625,"15min":2.625},"last":1.601},{"interface":"front","average":{"1min":1.446,"5min":1.446,"15min":1.446},"min":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"max":{"1min":2.5529999999999999,"5min":2.5529999999999999,"15min":2.5529999999999999},"last":1.4039999999999999}]}]},{"osd":2,"up_from":22,"seq":94489280541,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28860,"kb_used_data":1836,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94342980,"statfs":{"total":96636764160,"available":96607211520,"internally_reserved":0,"allocated":1880064,"data_stored":1088155,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,3,5,6,7,8,10,11,12,14],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Apr 18 14:44:22 2024","interfaces":[{"interface":"back","average":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"min":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"max":{"1min":1.175,"5min":1.175,"15min":1.175},"last":0.80300000000000005},{"interface":"front","average":{"1min":0.90900000000000003,"5min":0.90900000000000003,"15min":0.90900000000000003},"min":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"max":{"1min":1.3740000000000001,"5min":1.3740000000000001,"15min":1.3740000000000001},"last":0.63400000000000001}]},{"osd":3,"last update":"Thu Apr 18 14:44:22 2024","interfaces":[{"interface":"back","average":{"1min":1.0409999999999999,"5min":1.0409999999999999,"15min":1.0409999999999999},"min":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"max":{"1min":1.6830000000000001,"5min":1.6830000000000001,"15min":1.6830000000000001},"last":1.054},{"interface":"front","average":{"1min":1.0700000000000001,"5min":1.0700000000000001,"15min":1.0700000000000001},"min":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"max":{"1min":1.8839999999999999,"5min":1.8839999999999999,"15min":1.8839999999999999},"last":0.90000000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96699999999999997}]},{"osd":5,"last update":"Thu Apr 18 14:44:22 2024","interfaces":[{"interface":"back","average":{"1min":0.98799999999999999,"5min":0.98799999999999999,"15min":0.98799999999999999},"min":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"max":{"1min":1.5469999999999999,"5min":1.5469999999999999,"15min":1.5469999999999999},"last":0.93600000000000005},{"interface":"front","average":{"1min":0.92500000000000004,"5min":0.92500000000000004,"15min":0.92500000000000004},"min":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":1.333,"5min":1.333,"15min":1.333},"last":0.98099999999999998}]},{"osd":6,"last update":"Thu Apr 18 14:44:19 2024","interfaces":[{"interface":"back","average":{"1min":1.115,"5min":1.115,"15min":1.115},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":2.0529999999999999,"5min":2.0529999999999999,"15min":2.0529999999999999},"last":0.749},{"interface":"front","average":{"1min":1.089,"5min":1.089,"15min":1.089},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.8069999999999999,"5min":1.8069999999999999,"15min":1.8069999999999999},"last":0.85899999999999999}]},{"osd":7,"last update":"Thu Apr 18 14:44:22 2024","interfaces":[{"interface":"back","average":{"1min":1.165,"5min":1.165,"15min":1.165},"min":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"max":{"1min":2.012,"5min":2.012,"15min":2.012},"last":1.2190000000000001},{"interface":"front","average":{"1min":1.2949999999999999,"5min":1.2949999999999999,"15min":1.2949999999999999},"min":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"max":{"1min":2.1419999999999999,"5min":2.1419999999999999,"15min":2.1419999999999999},"last":1.083}]},{"osd":8,"last update":"Thu Apr 18 14:44:22 2024","interfaces":[{"interface":"back","average":{"1min":1.224,"5min":1.224,"15min":1.224},"min":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"max":{"1min":1.988,"5min":1.988,"15min":1.988},"last":1.2889999999999999},{"interface":"front","average":{"1min":1.3120000000000001,"5min":1.3120000000000001,"15min":1.3120000000000001},"min":{"1min":0.84999999999999998,"5min":0.84999999999999998,"15min":0.84999999999999998},"max":{"1min":2.2240000000000002,"5min":2.2240000000000002,"15min":2.2240000000000002},"last":1.129}]},{"osd":10,"last update":"Thu Apr 18 14:44:19 2024","interfaces":[{"interface":"back","average":{"1min":1.365,"5min":1.365,"15min":1.365},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":2.319,"5min":2.319,"15min":2.319},"last":1.107},{"interface":"front","average":{"1min":1.3879999999999999,"5min":1.3879999999999999,"15min":1.3879999999999999},"min":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"max":{"1min":2.27,"5min":2.27,"15min":2.27},"last":1.024}]},{"osd":11,"last update":"Thu Apr 18 14:44:19 2024","interfaces":[{"interface":"back","average":{"1min":1.49,"5min":1.49,"15min":1.49},"min":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"max":{"1min":2.4950000000000001,"5min":2.4950000000000001,"15min":2.4950000000000001},"last":1.27},{"interface":"front","average":{"1min":1.4590000000000001,"5min":1.4590000000000001,"15min":1.4590000000000001},"min":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"max":{"1min":2.411,"5min":2.411,"15min":2.411},"last":1.4470000000000001}]},{"osd":12,"last update":"Thu Apr 18 14:44:19 2024","interfaces":[{"interface":"back","average":{"1min":1.4910000000000001,"5min":1.4910000000000001,"15min":1.4910000000000001},"min":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":0.88500000000000001},"max":{"1min":2.2669999999999999,"5min":2.2669999999999999,"15min":2.2669999999999999},"last":1.196},{"interface":"front","average":{"1min":1.514,"5min":1.514,"15min":1.514},"min":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"max":{"1min":2.3719999999999999,"5min":2.3719999999999999,"15min":2.3719999999999999},"last":1.3260000000000001}]},{"osd":14,"last update":"Thu Apr 18 14:44:19 2024","interfaces":[{"interface":"back","average":{"1min":1.4390000000000001,"5min":1.4390000000000001,"15min":1.4390000000000001},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":2.3050000000000002,"5min":2.3050000000000002,"15min":2.3050000000000002},"last":1.3799999999999999},{"interface":"front","average":{"1min":1.5069999999999999,"5min":1.5069999999999999,"15min":1.5069999999999999},"min":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":2.4020000000000001,"5min":2.4020000000000001,"15min":2.4020000000000001},"last":1.244}]}]},{"osd":15,"up_from":23,"seq":98784247838,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32952,"kb_used_data":1832,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94338888,"statfs":{"total":96636764160,"available":96603021312,"internally_reserved":0,"allocated":1875968,"data_stored":1087311,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31848903},"hb_peers":[0,4,5,6,7,8,10,11,13,14],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Apr 18 14:44:19 2024","interfaces":[{"interface":"back","average":{"1min":0.94699999999999995,"5min":0.94699999999999995,"15min":0.94699999999999995},"min":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"max":{"1min":1.405,"5min":1.405,"15min":1.405},"last":0.99299999999999999},{"interface":"front","average":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"min":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":1.0569999999999999,"5min":1.0569999999999999,"15min":1.0569999999999999},"last":0.82899999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2050000000000001}]},{"osd":4,"last update":"Thu Apr 18 14:44:19 2024","interfaces":[{"interface":"back","average":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.85099999999999998},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.2669999999999999,"5min":1.2669999999999999,"15min":1.2669999999999999},"last":0.73899999999999999},{"interface":"front","average":{"1min":0.877,"5min":0.877,"15min":0.877},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.2410000000000001,"5min":1.2410000000000001,"15min":1.2410000000000001},"last":0.77800000000000002}]},{"osd":5,"last update":"Thu Apr 18 14:44:22 2024","interfaces":[{"interface":"back","average":{"1min":1.0209999999999999,"5min":1.0209999999999999,"15min":1.0209999999999999},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":2.0579999999999998,"5min":2.0579999999999998,"15min":2.0579999999999998},"last":1.0589999999999999},{"interface":"front","average":{"1min":1.089,"5min":1.089,"15min":1.089},"min":{"1min":0.75,"5min":0.75,"15min":0.75},"max":{"1min":1.9259999999999999,"5min":1.9259999999999999,"15min":1.9259999999999999},"last":0.96799999999999997}]},{"osd":6,"last update":"Thu Apr 18 14:44:19 2024","interfaces":[{"interface":"back","average":{"1min":1.1379999999999999,"5min":1.1379999999999999,"15min":1.1379999999999999},"min":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"max":{"1min":1.8680000000000001,"5min":1.8680000000000001,"15min":1.8680000000000001},"last":1.216},{"interface":"front","average":{"1min":1.228,"5min":1.228,"15min":1.228},"min":{"1min":0.86499999999999999,"5min":0.86499999999999999,"15min":0.86499999999999999},"max":{"1min":1.79,"5min":1.79,"15min":1.79},"last":1.125}]},{"osd":7,"last update":"Thu Apr 18 14:44:19 2024","interfaces":[{"interface":"back","average":{"1min":1.0549999999999999,"5min":1.0549999999999999,"15min":1.0549999999999999},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":1.488,"5min":1.488,"15min":1.488},"last":1.1020000000000001},{"interface":"front","average":{"1min":1.1830000000000001,"5min":1.1830000000000001,"15min":1.1830000000000001},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":1.976,"5min":1.976,"15min":1.976},"last":1.327}]},{"osd":8,"last update":"Thu Apr 18 14:44:19 2024","interfaces":[{"interface":"back","average":{"1min":1.1879999999999999,"5min":1.1879999999999999,"15min":1.1879999999999999},"min":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"max":{"1min":2.004,"5min":2.004,"15min":2.004},"last":0.88600000000000001},{"interface":"front","average":{"1min":1.222,"5min":1.222,"15min":1.222},"min":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"max":{"1min":1.786,"5min":1.786,"15min":1.786},"last":1.165}]},{"osd":10,"last update":"Thu Apr 18 14:44:19 2024","interfaces":[{"interface":"back","average":{"1min":1.3360000000000001,"5min":1.3360000000000001,"15min":1.3360000000000001},"min":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"max":{"1min":2.403,"5min":2.403,"15min":2.403},"last":1.0269999999999999},{"interface":"front","average":{"1min":1.331,"5min":1.331,"15min":1.331},"min":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"max":{"1min":2.2549999999999999,"5min":2.2549999999999999,"15min":2.2549999999999999},"last":1.554}]},{"osd":11,"last update":"Thu Apr 18 14:44:19 2024","interfaces":[{"interface":"back","average":{"1min":1.399,"5min":1.399,"15min":1.399},"min":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"max":{"1min":2.2109999999999999,"5min":2.2109999999999999,"15min":2.2109999999999999},"last":1.252},{"interface":"front","average":{"1min":1.4490000000000001,"5min":1.4490000000000001,"15min":1.4490000000000001},"min":{"1min":0.629,"5min":0.629,"15min":0.629},"max":{"1min":2.1589999999999998,"5min":2.1589999999999998,"15min":2.1589999999999998},"last":1.415}]},{"osd":13,"last update":"Thu Apr 18 14:44:22 2024","interfaces":[{"interface":"back","average":{"1min":1.391,"5min":1.391,"15min":1.391},"min":{"1min":1.0109999999999999,"5min":1.0109999999999999,"15min":1.0109999999999999},"max":{"1min":1.9419999999999999,"5min":1.9419999999999999,"15min":1.9419999999999999},"last":1.1910000000000001},{"interface":"front","average":{"1min":1.387,"5min":1.387,"15min":1.387},"min":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"max":{"1min":1.8959999999999999,"5min":1.8959999999999999,"15min":1.8959999999999999},"last":1.302}]},{"osd":14,"last update":"Thu Apr 18 14:44:19 2024","interfaces":[{"interface":"back","average":{"1min":1.4279999999999999,"5min":1.4279999999999999,"15min":1.4279999999999999},"min":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"max":{"1min":2.351,"5min":2.351,"15min":2.351},"last":1.488},{"interface":"front","average":{"1min":1.454,"5min":1.454,"15min":1.454},"min":{"1min":0.84299999999999997,"5min":0.84299999999999997,"15min":0.84299999999999997},"max":{"1min":2.766,"5min":2.766,"15min":2.766},"last":1.3520000000000001}]}]},{"osd":4,"up_from":22,"seq":94489280540,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":51000,"kb_used_data":1832,"kb_used_omap":1,"kb_used_meta":49150,"kb_avail":94320840,"statfs":{"total":96636764160,"available":96584540160,"internally_reserved":0,"allocated":1875968,"data_stored":1087311,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":50330054},"hb_peers":[2,3,5,6,10,11,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":2,"last update":"Thu Apr 18 14:44:20 2024","interfaces":[{"interface":"back","average":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":1.2330000000000001,"5min":1.2330000000000001,"15min":1.2330000000000001},"last":1.0700000000000001},{"interface":"front","average":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":1.306,"5min":1.306,"15min":1.306},"last":0.94899999999999995}]},{"osd":3,"last update":"Thu Apr 18 14:44:20 2024","interfaces":[{"interface":"back","average":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":1.1499999999999999,"5min":1.1499999999999999,"15min":1.1499999999999999},"last":1.0960000000000001},{"interface":"front","average":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":1.0169999999999999,"5min":1.0169999999999999,"15min":1.0169999999999999},"last":0.91500000000000004}]},{"osd":5,"last update":"Thu Apr 18 14:44:20 2024","interfaces":[{"interface":"back","average":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":1.0609999999999999,"5min":1.0609999999999999,"15min":1.0609999999999999},"last":0.874},{"interface":"front","average":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":1.2190000000000001,"5min":1.2190000000000001,"15min":1.2190000000000001},"last":1.296}]},{"osd":6,"last update":"Thu Apr 18 14:44:20 2024","interfaces":[{"interface":"back","average":{"1min":0.84999999999999998,"5min":0.84999999999999998,"15min":0.84999999999999998},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":1.1930000000000001,"5min":1.1930000000000001,"15min":1.1930000000000001},"last":1.137},{"interface":"front","average":{"1min":0.88,"5min":0.88,"15min":0.88},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.337,"5min":1.337,"15min":1.337},"last":1.1659999999999999}]},{"osd":10,"last update":"Thu Apr 18 14:44:20 2024","interfaces":[{"interface":"back","average":{"1min":0.876,"5min":0.876,"15min":0.876},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":1.49,"5min":1.49,"15min":1.49},"last":1.2170000000000001},{"interface":"front","average":{"1min":0.90900000000000003,"5min":0.90900000000000003,"15min":0.90900000000000003},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.5700000000000001,"5min":1.5700000000000001,"15min":1.5700000000000001},"last":1.014}]},{"osd":11,"last update":"Thu Apr 18 14:44:20 2024","interfaces":[{"interface":"back","average":{"1min":0.86499999999999999,"5min":0.86499999999999999,"15min":0.86499999999999999},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":1.2130000000000001,"5min":1.2130000000000001,"15min":1.2130000000000001},"last":1.427},{"interface":"front","average":{"1min":0.90100000000000002,"5min":0.90100000000000002,"15min":0.90100000000000002},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.365,"5min":1.365,"15min":1.365},"last":1.3300000000000001}]},{"osd":12,"last update":"Thu Apr 18 14:44:20 2024","interfaces":[{"interface":"back","average":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":1.1879999999999999,"5min":1.1879999999999999,"15min":1.1879999999999999},"last":1.371},{"interface":"front","average":{"1min":0.86099999999999999,"5min":0.86099999999999999,"15min":0.86099999999999999},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":1.2949999999999999,"5min":1.2949999999999999,"15min":1.2949999999999999},"last":1.401}]},{"osd":13,"last update":"Thu Apr 18 14:44:20 2024","interfaces":[{"interface":"back","average":{"1min":0.95999999999999996,"5min":0.95999999999999996,"15min":0.95999999999999996},"min":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.4279999999999999,"5min":1.4279999999999999,"15min":1.4279999999999999},"last":1.464},{"interface":"front","average":{"1min":0.89900000000000002,"5min":0.89900000000000002,"15min":0.89900000000000002},"min":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"max":{"1min":1.3360000000000001,"5min":1.3360000000000001,"15min":1.3360000000000001},"last":1.357}]},{"osd":14,"last update":"Thu Apr 18 14:44:20 2024","interfaces":[{"interface":"back","average":{"1min":1.022,"5min":1.022,"15min":1.022},"min":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":1.4730000000000001,"5min":1.4730000000000001,"15min":1.4730000000000001},"last":1.2629999999999999},{"interface":"front","average":{"1min":1.0429999999999999,"5min":1.0429999999999999,"15min":1.0429999999999999},"min":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"max":{"1min":1.369,"5min":1.369,"15min":1.369},"last":1.55}]},{"osd":15,"last update":"Thu Apr 18 14:44:20 2024","interfaces":[{"interface":"back","average":{"1min":1.016,"5min":1.016,"15min":1.016},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.5980000000000001,"5min":1.5980000000000001,"15min":1.5980000000000001},"last":1.488},{"interface":"front","average":{"1min":1.02,"5min":1.02,"15min":1.02},"min":{"1min":0.624,"5min":0.624,"15min":0.624},"max":{"1min":1.5649999999999999,"5min":1.5649999999999999,"15min":1.5649999999999999},"last":1.5249999999999999}]}]},{"osd":6,"up_from":22,"seq":94489280540,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32956,"kb_used_data":1836,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94338884,"statfs":{"total":96636764160,"available":96603017216,"internally_reserved":0,"allocated":1880064,"data_stored":1088155,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31848903},"hb_peers":[0,1,5,7,8,9,11,12,13,14],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Apr 18 14:44:30 2024","interfaces":[{"interface":"back","average":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":1.5629999999999999,"5min":1.5629999999999999,"15min":1.5629999999999999},"last":0.61099999999999999},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":1.006,"5min":1.006,"15min":1.006},"last":0.65400000000000003}]},{"osd":1,"last update":"Thu Apr 18 14:44:19 2024","interfaces":[{"interface":"back","average":{"1min":1.0329999999999999,"5min":1.0329999999999999,"15min":1.0329999999999999},"min":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"max":{"1min":1.633,"5min":1.633,"15min":1.633},"last":0.88200000000000001},{"interface":"front","average":{"1min":1.129,"5min":1.129,"15min":1.129},"min":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"max":{"1min":1.585,"5min":1.585,"15min":1.585},"last":1.1020000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95399999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86599999999999999}]},{"osd":5,"last update":"Thu Apr 18 14:44:19 2024","interfaces":[{"interface":"back","average":{"1min":0.96399999999999997,"5min":0.96399999999999997,"15min":0.96399999999999997},"min":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":1.627,"5min":1.627,"15min":1.627},"last":0.97599999999999998},{"interface":"front","average":{"1min":0.98199999999999998,"5min":0.98199999999999998,"15min":0.98199999999999998},"min":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"max":{"1min":1.246,"5min":1.246,"15min":1.246},"last":0.94899999999999995}]},{"osd":7,"last update":"Thu Apr 18 14:44:19 2024","interfaces":[{"interface":"back","average":{"1min":1.1399999999999999,"5min":1.1399999999999999,"15min":1.1399999999999999},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.5860000000000001,"5min":1.5860000000000001,"15min":1.5860000000000001},"last":1.024},{"interface":"front","average":{"1min":1.022,"5min":1.022,"15min":1.022},"min":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":1.482,"5min":1.482,"15min":1.482},"last":0.70499999999999996}]},{"osd":8,"last update":"Thu Apr 18 14:44:19 2024","interfaces":[{"interface":"back","average":{"1min":0.99299999999999999,"5min":0.99299999999999999,"15min":0.99299999999999999},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.3380000000000001,"5min":1.3380000000000001,"15min":1.3380000000000001},"last":0.80900000000000005},{"interface":"front","average":{"1min":1.163,"5min":1.163,"15min":1.163},"min":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"max":{"1min":1.673,"5min":1.673,"15min":1.673},"last":0.91000000000000003}]},{"osd":9,"last update":"Thu Apr 18 14:44:30 2024","interfaces":[{"interface":"back","average":{"1min":1.1279999999999999,"5min":1.1279999999999999,"15min":1.1279999999999999},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.3859999999999999,"5min":1.3859999999999999,"15min":1.3859999999999999},"last":1.073},{"interface":"front","average":{"1min":1.1870000000000001,"5min":1.1870000000000001,"15min":1.1870000000000001},"min":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"max":{"1min":1.5640000000000001,"5min":1.5640000000000001,"15min":1.5640000000000001},"last":1.133}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3240000000000001}]},{"osd":11,"last update":"Thu Apr 18 14:44:17 2024","interfaces":[{"interface":"back","average":{"1min":1.359,"5min":1.359,"15min":1.359},"min":{"1min":1.0229999999999999,"5min":1.0229999999999999,"15min":1.0229999999999999},"max":{"1min":2.3610000000000002,"5min":2.3610000000000002,"15min":2.3610000000000002},"last":1.2410000000000001},{"interface":"front","average":{"1min":1.1439999999999999,"5min":1.1439999999999999,"15min":1.1439999999999999},"min":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"max":{"1min":1.698,"5min":1.698,"15min":1.698},"last":1.169}]},{"osd":12,"last update":"Thu Apr 18 14:44:17 2024","interfaces":[{"interface":"back","average":{"1min":1.1950000000000001,"5min":1.1950000000000001,"15min":1.1950000000000001},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.5189999999999999,"5min":1.5189999999999999,"15min":1.5189999999999999},"last":1.052},{"interface":"front","average":{"1min":1.3400000000000001,"5min":1.3400000000000001,"15min":1.3400000000000001},"min":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"max":{"1min":2.1920000000000002,"5min":2.1920000000000002,"15min":2.1920000000000002},"last":1.1899999999999999}]},{"osd":13,"last update":"Thu Apr 18 14:44:30 2024","interfaces":[{"interface":"back","average":{"1min":1.4139999999999999,"5min":1.4139999999999999,"15min":1.4139999999999999},"min":{"1min":1.0309999999999999,"5min":1.0309999999999999,"15min":1.0309999999999999},"max":{"1min":1.794,"5min":1.794,"15min":1.794},"last":1.278},{"interface":"front","average":{"1min":1.29,"5min":1.29,"15min":1.29},"min":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":0.94599999999999995},"max":{"1min":1.591,"5min":1.591,"15min":1.591},"last":1.2569999999999999}]},{"osd":14,"last update":"Thu Apr 18 14:44:17 2024","interfaces":[{"interface":"back","average":{"1min":1.3280000000000001,"5min":1.3280000000000001,"15min":1.3280000000000001},"min":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"max":{"1min":1.8580000000000001,"5min":1.8580000000000001,"15min":1.8580000000000001},"last":1.319},{"interface":"front","average":{"1min":1.347,"5min":1.347,"15min":1.347},"min":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":1.712,"5min":1.712,"15min":1.712},"last":1.2230000000000001}]}]},{"osd":10,"up_from":22,"seq":94489280541,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32952,"kb_used_data":1832,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94338888,"statfs":{"total":96636764160,"available":96603021312,"internally_reserved":0,"allocated":1875968,"data_stored":1087311,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1599,"internal_metadata":31848897},"hb_peers":[1,6,7,8,9,11,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Apr 18 14:45:13 2024","interfaces":[{"interface":"back","average":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"min":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"max":{"1min":1.1910000000000001,"5min":1.1910000000000001,"15min":1.1910000000000001},"last":0.96999999999999997},{"interface":"front","average":{"1min":0.96099999999999997,"5min":0.96099999999999997,"15min":0.96099999999999997},"min":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":1.3380000000000001,"5min":1.3380000000000001,"15min":1.3380000000000001},"last":0.92400000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.371}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.117}]},{"osd":6,"last update":"Thu Apr 18 14:44:20 2024","interfaces":[{"interface":"back","average":{"1min":1.1830000000000001,"5min":1.1830000000000001,"15min":1.1830000000000001},"min":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"max":{"1min":3.9830000000000001,"5min":3.9830000000000001,"15min":3.9830000000000001},"last":0.73299999999999998},{"interface":"front","average":{"1min":1.0309999999999999,"5min":1.0309999999999999,"15min":1.0309999999999999},"min":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"max":{"1min":2.9420000000000002,"5min":2.9420000000000002,"15min":2.9420000000000002},"last":0.77600000000000002}]},{"osd":7,"last update":"Thu Apr 18 14:44:32 2024","interfaces":[{"interface":"back","average":{"1min":1.1870000000000001,"5min":1.1870000000000001,"15min":1.1870000000000001},"min":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":3.3679999999999999,"5min":3.3679999999999999,"15min":3.3679999999999999},"last":1.2170000000000001},{"interface":"front","average":{"1min":1.2190000000000001,"5min":1.2190000000000001,"15min":1.2190000000000001},"min":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"max":{"1min":3.1669999999999998,"5min":3.1669999999999998,"15min":3.1669999999999998},"last":1.264}]},{"osd":8,"last update":"Thu Apr 18 14:44:20 2024","interfaces":[{"interface":"back","average":{"1min":1.091,"5min":1.091,"15min":1.091},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":4.0439999999999996,"5min":4.0439999999999996,"15min":4.0439999999999996},"last":0.82599999999999996},{"interface":"front","average":{"1min":1.4390000000000001,"5min":1.4390000000000001,"15min":1.4390000000000001},"min":{"1min":0.89500000000000002,"5min":0.89500000000000002,"15min":0.89500000000000002},"max":{"1min":4.4900000000000002,"5min":4.4900000000000002,"15min":4.4900000000000002},"last":1.1379999999999999}]},{"osd":9,"last update":"Thu Apr 18 14:44:20 2024","interfaces":[{"interface":"back","average":{"1min":1.3580000000000001,"5min":1.3580000000000001,"15min":1.3580000000000001},"min":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"max":{"1min":3.8439999999999999,"5min":3.8439999999999999,"15min":3.8439999999999999},"last":1.0529999999999999},{"interface":"front","average":{"1min":1.361,"5min":1.361,"15min":1.361},"min":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"max":{"1min":4.2880000000000003,"5min":4.2880000000000003,"15min":4.2880000000000003},"last":1.1779999999999999}]},{"osd":11,"last update":"Thu Apr 18 14:44:20 2024","interfaces":[{"interface":"back","average":{"1min":1.4159999999999999,"5min":1.4159999999999999,"15min":1.4159999999999999},"min":{"1min":0.755,"5min":0.755,"15min":0.755},"max":{"1min":4.3399999999999999,"5min":4.3399999999999999,"15min":4.3399999999999999},"last":1.101},{"interface":"front","average":{"1min":1.5740000000000001,"5min":1.5740000000000001,"15min":1.5740000000000001},"min":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"max":{"1min":4.4450000000000003,"5min":4.4450000000000003,"15min":4.4450000000000003},"last":1.2350000000000001}]},{"osd":12,"last update":"Thu Apr 18 14:44:20 2024","interfaces":[{"interface":"back","average":{"1min":1.3440000000000001,"5min":1.3440000000000001,"15min":1.3440000000000001},"min":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"max":{"1min":3.5539999999999998,"5min":3.5539999999999998,"15min":3.5539999999999998},"last":1.3540000000000001},{"interface":"front","average":{"1min":1.431,"5min":1.431,"15min":1.431},"min":{"1min":0.621,"5min":0.621,"15min":0.621},"max":{"1min":4.125,"5min":4.125,"15min":4.125},"last":1.3109999999999999}]},{"osd":13,"last update":"Thu Apr 18 14:44:20 2024","interfaces":[{"interface":"back","average":{"1min":1.71,"5min":1.71,"15min":1.71},"min":{"1min":1.1160000000000001,"5min":1.1160000000000001,"15min":1.1160000000000001},"max":{"1min":4.5359999999999996,"5min":4.5359999999999996,"15min":4.5359999999999996},"last":1.3740000000000001},{"interface":"front","average":{"1min":1.5429999999999999,"5min":1.5429999999999999,"15min":1.5429999999999999},"min":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.85599999999999998},"max":{"1min":4.0049999999999999,"5min":4.0049999999999999,"15min":4.0049999999999999},"last":1.417}]},{"osd":14,"last update":"Thu Apr 18 14:44:20 2024","interfaces":[{"interface":"back","average":{"1min":1.7090000000000001,"5min":1.7090000000000001,"15min":1.7090000000000001},"min":{"1min":1.073,"5min":1.073,"15min":1.073},"max":{"1min":4.3940000000000001,"5min":4.3940000000000001,"15min":4.3940000000000001},"last":1.29},{"interface":"front","average":{"1min":1.5680000000000001,"5min":1.5680000000000001,"15min":1.5680000000000001},"min":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"max":{"1min":3.73,"5min":3.73,"15min":3.73},"last":1.4630000000000001}]},{"osd":15,"last update":"Thu Apr 18 14:44:20 2024","interfaces":[{"interface":"back","average":{"1min":1.5629999999999999,"5min":1.5629999999999999,"15min":1.5629999999999999},"min":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":0.94999999999999996},"max":{"1min":4.1959999999999997,"5min":4.1959999999999997,"15min":4.1959999999999997},"last":1.3879999999999999},{"interface":"front","average":{"1min":1.802,"5min":1.802,"15min":1.802},"min":{"1min":1.1579999999999999,"5min":1.1579999999999999,"15min":1.1579999999999999},"max":{"1min":4.577,"5min":4.577,"15min":4.577},"last":1.3320000000000001}]}]},{"osd":11,"up_from":22,"seq":94489280541,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32952,"kb_used_data":1832,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94338888,"statfs":{"total":96636764160,"available":96603021312,"internally_reserved":0,"allocated":1875968,"data_stored":1087311,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31848901},"hb_peers":[2,4,5,6,8,10,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":2,"last update":"Thu Apr 18 14:44:18 2024","interfaces":[{"interface":"back","average":{"1min":0.93899999999999995,"5min":0.93899999999999995,"15min":0.93899999999999995},"min":{"1min":0.503,"5min":0.503,"15min":0.503},"max":{"1min":1.367,"5min":1.367,"15min":1.367},"last":0.91500000000000004},{"interface":"front","average":{"1min":1.0229999999999999,"5min":1.0229999999999999,"15min":1.0229999999999999},"min":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":2.863,"5min":2.863,"15min":2.863},"last":0.749}]},{"osd":4,"last update":"Thu Apr 18 14:44:18 2024","interfaces":[{"interface":"back","average":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"min":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":1.1259999999999999,"5min":1.1259999999999999,"15min":1.1259999999999999},"last":0.77200000000000002},{"interface":"front","average":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.129,"5min":1.129,"15min":1.129},"last":0.71999999999999997}]},{"osd":5,"last update":"Thu Apr 18 14:44:23 2024","interfaces":[{"interface":"back","average":{"1min":0.98999999999999999,"5min":0.98999999999999999,"15min":0.98999999999999999},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":1.5840000000000001,"5min":1.5840000000000001,"15min":1.5840000000000001},"last":0.61399999999999999},{"interface":"front","average":{"1min":0.97199999999999998,"5min":0.97199999999999998,"15min":0.97199999999999998},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.619,"5min":1.619,"15min":1.619},"last":0.86199999999999999}]},{"osd":6,"last update":"Thu Apr 18 14:44:18 2024","interfaces":[{"interface":"back","average":{"1min":1.1319999999999999,"5min":1.1319999999999999,"15min":1.1319999999999999},"min":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"max":{"1min":2.9199999999999999,"5min":2.9199999999999999,"15min":2.9199999999999999},"last":0.96399999999999997},{"interface":"front","average":{"1min":1,"5min":1,"15min":1},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.9510000000000001,"5min":1.9510000000000001,"15min":1.9510000000000001},"last":1.105}]},{"osd":8,"last update":"Thu Apr 18 14:44:23 2024","interfaces":[{"interface":"back","average":{"1min":0.97799999999999998,"5min":0.97799999999999998,"15min":0.97799999999999998},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.452,"5min":1.452,"15min":1.452},"last":1.002},{"interface":"front","average":{"1min":1.006,"5min":1.006,"15min":1.006},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":1.383,"5min":1.383,"15min":1.383},"last":1.0449999999999999}]},{"osd":10,"last update":"Thu Apr 18 14:44:18 2024","interfaces":[{"interface":"back","average":{"1min":1.234,"5min":1.234,"15min":1.234},"min":{"1min":0.745,"5min":0.745,"15min":0.745},"max":{"1min":2.774,"5min":2.774,"15min":2.774},"last":1.208},{"interface":"front","average":{"1min":1.105,"5min":1.105,"15min":1.105},"min":{"1min":0.627,"5min":0.627,"15min":0.627},"max":{"1min":1.6890000000000001,"5min":1.6890000000000001,"15min":1.6890000000000001},"last":1.1839999999999999}]},{"osd":12,"last update":"Thu Apr 18 14:44:18 2024","interfaces":[{"interface":"back","average":{"1min":1.1639999999999999,"5min":1.1639999999999999,"15min":1.1639999999999999},"min":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.6719999999999999,"5min":1.6719999999999999,"15min":1.6719999999999999},"last":1.1579999999999999},{"interface":"front","average":{"1min":1.2729999999999999,"5min":1.2729999999999999,"15min":1.2729999999999999},"min":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"max":{"1min":3.4169999999999998,"5min":3.4169999999999998,"15min":3.4169999999999998},"last":0.89300000000000002}]},{"osd":13,"last update":"Thu Apr 18 14:44:23 2024","interfaces":[{"interface":"back","average":{"1min":1.367,"5min":1.367,"15min":1.367},"min":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"max":{"1min":3.3239999999999998,"5min":3.3239999999999998,"15min":3.3239999999999998},"last":1.0760000000000001},{"interface":"front","average":{"1min":1.1639999999999999,"5min":1.1639999999999999,"15min":1.1639999999999999},"min":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"max":{"1min":1.746,"5min":1.746,"15min":1.746},"last":1.2529999999999999}]},{"osd":14,"last update":"Thu Apr 18 14:44:18 2024","interfaces":[{"interface":"back","average":{"1min":1.1950000000000001,"5min":1.1950000000000001,"15min":1.1950000000000001},"min":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"max":{"1min":1.6619999999999999,"5min":1.6619999999999999,"15min":1.6619999999999999},"last":1.319},{"interface":"front","average":{"1min":1.2450000000000001,"5min":1.2450000000000001,"15min":1.2450000000000001},"min":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"max":{"1min":1.7210000000000001,"5min":1.7210000000000001,"15min":1.7210000000000001},"last":1.236}]},{"osd":15,"last update":"Thu Apr 18 14:44:23 2024","interfaces":[{"interface":"back","average":{"1min":1.284,"5min":1.284,"15min":1.284},"min":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"max":{"1min":1.851,"5min":1.851,"15min":1.851},"last":1.2769999999999999},{"interface":"front","average":{"1min":1.409,"5min":1.409,"15min":1.409},"min":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"max":{"1min":3.3769999999999998,"5min":3.3769999999999998,"15min":3.3769999999999998},"last":1.294}]}]},{"osd":12,"up_from":22,"seq":94489280541,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32952,"kb_used_data":1832,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94338888,"statfs":{"total":96636764160,"available":96603021312,"internally_reserved":0,"allocated":1875968,"data_stored":1087311,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[1,3,4,5,6,10,11,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Apr 18 14:44:30 2024","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":1.3400000000000001,"5min":1.3400000000000001,"15min":1.3400000000000001},"last":0.68100000000000005},{"interface":"front","average":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":1.2310000000000001,"5min":1.2310000000000001,"15min":1.2310000000000001},"last":0.78900000000000003}]},{"osd":1,"last update":"Thu Apr 18 14:44:20 2024","interfaces":[{"interface":"back","average":{"1min":0.93999999999999995,"5min":0.93999999999999995,"15min":0.93999999999999995},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.5449999999999999,"5min":1.5449999999999999,"15min":1.5449999999999999},"last":0.48599999999999999},{"interface":"front","average":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":1.2649999999999999,"5min":1.2649999999999999,"15min":1.2649999999999999},"last":0.57199999999999995}]},{"osd":3,"last update":"Thu Apr 18 14:44:20 2024","interfaces":[{"interface":"back","average":{"1min":0.93999999999999995,"5min":0.93999999999999995,"15min":0.93999999999999995},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":1.4930000000000001,"5min":1.4930000000000001,"15min":1.4930000000000001},"last":0.70099999999999996},{"interface":"front","average":{"1min":0.91500000000000004,"5min":0.91500000000000004,"15min":0.91500000000000004},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.4319999999999999,"5min":1.4319999999999999,"15min":1.4319999999999999},"last":0.47499999999999998}]},{"osd":4,"last update":"Thu Apr 18 14:44:20 2024","interfaces":[{"interface":"back","average":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":1.383,"5min":1.383,"15min":1.383},"last":0.34999999999999998},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":1.335,"5min":1.335,"15min":1.335},"last":0.38100000000000001}]},{"osd":5,"last update":"Thu Apr 18 14:44:30 2024","interfaces":[{"interface":"back","average":{"1min":0.93100000000000005,"5min":0.93100000000000005,"15min":0.93100000000000005},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.4710000000000001,"5min":1.4710000000000001,"15min":1.4710000000000001},"last":0.497},{"interface":"front","average":{"1min":1.03,"5min":1.03,"15min":1.03},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.784,"5min":1.784,"15min":1.784},"last":0.60599999999999998}]},{"osd":6,"last update":"Thu Apr 18 14:44:20 2024","interfaces":[{"interface":"back","average":{"1min":1.0289999999999999,"5min":1.0289999999999999,"15min":1.0289999999999999},"min":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":1.6060000000000001,"5min":1.6060000000000001,"15min":1.6060000000000001},"last":0.52700000000000002},{"interface":"front","average":{"1min":1.0820000000000001,"5min":1.0820000000000001,"15min":1.0820000000000001},"min":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"max":{"1min":1.5620000000000001,"5min":1.5620000000000001,"15min":1.5620000000000001},"last":0.64800000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1539999999999999}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4119999999999999}]},{"osd":10,"last update":"Thu Apr 18 14:44:20 2024","interfaces":[{"interface":"back","average":{"1min":1.137,"5min":1.137,"15min":1.137},"min":{"1min":0.626,"5min":0.626,"15min":0.626},"max":{"1min":1.6919999999999999,"5min":1.6919999999999999,"15min":1.6919999999999999},"last":0.76300000000000001},{"interface":"front","average":{"1min":1.1100000000000001,"5min":1.1100000000000001,"15min":1.1100000000000001},"min":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"max":{"1min":1.8899999999999999,"5min":1.8899999999999999,"15min":1.8899999999999999},"last":0.63500000000000001}]},{"osd":11,"last update":"Thu Apr 18 14:44:20 2024","interfaces":[{"interface":"back","average":{"1min":1.1890000000000001,"5min":1.1890000000000001,"15min":1.1890000000000001},"min":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"max":{"1min":2.04,"5min":2.04,"15min":2.04},"last":0.59199999999999997},{"interface":"front","average":{"1min":1.1599999999999999,"5min":1.1599999999999999,"15min":1.1599999999999999},"min":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"max":{"1min":1.8660000000000001,"5min":1.8660000000000001,"15min":1.8660000000000001},"last":0.66300000000000003}]},{"osd":13,"last update":"Thu Apr 18 14:44:20 2024","interfaces":[{"interface":"back","average":{"1min":1.181,"5min":1.181,"15min":1.181},"min":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"max":{"1min":1.8080000000000001,"5min":1.8080000000000001,"15min":1.8080000000000001},"last":0.73899999999999999},{"interface":"front","average":{"1min":1.228,"5min":1.228,"15min":1.228},"min":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"max":{"1min":2.133,"5min":2.133,"15min":2.133},"last":0.71199999999999997}]},{"osd":14,"last update":"Thu Apr 18 14:44:20 2024","interfaces":[{"interface":"back","average":{"1min":1.226,"5min":1.226,"15min":1.226},"min":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"max":{"1min":1.7410000000000001,"5min":1.7410000000000001,"15min":1.7410000000000001},"last":0.72099999999999997},{"interface":"front","average":{"1min":1.232,"5min":1.232,"15min":1.232},"min":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"max":{"1min":1.966,"5min":1.966,"15min":1.966},"last":0.79400000000000004}]},{"osd":15,"last update":"Thu Apr 18 14:44:20 2024","interfaces":[{"interface":"back","average":{"1min":1.2190000000000001,"5min":1.2190000000000001,"15min":1.2190000000000001},"min":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"max":{"1min":1.802,"5min":1.802,"15min":1.802},"last":0.621},{"interface":"front","average":{"1min":1.2889999999999999,"5min":1.2889999999999999,"15min":1.2889999999999999},"min":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"max":{"1min":1.8580000000000001,"5min":1.8580000000000001,"15min":1.8580000000000001},"last":0.78400000000000003}]}]},{"osd":0,"up_from":23,"seq":98784247837,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33464,"kb_used_data":2352,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94338376,"statfs":{"total":96636764160,"available":96602497024,"internally_reserved":0,"allocated":2408448,"data_stored":1616239,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[1,4,6,7,8,10,11,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Apr 18 14:44:23 2024","interfaces":[{"interface":"back","average":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":1.218,"5min":1.218,"15min":1.218},"last":0.69199999999999995},{"interface":"front","average":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.47,"5min":1.47,"15min":1.47},"last":0.84499999999999997}]},{"osd":4,"last update":"Thu Apr 18 14:44:19 2024","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":1.5409999999999999,"5min":1.5409999999999999,"15min":1.5409999999999999},"last":0.59899999999999998},{"interface":"front","average":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":1.903,"5min":1.903,"15min":1.903},"last":0.54900000000000004}]},{"osd":6,"last update":"Thu Apr 18 14:44:19 2024","interfaces":[{"interface":"back","average":{"1min":0.90200000000000002,"5min":0.90200000000000002,"15min":0.90200000000000002},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":2.5009999999999999,"5min":2.5009999999999999,"15min":2.5009999999999999},"last":0.78900000000000003},{"interface":"front","average":{"1min":0.89500000000000002,"5min":0.89500000000000002,"15min":0.89500000000000002},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":1.6240000000000001,"5min":1.6240000000000001,"15min":1.6240000000000001},"last":0.66500000000000004}]},{"osd":7,"last update":"Thu Apr 18 14:44:19 2024","interfaces":[{"interface":"back","average":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":1.2350000000000001,"5min":1.2350000000000001,"15min":1.2350000000000001},"last":0.72499999999999998},{"interface":"front","average":{"1min":0.93899999999999995,"5min":0.93899999999999995,"15min":0.93899999999999995},"min":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"max":{"1min":1.5860000000000001,"5min":1.5860000000000001,"15min":1.5860000000000001},"last":0.89200000000000002}]},{"osd":8,"last update":"Thu Apr 18 14:44:19 2024","interfaces":[{"interface":"back","average":{"1min":1.734,"5min":1.734,"15min":1.734},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":18.015999999999998,"5min":18.015999999999998,"15min":18.015999999999998},"last":0.44500000000000001},{"interface":"front","average":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":1.6599999999999999,"5min":1.6599999999999999,"15min":1.6599999999999999},"last":0.315}]},{"osd":10,"last update":"Thu Apr 18 14:44:19 2024","interfaces":[{"interface":"back","average":{"1min":1.0960000000000001,"5min":1.0960000000000001,"15min":1.0960000000000001},"min":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"max":{"1min":2.1339999999999999,"5min":2.1339999999999999,"15min":2.1339999999999999},"last":0.88400000000000001},{"interface":"front","average":{"1min":1.119,"5min":1.119,"15min":1.119},"min":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"max":{"1min":1.8540000000000001,"5min":1.8540000000000001,"15min":1.8540000000000001},"last":0.80800000000000005}]},{"osd":11,"last update":"Thu Apr 18 14:44:19 2024","interfaces":[{"interface":"back","average":{"1min":2.9990000000000001,"5min":2.9990000000000001,"15min":2.9990000000000001},"min":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":41.195999999999998,"5min":41.195999999999998,"15min":41.195999999999998},"last":0.93200000000000005},{"interface":"front","average":{"1min":3.1339999999999999,"5min":3.1339999999999999,"15min":3.1339999999999999},"min":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"max":{"1min":41.216999999999999,"5min":41.216999999999999,"15min":41.216999999999999},"last":0.86299999999999999}]},{"osd":13,"last update":"Thu Apr 18 14:44:23 2024","interfaces":[{"interface":"back","average":{"1min":0.95099999999999996,"5min":0.95099999999999996,"15min":0.95099999999999996},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":1.881,"5min":1.881,"15min":1.881},"last":0.63200000000000001},{"interface":"front","average":{"1min":1.091,"5min":1.091,"15min":1.091},"min":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":1.8720000000000001,"5min":1.8720000000000001,"15min":1.8720000000000001},"last":0.96899999999999997}]},{"osd":14,"last update":"Thu Apr 18 14:44:19 2024","interfaces":[{"interface":"back","average":{"1min":1.103,"5min":1.103,"15min":1.103},"min":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"max":{"1min":1.95,"5min":1.95,"15min":1.95},"last":0.754},{"interface":"front","average":{"1min":1.095,"5min":1.095,"15min":1.095},"min":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"max":{"1min":2.1219999999999999,"5min":2.1219999999999999,"15min":2.1219999999999999},"last":0.81999999999999995}]},{"osd":15,"last update":"Thu Apr 18 14:44:19 2024","interfaces":[{"interface":"back","average":{"1min":1.224,"5min":1.224,"15min":1.224},"min":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"max":{"1min":1.929,"5min":1.929,"15min":1.929},"last":1.1619999999999999},{"interface":"front","average":{"1min":1.179,"5min":1.179,"15min":1.179},"min":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":2.056,"5min":2.056,"15min":2.056},"last":0.90400000000000003}]}]},{"osd":3,"up_from":23,"seq":98784247836,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32956,"kb_used_data":1836,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94338884,"statfs":{"total":96636764160,"available":96603017216,"internally_reserved":0,"allocated":1880064,"data_stored":1088155,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31848904},"hb_peers":[0,2,4,5,8,9,10,11,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Apr 18 14:44:20 2024","interfaces":[{"interface":"back","average":{"1min":0.88200000000000001,"5min":0.88200000000000001,"15min":0.88200000000000001},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":1.4510000000000001,"5min":1.4510000000000001,"15min":1.4510000000000001},"last":0.76300000000000001},{"interface":"front","average":{"1min":1,"5min":1,"15min":1},"min":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"max":{"1min":1.4850000000000001,"5min":1.4850000000000001,"15min":1.4850000000000001},"last":0.92600000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4590000000000001}]},{"osd":2,"last update":"Thu Apr 18 14:44:20 2024","interfaces":[{"interface":"back","average":{"1min":0.98599999999999999,"5min":0.98599999999999999,"15min":0.98599999999999999},"min":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.5469999999999999,"5min":1.5469999999999999,"15min":1.5469999999999999},"last":0.80700000000000005},{"interface":"front","average":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":0.94999999999999996},"min":{"1min":0.623,"5min":0.623,"15min":0.623},"max":{"1min":1.425,"5min":1.425,"15min":1.425},"last":0.95099999999999996}]},{"osd":4,"last update":"Thu Apr 18 14:44:20 2024","interfaces":[{"interface":"back","average":{"1min":1.008,"5min":1.008,"15min":1.008},"min":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.7030000000000001,"5min":1.7030000000000001,"15min":1.7030000000000001},"last":0.84799999999999998},{"interface":"front","average":{"1min":0.98699999999999999,"5min":0.98699999999999999,"15min":0.98699999999999999},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":1.5309999999999999,"5min":1.5309999999999999,"15min":1.5309999999999999},"last":0.88700000000000001}]},{"osd":5,"last update":"Thu Apr 18 14:44:20 2024","interfaces":[{"interface":"back","average":{"1min":1.087,"5min":1.087,"15min":1.087},"min":{"1min":0.624,"5min":0.624,"15min":0.624},"max":{"1min":1.663,"5min":1.663,"15min":1.663},"last":1.103},{"interface":"front","average":{"1min":1.206,"5min":1.206,"15min":1.206},"min":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":1.6779999999999999,"5min":1.6779999999999999,"15min":1.6779999999999999},"last":1.389}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.472}]},{"osd":7,"last update":"Thu Apr 18 14:44:20 2024","interfaces":[{"interface":"back","average":{"1min":1.157,"5min":1.157,"15min":1.157},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.645,"5min":1.645,"15min":1.645},"last":0.82199999999999995},{"interface":"front","average":{"1min":1.115,"5min":1.115,"15min":1.115},"min":{"1min":0.503,"5min":0.503,"15min":0.503},"max":{"1min":1.6419999999999999,"5min":1.6419999999999999,"15min":1.6419999999999999},"last":0.90800000000000003}]},{"osd":8,"last update":"Thu Apr 18 14:44:20 2024","interfaces":[{"interface":"back","average":{"1min":1.1339999999999999,"5min":1.1339999999999999,"15min":1.1339999999999999},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.7529999999999999,"5min":1.7529999999999999,"15min":1.7529999999999999},"last":1.026},{"interface":"front","average":{"1min":1.304,"5min":1.304,"15min":1.304},"min":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"max":{"1min":1.7430000000000001,"5min":1.7430000000000001,"15min":1.7430000000000001},"last":1.22}]},{"osd":9,"last update":"Thu Apr 18 14:44:33 2024","interfaces":[{"interface":"back","average":{"1min":1.3,"5min":1.3,"15min":1.3},"min":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"max":{"1min":1.879,"5min":1.879,"15min":1.879},"last":1.1379999999999999},{"interface":"front","average":{"1min":1.254,"5min":1.254,"15min":1.254},"min":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"max":{"1min":1.8260000000000001,"5min":1.8260000000000001,"15min":1.8260000000000001},"last":1.337}]},{"osd":10,"last update":"Thu Apr 18 14:44:20 2024","interfaces":[{"interface":"back","average":{"1min":1.327,"5min":1.327,"15min":1.327},"min":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"max":{"1min":1.883,"5min":1.883,"15min":1.883},"last":1.0620000000000001},{"interface":"front","average":{"1min":1.3660000000000001,"5min":1.3660000000000001,"15min":1.3660000000000001},"min":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"max":{"1min":2.161,"5min":2.161,"15min":2.161},"last":1.1719999999999999}]},{"osd":11,"last update":"Thu Apr 18 14:44:20 2024","interfaces":[{"interface":"back","average":{"1min":1.4330000000000001,"5min":1.4330000000000001,"15min":1.4330000000000001},"min":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"max":{"1min":1.8959999999999999,"5min":1.8959999999999999,"15min":1.8959999999999999},"last":1.5640000000000001},{"interface":"front","average":{"1min":1.381,"5min":1.381,"15min":1.381},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":2.1160000000000001,"5min":2.1160000000000001,"15min":2.1160000000000001},"last":1.3080000000000001}]},{"osd":12,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.8740000000000001}]},{"osd":14,"last update":"Thu Apr 18 14:44:20 2024","interfaces":[{"interface":"back","average":{"1min":1.512,"5min":1.512,"15min":1.512},"min":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":0.94999999999999996},"max":{"1min":2.2879999999999998,"5min":2.2879999999999998,"15min":2.2879999999999998},"last":1.4750000000000001},{"interface":"front","average":{"1min":1.4139999999999999,"5min":1.4139999999999999,"15min":1.4139999999999999},"min":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"max":{"1min":2.0179999999999998,"5min":2.0179999999999998,"15min":2.0179999999999998},"last":1.429}]},{"osd":15,"last update":"Thu Apr 18 14:44:33 2024","interfaces":[{"interface":"back","average":{"1min":1.4730000000000001,"5min":1.4730000000000001,"15min":1.4730000000000001},"min":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"max":{"1min":2.1120000000000001,"5min":2.1120000000000001,"15min":2.1120000000000001},"last":1.5209999999999999},{"interface":"front","average":{"1min":1.452,"5min":1.452,"15min":1.452},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.9299999999999999,"5min":1.9299999999999999,"15min":1.9299999999999999},"last":1.3660000000000001}]}]},{"osd":7,"up_from":23,"seq":98784247838,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32952,"kb_used_data":1832,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94338888,"statfs":{"total":96636764160,"available":96603021312,"internally_reserved":0,"allocated":1875968,"data_stored":1087311,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":31848907},"hb_peers":[0,2,3,4,5,6,8,10,12,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Apr 18 14:44:34 2024","interfaces":[{"interface":"back","average":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":1.109,"5min":1.109,"15min":1.109},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.873,"5min":0.873,"15min":0.873},"min":{"1min":0.505,"5min":0.505,"15min":0.505},"max":{"1min":1.7589999999999999,"5min":1.7589999999999999,"15min":1.7589999999999999},"last":0.54300000000000004}]},{"osd":2,"last update":"Thu Apr 18 14:44:21 2024","interfaces":[{"interface":"back","average":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"min":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":1.1519999999999999,"5min":1.1519999999999999,"15min":1.1519999999999999},"last":0.78500000000000003},{"interface":"front","average":{"1min":0.97599999999999998,"5min":0.97599999999999998,"15min":0.97599999999999998},"min":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"max":{"1min":1.891,"5min":1.891,"15min":1.891},"last":0.85799999999999998}]},{"osd":3,"last update":"Thu Apr 18 14:44:34 2024","interfaces":[{"interface":"back","average":{"1min":0.88200000000000001,"5min":0.88200000000000001,"15min":0.88200000000000001},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.5920000000000001,"5min":1.5920000000000001,"15min":1.5920000000000001},"last":0.95299999999999996},{"interface":"front","average":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":1.2330000000000001,"5min":1.2330000000000001,"15min":1.2330000000000001},"last":1.0960000000000001}]},{"osd":4,"last update":"Thu Apr 18 14:44:21 2024","interfaces":[{"interface":"back","average":{"1min":0.95699999999999996,"5min":0.95699999999999996,"15min":0.95699999999999996},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.258,"5min":1.258,"15min":1.258},"last":0.81899999999999995},{"interface":"front","average":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":1.2170000000000001,"5min":1.2170000000000001,"15min":1.2170000000000001},"last":0.66600000000000004}]},{"osd":5,"last update":"Thu Apr 18 14:44:21 2024","interfaces":[{"interface":"back","average":{"1min":1.1140000000000001,"5min":1.1140000000000001,"15min":1.1140000000000001},"min":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"max":{"1min":1.8580000000000001,"5min":1.8580000000000001,"15min":1.8580000000000001},"last":0.98399999999999999},{"interface":"front","average":{"1min":1.1120000000000001,"5min":1.1120000000000001,"15min":1.1120000000000001},"min":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"max":{"1min":1.53,"5min":1.53,"15min":1.53},"last":1.0309999999999999}]},{"osd":6,"last update":"Thu Apr 18 14:44:21 2024","interfaces":[{"interface":"back","average":{"1min":1.139,"5min":1.139,"15min":1.139},"min":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"max":{"1min":1.8759999999999999,"5min":1.8759999999999999,"15min":1.8759999999999999},"last":1.147},{"interface":"front","average":{"1min":1.171,"5min":1.171,"15min":1.171},"min":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"max":{"1min":1.4570000000000001,"5min":1.4570000000000001,"15min":1.4570000000000001},"last":1.0780000000000001}]},{"osd":8,"last update":"Thu Apr 18 14:44:21 2024","interfaces":[{"interface":"back","average":{"1min":1.095,"5min":1.095,"15min":1.095},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":1.4159999999999999,"5min":1.4159999999999999,"15min":1.4159999999999999},"last":0.92800000000000005},{"interface":"front","average":{"1min":1.274,"5min":1.274,"15min":1.274},"min":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"max":{"1min":1.821,"5min":1.821,"15min":1.821},"last":1.0509999999999999}]},{"osd":10,"last update":"Thu Apr 18 14:44:21 2024","interfaces":[{"interface":"back","average":{"1min":1.151,"5min":1.151,"15min":1.151},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.831,"5min":1.831,"15min":1.831},"last":1.177},{"interface":"front","average":{"1min":1.278,"5min":1.278,"15min":1.278},"min":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"max":{"1min":1.53,"5min":1.53,"15min":1.53},"last":1.123}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71699999999999997}]},{"osd":12,"last update":"Thu Apr 18 14:44:21 2024","interfaces":[{"interface":"back","average":{"1min":1.2270000000000001,"5min":1.2270000000000001,"15min":1.2270000000000001},"min":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.7549999999999999,"5min":1.7549999999999999,"15min":1.7549999999999999},"last":1.004},{"interface":"front","average":{"1min":1.4039999999999999,"5min":1.4039999999999999,"15min":1.4039999999999999},"min":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"max":{"1min":2.0960000000000001,"5min":2.0960000000000001,"15min":2.0960000000000001},"last":1.2150000000000001}]},{"osd":14,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3819999999999999}]},{"osd":15,"last update":"Thu Apr 18 14:44:21 2024","interfaces":[{"interface":"back","average":{"1min":1.4330000000000001,"5min":1.4330000000000001,"15min":1.4330000000000001},"min":{"1min":0.874,"5min":0.874,"15min":0.874},"max":{"1min":2.6699999999999999,"5min":2.6699999999999999,"15min":2.6699999999999999},"last":1.278},{"interface":"front","average":{"1min":1.401,"5min":1.401,"15min":1.401},"min":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":2.516,"5min":2.516,"15min":2.516},"last":1.2010000000000001}]}]},{"osd":8,"up_from":23,"seq":98784247838,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32944,"kb_used_data":1832,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94338896,"statfs":{"total":96636764160,"available":96603029504,"internally_reserved":0,"allocated":1875968,"data_stored":1087311,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[1,2,3,4,5,7,9,11,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Apr 18 14:44:32 2024","interfaces":[{"interface":"back","average":{"1min":0.746,"5min":0.746,"15min":0.746},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":1.7290000000000001,"5min":1.7290000000000001,"15min":1.7290000000000001},"last":2.4540000000000002},{"interface":"front","average":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":2.48,"5min":2.48,"15min":2.48},"last":2.1669999999999998}]},{"osd":1,"last update":"Thu Apr 18 14:45:14 2024","interfaces":[{"interface":"back","average":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":0.83999999999999997},"min":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":1.2609999999999999,"5min":1.2609999999999999,"15min":1.2609999999999999},"last":0.52800000000000002},{"interface":"front","average":{"1min":0.85799999999999998,"5min":0.85799999999999998,"15min":0.85799999999999998},"min":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"max":{"1min":1.2230000000000001,"5min":1.2230000000000001,"15min":1.2230000000000001},"last":0.66000000000000003}]},{"osd":2,"last update":"Thu Apr 18 14:44:22 2024","interfaces":[{"interface":"back","average":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":1.1339999999999999,"5min":1.1339999999999999,"15min":1.1339999999999999},"last":0.71999999999999997},{"interface":"front","average":{"1min":0.996,"5min":0.996,"15min":0.996},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":2.54,"5min":2.54,"15min":2.54},"last":0.70599999999999996}]},{"osd":3,"last update":"Thu Apr 18 14:44:32 2024","interfaces":[{"interface":"back","average":{"1min":0.88800000000000001,"5min":0.88800000000000001,"15min":0.88800000000000001},"min":{"1min":0.628,"5min":0.628,"15min":0.628},"max":{"1min":1.137,"5min":1.137,"15min":1.137},"last":0.45100000000000001},{"interface":"front","average":{"1min":1.0209999999999999,"5min":1.0209999999999999,"15min":1.0209999999999999},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":2.6779999999999999,"5min":2.6779999999999999,"15min":2.6779999999999999},"last":0.53700000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33300000000000002}]},{"osd":5,"last update":"Thu Apr 18 14:44:22 2024","interfaces":[{"interface":"back","average":{"1min":1.0549999999999999,"5min":1.0549999999999999,"15min":1.0549999999999999},"min":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":2.7810000000000001,"5min":2.7810000000000001,"15min":2.7810000000000001},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.91800000000000004,"5min":0.91800000000000004,"15min":0.91800000000000004},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.5309999999999999,"5min":1.5309999999999999,"15min":1.5309999999999999},"last":0.5}]},{"osd":7,"last update":"Thu Apr 18 14:44:22 2024","interfaces":[{"interface":"back","average":{"1min":1.042,"5min":1.042,"15min":1.042},"min":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":1.925,"5min":1.925,"15min":1.925},"last":0.60799999999999998},{"interface":"front","average":{"1min":1.0800000000000001,"5min":1.0800000000000001,"15min":1.0800000000000001},"min":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"max":{"1min":1.669,"5min":1.669,"15min":1.669},"last":0.51900000000000002}]},{"osd":9,"last update":"Thu Apr 18 14:44:22 2024","interfaces":[{"interface":"back","average":{"1min":1.0249999999999999,"5min":1.0249999999999999,"15min":1.0249999999999999},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":1.6479999999999999,"5min":1.6479999999999999,"15min":1.6479999999999999},"last":0.54600000000000004},{"interface":"front","average":{"1min":1.163,"5min":1.163,"15min":1.163},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":2.9319999999999999,"5min":2.9319999999999999,"15min":2.9319999999999999},"last":0.68899999999999995}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.665}]},{"osd":11,"last update":"Thu Apr 18 14:44:22 2024","interfaces":[{"interface":"back","average":{"1min":1.206,"5min":1.206,"15min":1.206},"min":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"max":{"1min":2.1139999999999999,"5min":2.1139999999999999,"15min":2.1139999999999999},"last":0.55400000000000005},{"interface":"front","average":{"1min":1.2929999999999999,"5min":1.2929999999999999,"15min":1.2929999999999999},"min":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"max":{"1min":2.25,"5min":2.25,"15min":2.25},"last":0.63100000000000001}]},{"osd":12,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5629999999999999}]},{"osd":14,"last update":"Thu Apr 18 14:44:22 2024","interfaces":[{"interface":"back","average":{"1min":1.341,"5min":1.341,"15min":1.341},"min":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"max":{"1min":2.5800000000000001,"5min":2.5800000000000001,"15min":2.5800000000000001},"last":0.69599999999999995},{"interface":"front","average":{"1min":1.3919999999999999,"5min":1.3919999999999999,"15min":1.3919999999999999},"min":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"max":{"1min":3.0739999999999998,"5min":3.0739999999999998,"15min":3.0739999999999998},"last":0.58799999999999997}]},{"osd":15,"last update":"Thu Apr 18 14:44:22 2024","interfaces":[{"interface":"back","average":{"1min":1.355,"5min":1.355,"15min":1.355},"min":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"max":{"1min":2.4740000000000002,"5min":2.4740000000000002,"15min":2.4740000000000002},"last":0.73999999999999999},{"interface":"front","average":{"1min":1.4159999999999999,"5min":1.4159999999999999,"15min":1.4159999999999999},"min":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"max":{"1min":2.8620000000000001,"5min":2.8620000000000001,"15min":2.8620000000000001},"last":0.746}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":13,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":12,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":13,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":14,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":15,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-18T14:45:21.562 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-04-18T14:44:37.374221+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=14, tm_min=44, tm_sec=37, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=14, tm_min=45, tm_sec=13, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T14:45:21.562 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-04-18T14:44:47.245297+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=14, tm_min=44, tm_sec=47, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=14, tm_min=45, tm_sec=13, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T14:45:21.562 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2024-04-18T14:44:38.485106+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=14, tm_min=44, tm_sec=38, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=14, tm_min=45, tm_sec=13, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T14:45:21.562 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2024-04-18T14:44:36.901318+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=14, tm_min=44, tm_sec=36, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=14, tm_min=45, tm_sec=13, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T14:45:21.562 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-04-18T14:44:22.508567+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=14, tm_min=44, tm_sec=22, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=14, tm_min=45, tm_sec=13, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T14:45:21.562 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-04-18T14:45:41.563 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-18T14:45:41.883 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-04-18T14:45:41.885 INFO:teuthology.orchestra.run.smithi086.stderr:dumped all 2024-04-18T14:45:41.902 INFO:teuthology.orchestra.run.smithi086.stdout:{"pg_ready":true,"pg_map":{"version":192,"stamp":"2024-04-18T14:45:41.554517+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":159,"ondisk_log_size":159,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":16,"num_per_pool_osds":16,"num_per_pool_omap_osds":11,"kb":1509949440,"kb_used":561452,"kb_used_data":31532,"kb_used_omap":24,"kb_used_meta":529639,"kb_avail":1509387988,"statfs":{"total":1546188226560,"available":1545613299712,"internally_reserved":0,"allocated":32288768,"data_stored":19148772,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":25506,"internal_metadata":542350430},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":23,"apply_latency_ms":23,"commit_latency_ns":23000000,"apply_latency_ns":23000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.076499"},"pg_stats":[{"pgid":"1.0","version":"125'159","reported_seq":328,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-04-18T14:45:36.732727+0000","last_change":"2024-04-18T14:45:17.800175+0000","last_active":"2024-04-18T14:45:36.732727+0000","last_peered":"2024-04-18T14:45:36.732727+0000","last_clean":"2024-04-18T14:45:36.732727+0000","last_became_active":"2024-04-18T14:43:20.323133+0000","last_became_peered":"2024-04-18T14:43:20.323133+0000","last_unstale":"2024-04-18T14:45:36.732727+0000","last_undegraded":"2024-04-18T14:45:36.732727+0000","last_fullsized":"2024-04-18T14:45:36.732727+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"125'159","last_scrub_stamp":"2024-04-18T14:45:17.799901+0000","last_deep_scrub":"125'159","last_deep_scrub_stamp":"2024-04-18T14:45:17.799901+0000","last_clean_scrub_stamp":"2024-04-18T14:45:17.799901+0000","objects_scrubbed":2,"log_size":159,"log_dups_size":0,"ondisk_log_size":159,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T14:46:35.508901+0000","scrub_duration":0.0080611450000000005,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[13,0],"acting":[13,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":13,"acting_primary":13,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":132,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-04-18T14:45:36.732423+0000","last_change":"2024-04-18T14:45:19.731564+0000","last_active":"2024-04-18T14:45:36.732423+0000","last_peered":"2024-04-18T14:45:36.732423+0000","last_clean":"2024-04-18T14:45:36.732423+0000","last_became_active":"2024-04-18T14:43:21.327764+0000","last_became_peered":"2024-04-18T14:43:21.327764+0000","last_unstale":"2024-04-18T14:45:36.732423+0000","last_undegraded":"2024-04-18T14:45:36.732423+0000","last_fullsized":"2024-04-18T14:45:36.732423+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T14:45:19.731326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T14:45:19.731326+0000","last_clean_scrub_stamp":"2024-04-18T14:45:19.731326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T14:46:29.997744+0000","scrub_duration":0.0042827619999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,15],"acting":[5,15],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":128,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-04-18T14:45:36.897754+0000","last_change":"2024-04-18T14:45:23.093203+0000","last_active":"2024-04-18T14:45:36.897754+0000","last_peered":"2024-04-18T14:45:36.897754+0000","last_clean":"2024-04-18T14:45:36.897754+0000","last_became_active":"2024-04-18T14:43:21.414060+0000","last_became_peered":"2024-04-18T14:43:21.414060+0000","last_unstale":"2024-04-18T14:45:36.897754+0000","last_undegraded":"2024-04-18T14:45:36.897754+0000","last_fullsized":"2024-04-18T14:45:36.897754+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T14:45:23.092954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T14:45:23.092954+0000","last_clean_scrub_stamp":"2024-04-18T14:45:23.092954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T14:46:46.748772+0000","scrub_duration":0.003775469,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":129,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-04-18T14:45:36.732713+0000","last_change":"2024-04-18T14:45:18.772225+0000","last_active":"2024-04-18T14:45:36.732713+0000","last_peered":"2024-04-18T14:45:36.732713+0000","last_clean":"2024-04-18T14:45:36.732713+0000","last_became_active":"2024-04-18T14:43:21.328534+0000","last_became_peered":"2024-04-18T14:43:21.328534+0000","last_unstale":"2024-04-18T14:45:36.732713+0000","last_undegraded":"2024-04-18T14:45:36.732713+0000","last_fullsized":"2024-04-18T14:45:36.732713+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T14:45:18.771988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T14:45:18.771988+0000","last_clean_scrub_stamp":"2024-04-18T14:45:18.771988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T14:46:18.894566+0000","scrub_duration":0.0033455770000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[13,5],"acting":[13,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":13,"acting_primary":13,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":128,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-04-18T14:45:36.897771+0000","last_change":"2024-04-18T14:45:24.084882+0000","last_active":"2024-04-18T14:45:36.897771+0000","last_peered":"2024-04-18T14:45:36.897771+0000","last_clean":"2024-04-18T14:45:36.897771+0000","last_became_active":"2024-04-18T14:43:21.465481+0000","last_became_peered":"2024-04-18T14:43:21.465481+0000","last_unstale":"2024-04-18T14:45:36.897771+0000","last_undegraded":"2024-04-18T14:45:36.897771+0000","last_fullsized":"2024-04-18T14:45:36.897771+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T14:45:24.084608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T14:45:24.084608+0000","last_clean_scrub_stamp":"2024-04-18T14:45:24.084608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T14:46:29.572994+0000","scrub_duration":0.0037180220000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10],"acting":[3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":132,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-04-18T14:45:36.734496+0000","last_change":"2024-04-18T14:45:19.278328+0000","last_active":"2024-04-18T14:45:36.734496+0000","last_peered":"2024-04-18T14:45:36.734496+0000","last_clean":"2024-04-18T14:45:36.734496+0000","last_became_active":"2024-04-18T14:43:21.348012+0000","last_became_peered":"2024-04-18T14:43:21.348012+0000","last_unstale":"2024-04-18T14:45:36.734496+0000","last_undegraded":"2024-04-18T14:45:36.734496+0000","last_fullsized":"2024-04-18T14:45:36.734496+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T14:45:19.278062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T14:45:19.278062+0000","last_clean_scrub_stamp":"2024-04-18T14:45:19.278062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T14:46:26.825725+0000","scrub_duration":0.00291997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,12],"acting":[6,12],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":129,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-04-18T14:45:36.730609+0000","last_change":"2024-04-18T14:45:17.520027+0000","last_active":"2024-04-18T14:45:36.730609+0000","last_peered":"2024-04-18T14:45:36.730609+0000","last_clean":"2024-04-18T14:45:36.730609+0000","last_became_active":"2024-04-18T14:43:21.422468+0000","last_became_peered":"2024-04-18T14:43:21.422468+0000","last_unstale":"2024-04-18T14:45:36.730609+0000","last_undegraded":"2024-04-18T14:45:36.730609+0000","last_fullsized":"2024-04-18T14:45:36.730609+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T14:45:17.519918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T14:45:17.519918+0000","last_clean_scrub_stamp":"2024-04-18T14:45:17.519918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T14:46:19.973404+0000","scrub_duration":0.002702627,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2],"acting":[8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":119,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-18T14:45:36.469685+0000","last_change":"2024-04-18T14:45:19.850723+0000","last_active":"2024-04-18T14:45:36.469685+0000","last_peered":"2024-04-18T14:45:36.469685+0000","last_clean":"2024-04-18T14:45:36.469685+0000","last_became_active":"2024-04-18T14:44:59.929195+0000","last_became_peered":"2024-04-18T14:44:59.929195+0000","last_unstale":"2024-04-18T14:45:36.469685+0000","last_undegraded":"2024-04-18T14:45:36.469685+0000","last_fullsized":"2024-04-18T14:45:36.469685+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T14:45:19.850481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T14:45:19.850481+0000","last_clean_scrub_stamp":"2024-04-18T14:45:19.850481+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T14:46:40.376803+0000","scrub_duration":0.0037437859999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[14,0],"acting":[14,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":14,"acting_primary":14,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":132,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-04-18T14:45:36.535512+0000","last_change":"2024-04-18T14:45:23.562150+0000","last_active":"2024-04-18T14:45:36.535512+0000","last_peered":"2024-04-18T14:45:36.535512+0000","last_clean":"2024-04-18T14:45:36.535512+0000","last_became_active":"2024-04-18T14:43:21.328185+0000","last_became_peered":"2024-04-18T14:43:21.328185+0000","last_unstale":"2024-04-18T14:45:36.535512+0000","last_undegraded":"2024-04-18T14:45:36.535512+0000","last_fullsized":"2024-04-18T14:45:36.535512+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T14:45:23.561885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T14:45:23.561885+0000","last_clean_scrub_stamp":"2024-04-18T14:45:23.561885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T14:46:39.932592+0000","scrub_duration":0.0042249999999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[15,13],"acting":[15,13],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":15,"acting_primary":15,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":11},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1064960,"data_stored":1057856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":159,"ondisk_log_size":159,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":13,"up_from":24,"seq":103079215136,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33556,"kb_used_data":2436,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94338284,"statfs":{"total":96636764160,"available":96602402816,"internally_reserved":0,"allocated":2494464,"data_stored":1664863,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,2,3,4,5,7,11,12,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Apr 18 14:45:23 2024","interfaces":[{"interface":"back","average":{"1min":0.68700000000000006,"5min":0.81399999999999995,"15min":0.83499999999999996},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":0.96999999999999997,"5min":1.792,"15min":1.792},"last":0.65100000000000002},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.83699999999999997,"15min":0.85699999999999998},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.1120000000000001,"5min":2.0600000000000001,"15min":2.0600000000000001},"last":0.60999999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84099999999999997}]},{"osd":2,"last update":"Thu Apr 18 14:45:23 2024","interfaces":[{"interface":"back","average":{"1min":1.002,"5min":1.0309999999999999,"15min":1.036},"min":{"1min":0.69899999999999995,"5min":0.60599999999999998,"15min":0.60599999999999998},"max":{"1min":1.2749999999999999,"5min":1.974,"15min":1.974},"last":0.96499999999999997},{"interface":"front","average":{"1min":0.91300000000000003,"5min":0.98199999999999998,"15min":0.99399999999999999},"min":{"1min":0.59999999999999998,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.3520000000000001,"5min":1.9910000000000001,"15min":1.9910000000000001},"last":1.1899999999999999}]},{"osd":3,"last update":"Thu Apr 18 14:45:23 2024","interfaces":[{"interface":"back","average":{"1min":1.0009999999999999,"5min":0.93200000000000005,"15min":0.92000000000000004},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.3360000000000001,"5min":1.3360000000000001,"15min":1.3360000000000001},"last":1.1599999999999999},{"interface":"front","average":{"1min":1.111,"5min":1.0609999999999999,"15min":1.0529999999999999},"min":{"1min":0.81100000000000005,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":1.3819999999999999,"5min":1.4430000000000001,"15min":1.4430000000000001},"last":1.2310000000000001}]},{"osd":4,"last update":"Thu Apr 18 14:45:23 2024","interfaces":[{"interface":"back","average":{"1min":0.96599999999999997,"5min":0.97799999999999998,"15min":0.97999999999999998},"min":{"1min":0.57799999999999996,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.4039999999999999,"5min":1.4039999999999999,"15min":1.4039999999999999},"last":0.85999999999999999},{"interface":"front","average":{"1min":1.093,"5min":0.93899999999999995,"15min":0.91300000000000003},"min":{"1min":0.69199999999999995,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":1.518,"5min":1.518,"15min":1.518},"last":0.81499999999999995}]},{"osd":5,"last update":"Thu Apr 18 14:45:23 2024","interfaces":[{"interface":"back","average":{"1min":1.0649999999999999,"5min":0.98399999999999999,"15min":0.96999999999999997},"min":{"1min":0.66600000000000004,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":1.6160000000000001,"5min":1.6160000000000001,"15min":1.6160000000000001},"last":0.94099999999999995},{"interface":"front","average":{"1min":0.96599999999999997,"5min":1.0549999999999999,"15min":1.0700000000000001},"min":{"1min":0.63800000000000001,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.476,"5min":1.536,"15min":1.536},"last":0.90900000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1950000000000001}]},{"osd":7,"last update":"Thu Apr 18 14:45:34 2024","interfaces":[{"interface":"back","average":{"1min":1.133,"5min":1.157,"15min":1.161},"min":{"1min":0.89300000000000002,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":1.7709999999999999,"5min":2.4359999999999999,"15min":2.4359999999999999},"last":1.3300000000000001},{"interface":"front","average":{"1min":1.1619999999999999,"5min":1.1970000000000001,"15min":1.2030000000000001},"min":{"1min":0.78100000000000003,"5min":0.74099999999999999,"15min":0.74099999999999999},"max":{"1min":1.6859999999999999,"5min":3.532,"15min":3.532},"last":1.093}]},{"osd":11,"last update":"Thu Apr 18 14:45:34 2024","interfaces":[{"interface":"back","average":{"1min":1.224,"5min":1.232,"15min":1.234},"min":{"1min":0.80100000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"max":{"1min":1.6539999999999999,"5min":1.8069999999999999,"15min":1.8069999999999999},"last":1.3049999999999999},{"interface":"front","average":{"1min":1.298,"5min":1.284,"15min":1.282},"min":{"1min":1.022,"5min":0.84799999999999998,"15min":0.84799999999999998},"max":{"1min":1.698,"5min":2.2669999999999999,"15min":2.2669999999999999},"last":1.26}]},{"osd":12,"last update":"Thu Apr 18 14:45:23 2024","interfaces":[{"interface":"back","average":{"1min":1.113,"5min":1.2390000000000001,"15min":1.26},"min":{"1min":0.72499999999999998,"5min":0.70599999999999996,"15min":0.70599999999999996},"max":{"1min":1.726,"5min":1.911,"15min":1.911},"last":0.78100000000000003},{"interface":"front","average":{"1min":1.2829999999999999,"5min":1.3069999999999999,"15min":1.3109999999999999},"min":{"1min":0.77100000000000002,"5min":0.755,"15min":0.755},"max":{"1min":1.6259999999999999,"5min":2.504,"15min":2.504},"last":1.1220000000000001}]},{"osd":14,"last update":"Thu Apr 18 14:45:23 2024","interfaces":[{"interface":"back","average":{"1min":1.2629999999999999,"5min":1.2849999999999999,"15min":1.2889999999999999},"min":{"1min":0.92600000000000005,"5min":0.71599999999999997,"15min":0.71599999999999997},"max":{"1min":1.569,"5min":3.6240000000000001,"15min":3.6240000000000001},"last":0.999},{"interface":"front","average":{"1min":1.272,"5min":1.3400000000000001,"15min":1.351},"min":{"1min":0.90700000000000003,"5min":0.627,"15min":0.627},"max":{"1min":1.776,"5min":2.1960000000000002,"15min":2.1960000000000002},"last":1.028}]},{"osd":15,"last update":"Thu Apr 18 14:45:23 2024","interfaces":[{"interface":"back","average":{"1min":1.4330000000000001,"5min":1.371,"15min":1.361},"min":{"1min":1.147,"5min":0.73599999999999999,"15min":0.73599999999999999},"max":{"1min":1.9550000000000001,"5min":2.1080000000000001,"15min":2.1080000000000001},"last":1.3819999999999999},{"interface":"front","average":{"1min":1.3879999999999999,"5min":1.2849999999999999,"15min":1.268},"min":{"1min":1.02,"5min":0.83499999999999996,"15min":0.83499999999999996},"max":{"1min":2.1230000000000002,"5min":2.1230000000000002,"15min":2.1230000000000002},"last":1.286}]}]},{"osd":9,"up_from":24,"seq":103079215137,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":33036,"kb_used_data":1916,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94338804,"statfs":{"total":96636764160,"available":96602935296,"internally_reserved":0,"allocated":1961984,"data_stored":1135935,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1599,"internal_metadata":31848897},"hb_peers":[0,1,3,8,10,11,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Apr 18 14:45:23 2024","interfaces":[{"interface":"back","average":{"1min":0.81100000000000005,"5min":0.80700000000000005,"15min":0.80600000000000005},"min":{"1min":0.55700000000000005,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":1.2909999999999999,"5min":1.2909999999999999,"15min":1.2909999999999999},"last":0.85299999999999998},{"interface":"front","average":{"1min":0.79700000000000004,"5min":0.92100000000000004,"15min":0.94099999999999995},"min":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":1.1919999999999999,"5min":1.6559999999999999,"15min":1.6559999999999999},"last":0.73699999999999999}]},{"osd":1,"last update":"Thu Apr 18 14:45:23 2024","interfaces":[{"interface":"back","average":{"1min":0.91200000000000003,"5min":0.873,"15min":0.86699999999999999},"min":{"1min":0.61099999999999999,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":1.218,"5min":1.3200000000000001,"15min":1.3200000000000001},"last":0.95899999999999996},{"interface":"front","average":{"1min":0.95099999999999996,"5min":0.85699999999999998,"15min":0.84099999999999997},"min":{"1min":0.56000000000000005,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":3.0670000000000002,"5min":3.0670000000000002,"15min":3.0670000000000002},"last":0.91300000000000003}]},{"osd":3,"last update":"Thu Apr 18 14:45:23 2024","interfaces":[{"interface":"back","average":{"1min":1.119,"5min":1.0489999999999999,"15min":1.0369999999999999},"min":{"1min":0.83499999999999996,"5min":0.66700000000000004,"15min":0.66700000000000004},"max":{"1min":1.591,"5min":1.5980000000000001,"15min":1.5980000000000001},"last":1.248},{"interface":"front","average":{"1min":1.204,"5min":1.1639999999999999,"15min":1.157},"min":{"1min":0.747,"5min":0.747,"15min":0.747},"max":{"1min":1.8160000000000001,"5min":1.8160000000000001,"15min":1.8160000000000001},"last":1.0620000000000001}]},{"osd":8,"last update":"Thu Apr 18 14:45:23 2024","interfaces":[{"interface":"back","average":{"1min":1.0369999999999999,"5min":0.96599999999999997,"15min":0.95399999999999996},"min":{"1min":0.627,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":1.629,"5min":1.6899999999999999,"15min":1.6899999999999999},"last":0.996},{"interface":"front","average":{"1min":0.96099999999999997,"5min":1.262,"15min":1.3120000000000001},"min":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":1.661,"5min":5.4989999999999997,"15min":5.4989999999999997},"last":1.133}]},{"osd":10,"last update":"Thu Apr 18 14:45:23 2024","interfaces":[{"interface":"back","average":{"1min":1.2210000000000001,"5min":1.2010000000000001,"15min":1.1970000000000001},"min":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"max":{"1min":1.5509999999999999,"5min":1.5509999999999999,"15min":1.5509999999999999},"last":1.0249999999999999},{"interface":"front","average":{"1min":1.385,"5min":1.1699999999999999,"15min":1.1339999999999999},"min":{"1min":0.96399999999999997,"5min":0.65800000000000003,"15min":0.65800000000000003},"max":{"1min":3.1400000000000001,"5min":3.1400000000000001,"15min":3.1400000000000001},"last":1.198}]},{"osd":11,"last update":"Thu Apr 18 14:45:23 2024","interfaces":[{"interface":"back","average":{"1min":1.2569999999999999,"5min":1.153,"15min":1.1359999999999999},"min":{"1min":0.83299999999999996,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.823,"5min":1.849,"15min":1.849},"last":1.091},{"interface":"front","average":{"1min":1.2450000000000001,"5min":1.2330000000000001,"15min":1.2310000000000001},"min":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"max":{"1min":1.6910000000000001,"5min":1.8109999999999999,"15min":1.8109999999999999},"last":1.3149999999999999}]},{"osd":12,"last update":"Thu Apr 18 14:45:23 2024","interfaces":[{"interface":"back","average":{"1min":1.1819999999999999,"5min":1.2749999999999999,"15min":1.2909999999999999},"min":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"max":{"1min":1.7370000000000001,"5min":2.1560000000000001,"15min":2.1560000000000001},"last":1.1719999999999999},{"interface":"front","average":{"1min":1.3120000000000001,"5min":1.294,"15min":1.2909999999999999},"min":{"1min":0.90500000000000003,"5min":0.748,"15min":0.748},"max":{"1min":2.8540000000000001,"5min":2.8540000000000001,"15min":2.8540000000000001},"last":1.292}]},{"osd":13,"last update":"Thu Apr 18 14:45:23 2024","interfaces":[{"interface":"back","average":{"1min":1.526,"5min":1.431,"15min":1.415},"min":{"1min":0.85999999999999999,"5min":0.76600000000000001,"15min":0.76600000000000001},"max":{"1min":2.8029999999999999,"5min":2.8029999999999999,"15min":2.8029999999999999},"last":1.228},{"interface":"front","average":{"1min":1.46,"5min":1.468,"15min":1.47},"min":{"1min":1.0580000000000001,"5min":0.92100000000000004,"15min":0.92100000000000004},"max":{"1min":2.718,"5min":2.718,"15min":2.718},"last":1.4119999999999999}]},{"osd":14,"last update":"Thu Apr 18 14:45:23 2024","interfaces":[{"interface":"back","average":{"1min":1.5509999999999999,"5min":1.4750000000000001,"15min":1.462},"min":{"1min":1.151,"5min":0.88400000000000001,"15min":0.88400000000000001},"max":{"1min":2.5150000000000001,"5min":2.5150000000000001,"15min":2.5150000000000001},"last":1.462},{"interface":"front","average":{"1min":1.5209999999999999,"5min":1.5349999999999999,"15min":1.5369999999999999},"min":{"1min":1.0249999999999999,"5min":1.016,"15min":1.016},"max":{"1min":1.974,"5min":2.6549999999999998,"15min":2.6549999999999998},"last":1.2689999999999999}]},{"osd":15,"last update":"Thu Apr 18 14:45:23 2024","interfaces":[{"interface":"back","average":{"1min":1.552,"5min":1.4399999999999999,"15min":1.421},"min":{"1min":1.139,"5min":0.80400000000000005,"15min":0.80400000000000005},"max":{"1min":2.266,"5min":2.7789999999999999,"15min":2.7789999999999999},"last":1.4330000000000001},{"interface":"front","average":{"1min":1.605,"5min":1.4690000000000001,"15min":1.4470000000000001},"min":{"1min":1.1830000000000001,"5min":0.85899999999999999,"15min":0.85899999999999999},"max":{"1min":2.6349999999999998,"5min":2.6349999999999998,"15min":2.6349999999999998},"last":1.504}]}]},{"osd":5,"up_from":24,"seq":103079215138,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33040,"kb_used_data":1916,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94338800,"statfs":{"total":96636764160,"available":96602931200,"internally_reserved":0,"allocated":1961984,"data_stored":1135935,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,3,4,6,10,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Apr 18 14:45:33 2024","interfaces":[{"interface":"back","average":{"1min":0.89300000000000002,"5min":0.90500000000000003,"15min":0.90700000000000003},"min":{"1min":0.67200000000000004,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.113,"5min":1.339,"15min":1.339},"last":1.012},{"interface":"front","average":{"1min":0.83599999999999997,"5min":0.81399999999999995,"15min":0.81000000000000005},"min":{"1min":0.54000000000000004,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":1.3069999999999999,"5min":1.3069999999999999,"15min":1.3069999999999999},"last":0.86499999999999999}]},{"osd":1,"last update":"Thu Apr 18 14:45:12 2024","interfaces":[{"interface":"back","average":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":1.2370000000000001,"5min":1.2370000000000001,"15min":1.2370000000000001},"last":0.97699999999999998},{"interface":"front","average":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":1.526,"5min":1.526,"15min":1.526},"last":0.57499999999999996}]},{"osd":3,"last update":"Thu Apr 18 14:45:26 2024","interfaces":[{"interface":"back","average":{"1min":1.1359999999999999,"5min":1.046,"15min":1.0309999999999999},"min":{"1min":0.52100000000000002,"5min":0.497,"15min":0.497},"max":{"1min":1.4570000000000001,"5min":1.4650000000000001,"15min":1.4650000000000001},"last":1.3959999999999999},{"interface":"front","average":{"1min":0.80300000000000005,"5min":0.92000000000000004,"15min":0.93999999999999995},"min":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"max":{"1min":1.135,"5min":1.8460000000000001,"15min":1.8460000000000001},"last":1.0649999999999999}]},{"osd":4,"last update":"Thu Apr 18 14:45:26 2024","interfaces":[{"interface":"back","average":{"1min":0.92800000000000005,"5min":0.90000000000000002,"15min":0.89600000000000002},"min":{"1min":0.67500000000000004,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":1.1559999999999999,"5min":1.968,"15min":1.968},"last":1.2250000000000001},{"interface":"front","average":{"1min":1.1240000000000001,"5min":1.0369999999999999,"15min":1.0229999999999999},"min":{"1min":0.61899999999999999,"5min":0.60799999999999998,"15min":0.60799999999999998},"max":{"1min":1.4590000000000001,"5min":1.819,"15min":1.819},"last":1.3109999999999999}]},{"osd":6,"last update":"Thu Apr 18 14:45:26 2024","interfaces":[{"interface":"back","average":{"1min":1.024,"5min":1.0549999999999999,"15min":1.0600000000000001},"min":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"max":{"1min":1.4399999999999999,"5min":2.0760000000000001,"15min":2.0760000000000001},"last":1.4279999999999999},{"interface":"front","average":{"1min":1.1140000000000001,"5min":1.103,"15min":1.101},"min":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"max":{"1min":1.395,"5min":1.694,"15min":1.694},"last":1.444}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2330000000000001}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96599999999999997}]},{"osd":10,"last update":"Thu Apr 18 14:45:26 2024","interfaces":[{"interface":"back","average":{"1min":1.264,"5min":1.238,"15min":1.234},"min":{"1min":0.80100000000000005,"5min":0.73399999999999999,"15min":0.73399999999999999},"max":{"1min":1.5880000000000001,"5min":2.2709999999999999,"15min":2.2709999999999999},"last":1.1819999999999999},{"interface":"front","average":{"1min":1.1459999999999999,"5min":1.234,"15min":1.2490000000000001},"min":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"max":{"1min":1.423,"5min":2.4470000000000001,"15min":2.4470000000000001},"last":1.2649999999999999}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.256}]},{"osd":12,"last update":"Thu Apr 18 14:45:26 2024","interfaces":[{"interface":"back","average":{"1min":1.1120000000000001,"5min":1.113,"15min":1.113},"min":{"1min":0.72599999999999998,"5min":0.625,"15min":0.625},"max":{"1min":1.431,"5min":1.728,"15min":1.728},"last":1.351},{"interface":"front","average":{"1min":1.302,"5min":1.331,"15min":1.3360000000000001},"min":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"max":{"1min":1.6970000000000001,"5min":2.008,"15min":2.008},"last":0.91200000000000003}]},{"osd":13,"last update":"Thu Apr 18 14:45:26 2024","interfaces":[{"interface":"back","average":{"1min":1.3779999999999999,"5min":1.359,"15min":1.3560000000000001},"min":{"1min":0.69499999999999995,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":1.667,"5min":2.5070000000000001,"15min":2.5070000000000001},"last":1.5640000000000001},{"interface":"front","average":{"1min":1.133,"5min":1.262,"15min":1.284},"min":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":1.369,"5min":2.992,"15min":2.992},"last":0.82199999999999995}]},{"osd":14,"last update":"Thu Apr 18 14:45:33 2024","interfaces":[{"interface":"back","average":{"1min":1.4930000000000001,"5min":1.419,"15min":1.407},"min":{"1min":1.204,"5min":0.85099999999999998,"15min":0.85099999999999998},"max":{"1min":1.8160000000000001,"5min":2.1190000000000002,"15min":2.1190000000000002},"last":1.496},{"interface":"front","average":{"1min":1.3240000000000001,"5min":1.2749999999999999,"15min":1.2669999999999999},"min":{"1min":0.99199999999999999,"5min":0.84099999999999997,"15min":0.84099999999999997},"max":{"1min":1.7170000000000001,"5min":2.496,"15min":2.496},"last":1.5229999999999999}]},{"osd":15,"last update":"Thu Apr 18 14:45:26 2024","interfaces":[{"interface":"back","average":{"1min":1.4990000000000001,"5min":1.488,"15min":1.486},"min":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"max":{"1min":1.885,"5min":2.415,"15min":2.415},"last":1.639},{"interface":"front","average":{"1min":1.3520000000000001,"5min":1.4279999999999999,"15min":1.4399999999999999},"min":{"1min":0.748,"5min":0.748,"15min":0.748},"max":{"1min":1.639,"5min":2.7799999999999998,"15min":2.7799999999999998},"last":1.369}]}]},{"osd":14,"up_from":21,"seq":90194313249,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51048,"kb_used_data":1884,"kb_used_omap":1,"kb_used_meta":49150,"kb_avail":94320792,"statfs":{"total":96636764160,"available":96584491008,"internally_reserved":0,"allocated":1929216,"data_stored":1116823,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":50330054},"hb_peers":[0,4,5,6,7,8,9,11,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Apr 18 14:45:23 2024","interfaces":[{"interface":"back","average":{"1min":0.90400000000000003,"5min":0.95599999999999996,"15min":0.96399999999999997},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.2010000000000001,"5min":1.454,"15min":1.454},"last":0.96599999999999997},{"interface":"front","average":{"1min":0.93500000000000005,"5min":1.0389999999999999,"15min":1.0569999999999999},"min":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"max":{"1min":1.234,"5min":1.9390000000000001,"15min":1.9390000000000001},"last":1.0720000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.472}]},{"osd":2,"last update":"Thu Apr 18 14:44:31 2024","interfaces":[{"interface":"back","average":{"1min":0.89500000000000002,"5min":0.89500000000000002,"15min":0.89500000000000002},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":1.468,"5min":1.468,"15min":1.468},"last":0.64400000000000002},{"interface":"front","average":{"1min":1.131,"5min":1.131,"15min":1.131},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.8540000000000001,"5min":1.8540000000000001,"15min":1.8540000000000001},"last":1.032}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94499999999999995}]},{"osd":4,"last update":"Thu Apr 18 14:45:23 2024","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.90600000000000003,"15min":0.93600000000000005},"min":{"1min":0.51000000000000001,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":0.90800000000000003,"5min":1.296,"15min":1.296},"last":0.67800000000000005},{"interface":"front","average":{"1min":0.85499999999999998,"5min":0.95099999999999996,"15min":0.96699999999999997},"min":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":1.3160000000000001,"5min":1.5129999999999999,"15min":1.5129999999999999},"last":0.75800000000000001}]},{"osd":5,"last update":"Thu Apr 18 14:45:23 2024","interfaces":[{"interface":"back","average":{"1min":1.167,"5min":1.2070000000000001,"15min":1.214},"min":{"1min":0.85099999999999998,"5min":0.66300000000000003,"15min":0.66300000000000003},"max":{"1min":1.4490000000000001,"5min":2.1269999999999998,"15min":2.1269999999999998},"last":0.94299999999999995},{"interface":"front","average":{"1min":1.0740000000000001,"5min":1.149,"15min":1.161},"min":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"max":{"1min":1.4630000000000001,"5min":1.5920000000000001,"15min":1.5920000000000001},"last":0.90800000000000003}]},{"osd":6,"last update":"Thu Apr 18 14:45:23 2024","interfaces":[{"interface":"back","average":{"1min":0.83299999999999996,"5min":0.92400000000000004,"15min":0.93899999999999995},"min":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":1.22,"5min":1.3160000000000001,"15min":1.3160000000000001},"last":0.83499999999999996},{"interface":"front","average":{"1min":0.98699999999999999,"5min":1.127,"15min":1.151},"min":{"1min":0.70599999999999996,"5min":0.501,"15min":0.501},"max":{"1min":1.3819999999999999,"5min":1.7689999999999999,"15min":1.7689999999999999},"last":1.018}]},{"osd":7,"last update":"Thu Apr 18 14:45:23 2024","interfaces":[{"interface":"back","average":{"1min":1.125,"5min":1.212,"15min":1.226},"min":{"1min":0.76500000000000001,"5min":0.71899999999999997,"15min":0.71899999999999997},"max":{"1min":1.4850000000000001,"5min":1.7529999999999999,"15min":1.7529999999999999},"last":1.0409999999999999},{"interface":"front","average":{"1min":1.012,"5min":1.143,"15min":1.165},"min":{"1min":0.73099999999999998,"5min":0.67400000000000004,"15min":0.67400000000000004},"max":{"1min":1.2509999999999999,"5min":1.587,"15min":1.587},"last":1.1000000000000001}]},{"osd":8,"last update":"Thu Apr 18 14:45:23 2024","interfaces":[{"interface":"back","average":{"1min":1.1819999999999999,"5min":1.27,"15min":1.284},"min":{"1min":0.78100000000000003,"5min":0.63700000000000001,"15min":0.63700000000000001},"max":{"1min":1.5860000000000001,"5min":2.0569999999999999,"15min":2.0569999999999999},"last":0.88},{"interface":"front","average":{"1min":1.1499999999999999,"5min":1.23,"15min":1.244},"min":{"1min":0.72799999999999998,"5min":0.71699999999999997,"15min":0.71699999999999997},"max":{"1min":1.6950000000000001,"5min":1.8740000000000001,"15min":1.8740000000000001},"last":1.1499999999999999}]},{"osd":9,"last update":"Thu Apr 18 14:45:32 2024","interfaces":[{"interface":"back","average":{"1min":1.2849999999999999,"5min":1.4239999999999999,"15min":1.4470000000000001},"min":{"1min":1.1000000000000001,"5min":0.81599999999999995,"15min":0.81599999999999995},"max":{"1min":1.7709999999999999,"5min":2.1899999999999999,"15min":2.1899999999999999},"last":1.1879999999999999},{"interface":"front","average":{"1min":1.2909999999999999,"5min":1.3779999999999999,"15min":1.3919999999999999},"min":{"1min":0.89400000000000002,"5min":0.82599999999999996,"15min":0.82599999999999996},"max":{"1min":1.962,"5min":1.9930000000000001,"15min":1.9930000000000001},"last":1.214}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4219999999999999}]},{"osd":11,"last update":"Thu Apr 18 14:45:32 2024","interfaces":[{"interface":"back","average":{"1min":1.1699999999999999,"5min":1.379,"15min":1.4139999999999999},"min":{"1min":0.81499999999999995,"5min":0.79600000000000004,"15min":0.79600000000000004},"max":{"1min":1.4219999999999999,"5min":2.0059999999999998,"15min":2.0059999999999998},"last":1.2450000000000001},{"interface":"front","average":{"1min":1.3009999999999999,"5min":1.351,"15min":1.359},"min":{"1min":1.0209999999999999,"5min":0.78200000000000003,"15min":0.78200000000000003},"max":{"1min":1.5349999999999999,"5min":1.903,"15min":1.903},"last":1.2769999999999999}]},{"osd":12,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.016}]},{"osd":13,"last update":"Thu Apr 18 14:45:23 2024","interfaces":[{"interface":"back","average":{"1min":1.216,"5min":1.4139999999999999,"15min":1.4470000000000001},"min":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"max":{"1min":1.724,"5min":1.8620000000000001,"15min":1.8620000000000001},"last":1.3959999999999999},{"interface":"front","average":{"1min":1.4119999999999999,"5min":1.51,"15min":1.526},"min":{"1min":1.03,"5min":0.94299999999999995,"15min":0.94299999999999995},"max":{"1min":2,"5min":2.452,"15min":2.452},"last":1.2350000000000001}]},{"osd":15,"last update":"Thu Apr 18 14:45:23 2024","interfaces":[{"interface":"back","average":{"1min":1.3939999999999999,"5min":1.4890000000000001,"15min":1.5049999999999999},"min":{"1min":0.93400000000000005,"5min":0.93400000000000005,"15min":0.93400000000000005},"max":{"1min":2.0579999999999998,"5min":2.2549999999999999,"15min":2.2549999999999999},"last":1.3},{"interface":"front","average":{"1min":1.3380000000000001,"5min":1.448,"15min":1.466},"min":{"1min":0.90800000000000003,"5min":0.89800000000000002,"15min":0.89800000000000002},"max":{"1min":1.863,"5min":1.9550000000000001,"15min":1.9550000000000001},"last":1.4930000000000001}]}]},{"osd":1,"up_from":24,"seq":103079215138,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":33032,"kb_used_data":1912,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94338808,"statfs":{"total":96636764160,"available":96602939392,"internally_reserved":0,"allocated":1957888,"data_stored":1135091,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,2,3,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Apr 18 14:45:26 2024","interfaces":[{"interface":"back","average":{"1min":0.95999999999999996,"5min":0.81599999999999995,"15min":0.79200000000000004},"min":{"1min":0.749,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":1.2230000000000001,"5min":1.2230000000000001,"15min":1.2230000000000001},"last":0.70099999999999996},{"interface":"front","average":{"1min":0.98699999999999999,"5min":0.85899999999999999,"15min":0.83799999999999997},"min":{"1min":0.65600000000000003,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":1.3300000000000001,"5min":1.3300000000000001,"15min":1.3300000000000001},"last":1.109}]},{"osd":2,"last update":"Thu Apr 18 14:45:26 2024","interfaces":[{"interface":"back","average":{"1min":1.0509999999999999,"5min":0.96099999999999997,"15min":0.94599999999999995},"min":{"1min":0.72899999999999998,"5min":0.67800000000000005,"15min":0.67800000000000005},"max":{"1min":1.4690000000000001,"5min":1.4690000000000001,"15min":1.4690000000000001},"last":0.78700000000000003},{"interface":"front","average":{"1min":1.1020000000000001,"5min":0.98199999999999998,"15min":0.96199999999999997},"min":{"1min":0.61899999999999999,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":1.335,"5min":1.345,"15min":1.345},"last":0.98299999999999998}]},{"osd":3,"last update":"Thu Apr 18 14:45:26 2024","interfaces":[{"interface":"back","average":{"1min":1.2470000000000001,"5min":1.1100000000000001,"15min":1.087},"min":{"1min":0.91800000000000004,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":1.526,"5min":1.526,"15min":1.526},"last":1.0549999999999999},{"interface":"front","average":{"1min":1.2310000000000001,"5min":1.1799999999999999,"15min":1.1719999999999999},"min":{"1min":0.98299999999999998,"5min":0.80000000000000004,"15min":0.80000000000000004},"max":{"1min":1.621,"5min":1.7789999999999999,"15min":1.7789999999999999},"last":1.0229999999999999}]},{"osd":4,"last update":"Thu Apr 18 14:45:26 2024","interfaces":[{"interface":"back","average":{"1min":1.071,"5min":1,"15min":0.98799999999999999},"min":{"1min":0.621,"5min":0.61099999999999999,"15min":0.61099999999999999},"max":{"1min":1.6559999999999999,"5min":1.728,"15min":1.728},"last":0.94699999999999995},{"interface":"front","average":{"1min":1.171,"5min":0.98299999999999998,"15min":0.95199999999999996},"min":{"1min":0.79000000000000004,"5min":0.61599999999999999,"15min":0.61599999999999999},"max":{"1min":1.7509999999999999,"5min":1.7509999999999999,"15min":1.7509999999999999},"last":0.90500000000000003}]},{"osd":5,"last update":"Thu Apr 18 14:45:26 2024","interfaces":[{"interface":"back","average":{"1min":1.075,"5min":1.022,"15min":1.0129999999999999},"min":{"1min":0.625,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":1.7410000000000001,"5min":1.819,"15min":1.819},"last":0.93300000000000005},{"interface":"front","average":{"1min":1.2609999999999999,"5min":1.1180000000000001,"15min":1.0940000000000001},"min":{"1min":0.71299999999999997,"5min":0.437,"15min":0.437},"max":{"1min":2.0979999999999999,"5min":2.0979999999999999,"15min":2.0979999999999999},"last":1.218}]},{"osd":6,"last update":"Thu Apr 18 14:45:26 2024","interfaces":[{"interface":"back","average":{"1min":1.3819999999999999,"5min":1.278,"15min":1.2609999999999999},"min":{"1min":1.0629999999999999,"5min":0.70499999999999996,"15min":0.70499999999999996},"max":{"1min":2.0249999999999999,"5min":2.3639999999999999,"15min":2.3639999999999999},"last":0.83399999999999996},{"interface":"front","average":{"1min":1.4379999999999999,"5min":1.234,"15min":1.2},"min":{"1min":0.86099999999999999,"5min":0.65300000000000002,"15min":0.65300000000000002},"max":{"1min":2.302,"5min":2.302,"15min":2.302},"last":1.2829999999999999}]},{"osd":7,"last update":"Thu Apr 18 14:45:26 2024","interfaces":[{"interface":"back","average":{"1min":1.4259999999999999,"5min":1.2490000000000001,"15min":1.2190000000000001},"min":{"1min":0.86499999999999999,"5min":0.77500000000000002,"15min":0.77500000000000002},"max":{"1min":2.0379999999999998,"5min":2.0379999999999998,"15min":2.0379999999999998},"last":1.131},{"interface":"front","average":{"1min":1.421,"5min":1.2849999999999999,"15min":1.262},"min":{"1min":0.76200000000000001,"5min":0.74399999999999999,"15min":0.74399999999999999},"max":{"1min":2.0649999999999999,"5min":2.4399999999999999,"15min":2.4399999999999999},"last":1.085}]},{"osd":8,"last update":"Thu Apr 18 14:45:26 2024","interfaces":[{"interface":"back","average":{"1min":1.429,"5min":1.272,"15min":1.246},"min":{"1min":1.008,"5min":0.61699999999999999,"15min":0.61699999999999999},"max":{"1min":2.0529999999999999,"5min":2.0529999999999999,"15min":2.0529999999999999},"last":1.2},{"interface":"front","average":{"1min":1.4970000000000001,"5min":1.3069999999999999,"15min":1.2749999999999999},"min":{"1min":1.0089999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.9950000000000001,"5min":2.5169999999999999,"15min":2.5169999999999999},"last":1.167}]},{"osd":9,"last update":"Thu Apr 18 14:45:26 2024","interfaces":[{"interface":"back","average":{"1min":1.5720000000000001,"5min":1.3759999999999999,"15min":1.3440000000000001},"min":{"1min":1.036,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":2.1949999999999998,"5min":2.4780000000000002,"15min":2.4780000000000002},"last":1.331},{"interface":"front","average":{"1min":1.52,"5min":1.3540000000000001,"15min":1.3260000000000001},"min":{"1min":0.84099999999999997,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.964,"5min":2.161,"15min":2.161},"last":1.2629999999999999}]},{"osd":10,"last update":"Thu Apr 18 14:45:26 2024","interfaces":[{"interface":"back","average":{"1min":1.617,"5min":1.4490000000000001,"15min":1.421},"min":{"1min":1.137,"5min":0.77100000000000002,"15min":0.77100000000000002},"max":{"1min":2.0739999999999998,"5min":2.625,"15min":2.625},"last":1.244},{"interface":"front","average":{"1min":1.6599999999999999,"5min":1.488,"15min":1.46},"min":{"1min":1.0780000000000001,"5min":0.70799999999999996,"15min":0.70799999999999996},"max":{"1min":2.258,"5min":2.5529999999999999,"15min":2.5529999999999999},"last":1.504}]}]},{"osd":2,"up_from":22,"seq":94489280545,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28920,"kb_used_data":1900,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94342920,"statfs":{"total":96636764160,"available":96607150080,"internally_reserved":0,"allocated":1945600,"data_stored":1126379,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,3,5,6,7,8,10,11,12,14],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Apr 18 14:45:22 2024","interfaces":[{"interface":"back","average":{"1min":0.96799999999999997,"5min":0.88700000000000001,"15min":0.873},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":2.4470000000000001,"5min":2.4470000000000001,"15min":2.4470000000000001},"last":0.85099999999999998},{"interface":"front","average":{"1min":1.03,"5min":0.93300000000000005,"15min":0.91700000000000004},"min":{"1min":0.63400000000000001,"5min":0.60999999999999999,"15min":0.60999999999999999},"max":{"1min":2.5619999999999998,"5min":2.5619999999999998,"15min":2.5619999999999998},"last":0.79500000000000004}]},{"osd":3,"last update":"Thu Apr 18 14:45:22 2024","interfaces":[{"interface":"back","average":{"1min":0.95299999999999996,"5min":1.0229999999999999,"15min":1.0349999999999999},"min":{"1min":0.69899999999999995,"5min":0.65500000000000003,"15min":0.65500000000000003},"max":{"1min":1.4059999999999999,"5min":1.6830000000000001,"15min":1.6830000000000001},"last":1.123},{"interface":"front","average":{"1min":1.0109999999999999,"5min":1.0580000000000001,"15min":1.0660000000000001},"min":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"max":{"1min":1.3080000000000001,"5min":1.8839999999999999,"15min":1.8839999999999999},"last":1.091}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96699999999999997}]},{"osd":5,"last update":"Thu Apr 18 14:45:22 2024","interfaces":[{"interface":"back","average":{"1min":1.028,"5min":0.996,"15min":0.98999999999999999},"min":{"1min":0.63100000000000001,"5min":0.60199999999999998,"15min":0.60199999999999998},"max":{"1min":2.6560000000000001,"5min":2.6560000000000001,"15min":2.6560000000000001},"last":0.90700000000000003},{"interface":"front","average":{"1min":1.0940000000000001,"5min":0.95799999999999996,"15min":0.93600000000000005},"min":{"1min":0.60399999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":1.6180000000000001,"5min":1.6180000000000001,"15min":1.6180000000000001},"last":1.052}]},{"osd":6,"last update":"Thu Apr 18 14:45:20 2024","interfaces":[{"interface":"back","average":{"1min":1.1080000000000001,"5min":1.113,"15min":1.1140000000000001},"min":{"1min":0.52900000000000003,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":2.5089999999999999,"5min":2.5089999999999999,"15min":2.5089999999999999},"last":1.2989999999999999},{"interface":"front","average":{"1min":1.0469999999999999,"5min":1.0800000000000001,"15min":1.0860000000000001},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":1.6890000000000001,"5min":1.8069999999999999,"15min":1.8069999999999999},"last":1.2569999999999999}]},{"osd":7,"last update":"Thu Apr 18 14:45:22 2024","interfaces":[{"interface":"back","average":{"1min":1.167,"5min":1.165,"15min":1.165},"min":{"1min":0.72799999999999998,"5min":0.64900000000000002,"15min":0.64900000000000002},"max":{"1min":2.778,"5min":2.778,"15min":2.778},"last":1.1930000000000001},{"interface":"front","average":{"1min":1.218,"5min":1.2789999999999999,"15min":1.2889999999999999},"min":{"1min":0.71099999999999997,"5min":0.60699999999999998,"15min":0.60699999999999998},"max":{"1min":2.6110000000000002,"5min":2.6110000000000002,"15min":2.6110000000000002},"last":1.218}]},{"osd":8,"last update":"Thu Apr 18 14:45:22 2024","interfaces":[{"interface":"back","average":{"1min":1.3320000000000001,"5min":1.2450000000000001,"15min":1.2310000000000001},"min":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":2.8719999999999999,"5min":2.8719999999999999,"15min":2.8719999999999999},"last":1.1579999999999999},{"interface":"front","average":{"1min":1.4099999999999999,"5min":1.331,"15min":1.3180000000000001},"min":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"max":{"1min":3.0449999999999999,"5min":3.0449999999999999,"15min":3.0449999999999999},"last":1.3560000000000001}]},{"osd":10,"last update":"Thu Apr 18 14:45:20 2024","interfaces":[{"interface":"back","average":{"1min":1.3400000000000001,"5min":1.3600000000000001,"15min":1.363},"min":{"1min":0.57999999999999996,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":2.8170000000000002,"5min":2.8170000000000002,"15min":2.8170000000000002},"last":1.403},{"interface":"front","average":{"1min":1.425,"5min":1.395,"15min":1.3899999999999999},"min":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"max":{"1min":3.0110000000000001,"5min":3.0110000000000001,"15min":3.0110000000000001},"last":1.327}]},{"osd":11,"last update":"Thu Apr 18 14:45:20 2024","interfaces":[{"interface":"back","average":{"1min":1.5109999999999999,"5min":1.494,"15min":1.4910000000000001},"min":{"1min":0.89400000000000002,"5min":0.85999999999999999,"15min":0.85999999999999999},"max":{"1min":2.9100000000000001,"5min":2.9100000000000001,"15min":2.9100000000000001},"last":1.474},{"interface":"front","average":{"1min":1.6359999999999999,"5min":1.494,"15min":1.47},"min":{"1min":0.877,"5min":0.80400000000000005,"15min":0.80400000000000005},"max":{"1min":3.3490000000000002,"5min":3.3490000000000002,"15min":3.3490000000000002},"last":1.4430000000000001}]},{"osd":12,"last update":"Thu Apr 18 14:45:20 2024","interfaces":[{"interface":"back","average":{"1min":1.5369999999999999,"5min":1.5,"15min":1.494},"min":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"max":{"1min":2.9710000000000001,"5min":2.9710000000000001,"15min":2.9710000000000001},"last":1.4259999999999999},{"interface":"front","average":{"1min":1.5660000000000001,"5min":1.524,"15min":1.5169999999999999},"min":{"1min":0.81799999999999995,"5min":0.78400000000000003,"15min":0.78400000000000003},"max":{"1min":3.1640000000000001,"5min":3.1640000000000001,"15min":3.1640000000000001},"last":1.5409999999999999}]},{"osd":14,"last update":"Thu Apr 18 14:45:20 2024","interfaces":[{"interface":"back","average":{"1min":1.6950000000000001,"5min":1.49,"15min":1.456},"min":{"1min":0.77600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":3.3010000000000002,"5min":3.3010000000000002,"15min":3.3010000000000002},"last":1.512},{"interface":"front","average":{"1min":1.5700000000000001,"5min":1.5189999999999999,"15min":1.5109999999999999},"min":{"1min":0.69599999999999995,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":3.0819999999999999,"5min":3.0819999999999999,"15min":3.0819999999999999},"last":1.3819999999999999}]}]},{"osd":15,"up_from":23,"seq":98784247842,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33036,"kb_used_data":1912,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94338804,"statfs":{"total":96636764160,"available":96602935296,"internally_reserved":0,"allocated":1957888,"data_stored":1135091,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31848903},"hb_peers":[0,4,5,6,7,8,10,11,13,14],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Apr 18 14:45:21 2024","interfaces":[{"interface":"back","average":{"1min":0.85599999999999998,"5min":0.92800000000000005,"15min":0.93999999999999995},"min":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":1.175,"5min":1.405,"15min":1.405},"last":0.83599999999999997},{"interface":"front","average":{"1min":0.78200000000000003,"5min":0.78700000000000003,"15min":0.78800000000000003},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":1.038,"5min":1.0569999999999999,"15min":1.0569999999999999},"last":0.871}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2050000000000001}]},{"osd":4,"last update":"Thu Apr 18 14:45:21 2024","interfaces":[{"interface":"back","average":{"1min":0.79200000000000004,"5min":0.83899999999999997,"15min":0.84699999999999998},"min":{"1min":0.57099999999999995,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.095,"5min":1.2669999999999999,"15min":1.2669999999999999},"last":0.90100000000000002},{"interface":"front","average":{"1min":0.995,"5min":0.90000000000000002,"15min":0.88400000000000001},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":1.341,"5min":1.341,"15min":1.341},"last":0.98599999999999999}]},{"osd":5,"last update":"Thu Apr 18 14:45:25 2024","interfaces":[{"interface":"back","average":{"1min":0.92100000000000004,"5min":1.0009999999999999,"15min":1.014},"min":{"1min":0.64700000000000002,"5min":0.504,"15min":0.504},"max":{"1min":1.204,"5min":2.0579999999999998,"15min":2.0579999999999998},"last":0.76200000000000001},{"interface":"front","average":{"1min":0.98899999999999999,"5min":1.069,"15min":1.0820000000000001},"min":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"max":{"1min":1.2669999999999999,"5min":1.9259999999999999,"15min":1.9259999999999999},"last":0.71599999999999997}]},{"osd":6,"last update":"Thu Apr 18 14:45:21 2024","interfaces":[{"interface":"back","average":{"1min":1.2130000000000001,"5min":1.153,"15min":1.143},"min":{"1min":0.77600000000000002,"5min":0.73599999999999999,"15min":0.73599999999999999},"max":{"1min":1.468,"5min":1.8680000000000001,"15min":1.8680000000000001},"last":1.0329999999999999},{"interface":"front","average":{"1min":1.254,"5min":1.2330000000000001,"15min":1.2290000000000001},"min":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"max":{"1min":1.528,"5min":1.79,"15min":1.79},"last":1.01}]},{"osd":7,"last update":"Thu Apr 18 14:45:21 2024","interfaces":[{"interface":"back","average":{"1min":1.0669999999999999,"5min":1.0569999999999999,"15min":1.0549999999999999},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":1.647,"5min":1.647,"15min":1.647},"last":0.59399999999999997},{"interface":"front","average":{"1min":1.123,"5min":1.171,"15min":1.179},"min":{"1min":0.51000000000000001,"5min":0.438,"15min":0.438},"max":{"1min":1.4179999999999999,"5min":1.976,"15min":1.976},"last":1.1870000000000001}]},{"osd":8,"last update":"Thu Apr 18 14:45:21 2024","interfaces":[{"interface":"back","average":{"1min":1.0409999999999999,"5min":1.1579999999999999,"15min":1.1779999999999999},"min":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"max":{"1min":1.3340000000000001,"5min":2.004,"15min":2.004},"last":0.80400000000000005},{"interface":"front","average":{"1min":1.167,"5min":1.2110000000000001,"15min":1.218},"min":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"max":{"1min":1.4330000000000001,"5min":1.786,"15min":1.786},"last":1.127}]},{"osd":10,"last update":"Thu Apr 18 14:45:21 2024","interfaces":[{"interface":"back","average":{"1min":1.2450000000000001,"5min":1.3169999999999999,"15min":1.329},"min":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"max":{"1min":1.621,"5min":2.403,"15min":2.403},"last":1.0549999999999999},{"interface":"front","average":{"1min":1.282,"5min":1.321,"15min":1.327},"min":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"max":{"1min":1.6539999999999999,"5min":2.2549999999999999,"15min":2.2549999999999999},"last":1.101}]},{"osd":11,"last update":"Thu Apr 18 14:45:21 2024","interfaces":[{"interface":"back","average":{"1min":1.3440000000000001,"5min":1.3879999999999999,"15min":1.395},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":1.9239999999999999,"5min":2.2109999999999999,"15min":2.2109999999999999},"last":0.93400000000000005},{"interface":"front","average":{"1min":1.3480000000000001,"5min":1.4279999999999999,"15min":1.4419999999999999},"min":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":1.73,"5min":2.1589999999999998,"15min":2.1589999999999998},"last":1.147}]},{"osd":13,"last update":"Thu Apr 18 14:45:25 2024","interfaces":[{"interface":"back","average":{"1min":1.3899999999999999,"5min":1.3899999999999999,"15min":1.3899999999999999},"min":{"1min":0.627,"5min":0.627,"15min":0.627},"max":{"1min":1.849,"5min":1.9419999999999999,"15min":1.9419999999999999},"last":0.95899999999999996},{"interface":"front","average":{"1min":1.466,"5min":1.4019999999999999,"15min":1.3919999999999999},"min":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"max":{"1min":2.1419999999999999,"5min":2.1419999999999999,"15min":2.1419999999999999},"last":1.0760000000000001}]},{"osd":14,"last update":"Thu Apr 18 14:45:21 2024","interfaces":[{"interface":"back","average":{"1min":1.4370000000000001,"5min":1.429,"15min":1.4279999999999999},"min":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"max":{"1min":1.843,"5min":2.351,"15min":2.351},"last":1.232},{"interface":"front","average":{"1min":1.5009999999999999,"5min":1.4630000000000001,"15min":1.4570000000000001},"min":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"max":{"1min":2.206,"5min":2.766,"15min":2.766},"last":1.1659999999999999}]}]},{"osd":4,"up_from":22,"seq":94489280544,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":51064,"kb_used_data":1896,"kb_used_omap":1,"kb_used_meta":49150,"kb_avail":94320776,"statfs":{"total":96636764160,"available":96584474624,"internally_reserved":0,"allocated":1941504,"data_stored":1125535,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":50330054},"hb_peers":[2,3,5,6,10,11,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":2,"last update":"Thu Apr 18 14:45:23 2024","interfaces":[{"interface":"back","average":{"1min":0.94999999999999996,"5min":0.82999999999999996,"15min":0.81000000000000005},"min":{"1min":0.66600000000000004,"5min":0.437,"15min":0.437},"max":{"1min":1.206,"5min":1.2330000000000001,"15min":1.2330000000000001},"last":0.69399999999999995},{"interface":"front","average":{"1min":0.92900000000000005,"5min":0.81000000000000005,"15min":0.79000000000000004},"min":{"1min":0.57399999999999995,"5min":0.5,"15min":0.5},"max":{"1min":1.3420000000000001,"5min":1.3420000000000001,"15min":1.3420000000000001},"last":1.1930000000000001}]},{"osd":3,"last update":"Thu Apr 18 14:45:23 2024","interfaces":[{"interface":"back","average":{"1min":0.85799999999999998,"5min":0.79100000000000004,"15min":0.78000000000000003},"min":{"1min":0.55900000000000005,"5min":0.379,"15min":0.379},"max":{"1min":1.103,"5min":1.1499999999999999,"15min":1.1499999999999999},"last":1.137},{"interface":"front","average":{"1min":0.82899999999999996,"5min":0.753,"15min":0.73999999999999999},"min":{"1min":0.55700000000000005,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":1.054,"5min":1.054,"15min":1.054},"last":1.0409999999999999}]},{"osd":5,"last update":"Thu Apr 18 14:45:23 2024","interfaces":[{"interface":"back","average":{"1min":0.82999999999999996,"5min":0.754,"15min":0.74099999999999999},"min":{"1min":0.54800000000000004,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":1.0229999999999999,"5min":1.0609999999999999,"15min":1.0609999999999999},"last":1.171},{"interface":"front","average":{"1min":0.99199999999999999,"5min":0.81299999999999994,"15min":0.78300000000000003},"min":{"1min":0.56799999999999995,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":1.296,"5min":1.296,"15min":1.296},"last":0.99299999999999999}]},{"osd":6,"last update":"Thu Apr 18 14:45:23 2024","interfaces":[{"interface":"back","average":{"1min":1.0049999999999999,"5min":0.88100000000000001,"15min":0.85999999999999999},"min":{"1min":0.76800000000000002,"5min":0.501,"15min":0.501},"max":{"1min":1.446,"5min":1.446,"15min":1.446},"last":1.468},{"interface":"front","average":{"1min":0.95899999999999996,"5min":0.89500000000000002,"15min":0.88500000000000001},"min":{"1min":0.58799999999999997,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.304,"5min":1.337,"15min":1.337},"last":1.0189999999999999}]},{"osd":10,"last update":"Thu Apr 18 14:45:23 2024","interfaces":[{"interface":"back","average":{"1min":1.0760000000000001,"5min":0.91600000000000004,"15min":0.88900000000000001},"min":{"1min":0.60299999999999998,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":1.8009999999999999,"5min":1.8009999999999999,"15min":1.8009999999999999},"last":0.91700000000000004},{"interface":"front","average":{"1min":1.036,"5min":0.93400000000000005,"15min":0.91700000000000004},"min":{"1min":0.63,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.3660000000000001,"5min":1.5700000000000001,"15min":1.5700000000000001},"last":0.95899999999999996}]},{"osd":11,"last update":"Thu Apr 18 14:45:23 2024","interfaces":[{"interface":"back","average":{"1min":1.081,"5min":0.90800000000000003,"15min":0.879},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":1.429,"5min":1.429,"15min":1.429},"last":1.234},{"interface":"front","average":{"1min":1.1140000000000001,"5min":0.94299999999999995,"15min":0.91500000000000004},"min":{"1min":0.51900000000000002,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.6719999999999999,"5min":1.6719999999999999,"15min":1.6719999999999999},"last":1.2130000000000001}]},{"osd":12,"last update":"Thu Apr 18 14:45:23 2024","interfaces":[{"interface":"back","average":{"1min":1.077,"5min":0.85899999999999999,"15min":0.82299999999999995},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":1.538,"5min":1.538,"15min":1.538},"last":0.874},{"interface":"front","average":{"1min":1.113,"5min":0.91100000000000003,"15min":0.877},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":1.901,"5min":1.901,"15min":1.901},"last":1.3640000000000001}]},{"osd":13,"last update":"Thu Apr 18 14:45:23 2024","interfaces":[{"interface":"back","average":{"1min":1.218,"5min":1.0109999999999999,"15min":0.97699999999999998},"min":{"1min":0.65200000000000002,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.974,"5min":1.974,"15min":1.974},"last":1.425},{"interface":"front","average":{"1min":1.1180000000000001,"5min":0.94199999999999995,"15min":0.91300000000000003},"min":{"1min":0.63700000000000001,"5min":0.59499999999999997,"15min":0.59499999999999997},"max":{"1min":1.75,"5min":1.75,"15min":1.75},"last":1.3169999999999999}]},{"osd":14,"last update":"Thu Apr 18 14:45:23 2024","interfaces":[{"interface":"back","average":{"1min":1.1850000000000001,"5min":1.054,"15min":1.032},"min":{"1min":0.81100000000000005,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":1.601,"5min":1.601,"15min":1.601},"last":1.2549999999999999},{"interface":"front","average":{"1min":1.2470000000000001,"5min":1.083,"15min":1.056},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.5660000000000001,"5min":1.5660000000000001,"15min":1.5660000000000001},"last":1.2769999999999999}]},{"osd":15,"last update":"Thu Apr 18 14:45:23 2024","interfaces":[{"interface":"back","average":{"1min":1.292,"5min":1.071,"15min":1.034},"min":{"1min":0.73199999999999998,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.639,"5min":1.639,"15min":1.639},"last":1.343},{"interface":"front","average":{"1min":1.3160000000000001,"5min":1.079,"15min":1.0389999999999999},"min":{"1min":0.71299999999999997,"5min":0.624,"15min":0.624},"max":{"1min":2.0369999999999999,"5min":2.0369999999999999,"15min":2.0369999999999999},"last":1.5089999999999999}]}]},{"osd":6,"up_from":22,"seq":94489280544,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33020,"kb_used_data":1900,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94338820,"statfs":{"total":96636764160,"available":96602951680,"internally_reserved":0,"allocated":1945600,"data_stored":1126379,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31848903},"hb_peers":[0,1,5,7,8,9,11,12,13,14],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Apr 18 14:45:30 2024","interfaces":[{"interface":"back","average":{"1min":0.75800000000000001,"5min":0.79100000000000004,"15min":0.79700000000000004},"min":{"1min":0.53500000000000003,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":1.4890000000000001,"5min":1.5629999999999999,"15min":1.5629999999999999},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.73299999999999998,"5min":0.72599999999999998,"15min":0.72499999999999998},"min":{"1min":0.56200000000000006,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":1.0860000000000001,"5min":1.0860000000000001,"15min":1.0860000000000001},"last":0.77700000000000002}]},{"osd":1,"last update":"Thu Apr 18 14:45:21 2024","interfaces":[{"interface":"back","average":{"1min":0.97699999999999998,"5min":1.0209999999999999,"15min":1.0289999999999999},"min":{"1min":0.623,"5min":0.623,"15min":0.623},"max":{"1min":1.389,"5min":1.633,"15min":1.633},"last":0.73799999999999999},{"interface":"front","average":{"1min":1.079,"5min":1.119,"15min":1.125},"min":{"1min":0.80800000000000005,"5min":0.68899999999999995,"15min":0.68899999999999995},"max":{"1min":1.345,"5min":1.585,"15min":1.585},"last":1.254}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95399999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86599999999999999}]},{"osd":5,"last update":"Thu Apr 18 14:45:21 2024","interfaces":[{"interface":"back","average":{"1min":0.81399999999999995,"5min":0.93400000000000005,"15min":0.95399999999999996},"min":{"1min":0.69099999999999995,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":1.1020000000000001,"5min":1.627,"15min":1.627},"last":0.84999999999999998},{"interface":"front","average":{"1min":1.0169999999999999,"5min":0.98899999999999999,"15min":0.98399999999999999},"min":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"max":{"1min":1.5620000000000001,"5min":1.5620000000000001,"15min":1.5620000000000001},"last":0.92000000000000004}]},{"osd":7,"last update":"Thu Apr 18 14:45:21 2024","interfaces":[{"interface":"back","average":{"1min":1.1859999999999999,"5min":1.149,"15min":1.143},"min":{"1min":0.997,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.4059999999999999,"5min":1.5860000000000001,"15min":1.5860000000000001},"last":0.98799999999999999},{"interface":"front","average":{"1min":0.98899999999999999,"5min":1.0149999999999999,"15min":1.0189999999999999},"min":{"1min":0.70499999999999996,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":1.3560000000000001,"5min":1.482,"15min":1.482},"last":0.96199999999999997}]},{"osd":8,"last update":"Thu Apr 18 14:45:21 2024","interfaces":[{"interface":"back","average":{"1min":0.86599999999999999,"5min":0.96699999999999997,"15min":0.98399999999999999},"min":{"1min":0.56200000000000006,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.161,"5min":1.3380000000000001,"15min":1.3380000000000001},"last":1.171},{"interface":"front","average":{"1min":1.0409999999999999,"5min":1.1379999999999999,"15min":1.1539999999999999},"min":{"1min":0.755,"5min":0.63300000000000001,"15min":0.63300000000000001},"max":{"1min":1.3740000000000001,"5min":1.673,"15min":1.673},"last":0.88100000000000001}]},{"osd":9,"last update":"Thu Apr 18 14:45:30 2024","interfaces":[{"interface":"back","average":{"1min":1.0900000000000001,"5min":1.1200000000000001,"15min":1.125},"min":{"1min":0.80300000000000005,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.2729999999999999,"5min":1.3859999999999999,"15min":1.3859999999999999},"last":1.012},{"interface":"front","average":{"1min":1.1799999999999999,"5min":1.1850000000000001,"15min":1.1859999999999999},"min":{"1min":0.753,"5min":0.753,"15min":0.753},"max":{"1min":1.6319999999999999,"5min":1.6319999999999999,"15min":1.6319999999999999},"last":1.0640000000000001}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3240000000000001}]},{"osd":11,"last update":"Thu Apr 18 14:45:21 2024","interfaces":[{"interface":"back","average":{"1min":1.216,"5min":1.3300000000000001,"15min":1.349},"min":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"max":{"1min":1.456,"5min":2.3610000000000002,"15min":2.3610000000000002},"last":1.0369999999999999},{"interface":"front","average":{"1min":1.079,"5min":1.131,"15min":1.139},"min":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"max":{"1min":1.3919999999999999,"5min":1.698,"15min":1.698},"last":1.1020000000000001}]},{"osd":12,"last update":"Thu Apr 18 14:45:21 2024","interfaces":[{"interface":"back","average":{"1min":1.143,"5min":1.1839999999999999,"15min":1.1910000000000001},"min":{"1min":0.72399999999999998,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.7,"5min":1.7,"15min":1.7},"last":0.82399999999999995},{"interface":"front","average":{"1min":1.23,"5min":1.3180000000000001,"15min":1.3320000000000001},"min":{"1min":0.93100000000000005,"5min":0.71299999999999997,"15min":0.71299999999999997},"max":{"1min":1.5029999999999999,"5min":2.1920000000000002,"15min":2.1920000000000002},"last":1.1319999999999999}]},{"osd":13,"last update":"Thu Apr 18 14:45:30 2024","interfaces":[{"interface":"back","average":{"1min":1.365,"5min":1.4039999999999999,"15min":1.4099999999999999},"min":{"1min":1.151,"5min":1.0309999999999999,"15min":1.0309999999999999},"max":{"1min":1.546,"5min":1.794,"15min":1.794},"last":1.2909999999999999},{"interface":"front","average":{"1min":1.264,"5min":1.284,"15min":1.288},"min":{"1min":0.95799999999999996,"5min":0.94599999999999995,"15min":0.94599999999999995},"max":{"1min":1.5309999999999999,"5min":1.591,"15min":1.591},"last":1.1539999999999999}]},{"osd":14,"last update":"Thu Apr 18 14:45:21 2024","interfaces":[{"interface":"back","average":{"1min":1.3859999999999999,"5min":1.339,"15min":1.331},"min":{"1min":0.99199999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"max":{"1min":1.593,"5min":1.8580000000000001,"15min":1.8580000000000001},"last":1.2050000000000001},{"interface":"front","average":{"1min":1.3069999999999999,"5min":1.339,"15min":1.3440000000000001},"min":{"1min":1.073,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":1.5920000000000001,"5min":1.712,"15min":1.712},"last":1.234}]}]},{"osd":10,"up_from":22,"seq":94489280545,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33016,"kb_used_data":1896,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94338824,"statfs":{"total":96636764160,"available":96602955776,"internally_reserved":0,"allocated":1941504,"data_stored":1125535,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1599,"internal_metadata":31848897},"hb_peers":[1,6,7,8,9,11,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Apr 18 14:45:13 2024","interfaces":[{"interface":"back","average":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"min":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"max":{"1min":1.1910000000000001,"5min":1.1910000000000001,"15min":1.1910000000000001},"last":0.67300000000000004},{"interface":"front","average":{"1min":0.96099999999999997,"5min":0.96099999999999997,"15min":0.96099999999999997},"min":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":1.3380000000000001,"5min":1.3380000000000001,"15min":1.3380000000000001},"last":0.97199999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.371}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.117}]},{"osd":6,"last update":"Thu Apr 18 14:45:22 2024","interfaces":[{"interface":"back","average":{"1min":0.88900000000000001,"5min":1.1240000000000001,"15min":1.163},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":1.22,"5min":3.9830000000000001,"15min":3.9830000000000001},"last":0.72199999999999998},{"interface":"front","average":{"1min":0.81299999999999994,"5min":0.98699999999999999,"15min":1.016},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":1.3380000000000001,"5min":2.9420000000000002,"15min":2.9420000000000002},"last":0.80400000000000005}]},{"osd":7,"last update":"Thu Apr 18 14:45:32 2024","interfaces":[{"interface":"back","average":{"1min":1.075,"5min":1.1639999999999999,"15min":1.179},"min":{"1min":0.76100000000000001,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":1.3580000000000001,"5min":3.3679999999999999,"15min":3.3679999999999999},"last":1.044},{"interface":"front","average":{"1min":1.095,"5min":1.194,"15min":1.21},"min":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"max":{"1min":1.357,"5min":3.1669999999999998,"15min":3.1669999999999998},"last":1.3120000000000001}]},{"osd":8,"last update":"Thu Apr 18 14:45:22 2024","interfaces":[{"interface":"back","average":{"1min":0.94899999999999995,"5min":1.0620000000000001,"15min":1.081},"min":{"1min":0.59899999999999998,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.46,"5min":4.0439999999999996,"15min":4.0439999999999996},"last":1.0189999999999999},{"interface":"front","average":{"1min":1.0429999999999999,"5min":1.359,"15min":1.4119999999999999},"min":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"max":{"1min":1.484,"5min":4.4900000000000002,"15min":4.4900000000000002},"last":1.2769999999999999}]},{"osd":9,"last update":"Thu Apr 18 14:45:22 2024","interfaces":[{"interface":"back","average":{"1min":1.075,"5min":1.3009999999999999,"15min":1.339},"min":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":1.49,"5min":3.8439999999999999,"15min":3.8439999999999999},"last":1.228},{"interface":"front","average":{"1min":1.097,"5min":1.3080000000000001,"15min":1.343},"min":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"max":{"1min":1.4390000000000001,"5min":4.2880000000000003,"15min":4.2880000000000003},"last":0.86899999999999999}]},{"osd":11,"last update":"Thu Apr 18 14:45:22 2024","interfaces":[{"interface":"back","average":{"1min":1.1439999999999999,"5min":1.361,"15min":1.397},"min":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"max":{"1min":1.54,"5min":4.3399999999999999,"15min":4.3399999999999999},"last":0.94299999999999995},{"interface":"front","average":{"1min":1.2849999999999999,"5min":1.516,"15min":1.554},"min":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"max":{"1min":1.7130000000000001,"5min":4.4450000000000003,"15min":4.4450000000000003},"last":1.165}]},{"osd":12,"last update":"Thu Apr 18 14:45:22 2024","interfaces":[{"interface":"back","average":{"1min":1.246,"5min":1.3240000000000001,"15min":1.337},"min":{"1min":0.68700000000000006,"5min":0.66900000000000004,"15min":0.66900000000000004},"max":{"1min":1.774,"5min":3.5539999999999998,"15min":3.5539999999999998},"last":1.474},{"interface":"front","average":{"1min":1.21,"5min":1.3859999999999999,"15min":1.4159999999999999},"min":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":1.6120000000000001,"5min":4.125,"15min":4.125},"last":1.1220000000000001}]},{"osd":13,"last update":"Thu Apr 18 14:45:22 2024","interfaces":[{"interface":"back","average":{"1min":1.365,"5min":1.641,"15min":1.6870000000000001},"min":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"max":{"1min":1.595,"5min":4.5359999999999996,"15min":4.5359999999999996},"last":1.3779999999999999},{"interface":"front","average":{"1min":1.3899999999999999,"5min":1.512,"15min":1.532},"min":{"1min":0.755,"5min":0.755,"15min":0.755},"max":{"1min":1.847,"5min":4.0049999999999999,"15min":4.0049999999999999},"last":1.4379999999999999}]},{"osd":14,"last update":"Thu Apr 18 14:45:22 2024","interfaces":[{"interface":"back","average":{"1min":1.448,"5min":1.6559999999999999,"15min":1.6910000000000001},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":1.879,"5min":4.3940000000000001,"15min":4.3940000000000001},"last":1.6160000000000001},{"interface":"front","average":{"1min":1.4199999999999999,"5min":1.538,"15min":1.5580000000000001},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.897,"5min":3.73,"15min":3.73},"last":1.5509999999999999}]},{"osd":15,"last update":"Thu Apr 18 14:45:22 2024","interfaces":[{"interface":"back","average":{"1min":1.411,"5min":1.532,"15min":1.552},"min":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"max":{"1min":1.8240000000000001,"5min":4.1959999999999997,"15min":4.1959999999999997},"last":1.198},{"interface":"front","average":{"1min":1.506,"5min":1.742,"15min":1.782},"min":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"max":{"1min":1.8129999999999999,"5min":4.577,"15min":4.577},"last":1.5089999999999999}]}]},{"osd":11,"up_from":22,"seq":94489280545,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":33012,"kb_used_data":1896,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94338828,"statfs":{"total":96636764160,"available":96602959872,"internally_reserved":0,"allocated":1941504,"data_stored":1125535,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31848901},"hb_peers":[2,4,5,6,8,10,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":2,"last update":"Thu Apr 18 14:45:18 2024","interfaces":[{"interface":"back","average":{"1min":0.99099999999999999,"5min":0.94899999999999995,"15min":0.94199999999999995},"min":{"1min":0.71099999999999997,"5min":0.503,"15min":0.503},"max":{"1min":1.5329999999999999,"5min":1.5329999999999999,"15min":1.5329999999999999},"last":1.1000000000000001},{"interface":"front","average":{"1min":0.84799999999999998,"5min":0.98799999999999999,"15min":1.0109999999999999},"min":{"1min":0.64000000000000001,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":1.3280000000000001,"5min":2.863,"15min":2.863},"last":0.69199999999999995}]},{"osd":4,"last update":"Thu Apr 18 14:45:18 2024","interfaces":[{"interface":"back","average":{"1min":0.95999999999999996,"5min":0.82499999999999996,"15min":0.80300000000000005},"min":{"1min":0.64000000000000001,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":1.1419999999999999,"5min":1.1419999999999999,"15min":1.1419999999999999},"last":0.73199999999999998},{"interface":"front","average":{"1min":0.90000000000000002,"5min":0.83799999999999997,"15min":0.82799999999999996},"min":{"1min":0.60799999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.73,"5min":1.73,"15min":1.73},"last":0.61299999999999999}]},{"osd":5,"last update":"Thu Apr 18 14:45:24 2024","interfaces":[{"interface":"back","average":{"1min":1.1020000000000001,"5min":1.012,"15min":0.997},"min":{"1min":0.61399999999999999,"5min":0.443,"15min":0.443},"max":{"1min":1.9490000000000001,"5min":1.9490000000000001,"15min":1.9490000000000001},"last":0.98999999999999999},{"interface":"front","average":{"1min":1.056,"5min":0.98799999999999999,"15min":0.97699999999999998},"min":{"1min":0.70399999999999996,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.6439999999999999,"5min":1.6439999999999999,"15min":1.6439999999999999},"last":0.90600000000000003}]},{"osd":6,"last update":"Thu Apr 18 14:45:18 2024","interfaces":[{"interface":"back","average":{"1min":1.129,"5min":1.131,"15min":1.131},"min":{"1min":0.78700000000000003,"5min":0.64500000000000002,"15min":0.64500000000000002},"max":{"1min":1.7949999999999999,"5min":2.9199999999999999,"15min":2.9199999999999999},"last":0.58599999999999997},{"interface":"front","average":{"1min":1.0109999999999999,"5min":1.002,"15min":1},"min":{"1min":0.76800000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.4359999999999999,"5min":1.9510000000000001,"15min":1.9510000000000001},"last":0.81699999999999995}]},{"osd":8,"last update":"Thu Apr 18 14:45:24 2024","interfaces":[{"interface":"back","average":{"1min":0.98899999999999999,"5min":0.97999999999999998,"15min":0.97799999999999998},"min":{"1min":0.72999999999999998,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.4039999999999999,"5min":1.452,"15min":1.452},"last":1.038},{"interface":"front","average":{"1min":1.083,"5min":1.0209999999999999,"15min":1.0109999999999999},"min":{"1min":0.71199999999999997,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":1.5669999999999999,"5min":1.5669999999999999,"15min":1.5669999999999999},"last":1.171}]},{"osd":10,"last update":"Thu Apr 18 14:45:18 2024","interfaces":[{"interface":"back","average":{"1min":1.181,"5min":1.2230000000000001,"15min":1.23},"min":{"1min":0.622,"5min":0.622,"15min":0.622},"max":{"1min":1.911,"5min":2.774,"15min":2.774},"last":1.1950000000000001},{"interface":"front","average":{"1min":1.1299999999999999,"5min":1.1100000000000001,"15min":1.1060000000000001},"min":{"1min":0.751,"5min":0.627,"15min":0.627},"max":{"1min":1.4990000000000001,"5min":1.6890000000000001,"15min":1.6890000000000001},"last":1.131}]},{"osd":12,"last update":"Thu Apr 18 14:45:18 2024","interfaces":[{"interface":"back","average":{"1min":1.288,"5min":1.1879999999999999,"15min":1.1719999999999999},"min":{"1min":0.76900000000000002,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":2.3109999999999999,"5min":2.3109999999999999,"15min":2.3109999999999999},"last":1.278},{"interface":"front","average":{"1min":1.2250000000000001,"5min":1.2629999999999999,"15min":1.2689999999999999},"min":{"1min":0.86599999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"max":{"1min":2.0819999999999999,"5min":3.4169999999999998,"15min":3.4169999999999998},"last":1.359}]},{"osd":13,"last update":"Thu Apr 18 14:45:24 2024","interfaces":[{"interface":"back","average":{"1min":1.337,"5min":1.361,"15min":1.365},"min":{"1min":0.82999999999999996,"5min":0.77000000000000002,"15min":0.77000000000000002},"max":{"1min":1.9890000000000001,"5min":3.3239999999999998,"15min":3.3239999999999998},"last":1.53},{"interface":"front","average":{"1min":1.226,"5min":1.1759999999999999,"15min":1.1679999999999999},"min":{"1min":0.85399999999999998,"5min":0.74299999999999999,"15min":0.74299999999999999},"max":{"1min":1.6619999999999999,"5min":1.746,"15min":1.746},"last":1.23}]},{"osd":14,"last update":"Thu Apr 18 14:45:18 2024","interfaces":[{"interface":"back","average":{"1min":1.3120000000000001,"5min":1.218,"15min":1.202},"min":{"1min":0.90400000000000003,"5min":0.72399999999999998,"15min":0.72399999999999998},"max":{"1min":1.8899999999999999,"5min":1.8899999999999999,"15min":1.8899999999999999},"last":1.3009999999999999},{"interface":"front","average":{"1min":1.415,"5min":1.2789999999999999,"15min":1.256},"min":{"1min":1.105,"5min":0.73399999999999999,"15min":0.73399999999999999},"max":{"1min":2.4159999999999999,"5min":2.4159999999999999,"15min":2.4159999999999999},"last":1.335}]},{"osd":15,"last update":"Thu Apr 18 14:45:24 2024","interfaces":[{"interface":"back","average":{"1min":1.423,"5min":1.3109999999999999,"15min":1.2929999999999999},"min":{"1min":1.0629999999999999,"5min":0.65700000000000003,"15min":0.65700000000000003},"max":{"1min":2.4870000000000001,"5min":2.4870000000000001,"15min":2.4870000000000001},"last":1.3919999999999999},{"interface":"front","average":{"1min":1.464,"5min":1.4199999999999999,"15min":1.4119999999999999},"min":{"1min":1.0840000000000001,"5min":0.68799999999999994,"15min":0.68799999999999994},"max":{"1min":2.274,"5min":3.3769999999999998,"15min":3.3769999999999998},"last":1.6060000000000001}]}]},{"osd":12,"up_from":22,"seq":94489280545,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33016,"kb_used_data":1896,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94338824,"statfs":{"total":96636764160,"available":96602955776,"internally_reserved":0,"allocated":1941504,"data_stored":1125535,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[1,3,4,5,6,10,11,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Apr 18 14:44:30 2024","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":1.3400000000000001,"5min":1.3400000000000001,"15min":1.3400000000000001},"last":0.68100000000000005},{"interface":"front","average":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":1.2310000000000001,"5min":1.2310000000000001,"15min":1.2310000000000001},"last":0.78900000000000003}]},{"osd":1,"last update":"Thu Apr 18 14:45:22 2024","interfaces":[{"interface":"back","average":{"1min":0.81999999999999995,"5min":0.91600000000000004,"15min":0.93200000000000005},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.26,"5min":1.5449999999999999,"15min":1.5449999999999999},"last":0.80400000000000005},{"interface":"front","average":{"1min":0.82799999999999996,"5min":0.82199999999999995,"15min":0.82099999999999995},"min":{"1min":0.57199999999999995,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":1.2390000000000001,"5min":1.2649999999999999,"15min":1.2649999999999999},"last":1.121}]},{"osd":3,"last update":"Thu Apr 18 14:45:22 2024","interfaces":[{"interface":"back","average":{"1min":0.79700000000000004,"5min":0.91100000000000003,"15min":0.93000000000000005},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":1.202,"5min":1.4930000000000001,"15min":1.4930000000000001},"last":1.01},{"interface":"front","average":{"1min":0.85299999999999998,"5min":0.90200000000000002,"15min":0.91000000000000003},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.236,"5min":1.4319999999999999,"15min":1.4319999999999999},"last":1.046}]},{"osd":4,"last update":"Thu Apr 18 14:45:22 2024","interfaces":[{"interface":"back","average":{"1min":0.71799999999999997,"5min":0.79400000000000004,"15min":0.80700000000000005},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":1.1120000000000001,"5min":1.383,"15min":1.383},"last":0.75600000000000001},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.72499999999999998,"15min":0.72899999999999998},"min":{"1min":0.36099999999999999,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":1.1299999999999999,"5min":1.335,"15min":1.335},"last":0.85099999999999998}]},{"osd":5,"last update":"Thu Apr 18 14:45:30 2024","interfaces":[{"interface":"back","average":{"1min":0.92700000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"min":{"1min":0.497,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.304,"5min":1.4710000000000001,"15min":1.4710000000000001},"last":1.3200000000000001},{"interface":"front","average":{"1min":0.94799999999999995,"5min":1.0129999999999999,"15min":1.024},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.5329999999999999,"5min":1.784,"15min":1.784},"last":1.173}]},{"osd":6,"last update":"Thu Apr 18 14:45:22 2024","interfaces":[{"interface":"back","average":{"1min":0.98899999999999999,"5min":1.0209999999999999,"15min":1.026},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.385,"5min":1.6060000000000001,"15min":1.6060000000000001},"last":1.421},{"interface":"front","average":{"1min":1.0660000000000001,"5min":1.0780000000000001,"15min":1.0800000000000001},"min":{"1min":0.64800000000000002,"5min":0.63600000000000001,"15min":0.63600000000000001},"max":{"1min":1.524,"5min":1.5620000000000001,"15min":1.5620000000000001},"last":1.349}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1539999999999999}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4119999999999999}]},{"osd":10,"last update":"Thu Apr 18 14:45:22 2024","interfaces":[{"interface":"back","average":{"1min":1.022,"5min":1.1140000000000001,"15min":1.129},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.462,"5min":1.6919999999999999,"15min":1.6919999999999999},"last":1.2609999999999999},{"interface":"front","average":{"1min":1.089,"5min":1.105,"15min":1.1080000000000001},"min":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"max":{"1min":1.504,"5min":1.8899999999999999,"15min":1.8899999999999999},"last":1.2290000000000001}]},{"osd":11,"last update":"Thu Apr 18 14:45:22 2024","interfaces":[{"interface":"back","average":{"1min":1.0860000000000001,"5min":1.1679999999999999,"15min":1.1819999999999999},"min":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":1.6950000000000001,"5min":2.04,"15min":2.04},"last":1.54},{"interface":"front","average":{"1min":1.1000000000000001,"5min":1.1479999999999999,"15min":1.1559999999999999},"min":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":1.726,"5min":1.8660000000000001,"15min":1.8660000000000001},"last":1.518}]},{"osd":13,"last update":"Thu Apr 18 14:45:22 2024","interfaces":[{"interface":"back","average":{"1min":1.0880000000000001,"5min":1.1619999999999999,"15min":1.1739999999999999},"min":{"1min":0.64300000000000002,"5min":0.61699999999999999,"15min":0.61699999999999999},"max":{"1min":1.7030000000000001,"5min":1.8080000000000001,"15min":1.8080000000000001},"last":1.4490000000000001},{"interface":"front","average":{"1min":1.121,"5min":1.206,"15min":1.22},"min":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"max":{"1min":1.675,"5min":2.133,"15min":2.133},"last":1.3839999999999999}]},{"osd":14,"last update":"Thu Apr 18 14:45:22 2024","interfaces":[{"interface":"back","average":{"1min":1.1910000000000001,"5min":1.2190000000000001,"15min":1.2230000000000001},"min":{"1min":0.69099999999999995,"5min":0.64900000000000002,"15min":0.64900000000000002},"max":{"1min":1.7669999999999999,"5min":1.7669999999999999,"15min":1.7669999999999999},"last":1.498},{"interface":"front","average":{"1min":1.2430000000000001,"5min":1.234,"15min":1.232},"min":{"1min":0.79400000000000004,"5min":0.73099999999999998,"15min":0.73099999999999998},"max":{"1min":1.7470000000000001,"5min":1.966,"15min":1.966},"last":1.468}]},{"osd":15,"last update":"Thu Apr 18 14:45:22 2024","interfaces":[{"interface":"back","average":{"1min":1.167,"5min":1.208,"15min":1.2150000000000001},"min":{"1min":0.621,"5min":0.621,"15min":0.621},"max":{"1min":1.655,"5min":1.802,"15min":1.802},"last":1.5649999999999999},{"interface":"front","average":{"1min":1.24,"5min":1.2789999999999999,"15min":1.2849999999999999},"min":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"max":{"1min":1.794,"5min":1.8580000000000001,"15min":1.8580000000000001},"last":1.5860000000000001}]}]},{"osd":0,"up_from":23,"seq":98784247841,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33548,"kb_used_data":2432,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94338292,"statfs":{"total":96636764160,"available":96602411008,"internally_reserved":0,"allocated":2490368,"data_stored":1664019,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[1,4,6,7,8,10,11,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Apr 18 14:45:24 2024","interfaces":[{"interface":"back","average":{"1min":0.77600000000000002,"5min":0.80400000000000005,"15min":0.80800000000000005},"min":{"1min":0.55000000000000004,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":1.1699999999999999,"5min":1.218,"15min":1.218},"last":0.97299999999999998},{"interface":"front","average":{"1min":0.90400000000000003,"5min":0.91200000000000003,"15min":0.91300000000000003},"min":{"1min":0.57699999999999996,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.8120000000000001,"5min":1.8120000000000001,"15min":1.8120000000000001},"last":1.0569999999999999}]},{"osd":4,"last update":"Thu Apr 18 14:45:20 2024","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.66000000000000003,"15min":0.65000000000000002},"min":{"1min":0.27300000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":2.0249999999999999,"5min":2.0249999999999999,"15min":2.0249999999999999},"last":0.66400000000000003},{"interface":"front","average":{"1min":0.83799999999999997,"5min":0.79500000000000004,"15min":0.78800000000000003},"min":{"1min":0.34200000000000003,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":2.1320000000000001,"5min":2.1320000000000001,"15min":2.1320000000000001},"last":1.04}]},{"osd":6,"last update":"Thu Apr 18 14:45:20 2024","interfaces":[{"interface":"back","average":{"1min":0.93799999999999994,"5min":0.90900000000000003,"15min":0.90400000000000003},"min":{"1min":0.57999999999999996,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.667,"5min":2.5009999999999999,"15min":2.5009999999999999},"last":0.90900000000000003},{"interface":"front","average":{"1min":0.96099999999999997,"5min":0.90800000000000003,"15min":0.89900000000000002},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":2.2050000000000001,"5min":2.2050000000000001,"15min":2.2050000000000001},"last":0.997}]},{"osd":7,"last update":"Thu Apr 18 14:45:20 2024","interfaces":[{"interface":"back","average":{"1min":0.84499999999999997,"5min":0.79300000000000004,"15min":0.78500000000000003},"min":{"1min":0.54700000000000004,"5min":0.497,"15min":0.497},"max":{"1min":1.3260000000000001,"5min":1.3260000000000001,"15min":1.3260000000000001},"last":0.72299999999999998},{"interface":"front","average":{"1min":1.0449999999999999,"5min":0.95999999999999996,"15min":0.94599999999999995},"min":{"1min":0.66000000000000003,"5min":0.60799999999999998,"15min":0.60799999999999998},"max":{"1min":1.905,"5min":1.905,"15min":1.905},"last":0.77900000000000003}]},{"osd":8,"last update":"Thu Apr 18 14:45:20 2024","interfaces":[{"interface":"back","average":{"1min":0.91300000000000003,"5min":1.569,"15min":1.679},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":2.4359999999999999,"5min":18.015999999999998,"15min":18.015999999999998},"last":0.86799999999999999},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.79000000000000004,"15min":0.79400000000000004},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":1.75,"5min":1.75,"15min":1.75},"last":0.61899999999999999}]},{"osd":10,"last update":"Thu Apr 18 14:45:20 2024","interfaces":[{"interface":"back","average":{"1min":1.0960000000000001,"5min":1.0960000000000001,"15min":1.0960000000000001},"min":{"1min":0.749,"5min":0.69599999999999995,"15min":0.69599999999999995},"max":{"1min":2.2559999999999998,"5min":2.2559999999999998,"15min":2.2559999999999998},"last":1.0209999999999999},{"interface":"front","average":{"1min":1.1220000000000001,"5min":1.119,"15min":1.119},"min":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":2.3559999999999999,"5min":2.3559999999999999,"15min":2.3559999999999999},"last":1.22}]},{"osd":11,"last update":"Thu Apr 18 14:45:20 2024","interfaces":[{"interface":"back","average":{"1min":1.0189999999999999,"5min":2.6030000000000002,"15min":2.867},"min":{"1min":0.70899999999999996,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":1.845,"5min":41.195999999999998,"15min":41.195999999999998},"last":1.101},{"interface":"front","average":{"1min":1.1519999999999999,"5min":2.7370000000000001,"15min":3.0009999999999999},"min":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":2.0920000000000001,"5min":41.216999999999999,"15min":41.216999999999999},"last":1.1779999999999999}]},{"osd":13,"last update":"Thu Apr 18 14:45:24 2024","interfaces":[{"interface":"back","average":{"1min":1.0209999999999999,"5min":0.96499999999999997,"15min":0.95499999999999996},"min":{"1min":0.56499999999999995,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":1.966,"5min":1.966,"15min":1.966},"last":0.83999999999999997},{"interface":"front","average":{"1min":1.2370000000000001,"5min":1.1200000000000001,"15min":1.1000000000000001},"min":{"1min":0.72999999999999998,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":2.1749999999999998,"5min":2.1749999999999998,"15min":2.1749999999999998},"last":1.2}]},{"osd":14,"last update":"Thu Apr 18 14:45:20 2024","interfaces":[{"interface":"back","average":{"1min":1.1699999999999999,"5min":1.1160000000000001,"15min":1.107},"min":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"max":{"1min":2.399,"5min":2.399,"15min":2.399},"last":1.1240000000000001},{"interface":"front","average":{"1min":1.1319999999999999,"5min":1.1020000000000001,"15min":1.097},"min":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":2.0609999999999999,"5min":2.1219999999999999,"15min":2.1219999999999999},"last":0.93999999999999995}]},{"osd":15,"last update":"Thu Apr 18 14:45:20 2024","interfaces":[{"interface":"back","average":{"1min":1.296,"5min":1.238,"15min":1.228},"min":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"max":{"1min":2.3260000000000001,"5min":2.3260000000000001,"15min":2.3260000000000001},"last":1.1419999999999999},{"interface":"front","average":{"1min":1.2310000000000001,"5min":1.1890000000000001,"15min":1.1819999999999999},"min":{"1min":0.76800000000000002,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":2.2890000000000001,"5min":2.2890000000000001,"15min":2.2890000000000001},"last":1.2609999999999999}]}]},{"osd":3,"up_from":23,"seq":98784247840,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33036,"kb_used_data":1916,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94338804,"statfs":{"total":96636764160,"available":96602935296,"internally_reserved":0,"allocated":1961984,"data_stored":1135935,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31848904},"hb_peers":[0,2,4,5,8,9,10,11,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Apr 18 14:45:22 2024","interfaces":[{"interface":"back","average":{"1min":0.94499999999999995,"5min":0.89400000000000002,"15min":0.88600000000000001},"min":{"1min":0.64000000000000001,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":1.508,"5min":1.508,"15min":1.508},"last":0.88300000000000001},{"interface":"front","average":{"1min":0.95899999999999996,"5min":0.99099999999999999,"15min":0.997},"min":{"1min":0.75600000000000001,"5min":0.67100000000000004,"15min":0.67100000000000004},"max":{"1min":1.3899999999999999,"5min":1.4850000000000001,"15min":1.4850000000000001},"last":0.84999999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4590000000000001}]},{"osd":2,"last update":"Thu Apr 18 14:45:22 2024","interfaces":[{"interface":"back","average":{"1min":0.92900000000000005,"5min":0.97399999999999998,"15min":0.98199999999999998},"min":{"1min":0.70399999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.2829999999999999,"5min":1.5469999999999999,"15min":1.5469999999999999},"last":0.81599999999999995},{"interface":"front","average":{"1min":0.999,"5min":0.95899999999999996,"15min":0.95299999999999996},"min":{"1min":0.76800000000000002,"5min":0.623,"15min":0.623},"max":{"1min":1.4399999999999999,"5min":1.4399999999999999,"15min":1.4399999999999999},"last":0.66200000000000003}]},{"osd":4,"last update":"Thu Apr 18 14:45:22 2024","interfaces":[{"interface":"back","average":{"1min":0.92500000000000004,"5min":0.99099999999999999,"15min":1.002},"min":{"1min":0.69799999999999995,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.3140000000000001,"5min":1.7030000000000001,"15min":1.7030000000000001},"last":0.623},{"interface":"front","average":{"1min":0.98199999999999998,"5min":0.98599999999999999,"15min":0.98599999999999999},"min":{"1min":0.65000000000000002,"5min":0.495,"15min":0.495},"max":{"1min":1.3420000000000001,"5min":1.5309999999999999,"15min":1.5309999999999999},"last":1.0649999999999999}]},{"osd":5,"last update":"Thu Apr 18 14:45:22 2024","interfaces":[{"interface":"back","average":{"1min":1.1200000000000001,"5min":1.093,"15min":1.089},"min":{"1min":0.80900000000000005,"5min":0.624,"15min":0.624},"max":{"1min":1.341,"5min":1.663,"15min":1.663},"last":0.77600000000000002},{"interface":"front","average":{"1min":1.1759999999999999,"5min":1.2,"15min":1.204},"min":{"1min":0.84699999999999998,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":1.508,"5min":1.6779999999999999,"15min":1.6779999999999999},"last":0.998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.472}]},{"osd":7,"last update":"Thu Apr 18 14:44:20 2024","interfaces":[{"interface":"back","average":{"1min":1.157,"5min":1.157,"15min":1.157},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.645,"5min":1.645,"15min":1.645},"last":0.82199999999999995},{"interface":"front","average":{"1min":1.115,"5min":1.115,"15min":1.115},"min":{"1min":0.503,"5min":0.503,"15min":0.503},"max":{"1min":1.6419999999999999,"5min":1.6419999999999999,"15min":1.6419999999999999},"last":0.90800000000000003}]},{"osd":8,"last update":"Thu Apr 18 14:45:22 2024","interfaces":[{"interface":"back","average":{"1min":1.1499999999999999,"5min":1.137,"15min":1.135},"min":{"1min":0.81299999999999994,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.3819999999999999,"5min":1.7529999999999999,"15min":1.7529999999999999},"last":0.96199999999999997},{"interface":"front","average":{"1min":1.21,"5min":1.2849999999999999,"15min":1.2969999999999999},"min":{"1min":1.0589999999999999,"5min":0.81100000000000005,"15min":0.81100000000000005},"max":{"1min":1.399,"5min":1.7430000000000001,"15min":1.7430000000000001},"last":0.91100000000000003}]},{"osd":9,"last update":"Thu Apr 18 14:45:33 2024","interfaces":[{"interface":"back","average":{"1min":1.0920000000000001,"5min":1.258,"15min":1.286},"min":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"max":{"1min":1.4119999999999999,"5min":1.879,"15min":1.879},"last":1.1890000000000001},{"interface":"front","average":{"1min":1.2729999999999999,"5min":1.2569999999999999,"15min":1.2549999999999999},"min":{"1min":0.96199999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"max":{"1min":1.736,"5min":1.8260000000000001,"15min":1.8260000000000001},"last":1.1020000000000001}]},{"osd":10,"last update":"Thu Apr 18 14:45:22 2024","interfaces":[{"interface":"back","average":{"1min":1.2969999999999999,"5min":1.321,"15min":1.325},"min":{"1min":0.94599999999999995,"5min":0.70599999999999996,"15min":0.70599999999999996},"max":{"1min":1.742,"5min":1.883,"15min":1.883},"last":1.282},{"interface":"front","average":{"1min":1.409,"5min":1.3740000000000001,"15min":1.3680000000000001},"min":{"1min":1.1719999999999999,"5min":0.68000000000000005,"15min":0.68000000000000005},"max":{"1min":1.663,"5min":2.161,"15min":2.161},"last":1.03}]},{"osd":11,"last update":"Thu Apr 18 14:45:22 2024","interfaces":[{"interface":"back","average":{"1min":1.323,"5min":1.411,"15min":1.425},"min":{"1min":0.66100000000000003,"5min":0.61099999999999999,"15min":0.61099999999999999},"max":{"1min":1.569,"5min":1.8959999999999999,"15min":1.8959999999999999},"last":1.1339999999999999},{"interface":"front","average":{"1min":1.3100000000000001,"5min":1.3660000000000001,"15min":1.3759999999999999},"min":{"1min":0.70499999999999996,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":1.796,"5min":2.1160000000000001,"15min":2.1160000000000001},"last":1.335}]},{"osd":12,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.8740000000000001}]},{"osd":14,"last update":"Thu Apr 18 14:45:22 2024","interfaces":[{"interface":"back","average":{"1min":1.4370000000000001,"5min":1.4970000000000001,"15min":1.5069999999999999},"min":{"1min":1.1559999999999999,"5min":0.94999999999999996,"15min":0.94999999999999996},"max":{"1min":1.6990000000000001,"5min":2.2879999999999998,"15min":2.2879999999999998},"last":1.254},{"interface":"front","average":{"1min":1.478,"5min":1.4259999999999999,"15min":1.4179999999999999},"min":{"1min":1.331,"5min":0.76300000000000001,"15min":0.76300000000000001},"max":{"1min":1.7270000000000001,"5min":2.0179999999999998,"15min":2.0179999999999998},"last":1.218}]},{"osd":15,"last update":"Thu Apr 18 14:45:33 2024","interfaces":[{"interface":"back","average":{"1min":1.3680000000000001,"5min":1.452,"15min":1.466},"min":{"1min":0.95999999999999996,"5min":0.67500000000000004,"15min":0.67500000000000004},"max":{"1min":1.786,"5min":2.1120000000000001,"15min":2.1120000000000001},"last":1.3069999999999999},{"interface":"front","average":{"1min":1.3779999999999999,"5min":1.4370000000000001,"15min":1.4470000000000001},"min":{"1min":0.98599999999999999,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.6180000000000001,"5min":1.9299999999999999,"15min":1.9299999999999999},"last":1.3759999999999999}]}]},{"osd":7,"up_from":23,"seq":98784247842,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":33036,"kb_used_data":1912,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94338804,"statfs":{"total":96636764160,"available":96602935296,"internally_reserved":0,"allocated":1957888,"data_stored":1135091,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":31848907},"hb_peers":[0,2,3,4,5,6,8,10,12,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Apr 18 14:45:35 2024","interfaces":[{"interface":"back","average":{"1min":0.77400000000000002,"5min":0.78900000000000003,"15min":0.79100000000000004},"min":{"1min":0.57199999999999995,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":1.0920000000000001,"5min":1.109,"15min":1.109},"last":0.68700000000000006},{"interface":"front","average":{"1min":0.77700000000000002,"5min":0.85299999999999998,"15min":0.86599999999999999},"min":{"1min":0.51400000000000001,"5min":0.505,"15min":0.505},"max":{"1min":1.2070000000000001,"5min":1.7589999999999999,"15min":1.7589999999999999},"last":0.83199999999999996}]},{"osd":2,"last update":"Thu Apr 18 14:45:23 2024","interfaces":[{"interface":"back","average":{"1min":0.875,"5min":0.86699999999999999,"15min":0.86599999999999999},"min":{"1min":0.624,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":1.2450000000000001,"5min":1.2450000000000001,"15min":1.2450000000000001},"last":0.78500000000000003},{"interface":"front","average":{"1min":0.97299999999999998,"5min":0.97499999999999998,"15min":0.97499999999999998},"min":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"max":{"1min":1.256,"5min":1.891,"15min":1.891},"last":1.0800000000000001}]},{"osd":3,"last update":"Thu Apr 18 14:45:35 2024","interfaces":[{"interface":"back","average":{"1min":0.76800000000000002,"5min":0.85899999999999999,"15min":0.874},"min":{"1min":0.502,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.0820000000000001,"5min":1.5920000000000001,"15min":1.5920000000000001},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.85499999999999998,"5min":0.83899999999999997,"15min":0.83699999999999997},"min":{"1min":0.623,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":1.212,"5min":1.2330000000000001,"15min":1.2330000000000001},"last":0.93899999999999995}]},{"osd":4,"last update":"Thu Apr 18 14:45:23 2024","interfaces":[{"interface":"back","average":{"1min":1.018,"5min":0.96899999999999997,"15min":0.96099999999999997},"min":{"1min":0.67300000000000004,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.3240000000000001,"5min":1.3240000000000001,"15min":1.3240000000000001},"last":1.2589999999999999},{"interface":"front","average":{"1min":0.91700000000000004,"5min":0.85799999999999998,"15min":0.84799999999999998},"min":{"1min":0.54400000000000004,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":1.298,"5min":1.298,"15min":1.298},"last":1.042}]},{"osd":5,"last update":"Thu Apr 18 14:45:26 2024","interfaces":[{"interface":"back","average":{"1min":1.0589999999999999,"5min":1.103,"15min":1.1100000000000001},"min":{"1min":0.78300000000000003,"5min":0.58199999999999996,"15min":0.58199999999999996},"max":{"1min":1.2729999999999999,"5min":1.8580000000000001,"15min":1.8580000000000001},"last":1.1279999999999999},{"interface":"front","average":{"1min":1.1020000000000001,"5min":1.1100000000000001,"15min":1.111},"min":{"1min":0.86599999999999999,"5min":0.72499999999999998,"15min":0.72499999999999998},"max":{"1min":1.5349999999999999,"5min":1.5349999999999999,"15min":1.5349999999999999},"last":1.1950000000000001}]},{"osd":6,"last update":"Thu Apr 18 14:45:23 2024","interfaces":[{"interface":"back","average":{"1min":1.095,"5min":1.1299999999999999,"15min":1.1359999999999999},"min":{"1min":0.79500000000000004,"5min":0.60099999999999998,"15min":0.60099999999999998},"max":{"1min":1.367,"5min":1.8759999999999999,"15min":1.8759999999999999},"last":1.0089999999999999},{"interface":"front","average":{"1min":1.1759999999999999,"5min":1.1719999999999999,"15min":1.171},"min":{"1min":0.69099999999999995,"5min":0.67400000000000004,"15min":0.67400000000000004},"max":{"1min":1.6499999999999999,"5min":1.6499999999999999,"15min":1.6499999999999999},"last":0.90600000000000003}]},{"osd":8,"last update":"Thu Apr 18 14:45:23 2024","interfaces":[{"interface":"back","average":{"1min":1.0189999999999999,"5min":1.079,"15min":1.089},"min":{"1min":0.622,"5min":0.44,"15min":0.44},"max":{"1min":1.349,"5min":1.4159999999999999,"15min":1.4159999999999999},"last":1.2909999999999999},{"interface":"front","average":{"1min":1.141,"5min":1.2470000000000001,"15min":1.2649999999999999},"min":{"1min":0.69699999999999995,"5min":0.64400000000000002,"15min":0.64400000000000002},"max":{"1min":1.456,"5min":1.821,"15min":1.821},"last":1.163}]},{"osd":10,"last update":"Thu Apr 18 14:45:23 2024","interfaces":[{"interface":"back","average":{"1min":1.1319999999999999,"5min":1.147,"15min":1.149},"min":{"1min":0.82799999999999996,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.454,"5min":1.831,"15min":1.831},"last":1.103},{"interface":"front","average":{"1min":1.274,"5min":1.2769999999999999,"15min":1.2769999999999999},"min":{"1min":0.996,"5min":0.82999999999999996,"15min":0.82999999999999996},"max":{"1min":1.768,"5min":1.768,"15min":1.768},"last":0.97699999999999998}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71699999999999997}]},{"osd":12,"last update":"Thu Apr 18 14:45:23 2024","interfaces":[{"interface":"back","average":{"1min":1.2110000000000001,"5min":1.2230000000000001,"15min":1.2250000000000001},"min":{"1min":0.73099999999999998,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.613,"5min":1.7549999999999999,"15min":1.7549999999999999},"last":1.3520000000000001},{"interface":"front","average":{"1min":1.2390000000000001,"5min":1.371,"15min":1.393},"min":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"max":{"1min":1.593,"5min":2.0960000000000001,"15min":2.0960000000000001},"last":1.3720000000000001}]},{"osd":14,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3819999999999999}]},{"osd":15,"last update":"Thu Apr 18 14:45:23 2024","interfaces":[{"interface":"back","average":{"1min":1.304,"5min":1.407,"15min":1.4239999999999999},"min":{"1min":1.103,"5min":0.874,"15min":0.874},"max":{"1min":1.496,"5min":2.6699999999999999,"15min":2.6699999999999999},"last":1.232},{"interface":"front","average":{"1min":1.3600000000000001,"5min":1.3919999999999999,"15min":1.3979999999999999},"min":{"1min":1.1399999999999999,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":1.7130000000000001,"5min":2.516,"15min":2.516},"last":1.327}]}]},{"osd":8,"up_from":23,"seq":98784247842,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33036,"kb_used_data":1912,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94338804,"statfs":{"total":96636764160,"available":96602935296,"internally_reserved":0,"allocated":1957888,"data_stored":1135091,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[1,2,3,4,5,7,9,11,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Apr 18 14:44:32 2024","interfaces":[{"interface":"back","average":{"1min":0.746,"5min":0.746,"15min":0.746},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":1.7290000000000001,"5min":1.7290000000000001,"15min":1.7290000000000001},"last":2.4540000000000002},{"interface":"front","average":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":2.48,"5min":2.48,"15min":2.48},"last":2.1669999999999998}]},{"osd":1,"last update":"Thu Apr 18 14:45:14 2024","interfaces":[{"interface":"back","average":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":0.83999999999999997},"min":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":1.2609999999999999,"5min":1.2609999999999999,"15min":1.2609999999999999},"last":0.95699999999999996},{"interface":"front","average":{"1min":0.85799999999999998,"5min":0.85799999999999998,"15min":0.85799999999999998},"min":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"max":{"1min":1.2230000000000001,"5min":1.2230000000000001,"15min":1.2230000000000001},"last":0.69899999999999995}]},{"osd":2,"last update":"Thu Apr 18 14:45:23 2024","interfaces":[{"interface":"back","average":{"1min":0.95299999999999996,"5min":0.84599999999999997,"15min":0.82799999999999996},"min":{"1min":0.52900000000000003,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":1.407,"5min":1.407,"15min":1.407},"last":0.88200000000000001},{"interface":"front","average":{"1min":0.92500000000000004,"5min":0.98099999999999998,"15min":0.99099999999999999},"min":{"1min":0.50700000000000001,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":1.4770000000000001,"5min":2.54,"15min":2.54},"last":0.73299999999999998}]},{"osd":3,"last update":"Thu Apr 18 14:45:32 2024","interfaces":[{"interface":"back","average":{"1min":0.96399999999999997,"5min":0.90300000000000002,"15min":0.89300000000000002},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":1.4870000000000001,"5min":1.4870000000000001,"15min":1.4870000000000001},"last":0.998},{"interface":"front","average":{"1min":0.97299999999999998,"5min":1.0109999999999999,"15min":1.0169999999999999},"min":{"1min":0.53700000000000003,"5min":0.439,"15min":0.439},"max":{"1min":1.544,"5min":2.6779999999999999,"15min":2.6779999999999999},"last":0.92800000000000005}]},{"osd":4,"last update":"Thu Apr 18 14:45:28 2024","interfaces":[{"interface":"back","average":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":1.411,"5min":1.411,"15min":1.411},"last":0.56899999999999995},{"interface":"front","average":{"1min":0.873,"5min":0.873,"15min":0.873},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":1.8999999999999999,"5min":1.8999999999999999,"15min":1.8999999999999999},"last":0.65800000000000003}]},{"osd":5,"last update":"Thu Apr 18 14:45:23 2024","interfaces":[{"interface":"back","average":{"1min":1.073,"5min":1.0580000000000001,"15min":1.056},"min":{"1min":0.56599999999999995,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.629,"5min":2.7810000000000001,"15min":2.7810000000000001},"last":1.129},{"interface":"front","average":{"1min":0.96299999999999997,"5min":0.92700000000000005,"15min":0.92100000000000004},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":1.302,"5min":1.5309999999999999,"15min":1.5309999999999999},"last":0.75600000000000001}]},{"osd":7,"last update":"Thu Apr 18 14:45:23 2024","interfaces":[{"interface":"back","average":{"1min":1.0960000000000001,"5min":1.052,"15min":1.0449999999999999},"min":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":1.421,"5min":1.925,"15min":1.925},"last":1.0620000000000001},{"interface":"front","average":{"1min":1.163,"5min":1.0960000000000001,"15min":1.085},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.881,"5min":1.881,"15min":1.881},"last":1.3220000000000001}]},{"osd":9,"last update":"Thu Apr 18 14:45:23 2024","interfaces":[{"interface":"back","average":{"1min":1.1599999999999999,"5min":1.052,"15min":1.034},"min":{"1min":0.5,"5min":0.498,"15min":0.498},"max":{"1min":2.0489999999999999,"5min":2.0489999999999999,"15min":2.0489999999999999},"last":1.2809999999999999},{"interface":"front","average":{"1min":1.1990000000000001,"5min":1.1699999999999999,"15min":1.165},"min":{"1min":0.53800000000000003,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":2.2149999999999999,"5min":2.9319999999999999,"15min":2.9319999999999999},"last":1.0329999999999999}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.665}]},{"osd":11,"last update":"Thu Apr 18 14:45:23 2024","interfaces":[{"interface":"back","average":{"1min":1.1539999999999999,"5min":1.1950000000000001,"15min":1.202},"min":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":1.6739999999999999,"5min":2.1139999999999999,"15min":2.1139999999999999},"last":1.1850000000000001},{"interface":"front","average":{"1min":1.2829999999999999,"5min":1.2909999999999999,"15min":1.292},"min":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"max":{"1min":1.8100000000000001,"5min":2.25,"15min":2.25},"last":1.2350000000000001}]},{"osd":12,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5629999999999999}]},{"osd":14,"last update":"Thu Apr 18 14:45:23 2024","interfaces":[{"interface":"back","average":{"1min":1.3109999999999999,"5min":1.335,"15min":1.339},"min":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":2.1240000000000001,"5min":2.5800000000000001,"15min":2.5800000000000001},"last":1.101},{"interface":"front","average":{"1min":1.2549999999999999,"5min":1.3640000000000001,"15min":1.3819999999999999},"min":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":2.3969999999999998,"5min":3.0739999999999998,"15min":3.0739999999999998},"last":1.2110000000000001}]},{"osd":15,"last update":"Thu Apr 18 14:45:23 2024","interfaces":[{"interface":"back","average":{"1min":1.3600000000000001,"5min":1.3560000000000001,"15min":1.355},"min":{"1min":0.72799999999999998,"5min":0.67100000000000004,"15min":0.67100000000000004},"max":{"1min":2.1880000000000002,"5min":2.4740000000000002,"15min":2.4740000000000002},"last":1.3819999999999999},{"interface":"front","average":{"1min":1.298,"5min":1.3919999999999999,"15min":1.4079999999999999},"min":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.68700000000000006},"max":{"1min":2.3250000000000002,"5min":2.8620000000000001,"15min":2.8620000000000001},"last":1.2549999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":13,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":12,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":13,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":14,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":15,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-18T14:45:41.907 DEBUG:teuthology.orchestra.run.smithi086:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-04-18T14:45:42.222 INFO:teuthology.misc:Shutting down mds daemons... 2024-04-18T14:45:42.222 INFO:teuthology.misc:Shutting down osd daemons... 2024-04-18T14:45:42.223 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-04-18T14:45:42.223 INFO:teuthology.orchestra.run:waiting for 300 2024-04-18T14:45:42.314 INFO:tasks.ceph.osd.0:Stopped 2024-04-18T14:45:42.315 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2024-04-18T14:45:42.315 INFO:teuthology.orchestra.run:waiting for 300 2024-04-18T14:45:42.398 INFO:tasks.ceph.osd.4:Stopped 2024-04-18T14:45:42.398 DEBUG:tasks.ceph.osd.8:waiting for process to exit 2024-04-18T14:45:42.398 INFO:teuthology.orchestra.run:waiting for 300 2024-04-18T14:45:42.472 INFO:tasks.ceph.osd.8:Stopped 2024-04-18T14:45:42.473 DEBUG:tasks.ceph.osd.12:waiting for process to exit 2024-04-18T14:45:42.473 INFO:teuthology.orchestra.run:waiting for 300 2024-04-18T14:45:46.758 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.12 is failed for ~0s 2024-04-18T14:45:48.575 INFO:tasks.ceph.osd.12:Stopped 2024-04-18T14:45:48.576 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-04-18T14:45:48.576 INFO:teuthology.orchestra.run:waiting for 300 2024-04-18T14:45:48.666 INFO:tasks.ceph.osd.1:Stopped 2024-04-18T14:45:48.666 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2024-04-18T14:45:48.667 INFO:teuthology.orchestra.run:waiting for 300 2024-04-18T14:45:48.748 INFO:tasks.ceph.osd.5:Stopped 2024-04-18T14:45:48.748 DEBUG:tasks.ceph.osd.9:waiting for process to exit 2024-04-18T14:45:48.748 INFO:teuthology.orchestra.run:waiting for 300 2024-04-18T14:45:53.173 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.9 is failed for ~0s 2024-04-18T14:45:53.174 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.12 has been restored 2024-04-18T14:45:54.850 INFO:tasks.ceph.osd.9:Stopped 2024-04-18T14:45:54.850 DEBUG:tasks.ceph.osd.13:waiting for process to exit 2024-04-18T14:45:54.850 INFO:teuthology.orchestra.run:waiting for 300 2024-04-18T14:45:54.919 INFO:tasks.ceph.osd.13:Stopped 2024-04-18T14:45:54.919 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-04-18T14:45:54.919 INFO:teuthology.orchestra.run:waiting for 300 2024-04-18T14:45:55.000 INFO:tasks.ceph.osd.2:Stopped 2024-04-18T14:45:55.000 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2024-04-18T14:45:55.000 INFO:teuthology.orchestra.run:waiting for 300 2024-04-18T14:45:55.089 INFO:tasks.ceph.osd.6:Stopped 2024-04-18T14:45:55.090 DEBUG:tasks.ceph.osd.10:waiting for process to exit 2024-04-18T14:45:55.090 INFO:teuthology.orchestra.run:waiting for 300 2024-04-18T14:45:55.179 INFO:tasks.ceph.osd.10:Stopped 2024-04-18T14:45:55.179 DEBUG:tasks.ceph.osd.14:waiting for process to exit 2024-04-18T14:45:55.179 INFO:teuthology.orchestra.run:waiting for 300 2024-04-18T14:45:55.265 INFO:tasks.ceph.osd.14:Stopped 2024-04-18T14:45:55.266 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2024-04-18T14:45:55.266 INFO:teuthology.orchestra.run:waiting for 300 2024-04-18T14:45:55.360 INFO:tasks.ceph.osd.3:Stopped 2024-04-18T14:45:55.360 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2024-04-18T14:45:55.360 INFO:teuthology.orchestra.run:waiting for 300 2024-04-18T14:45:55.456 INFO:tasks.ceph.osd.7:Stopped 2024-04-18T14:45:55.456 DEBUG:tasks.ceph.osd.11:waiting for process to exit 2024-04-18T14:45:55.456 INFO:teuthology.orchestra.run:waiting for 300 2024-04-18T14:45:58.778 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.11 is failed for ~0s 2024-04-18T14:45:58.778 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.9 has been restored 2024-04-18T14:46:01.558 INFO:tasks.ceph.osd.11:Stopped 2024-04-18T14:46:01.558 DEBUG:tasks.ceph.osd.15:waiting for process to exit 2024-04-18T14:46:01.559 INFO:teuthology.orchestra.run:waiting for 300 2024-04-18T14:46:01.637 INFO:tasks.ceph.osd.15:Stopped 2024-04-18T14:46:01.637 INFO:teuthology.misc:Shutting down mgr daemons... 2024-04-18T14:46:01.637 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2024-04-18T14:46:01.637 INFO:teuthology.orchestra.run:waiting for 300 2024-04-18T14:46:01.664 INFO:tasks.ceph.mgr.y:Stopped 2024-04-18T14:46:01.665 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-04-18T14:46:01.665 INFO:teuthology.orchestra.run:waiting for 300 2024-04-18T14:46:01.696 INFO:tasks.ceph.mgr.x:Stopped 2024-04-18T14:46:01.696 INFO:teuthology.misc:Shutting down mon daemons... 2024-04-18T14:46:01.696 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-04-18T14:46:01.696 INFO:teuthology.orchestra.run:waiting for 300 2024-04-18T14:46:01.730 INFO:tasks.ceph.mon.a:Stopped 2024-04-18T14:46:01.730 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-04-18T14:46:01.730 INFO:teuthology.orchestra.run:waiting for 300 2024-04-18T14:46:01.751 INFO:tasks.ceph.mon.b:Stopped 2024-04-18T14:46:01.751 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2024-04-18T14:46:01.751 INFO:teuthology.orchestra.run:waiting for 300 2024-04-18T14:46:01.776 INFO:tasks.ceph.mon.c:Stopped 2024-04-18T14:46:01.776 INFO:tasks.ceph:Checking cluster log for badness... 2024-04-18T14:46:01.776 DEBUG:teuthology.orchestra.run.smithi086:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(OSD_SLOW_PING_TIME' | egrep -v 'but it is still running' | egrep -v 'objects unfound and apparently lost' | egrep -v 'slow request' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSDMAP_FLAGS\)' | egrep -v '\(OSD_' | egrep -v '\(PG_' | egrep -v '\(POOL_' | egrep -v '\(CACHE_POOL_' | egrep -v '\(SMALLER_PGP_NUM\)' | egrep -v '\(OBJECT_' | egrep -v '\(SLOW_OPS\)' | egrep -v '\(REQUEST_SLOW\)' | egrep -v '\(TOO_FEW_PGS\)' | egrep -v 'slow request' | egrep -v 'timeout on replica' | egrep -v 'late reservation from' | head -n 1 2024-04-18T14:46:01.794 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi086.front.sepia.ceph.com 2024-04-18T14:46:01.795 DEBUG:teuthology.orchestra.run.smithi086:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-04-18T14:46:02.061 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi086.front.sepia.ceph.com 2024-04-18T14:46:02.061 DEBUG:teuthology.orchestra.run.smithi086:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2024-04-18T14:46:02.267 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-8 on ubuntu@smithi086.front.sepia.ceph.com 2024-04-18T14:46:02.267 DEBUG:teuthology.orchestra.run.smithi086:> sync && sudo umount -f /var/lib/ceph/osd/ceph-8 2024-04-18T14:46:02.456 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-12 on ubuntu@smithi086.front.sepia.ceph.com 2024-04-18T14:46:02.456 DEBUG:teuthology.orchestra.run.smithi086:> sync && sudo umount -f /var/lib/ceph/osd/ceph-12 2024-04-18T14:46:02.648 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi096.front.sepia.ceph.com 2024-04-18T14:46:02.649 DEBUG:teuthology.orchestra.run.smithi096:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-04-18T14:46:02.914 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi096.front.sepia.ceph.com 2024-04-18T14:46:02.914 DEBUG:teuthology.orchestra.run.smithi096:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2024-04-18T14:46:03.084 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-9 on ubuntu@smithi096.front.sepia.ceph.com 2024-04-18T14:46:03.084 DEBUG:teuthology.orchestra.run.smithi096:> sync && sudo umount -f /var/lib/ceph/osd/ceph-9 2024-04-18T14:46:03.183 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-13 on ubuntu@smithi096.front.sepia.ceph.com 2024-04-18T14:46:03.183 DEBUG:teuthology.orchestra.run.smithi096:> sync && sudo umount -f /var/lib/ceph/osd/ceph-13 2024-04-18T14:46:03.309 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi119.front.sepia.ceph.com 2024-04-18T14:46:03.309 DEBUG:teuthology.orchestra.run.smithi119:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-04-18T14:46:03.576 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi119.front.sepia.ceph.com 2024-04-18T14:46:03.576 DEBUG:teuthology.orchestra.run.smithi119:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2024-04-18T14:46:03.776 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-10 on ubuntu@smithi119.front.sepia.ceph.com 2024-04-18T14:46:03.776 DEBUG:teuthology.orchestra.run.smithi119:> sync && sudo umount -f /var/lib/ceph/osd/ceph-10 2024-04-18T14:46:03.778 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.11 has been restored 2024-04-18T14:46:03.935 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-14 on ubuntu@smithi119.front.sepia.ceph.com 2024-04-18T14:46:03.935 DEBUG:teuthology.orchestra.run.smithi119:> sync && sudo umount -f /var/lib/ceph/osd/ceph-14 2024-04-18T14:46:04.086 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi134.front.sepia.ceph.com 2024-04-18T14:46:04.086 DEBUG:teuthology.orchestra.run.smithi134:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2024-04-18T14:46:04.360 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi134.front.sepia.ceph.com 2024-04-18T14:46:04.360 DEBUG:teuthology.orchestra.run.smithi134:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2024-04-18T14:46:04.549 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-11 on ubuntu@smithi134.front.sepia.ceph.com 2024-04-18T14:46:04.549 DEBUG:teuthology.orchestra.run.smithi134:> sync && sudo umount -f /var/lib/ceph/osd/ceph-11 2024-04-18T14:46:04.722 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-15 on ubuntu@smithi134.front.sepia.ceph.com 2024-04-18T14:46:04.723 DEBUG:teuthology.orchestra.run.smithi134:> sync && sudo umount -f /var/lib/ceph/osd/ceph-15 2024-04-18T14:46:04.895 INFO:tasks.ceph:Archiving mon data... 2024-04-18T14:46:04.896 DEBUG:teuthology.misc:Transferring archived files from smithi086:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/yuriw-2024-04-18_14:15:21-rados-wip-yuri2-testing-2024-04-17-0823-reef-distro-default-smithi/7662103/data/mon.a.tgz 2024-04-18T14:46:04.897 DEBUG:teuthology.orchestra.run.smithi086:> mktemp 2024-04-18T14:46:04.903 INFO:teuthology.orchestra.run.smithi086.stdout:/tmp/tmp.2YXB4dJmez 2024-04-18T14:46:04.903 DEBUG:teuthology.orchestra.run.smithi086:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.2YXB4dJmez 2024-04-18T14:46:05.045 DEBUG:teuthology.orchestra.run.smithi086:> sudo chmod 0666 /tmp/tmp.2YXB4dJmez 2024-04-18T14:46:05.104 DEBUG:teuthology.orchestra.remote:smithi086:/tmp/tmp.2YXB4dJmez is 408KB 2024-04-18T14:46:05.163 DEBUG:teuthology.orchestra.run.smithi086:> rm -fr /tmp/tmp.2YXB4dJmez 2024-04-18T14:46:05.168 DEBUG:teuthology.misc:Transferring archived files from smithi096:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/yuriw-2024-04-18_14:15:21-rados-wip-yuri2-testing-2024-04-17-0823-reef-distro-default-smithi/7662103/data/mon.b.tgz 2024-04-18T14:46:05.168 DEBUG:teuthology.orchestra.run.smithi096:> mktemp 2024-04-18T14:46:05.174 INFO:teuthology.orchestra.run.smithi096.stdout:/tmp/tmp.TH9ASaTrJt 2024-04-18T14:46:05.174 DEBUG:teuthology.orchestra.run.smithi096:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.TH9ASaTrJt 2024-04-18T14:46:05.359 DEBUG:teuthology.orchestra.run.smithi096:> sudo chmod 0666 /tmp/tmp.TH9ASaTrJt 2024-04-18T14:46:05.422 DEBUG:teuthology.orchestra.remote:smithi096:/tmp/tmp.TH9ASaTrJt is 569KB 2024-04-18T14:46:05.487 DEBUG:teuthology.orchestra.run.smithi096:> rm -fr /tmp/tmp.TH9ASaTrJt 2024-04-18T14:46:05.493 DEBUG:teuthology.misc:Transferring archived files from smithi119:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/yuriw-2024-04-18_14:15:21-rados-wip-yuri2-testing-2024-04-17-0823-reef-distro-default-smithi/7662103/data/mon.c.tgz 2024-04-18T14:46:05.493 DEBUG:teuthology.orchestra.run.smithi119:> mktemp 2024-04-18T14:46:05.499 INFO:teuthology.orchestra.run.smithi119.stdout:/tmp/tmp.KzfwUHwLt6 2024-04-18T14:46:05.499 DEBUG:teuthology.orchestra.run.smithi119:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.KzfwUHwLt6 2024-04-18T14:46:05.675 DEBUG:teuthology.orchestra.run.smithi119:> sudo chmod 0666 /tmp/tmp.KzfwUHwLt6 2024-04-18T14:46:05.735 DEBUG:teuthology.orchestra.remote:smithi119:/tmp/tmp.KzfwUHwLt6 is 568KB 2024-04-18T14:46:05.799 DEBUG:teuthology.orchestra.run.smithi119:> rm -fr /tmp/tmp.KzfwUHwLt6 2024-04-18T14:46:05.804 INFO:tasks.ceph:Cleaning ceph cluster... 2024-04-18T14:46:05.805 DEBUG:teuthology.orchestra.run.smithi086:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-04-18T14:46:05.807 DEBUG:teuthology.orchestra.run.smithi096:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-04-18T14:46:05.809 DEBUG:teuthology.orchestra.run.smithi119:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-04-18T14:46:05.850 DEBUG:teuthology.orchestra.run.smithi134:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-04-18T14:46:05.864 INFO:tasks.ceph:Checking for errors in any valgrind logs... 2024-04-18T14:46:05.864 DEBUG:teuthology.orchestra.run.smithi086:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2024-04-18T14:46:05.866 DEBUG:teuthology.orchestra.run.smithi096:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2024-04-18T14:46:05.869 DEBUG:teuthology.orchestra.run.smithi119:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2024-04-18T14:46:05.889 INFO:teuthology.orchestra.run.smithi086.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2024-04-18T14:46:05.892 INFO:teuthology.orchestra.run.smithi096.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2024-04-18T14:46:05.906 DEBUG:teuthology.orchestra.run.smithi134:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2024-04-18T14:46:05.927 INFO:teuthology.orchestra.run.smithi119.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2024-04-18T14:46:05.938 INFO:teuthology.orchestra.run.smithi134.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2024-04-18T14:46:05.943 INFO:tasks.ceph:Archiving crash dumps... 2024-04-18T14:46:05.944 DEBUG:teuthology.misc:Transferring archived files from smithi086:/var/lib/ceph/crash to /home/teuthworker/archive/yuriw-2024-04-18_14:15:21-rados-wip-yuri2-testing-2024-04-17-0823-reef-distro-default-smithi/7662103/remote/smithi086/crash 2024-04-18T14:46:05.945 DEBUG:teuthology.orchestra.run.smithi086:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-04-18T14:46:05.958 DEBUG:teuthology.misc:Transferring archived files from smithi096:/var/lib/ceph/crash to /home/teuthworker/archive/yuriw-2024-04-18_14:15:21-rados-wip-yuri2-testing-2024-04-17-0823-reef-distro-default-smithi/7662103/remote/smithi096/crash 2024-04-18T14:46:05.959 DEBUG:teuthology.orchestra.run.smithi096:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-04-18T14:46:05.970 DEBUG:teuthology.misc:Transferring archived files from smithi119:/var/lib/ceph/crash to /home/teuthworker/archive/yuriw-2024-04-18_14:15:21-rados-wip-yuri2-testing-2024-04-17-0823-reef-distro-default-smithi/7662103/remote/smithi119/crash 2024-04-18T14:46:05.971 DEBUG:teuthology.orchestra.run.smithi119:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-04-18T14:46:05.982 DEBUG:teuthology.misc:Transferring archived files from smithi134:/var/lib/ceph/crash to /home/teuthworker/archive/yuriw-2024-04-18_14:15:21-rados-wip-yuri2-testing-2024-04-17-0823-reef-distro-default-smithi/7662103/remote/smithi134/crash 2024-04-18T14:46:05.983 DEBUG:teuthology.orchestra.run.smithi134:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-04-18T14:46:05.993 INFO:tasks.ceph:Compressing logs... 2024-04-18T14:46:05.993 DEBUG:teuthology.orchestra.run.smithi086:> sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-04-18T14:46:06.002 DEBUG:teuthology.orchestra.run.smithi096:> sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-04-18T14:46:06.015 DEBUG:teuthology.orchestra.run.smithi119:> sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-04-18T14:46:06.029 DEBUG:teuthology.orchestra.run.smithi134:> sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-04-18T14:46:09.976 INFO:tasks.ceph:Archiving logs... 2024-04-18T14:46:09.976 DEBUG:teuthology.misc:Transferring archived files from smithi086:/var/log/ceph to /home/teuthworker/archive/yuriw-2024-04-18_14:15:21-rados-wip-yuri2-testing-2024-04-17-0823-reef-distro-default-smithi/7662103/remote/smithi086/log 2024-04-18T14:46:09.977 DEBUG:teuthology.orchestra.run.smithi086:> sudo tar c -f - -C /var/log/ceph -- . 2024-04-18T14:46:10.546 DEBUG:teuthology.misc:Transferring archived files from smithi096:/var/log/ceph to /home/teuthworker/archive/yuriw-2024-04-18_14:15:21-rados-wip-yuri2-testing-2024-04-17-0823-reef-distro-default-smithi/7662103/remote/smithi096/log 2024-04-18T14:46:10.547 DEBUG:teuthology.orchestra.run.smithi096:> sudo tar c -f - -C /var/log/ceph -- . 2024-04-18T14:46:10.956 DEBUG:teuthology.misc:Transferring archived files from smithi119:/var/log/ceph to /home/teuthworker/archive/yuriw-2024-04-18_14:15:21-rados-wip-yuri2-testing-2024-04-17-0823-reef-distro-default-smithi/7662103/remote/smithi119/log 2024-04-18T14:46:10.957 DEBUG:teuthology.orchestra.run.smithi119:> sudo tar c -f - -C /var/log/ceph -- . 2024-04-18T14:46:11.260 DEBUG:teuthology.misc:Transferring archived files from smithi134:/var/log/ceph to /home/teuthworker/archive/yuriw-2024-04-18_14:15:21-rados-wip-yuri2-testing-2024-04-17-0823-reef-distro-default-smithi/7662103/remote/smithi134/log 2024-04-18T14:46:11.261 DEBUG:teuthology.orchestra.run.smithi134:> sudo tar c -f - -C /var/log/ceph -- . 2024-04-18T14:46:11.640 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-04-18T14:46:11.648 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-04-18T14:46:11.649 DEBUG:teuthology.orchestra.run.smithi086:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-04-18T14:46:11.651 DEBUG:teuthology.orchestra.run.smithi096:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-04-18T14:46:11.654 DEBUG:teuthology.orchestra.run.smithi119:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-04-18T14:46:11.656 DEBUG:teuthology.orchestra.run.smithi134:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-04-18T14:46:11.775 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-04-18T14:46:11.879 INFO:teuthology.task.clock:Checking final clock skew... 2024-04-18T14:46:11.880 DEBUG:teuthology.orchestra.run.smithi086:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-18T14:46:11.882 DEBUG:teuthology.orchestra.run.smithi096:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-18T14:46:11.884 DEBUG:teuthology.orchestra.run.smithi119:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-18T14:46:11.887 DEBUG:teuthology.orchestra.run.smithi134:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-18T14:46:11.893 INFO:teuthology.orchestra.run.smithi086.stdout: remote refid st t when poll reach delay offset jitter 2024-04-18T14:46:11.893 INFO:teuthology.orchestra.run.smithi086.stdout:============================================================================== 2024-04-18T14:46:11.893 INFO:teuthology.orchestra.run.smithi086.stdout:+hv01.front.sepi 67.205.162.81 3 u 2 64 177 0.069 -2.543 4.512 2024-04-18T14:46:11.893 INFO:teuthology.orchestra.run.smithi086.stdout:*hv02.front.sepi 63.231.80.2 3 u 67 64 77 0.134 +2.685 3.013 2024-04-18T14:46:11.893 INFO:teuthology.orchestra.run.smithi086.stdout:+hv03.front.sepi 74.6.168.72 3 u 64 64 77 0.092 +2.421 2.821 2024-04-18T14:46:11.893 INFO:teuthology.orchestra.run.smithi086.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-18T14:46:11.894 INFO:teuthology.orchestra.run.smithi096.stdout: remote refid st t when poll reach delay offset jitter 2024-04-18T14:46:11.895 INFO:teuthology.orchestra.run.smithi096.stdout:============================================================================== 2024-04-18T14:46:11.895 INFO:teuthology.orchestra.run.smithi096.stdout:*hv01.front.sepi 67.205.162.81 3 u 2 64 177 0.212 -5.429 2.372 2024-04-18T14:46:11.895 INFO:teuthology.orchestra.run.smithi096.stdout:+hv02.front.sepi 63.231.80.2 3 u 62 64 77 0.121 +1.788 2.429 2024-04-18T14:46:11.895 INFO:teuthology.orchestra.run.smithi096.stdout:+hv03.front.sepi 74.6.168.72 3 u 66 64 77 0.117 +1.829 2.864 2024-04-18T14:46:11.895 INFO:teuthology.orchestra.run.smithi096.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-18T14:46:11.899 INFO:teuthology.orchestra.run.smithi119.stdout: remote refid st t when poll reach delay offset jitter 2024-04-18T14:46:11.899 INFO:teuthology.orchestra.run.smithi119.stdout:============================================================================== 2024-04-18T14:46:11.899 INFO:teuthology.orchestra.run.smithi119.stdout:+hv01.front.sepi 67.205.162.81 3 u 66 64 77 0.076 -7.526 4.342 2024-04-18T14:46:11.899 INFO:teuthology.orchestra.run.smithi119.stdout:*hv02.front.sepi 63.231.80.2 3 u 3 64 177 0.096 -1.525 4.882 2024-04-18T14:46:11.899 INFO:teuthology.orchestra.run.smithi119.stdout:+hv03.front.sepi 74.6.168.72 3 u 3 64 177 0.090 +5.015 4.926 2024-04-18T14:46:11.899 INFO:teuthology.orchestra.run.smithi119.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-18T14:46:11.900 INFO:teuthology.orchestra.run.smithi134.stdout: remote refid st t when poll reach delay offset jitter 2024-04-18T14:46:11.900 INFO:teuthology.orchestra.run.smithi134.stdout:============================================================================== 2024-04-18T14:46:11.900 INFO:teuthology.orchestra.run.smithi134.stdout:+hv01.front.sepi 67.205.162.81 3 u 65 64 77 0.092 -7.457 4.325 2024-04-18T14:46:11.900 INFO:teuthology.orchestra.run.smithi134.stdout:*hv02.front.sepi 63.231.80.2 3 u 7 64 177 0.111 -1.347 4.781 2024-04-18T14:46:11.900 INFO:teuthology.orchestra.run.smithi134.stdout:+hv03.front.sepi 74.6.168.72 3 u 67 64 77 0.080 +4.086 3.853 2024-04-18T14:46:11.901 INFO:teuthology.orchestra.run.smithi134.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-18T14:46:11.901 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-04-18T14:46:11.910 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-04-18T14:46:11.911 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-04-18T14:46:11.925 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-04-18T14:46:11.939 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-04-18T14:46:11.955 INFO:teuthology.task.internal:Duration was 838.355494 seconds 2024-04-18T14:46:11.956 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-04-18T14:46:11.971 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-04-18T14:46:11.971 DEBUG:teuthology.orchestra.run.smithi086:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-04-18T14:46:11.974 DEBUG:teuthology.orchestra.run.smithi096:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-04-18T14:46:11.976 DEBUG:teuthology.orchestra.run.smithi119:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-04-18T14:46:11.979 DEBUG:teuthology.orchestra.run.smithi134:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-04-18T14:46:12.015 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-04-18T14:46:12.015 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi086.front.sepia.ceph.com 2024-04-18T14:46:12.016 DEBUG:teuthology.orchestra.run.smithi086:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-04-18T14:46:12.061 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi096.front.sepia.ceph.com 2024-04-18T14:46:12.061 DEBUG:teuthology.orchestra.run.smithi096:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-04-18T14:46:12.071 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi119.front.sepia.ceph.com 2024-04-18T14:46:12.071 DEBUG:teuthology.orchestra.run.smithi119:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-04-18T14:46:12.081 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi134.front.sepia.ceph.com 2024-04-18T14:46:12.082 DEBUG:teuthology.orchestra.run.smithi134:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-04-18T14:46:12.091 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-04-18T14:46:12.092 DEBUG:teuthology.orchestra.run.smithi086:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-04-18T14:46:12.106 DEBUG:teuthology.orchestra.run.smithi096:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-04-18T14:46:12.114 DEBUG:teuthology.orchestra.run.smithi119:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-04-18T14:46:12.125 DEBUG:teuthology.orchestra.run.smithi134:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-04-18T14:46:12.161 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-04-18T14:46:12.161 DEBUG:teuthology.orchestra.run.smithi086:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-04-18T14:46:12.174 DEBUG:teuthology.orchestra.run.smithi096:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-04-18T14:46:12.182 DEBUG:teuthology.orchestra.run.smithi119:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-04-18T14:46:12.193 DEBUG:teuthology.orchestra.run.smithi134:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-04-18T14:46:12.259 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-04-18T14:46:12.273 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-04-18T14:46:12.274 DEBUG:teuthology.orchestra.run.smithi086:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-04-18T14:46:12.290 DEBUG:teuthology.orchestra.run.smithi096:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-04-18T14:46:12.300 DEBUG:teuthology.orchestra.run.smithi119:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-04-18T14:46:12.313 DEBUG:teuthology.orchestra.run.smithi134:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-04-18T14:46:12.326 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-04-18T14:46:12.337 DEBUG:teuthology.orchestra.run.smithi086:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-04-18T14:46:12.339 DEBUG:teuthology.orchestra.run.smithi096:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-04-18T14:46:12.342 DEBUG:teuthology.orchestra.run.smithi119:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-04-18T14:46:12.347 INFO:teuthology.orchestra.run.smithi086.stdout:kernel.core_pattern = core 2024-04-18T14:46:12.350 INFO:teuthology.orchestra.run.smithi096.stdout:kernel.core_pattern = core 2024-04-18T14:46:12.358 DEBUG:teuthology.orchestra.run.smithi134:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-04-18T14:46:12.366 INFO:teuthology.orchestra.run.smithi119.stdout:kernel.core_pattern = core 2024-04-18T14:46:12.378 INFO:teuthology.orchestra.run.smithi134.stdout:kernel.core_pattern = core 2024-04-18T14:46:12.466 DEBUG:teuthology.orchestra.run.smithi086:> test -e /home/ubuntu/cephtest/archive/coredump 2024-04-18T14:46:12.471 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-18T14:46:12.471 DEBUG:teuthology.orchestra.run.smithi096:> test -e /home/ubuntu/cephtest/archive/coredump 2024-04-18T14:46:12.476 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-18T14:46:12.476 DEBUG:teuthology.orchestra.run.smithi119:> test -e /home/ubuntu/cephtest/archive/coredump 2024-04-18T14:46:12.496 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-18T14:46:12.496 DEBUG:teuthology.orchestra.run.smithi134:> test -e /home/ubuntu/cephtest/archive/coredump 2024-04-18T14:46:12.513 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-18T14:46:12.513 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-04-18T14:46:12.525 INFO:teuthology.task.internal:Transferring archived files... 2024-04-18T14:46:12.525 DEBUG:teuthology.misc:Transferring archived files from smithi086:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/yuriw-2024-04-18_14:15:21-rados-wip-yuri2-testing-2024-04-17-0823-reef-distro-default-smithi/7662103/remote/smithi086 2024-04-18T14:46:12.525 DEBUG:teuthology.orchestra.run.smithi086:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-04-18T14:46:12.547 DEBUG:teuthology.misc:Transferring archived files from smithi096:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/yuriw-2024-04-18_14:15:21-rados-wip-yuri2-testing-2024-04-17-0823-reef-distro-default-smithi/7662103/remote/smithi096 2024-04-18T14:46:12.547 DEBUG:teuthology.orchestra.run.smithi096:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-04-18T14:46:12.568 DEBUG:teuthology.misc:Transferring archived files from smithi119:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/yuriw-2024-04-18_14:15:21-rados-wip-yuri2-testing-2024-04-17-0823-reef-distro-default-smithi/7662103/remote/smithi119 2024-04-18T14:46:12.568 DEBUG:teuthology.orchestra.run.smithi119:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-04-18T14:46:12.589 DEBUG:teuthology.misc:Transferring archived files from smithi134:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/yuriw-2024-04-18_14:15:21-rados-wip-yuri2-testing-2024-04-17-0823-reef-distro-default-smithi/7662103/remote/smithi134 2024-04-18T14:46:12.589 DEBUG:teuthology.orchestra.run.smithi134:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-04-18T14:46:12.610 INFO:teuthology.task.internal:Removing archive directory... 2024-04-18T14:46:12.610 DEBUG:teuthology.orchestra.run.smithi086:> rm -rf -- /home/ubuntu/cephtest/archive 2024-04-18T14:46:12.613 DEBUG:teuthology.orchestra.run.smithi096:> rm -rf -- /home/ubuntu/cephtest/archive 2024-04-18T14:46:12.615 DEBUG:teuthology.orchestra.run.smithi119:> rm -rf -- /home/ubuntu/cephtest/archive 2024-04-18T14:46:12.634 DEBUG:teuthology.orchestra.run.smithi134:> rm -rf -- /home/ubuntu/cephtest/archive 2024-04-18T14:46:12.653 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-04-18T14:46:12.667 INFO:teuthology.task.internal:Not uploading archives. 2024-04-18T14:46:12.667 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-04-18T14:46:12.786 INFO:teuthology.task.internal:Tidying up after the test... 2024-04-18T14:46:12.786 DEBUG:teuthology.orchestra.run.smithi086:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-04-18T14:46:12.789 DEBUG:teuthology.orchestra.run.smithi096:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-04-18T14:46:12.791 DEBUG:teuthology.orchestra.run.smithi119:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-04-18T14:46:12.793 INFO:teuthology.orchestra.run.smithi086.stdout: 655474 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Apr 18 14:46 /home/ubuntu/cephtest 2024-04-18T14:46:12.793 DEBUG:teuthology.orchestra.run.smithi134:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-04-18T14:46:12.795 INFO:teuthology.orchestra.run.smithi096.stdout: 658466 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Apr 18 14:46 /home/ubuntu/cephtest 2024-04-18T14:46:12.797 INFO:teuthology.orchestra.run.smithi119.stdout: 658639 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Apr 18 14:46 /home/ubuntu/cephtest 2024-04-18T14:46:12.800 INFO:teuthology.orchestra.run.smithi134.stdout: 658469 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Apr 18 14:46 /home/ubuntu/cephtest 2024-04-18T14:46:12.801 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-04-18T14:46:12.812 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-04-18T14:46:12.839 INFO:teuthology.run:Summary data: description: rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/classic msgr-failures/few objectstore/bluestore-stupid rados recovery-overrides/{default} supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} duration: 838.3554940223694 flavor: default owner: scheduled_yuriw@teuthology success: true 2024-04-18T14:46:12.839 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-18T14:46:12.920 INFO:teuthology.run:pass